CosmicAC Logo

Welcome

A self-hosted platform for running GPU workloads. Create GPU Container Jobs and serve open-source language models on your own Kubernetes cluster.

CosmicAC is a self-hosted platform for running GPU workloads. You deploy it on your own host machine, and it runs GPU Container Jobs and serves open-source language models on your Kubernetes cluster.

CosmicAC job types

CosmicAC runs two kinds of job. Choose the one that fits your task.

GPU Container Job

An isolated GPU machine you work on like a remote computer, with shell access.

Managed Inference

An OpenAI-compatible API that serves open-source language models.

Get started

Deploy CosmicAC, then install the CLI.

Installation

Deploy CosmicAC to run GPU workloads on your Kubernetes cluster.

Install the CLI

Install the CosmicAC CLI to interact with CosmicAC from your terminal.

Once you have CosmicAC running, start here.

Create a GPU Container Job

Launch your first GPU Container and open a shell into it.

Get a Managed Inference API key

Create a key and send your first chat-completion request.

Learn the concepts

Understand how CosmicAC runs jobs and serves models on your cluster.

Architecture

How CosmicAC connects to your cluster and runs each job type.

GPU Container Job

What a GPU Container Job is and when to use one.

Managed Inference

What a Managed Inference Job is and when to use one.

Guides

Follow hands-on guides to run jobs and operate your deployment.

GPU Container guides

Create, access, and work with GPU Container Jobs.

Managed Inference guides

Connect a client to Managed Inference and send requests.

Operations

Monitor, scale, upgrade, back up, and troubleshoot your deployment.

Reference

Look up commands, configuration options, and release details.

CLI commands

Every CosmicAC CLI command, with usage and examples.

Configuration reference

Every platform and job configuration option.

Release notes

What changed in each release.

Installation

Next Page

On this page

CosmicAC job typesGet startedLearn the conceptsGuidesReference