Arnict Inference

Add open-model inference with the OpenAI SDK. Choose an available model, stream a response, and track your token costs in one dashboard.

Illustrated developer selects an open model, represented by a fine neural lattice, through one app.

Connect once. Build from there.

Choose how you connect

  • OpenAI SDK
  • Node.js
  • Python
  • cURL
  • HTTP API
Choose your approach

From shared models to your own.

Start with serverless inference. Dedicated capacity and custom-model inference are coming soon.

Serverless inference

Available models

Use models marked Available in the catalog. Send requests through one API and pay for the tokens you use.

Dedicated GPU inference

Coming soon

Run a custom model of your choice on dedicated GPU capacity. Pricing and configuration options will be published before launch.

Custom-model serving

Coming soon

Bring your own model or a checkpoint produced with LoRA or full fine-tuning. Deploy it for inference on Arnict when custom serving opens.

Your inference content

Your app keeps the conversation.

Inference prompts and responses are never archived or used for training. Short-lived caches expire automatically. Your dashboard shows request usage and cost without storing conversation text.

Read about privacy →

A request passes through.
Your content doesn’t stay.

Usage ledger

Tokens · latency · status · cost

Integrate

Create an account, get an API key, and choose an available model. Use the OpenAI SDK to send your first request.

  • Stream text as the model responds
  • Create and revoke API keys in your dashboard
  • Review request status, token usage and cost
Read the quickstart

Keep your client. Change the endpoint.

Node.js
import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.arnict.com/v1",
  apiKey: process.env.ARNICT_API_KEY,
});

const completion = await client.chat.completions.create({
  model: process.env.ARNICT_MODEL, // an available model ID from the catalog
  messages: [{ role: "user", content: "Summarize this ticket." }],
  stream: true,
});

for await (const chunk of completion) {
  process.stdout.write(chunk.choices[0]?.delta?.content ?? "");
}
Questions

Yes, for chat completions and streaming. Set the base URL to https://api.arnict.com/v1, use your Arnict key, and choose an available model ID. Other capabilities and optional parameters depend on the model.

Inference content is processed to answer your requests. It is never archived or used for training or advertising. Temporary processing caches are discarded through expiry, eviction or the end of the process that holds them. We retain account and usage metadata needed to provide, secure and bill the service.

Choose a model marked Available in the catalog. Each model page lists its public ID, capabilities, context window, output limit and published rates.

The default is 120 requests per minute per account, shared across its API keys. Account or key settings may lower that limit. Use the rate-limit response headers and Retry-After value to schedule retries.

Confirmed input, cached input and output tokens are charged at the model’s applicable rates. A request with no confirmed usage is not charged. An interrupted response may still have confirmed usage.
Get started

Create an account, choose an available model, and connect your app with an API key.

Illustrated developer selects an open model, represented by a fine neural lattice, through one app.