Models & Providers

Switch providers by changing one line — your agent definition stays the same.

Supported Providers

Provider	Example	Env Var
Anthropic	`anthropic:claude-sonnet-4-6`	`ANTHROPIC_API_KEY`
OpenAI	`openai:gpt-4o`	`OPENAI_API_KEY`
Google	`google:gemini-2.0-flash-001`	`GOOGLE_API_KEY`
Groq	`groq:llama-3.3-70b-versatile`	`GROQ_API_KEY`
xAI	`xai:grok-2-1212`	`XAI_API_KEY`
Mistral	`mistral:mistral-large-latest`	`MISTRAL_API_KEY`
OpenRouter	`openrouter:anthropic/claude-3.5-sonnet`	`OPENROUTER_API_KEY`
Cerebras	`cerebras:llama3.1-70b`	`CEREBRAS_API_KEY`
DeepSeek	`deepseek:deepseek-chat`	`DEEPSEEK_API_KEY`
Amazon Bedrock	`amazon-bedrock:anthropic.claude-3-sonnet`	AWS credentials
Google Vertex	`google-vertex:gemini-2.5-flash`	GCP ADC
Azure OpenAI	`azure-openai-responses:gpt-4o`	`AZURE_OPENAI_API_KEY`

For provider-specific credentials — Azure OpenAI, Amazon Bedrock, Google Vertex AI, and Cloudflare Workers AI all take extra environment variables beyond a single API key. See Environment Variables for the full list.

Model Resolution Order

When multiple model sources are configured, GitAgent resolves the active model in this priority order:

Environment config model_override — from config/<env>.yaml
CLI flag --model provider:model-id — passed at runtime
agent.yaml model.preferred — defined in the agent repo

Custom / OpenAI-Compatible Endpoints

Any OpenAI-compatible endpoint works — point GitAgent at it inline, via an environment variable, or in agent.yaml.

# Inline URL
gitagent --model "ollama:llama3@http://localhost:11434/v1" --voice --dir ~/assistant

# Environment variable
export GITAGENT_MODEL_BASE_URL=http://localhost:11434/v1
gitagent --model "ollama:llama3" --voice --dir ~/assistant

# In agent.yaml
model:
  preferred: "custom:my-model@https://my-proxy.com/v1"

Compatible endpoints: Ollama (:11434), LM Studio (:1234), vLLM (:8000), LiteLLM (:4000), Lyzr AI Studio, and any other OpenAI-compatible proxy.

Lyzr AI Studio Integration

Connect to Lyzr’s managed agent infrastructure. Your agent runs on Lyzr’s servers with full observability.

Via installer (easiest) — Run the interactive installer and select Lyzr when prompted
Via CLI flag — gitagent --model "lyzr:<AGENT_ID>@https://agent-prod.studio.lyzr.ai/v4" --dir ~/assistant
Via SDK — Use the query() function with a lyzr: model string (see example below)

// sdk-example.ts
import { query } from "@open-gitagent/gitagent";

const result = query({
  prompt: "Hello! What can you help me with?",
  dir: "/path/to/agent",
  model: `lyzr:${LYZR_AGENT_ID}@https://agent-prod.studio.lyzr.ai/v4`,
  constraints: { temperature: 0.7, maxTokens: 2000 },
});
for await (const msg of result) {
  if (msg.type === "assistant") console.log(msg.content);
}

Environment Variables

Full list of provider API keys and runtime config variables

Overview

See how model configuration fits into the wider GitAgent architecture

SDK Reference

Pass model strings and constraints to query()

Observability

Track token usage and cost per model via OpenTelemetry

Getting Started

SDK

Personal Assistant

Configuration

Capabilities

Data & Integrations

Enterprise

Models & Providers

Supported Providers

Model Resolution Order

Custom / OpenAI-Compatible Endpoints

Lyzr AI Studio Integration

Environment Variables

Overview

SDK Reference

Observability

​Supported Providers

​Model Resolution Order

​Custom / OpenAI-Compatible Endpoints

​Lyzr AI Studio Integration

Environment Variables

Overview

SDK Reference

Observability

Supported Providers

Model Resolution Order

Custom / OpenAI-Compatible Endpoints

Lyzr AI Studio Integration