LLM provider routing

@livepeer/agent supports four LLM backends: Gemini, Claude, OpenAI, and Livepeer. Swap providers without changing application code.

@livepeer/agent abstracts LLM access behind a provider interface. The AgentRunner accepts any provider that implements the common interface; switching from Gemini to Claude or OpenAI requires changing one import and one constructor argument.

Available providers

The Livepeer provider routes all LLM calls through Livepeer infrastructure with a single Daydream API key from daydream.live. This is the simplest configuration: one key, one provider, all LLM backends available.

Swapping providers

import { AgentRunner, ToolRegistry, WorkingMemoryStore, SessionMemoryStore } from '@livepeer/agent';

// Option 1: Gemini directly
import { GeminiProvider } from '@livepeer/agent/providers/gemini';
const provider = new GeminiProvider({ apiKey: process.env.GEMINI_API_KEY! });

// Option 2: Claude directly
import { ClaudeProvider } from '@livepeer/agent/providers/claude';
const provider = new ClaudeProvider({ apiKey: process.env.ANTHROPIC_API_KEY! });

// Option 3: All LLM calls through Livepeer (single API key)
import { LivepeerProvider } from '@livepeer/agent/providers/livepeer';
const provider = new LivepeerProvider({ apiKey: process.env.DAYDREAM_API_KEY! });

// The runner interface is identical regardless of provider
const runner = new AgentRunner(
  provider,
  new ToolRegistry(),
  new WorkingMemoryStore(),
  new SessionMemoryStore(),
);

const result = await runner.run({ user: 'generate an image of a mountain' });

The AgentRunner calls provider.complete() internally. Each provider translates the common message format to its backend’s native API shape. Tool calls, working memory, and session memory work identically across all providers.

CLI provider selection

The CLI reads the provider from environment variables. Set the API key for the provider you want to use:

# Gemini (default if GEMINI_API_KEY is set)
export GEMINI_API_KEY=your-key
livepeer run flux-schnell --prompt "a mountain at dawn"

# Claude
export ANTHROPIC_API_KEY=your-key
livepeer run flux-schnell --prompt "a mountain at dawn"

# Livepeer (all backends via single key)
export DAYDREAM_API_KEY=sk_live_xxx
livepeer run flux-schnell --prompt "a mountain at dawn"

If multiple API keys are set, the CLI uses this precedence: DAYDREAM_API_KEY > GEMINI_API_KEY > ANTHROPIC_API_KEY > OPENAI_API_KEY.

Source: livepeer/storyboard packages/agent/README.md.

The Agent SDK page covers the full AgentRunner API, MCP server mode, and CLI verb reference.