Building Agents with Livepeer

How AI agents use Livepeer inference pipelines: Eliza plugin, LLM provider integration, BYOC containers, and the Agent SPE programme.

---

AI agents running on frameworks like elizaOS need inference compute for image generation, audio transcription, vision tasks, and LLM completions. Livepeer provides that compute through its decentralised GPU network. Agents interact with a gateway endpoint using the same request shape as any other client.

The Agent SPE (Special Purpose Entity), funded by the Livepeer treasury, focuses on integrating Livepeer inference into leading agent frameworks and building tooling for autonomous video agents.

Eliza Plugin

Livepeer is integrated into elizaOS as an image generation provider and an LLM provider. Both integrations ship in the elizaOS core repository.

Image generation provider: merged in elizaOS v0.1.7-alpha.2 (PR #1525, contributed by the Agent SPE). Agents configured with the Livepeer provider route GENERATE_IMAGE actions to a Livepeer gateway endpoint. The provider uses the text-to-image pipeline and returns image URLs that the agent can post, embed, or pass to downstream actions.

Configuration in an Eliza character file:

{
  "imageModelProvider": "livepeer",
  "settings": {
    "imageSettings": {
      "modelId": "ByteDance/SDXL-Lightning",
      "width": 1024,
      "height": 1024
    }
  }
}

Set LIVEPEER_GATEWAY_URL in your environment to point to a gateway. The community gateway at dream-gateway.livepeer.cloud works for development.

LLM provider: Livepeer is also available as an LLM provider in elizaOS (PR #2154). This routes the agent’s language model calls through the Livepeer llm pipeline, which exposes an OpenAI-compatible completions endpoint backed by network orchestrators.

See for a full walkthrough of both integrations.

Using AI Pipelines from Agents

Any agent that can make HTTP requests can call Livepeer AI pipelines directly. The access model is the same as for any other developer: POST to a gateway endpoint, receive a result.

The nine batch pipelines cover the inference tasks most agents need:

See for endpoint shapes and request schemas.

BYOC Containers for Agents

Agents that need custom inference logic (fine-tuned models, proprietary pipelines, or non-standard modalities) can run as BYOC (Bring Your Own Compute) containers registered with a Livepeer orchestrator. The orchestrator handles capability advertisement, job routing, and probabilistic micropayment settlement. The BYOC container only needs to expose an HTTP endpoint matching the pipeline contract.

This pattern suits autonomous agents that process jobs continuously instead of on demand: an agent running a persistent embedding pipeline, a custom vision model, or a specialised audio processor registers once and receives routed jobs as demand arrives on the network.

See for the container interface and registration steps.

Autonomous Streaming Agents

The Agent SPE Phase 2 (funded March 2025, 30,000 LPT) is developing autonomous VTuber agents: AI-driven 3D avatars built on Unreal Engine’s MetaHuman technology that stream live to platforms using Livepeer infrastructure. These agents use Livepeer AI pipelines for real-time video transformation, LLM-driven dialogue, and audio synthesis.

The architecture combines the live-video-to-video pipeline for real-time avatar rendering with the llm pipeline for autonomous response generation and the text-to-speech pipeline for voice output. The Livepeer gateway handles stream routing; the orchestrator network provides the inference compute.

This is the primary production use case for agent-driven live-video-to-video traffic on the network as of 2025.

Agent SPE

The Agent SPE is a Livepeer treasury-funded programme that integrates Livepeer inference into AI agent frameworks and builds tooling for the autonomous agent economy. Phase 1 (funded January 2025) delivered the Eliza image generation and LLM provider integrations. Phase 2 (funded March 2025) focuses on VTuber streaming agents and framework expansion.

The Agent SPE maintains a developer presence in the elizaOS Discord and provides support for builders using Livepeer with agent frameworks. The programme is run by Titan-Node, Phoenix, and DeFine.

The Eliza Livepeer plugin tutorial is the complete walkthrough for building an agent with Livepeer inference. For Storyboard’s agent runtime, see @livepeer/agent.

Related Pages

Eliza Plugin Tutorial

Full walkthrough of the Livepeer image generation and LLM provider integrations in elizaOS.

AI Pipelines

Endpoint shapes and request schemas for all nine batch pipeline types.

BYOC Overview

Run custom inference containers registered with a Livepeer orchestrator.

Real-Time AI

The live-video-to-video pipeline used by streaming agent applications.