Struct LlmAgent 

pub struct LlmAgent { /* private fields */ }

An Agent that answers with an OpenAI-compatible model, and can call one tool on the way.

let agent = LlmAgent::from_env().expect("AG_UI_LLM_API_KEY");
let app: axum::Router = axum::Router::new().route_agui("/agent", agent);

Implementations

impl LlmAgent

pub fn new( base_url: impl Into<String>, model: impl Into<String>, api_key: Option<String>, ) -> Self

An agent pointed at base_url, talking to model.

api_key is None for an endpoint that wants no credential, which is the usual case for a model served on localhost.

pub fn from_env() -> Result<Self, MissingApiKey>

An agent configured from the environment.

Variable	Default
BASE_URL_ENV	DEFAULT_BASE_URL
MODEL_ENV	DEFAULT_MODEL
API_KEY_ENV, then FALLBACK_API_KEY_ENV	none

Errors

MissingApiKey when no key is set and the endpoint is the default one, which needs one. A custom BASE_URL_ENV is taken to mean a server the caller runs, so a missing key there is not an error — it is sent as absent.

pub fn model(self, model: impl Into<String>) -> Self

Talks to a different model.

pub fn model_name(&self) -> &str

The model this agent is pointed at.

pub fn base_url(&self) -> &str

The endpoint this agent is pointed at. Carries no credential — the key is a header.

Trait Implementations

impl Agent for LlmAgent

type State = ()

The run’s shared state, deserialized from RunAgentInput::state and published through RunContext::set_state.

async fn run(&self, ctx: &mut RunContext<()>) -> Result<RunOutcome>

Serves one run.

impl Debug for LlmAgent

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Redacts the key. A #[derive(Debug)] here would put it in the first log line that formats a router.