Skip to main content

LlmClient

meta_language::grammar::inference::advisor

Trait LlmClient 

Source 
pub trait LlmClient: Send + Sync {
    // Required method
    fn complete(&self, prompt: &str) -> Result<String, LlmError>;
}
Expand description

Provider-agnostic LLM boundary for optional inference acceleration.

Required Methods§

Source

fn complete(&self, prompt: &str) -> Result<String, LlmError>

Completes one prompt.

Implementors§