Chat Model
The Chat Model is the primary AI engine that handles your conversations and reasoning tasks. This configuration is crucial for determining your agent’s intelligence, response quality, and reasoning capabilities.
Define which AI models power your agent’s capabilities across different functions.
Provider and Model Selection
Select your preferred AI provider (OpenAI, Anthropic, Google, etc.) and specify the exact model name for primary chat interactions.
Context Window Configuration
- Configure the context window size
- Allocate what portion goes to chat history versus system prompts
Advanced Features
- Enable vision capabilities for models that support image understanding
- Set rate limits for requests and tokens to manage API costs
- Add custom LiteLLM parameters in KEY=VALUE format to fine-tune temperature and other behaviors
Last updated on