Skip to main content
At Lyzr, we maintain a model-agnostic philosophy, giving you complete flexibility to choose from a vast library of commercial and open-source models directly within Agent Studio. The core challenge lies in balancing performance with operational constraints. You must view model selection not as choosing the “best” model, but as finding the optimal trade-off between Intelligence (Reasoning, Accuracy) and Efficiency (Cost, Latency).

​
Key Parameters for Model Selection

Every Large Language Model (LLM) decision hinges on these six interconnected metrics:
  1. Cost: The primary driver is token usage (input tokens read + output tokens generated). Top-tier models are significantly more expensive per million tokens than fast, low-latency models.
  2. Latency (Speed): The end-to-end response time (Time to First Token + Time to Last Token). Low latency is non-negotiable for real-time user-facing applications (e.g., chat), while high-intelligence models often require longer “thinking” time for complex reasoning, increasing latency.
  3. Context Size (Memory): Defines how much data (measured in tokens) the model can analyze in a single prompt. This includes the entire conversation history, input documents, and tool schemas. Larger context windows (e.g., 1M+ tokens) are vital for document processing and long-running agentic tasks.
  4. Reasoning & Intelligence: The model’s ability to handle complex logic, multi-step planning, mathematical inference, and synthesizing ideas (Chain-of-Thought). This is the key differentiator for top-tier models.
  5. Web Search & Tool Integration: The model’s inherent ability to access live data (via built-in or external tools) or execute code within a sandboxed environment. This is crucial for agents that need up-to-the-minute information or programmatic execution.
  6. Extra Capabilities (Modality): Features beyond text, such as Multimodal understanding (image, audio, video input) and generation capabilities (Image/Code/Audio output).

​
🧩 Matching Model Type to Use Case

The model choice directly dictates the maximum complexity and speed your Agent can achieve.

​
🧠 When to Use Readymade vs. Bring Your Own Model (BYOM)

Lyzr supports both commercial APIs and your own hosted models, each serving distinct business needs.
💡 Lyzr allows secure BYOM integration, enabling you to connect private, fine-tuned, or open-source model endpoints directly into Agent Studio for data compliance and custom performance.

​
⚠️ The Open Source Model Trade-off

Open source models (like Llama 3, Mistral, Mixtral, Gemma) offer unparalleled control but come with infrastructure complexity.

​
Detailed Provider Strengths & Use Case Mapping

​
🎯 Use Case vs. Model Recommendation Matrix

​
🧭 Pro Tip: Iterative Model Selection

The best practice is always an iterative approach:
  1. Start with the Balanced Tier: Begin with reliable, reasonably priced models like GPT-5 Mini or Claude Sonnet.
  2. Test & Measure: Deploy your Agent and carefully track response quality, latency, and cost for real user queries.
  3. Iterate:
    • If Reasoning/Accuracy is lacking, upgrade to a High Intelligence model (Opus/GPT-5/Gemini Pro).
    • If Latency/Cost is too high, downgrade to a Fast/Low Cost model (Flash/Haiku/Groq).
By rigorously testing these trade-offs, you ensure your Agent delivers the best possible user experience within your budget.