Guide · Technical · Model orchestration

Building a multi-modal AI infrastructure. Stop asking which model is best. Use the right one for each job, automatically.

You wouldn't ask which tool in a toolbox is best, so don't bet your business on a single AI model. This is how nBrain builds infrastructure that uses GPT-6 Astra, Claude Opus 5.5, Gemini 4 Argon, and open-weight models together, with an orchestrator that picks the right one for every task.

See how the orchestrator works
Model-agnostic by design 65% lower cost per AI task through routing Sensitive work can stay on private models
Your private AI platform
User intent"Analyze this 50-page contract and summarize the key terms."
nBrain

Agent orchestrator

ComplexityContext lengthTask typeSpeedAccuracyPrivacy
GPT-6 AstraReasoning
Claude Opus 5.5Long analysis
Gemini 4 ArgonMulti-modal
Open-weightPrivate, local
+ Document parsing+ Knowledge search+ CRM / email / drive+ Code sandbox
Select the model, attach the tools, return the answer with citations

Routing is one reason the platform pays for itself. Results from nBrain clients:

65%
lower cost per AI task, because the orchestrator sends each task to the right model
92%
less sales-team time on RFQs at Regal Technology Partners, a Tier 2 defense manufacturer
5 months
from first idea to a Brain built and launched across a 200-person manufacturer
33.5%
average increase in employee productivity within six months

Regal Technology Partners has shared its story publicly. Other results are anonymized to protect client confidentiality. Read the customer stories

The key insight

"Which LLM is best?" is the wrong question.

"The discussion around which LLM is best is a meaningless discussion. It would be like arguing what the best tool in your toolbox is. They all have reasons to be part of your AI infrastructure. Some are better at coding, some are better at creative work. Some are cheaper, faster, and some have higher or lower token limits. To get the most out of AI, you need to use all of them."
"The good news: when you control what you are doing with AI privately, you don't need to make the decision. We take it another level and let our agent orchestrator decide. AI knows which tool to pick for the job."
The nBrain philosophy
The problem

Why single-model setups fall short.

Relying on one AI model is like building a house with only a hammer. Each model has strengths and weaknesses that make it right for some tasks and wrong for others.

Limited capabilities

No single model is best at everything. One is the stronger generalist, another is better at long, careful reasoning and code review, and another handles very long documents and images more comfortably.

Inefficient costs

Sending simple tasks to a premium model is like hiring a neurosurgeon to put on a bandage. You pay for capability the job doesn't need.

Performance trade-offs

The most powerful models are slower and cost more. Simple queries don't need them, but choosing the right model by hand for every task isn't practical.

Vendor lock-in

Committing to one provider leaves you at its mercy on pricing, availability, and release schedule. Real control needs the freedom to switch.

Token limits

Models have different context windows. A very large window is overkill for a quick question but essential when you're analyzing a long document.

Specialized tasks

Vision work needs a vision-capable model. Code generation, creative writing, and data analysis each favor different models.

Understanding the landscape

Every model has its purpose.

A carpenter needs different tools for different jobs. A working AI infrastructure needs different models for different tasks, and the freedom to add new ones as they ship.

C

Claude Opus 5.5

Anthropic

Strong at complex reasoning, nuanced judgment, careful long-form writing, and detailed code review, with conservative safety guardrails.

Complex reasoningCode reviewLong contextCareful writing
G

GPT-6 Astra

OpenAI

The versatile generalist: strong across a wide range of tasks, good at orchestration and code, with a large tool and integration ecosystem.

VersatileCreative writingOrchestrationLarge ecosystem
G

Gemini 4 Argon

Google

Handles very long contexts and mixed inputs well: document analysis, research, images and video, and Google-native workflows.

Long contextMulti-modalDocument analysisFast tiers
L

Llama

Meta · open-weight

Open-weight models you can run privately on your own hardware: full customization and no per-call API fees at scale.

Open-weightSelf-hostedCost-effectivePrivacy control
M

Mistral and Qwen

Open-weight

Efficient models with a strong performance-to-cost ratio, well suited to high-volume production work. Mistral is EU-based.

Cost-efficientFastHigh volumePrivate deploy
+

Specialized models

Task-specific

Vision models, embedding models for search, transcription (Whisper), image and voice models, and task-specific fine-tuned models where the job calls for one.

VisionEmbeddingsTranscriptionDomain-specific
Technical architecture

How the orchestrator works.

At the center of every nBrain platform is an orchestrator that reads each request and routes it to the best model for that task. Here is what happens under the hood.

Input

User query

"Analyze this 50-page contract and summarize the key terms."

Step 1

Orchestrator analysis

Weighs complexity, context length, task type, and performance requirements.

Step 2

Task classification

Long document + legal analysis + high accuracy required.

Step 3

Model selection

Routes to Gemini 4 Argon for its long context window.

+
Step 4

Tool assembly

Attaches document parsing and summarization tools.

Output

Execution and response

Runs the request and returns a formatted summary with citations.

Simplified orchestrator logic
// Simplified orchestrator logic
async processQuery(userQuery) {
  // Step 1: Analyze the request
  const analysis = await this.analyzeQuery(userQuery);

  // Step 2: Classify task requirements
  const requirements = {
    complexity: analysis.complexity,      // simple | medium | complex
    contextLength: analysis.tokenCount,   // in tokens
    taskType: analysis.category,          // code | creative | analysis
    speedPriority: analysis.urgency,      // low | medium | high
    accuracyNeeds: analysis.criticalness  // standard | high | critical
  };

  // Step 3: Select optimal model
  const model = await this.selectModel(requirements);

  // Step 4: Route and execute
  const response = await model.execute(userQuery, {
    tools: this.getRelevantTools(requirements),
    temperature: this.getOptimalTemperature(requirements),
    maxTokens: this.calculateMaxTokens(requirements)
  });

  return response;
}
The process

Six steps to choosing the right model, every time.

Every query runs through an analysis pipeline that makes sure the right model handles each task, and gets better with use.

Step 01

Query analysis

The orchestrator works out what's being asked and what it will take to answer.

  • Token count estimate: how long is the input?
  • Task type: code, creative, analysis, and so on
  • Complexity: a simple question or multi-step reasoning
  • Context needs: does it need conversation history?
  • Output format: JSON, markdown, code, or prose
Step 02

Requirements mapping

From that analysis, it defines what the ideal model for this request looks like.

  • Speed versus quality trade-off
  • Cost constraints
  • Special capabilities: vision, code execution, and so on
  • Accuracy needs: critical or exploratory work
  • Privacy and compliance needs
Step 03

Model selection

It scores the available models against those requirements and picks the best fit.

  • Capability match for this task type
  • Context window check: can it handle the input?
  • Weighted score for speed, accuracy, and cost
  • Availability: is the model reachable right now?
  • Fallback ready if the primary fails
Step 04

Tool assembly

It prepares the tools, functions, and integrations the model will need.

  • Database query tools for relevant data
  • Connectors: Gmail, Google Drive, CRM, and more
  • Code sandboxes (Python, JavaScript)
  • Vector search for knowledge retrieval (RAG)
  • Document processing: PDF parsing, OCR
Step 05

Execution and monitoring

The request runs with live monitoring to keep quality up and catch errors.

  • Streaming responses for a faster feel
  • Token tracking for cost management
  • Error detection and automatic retries
  • Response quality checks
  • Performance metrics collected
Step 06

Learning and optimization

Every interaction feeds back in, so model selection improves over time.

  • Success and failure tracked by model and task type
  • Cost efficiency analysis
  • User satisfaction signals
  • Routing rules refined from outcomes
  • Benchmarking and A/B tests
In practice

Real-world routing examples.

How the orchestrator decides for different kinds of requests.

User requestModel selectedReasoning
"What's the weather like?"Llama (local)Simple query with no complex reasoning. A fast local model keeps cost near zero and answers instantly.
"Debug this React component and explain the issue"Claude Opus 5.5Complex code analysis that needs careful reasoning and a detailed explanation.
"Analyze this 200-page market research PDF"Gemini 4 ArgonNeeds a very large context window, so the whole document is read without truncation.
"Write a creative story about a space explorer"GPT-6 AstraA creative writing task where a strong generalist shines.
"What's in this image?"GPT-6 Astra or Gemini 4 ArgonA vision task needs a multi-modal model for detailed image analysis.
"Analyze Q3 financials and predict Q4 trends"Claude Opus 5.5Reasoning over structured data, spotting trends, and forecasting.
"Summarize today's emails" (100+ emails)Gemini 3.8 FlashHigh volume with long context. A fast tier keeps speed up and cost down.
"Generate SQL to find inactive customers"Claude Opus 5.5Precise code generation that has to understand the business logic behind it.

Model assignments are illustrative. Routing is tuned to each client's work, data rules, and budget, and changes as new models ship.

Scenario

Building a marketing campaign

User: "Help me create a marketing campaign for our new product launch."

Orchestrator decision: a multi-model approach.

  • GPT-6 AstraGenerates creative campaign concepts and messaging.
  • Claude Opus 5.5Analyzes competitor campaigns and develops strategic recommendations.
  • LlamaProduces dozens of social post variations quickly and cheaply.
  • Gemini 4 ArgonResearches market trends from the industry reports you upload.

Result: each model contributes what it does best, so the campaign comes together faster and better than any single model could manage alone.

The advantages

Why multi-model infrastructure wins.

Orchestration pays off across performance, cost, reliability, and how fast you can adopt what's new.

Better performance

Every task is handled by the model that's best at that job, so results stay consistently high quality.

Lower cost

Simple queries go to cheaper models and complex ones to premium models. Our clients see 65% lower cost per AI task through routing.

Built-in redundancy

If one model is down or rate-limited, the orchestrator fails over to an alternative. No single point of failure.

Privacy control

Sensitive data goes to private, self-hosted models; non-sensitive work can use cloud models. You decide which data goes where.

Keeps up with new models

New models ship constantly. Add them to the pool and the orchestrator evaluates when to use them, with no architecture changes.

Continuous improvement

The system learns from every interaction and gets better at matching models to tasks over time.

Specialized capabilities

Vision, code generation, embeddings, and other specialist models are there when needed, without juggling separate tools.

No vendor lock-in

Your business logic doesn't depend on any one provider. Switch models, add providers, or negotiate better terms whenever you want.

Easy experimentation

Test new models on a slice of traffic, A/B test approaches, and decide based on real performance data.

Build it yourself

The roadmap to multi-model infrastructure.

Want to build this in-house? Here is the step-by-step path to your own model orchestration system.

Phase 1 · Foundation

Core infrastructure

  • API connections to multiple model providers (OpenAI, Anthropic, Google, and others)
  • A unified interface layer that hides provider differences
  • Request and response handling with error management
  • Token counting and cost tracking
  • Logging and monitoring
  • Managed secrets for API keys
Phase 2 · Intelligence

Smart routing engine

  • Query analysis that classifies request types
  • A capability map of what each model does well
  • Decision logic for model selection by task
  • Context length detection and handling
  • A complexity scoring algorithm
  • Fallback chains for redundancy
Phase 3 · Orchestration

Agents and tools

  • A tool registry (databases, APIs, and more)
  • Dynamic tool selection per query
  • An execution pipeline that coordinates model and tools
  • Streaming responses for real-time feedback
  • Multi-step workflows for complex tasks
  • Conversation memory and context management
Phase 4 · Optimization

Performance and cost

  • Caching for repeated queries
  • Cost rules that use cheaper models when they'll do
  • Rate limiting and quota management
  • Performance benchmarking and comparison
  • A/B testing for model evaluation
  • Alerting on anomalies and failures
Phase 5 · Knowledge

Vector database and RAG

  • A vector database (Pinecone, Weaviate, Qdrant, or pgvector)
  • An embedding generation pipeline
  • Semantic search and retrieval
  • Document ingestion and chunking
  • Citation and source tracking
  • Hybrid search (vector plus keyword)
Phase 6 · Enterprise

Security and scale

  • Authentication and authorization layers
  • Audit logging for compliance
  • Privacy controls: data handling and retention
  • Multi-tenant isolation
  • Self-hosting for sensitive workloads
  • Horizontal scaling and load balancing
Phase 7 · Learning

Continuous improvement

  • A feedback loop that tracks model performance
  • Learned routing based on outcomes
  • An automated model evaluation pipeline
  • User satisfaction tracking
  • Automatic retraining of routing logic
  • Drift detection for degrading models
Phase 8 · Advanced

Advanced capabilities

  • Vision models for image analysis
  • Code execution sandboxes
  • A fine-tuning pipeline for custom models
  • Multi-agent collaboration
  • Reasoning techniques (chain-of-thought, tree-of-thought)
  • Self-improvement and meta-learning
Building it from scratchIndustry estimate: typically 6–12 months with a team of 3–5 experienced AI engineers, costing $300K–$600K.
The nBrain approachWe've built, tested, and tuned this infrastructure so you don't have to. Builds start at $40,000, and a typical build takes about 3 months. Running costs for your own cloud and model accounts are billed direct at list price, with no markup.
Key technical stack
The bottom line

Why this matters for your business.

The companies getting real value from AI aren't asking "which model should we use?" They're building infrastructure that uses the right model for each job, automatically.

Think of it like electricity. You don't decide between coal and solar each time you flip a switch; the grid sources power from whatever makes sense at that moment. Your AI infrastructure should work the same way.

This isn't theoretical. It's how nBrain's platform works today, , with orchestration that keeps learning and improving.

The debate over "the best AI model" is over. The answer is all of them, used well.

  • Better results. Each task handled by the model that's best at it.
  • Lower costs. 65% lower cost per AI task through routing and model selection.
  • Keeps up with AI. New models plug in without architecture changes.
  • No vendor lock-in. Freedom to switch providers and negotiate pricing.
  • Privacy control. Sensitive data stays on your infrastructure; non-sensitive work can use cloud models.
  • Reliability. Automatic failover keeps work moving when an individual model has issues.
Ready to build?

Put every model to work on your business, privately.

Whether you build it yourself from the roadmap or have nBrain build and run it for you, one strategy session shows where model routing and a Centralized AI Brain would pay off first.

Book a strategy session

Prefer email? hello@nbrain.ai