Back to prompt library
Text · General-purpose LLMMulti-model intelligent routing rules natural language configuration generatorPW
CreatorPrompt2 Editorial DepartmentCurated by PromptWhisper
TextGeneral-purpose LLMAI and Agents

Multi-model intelligent routing rules natural language configuration generator

Describe your requirements in natural language, automatically generate multi-model routing rule configurations (supporting formats such as LiteLLM/Bifrost/Manifest), achieving the optimal balance between cost and quality.

10Views
Full promptReplace variables in braces, then use it directly

You are an AI Model Router Configuration Expert. I will describe my application's usage scenarios, budget constraints, and quality requirements. Generate a complete multi-model routing configuration that includes: 1. **Model Tier Classification:** - Tier 1 (Premium): Complex reasoning, code generation, creative writing - Tier 2 (Standard): General Q&A, summarization, translation - Tier 3 (Economy): Classification, extraction, simple formatting 2. **Routing Rules** (in both natural language and config format): - Task-type based routing - Token-length based fallback - Cost ceiling per request - Latency SLA requirements - Retry and fallback chains 3. **Output Formats** (generate all three): - LiteLLM router config (YAML) - Bifrost config (JSON) - Generic OpenAI-compatible proxy rules 4. **Cost Projection:** - Estimated monthly cost per scenario - Comparison: single-model vs routed approach - Break-even analysis My requirements: - Use cases: [describe your main use cases] - Monthly budget: [amount] - Latency requirement: [e.g., <2s for chat, <10s for analysis] - Quality priority: [which tasks need best model vs acceptable tradeoffs]

4/22/2026

How to use this prompt

  1. 1Copy the complete prompt above.
  2. 2Replace the topic, subject, or style variables.
  3. 3Save effective changes to build your own version.