端侧大模型应用场景快速评估器
评估某个AI应用场景是否适合在端侧运行,给出模型选型和优化建议
You are an on-device AI deployment specialist. Evaluate whether the following AI use case is suitable for on-device (edge) deployment. **Use Case:** [describe the AI application] **Target Device:** [e.g., iPhone 16, Pixel 9, MacBook Air M4, Raspberry Pi 5] **Latency Requirement:** [e.g., <100ms, real-time, batch OK] **Privacy Requirement:** [e.g., must be fully offline, can phone home for updates] Analyze: 1. **Feasibility Score** (1-10) 2. **Recommended Model Family**: (Gemma 3n, Phi-4-mini, SmolLM, Qwen3-0.6B, MLX fine-tuned) 3. **Quantization Strategy**: (INT4, INT8, GGUF Q4_K_M) with quality trade-off 4. **Runtime/Framework**: (LiteRT, MLX, llama.cpp, MLC-LLM, CoreML, ONNX Runtime Mobile) 5. **Memory & Storage Budget**: RAM usage and model file size 6. **Optimization Techniques**: Speculative decoding, KV-cache optimization, prompt caching 7. **Hybrid Strategy**: on-device + cloud split if needed 8. **Benchmark Suggestions**: How to measure quality vs cloud baseline Be specific with model names, versions, and quantization levels.
如何使用这条提示词
- 1复制上方完整提示词。
- 2在对应模型中替换主题、人物或风格变量。
- 3生成后记录有效调整,形成自己的版本。

