CASE EVIDENCE / A RECORD
Shopify (Shopify/reasonableai) 公开的真实任务执行案例，来源为 公开代码库，复核于 2026-06-27T05:40:00Z。
原始记录：Shopify ReasonableAI benchmarks DeepSeek LLM 67B Chat for query classification in customer support
Chinese Brief
Shopify (Shopify/reasonableai) 公开的真实任务执行案例，来源为 公开代码库，复核于 2026-06-27T05:40:00Z。 Model Atlas 将它标记为 A 类证据，因为它同时具备具体使用者、具体任务、公开原始证据和可访问产物。 Model Atlas 不把 benchmark、教程、发布说明或集合页包装成真实案例。
任务
这是一个围绕真实任务执行的真实任务，公开材料可以回溯到具体使用者和具体产物。 原始资料写作：Shopify's ReasonableAI team benchmarked deepseek-llm:67b-chat (via Ollama) alongside mistral:latest, mixtral:latest, and llama2:13b on query classification prompts for customer support routing. Each model was run 5 time…
公开材料提供公开代码、README 或项目配置，可用于核验任务结果、项目形态和模型绑定关系。 原始资料写作：All four models returned the same and consistent classification results across 5 runs with 0.0 temperature. Mistral achieved the best overall performance on the classification task, but DeepSeek LLM 67B Chat demonstrate…
DeepSeek LLM 67B Chat 在该案例中承担真实任务执行相关的生成、分析、编排或实现角色。 原始资料写作：DeepSeek LLM 67B Chat provided deterministic, consistent query classification outputs across multiple runs, validating its suitability as a candidate for production customer support routing at Shopify. The evaluation sh…
当前判断基于公开材料；若产物下线、仓库变更或模型参与比例仅来自作者自述，需要在引用前重新复核。 原始资料写作：Benchmarking-only (not confirmed production deployment); evaluation was internal to Shopify ReasonableAI team; specific classification accuracy scores not publicly disclosed in the issue.