针对目前几款 SOTA LLMs 的蒸馏痕迹探讨

测试工具:Ichigo Bot ,一款 LLM API 聚合 Telegram 聊天机器人(✨GitHub:https://github.com/rewired-gh/ichigo-bot) 系统提示词:略;温度:0.2 ;测试提示词:Good morning 提示词非常简单,也是最常见的提示词之一。这是为了避免变成智商测试。以下是 LLMs 的回复。 GPT-4o (基准):Good morning! ☀️ How can I assist you today? 😊 以下为几乎确定是蒸馏的模型( https://github.com/Aegis1863/LLMs-Distillation-Quantification )。 Qwen Max:Good morning! 🌞 How can I assist you today? DeepSeek R1:Good morning! 🌞 How can I assist you today? 以下为暂无蒸馏证据的模型。 o3-mini:Good morning! I'm Ichigo (いちご 🍓). I hope your day is off to a great start. How can I assist you today? Gemini 2.0 Flash Thinking:Good morning to you too! ☀️ Hope you have a wonderful day ahead! 😊 Is there anything I can help you with this morning? 豆包 1.5 Pro:Good morning! It's a great start to the day. What exciting things do you have planned? 结论:对于洁癖而言,不建议使用几款蒸馏的模型。