我是 flutter_gemma 的创建者和维护者——这是一个用于在移动设备上本地运行 LLM 的 Flutter 插件。我越是使用设备端 AI，就越发确信：未来属于本地代理，或者至少是混合代理。
博客还附上了安全警告：非法蒸馏出来的模型可能缺失原模型的安全护栏，一旦被用于网络攻击、生物武器研发或大规模监控，后果难以预测。，推荐阅读服务器推荐获取更多信息
Initially I aimed to test with at least 10 formulas for each model for SAT/UNSAT, but it turned out to be more expensive than I expected, so I tested ~5 formulas for each case/model. First, I used the openrouter API to automate the process, but I experienced response stops in the middle due to long reasoning process, so I reverted to using the chat interface (I don't if this was a problem from the model provider or if it's an openrouter issue). For this reason I don't have standard outputs for each testing, but I linked to the output for each case I mentioned in results.。同城约会对此有专业解读
Continue reading...