# LLM筛选质量测试报告 **测试时间**: 2025-11-18T08:10:57.409Z **测试模型**: deepseek-chat + qwen-max **测试样本数**: 10 --- ## 质量指标 | 指标 | 实际值 | 目标值 | 状态 | |------|--------|--------|------| | 准确率 | 60.0% | ≥85% | ❌ | | 一致率 | 70.0% | ≥80% | ❌ | | 平均置信度 | 0.95 | - | - | | 需人工复核率 | 30.0% | ≤20% | ❌ | --- ## 混淆矩阵 ``` 预测纳入 预测排除 不确定 实际纳入 2 1 - 实际排除 0 4 - 不确定 - - 0 ``` --- ## 详细结果 ### 1. test-001 **标题**: Efficacy and Safety of Empagliflozin in Patients with Type 2 Diabetes: A Randomized, Double-Blind, Placebo-Controlled Trial **期望决策**: include **实际决策**: exclude **结果**: ❌ 错误 **一致性**: ✅ 一致 **平均置信度**: 0.93 **处理时间**: 11935ms **需人工复核**: 否 **DeepSeek结论**: exclude (置信度: 0.90) **Qwen结论**: exclude (置信度: 0.95) ### 2. test-002 **标题**: Cardiovascular Outcomes with Ertugliflozin in Type 2 Diabetes **期望决策**: include **实际决策**: include **结果**: ✅ 正确 **一致性**: ✅ 一致 **平均置信度**: 0.95 **处理时间**: 13225ms **需人工复核**: 否 **DeepSeek结论**: include (置信度: 0.95) **Qwen结论**: include (置信度: 0.95) ### 3. test-003 **标题**: Systematic Review and Meta-Analysis of SGLT2 Inhibitors in Type 2 Diabetes: A Comprehensive Assessment **期望决策**: exclude **实际决策**: exclude **结果**: ✅ 正确 **一致性**: ✅ 一致 **平均置信度**: 0.95 **处理时间**: 10683ms **需人工复核**: 否 **DeepSeek结论**: exclude (置信度: 0.95) **Qwen结论**: exclude (置信度: 0.95) ### 4. test-004 **标题**: Dapagliflozin Improves Cardiac Function in Diabetic Rats: An Experimental Study **期望决策**: exclude **实际决策**: exclude **结果**: ✅ 正确 **一致性**: ✅ 一致 **平均置信度**: 0.95 **处理时间**: 13067ms **需人工复核**: 否 **DeepSeek结论**: exclude (置信度: 0.95) **Qwen结论**: exclude (置信度: 0.95) ### 5. test-005 **标题**: Canagliflozin and Renal Outcomes in Type 2 Diabetes and Nephropathy **期望决策**: include **实际决策**: include **结果**: ✅ 正确 **一致性**: ✅ 一致 **平均置信度**: 0.95 **处理时间**: 12352ms **需人工复核**: 否 **DeepSeek结论**: include (置信度: 0.95) **Qwen结论**: include (置信度: 0.95) ### 6. test-006 **标题**: Real-World Experience with SGLT2 Inhibitors: A Retrospective Cohort Study **期望决策**: exclude **实际决策**: exclude **结果**: ✅ 正确 **一致性**: ✅ 一致 **平均置信度**: 0.95 **处理时间**: 11690ms **需人工复核**: 否 **DeepSeek结论**: exclude (置信度: 0.95) **Qwen结论**: exclude (置信度: 0.95) ### 7. test-007 **标题**: Pharmacokinetics and Pharmacodynamics of Empagliflozin in Healthy Volunteers **期望决策**: exclude **实际决策**: pending **结果**: ❌ 错误 **一致性**: ❌ 冲突 **平均置信度**: 0.95 **处理时间**: 14253ms **需人工复核**: 是 **DeepSeek结论**: exclude (置信度: 0.95) **Qwen结论**: exclude (置信度: 0.95) ### 8. test-008 **标题**: Comparative Effectiveness of SGLT2 Inhibitors versus DPP-4 Inhibitors in Elderly Patients with Type 2 Diabetes **期望决策**: exclude **实际决策**: pending **结果**: ❌ 错误 **一致性**: ❌ 冲突 **平均置信度**: 0.95 **处理时间**: 12808ms **需人工复核**: 是 **DeepSeek结论**: exclude (置信度: 0.95) **Qwen结论**: exclude (置信度: 0.95) ### 9. test-009 **标题**: Severe Diabetic Ketoacidosis Associated with SGLT2 Inhibitor Use: A Case Report **期望决策**: exclude **实际决策**: exclude **结果**: ✅ 正确 **一致性**: ✅ 一致 **平均置信度**: 0.95 **处理时间**: 12092ms **需人工复核**: 否 **DeepSeek结论**: exclude (置信度: 0.95) **Qwen结论**: exclude (置信度: 0.95) ### 10. test-010 **标题**: Effect of Sotagliflozin on Cardiovascular and Renal Events in Patients with Type 2 Diabetes and Moderate Renal Impairment **期望决策**: uncertain **实际决策**: pending **结果**: ❌ 错误 **一致性**: ❌ 冲突 **平均置信度**: 0.95 **处理时间**: 13503ms **需人工复核**: 是 **DeepSeek结论**: exclude (置信度: 0.95) **Qwen结论**: include (置信度: 0.95) --- **生成时间**: 2025-11-18T08:10:57.409Z