investigation

When the test-difficulty examples are replaced with a mixture of easier examples, Qwen jumps to 91.6% and Llama to 98.6%, while the test remains at exactly the same difficulty level.

A investigation by המחברים. Statements are as reported by the cited publishers — not verified by DecisionGateway.

אבל כשהם מחליפים את הדוגמאות ברמת הקושי של הטסט בתערובת של דוגמאות קלות יותר, Qwen קופץ ל-91.6% ו-Llama ל-98.6%.
mathyaiwithmikePublished 2026-10-18 Read source

Discussion

0/2000

Related claims