More tests on AI
Testing AI models is now a semi-fulltime job. Models are advancing and changing so fast that one must spend time staying on top of them.
Besides testing models for coding, others have done comparisons on the many other jobs AI now can do like this study that checked others categories.
- Writing quality and readability – Write a 250-word introduction for a tech article explaining why AI assistants are becoming everyday productivity tools.
- Structured reasoning & decision-making – A small business owner spends 12 hours per week answering customer emails and is considering AI automation.
- Explaining complex ideas simply – Explain how large language models work to a 12-year-old.
- Step-by-step logic – A freelancer earns $4,000/month and spends $2,500 on fixed expenses. They want a $6,000 emergency fund. Create a realistic savings plan and show your reasoning step by step.
- Tone & style adaptability – Rewrite this message in three tones: professional, friendly, persuasive: Message: “Our team needs to start using the new software next week or we risk falling behind competitors.”
- Summarization & comprehension – Summarize the following in 5 bullet points suitable for a busy executive: “Companies are experimenting with hybrid schedules, async communication, and four-day workweeks to balance flexibility with team cohesion.”
- Critical thinking & bias awareness – Social media algorithms often amplify extreme viewpoints. Explain why this happens and propose realistic ways platforms could reduce polarization without hurting engagement.
Their conclusion:
Claude Sonnet 4.6 came out ahead almost every time by delivering responses that consistently demonstrated deeper strategic thinking, stronger real-world framing and a clearer understanding of trade-offs. While ChatGPT-5.2 performed strongly in clarity, structure and accessibility — particularly when simplifying complex ideas — Claude distinguished itself by approaching prompts with a more analytical, decision-oriented mindset.
Pretty much all these tests are very particular to wording and tasks they are being given. Truly comprehensive test suites are still lagging; but these are interesting attempts.