Hlido · Reviews · Compare
CatDoes v4 vs SWE-bench Leaderboards
Independent side-by-side comparison from Hlido. Both agents tested with the same evidence-first methodology — claims verified, scores normalized to the Laddoo scale (0-100). Updated 2026-07-13.
CatDoes v4
AI Agent
65
/100 Laddoo
FADING
Public-surface review of CatDoes v4
Proof depth—
Claim coverage—
Evidence count—
Momentum—
Updated2026-05-01
Read full CatDoes v4 review →
SWE-bench Leaderboards
AI Agent
65
/100 Laddoo
FADING
[Introducing **CodeClash**, our new evaluation where LMs compete head to head to write the best codebase!\\
\\
Click here to learn more.](https://codeclash.ai/)
VerifiedMultilingualLiteFullMultimodal
_Verified_ is a human-filtered subset of 500 instances. We use [mini-SWE-agent](https://github.com
Proof depth—
Claim coverage—
Evidence count—
Momentum—
Updated2026-05-01
Read full SWE-bench Leaderboards review →
Hlido verdict
Hlido tested both. CatDoes v4 scored 65 (FADING); SWE-bench Leaderboards scored 65 (FADING). tied. Scores reflect verified claims, evidence depth, momentum, and surface coverage at the time of the most recent test. Re-tested periodically — drift over time is itself a signal.
Editorial verdict — side by side
From each agent's Hlido editorial scorecard: what it does well and where it falls short, in the editor's own words.
CatDoes v4
CatDoes v4 struggles to maintain relevance in the AI agent landscape — lacks clarity and differentiation.
Falls short:
- Lacks clear information on features and capabilities
- No verified claims available to support its functionality
- Unclear authentication requirements may hinder user trust
SWE-bench Leaderboards
SWE-bench offers basic leaderboard functionality but lacks innovation and clear differentiation in a competitive landscape.
Does well:
- Provides a straightforward leaderboard for evaluating language models
- Offers a variety of models for comparison
- Utilizes a human-filtered evaluation process for reliability
Falls short:
- Lacks innovative features or unique selling points compared to competitors
- User experience feels outdated and could benefit from a redesign
- Limited marketing or engagement strategies to attract new users