API test results

We run Veridrop, an open-source tool that checks AI APIs, on our own Cloudflare Workers and used it to test the four models on the RoamAI API. It checks whether the model behind an API is really Claude, whether features such as PDF input and tool use still work, and whether responses follow the official API format.

You can test any AI API with the same checks yourself: veridrop.roamai.cloud ↗

Score by item

ItemOpus 5.5Fable 5.1Sonnet 5.5Haiku 5.5
Authenticity
Identity100100100100
Behavioral signature100100100100
Thinking signature100100100100
Model consistency100100100100
Knowledge100100100100
Capability
PDF reading100100100100
Structured output100100100100
Protocol
Protocol100100100100
Response integrity100100100100
Message IDs100100100100
Token usage100100100100
Total100100100100

The total is the weighted average of the item scores; skipped items are left out. 85 or more counts as Excellent, 70 to 84 as Pass.