How ready is your SDK for AI coding agents?

SDKProof

How ready is your SDK for AI coding agents?

Live preview
AI coding assistants keep writing your library's old API. When a library ships a new major version, the model still writes the previous version's code from memory — it looks right, but it doesn't compile against the version you actually have installed. SDKProof measures exactly how often that happens. It gives an AI model real coding tasks for a library, then type-checks the generated code against the real installed package. Compiles = pass. No AI judging another AI — the compiler decides. Scores so far: Prisma 80, Vercel AI SDK 90, Zod 90, Next.js 92, TanStack Query 100. The pattern: the more recently a library changed, the more the AI gets wrong. Open source — run it on any TypeScript package.
  • SDKProof
  • SDKProof
  • SDKProof
  • SDKProof

Comments, support and feedback

Login to comment
  • zehan
    zehan
    2 months ago

    SDKProof Your product has strong potential, but I found a few key improvements that could make it even better. I'd love to share my feedback and suggestions—please contact me at contact@rforrank.com

  • Kalpit Rathore
    Kalpit Rathore
    Maker
    2 months ago

    @zain Thanks, & that's the direction I want to take it. Right now I only have the other axis, and half by accident. When Opus 5 shipped I re-ran the whole board & two libraries jumped 90 to 100 (Vercel AI SDK 7 and Zod 4). So I can watch the score move per model, but not yet per library version. Per-version is the more useful one for teams, I agree. That's the version where you can point at a specific upgrade & say this is what it cost you. It needs me to keep the old lockfiles around & re-run on each major, which I'm not doing yet but should be. One question since you're clearly thinking about this properly. Would you want it as a history on the library page, or as something that tells you when it moves? Those are pretty different builds & I'd rather build the one people actually want.

  • Zain Sheikh
    Zain Sheikh
    2 months ago

    Letting the compiler decide instead of an AI judging another AI is a clean signal. Do you plan to track scores per library version over time so teams can see when an upgrade breaks AI accuracy?

About this launch

SDKProof was launched by Kalpit Rathore in July 28th 2026.

  • 7
    Upvotes
  • 2886
    Impressions
  • #5
    Week rank

Trending launches