Evaluation list

API

API quality check

It runs this call with your API address, key, and model. It can check whether the call connects, whether the reply is complete, and whether tool calls and structured output come back in the expected shape.

Start the test

User test v1
Verifying…
Model

Default: run all checks

Choose checks
Checks

Private report; excluded from rankings.

Keys are excluded from reports

Before you start

I am allowed to test this API address and key.

How it is tested

You choose the checks. Folkbench uses your API address, key, and model and sends the calls from our server, then compares what actually came back. The result stays with you and does not change a ranking.

  1. Connectivity

    one short call, to see whether it connects and the reply has the expected shape.

  2. Model consistency

    several calls, to see whether the model identity, the stream, and a repeated request stay steady.

  3. Privacy

    whether the reply includes something that should not be there.

  4. Tool calling

    whether the API follows the tool-call shape.

  5. JSON

    whether it returns the agreed structure.

  6. PDF reading

    whether it can read a file and answer.

  7. Long context

    a longer input, to see whether the reply is still complete.

  8. Juice verification

    whether the text reports it. A missing or refused answer only means this run has no evidence for that item.

Related articles