How to evaluate

Work out if it fits, before anyone builds.

This library is for sizing up an idea carefully. It is not the place to start wiring something into production.

Nothing here runs yet

No record is a working endpoint or a live agent, and no keys are issued.

1. Start with the decision

Name the decision you are trying to support. A good use case says who makes that decision, what they need to see before they can make it, and what should happen when that evidence is missing.

2. Check what a person still has to do

Every record says what someone must check, interpret, approve, or decide. If that does not fit how your organisation works, stop here — there is no point going further.

3. Look at what goes in and what comes back

Read the inputs, the outputs, the checks, how answers are backed up, and what happens when the system is not sure. Treat all of it as subject to change until there is a real contract to review.

4. Use made-up examples only

Every example here is fictional or deliberately generic. Never send client documents, personal data, passwords, keys, or real records through a public channel.

5. Keep any pilot small and defined

A pilot should say which sources are approved, how you will know it worked, how you will try to break it, who reviews the results, how data is handled, and the point at which you would stop. Pricing, service levels, and how long data is kept are separate conversations.

Go deeper

The evaluation guides work through this method in detail, including responsible evaluation — what to test, what to keep back, and what a concept record cannot tell you.

Browse the records

Getting in touch

Discuss a use case

Tell me enough to work out whether this fits — but please don’t send anything confidential.

  1. 1Start with the record

    Each record already says what it does, where it needs a person to decide, how it behaves when something goes wrong, and what I haven’t settled yet. Nothing is held back for a conversation.

    Open the catalogue
  2. 2Ask a specific question

    Tell me the decision or the piece of work you want help with, who needs to check the results before anyone acts on them, and anything that limits how your data can be handled.

    Email me
  3. 3Run it yourself

    Not yet. Nothing here runs, no keys are issued, and I don't accept real data — so there is nothing to give you access to.

Please don’t send passwords, API keys, client data, or confidential documents.