1. AI use-case readiness
The single most reliable predictor of an AI project that never ships is that nobody can name the decision it changes. This domain tests whether there is a specific, recurring, measurable job to be done — and whether anyone has thought about what happens when the model is confidently wrong.
Name the decision the AI would make or inform. Which is closest?
Why it matters: This is the strongest single disqualifier in the whole assessment. A project that cannot name the decision has no boundary, so it cannot be scoped, estimated or finished.
How is that job done today, before any AI is involved?
Why it matters: Without a baseline there is nothing to compare the system against, so 'better' becomes a matter of opinion and the project can never be declared successful.
What number would tell you this worked, six months after launch?
Why it matters: A success measure agreed after launch is negotiated against whatever was actually built. Agreed before, it is a specification.
When the model is confidently wrong, who is affected and what happens next?
Why it matters: What a system does when it does not know is a product decision, and one of the few that cannot be deferred: the default behaviour of a language model is to answer anyway.