/Interview

Crack it with AI, the best way · Lesson 3 of 3 · 10 min

The AI-off test

Study with AI

Part 1Basics

Practising with AI creates a risk: you feel fluent because you recognise good answers, though you can't produce them. It's called the illusion of knowing, and it shows up at the worst moment.

The fix is simple, and it matches what one candidate described in a write-up about their Meta preparation: spend the last stretch without AI to check that the skills transferred.

Then use a clear rule to decide you're ready, because nerves won't tell you. Three AI-off mocks, a decent average, no very weak skill, and a small gap between your scores with and without AI.

Words you need

Transfer
Being able to do something in a new setting, without the support you learned it with.
Illusion of knowing
Mistaking familiarity for ability. Rereading and watching solutions both cause it.
AI gap
Your average score with AI, minus your average without it.

A worked example

Day 17. Meera's AI-on mocks average 4.4, and her AI-off average is 3.3. The gate reports a gap of 1.1, with verification the weakest. She'd been letting the assistant suggest her test cases. For the next three days she writes every test herself first. By day 20 her AI-off average is 3.8, and the gap is 0.4. The gate says she's ready, and this time she believes it.

Part 2The question

How do you know the skill is yours, and that you're ready?

By the end of this lesson, you should be able to:

  • Run AI-off mocks
  • Read your AI gap
  • Decide from evidence that you're ready

Part 3In detail

Step by step

  1. Turn AI off for the final quarter. Close it fully, except during rounds that allow it, which you'll still rehearse with it.
  2. Do at least three full mocks. With a person if you can, as a human reacts differently.
  3. Run the gate. Or work it out by hand.
  4. Fix what it finds. Go back to the weakest skill, and don't redo the whole course.
  5. Rest the day before. Cards only.

If the round allows AI

You still want both skills. Rehearse the AI-allowed round with the assistant too, in the same conditions you'll have on the day, and keep a stretch of AI-off practice for the fundamentals. Reports say the assistant in the room may be less helpful than the one you're used to.

The code, explained

This is real code, and our tests run it, including the buggy versions, to prove the bugs are real.

Are you ready?

Scores with AI can flatter you. This compares them with your scores without it.

MockGate.tsTypeScript
1export function readiness(aiOn: MockScore[], aiOff: MockScore[]): { ready: boolean; reasons: string[] } {2  const reasons: string[] = [];3  if (aiOff.length < 3) return { ready: false, reasons: [`${3 - aiOff.length} more AI-off mock(s) needed`] };4  const recent = aiOff.slice(-3);5  const offAvg = mean(recent.flatMap((m) => FIELDS.map((f) => m[f])));6  if (offAvg < 3.5) reasons.push(`AI-off average is ${offAvg.toFixed(1)}, below 3.5`);7  for (const f of FIELDS) {8    const v = mean(recent.map((m) => m[f]));9    if (v < 3) reasons.push(`${f} is ${v.toFixed(1)}, below 3`);10  }11  if (aiOn.length > 0) {12    const gap = mean(aiOn.slice(-3).flatMap((m) => FIELDS.map((f) => m[f]))) - offAvg;13    if (gap > 0.5) reasons.push(`AI-on scores beat AI-off by ${gap.toFixed(1)}, so the AI is carrying you`);14  }15  return { ready: reasons.length === 0, reasons };16}
16 linesUTF-8TypeScript
aiOff.length < 3
One good day proves little. It needs three AI-off mocks.
v < 3
One very weak skill can sink a round even when the average looks fine.
gap > 0.5
If you score much higher with AI, the AI is doing the work.

Tested by npm run test:modules.

What can go wrong

Only mocking with AI
You'll have no idea how you do without it until the day you find out.
Only mocking with AI as the interviewer
People interrupt, react and change direction. Do at least one with a person.
Waiting until you feel ready
That feeling may never come, or it may be wrong. Use the numbers.

Part 4Questions and answers

Answer out loud first, then open each one.

What does a big AI gap tell you?
The tool is doing work you can't yet do yourself. Find which skill has the biggest gap and practise it without help.
Why three mocks rather than one?
A single good day could be luck. Three in a row is much better evidence.

Part 5Going further

Drill: One full AI-off mock (60 min)

  1. Book a person if you can, or use the mock prompt once with typing only.
  2. Do the full round, with no help of any kind.
  3. Score all four competencies.
  4. Compare with your latest AI-on score.

Score yourself

Tick a line only if you did it without prompting.

0 of 4 Repeat the drill, and aim for the lines you missed.

Keep the fundamentals fresh with the critical basics.

Who says so

Checked in November 2026. Vendors and individuals often report what candidates told them, so treat their details as reports.

That's the plan. The final path is our own pick: build your own AI mock interviewer, and use it as your best interview story.

Next path: Build →

← The daily loop and your plan

AI Engineer · Crack it with AI, the best way