Sign inGet started
← Journal
Knowledge Work10 min read

The End of Generic AI Advice

Ask base AI to review your cold email and you get generic advice about personalisation. Run it through an expert skill and you get a calibrated score, an offer tier diagnosis, and a rewritten version using pattern-interrupt psychology. Same model. Radically different output.

1 March 2026 · 2,187 words

You already know AI can explain things. You can ask it to summarise Shape Up, outline the Story Grid methodology, or walk you through Kim Scott's Radical Candor framework. It will do all three competently. The concepts will be correct. The structure will be tidy.

Then you try to use it on something real. A stuck product bet. A flat chapter opening. A feedback conversation you've been avoiding. The response lands somewhere between "textbook summary" and "motivational poster."

This is not a model problem. The models are good. The problem is that information and judgment are different things. And most AI interactions give you the first while you need the second.

What Judgment Actually Is

When researchers from Harvard Business School and Boston Consulting Group put 758 management consultants in front of GPT-4, the results split cleanly. On tasks within AI's capability frontier — synthesis, analysis, explanation — consultants using AI completed 12.2% more tasks, 25.1% faster, at 40% higher quality. But on tasks outside the frontier — tasks requiring judgment — consultants using AI were 19 percentage points less likely to produce correct solutions than those working without it. AI didn't just fail to help. It made people worse.

The researchers called this the "jagged technological frontier." Some tasks that look difficult are easy for AI. Some tasks that look similar are still beyond it. The dividing line is not complexity. It is judgment — the calibrated, experience-built sense of what matters in a specific situation. And it is not a gap that more data or larger models have closed. The study was published in September 2023. The frontier has moved since then, but its shape has not changed. Tasks requiring expert methodology remain outside it.

Judgment has four components. Calibrated thresholds: knowing what "good" actually looks like, not in theory but in practice. Decision trees: the questions an expert asks, in the order they ask them. Prescribed formats: the specific way an expert presents results, not a way but the way. Pattern recognition: what an expert notices that a novice walks past.

These four things are what separate a useful answer from a correct one. And they are precisely what base AI lacks.

Three Problems, Three Gaps

The gap shows up differently depending on the domain. Here are three.

1. The Product Manager Who's Been Stuck for Two Weeks

A product director is shaping a billing migration. She's been at it for two weeks. She's tried three different shapes. All three fail on the same two requirements: zero downtime during cutover and a 48-hour rollback window.

She asks AI for help.

What base AI returns: A fourth shape. It proposes a new architecture — a phased migration with feature flags and a parallel-run period. It's a reasonable suggestion. It's also exactly the wrong move.

What a Shape Up skill returns: "When all shapes fail the same requirement, the problem isn't the shapes. It's the requirements." The skill identifies that R1 (zero downtime) and R6 (48-hour rollback) contain an implicit constraint that makes them jointly unsatisfiable at the stated appetite. It decomposes R1 into sub-requirements (R1a: zero downtime for reads, R1b: sub-second interruption for writes) and R6 into components (R6a: data rollback, R6b: routing rollback). Then it provides a ready-to-send message to the CTO explaining why the original requirements need renegotiation.

The difference: base AI treated a requirements problem as a design problem. The skill recognised the pattern — all shapes failing the same constraint — and applied Ryan Singer's diagnostic: the problem is upstream.

We tested this systematically. Five scenarios, eight scoring dimensions, forty points maximum. Base Claude scored 26.6. The pipeline-enhanced Shape Up skill scored 31.4 — an 18% improvement overall. But the lift was not evenly distributed. On voice: +64%. On mastery: +57%. On methodology: +57%. The improvement concentrated in the dimensions that separate an expert response from a competent one.

In multi-turn testing — a ten-stage journey simulating a complete shaping session — the gap widened. Base Claude lost the methodology thread after turn five and reverted to generic product management advice. It completed 60% of the journey. The enhanced skill modes maintained the methodology through all ten stages with 100% completion. Even the minimal stub-only variant — the lightest possible skill instruction — achieved 90%.

The pattern is clear. On a one-shot question, base AI holds up reasonably well. Across a sustained engagement, the kind where real work happens, it falls apart. The methodology thread frays. The specific notation gets dropped. The diagnostic rigour gives way to generic encouragement. By turn seven, you're getting the same advice you'd get from any general-purpose assistant.

2. The Writer Whose Opening Falls Flat

A novelist submits the opening scene of a thriller. A body has been discovered. The detective arrives. The scene is competent — clear setting, functional dialogue, logical sequence of events.

Something is off. The writer can feel it but can't name it.

What base AI returns: "Strong opening with good scene-setting. Consider adding more sensory detail to increase tension. The dialogue feels natural. You might want to end the chapter on a stronger hook." This is encouraging. It is also useless. The writer already knows the scene needs more tension. They need to know where the structure breaks.

What a Story Grid skill returns: The skill runs Shawn Coyne's Five Commandments analysis on the scene. It identifies that the Inciting Incident is present (the body), the Progressive Complications exist (witness contradictions, missing evidence), and the Crisis is implied — but the Climax is missing. The scene ends on continued investigation rather than a forced decision. The detective never has to choose. Without a choice, there's no revelation of character. Without character revelation, there's no reason for the reader to turn the page.

The skill doesn't say "add more tension." It names the structural absence — no Climax — and explains the consequence: the scene progresses without escalating. It then shows what a Climax would look like in this specific scene: forcing the detective to decide between pursuing the obvious suspect (satisfying her superior) or following the contradictory evidence (risking her position).

The difference: base AI described the symptom. The skill diagnosed the cause.

3. The Manager Who Keeps Avoiding a Conversation

A team lead has a direct report who's been underperforming for three months. Deadlines slip. Quality drops. The rest of the team notices. The manager knows she needs to address it. She hasn't.

She asks AI how to handle the situation.

What base AI returns: A balanced overview. "Consider using the SBI model (Situation-Behavior-Impact). Be specific about the behaviours you've observed. Focus on facts, not feelings. Create a safe space for dialogue." This is sound general advice. It also misses the actual problem entirely.

What a Radical Candor skill returns: The skill's first move is diagnosis, not advice. It identifies that three months of avoidance combined with genuine care for the employee is the textbook pattern for Ruinous Empathy — one of Kim Scott's four quadrants. The manager isn't lacking a framework. She's stuck in the wrong quadrant. She cares personally (the relationship matters to her) but isn't challenging directly (she's protecting the employee's feelings at the expense of their growth).

The skill names this pattern explicitly. Then it scripts the conversation. Not a template — a word-for-word opening calibrated to this specific situation:

"I've noticed the last three deliverables have been late, and the Jenkins migration had issues that required rework. I care about your growth here, and not telling you this directly would be doing you a disservice. What's going on?"

It flags the likely resistance point: the employee will probably deflect to workload. It prepares the follow-up: "Even if workload is a factor, the quality gaps suggest something else. Let's separate those two things."

The difference: base AI gave her a framework to apply. The skill diagnosed which quadrant she was stuck in, named the pattern, scripted the conversation, and anticipated the resistance. That's not information. That's the judgment Kim Scott developed across years of coaching at Google and Apple.

Notice what the skill did not do. It did not explain Radical Candor. It did not summarise the book. It did not offer four quadrants and leave the manager to figure out which one applied. It applied the methodology to her specific situation and produced something she could use in her next one-on-one. The distinction matters. Explanation is what you get from a book summary. Application is what you get from the expert sitting next to you.

The Pattern

Each example follows the same structure. The user asks for help. Base AI responds with a competent, general answer drawn from its training data. The skill responds with a specific diagnosis drawn from an expert's methodology.

The base response is correct. It just isn't useful in the way the user needs.

This is because base AI has read about these methodologies. It can summarise them, compare them, explain their history. What it cannot do is apply the calibrated thresholds, decision sequences, and pattern recognition that took their creators years to develop. It knows the concepts. It does not have the judgment.

The Harvard study found the same thing at scale. AI helps with information tasks. It does not help with judgment tasks. The gap is not one that better models will close. A larger model knows more. It does not know when a PM's requirements are the problem, not the shapes. It does not know that a missing Climax is why a scene feels flat. It does not know that three months of avoidance signals Ruinous Empathy, not a lack of feedback frameworks.

Those are expert recognitions. They come from methodology, not from data.

There is a useful way to think about what separates a skill from base AI. Four things. Calibrated thresholds — the expert's real standards for what "good" looks like. Decision trees — the diagnostic questions they ask, in the order they ask them. Prescribed formats — the specific way they present results, not a way but the way. Pattern recognition — what they notice that a novice walks past.

Base AI has none of these. It has information about all of them. It can describe Singer's binary fit check, Coyne's Five Commandments, Scott's four quadrants. It just cannot apply them the way their creators do. The distance between description and application is the entire value proposition.

What This Means

The question is not whether AI is useful. It is. An estimated three in four knowledge workers now use AI at work. Deloitte's 2026 State of AI survey found workforce access to AI expanded 50% in a single year. US productivity grew 2.7% in 2025 — nearly double the decade average. The tools are working.

But there is a telling counter-signal. Qualtrics found that research teams are quietly moving away from general-purpose AI tools (usage dropped from 75% to 67%) toward purpose-built specialist capabilities (up from 62% to 66%). The people who use AI most seriously are the ones discovering that generalist output isn't enough.

The question is what happens when the information ceiling hits — when the user needs judgment, not explanation.

One answer is to wait for better models. The evidence suggests this won't work. The jagged frontier isn't about model size. It's about the difference between knowing a concept and knowing how to apply it in a specific, messy, real-world situation. The Harvard study showed that AI didn't just fail on judgment tasks — it actively degraded performance. More capable models may shift the frontier's position, but they don't change its shape.

The other answer is to give AI the methodology it lacks. Not by writing longer prompts or providing more context. By extracting the expert's actual judgment — their thresholds, their diagnostic sequences, their formats, their pattern recognition — and packaging it so the AI can apply it faithfully.

That is what a skill does. It is not a chatbot. It is not a summary of a book. It is an expert's methodology, tested for fidelity, applied to your work. When a product manager asks for help with a stuck shape, the skill doesn't explain Shape Up. It runs Shape Up. When a writer submits a scene, the skill doesn't offer encouragement. It runs the Five Commandments analysis and names the structural gap. When a manager describes an avoidance pattern, the skill doesn't suggest a feedback framework. It diagnoses Ruinous Empathy and scripts the conversation.

Deloitte's 2026 survey found that only 20% of organisations say their talent is ready for AI. The bottleneck is not access to tools. It is the gap between having AI and knowing how to use it for work that matters. That gap is a judgment gap. And it will not be closed by training courses or prompt engineering workshops. It will be closed by giving AI the expert methodology it currently lacks.

The era of generic AI advice is ending. Not because the models are getting worse, but because the standard for "useful" is getting higher. Information was always going to become free. Judgment is what the work actually requires.

AI skillsexpert methodologybefore afterknowledge work
Become a creator

Turn your expertise into an AI skill

Your methodology. Your judgment. Available to anyone, on demand.

Start with one skill →