Operating Principle

2–4 min read

AI’s Capabilities Are Jagged, Not Uniform

AI’s Capabilities Are Jagged, Not Uniform

AI’s Capabilities Are Jagged, Not Uniform

AI can be exceptional at one task and unreliable at a similar one.

AI can be exceptional at one task and unreliable at a similar one.

AI can be exceptional at one task and unreliable at a similar one.

Capability must be tested task by task rather than assumed from category.

Capability must be tested task by task rather than assumed from category.

Capability must be tested task by task rather than assumed from category.

Capability must be tested task by task rather than assumed from category.

Explore marketing analytics and attribution →

Operating Question

What task, workflow, or oversight condition determines whether AI is useful here?

What task, workflow, or oversight condition determines whether AI is useful here?

What task, workflow, or oversight condition determines whether AI is useful here?

Why It Matters

Capability must be tested task by task rather than assumed from category.

Supporting Evidence

Dell’Acqua et al., “Navigating the Jagged Technological Frontier”.

Research Notes

Re-test assumptions as models, stakes, workflows, and oversight arrangements change.

Practical Actions

Test specific tasks; avoid superficial generalization; re-test as models change.

Continue Reading

Main Journal

All entries

Return to the complete Operator Journal library.

Main Journal

All entries

Return to the complete Operator Journal library.

Next Observation

Next article

Keep moving through the field notes.

Open the next observation

Next Observation

Next article

Keep moving through the field notes.

Open the next observation