Strategy for organizations
Where to apply generative AI in your organization, and how to start?
Lesson complete
If you like:
You now know how a model learns, what it costs to use, how it is evaluated, and what can go wrong. One question is left for whoever leads: where is it worth using, and where do you start?
No voice: the lesson advances on its own with subtitles.
The voice for this lesson is being recorded: for now it advances on its own with subtitles.
Review modeComment on this stepI finished the lesson
What you will achieve
- Rank use cases by frequency, value per occurrence, and risk, and place them on a two-by-two grid to choose where to start.
- Calculate the total cost of a use case (not just the tokens) and its first-year return, with the assumptions in plain view.
- Explain how to choose between buying, building, or fine-tuning, and how a pilot with a baseline and a measurable goal decides whether a project expands, gets fixed, or shuts down.
Key ideas
- A use case is a specific task, not “use AI.” It is ranked with three questions: how often it happens, what each one is worth, and how risky it is. Something small and frequent can be worth more than something big and rare.
- On a value-by-risk grid: start with lots of value and little risk; valuable but risky goes later, with controls; little value and little risk is not worth a project; and little value with high risk is not done.
- Build versus buy: buy what is common, build what uses your data (prompt and RAG), fine-tune only if that falls short, and almost never train from scratch.
- Total cost of ownership adds what you pay once and what you pay every month. In the example, tokens were 3% of the first year; the expensive part was people’s work. The return is calculated with the assumptions in view and recalculated with what was measured.
- A pilot has real users, a deadline, a baseline, and a measurable goal, and it ends in a decision: expand, fix, or shut down. Two common mistakes: deciding based on a demo, and letting shadow AI grow.
What many people believe
Common belief If the price per token is low, the AI project will be cheap.
What is true The price per token is only one part of the total cost. Building and integrating, preparing data and gold cases, monitoring and, above all, the people who review and maintain the system also cost money. In the bike shop example, tokens were 3% of the first year.
Check yourself
Four questions. No grade, no account: they just show whether the idea stuck.
Under the hoodFor those who want the math and the code. You do not need it to follow the course.
The lesson’s arithmetic
All of the shop’s figures are illustrative: they show how the calculation is put together, not numbers to copy. What matters is the shape of the formulas and that every assumption stays in view.
Value at stake. With occurrences a month and minutes saved each time, the hours of work at stake per month are
Warranty questions: h; diagnoses: h; résumés: h. If the value is not time (sales, quality, fewer errors), use whatever unit makes sense, but always multiplied by frequency.
Cost per task (lesson 26). With input tokens at dollars per million and output tokens at :
Even though output is less than a tenth of the tokens, it accounts for 30% of each question’s cost: each output token costs five times as much.
First-year total cost of ownership. With an upfront cost (building and integrating, 4,000; preparing data and gold cases, 2,000), a fixed monthly cost (hosting and monitoring, 70; people, 40 h × 10 = 400), and questions a month:
Tokens are , or 3%.
Benefit and return. With a cost of dollars per hour of work:
With , , and : , , and . The upfront investment is paid back in
Break-even points. Solving :
That is why the pilot’s goal is “at least three minutes”: below that, the first year loses money. With the four minutes measured, .
What this calculation leaves out
It is a first-order model. It does not discount money over time, count exit costs (switching providers), include the residual risk from lesson 35 (what an incident costs times its likelihood), or allow for token prices changing. Nor does time saved turn into money on its own: if nobody uses those hours for something else, the benefit never shows up in the books. That is why the pilot measures, and the calculation is redone with what was measured.
The two-by-two grid
It combines three factors on two axes: the horizontal one is (the value at stake) and the vertical one is the risk from lesson 35. The positions in the lesson are ordinal (order matters, distance does not). An alternative is a score, for example with , but a single number hides why a case ended up high or low; the grid forces you to state both reasons. A high-risk case can come down with controls (human approval, answers with sources, minimal permissions) and move to another zone, like the warranty questions.
In the European Union, screening job applications is in Annex III of the AI Act (high risk); under Regulation (EU) 2026/1744, those obligations apply from December 2, 2027.
Build, buy, or fine-tune
| Path | What it is | When |
|---|---|---|
| Buy | a ready-made product, paid per month or per user | common tasks: transcribing, drafting, summarizing |
| Build | your system on a provider’s model: prompt, RAG, tools | tasks that use your data or your processes |
| Fine-tune | on top of that, fine-tuning or LoRA with your examples (lesson 27) | a stable, highly repeated task with thousands of good examples, if the prompt and RAG fall short |
| From scratch | pretraining your own model (lessons 23 and 24) | almost never: tens of millions of dollars |
Before buying or building, evaluate with your gold cases (lesson 34): compare the options on the same set and the same total cost.
What the studies say
- Brynjolfsson, Li, and Raymond (2025), Quarterly Journal of Economics: 5,172 customer support agents, with an AI assistant introduced in stages. Issues resolved per hour rose 15% on average and 30% among the less skilled and less experienced workers; among the most experienced, the productivity effect was small and their quality dipped slightly. (The 2023 working paper reported 14% and 34%.)
- Dell’Acqua and colleagues (2023), Harvard Business School and BCG: 758 consultants in a preregistered experiment. On 18 tasks within GPT-4’s reach, those who used it completed 12.2% more tasks, 25.1% faster, and with higher quality; on a task chosen to fall outside its reach, they were 19% less likely to reach the correct solution than those who did not use it. The authors call this a “jagged technological frontier.”
- Microsoft and LinkedIn (Work Trend Index, May 8, 2024): a survey of 31,000 people in 31 countries. 75% of knowledge workers were using generative AI at work; 78% of those users were bringing their own tools; only 39% had received training from their company.
- Gartner (July 29, 2024): predicted that at least 30% of generative AI projects would be abandoned after proof of concept by the end of 2025, due to poor data quality, inadequate risk controls, escalating costs, or unclear business value. It is a consulting firm’s prediction, not a measurement.
In code
HOURLY = 10 # dollars per hour of work (assumption)
TASK_COST = (3500 * 3 + 300 * 15) / 1e6 # dollars per question (lesson 26)
UPFRONT, FIXED = 6000, 470 # once; every month (assumptions)
def first_year(questions, minutes):
benefit = 12 * questions * minutes / 60 * HOURLY
total_cost = UPFRONT + 12 * (FIXED + questions * TASK_COST)
return round(benefit), round(total_cost), round(benefit - total_cost)
print(TASK_COST)
for questions, minutes in [(2000, 6), (500, 6), (1000, 6), (2000, 4)]:
print(questions, minutes, first_year(questions, minutes))
net_saving = 6 / 60 * HOURLY - TASK_COST # dollars per question, after tokens
print(round((UPFRONT / 12 + FIXED) / net_saving)) # questions a month to break even
print(UPFRONT / (2000 * net_saving - FIXED)) # months to pay back the investment
Output:
0.015
2000 6 (24000, 12000, 12000)
500 6 (6000, 11730, -5730)
1000 6 (12000, 11820, 180)
2000 4 (16000, 12000, 4000)
985
4.0
What comes next
Lesson 37 brings the whole course together on a map: from the neuron to the chatbot, and from there to the questions worth asking any AI team or vendor.
Decision lens
What this idea means if your job is to decide, not to code.
- Make the list of use cases with three columns: how often it happens per month, what each one is worth, and how risky it is (lesson 35). Start with one that has lots of value and little risk; leave the valuable but risky ones for later, with controls.
- Ask for the total cost of ownership, not the price per token: building and integrating, preparing data and gold cases, hosting, monitoring, and the people who review. Insist that the return’s assumptions be written down, and recalculate with what the pilot measures.
- Before expanding, a pilot: real users, a fixed time frame, a baseline measured beforehand, a goal that says how much is needed not to lose money, and a named owner. At the end, expand, fix, or shut down; shutting down in time is success too.
- Banning is not enough against shadow AI: offer approved tools, a clear usage policy, and training, including when not to use it. In the 2024 Microsoft and LinkedIn survey, only 39% of people using AI at work had received training from their company.
Terms in this lesson
- Use case A specific task that AI could change, with who does it, how often, and with what data. It is compared with others by frequency, value per occurrence, and risk. “Use AI in sales” is not a use case; “answer warranty questions by email” is.
- Total cost of ownership (TCO) Everything it costs to own a system over a period: what you pay once (building, integrating, preparing data and gold cases) and what you pay every month (tokens or licenses, hosting and monitoring, the people who review and maintain it). The price per token is only one part.
- Pilot A small-scale test of a use case, with real users, a fixed time frame, a baseline measured beforehand, and a measurable goal. It ends in a data-based decision: expand, fix, or shut down.
- Build versus buy The decision about how to carry out a use case: buy a ready-made product, build on a provider’s model (prompt and RAG), fine-tune a model on your examples, or, almost never, train one from scratch. Rule of thumb: buy what is common; build what uses your data.
- Prompt The text used to ask a generative model for something; in an image generator, the description of the desired image.
- RAG (retrieval-augmented generation) A technique that, before generating, looks up in a collection of documents the chunks most similar to the question and includes them in the prompt, so the model answers from those sources without being retrained.
- Fine-tuning Continuing to train an already pretrained model on a small set of your own examples (input and desired answer) to change its behavior, without starting from scratch.
- Token A piece of text (a word, a word fragment, a symbol, or a basic code) taken from the vocabulary. It is the unit the model reads and generates, and the unit you are billed for.
- Pretraining The first stage of training a language model: over a huge corpus, the model guesses the next piece of text again and again and adjusts its parameters to lower the error. The result is a base model.
- Eval set (gold cases) Your own set of real cases from your work, each with the answer or criterion your experts accept, that the system has not seen. It is used to compare systems and is rerun after every change.
- Human in the loop A design in which the system stops before certain actions (irreversible ones, or those over a limit) and waits for a person’s decision: approve, correct, or reject. It costs attention and only protects if the review is real.
- AI governance The rules, owners, and processes through which an organization decides which uses of AI it accepts and makes sure they are followed. It starts with a usage policy, an inventory of systems, an owner for each system, and an incident log.
- Bias (in an AI system) An error that repeats systematically against a group of people, often inherited from the data. It is detected by measuring the error by group, not the average. Not the bias b of a model (lesson 3).
- Information leak Data reaching someone who should not have it: what gets pasted into an outside service, what a model memorized, or what an assistant shows to someone without permission. Not to be confused with lesson 10’s “data leakage” (from the test into training).
Full transcript
Sources
- Brynjolfsson, E., Li, D., Raymond, L. (2025). Generative AI at Work, The Quarterly Journal of Economics 140(2), 889–942
- Brynjolfsson, E., Li, D., Raymond, L. R. (2023). Generative AI at Work (NBER Working Paper 31161, versión de 2023)
- Dell’Acqua, F., McFowland III, E., Mollick, E. R., Lifshitz-Assaf, H., Kellogg, K., Rajendran, S., Krayer, L., Candelon, F., Lakhani, K. R. (2023). Navigating the Jagged Technological Frontier: Field Experimental Evidence of the Effects of AI on Knowledge Worker Productivity and Quality (HBS Working Paper 24-013)
- Microsoft y LinkedIn (2024). 2024 Work Trend Index Annual Report: AI at Work Is Here. Now Comes the Hard Part (8 de mayo de 2024)
- Gartner (2024). Gartner Predicts 30% of Generative AI Projects Will Be Abandoned After Proof of Concept By End of 2025 (comunicado, 29 de julio de 2024)
- MH&L (Material Handling & Logistics) (2024). 30% of Generative AI Projects Will Be Abandoned After Proof of Concept By End of 2025 (29 de julio de 2024; cobertura del comunicado)
- Anthropic (2026). Pricing (lista de precios de la API: 3 y 15 dólares por millón de tokens de entrada y salida en Claude Sonnet 4.5 y 4.6; consultada el 12 de octubre de 2026)
- National Institute of Standards and Technology (2023). Artificial Intelligence Risk Management Framework (AI RMF 1.0), NIST AI 100-1
- Parlamento Europeo y Consejo de la Unión Europea (2024). Reglamento (UE) 2024/1689 por el que se establecen normas armonizadas en materia de inteligencia artificial (anexo III: empleo)
- European Parliament and Council of the European Union (2026). Regulation (EU) 2026/1744 amending Regulation (EU) 2024/1689 (Digital Omnibus on AI), OJ L, 24 July 2026
CommentsThis lesson’s public conversation: questions, facts to check, ideas.
Comments live in GitHub Discussions, in the course’s public repository; writing one requires a GitHub account. They load from giscus.app when you open this section. The course reviewers read them, and if a change is accepted, it is applied in both languages. Open the thread on GitHub