36

Strategy for organizations

Where to apply generative AI in your organization, and how to start?

12 minExecutive path

Strategy for organizations

With voice. You can pause and jump to any step.

Lesson complete

Subtitles

You now know how a model learns, what it costs to use, how it is evaluated, and what can go wrong. One question is left for whoever leads: where is it worth using, and where do you start?

Voice

No voice: the lesson advances on its own with subtitles.

The voice for this lesson is being recorded: for now it advances on its own with subtitles.

0:00 / 0:00

What you will achieve

  • Rank use cases by frequency, value per occurrence, and risk, and place them on a two-by-two grid to choose where to start.
  • Calculate the total cost of a use case (not just the tokens) and its first-year return, with the assumptions in plain view.
  • Explain how to choose between buying, building, or fine-tuning, and how a pilot with a baseline and a measurable goal decides whether a project expands, gets fixed, or shuts down.

Key ideas

  1. A use case is a specific task, not “use AI.” It is ranked with three questions: how often it happens, what each one is worth, and how risky it is. Something small and frequent can be worth more than something big and rare.
  2. On a value-by-risk grid: start with lots of value and little risk; valuable but risky goes later, with controls; little value and little risk is not worth a project; and little value with high risk is not done.
  3. Build versus buy: buy what is common, build what uses your data (prompt and RAG), fine-tune only if that falls short, and almost never train from scratch.
  4. Total cost of ownership adds what you pay once and what you pay every month. In the example, tokens were 3% of the first year; the expensive part was people’s work. The return is calculated with the assumptions in view and recalculated with what was measured.
  5. A pilot has real users, a deadline, a baseline, and a measurable goal, and it ends in a decision: expand, fix, or shut down. Two common mistakes: deciding based on a demo, and letting shadow AI grow.

What many people believe

Common belief If the price per token is low, the AI project will be cheap.

What is true The price per token is only one part of the total cost. Building and integrating, preparing data and gold cases, monitoring and, above all, the people who review and maintain the system also cost money. In the bike shop example, tokens were 3% of the first year.

Check yourself

Four questions. No grade, no account: they just show whether the idea stuck.

ConceptA use case has a lot of value at stake and high risk, like helping with battery diagnoses in the workshop. What makes sense?
ConceptWhat does the total cost of ownership of an AI system include?
CalculationA case saves 4 minutes on each of 3,000 tasks a month, and an hour of work costs 10 dollars. Building it costs 8,000 dollars once, and running it costs 600 a month (tokens included). What is the first-year return?
ApplicationA six-week pilot had the goal of saving at least 3 minutes per question, with no more complaints. It measured 2 minutes, with quality fine. What do you do?

Under the hoodFor those who want the math and the code. You do not need it to follow the course.

The lesson’s arithmetic

All of the shop’s figures are illustrative: they show how the calculation is put together, not numbers to copy. What matters is the shape of the formulas and that every assumption stays in view.

Value at stake. With ff occurrences a month and mm minutes saved each time, the hours of work at stake per month are

H=f⋅m60.H = \frac{f \cdot m}{60}.

Warranty questions: 2,000×6/60=2002{,}000 \times 6 / 60 = 200 h; diagnoses: 300×30/60=150300 \times 30 / 60 = 150 h; résumés: 20×6/60=220 \times 6 / 60 = 2 h. If the value is not time (sales, quality, fewer errors), use whatever unit makes sense, but always multiplied by frequency.

Cost per task (lesson 26). With tit_i input tokens at pip_i dollars per million and tot_o output tokens at pop_o:

c=ti pi+to po106=3,500×3+300×15106=0.0105+0.0045=0.015 dollars.c = \frac{t_i\, p_i + t_o\, p_o}{10^6} = \frac{3{,}500 \times 3 + 300 \times 15}{10^6} = 0.0105 + 0.0045 = 0.015 \text{ dollars}.

Even though output is less than a tenth of the tokens, it accounts for 30% of each question’s cost: each output token costs five times as much.

First-year total cost of ownership. With an upfront cost II (building and integrating, 4,000; preparing data and gold cases, 2,000), a fixed monthly cost FF (hosting and monitoring, 70; people, 40 h × 10 = 400), and VV questions a month:

TCO1=I+12 (F+Vc)=6,000+12 (470+30)=12,000.\text{TCO}_1 = I + 12\,(F + V c) = 6{,}000 + 12\,(470 + 30) = 12{,}000.

Tokens are 12×30=36012 \times 30 = 360, or 3%.

Benefit and return. With a cost of hh dollars per hour of work:

B1=12 V m60 h,R1=B1−TCO1,ROI1=R1TCO1.B_1 = 12\, V\, \frac{m}{60}\, h, \qquad R_1 = B_1 - \text{TCO}_1, \qquad \text{ROI}_1 = \frac{R_1}{\text{TCO}_1}.

With V=2,000V = 2{,}000, m=6m = 6, and h=10h = 10: B1=24,000B_1 = 24{,}000, R1=12,000R_1 = 12{,}000, and ROI1=100%\text{ROI}_1 = 100\%. The upfront investment is paid back in

k=IV(m60h−c)−F=6,0002,000×0.985−470=4 months.k = \frac{I}{V\left(\frac{m}{60} h - c\right) - F} = \frac{6{,}000}{2{,}000 \times 0.985 - 470} = 4 \text{ months}.

Break-even points. Solving R1=0R_1 = 0:

V∗=I/12+Fm60h−c≈985 questions a month,m∗=60h(I/12+FV+c)=3 minutes.V^* = \frac{I/12 + F}{\frac{m}{60} h - c} \approx 985 \text{ questions a month}, \qquad m^* = \frac{60}{h}\left(\frac{I/12 + F}{V} + c\right) = 3 \text{ minutes}.

That is why the pilot’s goal is “at least three minutes”: below that, the first year loses money. With the four minutes measured, R1=16,000−12,000=4,000R_1 = 16{,}000 - 12{,}000 = 4{,}000.

What this calculation leaves out

It is a first-order model. It does not discount money over time, count exit costs (switching providers), include the residual risk from lesson 35 (what an incident costs times its likelihood), or allow for token prices changing. Nor does time saved turn into money on its own: if nobody uses those hours for something else, the benefit never shows up in the books. That is why the pilot measures, and the calculation is redone with what was measured.

The two-by-two grid

It combines three factors on two axes: the horizontal one is f×vf \times v (the value at stake) and the vertical one is the risk P×IP \times I from lesson 35. The positions in the lesson are ordinal (order matters, distance does not). An alternative is a score, for example priority=f⋅v⋅(1−r)\text{priority} = f \cdot v \cdot (1 - r) with r∈[0,1]r \in [0, 1], but a single number hides why a case ended up high or low; the grid forces you to state both reasons. A high-risk case can come down with controls (human approval, answers with sources, minimal permissions) and move to another zone, like the warranty questions.

In the European Union, screening job applications is in Annex III of the AI Act (high risk); under Regulation (EU) 2026/1744, those obligations apply from December 2, 2027.

Build, buy, or fine-tune

Path What it is When
Buy a ready-made product, paid per month or per user common tasks: transcribing, drafting, summarizing
Build your system on a provider’s model: prompt, RAG, tools tasks that use your data or your processes
Fine-tune on top of that, fine-tuning or LoRA with your examples (lesson 27) a stable, highly repeated task with thousands of good examples, if the prompt and RAG fall short
From scratch pretraining your own model (lessons 23 and 24) almost never: tens of millions of dollars

Before buying or building, evaluate with your gold cases (lesson 34): compare the options on the same set and the same total cost.

What the studies say

  • Brynjolfsson, Li, and Raymond (2025), Quarterly Journal of Economics: 5,172 customer support agents, with an AI assistant introduced in stages. Issues resolved per hour rose 15% on average and 30% among the less skilled and less experienced workers; among the most experienced, the productivity effect was small and their quality dipped slightly. (The 2023 working paper reported 14% and 34%.)
  • Dell’Acqua and colleagues (2023), Harvard Business School and BCG: 758 consultants in a preregistered experiment. On 18 tasks within GPT-4’s reach, those who used it completed 12.2% more tasks, 25.1% faster, and with higher quality; on a task chosen to fall outside its reach, they were 19% less likely to reach the correct solution than those who did not use it. The authors call this a “jagged technological frontier.”
  • Microsoft and LinkedIn (Work Trend Index, May 8, 2024): a survey of 31,000 people in 31 countries. 75% of knowledge workers were using generative AI at work; 78% of those users were bringing their own tools; only 39% had received training from their company.
  • Gartner (July 29, 2024): predicted that at least 30% of generative AI projects would be abandoned after proof of concept by the end of 2025, due to poor data quality, inadequate risk controls, escalating costs, or unclear business value. It is a consulting firm’s prediction, not a measurement.

In code

HOURLY = 10                          # dollars per hour of work (assumption)
TASK_COST = (3500 * 3 + 300 * 15) / 1e6   # dollars per question (lesson 26)
UPFRONT, FIXED = 6000, 470           # once; every month (assumptions)

def first_year(questions, minutes):
    benefit = 12 * questions * minutes / 60 * HOURLY
    total_cost = UPFRONT + 12 * (FIXED + questions * TASK_COST)
    return round(benefit), round(total_cost), round(benefit - total_cost)

print(TASK_COST)
for questions, minutes in [(2000, 6), (500, 6), (1000, 6), (2000, 4)]:
    print(questions, minutes, first_year(questions, minutes))

net_saving = 6 / 60 * HOURLY - TASK_COST          # dollars per question, after tokens
print(round((UPFRONT / 12 + FIXED) / net_saving))  # questions a month to break even
print(UPFRONT / (2000 * net_saving - FIXED))       # months to pay back the investment

Output:

0.015
2000 6 (24000, 12000, 12000)
500 6 (6000, 11730, -5730)
1000 6 (12000, 11820, 180)
2000 4 (16000, 12000, 4000)
985
4.0

What comes next

Lesson 37 brings the whole course together on a map: from the neuron to the chatbot, and from there to the questions worth asking any AI team or vendor.

Decision lens

What this idea means if your job is to decide, not to code.

  • Make the list of use cases with three columns: how often it happens per month, what each one is worth, and how risky it is (lesson 35). Start with one that has lots of value and little risk; leave the valuable but risky ones for later, with controls.
  • Ask for the total cost of ownership, not the price per token: building and integrating, preparing data and gold cases, hosting, monitoring, and the people who review. Insist that the return’s assumptions be written down, and recalculate with what the pilot measures.
  • Before expanding, a pilot: real users, a fixed time frame, a baseline measured beforehand, a goal that says how much is needed not to lose money, and a named owner. At the end, expand, fix, or shut down; shutting down in time is success too.
  • Banning is not enough against shadow AI: offer approved tools, a clear usage policy, and training, including when not to use it. In the 2024 Microsoft and LinkedIn survey, only 39% of people using AI at work had received training from their company.

Terms in this lesson

Full transcript
CommentsThis lesson’s public conversation: questions, facts to check, ideas.

Comments live in GitHub Discussions, in the course’s public repository; writing one requires a GitHub account. They load from giscus.app when you open this section. The course reviewers read them, and if a change is accepted, it is applied in both languages. Open the thread on GitHub

Sources