How we are measuring I3OS returns at Impulsa3
At Impulsa3, we have not treated I3OS returns as an isolated figure of hours saved. The expected margin compression in growth, marketing, and technology services forces us to observe production cost, response speed, delivered quality, and the time the team can devote to higher-value decisions. This experience has taught us that AI ROI is also visible in the ability to grow without turning every improvement into a new hire, and in moving talent away from routine work towards what truly differentiates the company.
70% of AI projects do not get beyond the pilot stage. The main cause is not technical: it is the inability to demonstrate a return. We give you a practical framework with formulas, KPIs by area, and a governance system for measuring AI’s real impact on your company
Artificial intelligence generates disproportionate expectations. A CEO reads that AI can increase productivity by 40%, an operations director hears that an chatbot cuts support costs by 60%, and suddenly there is pressure to implement AI across the organization. Six months later, the AI project is stuck in perpetual pilot, no one can quantify what it has delivered, and the budget is being questioned.
This pattern repeats in 70% of AI projects. And the main reason is not that the technology does not work. It is that no one defined from the outset which metrics to measure, how to isolate AI’s impact from the rest of the variables, or when to consider that the project has demonstrated its value.
Measuring AI ROI is more complex than measuring the ROI of a traditional investment. It is not just costs versus benefits. There are direct benefits (time savings and fewer errors), indirect benefits (better customer experience and lower turnover), and strategic benefits (scaling capacity and innovation speed) that are real but difficult to quantify.
In this article, we give you a practical framework for measuring the ROI of your AI projects: from the basic formula to area-specific KPIs, including the most common mistakes and a governance system based on the GO/FIX/KILL traffic-light model.
Why measuring AI ROI is harder (and more important) than it seems
Measuring ROI in AI presents specific challenges that do not exist in traditional technology investments:
- Attribution: If you implement an AI chatbot while redesigning the website, how do you separate the impact of each change? AI rarely operates in isolation. It integrates into existing processes where multiple variables influence the outcome.
- Time horizon: A machine-learning model needs data to improve. Month-one ROI is not representative of month-six ROI. Many projects are cancelled before reaching profitability because they are measured too early.
- Intangible benefits: How do you quantify that your customer-service team is less burned out because AI handles repetitive queries? Or that you make better inventory decisions because you have more reliable forecasts?
- Hidden costs: The cost of the tool is only the beginning. Data cleaning, integration, training, model maintenance, human oversight, and regulatory compliance all count. The TCO (Total Cost of Ownership) of an AI project is usually 2–3x the licence cost.
If you cannot measure impact, you cannot justify the investment. And if you cannot justify the investment, the project dies.
The basic AI ROI formula
The basic formula is the same as for any investment:
ROI (%) = [(Net AI benefit − Total AI cost) / Total AI cost] × 100
But the key is defining both components correctly:
Total costs (TCO)
Include all direct and indirect costs during the evaluation period:
- Licences and subscriptions: Monthly or annual cost of the AI tool (API calls, seats, processing volume).
- Integration and development: Development hours to connect AI to your systems (CRM, ERP, ecommerce, databases). This is usually the most underestimated cost.
- Data: Cleaning, transformation, labelling, and maintenance of the data feeding the model. Without quality data, no AI system will work.
- Training: Time spent training the team that will use and supervise the AI.
- Operations and maintenance: Monitoring, model retraining, support, and updates. It is not a one-off cost: it is recurring.
- Governance and compliance: DPIA, FRIA, technical file, and audits. The costs of regulatory compliance (GDPR, AI Act) are real and growing.
Benefits (direct + indirect)
- Time/cost savings: The easiest benefit to quantify. How many hours does AI save your team? What is the cost per hour of those hours? Example: if a chatbot resolves 500 queries per month that an agent previously handled (15 minutes per query × €25/hour), the saving is €3,125/month.
- Revenue increase: A recommendation engine that raises AOV by 12%. Demand prediction that reduces stockouts and captures lost sales. Personalization that improves conversion by 15%.
- Error reduction: Fraud detection that reduces chargebacks. Invoice automation that eliminates manual errors. Computer-vision quality control that reduces defects.
- Experience improvement: Faster response times, 24/7 availability, and personalization. Difficult to quantify directly, but reflected in NPS, retention, and lifetime value.
- Strategic capacity: AI can enable you to do things that were previously impossible at scale: analyze all CVs instead of 10%, monitor competitor prices in real time, and personalize communication for every customer.
Measurement period: The standard for evaluating an AI project’s ROI is six months after the pilot. Before then, you do not have enough data to capture the model’s learning curve and team adoption.
Area-specific KPIs: what to measure for each use case
Generic KPIs are not enough. Each AI use case has its own metrics. Here are the most relevant KPIs by area:
Customer service (AI chatbot)
- FCR (First Contact Resolution): Percentage of queries resolved without human escalation. Typical baseline: 40–60%. AI target: 70–85%.
- AHT (Average Handling Time): Average handling time per query. AI should reduce it by 30–50%.
- CSAT (Customer Satisfaction): Customer satisfaction after the interaction. It should remain at or improve on the human baseline.
- Human intervention rate: Percentage of conversations that require escalation to an agent. The lower the rate, the greater the chatbot’s autonomy.
Ecommerce (recommendations, prediction)
- AOV (Average Order Value): Impact of the recommendation engine on average order value. Target: +10–20%.
- Conversion rate: Percentage of visitors who buy. AI personalization can improve it by 10–30%.
- MAPE (forecast): Demand-forecast accuracy. Target: MAPE < 20% at family level.
- Fill rate: Percentage of orders fulfilled without a stockout. Prediction improves fill rate by 2–5%.
HR (AI-assisted recruitment)
- Time-to-hire: Days from publication to hiring. Target: 26–50% reduction.
- Cost per hire: Savings in screening and evaluation hours. Target: 30–50% reduction.
- Quality of hire: Six- and 12-month retention of candidates selected with AI versus without AI.
- Fairness metrics: The four-fifths rule to ensure AI does not discriminate (see Article 11).
Operations (automation, quality)
- Process time: Reduction in time spent on automated tasks (invoicing, classification, data entry).
- Error rate: Errors before versus after automation. Target: >80% reduction.
- Throughput: Volume processed per unit of time. AI typically multiplies throughput by 5–10x.
The five most common mistakes when measuring AI ROI
- Not defining the baseline before starting. If you do not measure your metrics before implementing AI, you cannot calculate improvement. Document the current state of each KPI before Gate 0. It seems obvious, but 60% of projects do not do it.
- Measuring too early. A machine-learning model needs data and time to optimize. Measuring ROI in month one is like judging a new employee in their first week. The minimum reliable period is six months after the pilot.
- Ignoring hidden costs. The real TCO of an AI project is usually 2–3x the tool’s cost. If you calculate ROI using the licence alone, you are overestimating the return. Include integration, data, training, operations, and compliance.
- Confusing technical metrics with business metrics. A model with 95% accuracy is impressive to the data-science team, but tells the CFO nothing. Always translate technical metrics into business impact: euros saved, incremental sales, and hours freed.
- Measuring savings only, not value created. AI does not only save costs. It enables things you could not do before: personalize at scale, predict demand at SKU level, and serve customers 24/7 in multiple languages. If you measure savings only, you underestimate 50% of the value.
The GO/FIX/KILL traffic light: ROI governance
The traffic-light governance model applied to ROI lets you make objective decisions about each AI project:
Define thresholds before starting
At Gate 0, before any investment, define three thresholds for each KPI:
- Green (GO): The project reaches or exceeds the target. Example: ROI > 150% after six months. Action: scale.
- Amber (FIX): The project shows progress but does not reach the target. Example: ROI between 50% and 150%. Action: investigate, optimize, and give it three more months.
- Red (KILL): The project shows no evidence of return. Example: ROI < 50% after six months with no positive trend. Action: stop and reassign resources.
Review at a fixed cadence
Establish monthly reviews of the KPI dashboard with key stakeholders. Do not wait six months to discover that the project does not work. Monthly review lets you detect negative trends and act early.
Document decisions
Each traffic-light review must be documented: the status of each KPI, the action decided, the owner, and the deadline. This documentation is part of the governance file and is useful both for organizational learning and regulatory compliance.
Reference point: According to industry data, back-office functions (operations, finance, administration) tend to generate the fastest and most measurable ROI in AI projects: automating repetitive processes with direct savings in hours. Sales and marketing absorb 50% of the GenAI budget, but back-office delivers a faster return.
Practical example: calculating ROI for a customer-service chatbot
Let us look at a concrete example for an ecommerce business implementing an AI chatbot for customer service:
Costs (annual TCO)
- AI chatbot platform: €500/month = €6,000/year
- CRM and ecommerce integration: €4,000 (one-off, amortized over two years = €2,000/year)
- Team training: €1,500 (one-off, first year)
- Maintenance and optimization: €200/month = €2,400/year
- Governance (DPIA, monitoring): €1,000/year
- Total first-year TCO: €12,900
Benefits (annual)
- Queries resolved by AI: 600/month × 15 min/query × €25/hour = €3,750/month = €45,000/year
- Reduced response time: improved CSAT (+5 points) → conservative estimate of 3% higher retention = €8,000/year
- 24/7 availability: captures out-of-hours queries → 5% more night-time conversions = €4,000/year
- Estimated total benefit: €57,000/year
ROI
ROI = [(57,000 − 12,900) / 12,900] × 100 = 342%
A 342% ROI in the first year. It seems high, but it is consistent with industry data: the average ROI of AI chatbots in ecommerce is between 200% and 400%, depending on query volume and the cost of the human team replaced.
Note: This calculation assumes that the chatbot resolves 70% of queries without human escalation (70% FCR), which is a realistic target with a well-configured RAG. If your FCR is lower, the benefit will be proportionally lower.
How to communicate AI ROI to leadership
Having the metrics is not enough. You need to communicate them in a way that decision-makers understand and can act on. These are the principles for effective communication of AI ROI:
- Talk in euros, not technical metrics. The CFO does not care that MAPE has fallen from 35% to 18%. They care that this improvement translates into €40,000 less obsolete stock per year. Always translate every technical metric into its economic equivalent.
- Compare with the cost of doing nothing. Do not present ROI in the abstract. Compare the AI versus no-AI scenario: “if we do not implement demand prediction, we will continue losing €80,000/year to stockouts and excess inventory. With AI, we reduce that loss to €30,000. The net saving of €50,000 covers the investment three times over”.
- Show the trend, not just the snapshot. A 150% ROI in month six says little by itself. But if it was 80% in month three and rose to 150% in month six, the trend shows that the model is improving with more data. Present progress charts, not just isolated figures.
- Include avoided costs. ROI is not only money earned. It is also money you did not lose: regulatory fines avoided by having an AI Act-compliant system, discrimination claims avoided by monitoring fairness metrics, and data leaks avoided by governing Shadow AI.
- Be honest about uncertainty. Do not present ROI as an exact number. Present a range: “we estimate ROI between 200% and 350% in the first year, depending on team adoption and data quality”. Honesty about uncertainty builds more trust than artificial precision.
Where ROI is fastest: back-office versus front-office
One of the industry’s most counterintuitive conclusions: 50% of the GenAI budget goes to sales and marketing, but back-office functions (operations, finance, administration) tend to deliver faster and more measurable ROI.
The reason is structural. Back-office processes are repetitive, well documented, and have clear metrics (process time, error rate, cost per transaction). AI automation generates direct, measurable savings from the first month.
By contrast, front-office AI projects (personalization, recommendations, sales chatbots) have potentially greater ROI but are more difficult to measure and attribute. The recommendation: start with back-office to generate demonstrable quick wins that justify investment in more ambitious front-office projects.
- Typical back-office quick wins: Invoice automation (70–90% saving in processing time), automatic support-ticket classification (40–60% reduction in triage time), and document data extraction (80% saving versus manual data entry).
- High-ROI front-office projects: Recommendation engine (AOV +10–20%), 24/7 customer-service chatbot (30–50% saving in agent costs), and churn prediction (retention +5–15%). They require more data and time but create strategic impact.
Optimal strategy: Start with 1–2 back-office projects that generate fast, measurable ROI. Use that documented success to secure budget and support for more transformative front-office projects. This is the 30–60–90 Plan applied to justifying investment.
Measure to decide, not to justify
The worst use of ROI is calculating it afterwards to justify a decision that has already been made. The best use is defining it beforehand to make better decisions: which projects to launch, which to scale, and which to stop.
The framework we propose (baseline + specific KPIs + complete TCO + GO/FIX/KILL traffic light) is not complex. It is disciplined. And that discipline makes the difference between the 30% of AI projects that demonstrate value and the 70% that die in pilot.
If you want to calculate the potential ROI of your next AI project, define the right KPIs, or implement a return-governance system, Impulsa3 can help you build the business case and support you from Gate 0.
These use cases connect to the decision between generative and predictive AI.