Skip to main content

Technical Leadership · 8 min read · 28 December 2025

Managing AI Projects: What Is Different from Traditional Software Development

AI projects fail for reasons that traditional project management does not anticipate. The differences are not cosmetic — they require genuinely different approaches to planning, estimation, and risk management.

By Ajay Prajapat — AI Systems Architect

Experienced project managers who have successfully delivered complex software projects often struggle with AI projects. Not because the fundamentals of project management do not apply — they do — but because AI projects have specific characteristics that require different approaches to estimation, risk management, and success definition. Applying traditional software project management patterns to AI without modification is a reliable way to produce a project that is late, over-budget, and underperforms.

Five Ways AI Projects Differ from Software Projects

1. Accuracy is not binary

Traditional software features either work or do not. AI features work to a degree. A document extraction system that is 87% accurate is not "broken" — it may be acceptable for some use cases and unacceptable for others. This means success criteria must be defined as thresholds, not binary pass/fail, and the team needs a plan for improving accuracy incrementally rather than fixing a bug.

2. Data quality is a dependency that is often discovered, not specified

Traditional software can be built against a data specification. AI systems often discover data quality problems during development that were not visible during scoping. The data that exists in the organisation is frequently inconsistent, incomplete, or poorly formatted in ways that only become apparent when the AI tries to process it. These discoveries are not scope creep — they are inherent to the project and need buffer in the plan.

3. Models change under you

LLM providers update base models, change pricing, and deprecate API versions. A system that works well on GPT-4o today may behave differently after a model update. This adds ongoing maintenance requirements that traditional software does not have: regression testing after model updates, prompts that may need adjustment, and evaluation infrastructure to detect behavioural changes.

4. The output space is not fully enumerable

Traditional software can be tested against all specified inputs. AI systems have an effectively infinite output space — you can never test all possible inputs or outputs. This means quality assurance requires statistical sampling, evaluation sets, and ongoing monitoring rather than comprehensive test coverage.

5. Iteration is the process, not a sign of poor planning

AI systems are developed through iterative refinement — build a version, evaluate it, identify failure modes, improve. The first version is not a deliverable; it is a hypothesis. Planning that does not account for multiple evaluation cycles and improvement iterations will always run late.

How to Adapt the Planning Process

— Allocate 25-40% of project time to data preparation and quality work — this is almost always underestimated

— Include evaluation infrastructure in scope from day one — it is not a nice-to-have at the end

— Plan for 2-3 evaluation cycles before production — each cycle discovers failure modes and informs the next

— Define success thresholds before development starts, not after you see the first results

— Budget for ongoing maintenance: model regression testing, prompt updates, evaluation set expansion

Communicating AI Project Progress to Stakeholders

The most common stakeholder management failure in AI projects: communicating "the AI is working" after a successful demo, then delivering "we need more time" when production reveals performance issues.

Better approach: communicate in terms of evaluation metrics rather than feature completion. "The system is at 82% accuracy on our test set, we need 90% for deployment, and we have identified the failure modes we need to address." This sets accurate expectations and demonstrates that the team understands what success requires.

← Back to all articles

Related reading

Continue reading.

A good place to start

What are you
working on?

A technical challenge. A team to upskill. An idea that needs a plan.
Tell me where you are and where you want to go.

Let’s talk about it