Skip to content
All insights

Artificial Intelligence & Machine Learning

Building an AI Strategy Roadmap for South African Enterprises

A practical framework for moving from AI pilots to production systems.

5 min read

Most South African enterprises are no longer asking whether artificial intelligence is relevant to their business. They have run the workshops, funded a proof of concept or two, and produced a model that performed convincingly in a notebook. The harder question, and the one that separates organisations compounding an advantage from those quietly writing off innovation budgets, is how a promising pilot becomes a system that operations teams depend on every day. An AI strategy roadmap is the document that answers it.

A roadmap is not a technology shopping list. It is a sequenced plan that connects a small number of business outcomes to the data, platform, and operating-model changes required to reach them. Written well, it survives contact with reality: budget cycles, scarce skills, regulatory review, and the inevitable discovery that the source data is messier than anyone admitted. Written badly, it becomes a slide deck that ages faster than the models it describes.

Start from decisions, not use cases

The most common failure we see is a roadmap built from a long-list of use cases harvested in workshops. Long-lists reward enthusiasm rather than value, and they tend to surface the ideas that are easiest to describe rather than the ones that matter. A more durable starting point is the decision inventory: the recurring, high-volume decisions your organisation makes where speed or accuracy has a measurable cost.

In short-term insurance that might be the triage of an inbound claim. In banking it is often the disposition of a flagged transaction. In healthcare administration it is the completeness of a pre-admission record. In each case the decision already exists, someone is already accountable for it, and there is already a baseline you can improve against. That baseline is what turns an AI programme into something a chief financial officer can evaluate.

For each candidate decision, write down three things before any modelling begins: the current cost of getting it wrong, the volume per month, and the latency the business can tolerate. Latency in particular has a habit of quietly dictating your architecture. A decision that must resolve in 200 milliseconds inside a transaction flow is a fundamentally different engineering problem to one that can be batched overnight, and the difference is worth knowing before you select infrastructure.

Be honest about data readiness

Every roadmap should include a candid assessment of the data that the priority decisions depend on. We assess four dimensions: availability, lineage, latency, and permission. Availability asks whether the data exists in a queryable form at all, rather than only inside a vendor's reporting screen. Lineage asks whether you can explain where a field came from and what has transformed it. Latency asks how stale the data is at the moment of use. Permission asks whether you have a lawful basis, under the Protection of Personal Information Act, to process it for this purpose.

Permission is where South African programmes stall most often, and almost always late. Processing personal information for a new purpose is not automatically covered by the consent obtained for the original purpose, and a model that has been trained on records it should not have seen is expensive to unwind. Bringing your information officer into the roadmap conversation early costs a few meetings. Discovering the problem during a pre-production review costs a quarter.

Where data readiness is genuinely poor, the correct roadmap entry is a data engineering initiative with its own outcome, not an AI initiative with an optimistic assumption attached. Sequencing this honestly is one of the more valuable things a roadmap does.

Choose the platform for the workload you will actually run

Infrastructure decisions are easier once the priority decisions and their latency budgets are written down. Broadly, three patterns cover most enterprise workloads we encounter.

  • Managed foundation models accessed through an API suit language-heavy workflows such as document extraction, summarisation, and retrieval-augmented search over internal knowledge. The engineering effort sits in retrieval quality, evaluation, and guardrails rather than in training.
  • Custom models trained on your own data suit structured prediction problems such as pricing, propensity, forecasting, and anomaly detection. These benefit from managed training services on Google Cloud or Microsoft Azure, with NVIDIA accelerators reserved for the training peaks rather than provisioned year-round.
  • Self-hosted open-weight models suit workloads where data residency, unit economics at high volume, or latency inside a private network are binding constraints. This is the most operationally demanding option and should be chosen deliberately rather than by default.

Data residency deserves specific attention. Both Google Cloud and Microsoft Azure now operate regions in South Africa, which resolves many residency questions that previously forced awkward architectural compromises. Confirm region availability for the specific managed services your design depends on, however, rather than for the region as a whole; service coverage is uneven and a missing service can quietly relocate a workload offshore.

Sequence in horizons, and fund the boring parts

A workable roadmap usually spans three horizons over eighteen to twenty-four months. The first, roughly the opening quarter, delivers one production decision end to end, however narrow. Narrow is the point: a single claim type, a single product line, a single branch. The objective is not scale but proof that your organisation can carry a model through security review, integration, deployment, and monitoring.

The second horizon industrialises what the first horizon improvised. This is where the feature store, model registry, evaluation harness, CI pipelines, and monitoring become shared infrastructure rather than one team's scripts. It is the least glamorous part of any roadmap and the part most often cut when budgets tighten, which is precisely why organisations find their second and third use cases cost as much as their first.

The third horizon extends coverage across adjacent decisions, where the marginal cost per use case should now be falling. If it is not falling, the second horizon was not completed, and the roadmap should say so rather than press on.

Instrument the outcome, not the output

Finally, define how each initiative will be measured before it is built, and measure the business outcome rather than the model metric. A fraud model's area under the curve is a diagnostic, not a result; the result is losses prevented net of the cost of investigating false positives. A document extraction model's field-level accuracy is a diagnostic; the result is handling time per case and the proportion of cases closed without human touch.

Insist that every initiative names its baseline, its target, the owner accountable for the business outcome, and the date the comparison will be made. This does more to keep an AI programme honest than any governance forum, because it makes success and failure legible to people outside the technology function. That legibility is what earns the second round of funding.

Want a second opinion on your roadmap?

We work with South African organisations on exactly these decisions, from strategy through to the systems that run in production.

Start a conversation