Many companies put off AI projects because they believe their system landscape is not yet ready for them. This reluctance is understandable, but in most cases it is not necessary.
Before we get into the details, a brief classification: this article looks at three different roles that AI can play in the context of evolved systems. Firstly, as an extension of current processes, where AI modules are integrated into existing workflows without changing the core system. Secondly, as an access layer to existing company data that could not previously be used systematically. And thirdly, as a tool that accelerates modernization projects themselves.
These three perspectives are conceptually different – and all three show that getting started with AI does not depend on a complete system replacement.
The actual problem is not a technical one
According to a Slalom study from 2025, 61% of German companies run the majority of their main business applications on outdated platforms. According to the study “Legacy Modernization 2024” (CIO/Computerwoche/Thinkwise), 72% are facing the challenge of updating outdated but business-critical legacy systems. This is not a marginal problem, but the normal state of the German corporate landscape.
What these figures do not show: Many of these companies are waiting. They are waiting for their system landscape to be “clean enough” to introduce AI. This logic reverses the causality. Because the real hurdles to introducing AI are rarely the age of a system. They are missing integration points, unclear data access and the question of governance: who is allowed to do what with which data?
These are solvable problems. And often, not a single core system needs to be touched.
Why LLMs and legacy go together better than you think
Here is an idea that surprises many: large language models, the AI technology behind applications such as internal assistants, automated document processes or intelligent search, are designed from the ground up to deal with precisely the data that typically accumulates in grown corporate landscapes.
LLMs are designed to understand human speech input and produce human-like text output. They can analyze and process large amounts of unstructured data such as texts, emails or documents – recognizing complex relationships and identifying patterns that are often difficult for humans to recognize.
Legacy systems produce exactly this type of data: Orders that arrive by email. Maintenance logs that are stored somewhere as a PDF scan on a file server. ERP histories that contain decades of transaction data but have never been systematically analyzed. Contracts, inquiries and documentation are all text, all human language, all processable.
The key point here is that AI is not “plugged onto” a system. It is about intelligently expanding existing processes without shaking the foundations. AI modules are integrated into the process chain, they read inputs, enrich them, forward them or return an answer. The core system remains unchanged. It delivers data and receives results as it always has, only now also from non-human agents.
Integration instead of replacement: how it works technically
The question that must be answered first in every project is not: “How do we replace this system?” Rather: “Where in this process can an AI module intervene in a meaningful way without having to change the core system?”
The answer almost always lies in integration layers. The core system, whether ERP, CRM, proprietary industry solution or database from the 1990s, remains what it is: the reliable repository for transactions and master data. An AI module is operated alongside it as an independent service. It obtains data from the existing system, processes it and delivers structured results back or directly to the user.
This avoids the biggest risks of traditional modernization projects: Core processes are not interrupted, no years-long migration project with an uncertain outcome, no loss of knowledge due to system changes. According to recent studies, 91% of companies prioritize the modernization of their core systems over a risky new development. This is a “modernize over replace” strategy that is primarily driven by the desire for stability. AI integration via external modules goes in exactly this direction.
In concrete terms: a mechanical engineering company continues to use its existing ERP for warehousing and orders and receives an AI component that automatically categorizes and pre-qualifies incoming supplier inquiries. An insurance company does not change its core system, but lets an LLM read claims notifications in free text, extract relevant information and feed it into the existing processing in a structured manner. A service provider opens up decades of contract data for targeted evaluations without ever migrating the data.
RAG: Harnessing the wealth of data in established systems
A particularly effective approach for companies with complex inventory landscapes is Retrieval Augmented Generation, or RAG for short. The principle is simple: a language model is not retrained with internal data, as this would be expensive and time-consuming. Instead, it receives the relevant information for each query from an indexed knowledge base that is fed from existing sources.
Typical sources are internal documents, wikis, support databases, product documentation, CRM systems or repositories such as SharePoint and Google Drive. In addition, there is ERP export data, scanned old documents, email archives, handwritten maintenance reports – everything that could not previously be systematically retrieved.
RAG gives companies the ability to power language models with their own data without retraining or fine-tuning, providing customized AI capabilities at a fraction of the time and cost. This is particularly relevant for regulated industries: Access rights can be controlled at document level, GDPR-compliant operation can be planned, and data does not leave the company’s own infrastructure if that is what is desired.
RAG is not a substitute for modernization. It is a way of accessing knowledge that is already there and has been lying fallow until now.
AI as a tool for modernization, not just as its result
There is a third perspective that is often overlooked: AI can actively accelerate the modernization of your own system landscape.
AI-supported tools such as automated code analyses make it possible to carry out complex migration and modernization processes with reduced manpower and minimize risks. Generative AI can analyze existing code, generate documentation and convert legacy code into modern languages while preserving the business logic. According to recent field reports, the time required can be reduced by around a third compared to manual refactoring.
This is particularly important because knowledge of legacy systems is dwindling. 61% of IT decision-makers see demographic change as a risk factor, as know-how about older technologies such as COBOL or mainframe structures is increasingly being lost. AI can serve as a bridge here, not to replace this knowledge, but to secure it and make it accessible before it is lost.
The result: no either/or between “continue to operate the system” and “build everything from scratch”. Instead, a third option: step-by-step, AI-supported further development in which every step can be used immediately.
Where to start?
The initial question is not a technology question, but a process question: Where in your system landscape does data accumulate today that no one systematically analyzes? Where are there steps in the process that are completed manually because no system links them automatically? Where is there knowledge in documents that no one can query?
These answers result in concrete pilot projects with a narrow scope, clear metrics and real ROI. No big bang. No waiting for the perfect infrastructure.
At BAYOOTEC, we bring together precisely these two areas of expertise: many years of experience in working with established system landscapes and the technical know-how for AI integration in complex, regulated environments. We build the connecting layer between what already exists and what is possible with AI today.
