Agentic AI Software Engineer
At a glance
Mid-level AI Engineering role at Machine Learning Reply. Munich · full-time.
Pay not stated AI Engineering salary
aimlroles summary, based on the employer's posting.
What you'll do
- Build and run cloud-based systems that can handle production workloads
- Develop AI agents that use tools, complete multi-step tasks and make decisions autonomously
- Take AI features from early prototypes through launch, including APIs, backend services and enterprise integrations
- Create retrieval and orchestration pipelines, then maintain the related MLOps, LLMOps and CI/CD workflows
- Test and monitor systems, improve their performance, and work with clients to clarify needs and deliver solutions
What you bring
- A completed degree in a technical or quantitative subject, such as computer science or engineering
- Programming experience in at least two languages, plus experience putting AI or ML models into production
- Practical knowledge of databases, LLMs, prompt design and bringing generative AI into working solutions
- Fluent English and German at C1 level or higher, which is mandatory
Who this fits
This mid-level role suits a software engineer who can take AI work from prototype to production and collaborate with clients. You’ll work in a flexible hybrid setup across client sites, the Munich office and remote work. The role is based in Munich or Berlin.
From the employer
We are looking for a skilled and motivated Consultant to join our team. The ideal candidate combines strong software engineering expertise with hands-on experience in modern AI systems, including agentic AI and generative AI applications. You will support our clients in designing and building intelligent, production-ready systems that leverage LLMs, autonomous agents, and scalable cloud architectures.
Responsibilities:
· Design, build, and deploy scalable, production-grade systems on cloud platforms such as AWS, GCP, or Azure.
· Develop and operate agentic AI systems, including multi-step workflows, tool integration, and autonomous decision-making components.
· Lead end-to-end implementation of AI-driven features, from prototyping (PoC) to production deployment.
· Build high-performance APIs and backend services for AI applications using frameworks such as FastAPI, Flask, or Spring Boot.
· Integrate generative AI solutions (LLMs, vector databases, RAG pipelines, orchestration frameworks like LangChain/LangGraph) into enterprise environments.
· Design and implement robust orchestration and retrieval pipelines for scalable AI applications.
· Set up and maintain MLOps / LLMOps pipelines and CI/CD workflows for continuous integration, evaluation, and deployment.
· Ensure software quality through testing, monitoring, observability, and performance optimization.
· Collaborate closely with clients and cross-functional teams to identify requirements and deliver impactful AI solutions.
What we offer you:
· Work on innovative AI and Software Engineering projects across industries (Banking, Insurance, Automotive, Retail, etc.).
· Expand your skills in areas such as MLOps, cloud architecture, data engineering, and generative AI.
· Collaborate with top technology partners in the cloud, AI, and automation ecosystem.
· Access to training, certifications, and interdisciplinary projects.
· Join a vibrant community with hackathons, conferences, and knowledge-sharing events.
· Award-winning office space in downtown Munich with great transport connections.
· Flexible working model between client site, Reply office, and remote work.
Deutschlandticket for public
Job requirements
Minimum Qualifications:
· Completed university studies with a strong quantitative or technical background (e.g., Computer Science, Data Science, Engineering, or similar).
· Ideally, you have already gained some initial consulting and project management experience Teamwork & Collaboration – ability to work effectively with others toward common objectives.
· Adaptability – flexibility in taking on different roles within a team and understand the need of the costumer
· Solid programming experience in at least two programming languages such as Python, Java, Rust, or JavaScript.
· Practical experience deploying ML/AI models into production environments (on-premises or cloud).
· Experience with different database technologies, including SQL and NoSQL, with knowledge of database design, data modeling, and data management.
· Experience with large language models (LLMs), prompt engineering, fine-tuning, and integrating generative AI into actual solutions.
· Strong communication skills for explaining technical concepts to both technical and business stakeholders.
· Fluent in English and at least C1-level German. This requirement is mandatory.
Desired Qualifications:
· Hands-on experience with cloud AI services.
· Understanding of MLOps concepts (model registry, monitoring, CI/CD).
· Knowledge of modern AI/ML frameworks and tools such as PyTorch, TensorFlow, Hugging Face, LangChain, or OpenAI APIs.
· Awareness of software engineering principles (SOLID, testing, version control).
· Familiarity with containerization and orchestration (Docker, Kubernetes).
· Cloud certifications are a plus.
· Teamwork & Collaboration – ability to work effectively with others toward common objectives.
· Adaptability – flexibility in taking on different roles within a team and understand the need of the costumer
What are you waiting for?
Join our team at Machine Learning Reply as a Consultant for Software Engineering and AI in Munich or Berlin!