AI/LLM Ops Engineer

6 days ago

Cape Town, Western Cape, South Africa Elixirr Digital Full time R150 000 - R250 000 per year
Do you want to help shape the future of intelligent systems, focusing on LLMs and agents? Do you enjoy turning cutting-edge research into production-grade AI solutions? Then join Elixirr Digital as our next AI/LLM Ops Engineer

Join Elixirr Digital as an AI/LLM Ops Engineer, where you will drive innovation and help shape the future of intelligent systems for clients across industries like banking, insurance, healthcare, telecommunications, consumer goods, and more. We're looking for proactive self-starters who are constantly reading research, applying it, and using AI to improve their processes, fully embracing the technology.

At Elixirr Digital, we've been early adopters of generative AI, working across open-source and foundation models. From building agents that automate internal workflows to deploying LLM-powered tools that delight users, we believe in pushing boundaries, applying emerging tech, and delivering real impact.

If you're excited to work at the forefront of generative AI, helping enterprises transform from the inside out, we want to hear from you. Let's build the future of AI together

What will you be doing as an AI/LLM Ops Engineer at Elixirr Digital?
  • Design, build, and maintain LLM/agent pipelines: from prototyping to fine-tuning, deployment, monitoring, and scaling.
  • Design and deploy agentic systems and orchestration frameworks leveraging LangChain, AutoGen, or other agent-oriented architectures to enable scalable, reliable automation.
  • Implement and operationalize RAG pipelines including document ingestion, embedding generation, context chunking, and vector database integration for optimized retrieval and knowledge management.
  • Monitor model performance (latency, accuracy, drift), ensure reliability and robustness.
  • Ensure security, and infrastructure scalability (cloud / GPU / TPU etc.).
  • Innovate: explore research, new frameworks, agentic capabilities; prototype internal tools; help improve process & tooling.
Competencies and skillset we expect you to have to successfully perform your job:
  • Strong experience in ML Ops / LLM Ops / AI Ops or similar roles.
  • Hands-on with LLMs: fine-tuning, deployment, building agentic solutions.
  • Practical experience with agent frameworks/tools (e.g., LangChain, AutoGen, Crew, Swarm, etc.).
  • Solid understanding of cloud infrastructure, containerization (Docker, Kubernetes), orchestration, CI/CD pipelines.
  • Proven track record of optimizing model performance, managing latency, monitoring, drift detection, logging (Ragas, DeepEval, LangSmith).
  • Comfortable scripting/programming in Python (plus automation tooling).
  • Experience with multi-modal agents or models (text, image, audio).
  • Prior work with vector databases (Pinecone, Weaviate, etc.), retrieval or knowledge store architectures.
We could be a perfect fit if you are:
  • Passionate about technology. You anticipate, recognize, and resolve technical problems using a variety of specialized tools for application development and support.
  • Independent. You are a self-motivated and ambitious individual, capable of managing multiple responsibilities effectively.
  • Problem-solver. You think creatively and find solutions to complex challenges.
  • Creative and outside-the-box thinker. You look beyond blog posts and whitepapers, competitions, and even state-of-the-art benchmarks to solve real-world problems.
  • Communicator. Strong verbal and written communication skills are essential to ensure effective collaboration and timely delivery of results within the team.
  • Proficient in English. We work across continents in a global environment, so fluent English, both written and spoken is a must.
Why join Elixirr Digital?
  • Global Impact: Work with top-tier clients across industries, solving real-world challenges with transformative AI solutions.
  • Cutting-Edge Innovation: Develop and deploy AI tools and platforms that redefine what's possible in enterprise AI.
  • Collaborative Culture: Join a team of innovators passionate about advancing AI while fostering a collaborative, inclusive environment.
  • Diverse Projects: Tackle a wide range of AI applications-from NLP to reinforcement learning-for use cases as varied as field support for telecom workers and optimizing customer workflows in banks.
Why is Elixirr Digital the right next step for you?

From working with cutting-edge technologies to solving complex challenges for global clients, we make sure your work matters. And while you're building great things, we're here to support you.

Compensation & Equity:
  • Performance bonus
  • Employee Stock Options Grant
  • Employee Share Purchase Plan (ESPP)
  • Competitive compensation
Health & Wellbeing:
  • Health benefits plan
  • Flexible working hours
  • Pension plan
Projects & Tools:
  • Modern equipment
  • Big clients and interesting projects
  • Cutting-edge technologies
Learning & Growth:
  • Growth and development opportunities
  • Internal LMS & knowledge hubs
We don't just offer a job - we create space for you to grow, thrive, and be recognized.

Intrigued? Apply now

  • AI Engineer

    6 days ago

    Cape Town, Western Cape, South Africa Ada Meher Full time R47 000 - R180 000 per year

    AI Engineer - Cape Town - Full Remote - R100,000 CTCI'm partnered with the innovation arm of a global freight management company that's on a mission to leverage artificial intelligence to drive growth, efficiency, and transformation across its operations. This division sits at the forefront of technology for the entire group, delivering solutions that power...

  • Senior AI Engineer

    2 weeks ago

    Cape Town, Western Cape, South Africa PayDoc Tech Full time R180 000 - R250 000 per year

    About UsPayDoc is a fast-growing health-tech start-up from Etherealmed, founded by a practising anaesthesiologist who understands first-hand the financial challenges specialist doctors face. Built on the success of MxNode (a proven billing platform already trusted by 400+ doctors across South Africa) PayDoc is the next step in creating seamless, mobile-first...

  • Cloud Engineer

    1 week ago

    Cape Town, Western Cape, South Africa RAY AI Full time R1 800 000 - R2 500 000 per year

    A Message from Our CEO:We are seeking a highly skilled Cloud Engineer & Infrastructure Security professional to design, build, and secure our hybrid infrastructure (cloud + on-prem). The ideal candidate will have deep experience with Kubernetes, Terraform, Helm, and a strong background in infrastructure security, DevSecOps, and on-prem deployments. This role...

  • AI Engineer

    1 week ago

    Cape Town, Western Cape, South Africa Elixirr Digital Full time R120 000 - R180 000 per year

    Are you passionate about leveraging AI to transform global industries? Do you have a proven track record of working with LLMs and building agentic solutions?Join Elixirr Digital as an AI Engineer, where you will drive innovation and help shape the future of intelligent systems for clients across industries like banking, insurance, healthcare,...

  • Data Scientist

    1 week ago

    Cape Town, Western Cape, South Africa RAY AI Full time R1 000 000 - R3 000 000 per year

    A Message from Our CEO:We are seeking a highly skilled Data Scientist with deep expertise in modern AI/ML systems, including LLMs, multimodal models, fine-tuning techniques, and advanced retrieval architectures. In this role, you will design, prototype, and deploy AI-powered solutions that leverage state-of-the-art language, vision, and agentic frameworks....

  • AI Principal Engineer

    2 hours ago

    Cape Town, Western Cape, South Africa MCO (MyComplianceOffice) Full time R2 000 000 - R2 500 000 per year

    About the RoleWe are seeking an accomplished AI Principal Engineer to lead the design, development, and optimisation of advanced AI and machine learning solutions. The ideal candidate will have a proven track record in building and deploying Large Language Model (LLM) applications at scale, with deep expertise in Retrieval-Augmented Generation (RAG), vector...

  • Lead AI Engineer

    1 week ago

    Cape Town, Western Cape, South Africa Elixirr Digital Full time R120 000 - R180 000 per year

    Are you passionate about leveraging AI to transform global industries? Do you have a proven track record of working with LLMs and building agentic solutions?Join Elixirr Digital as a Lead AI Engineer, where you will drive innovation and help shape the future of intelligent systems for clients across industries like banking, insurance, healthcare,...

  • Senior AI Engineer

    4 days ago

    Cape Town, Western Cape, South Africa Boardroom Appointments Full time R2 000 000 - R2 500 000 per year

    Senior AI Engineer - 6 Month ContractKey ResponsibilitiesBuild and deploy AI/ML models for use cases such as content recommendation, sentiment analysis, auto-tagging, voice-to-text transcription, and audience segmentation.Design intelligent tools to assist content creators, editors, and marketing teams with automation, prediction, and optimization.Develop...

  • AI ENGINEERING LEAD – design

    3 hours ago

    Cape Town, Western Cape, South Africa Acuity Consultants Full time R2 300 000 - R2 600 000 per year

    This is an exceptional opportunity for an ARTIFICIAL INTELLIGENCE ENGINEERING LEAD (AI Engineering lead) - with advanced Quantitative Analytical skills - to design, build, and run end-to-end AI Solutions for the world's leading Wellness / HealthTech Business.Based in CAPE TOWN, this AI ENGINEERING LEAD role offers a salary of R2.3m – R2.6mTHE COMPANY:This...

  • AI Lead

    4 days ago

    Cape Town, Western Cape, South Africa The Legends Agency Full time R1 500 000 - R2 500 000 per year

    Job Title: AI LeadLocation: Remote (Cape Town Preferred, Open to Candidates Anywhere in South Africa)Salary: Market RelatedWorking Hours: UK AlignedAbout the RoleWe're looking for an AI Lead to drive cutting-edge generative AI innovation in preventative healthcare. Working directly with the founder and engineering team, you'll design, prototype, and deploy...