RAG Developer

Backend Software Developer - AI Integrations (RAG)

About the Role:

Kaleidocode is an exciting software development consultancy that is looking for an experienced software developer to help our team build reliable, high-performing AI systems. You will need to design and build Retrieval-Augmented Generation (RAG) systems that combine cutting-edge LLMs with scalable, production-ready retrieval architectures. You'll develop RAG pipelines, expose them via APIs, and ensure reliability through automated testing and CI/CD pipelines.

What You'll Do:

• Develop and optimize RAG pipelines using vector databases (Solr, Pinecone, Weaviate, FAISS) and LLM APIs (OpenAI, Anthropic, Hugging Face).
• Build and maintain RESTful APIs (FastAPI or Flask) to serve AI-powered retrieval and generation capabilities.
• Implement robust testing, monitoring, and CI/CD pipelines for deployment and reliability.
• Integrate with internal and external systems to deliver scalable, observable AI microservices.

This is an exciting opportunity to expand your skill set and work on exciting projects for a global client. You'll be part of a forward-thinking, highly skilled team pushing the boundaries of applied AI.

Requirements

• Advanced level of proficiency in Python.
• Proven 3 years back-end develoment experience in commercial projects.
• Preferably experience working with LLM APIs, RAG architectures, and vector search technologies.
• Strong grasp of testing, Docker, CI/CD, and observability tools (e.g. Grafana, Prometheus, OpenTelemetry).

The ideal candidates would have:

• Ability to work effectively as part of a team and independently
• Ability to work in a variety of client settings and in a team-oriented environment
• Passion for the software industry and a wide interest in technology
• Good communication skills
• Knowledge of Agile/Scrum methodologies.

We appreciate people with a creative approach to problem-solving and a passion to grow their skills. You will work alongside smart, focused colleagues who design, code and deploy meaningful software with modern tools and processes.

Preferred Qualifications

Degree or Diploma in IT or Computer Science

Kaleidocode is an established premium consultancy, known by our clients around the globe as highly skilled software professionals who deliver and add value.

Salary
Salary offered will be commensurate with level of skill and experience.

Location
Kaleidocode (Pty) Ltd is based in Durban, KZN, South Africa. Remote applications are welcome, but visits to our Durban offices or client sites may be required.

Responses
If you have not received a response within 4 weeks please consider your application to have been unsuccessful.

Data Privacy
By applying for this position, you consent to providing Kaleidocode Pivot Pty Ltd and Kaleidocode Pty Ltd with your personal information. This information will be used for the purposes of your application for a position within our company, and will not be made available to any other parties without your prior consent. Should your application be successful, we may require further personal or special information which will be obtained with your consent.

---