Rust Software Engineer – LLM Evaluation

11 hours ago

Pretoria, Gauteng, South Africa Elvis Eckardt Recruitment & Sales Solutions Limited Full time
The Role:

Senior Software Engineer – Rust (LLM Evaluation & Repository Validation)

Location: Permanent Remote, Africa-Based

Contract Type: Contractor (no medical/paid leave)

Duration: 3 months (extensions possible)

Start Date: Immediate (within 1 week)

Commitment: 20–40 hours/week with some overlap with Pacific Standard Time (PST)

Experience Required: 3–8 years overall, with 2+ years in Rust

About the Project

We are building LLM evaluation and training datasets to train large language models (LLMs) to work on realistic software engineering problems. A key approach in this project involves creating verifiable SWE tasks from public repository histories in a synthetic, human-in-the-loop process. The goal is to expand dataset coverage across programming languages, complexity levels, and problem domains.

This role blends hands-on software engineering with AI-focused research, giving you a chance to work at the intersection of open-source software and cutting-edge AI systems.

Responsibilities:

  • Analyse and triage GitHub issues across trending open-source libraries.
  • Set up and configure repositories (including Dockerization and development environment setup).
  • Evaluate unit test coverage and quality across projects.
  • Run and modify codebases locally to assess LLM bug-fixing performance.
  • Collaborate with researchers to design/select repositories and tasks challenging for LLMs.
  • (Optional) Lead junior engineers collaborating on evaluation tasks.

Why Join:

  • Work remotely on impactful AI + software engineering projects.
  • Collaborate with researchers shaping the future of AI-assisted development.
  • Opportunity to contribute to real-world open-source challenges while influencing LLM training and evaluation.

Application Process: To apply, please submit your CV and a cover letter detailing your relevant experience and qualifications for the role. Applications will be reviewed on a rolling basis, so early submissions are encouraged.

Equal Opportunity Employer: We value diversity and are committed to creating an inclusive work environment. We encourage applicants from all backgrounds to apply.

Contact: Elvis Eckardt

Ideal Profile:

Must-Have Skills:

  • 3–8 years of professional software development experience.
  • Minimum 2+ years of experience with Rust in production environments.
  • Strong proficiency with Git, Docker, and software pipelines.
  • Ability to navigate and understand complex, real-world codebases.
  • Comfortable running, modifying, and testing repositories locally.

Nice-to-Have Skills:

  • Prior contributions to or evaluation of open-source projects.
  • Experience with developer tools, automation agents, or AI/LLM evaluation.
  • Exposure to LLM-related research or dataset generation.
What's on Offer?
  • Work within a company with a solid track record of success
  • Great work environment
  • Join a well known brand within IT Services

  • Evaluation Scenario Writer

    1 week ago

    Pretoria, Gauteng, South Africa Mindrift Full time R20 000 - R25 000 per year

    This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English.At Mindrift, innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of AI. What we...

  • Embedded Software Engineer

    12 hours ago

    Pretoria, Gauteng, South Africa Edrecruiters Full time

    Embedded Software Engineer: Protocols vacancy in Pretoria-East. A BEng Computer Engineering or BSc Computer Science, and 0 to 5 years of software development experience are required. The successful candidate will work in an agile development environment with other software, hardware, and R&D test engineers on multi-year international projects. Embedded...

  • Software Engineer

    1 week ago

    Pretoria, Gauteng, South Africa Hire Resolve Full time R900 000 - R1 200 000 per year

    Job Title: Software EngineerLocation: Pretoria, South AfricaHire Resolve, a reputable recruitment agency, is seeking a talented Software Engineer to join our client's team in Pretoria. The ideal candidate will have a passion for software development and a strong understanding of programming languages and technologies. As a Software Engineer, you will be...

  • Senior Software Engineer

    11 hours ago

    Pretoria, Gauteng, South Africa Edrecruiters Full time

    Senior Software Engineer is required for a leading electronic company in Pretoria-East. BEng (Electronic or Computer Engineering). Masters degree will be beneficial. 5-10 years working experience in software engineering and 2-5 years of leading a software engineering team. Senior Software EngineerPretoria-EastMinimum requirements and experience:BEng...

  • Software Engineer

    1 week ago

    Pretoria, Gauteng, South Africa Hire Resolve Full time R60 000 - R120 000 per year

    Position: Software EngineerHire Resolves client is seeking a highly skilled and experienced Software Engineer to join their dynamic team in Pretoria, Gauteng. The ideal candidate will be responsible for designing, developing, and maintaining software solutions that meet the needs of the clients and contribute to the overall success of the...

  • DSP Software Engineer

    12 hours ago

    Pretoria, Gauteng, South Africa Edrecruiters Full time

    Embedded DSP Software Engineer with a BEng Electronic Engineering, Computer Engineering, or BSc Computer Science degree is required. Cutting-edge technology 0-5 years of working experience in software development. DSP Software EngineerPretoria-EastMinimum Requirements and requirements:B. Eng. (Electronic Engineering) or BEng/BSc (Computer Engineering)0-5...

  • C++ Software Engineer

    2 days ago

    Pretoria, Gauteng, South Africa The Legends Agency Full time R520 000 - R780 000 per year

    C++ Software Engineer Join a cutting-edge simulation software company shaping real-time systems. Pretoria | R R65 000 About Our Client Our client is a specialist provider of high-performance simulation software. With a strong focus on real-time systems and mathematical modelling, the company offers an innovative environment where engineers solve complex...

  • Data Engineer

    2 weeks ago

    Pretoria, Gauteng, South Africa JorDan HR Full time R400 000 - R600 000 per year

    DATA ENGINEERLocation: GautengContract Type: 01 January December 2028 One of our clients in IT is looking to hire a Data Engineer to join their team.ESSENTIAL SKILLS Strong data engineering skills, including Python coding and data ingestion (ELT, Kafka, Apahe Spark)Familiarity with AI/ML frameworks (e.g Langchain, Langgraph, GAIA) and their integration into...

  • Junior AI Engineer

    1 week ago

    Pretoria, Gauteng, South Africa 60 Degrees Full time R734 000 - R1 142 000 per year

    Job DescriptionTHE OPPORTUNITY THAT AWAITS YOU Top grads wanted. Real AI. Real systems. Real scale.   A top Telco networking hub is building its next generation of AI capability — and are on the lookout for 5 razor-sharp Graduate AI Engineers to join the transformation. You'll help build production-grade AI systems for one of South Africa's leading ISPs,...

  • Software Engineer

    2 weeks ago

    Pretoria, Gauteng, South Africa Mukuru Full time R400 000 - R800 000 per year

    About MukuruMukuru is one of Africa's leading FinTech companies, on a mission to make financial services accessible, affordable, and reliable for everyone. With over 40 million cross-border transactions processed, we're transforming how communities move money and access financial tools that improve everyday life.From remittances to insurance, the Mukuru...