AI Model Evaluation Specialist

6 days ago


Cape Town, Western Cape, South Africa ENGINEERINGUK Full time

We are seeking a highly skilled AI Model Evaluation Specialist to join our team at ENGINEERINGUK. As an AI Model Evaluation Specialist, you will play a critical role in evaluating labels and annotated data for various projects across our organization, ensuring the accuracy and effectiveness of our advanced natural language processing models.

About the Role

The ideal candidate will have a strong background in linguistics, with experience in annotating texts across various experiences, organizations, and more, to support the creation of specialized models. You will also be responsible for ensuring the accuracy and integrity of the annotated data by performing regular quality checks and identifying and addressing inconsistencies.

Key Responsibilities
  • Evaluate labels and annotated data for various projects across our organization, some projects will last longer than others, but expect a variation of different evaluation requests month to month.
  • Domain Expertise: Gain proficiency in understanding and annotating texts across various experiences, organizations and more, to support the creation of specialized models.
Required Skills and Qualifications

To be successful in this role, you will need to have:

  • Native German Speaker
  • At least 6 months Auditing experience in Quality assurance or Annotations teams providing both German and English Support
  • Matric/Grade12/NQF4 or equivalent or higher qualification/s
  • Comfort and experience communicating and influencing across job levels with both internal and external partners
  • Ability to deep dive on audited results to find root causes
  • Must be exceeding quality targets and productivity targets for the last 3 months
  • Not currently on attendance probation or any conduct warnings in the last 3 months
  • Strong understanding of linguistic concepts, grammar, syntax, and language variations.

We are looking for a motivated and detail-oriented individual who is passionate about delivering high-quality results. If you have a strong background in linguistics and are looking for a challenging role that will utilize your skills, please submit your application.


  • AI Model Evaluator

    1 week ago


    Cape Town, Western Cape, South Africa ACCA Careers Full time

    As an AI Model Evaluator at ACCA Careers, you will be responsible for assessing the quality of AI model outputs and providing feedback to science teams to enhance model performance. This involves working closely with human-in-the-loop annotators and ML models to identify areas for improvement.You will need to have excellent analytical skills, with experience...


  • Cape Town, Western Cape, South Africa Mindrift Full time

    Key Responsibilities:Generate prompts that challenge AI models.Define comprehensive scoring criteria to evaluate the accuracy of the AI's answers.Correct the model's responses based on your domain-specific knowledge.


  • Cape Town, Western Cape, South Africa Findojobs South Africa Full time

    We are looking for an AI Model Enhancement and Implementation Professional to join our Technology Group in Cape Town. At Findojobs South Africa, we're a Microsoft Advanced Specialist Partner with South African roots, offering expertise in automation, software innovation & IoT, digital workplaces, data, and generative AI.About the Role:Enhance AI models for...


  • Cape Town, Western Cape, South Africa Findojobs South Africa Full time

    About the Role:As a Generative AI Model Developer at Findojobs South Africa, you will be responsible for designing, developing, and deploying advanced generative AI models. You will leverage your extensive knowledge of machine learning concepts to create innovative solutions that enhance user experiences. Your contributions will play a crucial role in...


  • Cape Town, Western Cape, South Africa Mindrift Full time

    Mindrift is a platform that connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe.About The JobWe are looking for an experienced Economist to work on AI projects that aim to improve GenAI models' ability to address specialized...


  • Cape Town, Western Cape, South Africa Mindrift Full time

    About the Role We are seeking a skilled AI tutor in physics to collaborate on projects that focus on enhancing the capabilities of Generative AI models. As an AI tutor, you will play a crucial role in shaping the future of AI technology by applying your domain-specific knowledge to refine the model's responses. Key Responsibilities Generate high-quality...


  • Cape Town, Western Cape, South Africa ENGINEERINGUK Full time

    Job Summary:">We are seeking a highly motivated AI Model Trainer and Analyst to join our team at ENGINEERINGUK. As a key member of our operations team, you will be responsible for developing and maintaining AI models, analyzing data, and providing insights to drive business growth.This is an excellent opportunity to apply your analytical skills and...


  • Cape Town, Western Cape, South Africa Outlier Full time

    Math Expert WantedWe are looking for a skilled Math Expert to contribute to our AI model training process. This freelance opportunity allows you to work from anywhere and set your own schedule.About the RoleYou will assess the accuracy and relevance of text generated by AI models, using your mathematical expertise.Crafting questions and answers related to...


  • Cape Town, Western Cape, South Africa Impact Full time

    Job DescriptionWe are seeking a talented Senior Data Scientist / Data Scientist with a passion for working with generative AI models such as large language models (LLMs).You will be part of a cross-functional squad working on developing and fine-tuning AI models to support influencer marketing activities.The successful candidate will have excellent...


  • Cape Town, Western Cape, South Africa Findojobs South Africa Full time

    We're seeking a Conversational AI Interaction Designer to join our Technology Group in Cape Town. At Findojobs South Africa, we're a Microsoft Advanced Specialist Partner with South African roots, providing expertise in automation, software innovation & IoT, digital workplaces, data, and generative AI.About the Position:Design conversational AI interactions...


  • Cape Town, Western Cape, South Africa Datonomy Solutions Full time

    Datonomy Solutions is committed to delivering innovative retail solutions that transform customer experiences. As a Senior Generative AI Specialist, you will play a crucial role in designing and developing cutting-edge AI models that drive business growth and improve operational efficiency.About the Job:This exciting opportunity involves collaborating with...


  • Cape Town, Western Cape, South Africa Findojobs South Africa Full time

    We're looking for an expert AI Development and Optimization Professional to join our team at Findojobs South Africa in Cape Town. As a Microsoft Advanced Specialist Partner with South African roots, we offer cutting-edge expertise in automation, software innovation & IoT, digital workplaces, data, and generative AI.About the Job:We need a talented individual...

  • AI Model Evaluator

    2 weeks ago


    Cape Town, Western Cape, South Africa findojobs-za Full time

    Job Overview: Our team is passionate about human motivation and behavior and uses machine learning, classification algorithms, and scalable platform services to have a cross-org impact every day. We evaluate user research, customer experience knowledge, data, and cross-Amazon Moderation expertise to ensure other teams think about customer...


  • Cape Town, Western Cape, South Africa Amazon Development Centre (South Africa) (Proprietary) Limited Full time

    Job DescriptionWe are seeking a highly skilled Data Quality and Insights Analyst to join our team at Amazon Development Centre (South Africa) (Proprietary) Limited. In this role, you will be responsible for assessing the quality of annotated training data for AI models and providing insights to drive improvement.The ideal candidate will have experience...


  • Cape Town, Western Cape, South Africa Sigma AI Full time

    Job DetailsSigma.AI is a global technology company that specializes in data collection and annotation for AI system development.We are seeking highly skilled native Vietnamese speakers to contribute to our remote projects. The work can be done from anywhere with an internet connection and is available 24 hours a day.Main ResponsibilitiesAssessing and...


  • Cape Town, Western Cape, South Africa ENGINEERINGUK Full time

    AI Training Data Specialist, Japanese Language DivisionJob Description:We are looking for a highly skilled and motivated AI Training Data Specialist to join our Japanese Language Division at ENGINEERINGUK. As a specialist, you will be responsible for creating high-quality annotated datasets that will be used to train and improve generative AI...


  • Cape Town, Western Cape, South Africa Impact Full time

    We are a dynamic company that is transforming the way businesses manage and optimize all types of partnerships—including traditional rewards affiliates, influencers, commerce content publishers, B2B, and more.What You'll Do:Develop and refine AI models to support influencer marketing efforts, driving informed decision-making through data-driven...

  • Senior AI Engineer

    1 week ago


    Cape Town, Western Cape, South Africa MSP Staffing (PTY) LTD Full time

    MSP Staffing (PTY) LTD is seeking a talented Senior Machine Learning Engineer/Lead Data Scientist to join our team. As a key member of our AI division, you will be responsible for leading the development of innovative AI solutions and driving impactful projects.Required Skills and QualificationsTo succeed in this role, you will need to possess a strong...


  • Cape Town, Western Cape, South Africa Solenya Full time

    About SolenyaSolenya is a pioneering company tackling an extremely complex problem: zero-shot multimodal personalized search and recommendations. We're on a mission to transform e-commerce as we know it.We've made significant progress, with our first client already experiencing the benefits of our innovative solution. Our team is scaling up, and we're poised...

  • AI Data Specialist

    2 weeks ago


    Cape Town, Western Cape, South Africa Mukuru Full time

    The AI Data SpecialistThe AI Data Specialist will be responsible for developing and maintaining robust data pipelines, ensuring data quality, and performing advanced data analysis to support business objectives, while leveraging their expertise in machine learning and data management to optimize models and automate processes, contributing to the enhancement...