Remote AI Evaluation Scenario Designer

1 week ago


WorkFromHome, South Africa Mindrift Full time

A leading AI innovation firm is seeking a candidate to design evaluation scenarios for LLM-based agents. This fully remote freelance role involves creating structured test cases and ensuring clarity in scenario execution. Ideal candidates will hold relevant degrees and have backgrounds in QA, software testing, or data analysis. Strong analytical and communication skills in English are essential. As part of the team, you will contribute to advanced AI projects while enjoying flexible hours and competitive pay rates, with potential earnings up to $22/hour.#J-18808-Ljbffr



  • WorkFromHome, South Africa Mindrift Full time

    A forward-thinking AI company is seeking an entry-level freelance tester to design structured evaluation scenarios for LLM-based agents. This part-time role requires a Bachelor's/Master's degree in Computer Science or a related field and strong analytical skills. Responsibilities include creating test cases, defining agent behavior, and reviewing outputs....


  • WorkFromHome, South Africa Mindrift Full time

    A leading AI company is looking for an entry-level part-time freelance professional to design realistic evaluation scenarios for AI agents. Responsibilities include defining test cases, annotating tasks, and collaborating with developers. Ideal candidates will hold a degree in Computer Science and possess strong analytical skills. The role offers flexible...


  • WorkFromHome, South Africa Mindrift Full time

    A leading AI company is seeking an individual to design structured evaluation scenarios for LLM-based agents. This remote freelance role requires a Bachelor's degree in Computer Science or related fields, strong analytical skills, and proficiency in writing scenarios. You'll create realistic test cases to help shape AI technology. Benefits include flexible...


  • WorkFromHome, South Africa Mindrift Full time

    A leading AI company is seeking a candidate to design structured evaluation scenarios for LLM-based agents. The role involves creating test cases, defining acceptable behaviors, and reviewing outputs in a fully remote freelance capacity. Ideal candidates should have a relevant degree, strong analytical and communication skills, and basic experience with...


  • WorkFromHome, South Africa Mindrift Full time

    This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. At Mindrift, innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of AI. What We Do...


  • WorkFromHome, South Africa Mindrift Full time

    At Mindrift, innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of AI. What We Do The Mindrift platform, launched and powered by Toloka, connects domain experts with cutting‑edge AI projects from innovative tech clients. Our mission is to unlock the potential of GenAI by tapping into...


  • WorkFromHome, South Africa Mindrift Full time

    Be among the first 25 applicants. Get AI-powered advice on this job and more exclusive features. This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. At Mindrift, innovation meets opportunity. We believe in...


  • WorkFromHome, South Africa Taskify Ai Full time

    A leading AI research company in South Africa seeks an Audio Generalist Evaluator Expert for a remote role. This short-term opportunity is perfect for freelancers or educators, focusing on evaluating audio-based AI models and optimizing prompts. Candidates are expected to have strong writing and analytical skills, along with familiarity with AI tools....


  • WorkFromHome, South Africa Mindrift Full time

    This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. At Mindrift, innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of AI. What We Do...


  • WorkFromHome, South Africa Mindrift Full time

    Be among the first 25 applicants. NOTE: This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. At Mindrift, innovation meets opportunity. We believe in using the power of collective human intelligence to...