Automation Tester for AI-Driven Applications

3 weeks ago


WorkFromHome, South Africa Sourceworx Full time

Automation Tester for AI-Driven Applications Job Purpose The tester will be responsible for validating the functionality, performance, and reliability of AI‑driven systems and applications. This includes designing and executing test cases for automation flows and intelligent features integrated into enterprise platforms. Important: This role is not about using AI for testing. Instead, this is about testing applications where AI has been used. Testers are required to understand the probabilistic nature of AI‑driven systems and should be able to test applications for factual correctness, hallucinations, guardrail breaches, and safety. Testers should have a firm understanding of GenAI tools such as ChatGPT, Gemini, etc., with an understanding of the patterns on how they provide answers and where they may provide inconsistent or incorrect answers. Elementary courses in prompt engineering will be highly beneficial. Experience At least 5-7 years in the field of test engineering. AI Tools Knowledge of GPT‑4.0 or other LLMs, as well as expertise in prompt engineering, is highly beneficial. Familiarity with the Microsoft Responsible AI Toolbox, AI Foundry, and Guardrail. Automation Tools Significant expertise in automation tools such as Selenium, JMeter, LoadRunner, or Appium for automating web, mobile, and performance testing. CI/CD Integration A strong grasp on continuous integration and continuous deployment tools such as Jenkins, Bamboo, or GitLab CI/CD to automate build and deployment processes. Quality Assurance Thorough understanding of Quality Assurance principles, testing methodologies, and best practices. The ability to develop robust automation frameworks to ensure the highest standards of quality in our products. Preferred Skills Experience in the Fintech/BFSI domain. Availability for remote or onsite work. Proficiency in automation and framework development. Expertise in validating data correction and hallucination. Expertise in AzureDevOps or Jira. Industry Standards Understanding of software development methodologies like Agile, Scrum, and DevOps practices. Roles And Responsibilities Role Focus: Testing and evaluating AI‑driven applications. Skills Required: Proficiency in testing and evaluating technology. Work Environment: Agile model, collaboration with Development and Integration teams. Independence: Ability to work independently and bring innovative ideas. Daily and weekly test reporting. Defect tracking. Attending daily stand‑up and retrospective meetings. Problem‑solving and root cause analysis. Automation scripts and test case accuracy. Analytical Skills: Ability to analyze test results, identify trends, and derive meaningful insights. Desired Traits: Detail‑oriented, innovative, analytical. #J-18808-Ljbffr



  • WorkFromHome, South Africa Sourceworx Full time

    Job Purpose The tester will be responsible for validating the functionality, performance, and reliability of AI-driven systems and applications. This includes designing and executing test cases for automation flows, and intelligent features integrated into enterprise platforms. This role is not about using AI for testing. Instead, this is about testing...


  • WorkFromHome, South Africa Sourceworx Full time

    A leading technology firm in Johannesburg is seeking an Automation Tester with 5-7 years of test engineering experience. The role requires validating AI-driven applications and understanding the patterns of AI tools. Key responsibilities include developing test cases, defect tracking, and reporting results. Proficiency in automation tools such as Selenium...


  • WorkFromHome, South Africa Sourceworx Full time

    A technology firm specializing in AI is seeking a Test Engineer to validate the functionality and performance of AI-driven systems. The role requires expertise in test engineering, automation tools, and AI technologies like GPT-4. Candidates should have 5-7 years of experience and be detail-oriented problem solvers able to work in an agile environment. This...

  • Automation Tester

    3 weeks ago


    WorkFromHome, South Africa Arch Retail Solutions Full time

    Join to apply for the Automation Tester role at Arch Retail Solutions . We’re looking for a Automation Tester to lead test automation across projects and teams in a fast-paced retail environment. Responsibilities Designing, implementing, and maintaining scalable test frameworks Driving QA standards and mentoring testers across the business Collaborating...


  • WorkFromHome, South Africa Loubby AI Full time

    Job Overview The AI Automation Expert Trainer (N8n) plays a crucial role in the organization by crafting and delivering an advanced curriculum focused on AI automation tools such as N8n, Zapier, Make, and Airtable. This role is essential in elevating the skills of professionals across multiple countries, ensuring they adopt cutting‑edge AI strategies...

  • Automation Tester

    4 weeks ago


    WorkFromHome, South Africa Spinnaker Software Full time

    Overview We’re looking for a Automation Tester to lead test automation across projects and teams in a fast-paced retail environment. Responsibilities Designing, implementing, and maintaining scalable test frameworks Driving QA standards and mentoring testers across the business Collaborating with developers and stakeholders to ensure quality at every stage...


  • WorkFromHome, South Africa Loubby AI Full time

    A leading AI education firm in South Africa is seeking an AI Automation Expert Trainer to develop and deliver training on tools like N8n, Zapier, Make, and Airtable. This full-time role involves mentoring professionals and creating tailored course content aimed at enhancing AI skills in diverse organizational contexts. The ideal candidate should possess...


  • WorkFromHome, South Africa IQbusiness Full time

    iqx the Technology Division of iqbusiness is looking for a skilled Senior Automation Tester for one of our clients in Johannesburg. We are looking for a skilled and motivated Automation Tester with strong experience with test automation and continuous integration/delivery tools such as Selenium, Cucumber, Cypress and others. Experience, skill and capability...


  • WorkFromHome, South Africa Executive Placements Full time

    AI and Automation Expert Location : Remote Salary : R pm Company Overview Join a cutting-edge technology firm at the forefront of AI innovation. We develop transformative AI-powered solutions that revolutionize business operations across industries. Our team is passionate about creating intelligent automation systems that drive measurable business impact and...

  • Junior Tester

    3 weeks ago


    WorkFromHome, South Africa Santam Insurance Full time

    Stay safe online. Now more than ever it’s important to be cybersafe. See Santam’s tips to help you stay safe online. Learn more. The Santam Finance team has a position available for an Automation Tester who will be based in Bellville (Hybrid). JOB DESCRIPTION The incumbent will take responsibility for the automation testing process, tools, techniques,...