Senior Data Engineer I

7 days ago


Randburg, Gauteng, South Africa LexisNexis South Africa Shared Services (Pty) Ltd Company Full time

At LexisNexis we develop the legal profession's most innovative products for data analysis, visualization, and research. We use the latest techniques in AI, machine learning, and data visualization to uncover insights about judges' rulings, build forecasts of likely outcomes, and reveal critical connections in massive datasets spanning the law, news, and finance.

Responsibilities

  1. As a senior machine learning operations engineer on our team, you will work on new product development in a small team environment writing production code in both run-time and build-time environments.
  2. You will help propose and build data-driven solutions for high-value customer problems by discovering, extracting, and modeling knowledge from large-scale natural language datasets.
  3. You will prototype new ideas, collaborating with other data scientists as well as product designers, data engineers, front-end developers, and a team of expert legal data annotators.
  4. Develop and implement a strategy for continuous improvement of our Machine Learning Ops including versioning, testing, automation, reproducibility, deployment, monitoring, and data privacy.
  5. Develop and report on ML Ops metrics such as deployment frequency, lead time for changes, mean time to restore, and change failure rate.
  6. Collaborate with data scientists, data engineers, API engineers, and the dev ops team.
  7. Build scalable data ingestion and machine learning inference pipelines.
  8. Scale up production systems to handle increased demand from new products, features, and users.
  9. Provide visibility into the health of our data platform (comprehensive view of data flow, resources usage, data lineage, etc) and optimize cloud costs.
  10. Automate and handle the life-cycle of the systems and platforms that process our data.

Requirements

  • Masters degree in Software Engineering, Data Engineering, Computer Science or related field.
  • 5 years of relevant work experience.
  • Strong Scala and Python background.
  • Experience with Apache Spark and / or Ray.
  • Knowledge of AWS, GCP, Azure, or other cloud platform.
  • Knowledge of current principles and frameworks for ML Ops.
  • Experience with ML Ops technologies such as ML Flow, DVC, Grafana, DataHub, Databricks.
  • Experience with machine learning technologies such as PyTorch, TensorFlow, AWS Sagemaker.
  • Experience with CI / CD pipelines, including Jenkins or Git Actions.
  • Experience with Docker containerization or Kubernetes orchestration.
  • Experience in improving data security and privacy, and managing and reducing cloud costs.
  • Knowledge of API development and machine learning deployment.

Work in a way that works for you

We promote a healthy work / life balance across the organization, with various flexible and remote working options available to employees.

Working with Us

LexisNexis Legal & Professional is proud to be an equal-opportunity employer. We are committed to equal opportunity employment regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. Together, we are building a diverse and inclusive workplace.

Working for you

We believe in a healthy work / life balance. We know that your well-being and happiness are key to a long and successful career.

#J-18808-Ljbffr

  • Randburg, Gauteng, South Africa Dimension Data Full time

    Are you tired of being micro-managed? Are you looking for a company where no-one tells you how to do your job? Do you want to work in a team, but not be told what to do and when to do it? If so, we believe this Senior Software Engineer role is perfect for youAs a Senior Software Engineer, you'll be responsible for building and maintaining our systems. You...


  • Randburg, Gauteng, South Africa Betway Group Full time

    Kick-start your career in the online gaming world and experience the very latest in technology and innovation.Data Pipeline Design and DevelopmentSenior Data Engineers are proficient in designing and implementing scalable and efficient data pipelines. They use streaming technologies such as Apache Spark, Apache Kafka, or equivalent to extract, transform, and...


  • Randburg, Gauteng, South Africa Dimension Data Full time

    The Senior ISP Network Engineer, DSL & Telephone Cable Networks, Data Center (DC), Integrated services provider (ISP), MPLS, ACI, SDA, CORE, IP Networks will be responsible for designing and implementing complex data networks across multiple locations. The role involves working closely with business teams to provide solutions to their network challenges....


  • Randburg, Gauteng, South Africa Network IT Full time

    Reference: NWA003388-Ren-1A well-known marketing organization with branches in multiple overseas countries is looking for a Senior Data Engineer to join their organization at their Johannesburg branch. The Senior Data Engineer will be required to work on a hybrid module. Working within the Data Science Team, the Data Engineer will be responsible for the...

  • Senior Data Engineer

    19 hours ago


    Randburg, Gauteng, South Africa Indsafri Full time

    Indsafri City of Johannesburg, Gauteng, South AfricaExp Required: At least 6+ Years of relevant work experience as Data Engineer - Python & CloudJob Location: Johannesburg - Hybrid (need to go to office like 3 or 2 days in a week, rest of the days remote work)Company Name: IndsafriNotice Period: Immediate to 30 days of notice (More than 30 days of notice...


  • Randburg, Gauteng, South Africa Lexisnexis Risk Solutions Full time

    Senior Software Engineer ILocations: Johannesburg, Port Elizabeth, Durban, Cape TownTime type: Full timePosted on: Posted 2 Days AgoJob requisition id: RDo you enjoy working with innovative research technology? Would you like to be part of a team that creates solutions for our customers?About our TeamLexisNexis Legal & Professional, which serves customers in...


  • Randburg, Gauteng, South Africa Absa Group Full time

    Job DescriptionWe are seeking an experienced Data Scientist with Advanced Statistics Expertise to join our team. The successful candidate will leverage deep data science skills in advanced statistics, data wrangling, data mining, data analysis, feature engineering & predictive modeling, storytelling, distributed computing & data visualization, machine...


  • Randburg, Gauteng, South Africa Iress Full time

    Job title : Senior Data EngineerJob Location : Gauteng, JohannesburgDeadline : April 21The Senior Data Engineer is responsible for designing, developing and maintaining high-performance, secure, and compliant data software / pipeline solutions for the wider Iress South Africa business.Success in this role involves designing and implementing reliable,...


  • Randburg, Gauteng, South Africa Salt Employee Benefits Full time

    Salt Employee Benefits requires a highly skilled Senior Data Engineering Professional to lead the development of our data engineering capabilities. The ideal candidate will have a deep understanding of data engineering principles and be able to design and implement scalable and efficient data infrastructure solutions.About the Role:Lead a team of data...


  • Randburg, Gauteng, South Africa Goldman Tech Resourcing (Pty) Ltd Full time

    Senior Data EngineerA Data Science and Artificial Intelligence company is looking for a Senior Data Engineer to join their teamLocation: JohannesburgRequirements:University / Post Graduate (Masters Degree)Computer SkillsData Collection and AnalysisAction PlanningData ControlCompliance ManagementSubstantial general work experience together with comprehensive...


  • Randburg, Gauteng, South Africa i Place People Full time

    i Place People is looking for a highly skilled Data-Driven Product Specialist to join our global network. As a key member of our team, you will collect, analyze, and process data to drive informed product and sales decisions.Main ResponsibilitiesThis role demands the ability to monitor local market trends and develop effective strategies.You will create a...


  • Randburg, Gauteng, South Africa Nintex Full time

    About the JobWe are looking for a highly skilled Data Engineer with expertise in cloud-based data engineering solutions. As a Senior Data Engineer at Nintex, you will be responsible for designing, developing, and implementing high-quality data engineering products and services.


  • Randburg, Gauteng, South Africa findojobs-za Full time

    We are looking for an experienced Data Warehousing Specialist to join our team. The ideal candidate will have a strong background in data engineering and be able to design, build, and maintain large-scale data warehouses.This is a mid-senior level position that requires a high level of technical expertise and excellent problem-solving skills. The successful...

  • Data Analyst

    6 days ago


    Randburg, Gauteng, South Africa Data Bene Full time

    A vacancy exists for a Data Analyst within the Micro Merchant Division – Touchsides, in Rosebank, Johannesburg.The primary focus as Data Analyst is to collect, analyze, clean and interpret data sets across the business to make informed decisions.Utilize technical expertise to ensure data is accurate and high-quality.Key ResponsibilitiesTranslate business...


  • Randburg, Gauteng, South Africa Salt Employee Benefits Full time

    Salt Employee Benefits is searching for a seasoned Senior Big Data Engineer to join our IT team. This individual will be responsible for creating and maintaining functional requirements, system specifications, and blueprints in support of data architecture and detailed design specifications.Key Responsibilities:Work closely with business leaders to...


  • Randburg, Gauteng, South Africa Relx Full time

    Senior Data ScientistDo you have extensive experience in data science and a proactive attitude that drives excellence? Do you enjoy being part of a team that works with a diverse range of technologies?About our TeamLexisNexis Legal & Professional, which serves customers in more than countries with 11,000 employees worldwide, is part of RELX, a global...

  • Data Engineer

    7 days ago


    Randburg, Gauteng, South Africa Network IT Full time

    Senior Data EngineerReference: NWA003386-Ren-1A well-known marketing organization with branches in multiple overseas countries is looking for a Senior Data Engineer to join their organization at their Johannesburg branch. The Senior Data Engineer will be required to work on a hybrid model. Working within the Data Science Team, the Data Engineer will be...

  • Engineering Lead

    4 days ago


    Randburg, Gauteng, South Africa Proconics Full time

    Career OpportunityProconics is seeking an Engineering Lead - C&I Systems to oversee the development, design, and implementation of control and instrumentation systems.


  • Randburg, Gauteng, South Africa LexisNexis South Africa Shared Services (Pty) Ltd Company Full time

    At LexisNexis Legal & Professional, we harness the power of innovative data solutions to drive business growth and success.About UsLeverage your expertise in machine learning operations to develop cutting-edge products that transform the legal profession.Job DescriptionAs a senior data engineer on our team, you will lead the design and implementation of...


  • Randburg, Gauteng, South Africa Betway Group Full time

    Join Betway Group as a Senior Data Engineer and play a key role in shaping our data engineering strategy. As a Senior Data Engineer, you will be responsible for designing and implementing data pipelines, database management, data modeling, and data quality and governance.About the Team:Our team is passionate about delivering high-quality data solutions that...