Data Engineer Leader

1 month ago

Cape Town, Western Cape, South Africa LexisNexis South Africa Shared Services (Pty) Ltd Company Full time
About the Role

We are seeking a skilled Senior Data Engineer I to join our team at LexisNexis South Africa Shared Services (Pty) Ltd Company.

As a senior machine learning operations engineer, you will work on new product development in a small team environment writing production code in both run-time and build-time environments. You will help propose and build data-driven solutions for high-value customer problems by discovering, extracting, and modeling knowledge from large-scale natural language datasets.

You will prototype new ideas, collaborating with other data scientists as well as product designers, data engineers, front-end developers, and a team of expert legal data annotators. You will get the experience of working in a start-up culture with the large datasets and many other resources of an established company.

  • Develop and implement a strategy for continuous improvement of our Machine Learning Ops including versioning, testing, automation, reproducibility, deployment, monitoring, and data privacy
  • Develop and report on ML Ops metrics such as deployment frequency, lead time for changes, mean time to restore, and change failure rate
  • Collaborate with data scientists, data engineers, API engineers, and the dev ops team
  • Build scalable data ingestion and machine learning inference pipelines
  • Scale up production systems to handle increased demand from new products, features, and users
  • Provide visibility into the health of our data platform (comprehensive view of data flow, resources usage, data lineage, etc) and optimize cloud costs
  • Automate and handle the life-cycle of the systems and platforms that process our data
Requirements
  • Masters degree in Software Engineering, Data Engineering, Computer Science or related field
  • 5 years of relevant work experience
  • Strong Scala and Python background
  • Experience with Apache Spark and/or Ray
  • Knowledge of AWS, GCP, Azure, or other cloud platform
  • Knowledge of current principles and frameworks for ML Ops
  • Experience with ML Ops technologies such as ML Flow, DVC, Grafana, DataHub, Databricks
  • Experience with machine learning technologies such as PyTorch, TensorFlow, AWS Sagemaker
  • Experience with CI/CD pipelines, including Jenkins or Git Actions
  • Experience with Docker containerization or Kubernetes orchestration
  • Experience in improving data security and privacy, and managing and reducing cloud costs
  • Knowledge of API development and machine learning deployment
About Us

We promote a healthy work/life balance across the organization, with various flexible and remote working options available to employees.

LexisNexis Legal & Professional is proud to be an equal-opportunity employer. We are committed to equal opportunity employment regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status.

  • Data Engineering Leader

    2 weeks ago

    Cape Town, Western Cape, South Africa CodeConnect Staffing (Pty) Ltd Full time

    About CodeConnect Staffing (Pty) Ltd:A forward-thinking global organization, driving innovation and shaping the future of technology in Africa.We're seeking a Senior Data Engineer to join our team and contribute to our exciting journey.Key Responsibilities:Design and maintain scalable data pipelines.Architect efficient and modern data solutions.Develop and...

  • Data Engineering Leader

    1 month ago

    Cape Town, Western Cape, South Africa Aculocity Full time

    Aculocity is seeking an exceptional Senior Data Engineer to lead the development and optimization of its data infrastructure and pipelines. This is a pivotal role in our agile Data Engineering team, where you will play a key part in designing, building, and maintaining complex data systems.We are looking for a seasoned professional with extensive experience...

  • Senior Technology Leader

    1 month ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    Job OverviewWe are seeking a Senior Technology Leader to join our team at Dimension Data. This is an exciting opportunity for an experienced software architect to take on a leadership role and shape the technology direction of our organization.About the RoleThe Senior Technology Leader will be responsible for designing, modifying, and integrating software...

  • Highly Skilled Network Engineer

    1 month ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    Job DescriptionWe are seeking a highly skilled network engineer to join our team at Dimension Data. As a network engineer, you will be responsible for designing, implementing and supporting new IT projects in modern networks, security solutions and cloud technologies.The ideal candidate will have at least 2 years' experience in networking field and possess...

  • Senior Data Engineering Manager

    1 week ago

    Cape Town, Western Cape, South Africa Datonomy Solutions Full time

    Datonomy Solutions is seeking an experienced Senior Data Engineering Manager to lead our data engineering team. As a key leader, you will be responsible for designing, implementing, and maintaining large-scale data systems, driving business growth through data-driven insights.About the RoleYou will oversee the development and maintenance of data pipelines,...

  • Data Architect

    1 month ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    Are you a skilled Data Engineer looking to take your career to the next level?We're seeking an experienced Data Architect to join our team at Dimension Data!About the Role:We're looking for a highly skilled Data Architect to design and build the data architecture of our products. As a key member of our team, you will use your technical knowledge to help us...

  • Data Engineering Leader

    1 month ago

    Cape Town, Western Cape, South Africa CodeConnect Staffing (Pty) Ltd Full time

    Company OverviewCodeConnect Staffing (Pty) Ltd is a dynamic and forward-thinking organization, driving innovation and shaping the future of technology in Africa.We are seeking a talented Senior Data Engineer to join our team and contribute to our exciting journey. This opportunity provides you with the chance to work with a company that is making significant...

  • Data Centrix Senior Virtualization Engineer

    1 month ago

    Cape Town, Western Cape, South Africa Data Centrix Full time

    Data Centrix is seeking a highly skilled VMware Server Engineer to join our team. As a critical member of our infrastructure team, you will be responsible for designing, implementing, and maintaining our virtualized environments.The ideal candidate will have extensive experience supporting Microsoft Exchange 2010 or higher, Active Directory, and Hyper-V....

  • Data Transformation Leader

    1 month ago

    Cape Town, Western Cape, South Africa Artefact Full time

    Job OverviewWe are seeking a seasoned Data Transformation Leader to join our team at Artefact. As a key member of our Consulting department, you will be responsible for delivering and managing projects that drive business growth and digital transformation for our clients.The ideal candidate will have a strong background in consulting and project management,...

  • Senior Data Scientist

    2 months ago

    Cape Town, Western Cape, South Africa Acuity Consultants Full time

    Job Title: Senior Data ScientistThis is an exciting opportunity for a Senior Data Scientist to drive transformative data science and machine learning solutions for high-profile global clients.Key Responsibilities:Conducting exploratory data analysis (EDA)Developing and deploying machine learning modelsApplying statistical methods to validate findingsData...

  • Data Governance Platforms Leader

    1 month ago

    Cape Town, Western Cape, South Africa Sanlam Full time

    Job DescriptionWe are seeking a highly skilled and experienced leader to fill the role of Data Governance Platforms LeaderAbout UsSanlam is a leading financial services group that provides a wide range of products and services to individuals, businesses, and organizations. We are committed to building strong relationships with our clients and employees, and...

  • Data Engineer for Innovative Data Platforms

    7 days ago

    Cape Town, Western Cape, South Africa Progressive IT Resourcing Full time

    Job DescriptionWe are seeking an experienced Data Engineer to join our team at Progressive IT Resourcing. As a key member of our data engineering organization, you will play a crucial role in designing and implementing scalable, secure, and efficient data platforms that enable business growth and innovation.About the RoleThis is an exciting opportunity for a...

  • Data Engineer

    4 weeks ago

    Cape Town, Western Cape, South Africa NOV Full time

    Unlock your potential as a Data Engineer with NOV, a global leader in designing and manufacturing tools for the energy industry. We are seeking an experienced professional to join our team in Cape Town.Job DescriptionWe are looking for a skilled Data Engineer to develop reporting and analysis software for our internal customers. As a key member of our team,...

  • Technical Leader for Data Modeling and Development

    4 weeks ago

    Cape Town, Western Cape, South Africa LexisNexis Full time

    Job DescriptionThis position involves serving as a technical leader for data modeling and development at LexisNexis. As a seasoned software engineer with 10+ years of experience, you will play a key role in developing and leading large multifunctional development activities.BASIC FUNCTIONS:Assist management in providing input and guidance on complex...

  • Data Center Operations Specialist

    1 month ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    About Dimension DataWe are a global technology company that provides innovative solutions to our clients. Our Data Center Operations team is responsible for ensuring the smooth operation of our data centers, providing a secure and reliable environment for our clients' data.Job SummaryWe are seeking an experienced Data Center Operations specialist to join our...

  • Electrical Engineer

    2 months ago

    Cape Town, Western Cape, South Africa Amazon Data Services South Africa (Pty) Ltd Full time

    About the RoleAs an Electrical Engineer - Data Center Specialist at Amazon Data Services South Africa (Pty) Ltd, you will play a vital role in ensuring the design, construction, and operation of our data centers. You will be responsible for performing design and equipment submittal reviews, troubleshooting site/equipment failures, and providing full...

  • Data Centrix Senior Systems Architect

    7 days ago

    Cape Town, Western Cape, South Africa Data Centrix Full time

    Job SummaryData Centrix is seeking a highly experienced Senior Server Engineer to join our team. As a key member of our data centre operations, you will be responsible for the proactive management and support of our Microsoft 365 environment, including Exchange, Hyper-V, and Azure.About UsData Centrix is a leading provider of IT services, committed to...

  • Data Center Electrical Engineer Expert

    1 month ago

    Cape Town, Western Cape, South Africa Amazon Data Services South Africa (Pty) Ltd Full time

    Company OverviewAmazon Data Services South Africa (Pty) Ltd is a leading provider of cloud computing services. We empower businesses to innovate and grow by providing a robust suite of products and services.Job SummaryWe are seeking an experienced Data Center Electrical Engineer Expert to join our team. As a key member of our AWS Infrastructure Services, you...

  • Highly Skilled Network Engineer for Dimension Data

    1 month ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    Job SummaryWe are seeking an experienced Network Engineer to join our team at Dimension Data. As a key member of our technical staff, you will be responsible for ensuring the smooth operation of our IT infrastructure.Your primary focus will be on managing hardware, software, and networks to guarantee optimal performance. You should have extensive knowledge...

  • Data Science Leader

    3 weeks ago

    Cape Town, Western Cape, South Africa ShopriteX Full time

    Job OverviewWe are seeking a highly skilled Data Science Leader to join our team at ShopriteX, a leading retailer in Africa. This is an exciting opportunity to lead complex data science initiatives and drive business growth through innovative solutions.