Senior Data Engineer

4 days ago

Randburg, Gauteng, South Africa Iress Full time

Job title : Senior Data Engineer

Job Location : Gauteng, Johannesburg

Deadline : April 21

The Senior Data Engineer is responsible for designing, developing and maintaining high-performance, secure, and compliant data software / pipeline solutions for the wider Iress South Africa business.

Success in this role involves designing and implementing reliable, maintainable, and regulation-compliant scalable data processing solutions that align with business requirements and industry standards.

The ideal candidate has strong technical expertise in financial markets and software and data engineering, ensuring systems meet correctness, performance, regulatory compliance, and availability expectations.

Some of the awesome things you'll be involved with:

  1. Design and develop high-quality data processing solutions for financial markets applications.
  2. Ensure correctness and accuracy of financial and other data processing.
  3. Implement and maintain data processing systems that meet business, compliance, and regulatory standards.
  4. Optimize performance and availability of data processing systems.
  5. Deliver solutions in short cycles, ensuring rapid feedback and the ability to course-correct as needed.
  6. Collaborate with key stakeholders to ensure reliability, security, and operational resilience.
  7. Conduct code reviews, testing, debugging, and troubleshooting to ensure software and data quality and system stability.
  8. Document technical specifications, system architectures, and deployment procedures.
  9. Mentor and support junior engineers, fostering continuous learning and knowledge sharing.
  10. Work with infrastructure and cloud teams to ensure smooth deployment, monitoring, and operational continuity of production systems.
  11. Contribute to architectural decisions and technical strategy with a focus on long-term maintainability and compliance.

What you will bring:

  1. Bachelor's degree in Computer Science, Engineering, or a related field (required).
  2. 5+ years of experience in software development, preferably within financial markets, trading, or regulatory-compliant systems.
  3. 5+ years of experience designing and maintaining scalable data pipelines.
  4. Proven experience as a Data Engineer or similar role, with a strong understanding of data engineering principles, methodologies, and best practices.
  5. Proficiency in programming languages such as Python, Java, or Scala, and experience with data processing frameworks such as Apache Spark, Apache Flink, or Apache Beam.
  6. Experience with relational databases (e.g., PostgreSQL, MySQL), NoSQL databases (e.g., MongoDB, Cassandra), and data warehousing technologies (e.g., Snowflake, BigQuery).
  7. Solid understanding of data modeling concepts, data warehousing architectures, and ETL processes.
  8. Strong analytical and problem-solving skills, with the ability to design and implement scalable data solutions to address complex business requirements.
  9. Experience working in regulated environments with a focus on auditability and data integrity.
  10. Certifications in relevant technologies or methodologies are a plus (e.g., AWS Certified Developer, Financial Markets Certifications).

Professional Skills and Competencies:

  1. Software Development & Architecture: Designs and builds reliable, maintainable, and well-structured scalable data processing systems using modern programming languages and frameworks.
  2. Testing & Quality Assurance: Implements robust testing strategies, including unit, integration, regression, and auditability testing.
  3. Performance & Availability Optimization: Enhances system reliability, uptime, and responsiveness under expected loads.
  4. Risk & Compliance Management: Ensures adherence to financial regulations, security policies, and industry standards.
  5. Data Governance & Security: Experience with data privacy, compliance, and governance.
  6. Understanding of data lineage, metadata management, and observability.
  7. Experience implementing RBAC (Role-Based Access Control) and security best practices.
  8. Incident Management & Troubleshooting: Diagnoses and resolves production issues to maintain system stability.
  9. Collaboration & Communication: Works closely with product, engineering, security, and SRE teams to develop and maintain resilient software and data processing systems.
  10. Iterative Delivery & Continuous Improvement: Adopts a short-cycle development approach for rapid feedback and course correction.
  11. Technical Leadership & Mentorship: Contributes to system design decisions and provides technical guidance to junior engineers.
  12. Industry Awareness & Continuous Learning: Keeps up with financial markets trends, software engineering advancements, and best practices in cloud and security.

Technology Stack:

  1. Languages: Python, Java, Scala, scripting / automation languages (Bash, Powershell, Make etc.)
  2. Data processing frameworks: Apache Spark, Apache Flink, Apache Beam
  3. Databases: Relational databases (MS SQL, PostgreSQL, MySQL), NoSQL databases (MongoDB, Cassandra)
  4. Data platform: Databricks
  5. Hosting: AWS
  6. CI / CD Tools: GitHub, Buildkite, Artifactory
  7. IaC Tools: Terraform
#J-18808-Ljbffr

  • Senior Software Engineer

    4 days ago

    Randburg, Gauteng, South Africa Dimension Data Full time

    Are you tired of being micro-managed? Are you looking for a company where no-one tells you how to do your job? Do you want to work in a team, but not be told what to do and when to do it? If so, we believe this Senior Software Engineer role is perfect for youAs a Senior Software Engineer, you'll be responsible for building and maintaining our systems. You...

  • Senior Data Engineer

    4 days ago

    Randburg, Gauteng, South Africa Betway Group Full time

    Kick-start your career in the online gaming world and experience the very latest in technology and innovation.Data Pipeline Design and DevelopmentSenior Data Engineers are proficient in designing and implementing scalable and efficient data pipelines. They use streaming technologies such as Apache Spark, Apache Kafka, or equivalent to extract, transform, and...

  • Senior ISP Network Engineer

    4 days ago

    Randburg, Gauteng, South Africa Dimension Data Full time

    The Senior ISP Network Engineer, DSL & Telephone Cable Networks, Data Center (DC), Integrated services provider (ISP), MPLS, ACI, SDA, CORE, IP Networks will be responsible for designing and implementing complex data networks across multiple locations. The role involves working closely with business teams to provide solutions to their network challenges....

  • Senior data engineer

    4 days ago

    Randburg, Gauteng, South Africa Network IT Full time

    Reference: NWA003388-Ren-1A well-known marketing organization with branches in multiple overseas countries is looking for a Senior Data Engineer to join their organization at their Johannesburg branch. The Senior Data Engineer will be required to work on a hybrid module. Working within the Data Science Team, the Data Engineer will be responsible for the...

  • Senior Data Engineering Professional

    4 days ago

    Randburg, Gauteng, South Africa Salt Employee Benefits Full time

    Salt Employee Benefits requires a highly skilled Senior Data Engineering Professional to lead the development of our data engineering capabilities. The ideal candidate will have a deep understanding of data engineering principles and be able to design and implement scalable and efficient data infrastructure solutions.About the Role:Lead a team of data...

  • Senior Data Engineer Johannesburg

    3 days ago

    Randburg, Gauteng, South Africa Goldman Tech Resourcing (Pty) Ltd Full time

    Senior Data EngineerA Data Science and Artificial Intelligence company is looking for a Senior Data Engineer to join their teamLocation: JohannesburgRequirements:University / Post Graduate (Masters Degree)Computer SkillsData Collection and AnalysisAction PlanningData ControlCompliance ManagementSubstantial general work experience together with comprehensive...

  • Senior Data Engineer

    4 days ago

    Randburg, Gauteng, South Africa Nintex Full time

    About the JobWe are looking for a highly skilled Data Engineer with expertise in cloud-based data engineering solutions. As a Senior Data Engineer at Nintex, you will be responsible for designing, developing, and implementing high-quality data engineering products and services.

  • Data Analyst

    3 days ago

    Randburg, Gauteng, South Africa Data Bene Full time

    A vacancy exists for a Data Analyst within the Micro Merchant Division – Touchsides, in Rosebank, Johannesburg.The primary focus as Data Analyst is to collect, analyze, clean and interpret data sets across the business to make informed decisions.Utilize technical expertise to ensure data is accurate and high-quality.Key ResponsibilitiesTranslate business...

  • Senior Data Engineering Role

    4 days ago

    Randburg, Gauteng, South Africa findojobs-za Full time

    We are looking for an experienced Data Warehousing Specialist to join our team. The ideal candidate will have a strong background in data engineering and be able to design, build, and maintain large-scale data warehouses.This is a mid-senior level position that requires a high level of technical expertise and excellent problem-solving skills. The successful...

  • Data Engineer

    4 days ago

    Randburg, Gauteng, South Africa Network IT Full time

    Senior Data EngineerReference: NWA003386-Ren-1A well-known marketing organization with branches in multiple overseas countries is looking for a Senior Data Engineer to join their organization at their Johannesburg branch. The Senior Data Engineer will be required to work on a hybrid model. Working within the Data Science Team, the Data Engineer will be...

  • Senior Data Engineer Lead

    4 days ago

    Randburg, Gauteng, South Africa LexisNexis South Africa Shared Services (Pty) Ltd Company Full time

    At LexisNexis Legal & Professional, we harness the power of innovative data solutions to drive business growth and success.About UsLeverage your expertise in machine learning operations to develop cutting-edge products that transform the legal profession.Job DescriptionAs a senior data engineer on our team, you will lead the design and implementation of...

  • Technical Lead Data Engineer

    4 days ago

    Randburg, Gauteng, South Africa Betway Group Full time

    Join Betway Group as a Senior Data Engineer and play a key role in shaping our data engineering strategy. As a Senior Data Engineer, you will be responsible for designing and implementing data pipelines, database management, data modeling, and data quality and governance.About the Team:Our team is passionate about delivering high-quality data solutions that...

  • Mid-Senior Level Data Engineer

    4 days ago

    Randburg, Gauteng, South Africa findojobs-za Full time

    We are seeking a highly skilled Data Engineer to join our team. The ideal candidate will have a strong background in data engineering and be able to design, build, and maintain large-scale data systems.This is a senior level position that requires a high level of technical expertise and excellent problem-solving skills. The successful candidate will work...

  • Senior Data Engineer Johannesburg North

    4 days ago

    Randburg, Gauteng, South Africa Network IT Full time

    Senior Data EngineerReference: NWA003388-Ren-1A well-known marketing organization with branches in multiple overseas countries is looking for a Senior Data Engineer to join their organization at their Johannesburg branch. The Senior Data Engineer will be required to work on a hybrid module. Working within the Data Science Team, the Data Engineer will be...

  • Senior Data Engineer – Deliver Data Engineering Strategy For The Most Customer-Centric Bank In

    4 days ago

    Randburg, Gauteng, South Africa Acuity Consultants Full time

    This is a fantastic opportunity for a Data Engineer with financial services / banking experience to design, build, and deliver the cloud data engineering solutions designed to support long-term business transformation efforts within the most customer-centric bank in Africa. This Senior Data Engineer role is Johannesburg-based with a CTC of R1,4 million per...

  • Senior Data Engineer

    4 days ago

    Randburg, Gauteng, South Africa Nintex Full time

    Job Location : Gauteng, JohannesburgDeadline : April 13, 2025About the role :You are responsible for ensuring the development of high-quality data engineering products and services, delivered on time and to acceptance criteria.You are a respected technical leader within your team and demonstrate ownership and technical excellence. Your advice is sought by...

  • Data Engineering Team Lead

    4 days ago

    Randburg, Gauteng, South Africa Betway Group Full time

    We are seeking a highly experienced Senior Data Engineer to join our team at Betway Group. As a Senior Data Engineer, you will be responsible for leading the design and implementation of data pipelines, database management, data modeling, and data quality and governance.About the Role:The successful candidate will have expertise in designing and implementing...

  • Senior Data Engineer

    5 days ago

    Randburg, Gauteng, South Africa NTT Full time

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Senior Data...

  • Senior Data Engineer I

    4 days ago

    Randburg, Gauteng, South Africa LexisNexis South Africa Shared Services (Pty) Ltd Company Full time

    At LexisNexis we develop the legal profession's most innovative products for data analysis, visualization, and research. We use the latest techniques in AI, machine learning, and data visualization to uncover insights about judges' rulings, build forecasts of likely outcomes, and reveal critical connections in massive datasets spanning the law, news, and...

  • Data Engineer Position

    4 days ago

    Randburg, Gauteng, South Africa Iress Full time

    Job Description:Iress is seeking a highly skilled Senior Data Engineer to join our team in Gauteng, Johannesburg. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining high-performance data software/pipeline solutions that meet the needs of our business.As a Senior Data Engineer, you will work closely...