Intermediate Data Engineer

1 week ago

Johannesburg, Gauteng, South Africa The Nippon Telegraph and Telephone Corporation (NTT) Full time R900 000 - R1 200 000 per year
Make an impact with NTT DATA
Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion - it's a place where you can grow, belong and thrive.

Your day at NTT DATA

As an Intermediate Data Engineer at NTT DATA, you will design, develop, and maintain robust data solutions on the Microsoft Azure Data Platform. You'll work with data from multiple business domains, enabling advanced analytics and reporting capabilities across the organisation. This role involves hands-on development with cloud data technologies, collaboration across data teams, and ensuring scalability, reliability, and performance of data assets.

Key Responsibilities:

Data Pipeline Design and Development
  • Design and implement scalable ETL/ELT pipelines using Azure Data Factory, and Synapse Pipelines.
  • Ingest structured and unstructured data from various sources to on-premises databases, APIs, Azure Event Hubs, and external systems.
  • Transform and load data into target layers such as Azure Data Lake and Azure Synapse Analytics following the medallion architecture (Bronze, Silver, Gold layers).
  • Automate and schedule workflows using ADF triggers, DataOps best practices, and Azure DevOps CI/CD pipelines.
Data Modeling and Architecture
  • Develop optimized data models and schema designs for reporting and analytics.
  • Implement Delta Lake and Parquet-based storage for scalable data processing.
  • Support the implementation of Data Lake architecture, integrating ADF and Synapse for unified analytics.
  • Collaborate with senior engineers and architects to refine data platform standards and blueprints.
Data Quality, Governance, and Security
  • Build and maintain data validation and data profiling routines using PySpark, Databricks, or Azure Data Factory.
  • Implement data lineage tracking and metadata management with Microsoft Purview.
  • Ensure compliance with data privacy, governance, and security standards (e.g., GDPR, ISO
  • Apply role-based access control (RBAC) and manage credentials securely via Azure Key Vault.
Optimization and Performance Tuning
  • Optimise SQL and Spark jobs for better execution times and cost efficiency.
  • Tune Synapse Dedicated SQL Pools for performance, including partitioning and distribution strategies.
  • Monitor pipelines and clusters using Azure Monitor, Log Analytics.
  • Continuously improve pipeline resilience, scalability, and automation coverage.
Collaboration and Continuous Improvement
  • Work closely with data analysts, data scientists, and business stakeholders to understand requirements and translate them into technical designs.
  • Contribute to team-wide code reviews, documentation, and knowledge-sharing sessions.
  • Participate in Agile/Scrum ceremonies and provide input for sprint planning and technical estimation.
Technical Skills and Tools:
  • Languages - Python, SQL, PySpark
  • Azure Services - Data Factory, Synapse Analytics, Data Lake Gen2, Event Hubs, Key Vault, Purview
  • Data Tools - Delta Lake, Power BI, dbt, Azure Monitor
  • Version Control / CI-CD - Git, Azure DevOps
  • Data Formats - Parquet, JSON, CSV, Delta
  • Concepts - DataOps, Lakehouse Architecture, Data Governance, Data Quality Management
Academic Qualifications and Certifications:
  • Bachelor's degree or equivalent in computer science, software engineering, information technology, or a related field.
  • Relevant certifications preferred such as SAP, Microsoft Azure etc.
  • Certified Data Engineer, Certified Professional certification preferred.
Performance Expectations:
  • Deliver production-ready data pipelines with strong documentation and minimal defects.
  • Proactively monitor and enhance data workflows to improve efficiency and reduce operational costs.
  • Demonstrate ownership of assigned data domains and work effectively within cross-functional teams.
  • Uphold NTT DATA's standards for security, compliance, and data excellence.
Workplace type:
Hybrid Working

About NTT DATA
NTT DATA is a $30+ billion business and technology services leader, serving 75% of the Fortune Global 100. We are committed to accelerating client success and positively impacting society through responsible innovation. We are one of the world's leading AI and digital infrastructure providers, with unmatched capabilities in enterprise-scale AI, cloud, security, connectivity, data centers and application services. Our consulting and industry solutions help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have experts in more than 50 countries. We also offer clients access to a robust ecosystem of innovation centers as well as established and start-up partners. NTT DATA is part of NTT Group, which invests over $3 billion each year in R&D.

Equal Opportunity Employer
NTT DATA is proud to be an Equal Opportunity Employer with a global culture that embraces diversity. We are committed to providing an environment free of unfair discrimination and harassment. We do not discriminate based on age, race, colour, gender, sexual orientation, religion, nationality, disability, pregnancy, marital status, veteran status, or any other protected category. Join our growing global team and accelerate your career with us. Apply today.

Third parties fraudulently posing as NTT DATA recruiters

NTT DATA recruiters will never ask job seekers or candidates for payment or banking information during the recruitment process, for any reason. Please remain vigilant of third parties who may attempt to impersonate NTT DATA recruiters-whether in writing or by phone-in order to deceptively obtain personal data or money from you. All email communications from an NTT DATA recruiter will come from an email address. If you suspect any fraudulent activity, please contact us.

  • Intermediate Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Dariel Full time R250 000 - R600 000 per year

    Data Engineer / Streaming EngineerJohannesburg, Gauteng, South Africa(Hybrid)Employment Type: Full-TimeAbout the RoleWe are looking for a highly skilled and motivatedData Engineer / Streaming Engineerto join our team. This role is central to building and supporting scalable, secure, and repeatable data pipelines that power intelligent decision-making. You'll...

  • Intermediate Data Engineer

    4 days ago

    Johannesburg, Gauteng, South Africa Boardroom Appointments Full time R250 000 - R500 000 per year

    Minimum requirements:Post Graduate Degree: Information TechnologyPost Graduate Degree: Information StudiesMasters Degree: Information TechnologyMasters Degree: Information StudiesExperienceMinimum 3 years experienceIT ArchitectureData IntegrityIT ApplicationsData AnalysisKnowledge ClassificationC++.Amazon Web Services.Amazon S3.DatabricksSkills:Database...

  • Intermediate Chemical Engineer

    4 days ago

    Johannesburg, Gauteng, South Africa SavageOne Pty Full time R1 200 000 - R2 400 000 per year

    Power & Energy Sector Onsite About the RoleWe are looking for an Intermediate Chemical Engineer to support a range of engineering initiatives within the power and energy sector, including electricity generation, transmission, distribution, and trading. This  role is ideal for an engineer with 8+ years of relevant experience, ready to contribute to...

  • Intermediate Industrial Engineer

    4 days ago

    Johannesburg, Gauteng, South Africa SavageOne Pty Full time R600 000 - R1 200 000 per year

    About the RoleWe are looking for an Intermediate Industrial Engineer to support a range of engineering and operational improvement initiatives. The role is ideal for an engineer with 5+ years of relevant experience, ready to take on responsibilities that drive efficiency, process optimization, and cost reduction within our operations.This role presents an...

  • Data Engineer

    5 days ago

    Johannesburg, Gauteng, South Africa Hyperclear Tech Full time R500 000 - R750 000 per year

    JOB TITLE: Intermediate Data EngineerLOCATION: Stellenbosch / Johannesburg (Hybrid)ABOUT CYBERLOGIC: Cyberlogic is a trusted Managed Solutions Provider with offices in South Africa, Mauritius, and the UK. Serving a diverse range of clients, spanning numerous industries, including the international maritime sector, Cyberlogic specialises in IT leadership,...

  • Data Engineer Data Engineer

    1 week ago

    Johannesburg, Gauteng, South Africa Praesignis Full time R900 000 - R1 200 000 per year

    We are looking for an experienced intermediate Data Engineer. Candidate must have strong SQL & SSIS capabilities, good production support with experience for being on call on a 7-day rotation cycle. AWS cloud skills would be a massive benefit as well.Skills & Experience Required:Technical Stack:Strong proficiency in  SSIS (SQL Server Integration Services) ...

  • Senior Data Management Security Engineer

    4 days ago

    Johannesburg, Gauteng, South Africa NTT DATA, Inc. Full time R800 000 - R1 200 000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.The Data Management Security Engineer...

  • Intermediate Data Capturer

    4 days ago

    Johannesburg, Gauteng, South Africa SavageOne Pty Full time R120 000 - R180 000 per year

    Job SummaryWe are seeking a detail-oriented and efficient Intermediate Data Capturer to support our data operations. The ideal candidate will have strong typing accuracy, data management skills, and a proactive attitude toward maintaining data integrity. You will be responsible for accurately inputting, updating, and verifying data into internal systems...

  • Intermediate Full Stack Software Engineer

    4 days ago

    Johannesburg, Gauteng, South Africa Hire Resolve Full time R400 000 - R800 000 per year

    Hire Resolve's client is seeking a skilled Intermediate Full Stack Software Engineer to join their team. As a Full Stack Software Engineer, you will be responsible for developing and maintaining software applications, collaborating with cross-functional teams, and ensuring the scalability and reliability of the applications.ResponsibilitiesCode development...

  • Data Engineers

    5 days ago

    Johannesburg, Gauteng, South Africa InfyStrat Full time R900 000 - R1 200 000 per year

    InfyStrat is on the lookout for skilled and driven Data Engineers with expertise in Denodo to join our innovative data team. As a Data Engineer, you will be responsible for designing, building, and maintaining data integration solutions that leverage Denodo's data virtualization platform. Your role will be pivotal in transforming complex data into actionable...