Data Engineer

2 weeks ago

Johannesburg, Gauteng, South Africa NTT Full time
JOB DESCRIPTION

NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future.

In today's 'iNTTerconnected' world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our clients solve some of the world's most significant technological, business and societal challenges.

With people at the heart of our success, NTT is committed to attracting and growing the best talent and providing an environment where everyone feels they can belong and their contribution matters.

Want to be a part of our team?

The Data Engineer is responsible for the transformation of data into a structured format that can be easily analysed in a query or report. The role is responsible for developing structured data sets that can be reused or compliment other data sets and reports. The individual analyses the data sources and data structure and will design and develop data models to support the analytics requirements of the business which includes management / operational / predictive / data science capabilities.

Working at NTT

Data Engineering

The key responsibilities of an Azure data engineer include designing and implementing data storage solutions Building and maintaining data pipelines, ensuring data quality and accuracy, optimizing data processing performance, developing, and maintaining data models and schemas, Collaborating with other teams to provide data for analytics and reporting, and ensuring compliance with data security & privacy regulations.

Designing and implementing data storage solutions on Azure

The data engineer is to design and implement data storage solutions on Azure. That includes selecting the appropriate Azure data storage services for the specific use case, such as Azure SQL Database, Azure Cosmos DB.

Building and maintaining data pipelines for data integration and processing

Build and maintain data pipelines for data integration and processing. Accordingly, data is collected from various sources structured and unstructured data, files into blob storage. The data is transformed into a practical format and loaded into the appropriate data storage solution on Azure using tools such as Azure Data Factory. Ensure data is pushed in to SQL tables views, measures and relationship are manged in these tables. Must also ensure the data pipeline is scalable and efficient.

Ensuring data quality and accuracy through testing and validation

Data quality and accuracy are critical to the success of any data management system. As a data engineer, you must ensure that the data stored and processed and is highly accurate. It involves testing and verifying the data at different phases of the data pipeline, from extraction through loading.

Optimizing data processing performance through tuning and monitoring:

Data processing performance is another critical aspect of data engineering. The data engineer must ensure the data processing is efficient and scalable by tuning the data pipeline and monitoring performance. That involves identifying and resolving bottlenecks in the data pipeline and optimising the data processing algorithms.

Developing and maintaining data models and schemas:

Data modelling and schema design are important aspects of data engineering. The data engineer must develop and maintain data models and schemas optimized for the specific use case. That involves selecting the appropriate data modelling techniques and ensuring the data schema is scalable and efficient.

Collaborating with other teams to provide data for analytics and reporting:

As a data engineer, you will work closely with other teams, such as data analysts, data scientists, and software developers, to provide the data they need to perform their job functions. That involves understanding the specific data requirements of each team and ensuring that the data is available in the appropriate format.

Ensuring data security and privacy prerequisites are followed:

The security and privacy of knowledge are important elements of any information management system. The data engineer oversees ensuring that the data stored and processed on Azure conforms with applicable data security and privacy requirements, such as POPIA and GDPR.

Technologies :

SQL, Apache Spark, Azure Blob Storage, Azure Data Factory, Azure Data Lake Storage, Azure Databricks, Azure Event Hubs, Azure Pipelines, Azure Repos, Azure SQL Database, Azure Stream Analytics, Azure Synapse Analytics, Microsoft Azure, Microsoft Power BI, PySpark, Python etc.

Skills Summary

Big Data Solutions, Business Analysis, Data Analysis, Data Analytics, DATABASICS, Data Lake, Data Modeling, Unstructured Data

What will make you a good fit for the role?

Workplace type:

Hybrid Working

Equal Opportunity Employer

NTT is proud to be an Equal Opportunity Employer with a global culture that embraces diversity. We are committed to providing an environment free of unfair discrimination and harassment. We do not discriminate based on age, race, color, sex, religion, national origin, disability, pregnancy, marital status, sexual orientation, gender reassignment, veteran status, or other protected category

Join our growing global team and accelerate your career with us. Apply today.

A career at NTT means:

Being part of a global pioneer – where you gain exposure to our Fortune 500 clients and world-leading global technology partners and work with a network of over 40,000 smart and diverse colleagues across 57 countries, delivering services in over 200 countries. Being at the forefront of cutting-edge technology – backed with a 150-year heritage of using technology for good. With 40% of the world's internet traffic running on our network and where Emoji were first invented, you can be proud of the group's many new 'firsts'. Making a difference – by doing meaningful work that helps to shape the future for our clients, and across industries and communities around the world. Being your best self – in a progressive 'Connected Working' environment that promotes flexibility, connection and wellbeing. Where diversity and different perspectives are embraced to ensure equal opportunities for all. Having ongoing opportunities to own and develop your career – with a personal and professional development plan and access to the broadest learning offerings in the industry.

  • Cloud Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Dimension Data Full time

    The Cloud Data Engineer, AWS Data Pipeline, AWS Storage Gateway and Digital Assets will work on the Amazon Web Services (AWS) infrastructure team. The engineer's primary focus is to provide data services that enhance our clients' businesses. You'll be a key member of the data pipeline team helping us deliver these solutions quickly and efficiently while...

  • Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Energy At Work Full time

    Job Title: Data Engineer (SAS)Location: RemoteAbout Our Client: Our client is a leading player in the insurance industry, dedicated to providing innovative solutions to meet the needs of our clients. They leverage cutting-edge technology to drive their business forward and are seeking a skilled Data Engineer to join their dynamic team. If you are passionate...

  • Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Planet10 Full time

    A leader in the Banking and Financial space is on the lookout for a Data Engineer to join their team. The purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the Company's Data Architecture Roadmap, to advance technical thought leadership for the Enterprise, deliver fit for purpose data products, and...

  • Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Iolap Full time

    Do you like building data systems and pipelines?Do you enjoy interpreting trends and patterns?Are you able to recognize the deeper meaning of data?Join iOLAP, an Elixirr Company, as a Data Engineer and help us analyze and organize raw data?to provide valuable business insights to our clients and stakeholdersAs Data Engineer, you will be responsible to ensure...

  • Data Engineer

    1 month ago

    Johannesburg, Gauteng, South Africa NTT Full time

    NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future.In today's 'iNTTerconnected' world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our clients solve some of...

  • Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa NTT Full time

    NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future.In today's 'iNTTerconnected' world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our clients solve some of...

  • Data Engineer

    4 weeks ago

    Johannesburg, Gauteng, South Africa NTT Full time

    NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future.In today's 'iNTTerconnected' world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our clients solve some of...

  • Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Iolap Full time

    Do you like building data systems and pipelines? Do you enjoy interpreting trends and patterns? Are you able to recognize the deeper meaning of data?Join iOLAP, an Elixirr Company, as a Data Engineer and help us analyze and organize raw datato provide valuable business insights to our clients and stakeholdersAs Data Engineer, you will be responsible to...

  • Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Nedbank Full time

    Requisition Details & Talent Acquisition Consultant REQ Thembi MtshaliJob FamilyRisk, Audit and ComplianceCareer StreamAuditingLeadership PipelineManage Self: ProfessionalJob PurposeThe purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the Nedbank Data Architecture Roadmap, to advance technical...

  • Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa iOLAP Full time

    Do you like building data systems and pipelines? Do you enjoy interpreting trends and patterns? Are you able to recognize the deeper meaning of data? Join iOLAP, an Elixirr Company, as a Data Engineer and help us analyze and organize raw data to provide valuable business insights to our clients and stakeholdersAs Data Engineer, you will be responsible to...

  • Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Nedbank Full time

    Requisition Details & Talent Acquisition ConsultantREQ Keabetswe ModiseJob FamilyInformation TechnologyCareer StreamData Leadership PipelineManager of Self ProfessionalJob PurposeThe purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the Nedbank Data Architecture Roadmap, to advance technical thought...

  • Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Recru-it Full time

    Job Purpose: The purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the company Data Architecture Roadmap, to advance technical thought leadership for the Enterprise, deliver fit for purpose data products, and support data initiatives. In addition, Data Engineers enhance the data infrastructure of...

  • Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Puma Energy Full time

    Main Purpose: Collaborate with data scientists and business stakeholders to design, develop, and maintain efficient data pipelines feeding into the organization's data lake. Ensure the data lake contains accurate, up-to-date, and high-quality data, enabling data scientists to develop insightful analytics and business stakeholders to make well-informed...

  • Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Mimecast Limited Full time

    Data Engineer (SQL experience essential) page is loaded Data Engineer (SQL experience essential) Apply locations South Africa - Johannesburg time type Full time posted on Posted 3 Days Ago job requisition id R4508 Analytics Engineer We're your dream business intelligence team The Business Intelligence & Analytics team at Mimecast is an exciting blend of...

  • Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Network Recruitment Full time

    Welcome to our Data Engineering team at XYZ Company!Qualifications: Bachelor's degree in Computer Science, Information Technology, or a related field (Master's degree preferred)Requirements: 5+ years of solid experience in data engineeringStrong background in data warehousing and data lake architectureProficiency in Data Vault and dimensional modeling...

  • Data Center Technician

    2 weeks ago

    Johannesburg, Gauteng, South Africa Dimension Data Full time

    Requirements: The Data Center Technician (DCT) responsibility is the maintenance of all Data Centre White Space, ensuring a 24/7 service offering within Internet Solutions Data Centers.The DCT provides a service to clients to ensure that their IT infrastructure and systems remain operational through proactively identifying, investigating and resolving...

  • Senior Software Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Dimension Data Full time

    FunctieomschrijvingAre you tired of being micro-managed? Are you looking for a company where no-one tells you how to do your job? Do you want to work in a team, but not be told what to do and when to do it? If so, we believe this Senior Software Engineer role is perfect for youAs a Senior Software Engineer, you'll be responsible for building and maintaining...

  • Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Samaha Consulting Full time

    The Data Analytics: Data Engineer role is responsible for understanding the full lifecycle of a BI Project from the user, the initiation of the request to delivery of the reporting solution to business. Continuous development of Markets Data Analytics Platform is done by enhancing current functionality and building out for new business requirements.Duties...

  • Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Ad Talent Africa Full time

    Who are we: An international group of companies within the hospitality industryWho are we looking for: A data Engineer with a high degree of proficiency in SSIS, SQL, SSAS Cubes, DAX, MDX and building stored proceduresWhat will you do:The Data Engineer will be responsible for designing data models, maintaining, and optimizing data infrastructure for data...

  • Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa PRR Recruitment Services Full time

    This well known company is looking for a Data Engineer. will be based in Rivonia The ideal candidate will have strong experience in the following: Data cleaning SQL ExportBig data Sets BSc Degree in Maths and Stats will be required a min of 3 years experience. Stable track record is required. Send your Cv to