Data Engineer

3 weeks ago

Johannesburg, South Africa Concord Efs Full time

About the Company Khonology is a digital services company focused on software development, Application Support, data analytics and engineering. Position Overview We are looking for a skilled Data Engineer to join our team. The ideal candidate will have a strong background in Python, AWS / Azure Cloud technologies, data pipeline management, ETL and ELT principles, and Big Data technologies. You will be responsible for designing, building, and maintaining scalable and robust data systems to support our data-driven initiatives and productionizing data related systems. Core Responsibilities and Competencies Programming: Write efficient and maintainable code in Python and SQL. Data Pipeline Management: Design, develop, and maintain data pipelines to ensure smooth data flow from various sources to the data warehouse. Production Systems: Apply best practices in production systems management to ensure reliability and scalability. ETL and ELT Processes: Implement and optimize ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processes to ensure data is correctly ingested, transformed, and loaded. Data API Integration: Develop and maintain data APIs to facilitate seamless data access and integration with other systems. Big Data Technologies: Utilize Hadoop and Spark to process large volumes of data efficiently. Database Management: Manage and optimize relational databases to ensure high performance and reliability. Data Modeling: Design and implement data models to support data product and machine learning needs. Query Optimization: Ensure that queries are always optimized for performance to enhance system efficiency. Tech Stack Platforms: AWS, Microsoft Azure Main Programming language: Python, SQL (Domain-Specific Language) Big Data technologies (On prem): Hadoop, Spark Code Repositories: BitBucket, GitHub, CodeCommit Deployment frameworks: Bamboo, Octopus Deploy, Codebuild and CodeDeploy Job Details Seniority level: Mid-Senior level Employment type: Contract Job function: Information Technology Industries: IT Services and IT Consulting #J-18808-Ljbffr

  • Senior Process Engineer

    2 weeks ago

    Johannesburg, South Africa Gig Engineer Full time

    Changing the way the world works @ Gig Engineer | Founder | MBA | Engineer | Jedi Gig Engineer is seeking an experienced Senior Process Engineer to lead process development and optimisation efforts on behalf of its client, dedicated to advancing nuclear fuel technologies for next-generation reactors. In this role, you will oversee the design, implementation,...

  • Senior Process Engineer.

    3 weeks ago

    Johannesburg, South Africa Gig Engineer Full time

    Gig Engineer is seeking an experienced Senior Process Engineer to lead process development and optimisation efforts on behalf of its client, dedicated to advancing nuclear fuel technologies for next-generation reactors. In this role, you will oversee the design, implementation, and scaling of processes across the Nuclear Fuel Cycle, utilising proprietary ASP...

  • Senior Data Management Security Engineer

    4 weeks ago

    Johannesburg, South Africa Ntt Data, Inc. Full time

    Senior Data Management Security Engineer NTT DATA, Inc. is hiring for a Senior Data Management Security Engineer. The role focuses on defining and enforcing data security strategies, policies, and controls across the organization's data landscape to protect data assets while enabling secure and compliant data usage across analytics, operations, and digital...

  • Senior Data Management Security Engineer

    5 days ago

    Johannesburg, Gauteng, South Africa NTT DATA, Inc. Full time R800 000 - R1 200 000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.The Data Management Security Engineer...

  • Data Scientist

    6 days ago

    Johannesburg, South Africa NTT DATA Full time

    **Make an impact with NTT DATA** Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion - it’s a place where you can grow, belong and thrive. **Your day at NTT DATA** The...

  • Lead Forward Deployed Engineer

    2 days ago

    Johannesburg, Gauteng, South Africa RANGR Data Full time R1 200 000 - R2 400 000 per year

    RANGR Data is an advanced data engineering and analytics consulting firm, and a certified partner of Palantir. We help clients implement and support the most advanced data operations platform: Palantir FoundryRole OverviewAs Lead Engineer, you are responsible for driving the technical success of client solutions by leading a team of engineers in designing,...

  • Project Manager

    2 weeks ago

    Johannesburg, South Africa Data Centrix Full time

    Qualifications and ExperienceBachelors degree in Information Systems, Computer Science, HR Technology, or related field. Project Management certification (PMP, PRINCE2, or Agile). 5+ years experience in data management projects, preferably in HR and/or mining industry. Experience in Denodo and related environments. Strong project management skills (PMBOK or...

  • Project Manager

    2 weeks ago

    Johannesburg, South Africa Data Centrix Full time

    Qualifications and ExperienceBachelors degree in Information Systems, Computer Science, HR Technology, or related field.Project Management certification (PMP, PRINCE2, or Agile).5+ years experience in data management projects, preferably in HR and/or mining industry.Experience in Denodo and related environments.Strong project management skills (PMBOK or...

  • 2022 59 Senior Data Analyst

    4 days ago

    Johannesburg, South Africa Data Centrix Full time

    Required Experience: - Minimum 5 years in a data-centric environment working in either SQL Data-Warehousing, - Analytics or as a dedicated Data-Modeller. - Solid experience in TSQL and SQL server skills. - Logical, and Physical Data-Modelling Expertise. - Experience with Forward and Reverse Engineering of Existing Databases. - Good understanding of Star...

  • 2022 37 Mid-level Data Analyst

    2 weeks ago

    Johannesburg, South Africa Data Centrix Full time

    Requirements - Minimum 5 years in a data-centric environment working in either SQL Data-Warehousing, - Analytics or as a dedicated Data-Modeller. - Above average TSQL and SQL server skills. - Logical, and Physical Data-Modelling Expertise. - Experience with Forward and Reverse Engineering of Existing Databases. - Good understanding of Star Schemas, Snowflake...