Current jobs related to Data Engineer - City of Johannesburg Metropolitan Municipality - Psybergate

  • Data Analyst

    5 days ago

    Johannesburg, Gauteng, South Africa Data Bene Full time

    A vacancy exists for a Data Analyst within the Micro Merchant Division – Touchsides, in Rosebank, Johannesburg. The primary focus as Data Analyst is to collect, analyze, clean and interpret data sets across the business to make informed decisions. Utilize technical expertise to ensure data is accurate and high-quality.Key Responsibilities include, but are...

  • Data Insights Analyst

    5 days ago

    Johannesburg, Gauteng, South Africa Data Bene Full time

    About the RoleThe Data Analyst will play a crucial role in driving business growth by providing insights and recommendations based on data analysis.Key Responsibilities include:Collecting, organizing, analyzing, and disseminating information to support business decision-makingResolving data queries, report writing, and presenting findings to...

  • Analytical Data Solutions Provider

    5 days ago

    Johannesburg, Gauteng, South Africa Data Bene Full time

    About the JobWe are seeking a talented Data Analyst to join our team at Data Bene. The successful candidate will be responsible for analyzing complex data sets and providing insights to inform business decisions.Key Responsibilities include:Collecting, organizing, and analyzing data to support business decision-makingDeveloping and maintaining databases and...

  • Data Protection Lead/Manager

    3 weeks ago

    Johannesburg, Gauteng, South Africa Data Centrix Full time

    Key Responsibilities:Define and implement data classification, data loss prevention (DLP), and encryption standards.Work with business units to identify sensitive data flows and implement appropriate controls.Oversee data privacy and compliance efforts (GDPR, local data protection regulations, IP protection requirements).Collaborate with IT, OT, and legal...

  • Data Science and Analytics Manager

    6 days ago

    Johannesburg, Gauteng, South Africa Data Centrix Full time

    Inherent RequirementsAt least 10 years of hands-on involvement in data science projects, including managing large-scale initiatives and leading multidisciplinary teams.Degree (Honours, Masters or PHD) in quantitative fields such as Actuarial Science, Statistics, Computer Science, Engineering, Mathematics and/or combination of these.Proven expertise in data...

  • 2022 37 Mid-level Data Analyst

    6 days ago

    Johannesburg, South Africa Data Centrix Full time

    Requirements - Minimum 5 years in a data-centric environment working in either SQL Data-Warehousing, - Analytics or as a dedicated Data-Modeller. - Above average TSQL and SQL server skills. - Logical, and Physical Data-Modelling Expertise. - Experience with Forward and Reverse Engineering of Existing Databases. - Good understanding of Star Schemas, Snowflake...

  • Citrix Engineer

    3 weeks ago

    Johannesburg, South Africa Data Centrix Full time

    Minimum Education and Experience Requirements Masters degree in information technology or computer scienceManagement of operations on virtualized and distributed infrastructures,Management of operations on environment with clustering, replication, load balancerITIL Practitioner (V3) / ITIL Specialist (V4)Citrix certifications (e.g., CCA-V, CCP-V, CCE-V) -...

  • Data Engineer

    3 weeks ago

    Johannesburg, Gauteng, South Africa Network Recruitment Full time

    We are seeking a highly skilled and experienced Data Engineer to join our team. In this role, you will be responsible for developing and maintaining scalable, secure, and repeatable data pipelines. You will manage data platforms, ensuring the accuracy and accessibility of data for reporting and analysis across the business. Key Responsibilities: Implement...

  • Data Engineer

    1 day ago

    Johannesburg, Gauteng, South Africa Network Recruitment Full time

    A leading technology-driven company is seeking a skilled Data Engineer to design, build, and optimize data pipelines for real-time and batch processing. If you're passionate about big data, cloud technologies, and scalable solutions, this is your chance to make an impactQualifications:Bachelors Degree in Computer Science, Computer Engineering, or related...

  • Data Engineer

    3 weeks ago

    Johannesburg, Gauteng, South Africa Network Recruitment Full time

    We are seeking a highly skilled and experienced Data Engineer to join our team. In this role, you will be responsible for developing and maintaining scalable, secure, and repeatable data pipelines. You will manage data platforms, ensuring the accuracy and accessibility of data for reporting and analysis across the business.Key Responsibilities: Implement and...

  • Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Network Recruitment Full time

    We are seeking a highly skilled and experienced Data Engineer to join our team. In this role, you will be responsible for developing and maintaining scalable, secure, and repeatable data pipelines. You will manage data platforms, ensuring the accuracy and accessibility of data for reporting and analysis across the business.Key Responsibilities: Implement and...

  • Data Engineer

    3 weeks ago

    Johannesburg, South Africa Network Recruitment Full time

    We are seeking a highly skilled and experienced Data Engineer to join our team. In this role, you will be responsible for developing and maintaining scalable, secure, and repeatable data pipelines. You will manage data platforms, ensuring the accuracy and accessibility of data for reporting and analysis across the business.Key Responsibilities:Implement and...

  • Data Engineer

    3 weeks ago

    Johannesburg, South Africa Network Recruitment Full time

    We are seeking a highly skilled and experienced Data Engineer to join our team. In this role, you will be responsible for developing and maintaining scalable, secure, and repeatable data pipelines. You will manage data platforms, ensuring the accuracy and accessibility of data for reporting and analysis across the business.Key Responsibilities: Implement and...

  • Data Engineer

    3 weeks ago

    Johannesburg, South Africa Network Recruitment Full time

    We are seeking a highly skilled and experienced Data Engineer to join our team. In this role, you will be responsible for developing and maintaining scalable, secure, and repeatable data pipelines. You will manage data platforms, ensuring the accuracy and accessibility of data for reporting and analysis across the business.Key Responsibilities: Implement and...

  • Data Engineer

    3 weeks ago

    Johannesburg, South Africa Network Recruitment Full time

    We are seeking a highly skilled and experienced Data Engineer to join our team. In this role, you will be responsible for developing and maintaining scalable, secure, and repeatable data pipelines. You will manage data platforms, ensuring the accuracy and accessibility of data for reporting and analysis across the business.Key Responsibilities:Implement and...

  • Data Engineer

    4 weeks ago

    Johannesburg, South Africa Network Recruitment Full time

    A leading technology firm is seeking a highly skilled Data Engineer to join their team in a hybrid/remote capacity. If you have experience in Python, SQL, AWS, and ETL processes , and are passionate about building and optimizing data pipelines , this role is for you Qualifications: BSc in Computer Science, Information Systems, Engineering, or a related...

  • Data Engineer

    3 weeks ago

    Johannesburg, Gauteng, South Africa Network Recruitment Full time

    A leading technology firm is seeking a highly skilled Data Engineer to join their team in a hybrid/remote capacity. If you have experience in Python, SQL, AWS, and ETL processes , and are passionate about building and optimizing data pipelines , this role is for you Qualifications: BSc in Computer Science, Information Systems, Engineering, or a related...

  • Data Engineer

    3 weeks ago

    Johannesburg, Gauteng, South Africa Network Recruitment Full time

    A leading technology firm is seeking a highly skilled Data Engineer to join their team in a hybrid/remote capacity. If you have experience in Python, SQL, AWS, and ETL processes , and are passionate about building and optimizing data pipelines , this role is for youQualifications: BSc in Computer Science, Information Systems, Engineering, or a related...

  • Data Engineer

    5 days ago

    Johannesburg, Gauteng, South Africa CrossBoundary Group Full time

    Get AI-powered advice on this job and more exclusive features.About The FirmCrossBoundary Energy develops, owns, and operates distributed renewable energy solutions for businesses, offering cheaper and cleaner energy through power purchase and lease agreements. With a secured portfolio exceeding $680M, the company boasts over 500MW of solar PV and wind...

  • Data Engineer

    5 days ago

    Johannesburg, Gauteng, South Africa Ananzi Full time

    Data EngineerCrossBoundary EnergyAbout the FirmCrossBoundary Energy develops, owns, and operates distributed renewable energy solutions for businesses, offering cheaper and cleaner energy through power purchase and lease agreements.With a secured portfolio exceeding $680M, the company boasts over 500MW of solar PV and wind generation, approximately 600MWh of...

Data Engineer

4 weeks ago

City of Johannesburg Metropolitan Municipality, South Africa Psybergate Full time
What you will be doing:
We are looking for an experienced Data Engineer with strong Python and SQL skills, as well as hands-on experience with Kafka, Docker, and Kubernetes. The ideal candidate will have a proven track record in building bespoke data processing pipelines, developing microservices, and designing data table structures and schemas. You will collaborate with cross-functional teams to integrate and optimize data systems, while working with both structured and unstructured data.

Key Responsibilities:
  • Design and Build Data Pipelines: Develop and maintain custom, scalable data pipelines for processing large datasets, including unstructured text and document data.
  • Integrate Data Systems: Collaborate with diverse teams to understand data sources and build robust integrations with various internal and external systems.
  • Build Microservices: Develop microservices to handle data processing tasks, ensuring they are scalable, secure, and efficient.
  • Optimize Performance: Design and optimize table structures, schemas, and database queries for improved data retrieval and storage performance.
  • Kafka and Real-time Data: Leverage Kafka for real-time data streaming and processing, ensuring high availability and low-latency data delivery.
  • Containerization & Orchestration: Use Docker and Kubernetes for deploying and managing data applications in production environments.
  • Collaborate with Teams: Work closely with data scientists, analysts, and other engineers to define requirements and deliver high-quality, reliable data solutions.
  • Ensure Data Quality: Maintain data integrity and implement best practices to ensure the consistency and quality of the data being processed
What we are looking for :
  • Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent practical experience).
  • 5 years experience as Date Engineer
  • Strong proficiency in Python: Experience in developing scalable data applications, automating processes, and implementing algorithms.
  • Strong SQL skills: Ability to design efficient queries and optimize database performance.
  • Hands-on experience with Kafka, including setting up and managing streams, and integrating with data pipelines.
  • Proficiency with Docker and Kubernetes for containerization and orchestration in production environments.
  • Experience building bespoke data processing pipelines: Expertise in handling large volumes of data from multiple sources and optimizing processing workflows.
  • Experience building microservices to deliver modular, scalable, and maintainable data solutions.
  • Experience designing table structures and schemas that meet both performance and business requirements.
  • Ability to collaborate with diverse teams, understanding their needs and building integrations that allow for efficient data flow.
  • Java experience is advantageous, particularly for implementing additional data processing logic or integration points.
  • Experience with unstructured text and document data is a plus, especially in processing and transforming such data for analytical purposes.

Please note that if you do not hear from us within 3 weeks, consider your application unsuccessful.

Please note that most of our positions are remote however candidates should be residing within the traveling distance as circumstance of the opportunity can change.