Senior Data Engineer

1 month ago

Pretoria, Gauteng, South Africa Hire Resolve Full time

Hire Resolve is seeking an experienced Senior Data Engineer - Cloud Architect to enhance their team.

This role will focus on designing and implementing data pipelines and architectures, ensuring data is accessible, reliable, and secure.

The ideal candidate will work closely with cross-functional teams to support data analytics and business intelligence efforts, playing a key role in driving data-driven decisions across the organization.

Responsibilities:

  • Identify valuable data sources and automate data collection processes.
  • Perform preprocessing on both structured and unstructured data.
  • Analyze large datasets to discover trends and patterns.
  • Expertise in Data Modeling (Relational and Star Schema).
  • Skilled in database design, development, and administration.
  • Experience in Data Warehouse design, build, and development.
  • Proficiency in database performance tuning and optimization.
  • Present data insights through data visualization techniques.
  • Propose solutions and strategies to address business challenges.
  • Collaborate with engineering and product development teams.
  • Hands-on experience with Hadoop/Spark-based distributed storage and computing frameworks.
  • Proficiency in real-time analytics and batch processing.
  • Strong background in architecting analytical applications in cloud environments such as Amazon Web Services (AWS) and Microsoft Azure.

Competencies:

  • Critical Thinking: Skilled in using logic and reasoning to evaluate strengths, weaknesses, and approaches to solutions.
  • Active Learning: Able to understand the impact of new information for current and future decision-making.
  • Systems Analysis: Capable of determining how a system should function and assessing the effects of changes in conditions or operations.
  • Complex Problem Solving: Ability to identify and address complex problems by developing and evaluating potential solutions.
  • Deductive Reasoning: Proficient in applying general rules to specific problems for logical solutions.
  • Inductive Reasoning: Skilled in combining information to identify relationships and form conclusions.
  • Excellent Communication: Ability to engage with C-level stakeholders and convey a deep understanding of business and technology.
  • Technical Literacy: Possesses a high level of technical proficiency to assess how software fits within an organizations structure.
  • Analytical Assessment: Strong analytical skills for evaluating current systems and determining project needs and scope.
  • Schedule Management: Extensive time management skills to set development schedules, milestones, and ensure timely delivery.
  • Team Leadership: Experience in leading and motivating development teams throughout the project lifecycle.
  • Strategic Execution: Ability to translate strategy into measurable and executable projects.

Requirements:

  • 8-10 years of experience as a Data Engineer or Database Developer.
  • Tertiary qualification in a related field (e.g., BSc in Computer Science, B.IT, or Informatics).
  • DP-203: Data Engineering on Microsoft Azure Certification.
  • Expertise in data mining, large-scale data modeling, and business requirements gathering/analysis.
  • Strong understanding and hands-on experience with data integration and transformation.
  • Proficient in implementing data modeling methodologies such as Dimensional Modeling and/or Data Vault.
  • Knowledge of data quality processes and master data management.
  • Experience in building design support systems using Database Management Systems (DBMS) like SQL Server or Oracle.
  • Skilled in designing and implementing data integration and ETL solutions using SSIS, Azure Data Factory, and/or SQL Server stored procedures.
  • Familiarity with Big Data technologies such as Hadoop, MapReduce, Spark, and message/event processing services like Kafka, Event Hub, and Stream Analytics.
  • Proficient in database query languages including T-SQL, ANSI SQL, and PL/SQL.
  • Some experience in software development using languages like Visual Basic, C++, C#, Java, or Python.
  • Experience with SQL Server Management Studio and Visual Studio.
  • Knowledge of implementing solutions using Azure SQL databases, Azure Synapse, Azure Storage Accounts (Data Lake), and/or Databricks.
  • Strong analytical skills and business acumen.
  • Additional skills in Tableau, Power BI, advanced math (e.g., statistics, algebra), Scala, Python, or R are advantageous.

  • Senior Data Engineer for Marine Engineering

    3 weeks ago

    Pretoria, Gauteng, South Africa Perfect Placement Recruitment Full time

    Join a dynamic team at Perfect Placement Recruitment as a Senior Data Engineer specializing in marine engineering.We are seeking an experienced professional to design, build, and optimize data pipelines within the Dassault Systèmes 3D Experience (3DX) platform. This role requires expertise in data integration, ETL tools, and programming languages such as...

  • Senior Data Engineer

    3 weeks ago

    Pretoria, Gauteng, South Africa South African Reserve Bank Full time

    Job Title: Senior Data EngineerSalary Estimate: R850,000 - R1,200,000 per annumJob Description:We are seeking a highly skilled Data Engineer to join our team at the South African Reserve Bank in Pretoria, Gauteng. The successful candidate will be responsible for designing and building robust, modular, scalable, deployable, reproducible, and versioned data...

  • Senior Data Architect

    3 weeks ago

    Pretoria, Gauteng, South Africa CLS Human Capital Specialists Full time

    CLS Human Capital Specialists is seeking a Senior Data Architect to lead our cloud data engineering efforts.Estimated salary: $120,000 - $180,000 per year.About the RoleThis role is ideal for someone with 2+ years of experience in data engineering and proficiency in programming languages like Python.Design and implement scalable data pipelines using big data...

  • Senior Data Architect

    5 days ago

    Pretoria, Gauteng, South Africa IT Ridge Technologies Full time

    About the RoleWe are seeking an experienced Senior Data Architect to design and implement a robust data strategy that effectively integrates structured and unstructured data into our data lakes, warehouses, and databases. As a key member of our ICT team, you will collaborate with data scientists and analysts to develop analytical solutions that address...

  • Senior Data Insights Specialist

    4 weeks ago

    Pretoria, Gauteng, South Africa ATripleA Recruitment and Temps Full time

    About UsATripleA Recruitment and Temps is a leading provider of recruitment and temporary staffing services. We are committed to helping businesses find top talent and achieve their goals.Job Title: Senior Data Insights SpecialistJob SummaryWe are seeking a highly motivated and detail-oriented Senior Data Insights Specialist to join our data analytics team....

  • Senior Software Engineer

    2 months ago

    Pretoria, Gauteng, South Africa Absolut Career Personnel Full time

    We are seeking a Senior Software Engineer to join our team and contribute to the development of cloud-based data analytics solutions. The successful candidate will have a strong background in software development, cloud computing, and data analytics. Key responsibilities include designing and implementing scalable cloud-based architectures, developing data...

  • Data Engineer

    2 months ago

    Pretoria, Gauteng, South Africa Tekshapers Full time

    Job Summary:As a Senior ETL Developer at Tekshapers, you will be responsible for designing and implementing ETL jobs using Informatica. You will work with Product and Client teams to understand technical and functional requirements, and translate business requirements into technology implementation. The ideal candidate will have experience with data feeds,...

  • Data Engineering Lead

    1 month ago

    Pretoria, Gauteng, South Africa IT Ridge Technologies Full time

    Job DescriptionWe are seeking an experienced Data Engineering Lead to join our team at IT Ridge Technologies. As a key member of our data engineering team, you will be responsible for designing and managing a resilient data pipeline that effectively processes and integrates both structured and unstructured data into data lakes, warehouses, databases, and...

  • Data Engineering Leader

    3 weeks ago

    Pretoria, Gauteng, South Africa IT Ridge Technologies Full time

    About the RoleAt IT Ridge Technologies, we are seeking an experienced Data Engineering Leader to design and manage a resilient data pipeline that effectively processes and integrates both structured and unstructured data into data lakes, warehouses, databases, and other data sources.The ideal candidate will thrive in an agile setting, working closely with...

  • Senior Data Integration Specialist

    1 month ago

    Pretoria, Gauteng, South Africa Perfect Placement Recruitment Full time

    We are seeking a highly skilled Senior Data Integration Specialist to join our team at Perfect Placement Recruitment. This role involves working with our client in the marine sector, utilizing your expertise in data management and integration within the 3DX platform.Job SummaryThis is a full-time position that requires strong analytical and problem-solving...

  • Senior Financial Growth Strategist

    4 weeks ago

    Pretoria, Gauteng, South Africa Data Centrix Full time

    About Data CentrixWe are a leading organization in the commercial finance industry, and we are seeking an exceptional Senior Financial Growth Strategist to join our team.

  • Data Engineer Lead

    5 days ago

    Pretoria, Gauteng, South Africa IT Ridge Technologies Full time

    About the JobIT Ridge Technologies is seeking a Technical Data Specialist to join our team. As a Technical Data Specialist, you will be responsible for designing and implementing data solutions that effectively integrate structured and unstructured data into our data lakes, warehouses, and databases.Key Responsibilities• Design and implement data pipelines...

  • Data Centrix Business Process Specialist

    4 days ago

    Pretoria, Gauteng, South Africa Data Centrix Full time

    Description of the Job:We are looking for a seasoned Business Process Specialist to join our team at Data Centrix. The ideal candidate will have extensive experience in business analysis and a strong understanding of Business Process Management.Job Summary:This position involves working closely with stakeholders to identify and analyze business needs,...

  • Senior Business Analysis Professional

    4 days ago

    Pretoria, Gauteng, South Africa Data Centrix Full time

    Job Title: Senior Business Analysis ProfessionalData Centrix is seeking a highly experienced Senior Business Analysis Professional to join our team. As a senior business analyst, you will play a key role in driving business process improvement and implementing change across the organization.About the Role:In this role, you will be responsible for planning...

  • Data Engineering Specialist

    2 months ago

    Pretoria, Gauteng, South Africa E-Merge Full time

    E-Merge is seeking a talented Data Engineering Specialist to join our team. The ideal candidate will have a strong analytical background and be able to drive value from our data by building Python, ETL processes, and writing superb SQL. Responsibilities include working closely with the development team, data analysts, and BI analysts to build and maintain...

  • Senior IBM Resource

    2 months ago

    Pretoria, Gauteng, South Africa Dimension Data Full time

    Job OverviewWe are seeking an experienced IBM Spectrum Scale engineer to join our team at Dimension Data. As a key member of our team, you will be responsible for setting up the current Spectrum Scale environment to access the transversal SAN storage for High Availability.Key ResponsibilitiesDeploy IBM Spectrum Scale in a shared-disk or shared-nothing...

  • Senior Software Engineer

    1 month ago

    Pretoria, Gauteng, South Africa Mukuru Full time

    Unlock Your Potential as a Senior Software Engineer at MukuruMukuru is a leading Africa-based FinTech that empowers underserved communities with safe, affordable, and reliable financial services. With a decade of experience and over 40 million cross-border transactions, we are one of Africa's largest remittances-led FinTech companies.About the RoleWe are...

  • Marine Engineering Data Specialist

    5 days ago

    Pretoria, Gauteng, South Africa Perfect Placement Recruitment Full time

    Perfect Placement Recruitment seeks a skilled Data Engineer to join our client's team in the Netherlands. In this role, you will design, build, and optimize data pipelines within the 3DX platform to support engineering processes and ensure seamless data flow.Salary Range: €60,000 - €80,000 per annumAbout the Job:This is a full-time position that requires...

  • Data Engineer

    3 weeks ago

    Pretoria, Gauteng, South Africa CLS Human Capital Specialists Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team in Pretoria, Gauteng.About the JobThe successful candidate will work closely with our cross-functional team to build complex algorithms that provide unique insights into our data.They will model front-end and back-end data sources to draw a comprehensive picture of user...

  • Senior Data Analyst

    3 weeks ago

    Pretoria, Gauteng, South Africa ATripleA Recruitment and Temps Full time

    We are seeking a highly skilled Senior Data Analyst to join our team at ATripleA Recruitment and Temps. This role offers an exciting opportunity for a talented individual to drive business growth through data-driven insights.Job SummaryAs a Senior Data Analyst, you will be responsible for collecting, processing, and analyzing large datasets to provide...