Senior Data Solutions Engineer

2 weeks ago

Cape Town, Western Cape, South Africa PBT Group Full time
PBT Group Job Description

We are seeking a highly skilled Senior Data Solutions Engineer to join our team at PBT Group.

Job Summary:

The successful candidate will be responsible for designing, building, and operationalizing large-scale enterprise data solutions and applications using AWS data and analytics services in combination with 3rd parties.

Key Responsibilities:

  • Design and build production data pipelines from ingestion to consumption within a big data architecture.
  • Analyze, re-architect, and re-platform on-premise data warehouses to data platforms on AWS cloud.
  • Design and implement data engineering, ingestion, and curation functions on AWS cloud.
  • Perform detailed assessments of current state data platforms and create an appropriate transition path to AWS cloud.
  • Design, implement, and support an analytical data infrastructure providing ad-hoc access to large datasets and computing power.
  • Interface with other technology teams to extract, transform, and load data from a wide variety of data sources.
  • Creation and support of real-time data pipelines built on AWS technologies.
  • Continual research of the latest big data and visualization technologies to provide new capabilities and increase efficiency.
  • Working closely with team members to drive real-time model implementations for monitoring and alerting of risk systems.
  • Collaborate with other tech teams to implement advanced analytics algorithms that exploit our rich datasets for statistical analysis, prediction, clustering, and machine learning.

Requirements:

  • Advanced working knowledge and experience with modern data practices, using Delta.io, CDC management, and data load practices.
  • Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets.
  • Experience working with distributed systems as it pertains to data storage and computing.
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Strong analytic skills related to working with unstructured datasets.
  • Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
  • A successful history of manipulating, processing, and extracting value from large, disconnected data sets.
  • Working knowledge of message queuing, stream processing, and highly scalable Big Data, data stores.
  • Strong project management and organizational skills.
  • Experience supporting and working with cross-functional teams in a dynamic environment.
  • Experience in a Data Engineer or similar roles.
  • Experience with big data tools: Delta.io, PySpark, Kafka, etc.
  • Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
  • Experience with data pipeline and workflow management tools: Step functions, Glue workflow, etc.
  • Experience with AWS cloud services: EC2, EMR, RDS, Redshift.

Qualifications:

  • Relevant data warehouse and BI solution training is essential.
  • B.Sc. or related degree is advantageous.
  • 5+ years programming experience.

  • Senior Data Engineer

    4 weeks ago

    Cape Town, Western Cape, South Africa Datonomy Solutions Full time

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Datonomy Solutions. As a key member of our data analytics team, you will play a crucial role in designing, developing, and maintaining our business intelligence systems.Key ResponsibilitiesDesign and Develop BI Solutions: Utilize your expertise in data engineering to...

  • Senior Data Engineer

    2 weeks ago

    Cape Town, Western Cape, South Africa Datonomy Solutions Full time

    We are seeking a highly skilled Senior Data Engineer to join our team at Datonomy Solutions. In this role, you will be responsible for designing and implementing data solutions using industry best practices. You should have a strong background in data and business intelligence, with experience in SQL technology, reporting technology, and cloud technology.Key...

  • Senior Data Engineer

    2 days ago

    Cape Town, Western Cape, South Africa Datonomy Solutions Full time

    We are looking for a Senior Data Engineer at Datonomy Solutions to support and manage BI analytics solutions. In this role, you should have a background in data and business intelligence. You should be analytical; an excellent communicator and a problem-solving aptitude is needed in this role. Ultimately, you will enhance our business intelligence systems to...

  • Senior SCCM Engineer

    2 months ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    Job SummaryThe Senior SCCM Engineer is a key member of the Dimension Data team, responsible for ensuring the smooth operation of our End User Compute environment. This role requires a high level of technical expertise, as well as excellent problem-solving and communication skills.Key ResponsibilitiesInfrastructure ManagementThe Senior SCCM Engineer is...

  • Senior Data Engineer

    2 days ago

    Cape Town, Western Cape, South Africa Datonomy Solutions Full time

    {"roleRequirements":{"qualifications":{"text":"Bachelor's degree in Computer Science, Statistics, Informatics, Information Systems, Engineering or other quantitative fields. National Diploma in Information Technology related discipline preferred."},"workExperience":{"text":"2-5 years of relevant experience in a similar environment working with relevant tools...

  • Senior Solutions Architect

    1 month ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    Job Title: Senior Solutions ArchitectAt Dimension Data, we are seeking a highly skilled Senior Solutions Architect to join our team. As a Senior Solutions Architect, you will be responsible for designing and implementing business solutions that meet the needs of our clients.Key Responsibilities:Design and implement technical solutions that meet client...

  • Senior Solutions Architect

    3 weeks ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    Job Title: Senior Solutions ArchitectDimension Data is seeking a highly skilled Senior Solutions Architect to join our team. As a Senior Solutions Architect, you will be responsible for designing and implementing business solutions that meet the needs of our clients.Key Responsibilities:Design and implement technical solutions that meet client business...

  • Avaya Engineer

    2 months ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    Job Title: Avaya Engineer - Dimension DataWe are seeking a highly skilled Avaya Engineer to join our team at Dimension Data. As an Avaya Engineer, you will be responsible for providing technical support and expertise to our clients and internal teams.Key Responsibilities:Proactively monitor and resolve technical incidents and problems to ensure minimal...

  • Senior Data Engineer

    1 month ago

    Cape Town, Western Cape, South Africa Acuity Consultants Full time

    Job Title: Senior Data EngineerAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our team at Acuity Consultants. As a Senior Data Engineer, you will be responsible for designing and building scalable data pipelines using Apache Spark, developing high-quality code in Java and Scala, and modernizing legacy pipelines to ensure smooth...

  • Senior Data Engineer

    2 weeks ago

    Cape Town, Western Cape, South Africa Progressive IT Resourcing Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Progressive IT Resourcing. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures.Key Responsibilities:Design and implement data pipelines and architectures to support...

  • Senior Data Engineer

    2 weeks ago

    Cape Town, Western Cape, South Africa Acuity Consultants Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at Acuity Consultants. As a Senior Data Engineer, you will be responsible for designing and building scalable data pipelines using Apache Spark, developing high-quality code in Java and Scala, and modernizing and enhancing legacy pipelines.Key...

  • Senior Network Engineer

    2 months ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    Job DescriptionJob SummaryWe are seeking a highly skilled and experienced Senior Network Engineer to join our team at Dimension Data. As a Senior Network Engineer, you will be responsible for designing, implementing, and maintaining complex network infrastructure solutions for our clients.Key ResponsibilitiesDesign and implement network infrastructure...

  • Senior Data Engineer

    1 month ago

    Cape Town, Western Cape, South Africa Ringier South Africa Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Ringier South Africa. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems and pipelines.Key Responsibilities:Design and Implement Data Systems: Develop and implement efficient data systems...

  • Senior Data Engineer

    4 weeks ago

    Cape Town, Western Cape, South Africa Progressive IT Resourcing Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Progressive IT Resourcing. As a Senior Data Engineer, you will play a key role in designing, building, and maintaining our data platforms and services.About the RoleThe Senior Data Engineer will be responsible for:Designing and implementing data ingestion...

  • Senior Software Engineer

    4 weeks ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    About the RoleWe are seeking a highly skilled Senior Developer to join our team at Dimension Data. As a Senior Developer, you will be responsible for designing, developing, and implementing software solutions to meet the business needs of our clients.Key ResponsibilitiesDesign and develop software solutions using C#.Net and AngularResearch and provide...

  • Senior Software Engineer

    1 month ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    About the RoleWe are seeking a highly skilled Senior Developer to join our team at Dimension Data. As a Senior Developer, you will be responsible for designing and implementing software solutions to meet the business' needs.You will work closely with other developers on both technology and product development projects, ensuring that solutions are scalable,...

  • Senior Data Center Electrical Engineer

    4 weeks ago

    Cape Town, Western Cape, South Africa Amazon Data Services South Africa (Pty) Ltd Full time

    About the RoleWe are seeking an experienced Electrical Engineer to join our team at Amazon Data Services South Africa (Pty) Ltd. As a Senior Data Center Electrical Engineer, you will be responsible for providing full life-cycle support to our data centers from design inception through site improvement and maintenance.Key ResponsibilitiesPerform design and...

  • Senior Data Engineer

    4 weeks ago

    Cape Town, Western Cape, South Africa Acuity Consultants Full time

    Job DescriptionThis is a fantastic opportunity for a Senior Data Engineer to work on a global leader in music streaming services, designing and building scalable data pipelines for the algorithmic music recommendation feature of the streaming service.This is a Cape Town-based (hybrid working) role.The CTC on offer for this role is R1,4 – R1,6 million per...

  • Senior Avaya Support Engineer

    1 month ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    Job Title: Senior Avaya Support EngineerDimension Data is seeking a highly skilled Senior Avaya Support Engineer to join our team. As a Senior Avaya Support Engineer, you will be responsible for providing technical support and expertise to our clients, ensuring that their Avaya systems are running smoothly and efficiently.Key Responsibilities:Provide...

  • Solutions Architect

    2 months ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    About the RoleThe Solutions Architect will be responsible for designing and implementing innovative technology solutions that leverage Dimension Data's expertise and enable the team to deploy new software quickly, reliably, and scalably. As a key member of our team, you will drive innovation within the company by developing cutting-edge technology...