Senior Data Engineer

4 weeks ago


Sandton, South Africa Dimension Data Full time
About Dimension Data

We are seeking a highly skilled Data Engineer to join our team at Dimension Data. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines and architectures.

Key Responsibilities:

  • Design and implement data pipelines and architectures to meet business requirements.
  • Develop and maintain high-quality, custom workflows and analytics solutions.
  • Collaborate with cross-functional teams to understand client requirements and establish knowledge of data for accurate design, analysis, and retrieval.
  • Pull data from various data sources and combine it to store it in a data store for analysis and retrieval.
  • Provide regular and timely feedback to clients on design and build status.
  • Educate requestors as to appropriate and desirable parameters to ensure they get the information they need.
  • Ensure all tasks are updated on agile boards in a timely manner.
  • Assist Project Managers and Change and Training Managers with any project and training related administration tasks.
  • Actively upskill in relevant technologies as prescribed by team leadership.
  • Integration and execution with Machine-learning models and AI in-flow.
  • Documentation and Design of Solutions.

Requirements:

  • Minimum 4+ years work experience with exposure to data pipeline development and solutions architecture as well as project management/coordination experience.
  • Strong understanding of Python, data processing, and transformation.
  • Strong understanding of Microsoft SQL Server and T-SQL Development.
  • Strong understanding of Code Optimization.
  • Understanding of Real-Time Data Processing and Streaming.
  • Understanding of Apache Beam.
  • Advantageous: Understanding of Apache NiFi and building complex workflows.
  • Understanding of opensource streaming technologies (Apache Spark Streaming, Flink).
  • Understanding of Apache Kafka.
  • Understanding of Apache Spark.
  • Understanding of Apache Hadoop.
  • Competency in Python and developing Spark models.
  • Fundamental understanding of MongoDB.
  • Fundamental understanding of Redis.
  • Fundamental understanding of Databricks.
  • Fundamental understanding and optimization of Linux and cloud environments.

Qualifications:

B Degree – Computer Science / Engineering.

Hortonworks Certified.


  • Data Engineer

    2 weeks ago


    Sandton, South Africa Dimension Data Full time

    About Dimension DataWe are looking for an experienced Senior Data Engineer to join our team at Dimension Data. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data pipelines and solutions.Key ResponsibilitiesDesign and implement data pipelines and solutions using Python and big data technologies.Collaborate...

  • Senior Data Engineer

    4 weeks ago


    Sandton, South Africa Dimension Data Full time

    About Dimension DataWe empower our people to deliver client-centric solutions. Our diverse and inspiring team of experts is serious about delivering measurable and sustainable value at every turn.Key Responsibilities:Conceptualize, design, and create high-quality, custom workflows and analytics solutions.Develop, test, and implement big data solution...

  • Data Engineer

    2 weeks ago


    Sandton, South Africa Dimension Data Full time

    Job RequirementsWe are looking for a skilled Data Engineer to join our team at Dimension Data. Key ResponsibilitiesAdvanced knowledge of T24 architecture and Data from a MOD perspective is essential.Analyzing and organizing raw data to meet business needs.Designing and building data systems and pipelines to support business objectives.Evaluating business...


  • Sandton, South Africa Dimension Data Full time

    Dimension DataA highly experienced Senior Cloud Engineer Leader is required to join our team at Dimension Data, where you will play a key role in shaping the future of cloud engineering. The ideal candidate will have substantial years of team management experience and a strong working knowledge of Amazon Web Services / Microsoft Azure.The successful...


  • Sandton, South Africa Dimension Data Full time

    OverviewWe are seeking an experienced Senior Software Engineer to join our team at Dimension Data.Estimated Salary: €90,000 - €120,000 per annumJob Description:As a Senior Software Engineer, you will play a key role in designing and developing high-quality software solutions using Java, Go, JavaScript, HTML, CSS, and C# .Net. You will also be responsible...


  • Sandton, South Africa Dimension Data Full time

    About the RoleAs a Data Engineer at Dimension Data, you will play a key part in designing and developing high-quality big data solutions. With a strong focus on Python development and data processing, you will work closely with our team to create custom workflows and analytics solutions that meet our clients' needs.


  • Sandton, South Africa Dimension Data Full time

    Job SummaryWe are seeking a highly skilled Senior Engineering Manager to lead the development of high-performing, scalable applications at Dimension Data in Johannesburg CBD. This is a 6-month contract opportunity.About the RoleThe successful candidate will be responsible for building and leading a team of engineers to design and develop complex technical...

  • Senior Data Architect

    2 weeks ago


    Sandton, South Africa Dimension Data Full time

    Job SummaryWe are seeking a skilled Intermediate Data Engineer to join our team at Dimension Data. As a Data Engineer and Analyst, you will be responsible for designing and developing scalable data processing solutions using Apache Hadoop and Spark technology. The ideal candidate will have strong experience in data pipeline development, data processing and...


  • Sandton, South Africa Dimension Data Full time

    Job SummaryWe are seeking an experienced Senior Network Engineer Lead to join our team at Dimension Data. As a key member of our engineering team, you will be responsible for leading the design, implementation, and maintenance of complex network architectures.About the RoleThis is a senior leadership role that requires technical expertise, strong...


  • Sandton, South Africa Dimension Data Full time

    Role OverviewWe are seeking a highly skilled Data Protection Engineer to join our Dimension Data team. In this role, you will be responsible for maintaining and improving the company's backup infrastructure, ensuring that all data is backed up on an ongoing basis and can be restored quickly in the event of an outage or disaster.ResponsibilitiesProvide...


  • Sandton, South Africa Dimension Data Full time

    Job Title:Intermediate Data EngineerJob Summary:We are seeking an experienced Intermediate Data Engineer to join our team at Dimension Data. The successful candidate will have a strong background in data processing and archiving, with expertise in SQL and Big Data Analytics.Key Responsibilities:Design and develop high-quality, custom workflows and analytics...


  • Sandton, South Africa Dimension Data Full time

    As a Cloud Engineer Senior Professional at Dimension Data, you will be responsible for delivering high-quality services to our clients by proactively identifying and resolving technical incidents and problems.Your primary objective is to ensure zero missed service level agreement (SLA) conditions, providing a seamless experience for our clients. You will...


  • Sandton, South Africa Dimension Data Full time

    Key ResponsibilitiesAs a Senior Network Engineer at Dimension Data, you will be responsible for designing, implementing, and maintaining complex network infrastructure. Your expertise in network planning, configuration, and troubleshooting will be crucial in ensuring the stability and security of our network systems.RequirementsTo be successful in this role,...


  • Sandton, South Africa Dimension Data Full time

    We are looking for a skilled Senior Frontend Software Engineer to join our team at Dimension Data.About the RoleThis is an exciting opportunity for an experienced frontend developer to work on complex software projects using Angular 7/8/9 and TypeScript. As a senior engineer, you will be responsible for designing and developing high-quality frontend...


  • Sandton, South Africa Dimension Data Full time

    Job DescriptionWe are seeking an experienced Senior Network Solutions Engineer to join our team at Dimension Data. As a key member of our engineering team, you will play a critical role in designing and implementing network solutions for our clients.Key Responsibilities:Designing and deploying Cisco VPN Firewall solutionsMaintaining and administering a...


  • Sandton, South Africa Dimension Data Full time

    Job SummaryThe Senior Network Engineer will be responsible for providing expert-level technical support to clients by proactively identifying and resolving complex technical incidents and problems. This role will maintain a high level of service to clients by ensuring zero missed service level agreement (SLA) conditions.The ideal candidate will have solid...


  • Sandton, South Africa Dimension Data Full time

    About the RoleWe are seeking an experienced Senior Frontend Engineer to join our team at Dimension Data. This is an exciting opportunity to work with cutting-edge technologies and collaborate with a talented team of professionals.Key ResponsibilitiesDesign and develop complex frontend applications using Angular and TypeScript.Collaborate with...


  • Sandton, South Africa Dimension Data Full time

    Company OverviewDimension Data is a leading technology services company that provides data migration solutions to clients worldwide. Our team of experts has extensive experience in manufacturing data integration, ensuring seamless data transfer between systems.Job SummaryWe are seeking a skilled Senior Data Migration Specialist to join our team in Dimension...

  • Data Centre Operations

    6 months ago


    Sandton, South Africa Dimension Data Full time

    FunctieomschrijvingDo you want greater control over your own career? We believe this Data Centre Operations role was created for you! Please read through and apply!Data Centre Operations (DCO) person: Data Centre - manages the operational day to day tasks onsite and assists the Site Manager/ Senior Operations Manager in operational tasks such as budgeting,...

  • Data Architect

    4 weeks ago


    Sandton, South Africa Dimension Data Full time

    Job Title: Data EngineerWe are seeking a skilled Data Engineer to join our team at Dimension Data. This is a remote work opportunity.Key Responsibilities:Design and develop data systems and pipelines to support business needsAnalyze and interpret complex data to inform business decisionsCollaborate with data scientists and architects to drive data-driven...