Senior Data Engineer-

4 weeks ago


Sandton, South Africa Dimension Data Full time
Functieomschrijving

About Dimension Data

At Dimension Data we empowering our people to deliver client-centric solutions. We want to see our people make the most of every opportunity, and together we can achieve the extraordinary. Our diverse and inspiring people are experts at what they do and serious about delivering measurable and sustainable value at every turn.

Requirements

  • Extensive understanding and application of Python Development and building complex solutions and applications.
  • Extensive understanding and application of Python and data processing and transformation
  • Strong understanding of Microsoft SQL Server and T-SQL Development
  • Strong Understanding of Code Optimization
  • Understanding of Real-Time Data Processing and Streaming
  • Understanding of Apache Beam
  • Advantageous
  • Understanding of Apache NiFi and building complex workflows.
  • Understanding of opensource streaming technologies (Apache Spark Streaming, Flink)
  • Understanding of Apache Kafka
  • Understanding of Apache Spark
  • Understanding of Apache Hadoop
  • Competency in Python and developing Spark models.
  • Fundamental understanding of MongoDB
  • Fundamental understanding of Redis
  • Fundamental understanding of Databricks
  • Fundamental understanding and optimization of Linux and cloud environments.

Key Performance Areas:

  • Effectively conceptualize, design, and create high-quality, custom workflows and analytics solutions.
  • Develop, test, and implement big data solution designs.
  • Understand client requirements and establish knowledge of data for accurate design, analysis, and retrieval.
  • Pull data from various data sources and combine it to store it in a data store for analysis and retrieval.
  • Collaborating with end users on standardized and best practice approaches.
  • Making suggestions and enhancements on existing solutions.
  • Providing regular and timely feedback to clients on design and build status
  • Educating requestors as to appropriate and desirable parameters to ensure they get the information they need
  • Ensure all tasks are updated on agile boards in a timely manner
  • Assist Project Managers and Change and Training Managers with any project and training related administration tasks
  • Actively Upskill in relevant technologies as prescribed by team leadership
  • Integration and execution with Machine-learning models and AI in-flow.
  • Documentation and Design of Solutions

Job Related Experience:

  • Minimum 4+ years work experience with exposure to data pipeline development and solutions
  • architecture as well as project management/coordination experience.

Behavioural Competencies:

  • Good Communication Skills
  • Good Presentation Skills
  • Good Adaptability
  • Must take Initiative
  • Good at planning and organising
  • Good at Teamwork
  • Good at Influencing
  • Good at Problem Solving
  • Must have Attention to Detail
  • Must be good at Analytical Thinking
  • Must have a desire for Innovation
  • Must be able to Conceptualise ideas

Qualifications

B Degree – Computer Science / Engineering

Hortonworks Certified


  • Senior Data Engineer-

    2 weeks ago


    Sandton, South Africa Dimension Data Full time

    FunctieomschrijvingAbout Dimension DataAt Dimension Data we empowering our people to deliver client-centric solutions. We want to see our people make the most of every opportunity, and together we can achieve the extraordinary. Our diverse and inspiring people are experts at what they do and serious about delivering measurable and sustainable value at every...

  • Data Engineer

    2 weeks ago


    Sandton, South Africa Dimension Data Full time

    FunctieomschrijvingStandard Bank Anglo is looking for a Data Engineer. This will be strictly remote work. RequirementsAdvanced knowledge of T24 architecture and Data from a MOD perspective Analyze and organize raw data Build data systems and pipelinesEvaluate business needs and objectivesInterpret trends and patternsConduct complex data analysis and report...

  • Data Engineer

    4 weeks ago


    Sandton, South Africa Dimension Data Full time

    FunctieomschrijvingStandard Bank Anglo is looking for a Data Engineer. This will be strictly remote work. Requirements Advanced knowledge of T24 architecture and Data from a MOD perspective Analyze and organize raw data Build data systems and pipelinesEvaluate business needs and objectivesInterpret trends and patternsConduct complex data analysis and report...


  • Sandton, South Africa Dimension Data Full time

    FunctieomschrijvingIntermediate Data Engineer, Data Processing and Archiving, SQL, Big Data Analytics, Big Data This is a great opportunity to work with an industry leading company in the finance sector. The role will be based at our headquarters in London. The ideal candidate will have strong experience of working on large scale data processing projects...


  • Sandton, South Africa Dimension Data Full time

    FunctieomschrijvingDo you want greater control over your own career? We believe this Data Centre Operations role was created for you! Please read through and apply!Data Centre Operations (DCO) person: Data Centre - manages the operational day to day tasks onsite and assists the Site Manager/ Senior Operations Manager in operational tasks such as budgeting,...

  • Data Analyst

    2 months ago


    Sandton, South Africa Dimension Data Full time

    As a Data Analyst, you will help to build and maintain the company's data warehouse and analysis tools. You'll work with other analysts in order to understand the business requirements of our customers and deliver new products that meet those needs. **Requirements - Builds and maintains database infrastructure used for data storage, processing, and...

  • Engineer Backups

    4 weeks ago


    Sandton, South Africa Dimension Data Full time

    FunctieomschrijvingAre you looking to be a part of an innovative team that wants to work with the latest technologies? Do you want to work in a place where your ideas are valued and implemented? Are you looking for a new challenge? We believe this role should be perfect for you! Please read through and apply.As a Backups Engineer, you'll be responsible for...

  • Data Analyst

    2 weeks ago


    Sandton, South Africa Dimension Data Full time

    As a Data Analyst, you will help to build and maintain the company's data warehouse and analysis tools. You'll work with other analysts in order to understand the business requirements of our customers and deliver new products that meet those needs.**Requirements Builds and maintains database infrastructure used for data storage, processing, and analysis...


  • Sandton, South Africa Dimension Data Full time

    FunctieomschrijvingOur client seeks a Senior Mobile Dev – Skill base Ionic 5 for a 6 month contract.   Requirements ·       Knowledge of the SOLID principles (Clean code)·       Skill base Ionic 5·       OO concepts·       TDD·       BDD·       Testing methodologies (Smoke / Pen /...


  • Sandton, South Africa HR Genie Full time

    Our Client a Global Tech firm is seeking a 5 Senior Data Engineers to join their team in Sandton on a contract basis. They offer stability, growth, attractive rates and a great working environment.The Data Engineer skill is required to enable the data lifecycle within EDS, namely the ability to integrate data between the source system (golden/trusted) and...


  • Sandton, South Africa HR Genie Full time

    Our Client a Global Tech firm is seeking a 5 Senior Data Engineers to join their team in Sandton on a contract basis. They offer stability, growth, attractive rates and a great working environment. The Data Engineer skill is required to enable the data lifecycle within EDS, namely the ability to integrate data between the source system (golden/trusted) and...

  • Data Specialist

    2 weeks ago


    Sandton, South Africa Dimension Data Full time

    FunctieomschrijvingUnder the guidance of more senior IT Data Architects, the IT Data Specialist applies data analysis, data modelling and quality assurance techniques based on a detailed understanding of business processes to establish, modify or maintain internal data structures and associated components (entity, relationship and attribute descriptions)....

  • Data Specialist

    4 weeks ago


    Sandton, South Africa Dimension Data Full time

    FunctieomschrijvingUnder the guidance of more senior IT Data Architects, the IT Data Specialist applies data analysis, data modelling and quality assurance techniques based on a detailed understanding of business processes to establish, modify or maintain internal data structures and associated components (entity, relationship and attribute descriptions)....

  • Process Engineer II

    4 weeks ago


    Sandton, South Africa Dimension Data Full time

    To deal with and influence the more strategic and tactical aspects of discovering, validating, documenting, and communicating business process-related knowledge through modeling: simulating and analysing current and future states. The focus is on complex business outcomes and technical aspects, in line with the business Strategy. Requirements ...


  • Sandton, South Africa Dimension Data Full time

    FunctieomschrijvingAre you looking for an opportunity where you make a real impact? Do you want to work with a team of highly motivated, talented individuals who are passionate about what they do? Are you interested in working from home every other week or in the office during weekdays? We believe this Senior Infrastructure Project Manager was created for...

  • Data Engineer

    2 weeks ago


    Sandton, South Africa Investec Full time

    Description We are looking for an experienced Data Engineer to join our dynamic team. This role is based in South Africa (Investec Ltd.), and the main Investec office is the 100 Grayston. The Data Engineer will design, develop, and maintain our data systems and infrastructure. This role requires strong technical skills, a deep knowledge of data engineering...

  • Network Engineer

    4 weeks ago


    Sandton, South Africa Dimension Data Full time

    FunctieomschrijvingUnder the guidance of more senior Networking Engineers, the Network Engineer (L1) will provide a service to clients to ensure that their IT infrastructure and systems remain operational through proactively identifying, investigating, and resolving technical incidents and problems and to restore services to clients by managing incidents to...


  • Sandton, South Africa Dimension Data Full time

    FunctieomschrijvingMS Network Engineer L4 Description The MS Network Engineer L4 is a high level in the Engineer series and may be assigned to function as a supervisor, expert, or leader. When assigned as a supervisor, develops, coordinates and executes policies, methods and procedures, and supervises personnel; when assigned as an expert, performs work...


  • Sandton, South Africa Dimension Data Full time

    FunctieomschrijvingMS Network Engineer L4 Description The MS Network Engineer L4 is a high level in the Engineer series and may be assigned to function as a supervisor, expert, or leader. When assigned as a supervisor, develops, coordinates and executes policies, methods and procedures, and supervises personnel; when assigned as an expert, performs work...

  • Junior Data Engineer

    2 weeks ago


    Sandton, South Africa Progressive IT Resourcing Full time

    Job PurposeThe purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the Company Data Architecture Roadmap, to advance technical thought leadership for the Enterprise, deliver fit for purpose data products, and support data initiatives. In addition, Data Engineers enhance the data infrastructure of the...