Senior Data Engineer-

Found in: Talent ZA C2 - 2 weeks ago


Sandton, South Africa Dimension Data Full time
Functieomschrijving

About Dimension Data

At Dimension Data we empowering our people to deliver client-centric solutions. We want to see our people make the most of every opportunity, and together we can achieve the extraordinary. Our diverse and inspiring people are experts at what they do and serious about delivering measurable and sustainable value at every turn.

Requirements

  • Extensive understanding and application of Python Development and building complex solutions and applications.
  • Extensive understanding and application of Python and data processing and transformation
  • Strong understanding of Microsoft SQL Server and T-SQL Development
  • Strong Understanding of Code Optimization
  • Understanding of Real-Time Data Processing and Streaming
  • Understanding of Apache Beam
  • Advantageous
  • Understanding of Apache NiFi and building complex workflows.
  • Understanding of opensource streaming technologies (Apache Spark Streaming, Flink)
  • Understanding of Apache Kafka
  • Understanding of Apache Spark
  • Understanding of Apache Hadoop
  • Competency in Python and developing Spark models.
  • Fundamental understanding of MongoDB
  • Fundamental understanding of Redis
  • Fundamental understanding of Databricks
  • Fundamental understanding and optimization of Linux and cloud environments.

Key Performance Areas:

  • Effectively conceptualize, design, and create high-quality, custom workflows and analytics solutions.
  • Develop, test, and implement big data solution designs.
  • Understand client requirements and establish knowledge of data for accurate design, analysis, and retrieval.
  • Pull data from various data sources and combine it to store it in a data store for analysis and retrieval.
  • Collaborating with end users on standardized and best practice approaches.
  • Making suggestions and enhancements on existing solutions.
  • Providing regular and timely feedback to clients on design and build status
  • Educating requestors as to appropriate and desirable parameters to ensure they get the information they need
  • Ensure all tasks are updated on agile boards in a timely manner
  • Assist Project Managers and Change and Training Managers with any project and training related administration tasks
  • Actively Upskill in relevant technologies as prescribed by team leadership
  • Integration and execution with Machine-learning models and AI in-flow.
  • Documentation and Design of Solutions

Job Related Experience:

  • Minimum 4+ years work experience with exposure to data pipeline development and solutions
  • architecture as well as project management/coordination experience.

Behavioural Competencies:

  • Good Communication Skills
  • Good Presentation Skills
  • Good Adaptability
  • Must take Initiative
  • Good at planning and organising
  • Good at Teamwork
  • Good at Influencing
  • Good at Problem Solving
  • Must have Attention to Detail
  • Must be good at Analytical Thinking
  • Must have a desire for Innovation
  • Must be able to Conceptualise ideas

Qualifications

B Degree – Computer Science / Engineering

Hortonworks Certified


  • Data Engineer

    Found in: Talent ZA C2 - 2 weeks ago


    Sandton, South Africa Dimension Data Full time

    FunctieomschrijvingStandard Bank Anglo is looking for a Data Engineer. This will be strictly remote work. Requirements Advanced knowledge of T24 architecture and Data from a MOD perspective Analyze and organize raw data Build data systems and pipelinesEvaluate business needs and objectivesInterpret trends and patternsConduct complex data analysis and report...

  • Intermediate Data Engineer-

    Found in: Talent ZA C2 - 2 weeks ago


    Sandton, South Africa Dimension Data Full time

    FunctieomschrijvingIntermediate Data Engineer, Data Processing and Archiving, SQL, Big Data Analytics, Big Data This is a great opportunity to work with an industry leading company in the finance sector. The role will be based at our headquarters in London. The ideal candidate will have strong experience of working on large scale data processing projects...

  • Senior Mobile Engineer-

    Found in: Talent ZA C2 - 2 weeks ago


    Sandton, South Africa Dimension Data Full time

    FunctieomschrijvingOur client seeks a Senior Mobile Dev – Skill base Ionic 5 for a 6 month contract.   Requirements ·       Knowledge of the SOLID principles (Clean code)·       Skill base Ionic 5·       OO concepts·       TDD·       BDD·       Testing methodologies (Smoke / Pen /...

  • Senior Data Engineer X5

    Found in: Whatjobs ZA C2 - 3 days ago


    Sandton, South Africa HR Genie Full time

    Our Client a Global Tech firm is seeking a 5 Senior Data Engineers to join their team in Sandton on a contract basis. They offer stability, growth, attractive rates and a great working environment. The Data Engineer skill is required to enable the data lifecycle within EDS, namely the ability to integrate data between the source system (golden/trusted) and...

  • Senior Data Engineer X5

    Found in: Talent ZA 2A C2 - 2 weeks ago


    Sandton, South Africa HR Genie Full time

    Our Client a Global Tech firm is seeking a 5 Senior Data Engineers to join their team in Sandton on a contract basis. They offer stability, growth, attractive rates and a great working environment.The Data Engineer skill is required to enable the data lifecycle within EDS, namely the ability to integrate data between the source system (golden/trusted) and...

  • Data Specialist

    Found in: Talent ZA C2 - 2 weeks ago


    Sandton, South Africa Dimension Data Full time

    FunctieomschrijvingUnder the guidance of more senior IT Data Architects, the IT Data Specialist applies data analysis, data modelling and quality assurance techniques based on a detailed understanding of business processes to establish, modify or maintain internal data structures and associated components (entity, relationship and attribute descriptions)....

  • Process Engineer II

    Found in: Talent ZA C2 - 2 weeks ago


    Sandton, South Africa Dimension Data Full time

    To deal with and influence the more strategic and tactical aspects of discovering, validating, documenting, and communicating business process-related knowledge through modeling: simulating and analysing current and future states. The focus is on complex business outcomes and technical aspects, in line with the business Strategy. Requirements ...

  • Network Engineer

    Found in: Talent ZA C2 - 2 weeks ago


    Sandton, South Africa Dimension Data Full time

    FunctieomschrijvingUnder the guidance of more senior Networking Engineers, the Network Engineer (L1) will provide a service to clients to ensure that their IT infrastructure and systems remain operational through proactively identifying, investigating, and resolving technical incidents and problems and to restore services to clients by managing incidents to...

  • Data Engineer

    Found in: Talent ZA C2 - 18 hours ago


    Sandton, South Africa Hollard Recruitment Full time

    An exciting new opportunity has become available within Hollard Group Risk. We are looking to recruit a Data Engineer in our IT Operations Space.The Data Engineering will report into the Hollard Group Risk (HGR) Business Unit area and will provide BI Development and Data Analysis across all departments within HGR.The Data Engineering will report into the...

  • DevOps Engineer

    Found in: Talent ZA C2 - 2 weeks ago


    Sandton, South Africa Dimension Data Full time

    FunctieomschrijvingWe are looking for talented and enthusiastic DevOps Engineers to join our “Building 20” team at Dimension Data. Building 20 is our innovation program targeting the technology platforms we use to service our clients. We’re looking for self-starters to join this team – not only to optimise and improve our current approaches, but also...

  • Master Data Migration Consultant

    Found in: Talent ZA C2 - 2 weeks ago


    Sandton, South Africa Dimension Data Full time

    FunctieomschrijvingAs a Master Data Migration Consultant, you'll provide support to the company's engineers on issues relating to data migration. You will work closely with our teams in Engineering and Business Development.You will be responsible for researching technical solutions that would allow us to quickly transfer data from one system or database into...

  • Security Engineer

    Found in: Talent ZA C2 - 2 weeks ago


    Sandton, South Africa Dimension Data Full time

    FunctieomschrijvingAre you tired of working long hours, being unproductive and feeling pressured by your manager? Are you looking to work for a company where your opinions matter and you can make an impact? We're here to offer you this job as a Security Engineer!As a Security Engineer, you'll work with the engineering team to develop and implement security...

  • Senior Technical Consultant

    Found in: Talent ZA C2 - 2 weeks ago


    Sandton, South Africa Dimension Data Full time

    As a Senior Technical Consultant, you will be responsible for delivering high-quality software solutions, and technical consulting to the business. You'll use your extensive experience building complex applications in Microsoft technologies to ensure that our products are delivered on time and on budget. To be the custodian of technical thought leadership...

  • Senior SD-WAN Network Engineer

    Found in: Talent ZA C2 - 2 weeks ago


    Sandton, South Africa Dimension Data Full time

    FunctieomschrijvingYou will be responsible for the validation of the service integrity of the deployed and supported networks. This will include the validation of the report integrity for customer interaction. The role requires close interaction with the deployment and support teams to identify any changes that would be required to further enhance the...

  • SecOps Engineer

    Found in: Talent ZA C2 - 2 weeks ago


    Sandton, South Africa Dimension Data Full time

    FunctieomschrijvingAre you tired of working long hours? Is your job unfulfilling and unrewarding? Do you want to work only 8 hours a day, including a maximum of 2 am to 9 am during weekdays? Are you looking for an opportunity in which your work will have real impact on the lives of others around you? Apply for this SecOps Engineer (L3) role!As a SecOps...

  • MS Engineer

    Found in: Talent ZA C2 - 2 weeks ago


    Sandton, South Africa Dimension Data Full time

    FunctieomschrijvingAre you looking for a career in one of the best engineering companies? Apply for this MS Engineer (L2) role!MS Engineer (L2) is responsible for providing a managed service to clients to ensure that their IT infrastructure and systems remain operational. Through the proactive monitoring, identifying, investigating and resolving of technical...

  • Data Centre Technician

    Found in: Talent ZA C2 - 2 weeks ago


    Sandton, South Africa Dimension Data Full time

    FunctieomschrijvingThe Data Center Technician (DCT) responsibility is the maintenance of all Data Centre Facilities and management of 3rd party vendors ensuring a 24/7 service offering within Internet Solutions Data Centers .The DCT provides a service to clients to ensure that their IT infrastructure and systems remain operational through proactively...

  • Azure Platform Engineer

    Found in: Talent ZA C2 - 2 weeks ago


    Sandton, South Africa Dimension Data Full time

    FunctieomschrijvingIf you want to work in a company that values your opinion, and if you understand the importance of making an impact on your team's development, then apply for this Azure Platform Engineer role!As a Platform Engineer, you'll be responsible for designing and building new services in the Azure Cloud Platform. You will work with engineers from...

  • Security Engineer L3-

    Found in: Talent ZA C2 - 2 weeks ago


    Sandton, South Africa Dimension Data Full time

    FunctieomschrijvingThe Security Engineer L3 is a high level in the Engineer series and may be assigned to function as a supervisor, expert or leader. When assigned as a supervisor, develops, coordinates and executes policies, methods and procedures, and supervises personnel; when assigned as an expert, performs work requiring a very high level of technical...

  • TS Implementation Engineer

    Found in: Talent ZA C2 - 2 weeks ago


    Sandton, South Africa Dimension Data Full time

    FunctieomschrijvingTS Implementation Engineer is involved in highly complex environments for installation, conguration and fault management. They provide technical support to Dimension Data clients. This includes remotely supporting clients within Service Level Agreements (SLAs) to install and congure software and hardware, resolve incidents, perform root...