Data Engineer

Found in: beBee S ZA - 1 month ago

Western Cape Cape Town, South Africa Woolworths Full time
Woolworths’s job vacancy, Career and Recruitment

Job title : Data Engineer – Cape Town jobs in Western Cape

Job Location : Western Cape, Cape Town

Deadline : March 22, 2024

Quick Recommended Links

Jobs by Location Job by industries

Job description

Assist in designing and implementing scalable and robust processes for ingesting and transforming large data sets. Assist in the design and implementation of data pipelines from a variety of data sources and support the maintenance thereof. Ingest large, complex data sets that meet functional and non-functional requirements. Enable the business to solve the problem of working with large volumes of data in diverse formats, and in doing so, enable innovative solutions. Build bulk and delta data patterns for optimal extraction, transformation, and loading of data. Supports the organisations cloud strategy and alignment to data architecture and data governance. Engineer data in the appropriate formats for downstream consumption for analytics or Enterprise applications. Assist in the development of APIs to expose the data to Enterprise Applications and 3rd party vendors. Assist in identifying, designing and implementing robust process improvement activities to drive efficiency and automation for greater scalability.  This includes looking at new solutions and new ways of working and being on the forefront of emerging technologies. Work with various stakeholders across the organisation to understand data requirements and apply technical knowledge of data management to solve key business problems. Provide support in the operational environment with all relevant support teams for data services. Create and maintain functional requirements and system specifications in support of data architecture and detailed design specifications for current and future designs. Support test and deployment of new services and features.

Minimum requirements

Bachelor’s degree in Computer Science, Business Informatics, Mathematics, Statistics or Engineering with 4 – 5 years relevant data engineering experience. A strong understanding of data structures, algorithms, and effective software design. Significant experience working with structured and unstructured data at scale and different data stores such as key-value, document, columnar, etc. as well as traditional RDBMS and data warehouses. Good programming, performance tuning and troubleshooting skills using programming languages such as python, scala, java and C . Practical experience with Apache Spark and AWS services such as Redshift, Glue, Lambda, EMR, S3, IAM, RDS, etc. Experience wrangling terabytes of big, complicated, imperfect data. Experience with designing and implementing Cloud (AWS) solutions including use of APIs available. Experience with DevOPS architecture, implementation and operation would be advantageous. Experience with version control systems such as Git, SVN. Excellent verbal and written communication skills; must work well in an agile, collaborative team environment.Knowledge of Engineering and Operational Excellence using standard methodologies. Best practices in software engineering, data management, data storage, data computing and distributed systems to solve business problems with data. Some experience in applying SAFe/Scrum/Kanban methodologies would be advantageous. Knowledge and understanding of business process management lifecycle which covers the design, modelling, execution, monitoring, and optimization as well as business process re-engineering. Good problem-solving skills: The ability to exercise judgment in solving technical, operational, and organizational challenges, to identify issues proactively, to present solutions and options leading to resolution

*ICT jobs in south africa

*Data Engineer – Cape Town in Cape Town

  • Data Engineer

    Found in: Talent ZA C2 - 3 weeks ago

    Cape Town, South Africa Dimension Data Full time

    As a Data Engineer, you'll design and build the data architecture of our products. You will use your technical knowledge to help us develop new products by taking an idea from concept to reality. You'll work on projects across multiple teams in order to achieve company goals and objectives. Your role will involve: - Analyzing business requirements; -...

  • Data & QA Engineer

    Found in: beBee S ZA - 4 weeks ago

    Western Cape, Cape Town, South Africa Crypto Banter Full time

    Crypto Banter’s job vacancy, Career and Recruitment Job title : Data & QA Engineer jobs in Western Cape Job Location : Western Cape, Cape Town Deadline : May 01, 2024 Quick Recommended Links Jobs by Location Job by industries Role Overview: We’re seeking a multifaceted specialist who blends the expertise of QA, Data Analysis, and Data Engineering....

  • Data Engineer

    Found in: beBee jobs ZA - 2 weeks ago

    Cape Town, Western Cape, South Africa Creative CFO Full time

    Creative CFO's job vacancy, Career and RecruitmentJob title : Data Engineer – Cape Town jobs in Western CapeJob Location : Western Cape, Cape TownDeadline : April 28, 2024Quick Recommended LinksJobs by LocationJob by industries The position:As a Data Engineer at Creative CFO, you will be at the forefront of architecting, building, and maintaining our data...

  • IT Data Engineer

    Found in: Talent ZA 2A C2 - 3 weeks ago

    Cape Town, South Africa Armstrong Appointments Full time

    Our client based in Cape Town are currently seeking the skills of an IT Data Engineer to assist in designing and implementing scalable and robust processes to support the data engineering capability. This role will be responsible for extracting and transforming massive amounts of data at scale and consolidating this data into a bigger data ecosystem. Main...

  • Data Engineer

    Found in: Talent ZA C2 - 3 weeks ago

    Cape Town, South Africa 60degrees Full time

    Job Description Data Engineer (Gauteng) Compensation: R 450 000 – R 550 000 per annum Working model: Hybrid The opportunity that awaits you: Our client, a solutions energy engineering solution provider with projects mainly in Sub-Saharan Africa seeks to expand their team. Our client takes pride in not just ticking a box but...

  • Data Engineer

    Found in: Talent ZA C2 - 3 weeks ago

    Cape Town, South Africa DLK Group Full time

    Job Description ·Modifying the database structure, asnecessary, from information given by application developers. ·Enrolling users and maintaining systemsecurity. ·Controlling and monitoring user accessto the database. ·Monitoring and optimizing the performanceof the database. ·Maintaining archived data. ·Contacting database vendor...

  • L2 Network Engineer

    Found in: Talent ZA C2 - 3 weeks ago

    Cape Town, South Africa Dimension Data Full time

    FunctieomschrijvingAre you tired of micro-managing your work? Do you want to be part of a team where it is easy to make a difference? My client instructs me to find the right people for this L2 Network Engineer role!As a L2 Network Engineer, you'll be responsible for helping to maintain and upgrade the company's networks. You will perform regular network...

  • Network Engineer L1

    Found in: Talent ZA C2 - 3 weeks ago

    Cape Town, South Africa Dimension Data Full time

    FunctieomschrijvingNetwork Engineer L1LOCATION : Cape Town, South AfricaTYPE : TemporaryDo you want to join a company that values your opinion? Do you want to work on the same project for years, becoming more and more involved in the process? Do you enjoy working with people from all over the world? Check out this Senior Network Engineer L1 role!As a Network...

  • Data Engineer

    Found in: Whatjobs ZA C2 - 1 week ago

    Cape Town, South Africa IOCO Full time

    We are seeking an experienced Data Migration Engineer to join our team on a contract basis to facilitate this migration process. The ideal candidates will have strong expertise in data engineering, particularly with Azure Synapse services, SSIS, and API integration.   What you’ll do: Collaborate with the existing team to understand the current data...

  • Data Engineer

    Found in: Talent ZA 2A C2 - 3 weeks ago

    Cape Town, South Africa IOCO Full time

    We are seeking an experienced Data Migration Engineer to join our team on a contract basis to facilitate this migration process. The ideal candidates will have strong expertise in data engineering, particularly with Azure Synapse services, SSIS, and API integration. What you’ll do:Collaborate with the existing team to understand the current data...

  • Avaya Engineer

    Found in: Talent ZA C2 - 3 weeks ago

    Cape Town, South Africa Dimension Data Full time

    FunctieomschrijvingAre you looking for a new challenge? Are you tired of working long hours and feeling like you are not making an impact? We believe this Avaya Engineer role was created for you!As an Avaya Engineer, you'll be responsible for the information technology (IT) support of our business. You will provide IT technical support to all teams within...

  • Intern Data Engineer

    Found in: beBee jobs ZA - 3 weeks ago

    Cape Town, Western Cape, South Africa Kuda Full time

    Kuda's job vacancy, Career and RecruitmentJob title : Intern Data Engineer (6 Months) jobs in Western CapeJob Location : Western Cape, Cape TownDeadline : May 16, 2024Quick Recommended LinksJobs by LocationJob by industries Learning OpportunitiesDirect exposure to Microsoft SQL Server and Azure SQL DB.Hands-on experience with data integration and...

  • AWS Data Engineer

    Found in: Talent ZA C2 - 3 weeks ago

    Cape Town, South Africa PBT Group Full time

    PBT Group is currently offering an opportunity for an AWS Data Engineer with 2 to 5 years of relevant experience.The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security. Data Engineers play a pivotal role in facilitating the acquisition of data from diverse sources,...

  • Data Integration Engineer

    Found in: beBee S ZA - 4 weeks ago

    Western Cape, Cape Town, South Africa Boldr Full time

    Boldr’s job vacancy, Career and Recruitment Job title : Data Integration Engineer – Cape Town jobs in Western Cape Job Location : Western Cape, Cape Town Deadline : May 04, 2024 Quick Recommended Links Jobs by Location Job by industries WHAT WILL YOU DO Understand and execute complex client data operations and troubleshooting within a PHP...

  • Data Integration Engineer

    Found in: beBee S ZA - 3 weeks ago

    Western Cape, Cape Town, South Africa Boldr Full time

    Boldr’s job vacancy, Career and Recruitment Job title : Data Integration Engineer – Cape Town jobs in Western Cape Job Location : Western Cape, Cape Town Deadline : May 04, 2024 Quick Recommended Links Jobs by Location Job by industries WHAT WILL YOU DO Understand and execute complex client data operations and troubleshooting within a PHP...

  • Data Streaming Engineer

    Found in: Talent ZA C2 - 3 weeks ago

    Cape Town, South Africa PBT Group Full time

    PBT Group has an opportunity for a Data Streaming Engineer to build, enhance, and maintain real-time data pipeline. Work with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer on the Data Streaming Platform team, you will be responsible for developing and maintaining data ingestion pipelines vital to the...

  • Data & QA Engineer

    Found in: beBee jobs ZA - 2 weeks ago

    Cape Town, Western Cape, South Africa Crypto Banter Full time

    Crypto Banter's job vacancy, Career and RecruitmentJob title : Data & QA Engineer jobs in Western CapeJob Location : Western Cape, Cape TownDeadline : May 01, 2024Quick Recommended LinksJobs by LocationJob by industries Role Overview:We're seeking a multifaceted specialist who blends the expertise of QA, Data Analysis, and Data Engineering. This role is...

  • Product Data Engineer II

    Found in: beBee S ZA - 4 weeks ago

    Western Cape, Stellenbosch, South Africa Capitec Bank Full time

    Capitec Bank’s job vacancy, Career and Recruitment Job title : Product Data Engineer II jobs in Western Cape Job Location : Western Cape, Stellenbosch Deadline : May 05, 2024 Quick Recommended Links Jobs by Location Job by industries Purpose Statement To contribute to the design and development of new applications / systems to meet the business...

  • Data Flow Analytics

    Found in: beBee S ZA - 3 weeks ago

    Western Cape, Cape Town, South Africa Amazon Full time

    Amazon’s job vacancy, Career and Recruitment Job title : Data Flow Analytics – Cloud Support Engineer, Support Engineering jobs in Western Cape Job Location : Western Cape, Cape Town Deadline : April 08, 2024 Quick Recommended Links Jobs by Location Job by industries WHAT CAN YOU EXPECT FROM A LIFE AT AWS? Every day will bring new and exciting...

  • Platform Data Engineer III

    Found in: beBee S ZA - 2 weeks ago

    Western Cape, Stellenbosch, South Africa Capitec Bank Full time

    Capitec Bank’s job vacancy, Career and Recruitment Job title : Platform Data Engineer III jobs in Western Cape Job Location : Western Cape, Stellenbosch Deadline : May 22, 2024 Quick Recommended Links Jobs by Location Job by industries Purpose Statement To contribute to the design and development of new applications / systems to meet the business...