Senior Big Data Engineer III

Found in: Talent ZA C2 - 1 week ago

Cape Town, South Africa Impact tech Inc Full time

The Company : 

At impact.com we are passionate about our people, our technology, and are obsessed with customer success. Working together enables us to grow rapidly, win, and serve the largest brands in the world. We use cutting edge technology to solve real-world problems for our clients and continue to pull ahead of the pack as the leading SaaS platform for businesses to automate their partnerships and grow their revenue like never before. We have an entrepreneurial spirit and a culture where ambition and curiosity is rewarded. If you are looking to join a team where your opinion is valued, your contributions are noticed, and enjoy working with fun and talented people from all over the world, then this is the place for you

impact.com, the world’s leading partnership management platform, is transforming the way businesses manage and optimize all types of partnerships—including traditional rewards affiliates, influencers, commerce content publishers, B2B, and more. The company’s powerful, purpose-built platform makes it easy for businesses to create, manage, and scale an ecosystem of partnerships with the brands and communities that customers trust to make purchases, get information, and entertain themselves at home, at work, or on the go. To learn more about how impact.com’s technology platform and partnerships marketplace is driving revenue growth for global enterprise brands such as Walmart, Uber, Shopify, Lenovo, L’Oreal, Fanatics and Levi’s, visit www.impact.com.

Why this role is exciting 

As a Senior Big Data Engineer III, your focus will be on delivering epics for the squad through planning, designing, implementing, testing and deploying. You will be self-sufficient with an understanding of ancillary services and infrastructure. This role assumes that you are able to define the correct cloud services to use, implement new libraries and identify and solve problems independently. You will have experience across multiple languages with practical experience in common architectural patterns, implementing blackbox and whitebox testing and complex integration testing frameworks. At this level, you are expected to deliver independently as well as unblock and assist team members with delivery. You should feel comfortable escalating and communicating effectively.

You will also be working closely with the SSO to prioritise, and understand the strategic direction of the product and help team members with planning, design and implementation.

What you will be doing: 

Collaborate with the team to fulfill the department's quarterly objectives Design, implement features, and write tests on the Impact Data Platform leveraging most Big Data Tech Stack Perform Releases, maintain continuous integration pipeline, code merging Advanced knowledge in numerous: Hadoop, Spark, SQL, NoSQL, Streaming On-Call for Monitoring and Alerting and communicate to team / Company as needed Analyze any job failure, log tickets in JIRA, deliver analysis, code fix, perform data fix Consulting, leaning into other squads (roadmap, tech), and communicating cross squad via slack, email, JIRA, Zoom. Create, Maintain & Communicate proper documentation Advanced knowledge of various Cloud solutions and Managed Services Able to tune the performance of Systems, Pipeline flows, Applications, Datastores Assist systems group with database and other infrastructure upgrades (sometimes off- hours/weekends) Gain and maintain enough understanding of The Business to deliver effective solutions Perform data quality analysis and introduce monitors with proper alerting for the team Take the lead role when interviewing new candidates Initiate and lead technical approaches and process improvements with team Mentor Associate Engineers as well knowledge share within the Team and Engineering Department Introduce & lay the foundation for new technologies in our stack Ability to perform root-cause analysis on numerous Provide insights and recommendations Contract negotiation with 3rd All necessary duties as required Take a leadership role on Projects; become the responsible point person for some Company Goals Develop Epics, Tasks, Sub-tasks; working with Product Manager as well as cross squad planning Provide projections for Growth and Stability Decide on new technologies within Impact Tech 3rd Party Pricing / Cloud usage and budget management Expand Technology learning within Impact by promoting outside the squad (need better wording) Thinking outside your own squad - how to improve other teams Proven track record writing scalable, reliable, resilient pipelines

Does this sound like you?

Completed BSc. In Computer Science or related field or equivalent professional experience. Any opensource contributions are strongly Desire to work with Big Data and surrounding Technologies 5+ years experience with numerous ETL / Streaming Pipeline Technologies 8+ years Software Development Agile / Iterative Kanban / Scrum Experience working in a Start-up or Internet business is valuable Customer Focus Service-Oriented Experience working with Large Data Volumes - Terabytes to Petabytes(preferred) Experience working with Big Data Tech - Spark, Kafka, Google Pub/Sub, HBase Ability to tune numerous types of system and applications in a Data Pipeline Exposure and experience in any Google Cloud technology highly desired Knowledge of Digital Marketing or Web Analytics is a big plus Continuous Integration / Delivery methods, tooling, integrations Ability to Implement core principles of Ralph Kimball - Star Schemas / Facts / Dimensions Advanced Experience with Relational Databases, Table design, SQL Deep knowledge of multiple Big Data Technologies Experience Mentoring / Training teams Masters degree or advanced learning in a related field preferred

Nice to have:

 Affiliate & Partnerships Industry Fundamentals Certification by PXA

Benefits/Perks:

Unlimited PTO policy Take the time off that you need. We are truly committed to a positive work-life balance, recognising that it is important to be happy and fulfilled in both Training & Development Learning the advanced partnership automation products Medical Aid and Provident Fund Group schemes with Discovery & Bonitas for medical aid Group scheme with Momentum for provident fund Stock Options 3-year vesting schedule pending Board approval Internet Allowance Flexible work hours Casual work environment Technology stipend.

  • Platform Data Engineer III

    Found in: beBee S ZA - 2 weeks ago

    Western Cape, Stellenbosch, South Africa Capitec Bank Full time

    Capitec Bank’s job vacancy, Career and Recruitment Job title : Platform Data Engineer III jobs in Western Cape Job Location : Western Cape, Stellenbosch Deadline : May 22, 2024 Quick Recommended Links Jobs by Location Job by industries Purpose Statement To contribute to the design and development of new applications / systems to meet the business...

  • Kafka Big Data Engineer

    Found in: Talent ZA C2 - 3 weeks ago

    Cape Town, South Africa PBT Group Full time

    PBT Group has an opportunity for a Kafka Big Data Engineer. As a Kafka Engineer, you will be responsible for the building, improvement and scaling of our streaming data platform. This role requires a combination of strong technical skills, deep understanding of distributed systems as well as excellent communication abilities. Kafka engineer is a big data...

  • Big Data Administrator

    2 days ago

    Cape Town, South Africa PBT Group Full time

    PBT Group has an opportunity for an experienced Big Data Administrator. Big Data team is responsible for the operational and technical support of the Big Data platform. The platform includes Hadoop (Cloudera), ingestion and streaming (Nifi and Kafka) and is deployed both on premise (currently) and as hybrid cloud platform (planned). Project Deliverables,...

  • Software Engineer III

    Found in: beBee jobs ZA - 2 weeks ago

    Gauteng, Cape Town, South Africa LexisNexis Full time

    LexisNexis's job vacancy, Career and RecruitmentJob title : Software Engineer III (Johannesburg, Durban, Cape Town) jobs in GautengJob Location : Gauteng, Cape TownDeadline : May 03, 2024Quick Recommended LinksJobs by LocationJob by industries About the RoleAs a Software Engineer, you'll perform research, design, and software development assignments within a...

  • Software Engineer III

    Found in: Talent ZA C2 - 2 days ago

    Cape Town, South Africa LexisNexis Full time

    Software Engineer Do you enjoy working with innovative research technology? Would you like to be part of a team creates solutions for our customers? About our Team About the Role As a Senior Software Engineer, you’ll be a key part of our Agile development squad. You will develop exciting, new data-driven solutions that will shape the future of our...

  • Senior Data Engineer

    Found in: Talent ZA C2 - 3 weeks ago

    Cape Town, South Africa IO Global Full time

    SummaryIO Global (IOG), the creator of the Cardano blockchain platform, is searching for a Senior Data Engineer, preferably with a DeFi background. IOG is creating a spinout venture that combines crypto/Web3/DeFi innovations with traditional finance (TradFi) to make borrowing and lending services more transparent, efficient, and available to a broader...

  • Data Engineer

    Found in: Talent ZA C2 - 3 weeks ago

    Cape Town, South Africa Dimension Data Full time

    As a Data Engineer, you'll design and build the data architecture of our products. You will use your technical knowledge to help us develop new products by taking an idea from concept to reality. You'll work on projects across multiple teams in order to achieve company goals and objectives. Your role will involve: - Analyzing business requirements; -...

  • Big Data Developer

    Found in: Talent ZA C2 - 3 weeks ago

    Cape Town, South Africa PRR Recruitment Services Full time

     Big Data Developer - Fully remote role. This international software company is looking for a Big Data Developer. The ideal candidate will have strong experience in Scala and Apache Spark will need to write testable functional Scala in Production grade systemsstrong Cloud platform to architect and build data pipelines.  Will need strong data...

  • Data Engineering Lead

    7 days ago

    Cape Town, South Africa Progressive Edge Full time

    **Data Engineering Lead** **Permanent** **Cape Town** A large established enterprise is looking to employ a Technical Lead : Data Engineering with deep technical knowledge the ability to lead and mentor a team of Data engineers. You will require substantial expertise in a broad range of software development & programming fields. Your knowledge of data...

  • DevOps Data Engineer

    Found in: Talent ZA C2 - 3 weeks ago

    Cape Town, South Africa PBT Group Full time

    PBT Group has a requirement for an intermediate DevOps Data Engineer. Duties:Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties – Glue, Step-functions, Kafka CC, PySpark, DynamoDB, Delta.io, RedShift, Lambda, DeltaLake,...

  • DevOps Data Engineer

    Found in: Whatjobs ZA C2 - 6 days ago

    Cape Town, South Africa PBT Group Full time

    PBT Group has a requirement for an intermediate DevOps Data Engineer.   Duties: Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties – Glue, Step-functions, Kafka CC, PySpark, DynamoDB, Delta.io, RedShift, Lambda, DeltaLake, Python,....

  • AWS Data Engineer

    Found in: Talent ZA C2 - 3 weeks ago

    Cape Town, South Africa PBT Group Full time

    PBT Group is currently offering an opportunity for an AWS Data Engineer with 2 to 5 years of relevant experience.The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security. Data Engineers play a pivotal role in facilitating the acquisition of data from diverse sources,...

  • DevOps Data Engineer

    Found in: Talent ZA C2 - 3 weeks ago

    Cape Town, South Africa PBT Group Full time

    PBT Group has a requirement for an intermediate DevOps Data Engineer. Duties:Strong experience with AWS, Terraform, CI/CD, GitDesign, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties – Glue, Step-functions, Kafka CC, PySpark, DynamoDB,...

  • DevOps Data Engineer

    Found in: Whatjobs ZA C2 - 6 days ago

    Cape Town, South Africa PBT Group Full time

    PBT Group has a requirement for an intermediate DevOps Data Engineer.   Duties: Strong experience with AWS, Terraform, CI/CD, Git Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties – Glue, Step-functions, Kafka CC, PySpark, DynamoDB,...

  • DevOps Data Engineer

    Found in: Talent ZA 2A C2 - 3 weeks ago

    Cape Town, South Africa PBT Group Full time

    PBT Group has a requirement for an intermediate DevOps Data Engineer. Duties:Strong experience with AWS, Terraform, CI/CD, GitDesign, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties – Glue, Step-functions, Kafka CC, PySpark, DynamoDB,...

  • Engineering Officer

    7 days ago

    Cape Town, South Africa Protea Maritime Connection Full time

    **Key Responsibilities**: - Oversee the safe operation of all engineering systems within the engine room. - Perform routine checks and maintenance of propulsion systems, auxiliary equipment, and engineering controls. - Ensure compliance with the (STCW) Code III/1. - Monitor fuel transfers and maintain accurate records of all engineering operations. -...

  • AWS Data Engineer

    Found in: Adzuna ZA B C2 - 1 week ago

    Cape Town, South Africa Adzuna ZA B C2 Full time

    PBT Group has an opportunity for an AWS Data Engineer, preferably with Hadoop experience. Duties:Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties - Spark, EMR, DynamoDB, RedShift, Kinesis, Lambda, Glue, Snowflake.Analyze, re-architect...

  • AWS Data Engineer

    Found in: Whatjobs ZA C2 - 6 days ago

    Cape Town, South Africa PBT Group Full time

    PBT Group has an opportunity for an AWS Data Engineer, preferably with Hadoop experience.   Duties: Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties - Spark, EMR, DynamoDB, RedShift, Kinesis, Lambda, Glue, Snowflake. Analyze,...

  • AWS Data Engineer

    Found in: Talent ZA C2 - 3 weeks ago

    Cape Town, South Africa PBT Group Full time

    PBT Group has an opportunity for an AWS Data Engineer, preferably with Hadoop experience. Duties:Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties - Spark, EMR, DynamoDB, RedShift, Kinesis, Lambda, Glue, Snowflake.Analyze, re-architect...

  • AWS Data Engineer

    Found in: Talent ZA 2A C2 - 3 weeks ago

    Cape Town, South Africa PBT Group Full time

    PBT Group has an opportunity for an AWS Data Engineer, preferably with Hadoop experience. Duties:Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties - Spark, EMR, DynamoDB, RedShift, Kinesis, Lambda, Glue, Snowflake.Analyze, re-architect...