Principal Data Engineer

7 days ago

Johannesburg, Gauteng, South Africa Promapp Full time
About Promapp

Promapp is a leading provider of business process management (BPM) solutions, empowering organizations to transform the way they work and drive business excellence.

As a global standard for process intelligence and automation, we're trusted by over 10,000 public and private sector organizations across 90 countries. Our customers, from industry giants like Amazon, Coca-Cola, and Microsoft, rely on the Promapp Platform to accelerate their digital transformation journeys by managing, automating, and optimizing business processes quickly and efficiently.

Our Culture

We are committed to fostering a workplace that supports amazing people in doing their very best work every day. Collaboration is constant, our workplace is fun, the environment is fast-paced, and we value our people's curiosity, ideas, and enthusiasm. Driven by passion and accountability, we take initiative, measure progress, and deliver results. Our culture fosters innovation and problem-solving, fueled by curiosity and a commitment to thinking big. Together, we move with agility, prioritize customer needs, and build unity through empathy, leaving a positive impact wherever we go.

Working in Engineering

Working at Promapp as an engineer means building more than just software; it's about making a tangible impact with every line of code. Our engineers are process experts, developing the industry's most complete process and automation platform to transform the way people work. If you're interested, curious and want to learn and do more, the sky is the limit here. We take a solutions-oriented and collaborative approach, constantly innovating our business and products.

About the Role

You are an expert in data acquisition and processing not only in your team's domain, but also across Promapp. Your technical leadership demonstrates a passion for quality data engineering and is demonstrated across multiple, complex projects and in assistance to other teams. You mentor other engineers and provide experienced advice in your specialties across other teams. You look for opportunities to mine data from development and operations that usefully informs development and product decisions. Your data engineering pipelines are designed with the possible downstream requirements of data analysts and scientists in mind.

As a Principal Data Engineer, you are focused on the work of your team and domain, but you also have a larger role across Promapp and in the outside data engineering community. You will participate in larger projects on occasion, but your focus is designing, developing, implementing and mentoring on your team's assigned deliverables.

Your Key Responsibilities
  • You ensure that data history is sufficient for data science modeling requirements.
  • You identify and forward Intellectual Property (IP) opportunities to the Promapp Patent process.
  • You coordinate the data inputs from multiple sources to fashion an end-to-end pipeline to create report artifacts that meet all reporting objectives of management stakeholders.
  • You create and maintain instrumentation that surfaces data ingestion systems' stability and availability metrics.
  • You use Azure event hubs and functions to implement required data operations while leveraging Azure product strengths and compensating for its limitations (scaling, error handling, etc.).
  • You apply different data pipeline architectures appropriately to meet product requirements (data warehouse, data lake, data lakehouse, etc.).
  • You identify and implement opportunities to optimize ETL processing to efficiently process large data sets.
  • You develop or adapt partitioning and data organization techniques for optimal querying of big data.
  • You implement data storage, access structures, and security protocols that meet Promapp's data sovereignty and Personally Identifying Information (PII) policies.
  • You are an active part of the incident management process, including on-call rotation and being a key resource in the escalation response.
  • You work with data providers to document the incoming data stream's domain boundaries, datatypes, and term definitions in sufficient detail to enable transformation of the data for end-user consumption.
What We're Looking For
  • You have 8+ years experience in data engineering.
  • Hands-on experience with PaaS.
  • Experience with DataBricks, Azure, Unit Catalog.
  • Experience with Hadoop/Spark, Kafka and Azure OpenAI.
  • Experience with Scala and Python is advantageous.
  • Experience with real-time data streaming and any distributed computing experience would be advantageous.
What's in it for You

Our people work in the way that best suits them and their teams - whether at home, in an office, or another place that sparks creativity, focus, and collaboration. Our work environment is such that our people can successfully deliver their work while adequately supporting their lifestyle and preferences.

While our offerings differ from country to country, we offer our entire global workforce an array of exciting perks and benefits, including:

  • Global Gratitude and Recharge Days.
  • Flexible, paid time off policy.
  • Employee wellness programs and counseling resources.
  • Meaningful peer recognition and awards.
  • Paid parental leave.
  • Invention/patenting assistance.
  • Community impact, paid volunteer time, and opportunities.
  • Intercultural learning and celebration.
  • Multiple tools through which to learn and grow, and an incredible global community.

  • Principal Data Engineer

    5 days ago

    Johannesburg, Gauteng, South Africa Nintex Full time

    About NintexNintex is a global leader in process intelligence and automation, trusted by over 10,000 organizations across 90 countries. Our customers, including industry giants like Amazon, Coca-Cola, and Microsoft, rely on our platform to accelerate their digital transformation journeys by managing, automating, and optimizing business processes quickly and...

  • Principal Data Engineer

    4 days ago

    Johannesburg, Gauteng, South Africa Nintex Full time

    About NintexNintex is a leading provider of process intelligence and automation solutions, trusted by over 10,000 organizations across 90 countries. Our customers, including industry giants like Amazon, Coca-Cola, and Microsoft, rely on our platform to accelerate their digital transformation journeys by managing, automating, and optimizing business processes...

  • Data Engineer

    7 days ago

    Johannesburg, Gauteng, South Africa E-Merge Full time

    Job SummaryE-Merge is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in helping us drive business value from our data. You will be responsible for building and maintaining our data pipelines, ensuring data quality, and developing data models to support business decision-making.Key...

  • Principal Tailings Engineer

    4 days ago

    Johannesburg, Gauteng, South Africa SLR Full time

    About SLRSLR is a global leader in environmental and advisory solutions, helping clients achieve their sustainability goals. With over 100 offices in 13 countries, we foster collaboration and learning between disciplines and services.Job PurposeOur Africa-based team requires a Principal Tailings Engineer to complement our Engineering and Mine Waste teams,...

  • Senior Security Platform Engineer

    5 days ago

    Johannesburg, Gauteng, South Africa NTT DATA Full time

    About the RoleThe Senior Security Platform Engineer is a highly skilled professional responsible for ensuring the security and integrity of NTT DATA's technology infrastructure. This role involves advanced security technologies, including Cisco ISE, and requires a strong understanding of security architecture, networking, and Linux concepts.Key...

  • Data Engineer

    5 days ago

    Johannesburg, Gauteng, South Africa IOCO Full time

    About IOCOIOCO is a dynamic and innovative company that is seeking a talented and motivated Data Engineer to join our team. As a Data Engineer, you will play a crucial role in supporting data-related initiatives and ensuring the efficient processing and analysis of data.Job Purpose:Design and Build Data SolutionsExtract, Transform, and Load (ETL) DataImprove...

  • Data Engineering Specialist

    5 days ago

    Johannesburg, Gauteng, South Africa PBT Group Full time

    PBT Group's Data Engineering OpportunityThe role of a Data Engineer at PBT Group necessitates proficiency in Data Engineering to orchestrate the data lifecycle within the Engineering Data Systems. This involves the crucial capacity to seamlessly integrate data from source systems, whether they are considered golden or trusted, to the designated target...

  • Senior Manager

    5 days ago

    Johannesburg, Gauteng, South Africa NTT DATA Full time

    About the RoleThe Senior Manager, Data Science is a senior people management role accountable for operationally managing other seasoned or senior Data Scientists / Data Analysts. In addition to managing a team, this role applies and inspires the adoption of data science and analytics within NTT DATA.Key ResponsibilitiesManage a team of Data Scientists / Data...

  • Network Services Engineer

    7 days ago

    Johannesburg, Gauteng, South Africa NTT DATA Full time

    Job OverviewMake a Difference with NTT DATANTT DATA is a leading provider of business and technology services, serving 75% of the Fortune Global 100. We are committed to helping clients innovate, optimize, and transform for long-term success.Your RoleThe Network Services Engineer (L1) is responsible for providing a managed service to clients to ensure that...

  • Data Engineer

    7 days ago

    Johannesburg, Gauteng, South Africa JCM Consultants Full time

    About JCM ConsultantsWe are a dynamic IT company seeking a talented Data Engineer to join our team. Our company culture is built on a foundation of hard work, teamwork, and a passion for innovation.The RoleYou will be responsible for developing and implementing data engineering solutions to drive business growth and improve data-driven decision making. Key...

  • Cybersecurity Engineer

    4 days ago

    Johannesburg, Gauteng, South Africa NTT DATA Full time

    About the RoleMake a Difference with NTT DATANTT DATA is a global leader in business and technology services, serving 75% of the Fortune Global 100. We're committed to helping clients innovate, optimize, and transform for long-term success. As a Cybersecurity Engineer, you'll play a critical role in ensuring the security and reliability of our network...

  • Data Engineer

    5 days ago

    Johannesburg, Gauteng, South Africa E-Merge Full time

    A technology and analytics driven consulting company empowering clients by solving real-world business challenges that deliver tangible value and count their core capabilities as spanning the disciplines of Data Science, Data Engineering and Software Engineering have an opening for an Azure Data Engineer to help develop best practices and drive improvements...

  • Azure Cloud Infrastructure Engineer

    5 days ago

    Johannesburg, Gauteng, South Africa NTT DATA Full time

    Job DescriptionAbout the RoleWe are seeking a highly skilled Cloud Infrastructure Engineer to join our team at NTT DATA. As a key member of our infrastructure team, you will be responsible for designing, implementing, and maintaining scalable and secure cloud infrastructure solutions.Key ResponsibilitiesDesign and implement cloud infrastructure solutions...

  • Principal AWS Solutions Architect

    2 months ago

    Johannesburg, Gauteng, South Africa NTT Full time

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAWe are looking...

  • Data Engineer

    5 days ago

    Johannesburg, Gauteng, South Africa Performability Recruitment Full time

    About the RoleThis is a hybrid role based in Johannesburg, South Africa, that requires a professional with a strong background in data engineering to join our team at Performability Recruitment.The ideal candidate will be part of a multi-disciplinary technology team, working closely with our customers, business partners, and software vendors to design,...

  • Data Engineer

    1 day ago

    Johannesburg, Gauteng, South Africa Planet10 Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Planet10, a leading company in the Financial and Banking sector. As a Data Engineer, you will play a critical role in advancing our technical thought leadership, delivering fit-for-purpose data products, and supporting data initiatives.Key ResponsibilitiesDesign, develop, and...

  • Senior Systems Engineer

    7 days ago

    Johannesburg, Gauteng, South Africa NTT DATA Full time

    Job OverviewNTT DATA is seeking a highly skilled Senior Systems Engineer to join our team. As a key member of our IT infrastructure team, you will be responsible for installing, testing, and maintaining hardware and software systems to ensure optimal performance and availability.Key ResponsibilitiesInstall, test, and maintain new hardware and software...

  • Senior Data Engineer

    5 days ago

    Johannesburg, Gauteng, South Africa Salt Employee Benefits Full time

    Salt Employee Benefits is seeking a highly skilled Data Engineer to join our IT team. This role requires the incumbent to have a deep understanding of data management and technical skills, including SQL database design and multiple programming languages. The successful incumbent will work closely with business leaders to determine what data insights are...

  • Data Engineer

    5 days ago

    Johannesburg, Gauteng, South Africa Salt Employee Benefits Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Salt Employee Benefits. As a Data Engineer, you will play a critical role in building and maintaining our data infrastructure, ensuring that our business leaders have access to accurate and timely data insights.Key ResponsibilitiesData EngineeringCollaborate with business...

  • AWS Cloud Data Engineer

    5 days ago

    Johannesburg, Gauteng, South Africa Planet10 Full time

    About the RoleWe are seeking a highly skilled AWS Cloud Data Engineer to join our team at Planet10. As a key member of our engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems on AWS.Key ResponsibilitiesLeadership and CollaborationLead cross-functional teams to develop and implement...