Software Developer/Data Engineer

At
Altron Digital Business
, we provide the enterprise-grade solutions that organisations need to operate, optimise, and transform into a resilient digital business.

Our purpose is to use technology to transform today into a simpler, safer and smarter tomorrow.

We're committed to providing the best solutions to save money and help our clients' business grow with a robust IT ecosystem that supports digital transformation.

We are looking for strong Data Engineer to join our MAC (Margin Assurance Cloud) project. MAC is a bespoke in-house developed AWS Serverless Cloud Native application.

The core functions are:

Data:

• Extract, load and transform data using familiar scripting language like SQL & Python for the purpose to produce automated, near real time Assurance Controls to the MA Team

Self-Service:

• Access to Athena using workgroups & federated roles for end users (MA Team) to run their own queries for the purpose of investigations

Reporting & Alerting:

• Capability to create reports from Athena views and send via email to the business customer;
• Alerting capabilities & Monitoring on File Ingestion

Main Components (AWS Services used):
S3, Athena, Lambda Functions, GLUE, EC2

Main Coding Language:
Python, PySpark and SQL

In support to our clients IT strategy we are in progress with a major migration project of the current on-prem Assurance system utilized by business Margin Assurance residing in FINOPS to the MAC Cloud environment.

We are in need of passionate and skilled Data Engineer that can help the team drive the project to fruition.

The scope of the project build includes:

1. Data Ingestion and Transformation;
2. S3 Loader Output Build;
3. Athena SOX Validation Reports Build;
4. Athena SOX Aggregation Reports Build;

Delivery will be an agile project which will be managed in monthly sprints. Altron will deliver the requirements as listed and prioritized in the backlog by the Vodacom Technical Delivery Lead and agreed to in each Sprint Planning Ceremony.

Key Responsibilities:

• Implement scalable data pipelines and architectures using technologies like PySpark/Python/SQL
• Build out distributed data pipelines and compute tier that operates on AWS Lambda and Glue
• Serve as a technical resource for team members and mentor junior engineers
• Collaborate with team to deliver high-quality solutions that meet business requirements
• Ensure that code is well-designed, maintainable, and adheres to best practices and standards
• Play a key role in shaping the direction of engineering practices through working on a scrum-size team empowered to organize and ensure sprint deliverables are met as committed during sprint planning ceremonies
• Following the project development tools like JIRA, Confluence and GIT
• Assist DEVOPS Engineer in automation CICD practices.
• Evaluate and recommend new technologies and approaches to improve the performance, scalability, and reliability of our software systems.

Experience / Skills / Requirements:

• 4 to 8 Years of Data Engineering or Software Development experience working on Data Driven eco systems
• Required to code complex transformations using loader specifications provided by the BA
• Be able to work with Big Data sets, very knowledgeable in understanding and solving data problems
• Be able to automate ingestion through building ingestion pipelines using Lambda or Glue
• Very skilled in coding languages PySpark/Python/SQL
• Must have worked on AWS, with the focus on the following services: S3, Athena, Lambda Functions, GLUE, EC2
• Experience in AWS and Certificate in AWS certification required
• Experience with data modelling and data architecture design required

Educational Qualifications:

• BSc Comp Sci/BEng

Professional Qualifications

• AWS Professional Certification

Disclaimer:

Dear Applicant, we appreciate your interest in joining our organization. It is imperative for us that you understand how we handle your information. We are committed to ensuring the security and confidentiality of the information you provide. Your personal details will be collected for the sole purpose of the application process and will be used strictly for that purpose. By applying, you acknowledge and consent to the collection, use, and protection of your personal information in accordance with our privacy policy. If you have any inquiries or concerns, our Human Resource department is available to provide clarification. We look forward to reviewing your application.

Altron is committed to diversity and Employment Equity within the workplace. In this regard, the relevant laws and principles associated with Employment Equity will be considered when appointing potential candidates.

Should your experience and qualifications align with the requirements, we will be in contact to discuss the next steps. Should you not receive feedback within 2 weeks, please consider your application as not successful.

In the meantime, we encourage you to explore our company's website.