Specialist: Data Management

**Role purpose**:
Responsible for implementing “Platform as a Service” roadmaps, defining and prioritizing functionalities in order to maximize the delivered value at any point in time. Your role is to provide Technical leadership and also plan, analyze, design, develop, test, support and maintain the ASOC Platform Technologies to ensure quality data in support of the business requirements and the realization of these into final solution implementation within the ASOC Business Intelligence domain for the management of OSS services. To ensure that information is treated as a strategic asset whereby the integration of data can deliver value and help align business priorities and technology. Responsible for expanding and optimizing the ASOC Technologies through implementing robust Platform architecture, as well as optimizing data flow and collection of key metrics for cross-functional teams.

**Your responsibilities will include**:
Engineer OSS solutions for optimal development and support from a wide variety of data sources using SQL and Platform (PaaS) technologies.
Provide input to building analytics that utilizes the data pipeline to provide actionable insights into customer operations, operational efficiency, and other key business performance metrics.
Estimate user and technical stories to help inform and prioritize the backlog.
To ensure that solutions are delivered through the agile delivery processes, partaking in all the key agile ceremonies within the team to contribute to the successful delivery of Solutions.
Explore, understand, and implement most recent Machine Learning algorithms and approaches for supervised and unsupervised machine learning and deep learning.
Handle and process multi-terabyte data sets in scale-up and scale-out environments.
Engage in full stack development from REST service to persistence adopting latest state-of-the-art technologies.
Experience in Data warehousing, Data Modelling, Data Integration, Data Migration and ETL process.
Develop all data warehouse models and prepare reports for all meta data integration into systems and draft all ETL scripts and prepare required reports for all end users.
Develop data abstracts from various data sources including spreadsheets, structured and unstructured data, flat files, xml files etc.
Provide support to all ETL schedule and maintain compliance to same and develop and maintain various standards to perform ETL codes and maintain an effective project life cycle on all ETL processes.
Collaborate with all developers and business users to gather required data and execute all ETL programs and scripts on systems and implement all data warehouse activities.
Collaborate and perform tests and provide update to all ETL activities within schedule and provide support to all large data volumes and assist in data processing.
Documents all technical and system specifications documents for all ETL processes and perform unit tests on all processes and prepare required programs and scripts.
Analyze and interpret all complex data on all target systems.
Analyze and provide resolutions to all data issues and coordinate with data analyst to validate all requirements.
Perform tests and validate all data flows and prepare all ETL processes according to business requirements and incorporate all business requirements into all design specifications.
Document all test procedures for systems and processes and coordinate with business analysts and users to resolve all requirement issues and maintain quality for same.
Monitor all business requirements and validate all designs and schedule all ETL processes and prepare documents for all data flow diagrams.
Analyze user requirements and translate into database requirements and implement in database code.

**The ETL Developer shall also be responsible for**:
Maintaining and enhancing the performance of existing data pipelines.
Monitoring data pipelines and related systems to ensure optimized performance.
Automate data pipelines to increase efficiency.
Performing debugging procedures on database scripts and programs, as well as resolving conflicts.
Developing quality assurance tests to ensure pipelines and scripts are accurate.
Collaborating with researchers to understand data requirements and review results of data pipelines.
Adhering to best practices in securely storing, backing up, and archiving data.
Documenting processes related to data pipeline design, configuration, and performance.
Keeping abreast of developments and best practices in database engineering.
Reviewing database and user reports, as well as system information.

Education: Bachelor’s degree in information systems, information technology, computer science, or similar.
2-5 years of DB development experience in ETL Development, Data transformations using Pentaho - must be an excellent Pentaho and/or Informatica developer
Must have experience across Oracle, PL/SQL and MySQL Server space
Develop complex SQL queries and Stored Procedures
Experien