Senior Data Engineer

The Senior Data Engineer / Data Analyst is responsible for designing, implementing, and managing data migration initiatives while ensuring data integrity, traceability, governance, and compliance through robust audit trail mechanisms.

The role acts as a bridge between business stakeholders and technical teams, translating business requirements into scalable data solutions and ensuring successful delivery of data transformation and migration projects.

This role is suitable for a Senior Data Engineer / Data Analyst that combines data migration expertise, audit trail governance, and strong stakeholder engagement capabilities across both business and technical audiences.

Key Responsibilities

Data Migration

Planning and Analysis

• Assess source and target systems to determine migration scope, complexity, and dependencies.
• Conduct data profiling, reconciliation, and quality assessments.
• Define migration strategies, mappings, transformation rules, and validation criteria.
• Prepare migration runbooks and rollback plans.

Migration Delivery

• Design, develop, and execute ETL/ELT processes.
• Perform full, incremental, and delta data migrations.
• Manage cutover activities and post-migration support.
• Ensure data consistency between legacy and target platforms.

Data Validation and Reconciliation

• Validate record counts, balances, transactions, and business rules.
• Investigate and resolve migration discrepancies.

Audit Trails and Data Governance

Audit Framework Design

• Design and implement data lineage and audit tracking mechanisms.
• Ensure traceability from source systems through transformation layers to reporting outputs.
• Maintain detailed audit logs for data movement and changes.

Compliance and Governance

• Support regulatory and governance requirements.
• Implement controls for:
• Data access management
• Data privacy and security

Monitoring & Reporting

• Track migration status, exceptions, and remediation activities.
• Support internal and external audit processes.

Business and Stakeholder Engagement

Requirements Gathering

• Facilitate workshops with business and technical stakeholders.
• Elicit and document:
• Business requirements
• Functional requirements
• Non-functional requirements
• Data requirements
• Reporting requirements

Stakeholder Management

• Act as the primary liaison between business users, project teams, and technology teams.
• Present technical concepts in business-friendly language.
• Manage stakeholder expectations throughout project delivery.

Documentation

• Produce and maintain:
• Business Requirement Documents (BRDs)
• Functional Specifications
• Data Mapping Documents
• Technical Design Documents
• Migration Runbooks

Technical Responsibilities

Data Integration

• Design and implement ETL/ELT pipelines.
• Build scalable and reusable data integration solutions.
• Integrate data from cloud, on-premises, and third-party systems.
• Create conceptual, logical, and physical data models.
• Design data warehouses, data marts, and reporting structures.
• Implement dimensional and relational modelling techniques.

Database Development

• Develop and optimize SQL queries and stored procedures.
• Perform performance tuning and query optimization.
• Maintain database integrity and availability.

Required Technical Skills

Databases

• Microsoft SQL Server
• Oracle

Programming and Scripting

• SQL (Advanced)
• Python
• PowerShell
• Shell Scripting

ETL / Integration Tools

• SSIS
• Informatica
• Talend
• Databricks

Cloud Platforms (advantageous)

• AWS

Reporting and Analytics (advantageous)

• Tableau
• Excel Advanced Analytics

Data Governance

• Metadata Management
• Data Quality Frameworks
• Master Data Management (MDM)
• Audit Controls

Required Business Analysis Skills

• Requirements elicitation and analysis
• Process mapping
• Gap analysis
• Data mapping and transformation analysis
• User story development
• Workshop facilitation
• Business process improvement
• Stakeholder engagement