Azure Databricks DevOps Engineer

4 days ago

Centurion, Gauteng, South Africa Boardroom Appointments Full time


Azure Databricks DevOps Engineer

Key Responsibilities:

  • Databricks Management: Deploy, configure, and maintain Azure Databricks environments, ensuring scalability, security, and efficiency.

  • Infrastructure Automation: Implement and manage IaC using Terraform, ARM templates, or Bicep to automate cloud resource provisioning.

  • CI/CD Pipelines: Develop and manage CI/CD pipelines using tools like Azure DevOps, GitHub Actions, Jenkins to automate data pipeline deployments.

  • Monitoring & Logging: Set up and maintain monitoring solutions using Azure Monitor, Log Analytics, and Application Insights for proactive issue resolution.

  • Security & Compliance: Implement best practices for security, governance, and compliance, including RBAC, encryption, and network security policies.

  • Data Integration & Optimization: Work with Data Engineers to optimize ETL pipelines, ensuring high performance and cost efficiency.

  • Collaboration: Work closely with Data Scientists, Engineers, and Business Analysts to enable efficient data workflows.

  • Incident Management: Troubleshoot and resolve Databricks, Azure Kubernetes Services (AKS), and networking issues efficiently.

  • Documentation & Best Practices: Maintain technical documentation and establish best practices for Azure Databricks and DevOps processes.

Required Skills & Qualifications:

  • Bachelors or Masters degree in Computer Science, IT, or a related field.

  • 5+ years of experience in DevOps, Cloud Engineering, or Data Engineering roles.

  • Strong hands-on experience with Azure Databricks, Azure Data Factory, and Azure Synapse Analytics.

  • Proficiency in Terraform, ARM Templates, or Bicep for infrastructure automation.

  • Experience with CI/CD tools such as Azure DevOps, GitHub Actions, or Jenkins.

  • Knowledge of Python, Scala, or PowerShell for automation and scripting.

  • Familiarity with containerization (Docker, Kubernetes, AKS).

  • Solid understanding of Azure networking, security, and identity management (IAM, RBAC, AAD).

  • Experience with monitoring and logging tools (Azure Monitor, Log Analytics, Prometheus, Grafana).

  • Strong problem-solving skills and ability to work in an Agile/Scrum environment.

Preferred Qualifications:

  • Azure Certifications (e.g., AZ-400, AZ-104, DP-203, DP-900).

  • Experience with Big Data processing frameworks (Apache Spark, Delta Lake).

  • Understanding of ML Ops and working with machine learning models in Databricks.

  • Knowledge of Event-driven architectures (Azure Event Hubs, Kafka, Service Bus).


  • Automation Engineer

    1 week ago

    Centurion, Gauteng, South Africa Network Contracting Full time R250 000 - R500 000 per year

    Brief Description:Are you an experienced Automation Engineer with a strong background in test automation frameworks and scripting?We are actively building our pipeline of skilled Automation Engineers for long-term assignments and contract opportunities with clients across multiple industries in South Africa. Job & Company Description:I am currently seeking...

  • Machine Learning Engineer

    1 week ago

    Centurion, Gauteng, South Africa AO Connect Solutions Full time R500 000 - R1 200 000 per year

    Purpose of the RoleThe Machine Learning Engineer is responsible fordeploying, monitoring, and maintaining ML models in production. They turn prototype models into scalable, production-grade systems by building automated pipelines, integrating with infrastructure, and ensuring data and model quality. They work closely with Data Scientists, Data Engineers, and...

  • AI Engineer

    1 week ago

    Centurion, Gauteng, South Africa Network1 Full time R80 000 - R120 000 per year

    Our client, a leading technology-driven network and digital solutions provider, is embarking on a major AI transformation initiative and is seeking 5 early-career AI Engineers to join their foundational team. This is your chance to contribute to an end-to-end AI ecosystem; designing, deploying, and scaling intelligent systems that drive real business impact....

  • Junior Software Engineer

    4 days ago

    Centurion, Gauteng, South Africa Hire Resolve Full time R330 000 - R360 000 per year

    Hire Resolve's client in the Information Technology industry is urgently seeking the expertise of a Junior Software Engineer in Centurion, Gauteng.ResponsibilitiesExecute full software development life cycle (SDLC)Design, develop, modify, implement, and support software components anywhere in the software stackDevelop flowcharts, layouts, and documentation...

  • Junior Software Engineer

    4 days ago

    Centurion, Gauteng, South Africa Hire Resolve Full time R250 000 - R500 000 per year

    Hire Resolve is looking for a Junior Software Engineer to join their team in Centurion, GP. A leading-edge South African based Technology and Software company that develops bespoke software solutions. Namocorp was founded with a clear sense of Why – that purpose, cause or belief that goes beyond the software we develop or the services we...

  • Senior Software Engineer

    4 days ago

    Centurion, Gauteng, South Africa Hire Resolve Full time R1 200 000 - R2 400 000 per year

    Hire Resolve's client, a leading-edge South African based Technology and Software company that developsbespoke software solutions, is currently seeking a highly skilled Senior Software Engineer to join their team in Centurion, Gauteng. In this role, you'll design and implement new systems, maintain existing ones, and oversee the entire software development...

  • Senior Frontend Engineer

    4 days ago

    Centurion, Gauteng, South Africa Reisiger Engineering Full time R90 000 - R120 000 per year

    We are seeking a world-class Senior Frontend Engineer—someone passionate about shaping next-generation web and mobile experiences. Our current projects are at the forefront of agriculture map visualizations, bio-tech, med-tech, and digital transformations. You will play a pivotal technical leadership role, mentoring peers, driving architectural...

  • Intermediate Software Engineer

    4 days ago

    Centurion, Gauteng, South Africa Hire Resolve Full time R500 000 - R1 200 000 per year

    Hire Resolve's client is seekoing a passionate Software Engineer to design, develop, implement, and maintain software solutions. Software Engineer responsibilities include gathering user requirements, defining system functionality, and writing code in various languages, like C#, and JavaScript amongst others. Our ideal candidates are familiar with the...

  • Senior Server Engineer

    1 week ago

    Centurion, Gauteng, South Africa Disruptive IT (PTY) LTD Full time R600 000 - R1 200 000 per year

    Company DescriptionDisruptive IT (PTY) LTD is a 100% black female-owned and managed company that redefines traditional approaches to IT through innovation and disruption. With over 15 years of experience in IT and Finance, the company is dedicated to providing cost-effective solutions that enable businesses to thrive in the digital age. Disruptive IT focuses...

  • Java Software Development Manager

    4 days ago

    Centurion, Gauteng, South Africa Hire Resolve Full time R120 000 - R180 000 per year

    Hire Resolve's client is looking for a Java Software Development Manager to join their team in Centurion, Gauteng. The Software Development department drives technological innovation and maintains the company's competitive edge. It focuses on developing high-quality software solutions aligned with strategic business goals, enhancing customer experience,...