Spark Administrator

7 days ago

Soweto, Gauteng, South Africa Paracon Full time R1 200 000 - R2 400 000 per year

Seeking an experienced Spark Administrator with strong Linux and Starburst/Trino skills to support large-scale data platforms in a regulated banking environment. Requires 5+ years of hands-on experience in big data infrastructure and system operations.

Key Responsibilities

Install, configure, and maintain Apache Spark clusters.

Monitor cluster performance and troubleshoot Spark jobs.

Administer Linux servers and automate tasks using scripts (Bash/Python).

Manage and optimize Starburst/Trino clusters and connectors.

Ensure platform security, access control, and compliance with banking standards.

Support data engineering and analytics teams with performance tuning.

Maintain high availability for critical banking data pipelines.

Required Skills

5+ years in Spark administration and big data platforms.

Strong Linux system administration (RHEL preferred).

Hands-on Starburst/Trino experience.

Knowledge of Hadoop ecosystem (HDFS, Hive, Ranger).

Scripting abilities (Bash, Python).

Understanding of authentication, networking, and security.

Preferred

Cloud experience (AWS/Azure/GCP).

Familiarity with banking data workflows and governance

Applications can be send to

  • Big Data Platform Engineer

    6 days ago

    Soweto, Gauteng, South Africa Paracon Full time R1 200 000 - R2 500 000 per year

    Seeking an experienced Big Data Platform Engineer with strong Linux and Starburst/Trino skills to support large-scale data platforms in a regulated banking environment. Requires 5+ years of hands-on experience in big data infrastructure and system operations.Key ResponsibilitiesInstall, configure, and maintain Apache Spark clusters.Monitor cluster...