Lead: Data Engineering, Cape Town

Last update 2024-02-29
Expires 2024-03-29
ID #2003938916
Lead: Data Engineering, Cape Town
South Africa, Western Cape, Cape Town,
Modified January 23, 2024


Job Purpose:
In this vital role, you'll manage the development and maintenance of our advanced data infrastructure, crucial for maintaining rain's position as a leader in 5 G technology in South Africa. Your responsibilities include overseeing data pipelines, warehouses, and lakes, ensuring data quality and reliability. Collaborating with various teams like Network, Consumer, and Dev Ops, you'll be instrumental in driving data-driven strategies across the organization. If you're passionate about leading-edge data engineering and want to contribute significantly to our team, we encourage you to apply and join our journey in pioneering 5 G advancements.

Key Responsibilities:
1. Leadership and team management:
Lead and mentor a team of data engineers.
Engrain a culture of continuous process improvement.
Manage planning, execution, delivery, and maintenance of efforts.
2. Data strategy and architecture
Develop and implement and data strategies that align with business goals.
Co-design and maintain data architectures.
Oversee the integration of data management technologies on the cloud (AWS, Azure, GCP, HCS) and on-premises.
3. Data process and analytics
Ensure efficient data processing and pipeline development from various sources such as databases, Network Element (NE) events, log files, APIs, streaming sources, and external data-generated sources.
Implement systems for tracking data quality and consistency, complying to data protection and privacy regulation best practices.
Implement monitoring and performance optimization strategies for data infrastructure, considering budget and requirements.
Work closely with data scientists and analysts to support data modeling, analysis, and reporting.
Extensive (5+ years) experience in data engineering.
At least 3 years in a leadership role.
Proficiency in engineering tools and languages, Python and SQL are a must., and a strong understanding of big data technologies such as (1) Hadoop, Hive, Mongo DB, Postgres etc; (2) Presto, Elastic Search etc for data mining; (3) Kafka, Splunk, Apache Spark etc for big data analytics.
Preferred experience in containerisation and/or dockerisation of developed solutions.
Strong understanding of ETL processes, data warehousing principles.
Personal Attributes:
Excellent problem solving, analytical and management skills.
Strong leadership and team building abilities.
Excellent communication and interpersonal skills.
Ability to work in a fast-paced, dynamic environment.
Passionate about data-driven decision making.

Job details:

Job type: Full time
Contract type: Permanent
Salary type: Monthly
Occupation: Lead: data engineering

⇐ Previous job

Next job ⇒     


Contact employer

    Employer's info

    Quick search:


    Type city or region