Senior Data Engineer
Analyst
Johannesburg – Gauteng – South Africa
Join a team in Johannesburg as a Senior Data Engineer and play a pivotal role in delivering high-quality data to business and end users. If you’re passionate about data engineering, possess strong skills in data ingestion, transformation, and warehousing, and have experience with SQL Server and Azure, then we want to hear from you. This is an exciting opportunity to work on cutting-edge technology, collaborate within a dynamic team, and make a lasting impact on clients as we modernize the technology stack on Azure. If you thrive in a fast-paced, innovative environment and are driven by problem-solving, apply now and be part of our exciting journey!
Type: Permanent
Salary: Up to R1.2m pa CTC
Area: Onsite in Johannesburg
Responsibilities:
- Data Engineering Process: The candidate will be responsible for delivering all stages of the data engineering process, including data ingestion, transformation, data modeling, and data warehousing, and building self-service data products.
- On-Prem and Cloud Environments: The role spans both SQL Server and Azure environments. The candidate’s skills will determine their initial focus, with the ultimate goal of migrating all on-prem systems to the cloud.
- Collaboration and Support: The successful candidate will work closely with Architecture, DevOps, Database Administrators, and upstream Application teams.
Required Experience and Skills
You should have experience and skills in the following areas:
- Data Analysis and Exploration: Working closely with end-users to understand their business and data requirements, ad hoc data analysis, and ‘data wrangling’ using Synapse Analytics and Databricks.
- Data Ingestion and Warehousing: Building dynamic meta-data driven data ingestion patterns using Azure Data Factory and Databricks, as well as building and maintaining the Enterprise Data Warehouse using Data Vault 2.0 methodology.
- Data Products and Analysis Services: Building and maintaining business-focused data products and data marts, as well as building and maintaining Azure Analysis Services databases and cubes.
- Infrastructure and Deployment: Building ‘infrastructure-as-code’ deployment pipelines and sharing support and operational duties within the engineering team.
- Technical Skills: Strong T-SQL and SQL programming, extensive experience with SQL Server and SSIS, knowledge and experience of data warehouse modeling methodologies, experience in Azure (Data Factory, Databricks, Synapse Analytics, ADLS Gen2), and using source control, preferably GIT.
Additional Skills and Qualifications
- Advantageous Technical Skills: Knowledge of financial markets and some programming ability (C#, .Net Core).
- Non-Technical Attributes: The ability to communicate clearly and effectively in English is critically important to the role. Collaboration and knowledge sharing within the ten-person data engineering team are encouraged and expected, while self-reliance is also essential due to the small size of the team.
- Preferred Qualifications: BCom Information Systems, BSc in Computer Science, or other relevant qualification.
Opportunity for Innovation and Impact
In addition to the primary responsibilities, the role offers the opportunity to support transformation projects, enhance existing features, and develop new applications that push the boundaries of what’s possible. The successful candidate will have the freedom to explore creativity, showcase technical expertise, and make a lasting impact on valued clients as part of the modernization of its technology stack on Azure.
This role presents an exciting opportunity for passionate problem solvers who are driven by innovation and thrive in a fast-paced, dynamic setting.