Our Data Engineer is responsible for designing and building data pipelines and infrastructure to support data processing and analysis. They work with a range of technologies and programming languages to ensure data is collected, stored, and processed efficiently, securely, and accurately.
QUALIFICATIONS
- 5+ years SQL experience
- Working knowledge of Python
- Excellent problem-solving skills, with a solution mindset
- A great communicator, including excellent verbal and written communication skills
- Mathematics and statistics background
- Exposure to Data Factory and/or Databricks
- Exposure to visualisation platforms, such as Power BI or Tableau advantageous
- Keen aptitude to learn industry best practices and adopt current trends
- Ability to work autonomously and as part of a team
DUTIES AND RESPONSIBILITIES
- Develop and resolve complex MS SQL queries, and calculations
- Create and maintain ETL pipelines using Data Factory and Databricks
- Optimise SQL code to ensure accuracy and performance
- Prepare data for BI models
- Combine raw information from different sources
- Explore ways to enhance data quality and reliability
- Play an active role in an agile development team
- Commitment to finding solutions and best practice
