Our long term partner are looking for a data engineer to join their dynamic data team, responsible for crafting robust data infrastructure to seamlessly connect various IT systems, whether on-premise or in the cloud. Your work will empower different business functions, including data loss prevention, migration teams, and data analysts, enhancing their ability to deliver impactful insights to key stakeholders.
You'll report to the Data Architecture Lead. This role demands a technical expert in data pipeline design, engineering, maintenance, and warehouse development. Effective collaboration with cross-functional teams and clear communication skills are crucial.
As a Data Engineering Specialist, your role will encompass:
- Designing, developing, and maintaining efficient data pipelines using Azure Data Factory, Azure Databricks, and SQL SMS.
- Collaborating within the data team to align models with business requirements.
- Assisting in data extraction, transformation, and loading (ETL) for optimized data access solutions.
- Monitoring and troubleshooting data pipelines, ensuring data availability and reliability.
Key Responsibilities:
- Ownership, cataloging, and maintenance of all data pipelines within the organization.
- Creation and upkeep of data pipeline designs and patterns following best practices.
- Ensuring accuracy and quality of transported data through pipelines.
- Accountability to Project Managers and Data/Architecture Head for all related actions.
- Providing guidance to Digital and ICT teams on Data Engineering best practices.
- Exemplifying and promoting company values and work ethos.
- Nurturing a culture of high performance within the team.
- Developing a structured personal growth plan.
Requirements:
- Minimum of 3 years' experience as a Data Engineer in an Azure environment for a medium/large organization.
- Preferably holds Azure data engineering certifications.
Key Competencies:
Technical:
- Proficiency in Azure computing environments.
- Expertise in Data Engineering.
- Familiarity with Azure DevOps.
- Understanding of Data Warehousing.
Critical Development Experiences:
- Exposure to Data Architecture.
- Project Management involvement.
- Familiarity with DevOps Management.