Senior Data Engineer

Use your deep data engineering expertise to help modernise enterprise analytics and reporting at the New Zealand Customs Service | Te Mana Ārai o Aotearoa. We are looking for an experienced Senior Data Engineer to play a key role in designing and building our next-generation analytics and reporting platform. This is an opportunity to work at the centre of a significant modernisation programme, helping to rebuild ingestion, transformation, modelling and reporting capability using Microsoft Fabric and Power BI. As Senior Data Engineer, you will help design and implement modern, scalable data solutions using Microsoft Fabric, including Data Factory, Dataflows Gen2, Lakehouse, Pipelines and Notebooks. You will develop Lakehouse and Warehouse models using Delta Lake, SQL, Python and PySpark, applying modern ELT patterns and distributed processing techniques. A key focus of the role will be supporting the migration from a legacy IBM IIS/DataStage environment to Fabric-native solutions. Experience with the legacy platform is not essential; what matters is your ability to understand existing business logic and re-engineer it into maintainable, high-performing data pipelines and reporting outputs. What you’ll bring | Ko wai koe We are interested in hearing from people who bring strong technical expertise, sound engineering judgement and the ability to work collaboratively with analysts, architects and business stakeholders. You will be comfortable providing technical guidance, contributing to design decisions and supporting capability uplift across the team. Hands-on experience with Microsoft Fabric, including Data Factory, Dataflows Gen2, Lakehouse, Pipelines and/or Notebooks. Strong proficiency in Python and PySpark for data transformation and distributed processing. Solid SQL skills and experience implementing ELT patterns. Experience building Power BI datasets, semantic models and reports. Familiarity with Git, DevOps practices and automated testing for data workloads. An understanding of Lakehouse architecture and Delta Lake. Exposure to IBM IIS/DataStage or other legacy ETL tools would be helpful, as would experience in large-scale migration or modernisation projects, but these are not essential. At Customs, our purpose is to protect New Zealand’s border using world-class tools, people and innovative approaches. We promote New Zealand by facilitating trade and welcoming visitors, and we work collaboratively across the border sector to deliver services that make a meaningful difference for Aotearoa. This role sits within Digital and Technology and contributes to the delivery of stable, robust and future-focused technology products and services. You will work closely with technical teams and business stakeholders to develop trusted data products that support decision-making across Customs. #J-18808-Ljbffr