Senior Data Engineer
Job description
Camden Council is one of Australia’s fastest-growing local government areas, delivering major digital and data modernisation initiatives to support a thriving and connected community.
With significant investment in Azure cloud capabilities, the Council is building a scalable, modern data platform to enable high-quality analytics and evidence-based decision making.
We are excited to partner with Camden Council to recruit an experienced Senior Data Engineer who will play a pivotal role in driving this transformation.
The Opportunity
As the Senior Data Engineer, you will be a key technical lead within the Digital Technology & Innovation Branch, responsible for architecting and delivering end-to-end data solutions across Camden Council’s Azure environment.
This is a hands-on role where you will design, develop, and optimise data pipelines, establish best-practice data engineering standards, and enable advanced analytics across the organisation. You will work closely with the Team Leader – Data & Insights, the CIO, and cross-functional stakeholders to build a sustainable and scalable data ecosystem.
Key Responsibilities
You’re an experienced Senior Data Engineer who thrives in cloud-native environments and enjoys building enterprise-scale data solutions from the ground up. You will bring:
With significant investment in Azure cloud capabilities, the Council is building a scalable, modern data platform to enable high-quality analytics and evidence-based decision making.
We are excited to partner with Camden Council to recruit an experienced Senior Data Engineer who will play a pivotal role in driving this transformation.
The Opportunity
As the Senior Data Engineer, you will be a key technical lead within the Digital Technology & Innovation Branch, responsible for architecting and delivering end-to-end data solutions across Camden Council’s Azure environment.
This is a hands-on role where you will design, develop, and optimise data pipelines, establish best-practice data engineering standards, and enable advanced analytics across the organisation. You will work closely with the Team Leader – Data & Insights, the CIO, and cross-functional stakeholders to build a sustainable and scalable data ecosystem.
Key Responsibilities
- Design, build, and maintain end-to-end data pipelines using Azure Data Factory.
- Transform raw data into high-quality, structured assets using Azure Databricks, PySpark, Delta Lake, and Spark SQL.
- Manage data across Bronze, Silver, Gold layers in Azure Data Lake Storage Gen2.
- Develop and optimise data models to support analytics and Power BI reporting.
- Enable advanced analytics by delivering clean, reliable, production-ready datasets.
- Implement CI/CD pipelines and Git-based development practices.
- Uphold data governance, including cataloging and lineage through Azure Purview/Unity Catalog.
- Partner closely with business units to translate requirements into scalable data solutions.
- Support platform optimisation, performance tuning, and cost management.
You’re an experienced Senior Data Engineer who thrives in cloud-native environments and enjoys building enterprise-scale data solutions from the ground up. You will bring:
- 5+ years’ experience in data engineering, including ETL/ELT, data modelling, and Azure data architecture.
- Hands-on experience with Azure Databricks (PySpark, Spark SQL, Delta Lake).
- Strong expertise in Azure Data Factory and orchestrating end-to-end pipelines.
- Proficiency in Python and SQL.
- Experience integrating data from APIs, on-prem databases, and CSV/JSON files.
- Familiarity with Azure Purview/Unity Catalog and data governance frameworks.
- Experience with CI/CD pipelines and Git-based workflows.
- Excellent communication and problem-solving skills.
- Experience with Power BI, Jira, Confluence, or local government systems (Authority, CAMMS).
- Be at the forefront of Camden’s enterprise data transformation.
- Work with modern Azure technologies in a forward-thinking organisation.
- Hybrid work model – 3 days onsite in Oran Park.
- Supportive leadership, strong team culture, and impactful community-focused work.
- Competitive salary and 2-year fixed term security.