Senior Data Engineer
Auckland, Auckland, New Zealand
Location: CBD, Inner West & Eastern Suburbs
Reference ID: 1143880
Email: [email protected] Call: 0483 945 772 West Sector: Technology Job Summary - Not for profit
- Excellent benefits
- Flexible working
Job Description Senior Data Engineer required for our not for profit, Sydney based client.
Key Responsibilities:
This role will take responsibility for the following areas;
•Leveraging Azure data services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Data Lake Storage to build end-to-end data solutions.
•Creating and managing data models and schemas within Azure SQL Data Warehouse, Azure SQL Database, or Azure Cosmos DB.
•Utilising Azure DevOps for version control, continuous integration, and deployment (CI/CD) of data engineering solutions.
•Automating data workflows and pipelines using Azure Logic Apps and Azure Functions.
•Implementing Azure Monitor and Azure Application Insights for real-time insights and troubleshooting.
•Developing ETL processes to cleanse, aggregate, and enrich data to make it suitable for analysis.
•Building and maintaining data warehouses or data lakes that store structured and unstructured data.
•Designing, implementing, and maintaining data pipelines to extract, transform, and load (ETL) data from various sources into a central data repository.
Essential Skills:
•Bachelor's degree in computer science, information technology, or a related field. A master's degree may be preferred.
•Proficiency in Azure services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Data Lake Storage.
•Strong programming skills in languages such as Python, PowerShell, or T-SQL within the Azure environment.
•Experience with Azure-native data warehousing solutions like Azure SQL Data Warehouse.
•Familiarity with Azure cloud services, including Azure Key Vault, Azure Active Directory, and Azure Purview and Microsoft 365, Microsoft Power •Platform and Dynamics 365 ecosystem.
•Knowledge of data governance and security best practices in Azure.
All Rights Reserved | West Recruitment Pty Ltd
#J-18808-Ljbffr