Lead Snowflake Data Engineer

Job Title: Lead Azure & Snowflake Data Engineer Location: Vancouver, BC (Hybrid) Employment Type: Contract About the Role: We are seeking a skilled and experienced Azure & Snowflake Data Engineer to join our team. As a key player, you will design, build, and maintain scalable data solutions using Microsoft Azure and Snowflake technologies. You will collaborate with cross functional teams to ensure that our data infrastructure is optimized for performance, security, and scalability. The project involves leveraging a ready Snowflake Adapter with a SaaS system to pull all the relevant data from the SaaS system. If the adapter cannot be leveraged, the client plans on using Azure Data Factory to extract the data from the source system. You would then be involved in transforming the data and preparing it for loading into the Data Warehouse Key Responsibilities: Data Pipeline Development: Design and implement end to end data pipelines to support data ingestion, transformation, and loading (ETL/ELT) using Azure Data Factory (ADF), Snowflake, Logic Apps and other relevant Azure tools. Data Warehousing: Develop, maintain, and optimize large-scale data warehouses and analytical databases on Azure, including Azure SQL Data Warehouse and Snowflake Data Modeling: Create and maintain logical and physical data models that align with business requirements, ensuring data integrity and scalability. Cloud Integration: Develop and manage cloud based data integration solutions between various systems, including on premises, cloud, and third party data sources. Data Governance: Ensure compliance with data governance and security policies, including data encryption, anonymization, and adherence to data privacy regulations. Automation: Automate repetitive data tasks and implement performance tuning strategies to ensure efficient data processing. Collaboration: Work closely with business stakeholders, data analysts, and software development teams to gather requirements and deliver reliable, efficient data solutions. Required Qualifications: Experience: 10 years of experience working as a Data Engineer with a focus on Azure and Cloud technologies. Experience working with Snowflake is nice to have Technical Expertise: Strong experience with Azure Data Factory (ADF), Azure Data Lake, and Azure SQL Database. Handson experience wth ETL/ELT pipeline development using Azure technologies. Expertise in SQL & PLSQL for data transformation and processing. Familiarity with Power BI or other reporting tools for data visualization Cloud Technologies: Solid understanding of Azure cloud services, including storage solutions (Blob Storage, Data Lake), and compute services (Snowflake). Big Data: Experience working with largescale data sets and knowledge of data partitioning, indexing, and optimization techniques. Data Security: Understanding of Azure data security best practices, including encryption, role based access control (RBAC), and Azure Key Vault. Data Modeling: Strong data modeling skills with experience in dimensional and relational data models. Preferred Qualifications: Certifications: Azure Data Engineer Associate or equivalent certification. Experience with DevOps practices and tools such as Azure DevOps, Git, CI/CD pipelines. Soft Skills: Excellent problem-solving skills with the ability to troubleshoot complex data issues. Strong verbal and written communication skills to collaborate with business stakeholders. Team oriented mindset with a proactive approach to improving data processes. Why Join Us? Opportunity to work with cutting-edge Azure technologies and largescale data projects. Collaborative work environment with a focus on continuous learning and development. Competitive salary and benefits package.

Location: Greater Vancouver, CA

Posted Date: 11/11/2024