Astek
Data Engineer
Job Location
Toronto, Canada
Job Description
Job Offer: Data Engineer Location: Toronto Contract Duration: 6 months, renewable Work Mode: Hybrid Start Date: ASAP Why Join Us? Astek is a global leader in technology consulting. With 9,600 experts worldwide, we guide our clients through digital transformation by developing innovative solutions. In Canada, we excel in IT and engineering. We collaborate with leading companies to tackle major technological challenges, putting innovation, collaboration, and excellence at the heart of our actions. Join a passionate and committed team ready to bring your ideas to life. About the Role On behalf of our client in the Banking industry , Astek Canada is seeking a motivated Data Engineer ready to take on new challenges. Your Responsibilities As a Data Engineer, you will be responsible for: Work together with other data engineers, data analysts, business analysts, business SME’s, records analyst, and privacy analyst to understand the needs for data and create effective, secure data workflows. Responsible for designing, building, and maintaining secure and compliant data processing pipelines using various Microsoft Azure data services and frameworks including but not limited to Azure Databricks, Data factory, ADLS Storage, PySpark. Build databases, data marts or data warehouse and perform data migration work. Build reporting and analytical tools to utilize the data pipeline, provide actionable insight into key business performance metrics. Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Microsoft Azure Cloud. Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and/or Azure Blob Storage. Utilize Azure Data Factory or comparable technologies, create and maintain ETL (Extract, Transform, Load) operations. Implement data validation and cleansing procedures to ensure the quality, integrity, and dependability of the data. Monitor and resolve data pipeline problems to ensure consistency and availability of the data. Adapt and learn new technologies per business requirements. Ensure compliance with data governance, privacy and security policies. Fosters and maintains an organizational culture that promotes equity, diversity and inclusion, mutual respect, teamwork, and service excellence. Your Qualifications Education/Experience: Architectures, and datasets using Microsoft Azure technologies including Spark. Experience with data migration projects within Microsoft and Azure. Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. Key Skills: Strong analytic skills related to working with unstructured datasets. A successful history of manipulating, processing, and extracting value from large, disconnected datasets. Ability to plan, prioritize and manage workload within a time sensitive environment. Cloud experience – MS Azure - Azure EventHub, ADF, ADLS, Azure SQL, ASP Framework – Spark and Spark optimization Working Knowledge: Bitbucket, GitHub, Confluence, JIRA, Experience in DevOps pipeline, CI/CD and related tools (SQL) as well as working familiarity with a variety of databases. Advanced experience programming ETL code, building and optimizing data pipelines, Nice to have: Confluent Kafka, REDIS DB, AKS, MQ, OAuth, Postman. Experience with Data Migration projects. Personal Qualities: Analytical and solution-oriented mindset. Team collaboration and teamwork skills. Autonomy and rigor in managing priorities. The Astek Advantages Personalized CARE plan for our employees. Diversity & Inclusion Charter. Ready to Take on the Challenge? Apply now by sending your CV and discover a rewarding career at Astek Canada.
Location: Toronto, CA
Posted Date: 3/8/2025
Location: Toronto, CA
Posted Date: 3/8/2025
Contact Information
Contact | Human Resources Astek |
---|