Senior Data Engineer

Data Engineer Consultant (Informatica, PostgreSQL, Hadoop, AWS) 3-6 month initial extendable contract Start Date - November 2024 3 days per week in office (Markham) This role is part of our client's Information Technology Enterprise Data Services Group, where you will take a lead role in architecture, design, analysis, and implementation within an experienced team. Drawing on your in-depth knowledge of both modern and legacy data platforms, you will develop robust data ecosystems that align with business needs and the enterprise architecture standards of the organization. Our client is currently undertaking an exciting initiative to modernize and create a next-generation data platform, aimed at addressing growing data demands and harnessing AI capabilities to enhance business value. Key Responsibilities: Architect, build, and operationalize large-scale enterprise data solutions using platforms like Hadoop, Postgres, and Snowflake. Apply advanced knowledge of AWS cloud services, with a particular focus on data engineering and analytics. Re-engineer and migrate existing on-premises big data platforms to the cloud. Design and implement solutions for data acquisition, integration, and data warehousing that cater to complex internal and external data sources. Work closely with stakeholders including business teams, product owners, IT architects, developers, and analysts to ensure solutions meet both functional and technical standards. Ensure compliance with enterprise-wide data governance and design frameworks. Act as a technical resource for delivery teams, helping to resolve architectural and technical challenges for optimized delivery. Build ETL pipelines for ingesting data into Hadoop from a variety of data sources, including files, mainframes, relational databases, and NoSQL systems, using Informatica BDM. Promote and advocate for the use of data catalogs, governance, and high data quality practices. Utilize strong problem-solving abilities to overcome technical challenges. Operate within an Agile delivery framework, iterating on data models and solution designs to deliver incremental improvements. Mentor and guide junior team members, providing leadership by example. Focus on outcomes, using critical thinking and decision-making skills to challenge existing processes and improve overall efficiency. Qualifications: Education : Bachelor’s degree in Computer Science, Computer Engineering, or a related field. Experience : 5 years of experience in designing and implementing data lakes, data integration solutions, and data warehouses/marts. Technical Expertise : Proficient with data technologies such as Hadoop, PostgreSQL, and the Informatica product suite. ETL Proficiency : Hands-on experience with BDM execution engines like Spark, Hive, and Native, with deep knowledge of ETL processes using Informatica. Cloud Data Lake : Solid experience with cloud-based data lake architectures, especially on AWS services such as S3, EMR, Redshift, and Data Catalog. Data Governance : Proven ability to implement and maintain data governance practices. Reporting Tools : Familiarity with tools like QlikSense, SAP Business Objects, SAS, and Dataiku. Agile Experience : Background in Agile development methodologies. Communication Skills : Strong written and verbal communication abilities. Insurance Experience : Familiarity with Claim Center and Guidewire is an advantage, along with the ability to understand the business processes behind technical systems.

Location: Toronto, CA

Posted Date: 11/6/2024