Data Engineer

Title: Data Engineer Location: Old Toronto, ON - 2/3 times a week on-site Duration: 6-month contract to start, Permanent role FT after Key Responsibilities: Design, develop, and maintain data pipelines for handling large volumes of data streams using Apache Kafka . Implement real-time data processing solutions using Apache Flink or Apache Spark . Build and maintain RESTful APIs using Spring Boot to support data integration across systems. Design and implement workflow orchestration solutions using Temporal IO to ensure fault-tolerant, scalable, and reliable distributed systems. Develop and manage Temporal workflows for orchestrating complex data pipelines and processes. Work with NoSQL databases , ensuring optimal performance and scalability. Collaborate with cross-functional teams to deliver high-quality data solutions for business needs. Troubleshoot and optimize existing data pipelines and workflows to ensure efficiency and reliability. Required Skills : Experience in data engineering or a related field. Strong proficiency in Apache Kafka for handling large-scale data streams. Expertise in Apache Flink or Apache Spark for real-time and batch data processing. Proven experience with Temporal IO or similar workflow orchestration frameworks (e.g., Cadence). Good understanding of Java and its related concepts. Experience building RESTful APIs with Spring Boot . Solid understanding of NoSQL databases (e.g., MongoDB, Cassandra). Familiarity with cloud environments and containerization (e.g., AWS, Docker) is a plus.

Location: Toronto, CA

Posted Date: 2/4/2025