Quarry Consulting

Data Engineer

Click Here to Apply

Job Location

Toronto, Canada

Job Description

Title: Data Engineer Location: Old Toronto, ON - 2/3 times a week on-site Duration: 6-month contract to start, Permanent role FT after Key Responsibilities: Design, develop, and maintain data pipelines for handling large volumes of data streams using Apache Kafka . Implement real-time data processing solutions using Apache Flink or Apache Spark . Build and maintain RESTful APIs using Spring Boot to support data integration across systems. Design and implement workflow orchestration solutions using Temporal IO to ensure fault-tolerant, scalable, and reliable distributed systems. Develop and manage Temporal workflows for orchestrating complex data pipelines and processes. Work with NoSQL databases , ensuring optimal performance and scalability. Collaborate with cross-functional teams to deliver high-quality data solutions for business needs. Troubleshoot and optimize existing data pipelines and workflows to ensure efficiency and reliability. Required Skills : Experience in data engineering or a related field. Strong proficiency in Apache Kafka for handling large-scale data streams. Expertise in Apache Flink or Apache Spark for real-time and batch data processing. Proven experience with Temporal IO or similar workflow orchestration frameworks (e.g., Cadence). Good understanding of Java and its related concepts. Experience building RESTful APIs with Spring Boot . Solid understanding of NoSQL databases (e.g., MongoDB, Cassandra). Familiarity with cloud environments and containerization (e.g., AWS, Docker) is a plus.

Location: Toronto, CA

Posted Date: 2/4/2025
Click Here to Apply
View More Quarry Consulting Jobs

Contact Information

Contact Human Resources
Quarry Consulting

Posted

February 4, 2025
UID: 5029200215

AboutJobs.com does not guarantee the validity or accuracy of the job information posted in this database. It is the job seeker's responsibility to independently review all posting companies, contracts and job offers.