Data Engineer - Azure Platform

Data Engineer | 100% Remote | 12-Month Contract. We are looking for an experienced Data Engineer to join our team on a 12-month remote contract. This role offers a great opportunity to work with Azure services, including Azure Databricks, Azure DataFactory, and Azure DevOps, to build secure, scalable data pipelines. What You'll Do : - Develop data solutions using Python/PySpark and SQL. - Build and maintain data pipelines utilizing Azure Databricks, Azure DataFactory, and Azure DevOps. - Implement CI/CD principles to streamline development and deployment. - Ensure robust security using API and data security practices. - Work with relational databases like SQL Server, Oracle, and MySQL. - Collaborate with cross-functional teams to solve complex : - Designs data integrations and data quality framework. - Designs and evaluates open source and vendor tools for data lineage. - Works closely with all business units and engineering teams to develop strategy for long term data platform architecture. Expertise : - Performance Turing - Optimize SQL, PySpark for performance. - Airflow workflow scheduling tool for creating data pipelines. - GitHub source control tool & experience with creating/ configuring Jenkins pipeline. - Proficient in Databricks, Airflow. What You Bring : - Expertise in Python/PySpark and SQL. - Proven experience with Azure services (Databricks, DataFactory, DevOps). - Knowledge of CI/CD principles and data security practices. - Familiarity with relational databases such as SQL Server, Oracle, or MySQL. - Excellent communication and problem-solving skills. Why Join Us : - 100% remote - work from the comfort of your home. - Exciting opportunity to work on cutting-edge technologies. - Collaborative and innovative work environment. - Apply now and take the next step in your Data Engineering career. (ref:hirist.tech)

Location: in, IN

Posted Date: 10/30/2024