Data Engineer 2

We are seeking an experienced Data Engineer Developer with 3-5 years of experience to join our talented team in Bangalore. In this role, you will be responsible for designing, implementing, and optimizing data pipelines, ETL processes, and data integration solutions using Python, Spark, SQL, Snowflake, dbt, and other relevant technologies. Position Responsibilities: Design, develop, and maintain scalable and efficient data pipelines, ETL processes, and data integration solutions using Python, Spark, SQL, Snowflake, and other relevant technologies. Utilize big data processing frameworks such as Apache Spark to process and analyze large volumes of data efficiently. Implement data transformations, aggregations, and business logic to support analytics and reporting requirements. Leverage cloud-based data platforms such as Snowflake to store and manage structured and semi structured data at scale. Utilize dbt (Data Build Tool) for data modeling, transformation, and documentation to ensure data consistency, quality, and integrity. Monitor and optimize data pipelines and ETL processes for performance, scalability, and reliability. Conduct data profiling, cleansing, and validation to ensure data quality and integrity across different data sets. Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver actionable insights. Stay updated on emerging technologies and best practices in data engineering, contributing to continuous improvement and innovation within the team. Preferred Experience / Education / Skills: Global operations, manufacturing, supply chain data pipeline and KPI development domain knowledge is required Bachelor's degree in Computer Science, Engineering, or related field. 3-5 years of experience in data engineering, with proficiency in Python, Spark, SQL, Snowflake, dbt, and other relevant technologies. Strong understanding of distributed computing principles and big data processing frameworks such as Apache Spark. Hands-on experience with cloud-based data platforms such as Snowflake, AWS, Azure, or Google Cloud Platform. Experience with data modeling, ETL development, and data integration using SQL and Python. Familiarity with dbt (Data Build Tool) for managing data transformation and modeling workflows. Excellent problem-solving skills, analytical thinking, and attention to detail. Strong communication and interpersonal skills, with the ability to collaborate effectively in a team environment. Eagerness to learn and adapt to new technologies and tools in a fast-paced environment.

Location: Bangalore, IN

Posted Date: 9/2/2024