ProcDNA - Data Engineering Lead

What We Are Looking For : You'll build and maintain systems for efficient data collection, storage, and processing to ensure data pipelines are robust and scalable for seamless integration and analysis. We are seeking an individual who not only possesses the requisite expertise but also thrives in the dynamic landscape of a fast-paced global firm. What You'll Do : - Design/implement complex and scalable enterprise data processing and BI reporting solutions. - Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using DBt, and airflow. - Ensure strict data compliance, security, and cost optimization. - Re-architect data solutions for scalability, reliability, and resilience. - Manage data schemas and flow to ensure compliance, integrity, and security. - Deliver end-to-end data solutions across multiple infrastructures and applications. - Actively monitor and triage technical challenges in critical situations that require immediate resolution. - Develop relationships with external stakeholders to maintain awareness of data and security issues and trends. - Review work from other tech team members and provide feedback for growth. - Effectively mentor and develop your team members. Must have : - 8-12 years of experience in a data engineering role with an engineering degree in background. - Expertise in writing SQL and database objects - Stored procedures, functions, and views. - Hands-on experience in ETL/ELT and data security, SQL performance optimization, and job orchestration tools and technologies e.g., DBt, APIs, Apache Airflow. - Knowledge of data warehouses (Redshift, Snowflake, Databricks, Cloudera). - Proficient in Python scripting, PySpark, and Spark. - Experience with data ingestion, storage, and consumption. - Skilled in SQL and data schema management. - Excellent leadership, communication, and interpersonal skills, with the ability to build and motivate high-performing teams. - Strong project management skills, with experience in defining project scope, objectives, and deliverables, developing project plans, and managing project budgets and resources. - Domain knowledge of the pharma landscape is a plus. Skills : Data Engineering, Aws, Snowflake, Data Warehouse Architecture, Data Warehousing, SQL (ref:hirist.tech)

Location: Pune, IN

Posted Date: 10/9/2024