Senior Data Engineer

Job Title : Senior Data Engineer - DBT Location : Chennai , Hyderabad , Bangalore Who we are : Tiger Analytics is a global leader in AI and analytics, helping Fortune 1000 companies solve their toughest challenges. We offer : Fullstack AI and analytics services & solutions to empower businesses to achieve real outcomes and value at scale. We are on a mission to push the boundaries of what AI and analytics can do to help enterprises navigate uncertainty and move forward decisively. Our purpose is to provide certainty to shape a better tomorrow. Our team of 4000 technologists and consultants are based in the US, Canada, the UK, India, Singapore and Australia, working closely with clients across CPG, Retail, Insurance, BFS, Manufacturing, Life Sciences, and Healthcare. Many of our team leaders rank in Top 10 and 40 Under 40 lists, exemplifying our dedication to innovation and excellence. We are a Great Place to Work-Certified- (2022-24), recognized by analyst firms such as Forrester, Gartner, HFS, Everest, ISG and others. We have been ranked among the - Best- and - Fastest Growing- analytics firms lists by Inc., Financial Times, Economic Times and Analytics India Magazine. Curious about the role? What your typical day would look like? As a Senior Data Engineer, you will operate autonomously with minimal supervision, leveraging your exceptional organizational and problem-solving abilities. On a typical day, you might : - Independently conducts stakeholder discussions to gather project requirements for non-complex data platforms, meticulously documenting technical and business requirements and obtaining sign-off. - Designs the entire technical solution for the project, encompassing ingestion, ETL/ELT, data models, processing, governance, etc. with minimal support from subject matter experts. - Writes clean, elegant, maintainable, and efficient code. - Assumes full ownership of end-to-end data pipeline implementation, undertaking advanced tasks such as performance tuning, optimized coding, providing technical advisory, creating reusable code, offering technical assistance to team members, and conducting code reviews. Possesses working knowledge in multiple paradigms (Big Data/MPP/Modern or Traditional DWH OnPrem/Cloud). - Troubleshoots and guides teams on various data modeling scenarios, independently resolving complex scenarios (e.,nested/custom hierarchies) and handling all modeling techniques (e., ER, Dimensional, Data Vault, Canonical). - Independently develops end-to-end data integration services on the project's cloud platform, reviewing cloud-based integration tasks performed by the team. - Ensures quality control checks and adheres to acceptable coding/organizational practices, with the ability to reproduce results at any given time. - Demonstrates willingness and openness to learning new practices, platforms, and technologies. EXPERTISE AND QUALIFICATIONS : What do we expect? - Over 7 years of comprehensive experience in data warehousing systems, with a minimum of 1 year dedicated to building and implementing full-scale data warehouse solutions on cloud data warehouses. - Hands-on experience of 2 years in designing and developing data integration solutions using DBT. - Strong proficiency with Apache Airflow development and Python scripting, with at least 2 years of practical experience. - Proficient in creating DBT Models, Materialization, Macros, Snapshots, Jinja templating, and YAML file manipulation. - Skilled in designing and constructing data pipelines for ingesting raw data into Cloud Data Warehouses (e. , Snowflake, Redshift, BigQuery), cleansing and transforming data to meet required specifications using various ETL/ELT tools. - Successfully implemented at least one end-to-end project with multiple transformation layers. - Sound understanding of data architecture, data modeling, and physical database design and tuning. - Strong command over SQL, capable of crafting structured and efficient queries for large datasets. - Experience in migration projects, with familiarity in utilizing frameworks considered an added advantage. - Proficient in writing test cases for data profiling and validation purposes. - Familiarity with DBT Cloud job creation and management. - Good grasp of coding standards, with the ability to define standards and testing strategies for projects. - Competent in building Airflow-Dbt connections and creating Dags for scheduling dbt cloud jobs. - Experienced in integrating GitHub or other version control tools with dbt and Airflow. - Proficient in Shell/PowerShell scripting. - Enthusiastic about working in Agile methodology and possessing a comprehensive understanding of the DevOps process. - Enjoy guiding and mentoring junior members of the team. - You are important to us, let- s stay connected - Every individual comes with a different set of skills and qualities so even if you don- t tick all the boxes for the role today, we urge you to apply as there might be a suitable/unique role for you tomorrow. - We are an equal-opportunity employer. - Our diverse and inclusive culture and values guide us to listen, trust, respect, and encourage people to grow the way they desire. Note : - The designation will be commensurate with expertise and experience. - Compensation packages are among the best in the industry (ref:hirist.tech)

Location: India, IN

Posted Date: 10/9/2024