Developer - Data Engineering

Developer - Data Engineering is a part of the Data & Analytics function to work on designing, developing, testing, and supporting Digital Data Core pipelines and complex data models development in Amazon Web Services (AWS) and deliver insights to the business. Primary Responsibilitiesinclude but are not limited to the following: Designs, develops, and maintains scalable data pipelines with delta mechanism in AWS Lake using AWS services and PySpark. Analyzes, designs, develops, tests, deploys and supports Data models in AWS S3 using Spark SQL based on extracts from various sources based on functional design specifications Stay up to date with industry trends and best practices in data engineering, AWS services, AWS Lake, PySpark and Athena Reviews business requirements, helps to create functional design, and develops technical design documents and data lineage, data dictionaries, and metadata management. Understands the functionality of business processes and data that will be required to build, test and implementation. Performs SQL scripting. Participates actively in local and global teams. Requirements: Bachelors degree in computer science, Engineering or Technology from an accredited university A minimum of 2-4 years of solid experience in data warehousing including data pipelines and data modeling particularly on AWS platform 2-4 of years strong experience in Python, PySpark with SQL scripting 2-3 years Solid experience with AWS services such as S3, Amazon EKS, Amazon EMR, CloudFormation, AWS Secrets Manager, Glue and Athena Good experience in Relational Databases and concepts Extensive working knowledge on any of the business processes including sales, finance, supply chain, manufacturing, Master Data etc. Detail oriented, self-directed and have strong independent problem-solving, analytical and multi-tasking skills with English fluency Have a strong background and interest in technology Additional Job Description Additional Job Description: AWS certification - Professional is a plus. Good working knowledge in Databricks is preferable.

Location: Bangalore, IN

Posted Date: 9/2/2024