Lead Big Data Engineer

Do you have a passion for leveraging data and cutting-edge technology to solve complex business challenges in a collaborative and fast-paced environment? Join our team at Capital One and be part of a group dedicated to innovation and customer-focused solutions. We are seeking a Lead Big Data Engineer to drive a major transformation within our organization.

Key Responsibilities:

• Lead the design, development, and implementation of technical solutions using full-stack development tools and technologies
• Collaborate with a team of experienced developers in machine learning, microservices, and full stack systems
• Utilize programming languages such as Java, Scala, Python, and Open Source RDBMS and NoSQL databases, as well as Cloud-based data warehousing services such as Redshift and Snowflake
• Stay updated on tech trends, experiment with new technologies, and mentor other team members
• Work with product managers to deliver robust cloud-based solutions that enhance customer experiences
• Conduct unit tests and code reviews to ensure high-quality and optimized performance

Basic Qualifications:

• Bachelor's Degree
• Minimum 3 years of experience in application development
• At least 1 year of experience in big data technologies

Preferred Qualifications:

• 5+ years of application development experience in Python, SQL, Scala, or Java
• 2+ years of experience with a public cloud (AWS, Azure, Google Cloud)
• 3+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)
• 2+ years of experience working on real-time data and streaming applications
• 2+ years of experience with NoSQL implementation (Mongo, Cassandra)
• 2+ years of data warehousing experience (Redshift or Snowflake)
• 3+ years of experience with UNIX/Linux
• 2+ years of experience with Agile engineering practices

Please note that this role is not eligible for work authorization sponsorship. Learn more about our comprehensive benefits package on the Capital One Careers website. We encourage a diverse and inclusive workplace where all qualified applicants will receive consideration for employment without regard to sex, race, age, religion, disability, genetic information, marital status, sexual orientation, gender identity, citizenship, protected veteran status, or any other basis prohibited by law.