Big Data DevOps Engineer - Spark/HBase/Automation Tools

Job Requirements : - 5 years of DevOps experience managing the Big Data application stack including HDFS, YARN, Spark, Hive and Hbase - A deeper understanding of all the configurations required for installing and maintaining the infrastructure in the long run - Experience setting up high availability, configuring resource allocation, setting up capacity schedulers, handling data recovery tasks - Experience with middle-layer technologies including web servers (HTTP, ningx), application servers (Jboss, Tomcat), and database systems (Postgres, Mysql) - Experience setting up enterprise security solutions including setting up active directories, firewalls, SSL certificates, Kerberos KDC servers, etc. - Experience maintaining and hardening the infrastructure by regularly applying required security packages and patches - Experience supporting on-premise solutions as well as on AWS cloud - Experience working with and supporting Spark-based applications on YARN - Experience with one or more automation tools such as Ansible, Terraform, etc - Experience working with CI/CD tools like Jenkins and various test report and coverage plugins - Experience defining and automating the build, versioning, and release processes for complex enterprise products - Experience supporting clients remotely and on-site - Experience working with and supporting Java- and Python-based tech stacks would be a plus (ref:hirist.tech)

Location: in, IN

Posted Date: 10/23/2024