Principal Engineer - Hadoop

Responsibilities :

• Provide Support Services to our Gold & Enterprise customers using our flagship product suits. This may include assistance provided during the engineering and operations of distributed systems as well as responses for mission-critical systems and production customers.
• Lead end-to-end delivery and customer success of next-generation features related to scalability, reliability, robustness, usability, security, and performance of the product
• Lead and mentor others about concurrency, parallelization to deliver scalability, performance, and resource optimization in a multithreaded and distributed environment
• Demonstrate the ability to actively listen to customers and show empathy to the customer’s business impact when they experience issues with our products

Requires Skills :

• 10+ years of Experience with a highly scalable, distributed, multi-node environment (100+ nodes)
• Hadoop operation including Zookeeper, HDFS, YARN, Hive, and related components like the Hive metastore, Cloudera Manager/Ambari, etc
• Authentication and security configuration and tuning (KNOX, LDAP, Kerberos, SSL/TLS, second priority: SSO/OAuth/OIDC, Ranger/Sentry)
• Java troubleshooting, e.g., collection and evaluation of jstacks, heap dumps
• Linux, NFS, Windows, including application installation, scripting, basic command line
• Docker and Kubernetes configuration and troubleshooting, including Helm charts, storage options, logging, and basic kubectl CLI
• Experience working with scripting languages (Bash, PowerShell, Python)
• Working knowledge of application, server, and network security management concepts
• Familiarity with virtual machine technologies
• Knowledge of databases like MySQL and PostgreSQL,
• Certification on any of the leading Cloud providers (AWS, Azure, GCP ) and/or Kubernetes is a big plus