Kafka Administrator at Cargill Business Services · Bengaluru (Bangalore) · 2 - 6 years · Profitable · Posted 6 Aug 2024
As a Kafka Administrator at Cargill you will work across the full set of data platform technologies spanning on-prem and SAS solutions empowering highly performant modern data centric solutions. Your work will play a critical role in enabling analytical insights and process efficiencies for Cargill’s diverse and complex business environments. You will work in a small team who shares your passion for building, configuring, and supporting platforms while sharing, learning and growing together.
- Develop and recommend improvements to standard and moderately complex application support processes and procedures.
- Review, analyze and prioritize incoming incident tickets and user requests.
- Perform programming, configuration, testing and deployment of fixes or updates for application version releases.
- Implement security processes to protect data integrity and ensure regulatory compliance.
- Keep an open channel of communication with users and respond to standard and moderately complex application support requests and needs.
MINIMUM QUALIFICATIONS
- 2-4 year of minimum experience
- Knowledge of Kafka cluster management, alerting/monitoring, and performance tuning
- Full ecosystem Kafka administration (kafka, zookeeper, kafka-rest, connect)
- Experience implementing Kerberos security
- Preferred:
- Experience in Linux system administration
- Authentication plugin experience such as basic, SSL, and Kerberos
- Production incident support including root cause analysis
- AWS EC2
- Terraform
Shubham Vishwakarma
Full Stack Developer - Averlon
Similar jobs (1)
Python
grafana
KubernetesExperience: 8+ years (including 5+ years hands-on with Apache Kafka platform engineering)
Key Responsibilities
• Manage Kafka cluster lifecycle: provisioning, configuration tuning, upgrades, and decommissioning
• Deploy, operate, and maintain Kafka on Kubernetes using Confluent for Kubernetes (CFK)
• Monitor cluster health and set up alerting across consumer lag, broker health, and topic throughput
• Design and operate disaster recovery and multi-region replication strategies
• Enforce Kafka security policies including access reviews and ACL management
• Troubleshoot performance bottlenecks, consumer lag issues, and broker failures
Must Have
• 8+ years in messaging/streaming platform engineering, with 5+ years on Apache Kafka platform engineering
• Hands-on administration of self-managed on-premises Kafka clusters in KRaft mode
• Confluent for Kubernetes (CFK): operator management and custom resource configuration
• Kafka Connect: connector lifecycle, SMTs, and error handling
• Confluent Schema Registry; schema evolution and compatibility modes
• Kafka security: TLS/mTLS, SASL, and ACL configuration and troubleshooting
• Proficiency in Java or Scala; Python for scripting and tooling
• Observability: Prometheus, Grafana, and OpenTelemetry
Good to Have
• Apache Flink for complex event processing beyond Kafka Streams
• CDC pipelines into Kafka
• Operational experience with MirrorMaker 2 or Confluent Replicator in multi-DC setups
• Knowledge of event-driven architecture or data mesh principles
• Build and maintain infrastructure-as-code for Kafka resources
• Integrate Kafka platform changes with CI/CD pipelines for topic and schema deployments
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon