
Data Engineer – Splunk & ELK Stack
Job Summary
We are seeking a skilled Data Engineer with hands-on experience in Splunk, the ELK Stack (Elasticsearch, Logstash, Kibana), and modern data engineering practices. The ideal candidate will design, build, and maintain scalable data pipelines, log analytics platforms, and monitoring solutions to support business intelligence, security, and operational excellence.
Key Responsibilities
- Design, develop, and maintain scalable data ingestion and ETL/ELT pipelines.
- Configure, administer, and optimize Splunk environments for log collection, indexing, searching, and reporting.
- Develop and maintain ELK Stack solutions using Elasticsearch, Logstash, Kibana, and Beats.
- Build dashboards, visualizations, alerts, and reports for infrastructure, application, and security monitoring.
- Integrate data from multiple structured and unstructured sources into centralized analytics platforms.
- Optimize Elasticsearch clusters for performance, scalability, and high availability.
- Troubleshoot data pipeline failures, indexing issues, and system performance bottlenecks.
- Automate deployment and configuration using scripting and Infrastructure as Code where applicable.
- Collaborate with DevOps, Security, Cloud, and Application teams to implement observability and monitoring solutions.
- Ensure data quality, governance, and compliance with organizational standards.
- Document technical designs, operational procedures, and best practices.
Required Skills
- Strong experience with Splunk Enterprise administration and development.
- Hands-on experience with the ELK Stack:
- Elasticsearch
- Logstash
- Kibana
- Beats (Filebeat, Metricbeat, Winlogbeat, etc.)
- Experience building ETL/ELT pipelines and data integration workflows.
- Strong SQL skills and experience with relational databases.
- Experience with Python, Shell scripting, or Java for automation.
- Understanding of log management, monitoring, and observability concepts.
- Experience working with Linux environments.
- Knowledge of REST APIs and data ingestion techniques.
- Familiarity with cloud platforms such as AWS, Azure, or Google Cloud.
- Experience with Git and CI/CD pipelines.
Preferred Skills
- Experience with Kafka, Spark, or other streaming technologies.
- Knowledge of Docker and Kubernetes.
- Experience with Terraform, Ansible, or other Infrastructure as Code tools.
- Understanding of SIEM concepts and security analytics.
- Experience with Prometheus, Grafana, or OpenTelemetry.
- Exposure to big data technologies and distributed systems.

Similar jobs
Senior BackEnd Engineer
The ideal candidate will have a strong background in building scalable applications, a deep understanding of back-end technologies, and experience with cloud infrastructure. As a Back End Engineer, you will be responsible for designing, developing, and maintaining a scalable workflow management system. You will work closely with cross-functional teams to build robust and efficient applications that meet the needs of our users. Your expertise in Scala, Python, AI Agents/APIs, and GCP will be crucial in ensuring our system is reliable, performant, and scalable.
Key Responsibilities:
Back-End Development:
- Build and maintain back-end services and APIs using Scala.
- Implement and optimize Orchestration workflow system involving database queries and operations.
- Build API integrations with Third Party APIs and services.
- Ensure robust and scalable server-side logic.
Cloud Integration:
- Deploy, manage, and monitor applications on Google Cloud Platform (GCP).
- Utilize GCP services to enhance application performance and scalability.
- Implement cloud-based solutions for data storage, processing, and analytics.
Collaboration And Communication:
- Work closely with cross-functional teams to define, design, and ship new features.
- Participate in code reviews and contribute to sharing team knowledge.
- Document development processes, coding standards, and project requirements.
Qualifications:
- Educational Background:
- Completed a masters/bachelor degree in Computer Science, Engineering, or a related field.
- Technical Skills:
- Proficiency in Scala programming language.
- Strong experience with React and ReactJS.
- Familiarity with Google Cloud Platform (GCP) and its services.
- Knowledge of front-end development tools and best practices.
- Understanding of RESTful API design and implementation.
- Soft Skills:
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration abilities.
- Eagerness to learn and adapt to new technologies and challenges.
Preferred Qualifications:
- Experience with version control systems such as Git.
- Familiarity with CI/CD pipelines and DevOps practices.
- Understanding of workflow management systems and their requirements.
- Experience with containerization technologies like Docker.
Must have Skills
- Scala - 4 Years
- React.Js - 1 Years
- RESTful API - 4 Years
- Docker - 2 Years
- Python - 3 Years
- Artificial Intelligence - 2 Years
Profile: Senior Java Developer
🔷 Experience: 5+ Years
🔷 Location: Remote
🔷 Shift: Day Shift
(Only immediate joiners & candidates who have completed notice period)
✨ What we want:
✅ AWS cloud services (MANDATORY)
✅ Docker containerization (MANDATORY)
✅ Spring/Spring Boot framework
✅ RESTful API development
✅ Microservices architecture
✅ Database experience (SQL/NoSQL)
✅ Git version control & CI/CD
✅ Kubernetes orchestration
Job Description
We are looking for a passionate Search Specialist Backend Engineer to join our team. This role will focus on improving and optimizing our search capabilities to enhance user experience, scalability, and relevancy.
Location - Bangalore
Designation - Senior Software engineer - Search Specialist
Responsibilities:
● Design, develop, and maintain the search application, ensuring performance, and scalability.
● Collaborate with cross-functional teams to define and implement search features and improvements.
● Ensure search results are relevant by employing techniques like ranking, personalization, and recommendation.
● Work on complex problems related to search algorithms, data structures, and distributed systems.
● Implement logging, metrics, and monitoring for search services.
● Optimize search by tuning the underlying algorithms, experimenting with new techniques, and leveraging tools like Elasticsearch, Solr, etc.
● Maintain and improve existing search functionalities while ensuring backward compatibility.
● Stay updated with the latest advancements in search technology and industry best practices.
Basic Qualifications:
● Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
● Experience with search engines like Elasticsearch, Solr, or similar technologies.
● Solid understanding of algorithms, data structures, and distributed systems.
● Proficiency in Python and Django.
● Familiarity with RESTful APIs and backend services.
● Preferred Qualifications:
● Experience with natural language processing (NLP) or machine learning as applied to search.
● Knowledge of various search relevance techniques and ranking algorithms.
● Experience in a cloud environment (e.g., AWS, Google Cloud, Azure). ● Familiarity with containerization technologies such as Docker and Kubernetes.
● Strong analytical and debugging skills. Personal Attributes:
● Strong communication skills and ability to collaborate effectively in a team setting.
● A keen interest in improving user experience through search.
● Proactive, self-motivated, and able to work in a fast-paced environment
Who You Are:
- You’ve built scalable, production-ready APIs in fast-paced environments, and are comfortable with the challenges that come with a growing startup.
- You understand event-driven architectures and have hands-on experience building real-time applications.
- You are fully capable of taking ownership of backend systems, from designing the database schema to writing efficient, maintainable code.
- You think beyond the code: optimizing performance, scalability, and security are as important as building new features.
- You’re comfortable troubleshooting complex issues, whether that’s API bottlenecks, database performance, or production issues.
Responsibilities:
- Design, implement, and manage a NestJS backend with a modular, scalable architecture that can easily handle real-time events and communication.
- Develop and maintain WebSocket services for real-time event-driven updates and ensure seamless communication across the system.
- Integrate RabbitMQ for reliable internal messaging, handling queues and ensuring event-driven workflows are efficient and fault-tolerant.
- Implement database management strategies using MongoDB, Redis, and Elasticsearch, ensuring efficient data handling, indexing, and optimization.
- Integrate with external APIs (JSON-RPC, XML-RPC, REST) to enhance system capabilities.
- Ensure high performance of the system by optimizing database queries, implementing caching strategies using Redis, and ensuring optimal indexing and data flow.
- Implement role-based authentication and authorization mechanisms using JWT, OAuth, and RBAC patterns within NestJS.
- Follow security best practices to ensure sensitive data is protected, credentials are stored securely, and the system is resilient to common vulnerabilities.
- Work collaboratively with cross-functional teams to ensure seamless integration between different services and technologies.
Must-Have Skills:
- Strong proficiency in Node.js and NestJS with TypeScript.
- Solid experience with MongoDB, Redis, and Elasticsearch for data storage and real-time data handling.
- In-depth knowledge of WebSockets and Socket.IO in NestJS Gateways, enabling real-time communication and updates.
- Experience with RabbitMQ for message queuing and asynchronous task handling.
- Strong understanding of authentication & authorization systems using JWT, OAuth, and RBAC (Role-Based Access Control).
- Expertise in optimizing APIs, including techniques for caching, improving database performance, and reducing latency.
- Familiar with API security best practices, including secure storage of credentials, encryption, and safeguarding sensitive data.
Key Skills:
- TypeScript, NestJS, WebSockets, Socket.io
- Redis, MongoDB, Elasticsearch, RabbitMQ
- API Optimization, JWT, OAuth, RBAC
- Real-time communication, Event-driven architecture
Experience of atleast 9 + years in developing Java Solutions and Architecture
Mandatory Experience of working on AWS, Microservices architecture, Dockers, Kubernetes
Experience in creating architecture for Cloud Applications in AWS
Should have worked on large scale Saas application for atleast 3 years
Knowledge and experience in any of the following
Javascript, AngularJS, Python, Ruby, PHP
Driving DevOps best practices by using Docker, Kubernetes.
Excellent interpersonal, verbal and written communication skills
Location Chennai, Bengaluru, Hyderabad,
Senior Python Backend Developer
Notice Period: 45 days / Immediate Joining
Banyan Data Services (BDS) is a US-based Infrastructure Services Company, headquartered in San Jose, California, USA. It provides full-stack managed services to support business applications and data infrastructure. We are looking for a Senior Python Developer to join our development team based out of Bangalore. This teamwork on building the next-generation SAS application on the Hybrid Cloud platform.
It's a once-in-a-lifetime opportunity to join our rocket ship startup run by a world-class executive team. We are looking for candidates that aspire to be a part of the cutting-edge solutions and services we offer that address next-gen data evolution challenges.
Key Qualificatisons
· Ability to write high-quality code efficiently.
· Design and develop new services/micro-services.
· Participate in planning and management of development process.
· Share architectural design vision with both technical and non-technical team members, including fellow engineers.
· Works on improvements in development toolset including testing frameworks, deployment scripts, and monitoring libraries.
· Experience solving complex problems and implementing solutions for performance and scalability.
· Write clean, well-structured, and maintainable code with automated test coverage and corresponding documentation.
· Explore new latest relevant technology, techniques, frameworks, tools, methodologies, and processes.
· Comfortable working with all aspects of software development; including dev-ops, quality assurance, research, and design.
Requirements
· Minimum 3 years of experience as a Python Developer in application development.
· Experience in Developing applications/software using Python, developing web services using Django/Flask, working with REST API, and working with any databases technology.
· Strong in Reg expression and string handling.
· Strong in python programming and should be able to develop both API, UI, and backend validations.
· Integration of user-facing elements developed by front-end developers with server-side logic and Implementation of security and data protection.
· Experience in Developing applications, software using Python, developing web services using Django, Flask, working with REST API, and working with any databases technology.
· Worked on open-source tools for logging, monitoring, search engine, caching, etc.
· Exposure to any of relation database technologies MySQL/Postgres/Oracle or any No-SQL database.
· Experience working on DevOps tools for continuous integration.
· Performed App servers, application deployments, web server deployments.
· Design and implementation of low-latency, high-availability, and performant applications.
· Working knowledge of AWS, enough to be able to set up the environment for application development.
· Good good analytical and execution skills.
· Worked on open-source software for development, logging, monitoring, search engine, caching, etc.
http://www.banyandata.com" target="_blank">www.banyandata.com
Job Description :
We are currently building a next generation consumer tech product at the intersection of AI ML through Mobile and Commerce. The product requires building proprietary frameworks using latest technologies.
We have an urgent requirement of a Backend Developer/ Fresher/ Intern, who would become core member of our Product Team, is a great problem solver, can learn quickly, and communicate clearly.
Must Have Skill Set :
-
Efficient software development background including design patterns, data structures, test driven development
-
Individual contributor with strong analytical skills, with excellent problem solving abilities. Excellent verbal and written communication skills
-
Should be able to work under tight deadlines and stretch as and when required
-
Self starter with the ability to research solutions independently and solve problems Strong, object oriented design and coding skills, c++/Java on a Linux platform Preferably with internship experience of Product based companies Working on products with strong Knowledge of SpringBoot and REST API frameworks Strong knowledge of Data structures and Algorithms
-
Hands on expertise in Database/Datastores - MongoDB, MYSQL, Elastic Search, Redis and Kafka will be a big plus
Key Responsibility :
-
Tasks will include complete responsibility for application design, code development, testing, deployment and maintenance
-
Develop code as part of an agile team to deliver new features enhancements Design and develop REST APIs
-
Follow approved life cycle methodologies, create design documents, and perform program coding and testing Develop plans outlining steps and time tables for developing programs and communicate plans and status to management
-
Work independently or with minimal supervision and utilize knowledge, experience and judgment to accomplish well defined goals
-
You should be at ease with maintaining cloud instances on AWS and other cloud services
-
You have experience in identifying, debugging and resolving complex production issues End to End ownership of various applications and microservices
-
Architect, design, develop, deploy and operate services that serve millions of users
What You Get :
1. You work with a team of passionate folks who love design and technology 2. Immense learning and growth opportunities in small, multi functional, tightly
knit teams
3. Flexible work timings; 5 days a week
4. Accelerated learning
5. Huge Responsibility early in your career which will come handy in future
6. Ownership and independence
Qualifications :
B.Tech/ MCA in Computer Science or equivalent
About QuHu
QuHu is an audio first content platform where users can create, share & distribute their content and the discovery happens via a feed based on interest graph. We aim to build an audio ecosystem with a global presence consisting of audio-based social networks and audio communities.
At QuHu, we want to cultivate a vibrant and growing online UGC audio community and interactive audio entertainment platform where users are encouraged to create, share, discover and enjoy audio, and experience immersive and diversified entertainment features through audio. QuHu envisions a global audio ecosystem – a place where everyone can be connected through voices and across cultures.
The two pillars around which QuHu is built are:
Users - for whom we want to solve the problem of discovery basis interest (algorithmically driven feed) and provide an impressive experience through audio- bites (short content), live audio, audio rooms & audio games.
Creators - for whom we want to make creation & editing a seamless process through a suite of 'creator tools' like sound mixing, trim, pitch shifter, voicemojis, voice filters, noise reduction, etc & help them monetise
About Recko:
Recko was founded in 2017 to organise the world’s transactional information and provide intelligent applications to finance and product teams to make sense of the vast amount of data available. With the proliferation of digital transactions over the past two decades, Enterprises, Banks and Financial institutions are finding it difficult to keep a track on the money flowing across their systems. We are building products which enable them to handle and monitor massive volumes of transactional data without writing a single line of code and ensure the right amounts are flowing between the right beneficiaries, with the right deductions at the right time. Over the last few months, we have grown to a point where we are processing more than 25 million transactions monthly for our customers.
Recko is a Series A funded startup, backed by marquee investors like Vertex Ventures, Prime Venture Partners and Locus Ventures. Traditionally enterprise software is always built around functionality. We are reimagining enterprise software to be built around the user. We believe software is an extension of one’s capability, and it should be delightful and fun to use.
Working at Recko:
We believe that great companies are built by amazing people. At Recko, We are a group of young Engineers, Product Managers, Analysts and Business folks who are on a mission to bring consumer tech DNA to enterprise fintech applications. The current team at Recko is 50 members strong with stellar experience across fintech, e-commerce, digital domains at companies like Flipkart, PhonePe, Ola Money, Belong, Razorpay, Grofers, Jio, Oracle etc. We are growing aggressively across verticals.
About the Role:
What are we looking for:
1. 2+ years of experience with Java MVC frameworks like Spring / Dropwizard / Play and with
MySQL / Oracle / PostgreSQL.
2. Experience building at least one application from scratch.
3. Understanding of at least one test frameworks and basic system administration.
4. Experience with cache store / message broker like Redis / RabbitMQ / Kafka.
5. Good to have: Experience with NoSQL databases like Cassandra, MongoDb, Neo4j, ElasticSearch. etc and Understanding of different concurrency models used in Akka, node.js, Go, RxJava etc
6. Interest in learning new languages / framework as needed.
7. A growth mindset and passionate about building things from the ground up and most
importantly, you should be fun to work with.
As a backend developer at Recko, you will:
1. Design and implement microservices with high reliability and scalability.
2. Be involved and participate in the overall application lifecycle.
3. Define and communicate technical and design requirements.
4. Learn about new technologies and incorporate them.
5. Improve engineering standards, tooling, and processes.
6. Collaborate with multi-disciplinary team of designers, developers and system administrators.










