NoSQL DBA at codersbrain · Kolkata, Mumbai, Gurugram · 5 - 22 years · ₹10L - ₹16L / yr · Bootstrapped · Posted 4 Jan 2025
A) Skills Required
Essential Skills (Two top
skills)
3 possible combinations.
1. Candidate having expertise in both ElasticSearch and Kafka, preferably.
OR
2. Candidate having expertise in ElasticSearch and willing to learn Kafka.
OR
3. Candidate having expertise in Kafka and willing to learn ElasticSearch.
B) Other Information
Educational Qualifications Graduate
Experience Mid-Level (6+ years)
Minimum Qualifications:
ElasticSearch/OpenSearch
· Software Lifecycle/programing skills
· Linux
· Python
· Ingestion tools (logstash, OpenSearch Ingestion, Fluentd, fluentbit, Harness,
CloudFormation, container, images, ECS, lambda).
· SQL query
· Json
· AWS knowledge
Kafka/MSK
· Linux
· In-depth understanding of Kafka broker configurations, zookeepers, and
connectors
· Understand Kafka topic design and creation.
· Good knowledge in replication and high availability for Kafka system
· Good understanding of producers and consumer group
· Understanding Kafka partitions and scaling up
· Kafka latency/lag and throughput
· Integrating Kafka connect with various data sources can be internal or external.
· Kafka security using SSL/Certs

About codersbrain
About
Connect with the team
Similar jobs (10)
1st virtual , 2nd round F2F
Python pyspark, SQL, data engineer
5+yrs
Bang/hyderabad
immediate to 15days.
1st virtual , 2nd round F2F -
Python pyspark, SQL, data engineer
5+yrs
Bang/hyderabad
immediate to 15days.

SDE3 – Data Platform Engineer
Experience: 5–10 Years
Employment Type: Contract-to-Hire (3 Months)
Location: Remote initially | Pune after conversion
About the Role
We are looking for an experienced SDE3 – Data Platform Engineer with strong backend development and data engineering expertise.
The ideal candidate should have excellent programming skills in Java (preferred), Golang, or Python, along with hands-on experience building scalable data platforms, distributed systems, and data pipelines.
Key Responsibilities
- Design and develop scalable backend and data platform solutions.
- Build and optimize ETL/ELT pipelines and data ingestion systems.
- Develop APIs and backend services for data infrastructure.
- Work with Kafka, Spark, Airflow, BigQuery, and Redshift.
- Handle large-scale data processing and distributed systems.
- Optimize application performance, scalability, and reliability.
- Collaborate with engineering teams to deliver production-grade solutions.
Required Skills
- Strong programming in Java, Golang, or Python (Java preferred).
- Backend development and API development.
- Data pipelines, ETL/ELT, and data ingestion.
- Strong SQL and data modeling.
- Kafka, Spark, Airflow, BigQuery, or Redshift.
- Distributed systems and system design.
- Docker, Kubernetes, and CI/CD fundamentals.
Ideal Candidate
- Strong Backend + Data Engineering background.
- Experience building scalable data platforms.
- Excellent coding and problem-solving skills.
- Experience handling high-volume data processing.
Note: Pure Data Engineers, BI/Analytics professionals, and candidates with only SQL reporting or basic ETL experience are not suitable.
Work Arrangement
- Initial 3-month contractual period – Remote.
- Conversion based on performance.
- Post-conversion – 5 days WFO from Pune.
🚨 HIRING | Data Engineer – Amazon EMR 🔥
We are looking for experienced Data Engineers with strong hands-on expertise in Amazon EMR, Python, and Scala.
📌 JOB DETAILS:
💼 Experience: 6+ Years
💰 CTC: Up to 30 LPA
📍 Location: Bangalore
🔑 MANDATORY SKILLS:
• Amazon EMR
• Python
• Scala
• Data Engineering
📋 KEY REQUIREMENTS:
• 6+ years of relevant experience in Data Engineering.
• Strong hands-on experience with Amazon EMR.
• Strong programming skills in Python and Scala.
• Experience with large-scale data processing and data engineering solutions.
• Strong problem-solving and communication skills.
📩 Interested candidates can share their updated resumes:
📧 pavithra.e @vysystems. com
📞 8 9 2 5 8 0 2 4 5 7
🔄 Know someone who would be a good fit? Tag them or share this post!
#Hiring #DataEngineer #DataEngineering #AmazonEMR #Python #Scala #AWSJobs #BangaloreJobs #ITJobs #TechHiring #HiringNow
role: data engineer
Python pyspark, SQL, data engineer
5+yrs
Bangalore/Hyderabad
immediate to 15days.
1st virtual , 2nd round F2F
Python pyspark, SQL, data engineer
5+yrs
9+yrs
Bangalore/Hyderabad
immediate to 15days.
We are hiring experienced Data Engineers for a permanent opportunity in Bangalore.
Job Description
Role: Data Engineer
Location: Bangalore
Experience: 6+ Years
Key Responsibilities:
- Design, develop, and maintain scalable data processing pipelines using Amazon EMR.
- Develop data engineering solutions using Python and Scala.
- Process and transform large volumes of structured and unstructured data.
- Build and optimize distributed data processing workflows for performance and scalability.
- Work with big data technologies and cloud-based data processing environments.
- Perform data integration, validation, transformation, and quality checks.
- Troubleshoot data pipeline issues and optimize processing performance.
- Collaborate with data architects, analysts, and development teams to deliver reliable data solutions.
Required Skills:
- Strong hands-on experience with Amazon EMR.
- Proficiency in Python and Scala.
- Experience in big data processing and data pipeline development.
- Good understanding of distributed computing and data transformation techniques.
- Experience in performance tuning and troubleshooting data processing jobs.
- Strong analytical, problem-solving, and communication skills.
Strong Data Engineer (AWS) Profile
2
Mandatory (Experience 1) – Must have minimum 6+ years of experience in Data Engineering, with strong experience designing, developing, and maintaining scalable data pipelines and ETL processes.
3
Mandatory (Experience 2) – Must have 3+ years of hands-on experience with AWS data engineering services, particularly S3, AWS Glue, EMR, Lambda, and Redshift.
4
Mandatory (Experience 3) – Must have strong programming experience in Python, Java, or Scala, with hands-on development of data processing and pipeline solutions.
5
Mandatory (Experience 4) – Must have strong expertise in SQL, data warehousing, and database technologies, including experience with both SQL and NoSQL databases.
6
Mandatory (Experience 5) – Must have hands-on experience working with Big Data technologies and distributed data processing, including designing and optimizing large-scale data pipelines.
7
Mandatory (Experience 6) – Must have experience with data pipeline troubleshooting, monitoring, data quality, governance, and security best practices.
8
Mandatory (Education) – B.Tech / B.E./ M.Tech

We are hiring for a Data Engineer & Java scala for a full-time opportunity in Bangalore.
Experience: 4–10 Years
Must-Have Skills:
Java / Scala / Python, Data Engineering, Databricks / Snowflake, and Cloud (AWS / Azure / GCP).
We are looking for strong software engineers with hands-on experience in data platform development, scalable backend programming, data integration, and cloud technologies.
Experience in Banking, Capital Markets, Market Risk, or Regulatory Reporting will be an added advantage.
Strong Data Engineer (AWS) Profile
2
Mandatory (Experience 1) – Must have minimum 6+ years of experience in Data Engineering, with strong experience designing, developing, and maintaining scalable data pipelines and ETL processes.
3
Mandatory (Experience 2) – Must have 3+ years of hands-on experience with AWS data engineering services, particularly S3, AWS Glue, EMR, Lambda, and Redshift.
4
Mandatory (Experience 3) – Must have strong programming experience in Python, Java, or Scala, with hands-on development of data processing and pipeline solutions.
5
Mandatory (Experience 4) – Must have strong expertise in SQL, data warehousing, and database technologies, including experience with both SQL and NoSQL databases.
6
Mandatory (Experience 5) – Must have hands-on experience working with Big Data technologies and distributed data processing, including designing and optimizing large-scale data pipelines.
7
Mandatory (Experience 6) – Must have experience with data pipeline troubleshooting, monitoring, data quality, governance, and security best practices.
8
Mandatory (Education) – B.Tech / B.E./ M.Tech






