Cutshort logo
Technology service company logo
Sr. Spark Software Engineer
Technology service company
Sr. Spark Software Engineer
Jobdost's logo

Sr. Spark Software Engineer

at Technology service company

Agency job
5 - 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Ansible
skill iconGit
JIRA
Apache Spark
Spark
Apache Kafka
Microservices
skill iconKubernetes
Terraform
NOSQL Databases
API
skill iconDocker
  • Bachelor’s or master’s degree in Computer Engineering, Computer Science, Computer Applications, Mathematics, Statistics, or related technical field. Relevant experience of at least 3 years in lieu of above if from a different stream of education.

  • Well-versed in and 3+ hands-on demonstrable experience with: ▪ Stream & Batch Big Data Pipeline Processing using Apache Spark and/or Apache Flink.
    ▪ Distributed Cloud Native Computing including Server less Functions
    ▪ Relational, Object Store, Document, Graph, etc. Database Design & Implementation
    ▪ Micro services Architecture, API Modeling, Design, & Programming

  • 3+ years of hands-on development experience in Apache Spark using Scala and/or Java.

  • Ability to write executable code for Services using Spark RDD, Spark SQL, Structured Streaming, Spark MLLib, etc. with deep technical understanding of Spark Processing Framework.

  • In-depth knowledge of standard programming languages such as Scala and/or Java.

  • 3+ years of hands-on development experience in one or more libraries & frameworks such as Apache Kafka, Akka, Apache Storm, Apache Nifi, Zookeeper, Hadoop ecosystem (i.e., HDFS, YARN, MapReduce, Oozie & Hive), etc.; extra points if you can demonstrate your knowledge with working examples.

  • 3+ years of hands-on development experience in one or more Relational and NoSQL datastores such as PostgreSQL, Cassandra, HBase, MongoDB, DynamoDB, Elastic Search, Neo4J, etc.

  • Practical knowledge of distributed systems involving partitioning, bucketing, CAP theorem, replication, horizontal scaling, etc.

  • Passion for distilling large volumes of data, analyze performance, scalability, and capacity performance issues in Big Data Platforms.

  • Ability to clearly distinguish system and Spark Job performances and perform spark performance tuning and resource optimization.

  • Perform benchmarking/stress tests and document the best practices for different applications.

  • Proactively work with tenants on improving the overall performance and ensure the system is resilient, and scalable.

  • Good understanding of Virtualization & Containerization; must demonstrate experience in technologies such as Kubernetes, Istio, Docker, OpenShift, Anthos, Oracle VirtualBox, Vagrant, etc.

  • Well-versed with demonstrable working experience with API Management, API Gateway, Service Mesh, Identity & Access Management, Data Protection & Encryption.

    Hands-on experience with demonstrable working experience with DevOps tools and platforms viz., Jira, GIT, Jenkins, Code Quality & Security Plugins, Maven, Artifactory, Terraform, Ansible/Chef/Puppet, Spinnaker, etc.

  • Well-versed in AWS and/or Azure or and/or Google Cloud; must demonstrate experience in at least FIVE (5) services offered under AWS and/or Azure or and/or Google Cloud in any categories: Compute or Storage, Database, Networking & Content Delivery, Management & Governance, Analytics, Security, Identity, & Compliance (or) equivalent demonstrable Cloud Platform experience.

  • Good understanding of Storage, Networks and Storage Networking basics which will enable you to work in a Cloud environment.

  • Good understanding of Network, Data, and Application Security basics which will enable you to work in a Cloud as well as Business Applications / API services environment.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Tops Infosolutions
Zurin Momin
Posted by Zurin Momin
Ahmedabad
2 - 4 yrs
₹7L - ₹11L / yr
skill iconPython
skill iconDjango
Artificial Intelligence (AI)
Retrieval Augmented Generation (RAG)
AWS Lambda
+1 more

Job Description: Python Developer

Experience: 2+ Years

Job Location: Nr. Iskcon Mega Mall, SG Highway, Ahmedabad

Timings: 10 AM to 7 PM


Job Description:


Technical Skills :

  • Good knowledge of Python with 2+ years of minimum experience 
  • Strong understanding of various Python Libraries, APIs, and toolkits. 
  • Good experience in Django, Django REST Framework, and Flask framework.
  • Understanding of AWS Serverless implementation using Lambda and API Gateway
  • Hands-on Experience in Databases like Mysql, PostgreSQL.
  • Good experience/understanding in Agentic AI / RAG.
  • Proficient in NoSQL document databases especially MongoDB, Redis.
  • Stronghold in Data Structures and Algorithm
  • Thorough understanding of version control system concepts especially GIT.
  • Understanding of the whole web stack and how all the pieces fit together (front-end, database, network layer, etc.) and how they impact the performance of your application.
  • Excellent understanding of MVC and OOP. Bonus for the understanding of prevalent design patterns.
  • Excellent debugging and optimization skills


Job Responsibilities :

  • Building big, robust, scalable, and maintainable applications.
  • Debugging, Fixing bugs, Identifying Performance Issues, and Improving App Performance.
  • Continuously discover, evaluate, and implement new technologies to maximize development efficiency.
  • Handling complex technical issues related to web app development & discussing solutions with the team.
  • Developing, Deploying, and maintaining Multistage, Multi-tier applications.
  • To write high-performing code and will be participating in key architectural decisions.
  • Project Execution & Client Interaction
  • Scrum Implementation



Read more
Global digital transformation solutions provider
Global digital transformation solutions provider
Agency job
via Peak Hire Solutions by Dharati Thakkar
Trivandrum, Thiruvananthapuram
5 - 7 yrs
₹18L - ₹26L / yr
skill iconKotlin
skill iconJava
skill iconAmazon Web Services (AWS)
skill iconSpring Boot
Microservices
+24 more

JOB DETAILS:

* Job Title: Lead I - Software Engineering-Kotlin, Java, Spring Boot, Aws

* Industry: Global digital transformation solutions provide

* Salary: Best in Industry

* Experience: 5 -7 years

* Location: Trivandrum, Thiruvananthapuram

Role Proficiency:

Act creatively to develop applications and select appropriate technical options optimizing application development maintenance and performance by employing design patterns and reusing proven solutions account for others' developmental activities

 

Skill Examples:

  1. Explain and communicate the design / development to the customer
  2. Perform and evaluate test results against product specifications
  3. Break down complex problems into logical components
  4. Develop user interfaces business software components
  5. Use data models
  6. Estimate time and effort required for developing / debugging features / components
  7. Perform and evaluate test in the customer or target environment
  8. Make quick decisions on technical/project related challenges
  9. Manage a Team mentor and handle people related issues in team
  10.  Maintain high motivation levels and positive dynamics in the team.
  11.  Interface with other teams’ designers and other parallel practices
  12.  Set goals for self and team. Provide feedback to team members
  13.  Create and articulate impactful technical presentations
  14.  Follow high level of business etiquette in emails and other business communication
  15.  Drive conference calls with customers addressing customer questions
  16.   Proactively ask for and offer help
  17.  Ability to work under pressure determine dependencies risks facilitate planning; handling multiple tasks.
  18.  Build confidence with customers by meeting the deliverables on time with quality.
  19.  Estimate time and effort resources required for developing / debugging features / components
  20.  Make on appropriate utilization of Software / Hardware’s.
  21.  Strong analytical and problem-solving abilities

 

Knowledge Examples:

  •     Appropriate software programs / modules
  1. Functional and technical designing
  2. Programming languages – proficient in multiple skill clusters
  3. DBMS
  4. Operating Systems and software platforms
  5. Software Development Life Cycle
  6. Agile – Scrum or Kanban Methods
  7. Integrated development environment (IDE)
  8. Rapid application development (RAD)
  9. Modelling technology and languages
  10. Interface definition languages (IDL)
  11. Knowledge of customer domain and deep understanding of sub domain where problem is solved

 

Additional Comments:

We are seeking an experienced Senior Backend Engineer with strong expertise in Kotlin and Java to join our dynamic engineering team.

The ideal candidate will have a deep understanding of backend frameworks, cloud technologies, and scalable microservices architectures, with a passion for clean code, resilience, and system observability.

You will play a critical role in designing, developing, and maintaining core backend services that power our high-availability e-commerce and promotion platforms.

 

Key Responsibilities

Design, develop, and maintain backend services using Kotlin (JVM, Coroutines, Serialization) and Java.

Build robust microservices with Spring Boot and related Spring ecosystem components (Spring Cloud, Spring Security, Spring Kafka, Spring Data).

Implement efficient serialization/deserialization using Jackson and Kotlin Serialization. Develop, maintain, and execute automated tests using JUnit 5, Mockk, and ArchUnit to ensure code quality.

Work with Kafka Streams (Avro), Oracle SQL (JDBC, JPA), DynamoDB, and Redis for data storage and caching needs. Deploy and manage services in AWS environment leveraging DynamoDB, Lambdas, and IAM.

Implement CI/CD pipelines with GitLab CI to automate build, test, and deployment processes.

Containerize applications using Docker and integrate monitoring using Datadog for tracing, metrics, and dashboards.

Define and maintain infrastructure as code using Terraform for services including GitLab, Datadog, Kafka, and Optimizely.

Develop and maintain RESTful APIs with OpenAPI (Swagger) and JSON API standards.

Apply resilience patterns using Resilience4j to build fault-tolerant systems.

Adhere to architectural and design principles such as Domain-Driven Design (DDD), Object-Oriented Programming (OOP), and Contract Testing (Pact).

Collaborate with cross-functional teams in an Agile Scrum environment to deliver high-quality features.

Utilize feature flagging tools like Optimizely to enable controlled rollouts.

 

Mandatory Skills & Technologies Languages:

Kotlin (JVM, Coroutines, Serialization),

Java Frameworks: Spring Boot (Spring Cloud, Spring Security, Spring Kafka, Spring Data)

Serialization: Jackson, Kotlin Serialization

Testing: JUnit 5, Mockk, ArchUnit

Data: Kafka (Avro) Streams Oracle SQL (JDBC, JPA) DynamoDB (NoSQL) Redis (Caching)

Cloud: AWS (DynamoDB, Lambda, IAM)

CI/CD: GitLab CI Containers: Docker

Monitoring & Observability: Datadog (Tracing, Metrics, Dashboards, Monitors)

Infrastructure as Code: Terraform (GitLab, Datadog, Kafka, Optimizely)

API: OpenAPI (Swagger), REST API, JSON API

Resilience: Resilience4j

Architecture & Practices: Domain-Driven Design (DDD) Object-Oriented Programming (OOP) Contract Testing (Pact) Feature Flags (Optimizely)

Platforms: E-Commerce Platform (CommerceTools), Promotion Engine (Talon.One)

Methodologies: Scrum, Agile

 

Skills: Kotlin, Java, Spring Boot, Aws

 

Must-Haves

Kotlin (JVM, Coroutines, Serialization), Java, Spring Boot (Spring Cloud, Spring Security, Spring Kafka, Spring Data), AWS (DynamoDB, Lambda, IAM), Microservices Architecture

 

 

******

Notice period - 0 to 15 days only

Job stability is mandatory

Location: Trivandrum

Virtual Weekend Interview on 7th Feb 2026 - Saturday

Read more
Logistics & Supply Chain Network Platform
Logistics & Supply Chain Network Platform
Agency job
via Jobdost by Sathish Kumar
Bengaluru (Bangalore)
2 - 4 yrs
₹10L - ₹14L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
  • Strong knowhow of data-structures and algorithms.
  • Strong core server-side technologies experience (Java/ other)
  • Knowledge of Android is a huge plus.
  • Strong understanding of OO/ design and good software development practices.
  • Strong database skills and good knowhow of databases.
  • Exposure to configuration management, testing, deployment.
  • Hands on development across technologies
Read more
Gipfel & Schnell Consultings Pvt Ltd
Aravind Kumar
Posted by Aravind Kumar
Bengaluru (Bangalore)
2 - 12 yrs
Best in industry
skill iconNodeJS (Node.js)
skill iconMongoDB
Mongoose
skill iconExpress
skill iconJavascript
+7 more
  • Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent experience)
  • Proven 2 to 12 years of professional experience in Node.js development
  • Strong proficiency in JavaScript, including ES6+ syntax
  • Expertise in designing and developing RESTful APIs and microservices architecture
  • Experience with popular Node.js frameworks such as Express.js, Nest.js, or Hapi.js
  • Experience in modern front-end technologies (e.g., HTML, CSS, JavaScript frameworks like React, Angular, or Vue.js)
  • Solid understanding of asynchronous programming, event-driven architecture, and design patterns
  • Extensive knowledge of database systems, both SQL and NoSQL (e.g., MongoDB, PostgreSQL, MySQL)
  • Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform
  • Familiarity with containerization technologies (e.g., Docker, Kubernetes)


Read more
UK based MNC
Remote only
5 - 7 yrs
₹6L - ₹9L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)

We are seeking an experienced Senior Java Developer specializing in Spring Boot and Apache Camel to join our team. This individual will be responsible for designing, developing, and implementing robust, scalable, and high-performance applications. You will work on complex projects and integrations, leveraging Spring Boot and Apache Camel to streamline business processes and message routing.


Key Requirements:

  • 5+ years of experience in Java Development, specifically with Spring Boot.
  • Proven experience in using Apache Camel for integrating distributed systems.
  • Solid understanding of microservices architecture and RESTful API development.
  • Proficiency in Java-based middleware technologies.
  • Strong knowledge of message queues (e.g., RabbitMQ, ActiveMQ, Kafka) and their integration with Apache Camel.
  • Experience with cloud services such as AWS, Azure, or GCP is a plus.
  • Familiarity with CI/CD pipelines and automated deployment processes.
  • Experience with Agile development methodologies.
  • Strong problem-solving skills and attention to detail.
  • Excellent communication skills, both written and verbal.


Bonus Skills:

  • Experience with Docker and Kubernetes for containerization and orchestration.
  • Knowledge of Apache Kafka for event streaming.
  • Experience with modern development tools like Git, Jenkins, and JIRA.


What We Offer:

  • A dynamic and collaborative work environment.
  • Opportunities for career advancement and skill development.
  • Flexible working hours and the ability to work remotely.
  • Competitive salary and benefits.



Read more
Recro
at Recro
1 video
32 recruiters
Mounashree JP
Posted by Mounashree JP
Bengaluru (Bangalore)
2 - 3 yrs
Best in industry
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Microservices

Required Skills:


  • 3+ year of experience in Development in JAVA technology.
  • Strong Java Basics
  • SpringBoot or Spring MVC
  • Hands on experience on Relational Databases (SQL query or Hibernate) + Mongo (JSON parsing)
  • Proficient in REST API development
  • Messaging Queue (RabitMQ or Kafka)
  • Microservices
  • Any Caching Mechanism
  • Good at problem solving


Good to Have Skills:


  • 4+ years of experience in using Java/J2EE tech stacks
  • Good understanding of data structures and algorithms.
  • Excellent analytical and problem solving skills.
  • Ability to work in a fast paced internet start-up environment.
  • Experience in technical mentorship/coaching is highly desirable.
  • Understanding of AI/ML algorithms is a plus.


Read more
Recro
at Recro
1 video
32 recruiters
Simran Gupta
Posted by Simran Gupta
Bengaluru (Bangalore)
2 - 6 yrs
Best in industry
skill iconNodeJS (Node.js)
skill iconMongoDB
Mongoose
API
SQL
+2 more
  • Rewrite existing APIs in NodeJS. 
  • Remodel the APIs into Micro services-based architecture. 
  • Implement a caching layer wherever possible. 
  • Optimize the API for high performance and scalability. 
  • Write unit tests for API Testing.
  • Automate the code testing and deployment process.


Skills Required: 

  • At least 2 years of experience developing Backends using NodeJS — should be well versed with its asynchronous nature & event loop, and know its quirks and workarounds. 
  • Excellent hands-on experience using MySQL or any other SQL Database. 
  • Good knowledge of MongoDB or any other NoSQL Database. 
  • Good knowledge in postgre
  • Good knowledge of Redis, its data types, and their use cases. 
  • Experience with graph-based databases like GraphQL and Neo4j. 
  • Experience developing and deploying REST APIs. 
  • Good knowledge of Unit Testing and available Test Frameworks. 
  • Good understanding of advanced JS libraries and frameworks. 
  • Experience with Web sockets, Service Workers, and Web Push Notifications. 
  • Familiar with NodeJS profiling tools. 
  • Proficient understanding of code versioning tools such as Git. 
  • Good knowledge of creating and maintaining DevOps infrastructure on cloud platforms. 
  • Should be a fast learner and a go-getter — without any fear of trying out new things Preferences. 
  • Experience building a large scale social or location-based app
Read more
Hiring for our product base client for Bangalore
Hiring for our product base client for Bangalore
Agency job
via Natalie Consultants by Rahul Kumar
Bengaluru (Bangalore)
6 - 12 yrs
₹25L - ₹46L / yr
skill iconJava
Hibernate (Java)
skill iconSpring Boot
J2EE
Microservices

Location: Bangalore

Function: Software Engineering → Backend Development

Requirements:

  • 4 + years of experience in Java, Spring, Hibernate, Springboot/microservices
  • Good understanding and practical experience in Spring framework ( Spring boot,JPA,MVC)
  • Extensively worked on microservices based design architecture
  • Strong command on Data Structures, algorithms & Problem Solving
  • Very strong on Oops Java Basic,
  • Good on Multithreading Concepts
  • Should have good exposure on Messaging platform (Kafka,JMS, AMQ etc,)

About Bigbasket.com

At bigbasket.com we believe in being smart, quick and efficient, making your life as leisurely as possible. We understand that in this fast-paced world, time is always of the essence and hence want to make your grocery shopping easy and convenient so that no time is wasted in this process. So, no more hassle of going down to the grocery store and long queues for billing etc. You can browse through our varied range of products at bigbasket.com, order them and get them to be delivered at your own convenient time slot.

 

We specially hand pick each and every product for you, putting it through a safety packaging process and finding your home, no matter how bad the wind is or how cold the weather is. Our ''No questions asked refund' and ''10% off for a delayed delivery'' policy makes us a customer friendly online food and grocery store. Just follow three simple steps and get your order delivered - simply Browse, Add to cart & Choose delivery slot!

Why Explore a Career at Bigbasket.com

Bigbasket engineering thrives on out of the box thinking and relentless pursuit of excellence. We are looking for senior developers who share our passion for building world class software. If you are excited about the prospect of changing the way India shops for groceries and being a pioneer -- then this a great home for you. Not to mention the thrill of building products that millions use on a daily basis and using cutting edge technology to make the products customers love.

 

While we are techies at heart -- we don't use technology for the sake of technology, but pride ourselves in solving customer problems in the most efficient and elegant ways. Do the customers really care about efficient implementation of Levenshtein Distance? Well no. But they really appreciate when their typos are pardoned and don't get in the way. Similarly customers don't give a damn that robots efficiently segregate their packets, but they do care about their orders delivered in a timely way.

 

If you enjoy Coding, Testing and love solving business problems, then we'd like to meet you.

Read more
Freestone Infotech Pvt. Ltd.
at Freestone Infotech Pvt. Ltd.
1 video
7 recruiters
Riddhi S
Posted by Riddhi S
Remote, Mumbai, Pune
4 - 10 yrs
₹8L - ₹25L / yr
skill iconJava
Algorithms
Design patterns
Object Oriented Programming (OOPs)
Analytical Skills
+5 more

Opportunity to work with a Silicon Valley based security and governance start-up.


About Privacera

Privacera, Inc is a California based start-up company that is looking for Senior Software Engineers to work out of our Mumbai/Pune based office. Privacera is a cloud-based product which uses Cloud native services in AWS, Azure and GCP. Privacera is a fast-growing start-up and provides ample opportunity work on all Cloud services like AWS S3, DynamoDB, Kinesis, RedShift, EMR, Azure ADLS, HDInsight, GCP GCS, GCP PubSub and other services.



We are looking for motivated individuals who are keen to work on Cloud or Big Data services or have worked on Cloud and Big Data. If you want to work in a start-up culture and are ready for the challenge, then join us on our exciting journey.

Responsibilities:

  • Design, code and debug cloud-native applications.
  • Evaluate and identify new technologies for implementation
  • Determine operational feasibility by evaluating analysis, problem definition, requirements, solution development and proposed solutions
  • Write well designed, testable, efficient code
  • Develop software verification plans and quality assurance procedures
  • Serve as a subject matter expert

Requirements:
  • 5+ years of relevant experience in software development

  • Deep understanding of public cloud infrastructure (AWS, Azure or Google)

  • Experience with large scale distributed systems

  • Ability to troubleshoot distributed systems

  • Prior experience with data encryption, TLS/SSL is a strong plus

  • Experience with Docker and Kubernetes is a plus

  • Deep experience with Java

  • Excellent communication (writing, conversation, presentation) skills, consensus building, Quick learner
    Good to have experience in Production support - Tier 4

    Experience with these technologies are a plus: AWS, Microsoft Azure, Google Cloud, Cloudera, Snowflake, Mongo DB, Oracle, Databricks, Datastax, Confluent

Read more
Infinitum Global
at Infinitum Global
7 recruiters
Shubashri J
Posted by Shubashri J
Bengaluru (Bangalore)
4 - 10 yrs
₹7L - ₹15L / yr
skill iconJava
J2EE
AWS Simple Notification Service (SNS)
RESTful APIs
Agile/Scrum
+1 more
Full stack developer with Excellent Technical knowledge and Hands on with • Java(IntelliJ , Tomcat, apache), J2EE (Spring and Hibernate) , OOPS, AngularJS, CSS , HTML5, SQL Join & Aggregation Queries, Stored Procedures. • Agile methodology (Scrum) with Visual Studio source control • REST APIs, MySql, AWS • 5-8 years of experience Note: You will be on permanent of “Infinitum Global” and work in client Location at Wipro, Bangalore This will be C2H, After 4 to 6 months you will be permanent with Wipro
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos