Cutshort logo
Technology service company logo
Sr. Spark Software Engineer
Technology service company
Sr. Spark Software Engineer
Jobdost's logo

Sr. Spark Software Engineer

at Technology service company

Agency job
5 - 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Ansible
skill iconGit
JIRA
Apache Spark
Spark
Apache Kafka
Microservices
skill iconKubernetes
Terraform
NOSQL Databases
API
skill iconDocker
  • Bachelor’s or master’s degree in Computer Engineering, Computer Science, Computer Applications, Mathematics, Statistics, or related technical field. Relevant experience of at least 3 years in lieu of above if from a different stream of education.

  • Well-versed in and 3+ hands-on demonstrable experience with: ▪ Stream & Batch Big Data Pipeline Processing using Apache Spark and/or Apache Flink.
    ▪ Distributed Cloud Native Computing including Server less Functions
    ▪ Relational, Object Store, Document, Graph, etc. Database Design & Implementation
    ▪ Micro services Architecture, API Modeling, Design, & Programming

  • 3+ years of hands-on development experience in Apache Spark using Scala and/or Java.

  • Ability to write executable code for Services using Spark RDD, Spark SQL, Structured Streaming, Spark MLLib, etc. with deep technical understanding of Spark Processing Framework.

  • In-depth knowledge of standard programming languages such as Scala and/or Java.

  • 3+ years of hands-on development experience in one or more libraries & frameworks such as Apache Kafka, Akka, Apache Storm, Apache Nifi, Zookeeper, Hadoop ecosystem (i.e., HDFS, YARN, MapReduce, Oozie & Hive), etc.; extra points if you can demonstrate your knowledge with working examples.

  • 3+ years of hands-on development experience in one or more Relational and NoSQL datastores such as PostgreSQL, Cassandra, HBase, MongoDB, DynamoDB, Elastic Search, Neo4J, etc.

  • Practical knowledge of distributed systems involving partitioning, bucketing, CAP theorem, replication, horizontal scaling, etc.

  • Passion for distilling large volumes of data, analyze performance, scalability, and capacity performance issues in Big Data Platforms.

  • Ability to clearly distinguish system and Spark Job performances and perform spark performance tuning and resource optimization.

  • Perform benchmarking/stress tests and document the best practices for different applications.

  • Proactively work with tenants on improving the overall performance and ensure the system is resilient, and scalable.

  • Good understanding of Virtualization & Containerization; must demonstrate experience in technologies such as Kubernetes, Istio, Docker, OpenShift, Anthos, Oracle VirtualBox, Vagrant, etc.

  • Well-versed with demonstrable working experience with API Management, API Gateway, Service Mesh, Identity & Access Management, Data Protection & Encryption.

    Hands-on experience with demonstrable working experience with DevOps tools and platforms viz., Jira, GIT, Jenkins, Code Quality & Security Plugins, Maven, Artifactory, Terraform, Ansible/Chef/Puppet, Spinnaker, etc.

  • Well-versed in AWS and/or Azure or and/or Google Cloud; must demonstrate experience in at least FIVE (5) services offered under AWS and/or Azure or and/or Google Cloud in any categories: Compute or Storage, Database, Networking & Content Delivery, Management & Governance, Analytics, Security, Identity, & Compliance (or) equivalent demonstrable Cloud Platform experience.

  • Good understanding of Storage, Networks and Storage Networking basics which will enable you to work in a Cloud environment.

  • Good understanding of Network, Data, and Application Security basics which will enable you to work in a Cloud as well as Business Applications / API services environment.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

NeoGenCode Technologies Pvt Ltd
Remote, Bengaluru (Bangalore), Mumbai, Gurugram, Pune, Hyderabad, Chennai, Coimbatore
5 - 12 yrs
₹15L - ₹35L / yr
Temporal.io
skill iconNodeJS (Node.js)
skill iconJava
skill iconReact.js
keycloak
+7 more

Job Title : Senior Consultant (Java / NodeJS + Temporal)

Experience : 5 to 12 Years

Location : Bengaluru, Chennai, Hyderabad, Pune, Mumbai, Gurugram, Coimbatore

Work Mode : Remote (Must be open to travel for occasional team meetups)

Notice Period : Immediate Joiners or Serving Notice

Interview Process :

  • R1 : Tech Interview (60 mins)
  • R2 : Technical Interview
  • R3 : (Optional) Interview with Client

Job Summary :

We are seeking a Senior Backend Consultant with strong hands-on expertise in Temporal (BPM/Workflow Engine) and either Node.js or Java.

The ideal candidate will have experience in designing and developing microservices and process-driven applications, as well as orchestrating complex workflows using Temporal.io.

You will work on high-scale systems, collaborating closely with cross-functional teams.


Mandatory Skills :

Temporal.io, Node.js (or Java), React.js, Keycloak IAM, PostgreSQL, Terraform, Kubernetes, Azure, Jest, OpenAPI


Key Responsibilities :

  • Design and implement scalable backend services using Node.js or Java.
  • Build and manage complex workflow orchestrations using Temporal.io.
  • Integrate with IAM solutions like Keycloak for role-based access control.
  • Work with React (v17+), TypeScript, and component-driven frontend design.
  • Use PostgreSQL for structured data persistence and optimized queries.
  • Manage infrastructure using Terraform and orchestrate via Kubernetes.
  • Leverage Azure Services like Blob Storage, API Gateway, and AKS.
  • Write and maintain API documentation using Swagger/Postman/Insomnia.
  • Conduct unit and integration testing using Jest.
  • Participate in code reviews and contribute to architectural decisions.

Must-Have Skills :

  • Temporal.io – BPMN modeling, external task workers, Operate, Tasklist
  • Node.js + TypeScript (preferred) or strong Java experience
  • React.js (v17+) and component-driven UI development
  • Keycloak IAM, PostgreSQL, and modern API design
  • Infrastructure automation with Terraform, Kubernetes
  • Experience in using GitFlow, OpenAPI, Jest for testing

Nice-to-Have Skills :

  • Blockchain integration experience for secure KYC/identity flows
  • Custom Camunda Connectors or exporter plugin development
  • CI/CD experience using Azure DevOps or GitHub Actions
  • Identity-based task completion authorization enforcement
Read more
Wissen Technology
at Wissen Technology
4 recruiters
Shivangi Bhattacharyya
Posted by Shivangi Bhattacharyya
Bengaluru (Bangalore)
5 - 8 yrs
₹5L - ₹25L / yr
skill iconJava
skill iconPython
skill iconSpring Boot
Microservices

JOB DESCRIPTION-


Exp - 5 to 8yrs 



Job Summary


We are looking for a highly skilled and motivated Senior Software Engineer with strong expertise in Java (primary) and working knowledge of Python. The ideal candidate will be responsible for designing, developing, and maintaining scalable backend systems, while contributing to high-quality software delivery across the full development lifecycle.

 

Key Responsibilities

  • Design, develop, and maintain robust, scalable, and high-performance applications using Java (Spring Boot / Microservices architecture)
  • Develop reusable components and APIs with a focus on performance, security, and scalability
  • Leverage Python for automation, scripting, data processing, or ML-related use cases (as applicable)
  • Collaborate with cross-functional teams including Product, QA, DevOps, and Architecture
  • Participate in system design discussions and contribute to technical decision-making
  • Write clean, efficient, and well-documented code following coding standards and best practices
  • Optimize applications for maximum speed and scalability
  • Troubleshoot and debug complex production issues
  • Contribute to CI/CD pipelines and DevOps practices
  • Mentor junior engineers and perform code reviews

 

Required Skills & Qualifications

Technical Skills

  • Strong hands-on experience in Core Java, Spring Boot, and Microservices architecture
  • Solid understanding of RESTful APIs, multithreading, concurrency, and JVM performance tuning
  • Practical experience with Python (automation, scripting, or backend development)
  • Experience with databases: SQL (MySQL, PostgreSQL) and/or NoSQL (MongoDB, Cassandra)
  • Familiarity with cloud platforms (AWS, Azure, or GCP)
  • Strong knowledge of data structures, algorithms, and system design
  • Experience with message brokers (Kafka, RabbitMQ)
  • Exposure to containerization & orchestration (Docker, Kubernetes)
  • Experience with version control systems (Git)

 

Preferred Skills

  • Experience in distributed systems and event-driven architectures
  • Knowledge of Python frameworks (Flask, FastAPI, Django)
  • Exposure to big data technologies (Spark, Hadoop) or ML workflows
  • Experience with CI/CD tools (Jenkins, GitHub Actions, etc.)
  • Familiarity with observability tools (Prometheus, Grafana, ELK stack)

 

Soft Skills

  • Strong problem-solving and analytical skills
  • Excellent communication and collaboration abilities
  • Ability to work in a fast-paced agile environment
  • Proactive ownership and accountability


Read more
company logo
Agency job
via Recro by Mohit Arora
Bengaluru (Bangalore), Delhi, Gurugram, Noida
3 - 7 yrs
Best in industry
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Spring MVC
+4 more

Required Education:


B.Tech./ BE - Computer, IT, Electronics only

Required Skills:


  • 2+ year of experience in Development in JAVA technology.
  • Strong Java Basics
  • SpringBoot or Spring MVC
  • Hands on experience on Relationl Databases (SQL query or Hibernate) + Mongo (JSON parsing)
  • Proficient in REST API development
  • Messaging Queue (RabitMQ or Kafka)
  • Microservices
  • Any Caching Mechanism
  • Good at problem solving


Good to Have Skills:


  • 4+ years of experience in using Java/J2EE tech stacks
  • Good understanding of data structures and algorithms.
  • Excellent analytical and problem solving skills.
  • Ability to work in a fast paced internet start-up environment.
  • Experience in technical mentorship/coaching is highly desirable.
  • Understanding of AI/ML algorithms is a plus


Read more
Global Cloud Messaging Leader
Global Cloud Messaging Leader
Agency job
via Unnati by Veena Salian
Remote
4 - 7 yrs
₹20L - ₹30L / yr
skill iconJava
Apache Kafka
skill iconRedis
Object Oriented Programming (OOPs)
Data Structures
+2 more
Be a part of one of the best IT companies that is making it easier for businesses and customers to interact with each other, efficiently and economically too.
 
Our client is a global platform that provides exceptional customer engagement through chatbots and various channels for their business clients. They have made their presence known across verticals, small and large businesses and even in emerging markets. The objective of their messaging platform is to create a rich experience for the marketing, sales and support teams using messaging channels, device manufacturers and operators.
 
They are currently working with nearly 40 thousand brands, serving almost 6 billion messages per month. Their clientele includes well-known giants such as HDFC Bank, Twitter, FB, Whatsapp, Google, LinkedIn, Zomato, Citibank, Vogue and many more. With offices based in the USA, Brazil, Mexico and India, their team has become an integral part of their clients’ numerous customer success stories.
 
As a Sr Software Engineer (Java), you will work with an innovative team and be passionate about delivering quality products and results.
 
What you will do:
  • Collaborating with the product team to understand the requirement
  • Managing Design and development of the product
  • Ensuring code quality, security and extensibility
  • Following the agile development cycles
  • Conducting performance tests and optimization of the code based on the results.
  • Debugging and troubleshooting of technical issues
  • Helping the support team to resolve external user issues

 

Desired Candidate Profile

What you need to have:
  • B.Tech /B.E.; M.Tech; MCA
  • Strong at OOPS, Java/ J2EE, JAX-RS, JDBC, RESTful Web Services, Data Structures, Queues, Multi-Threading etc.
  • MySQL and Mongo database knowledge
  • Basic understanding of AWS Cloud
  • Must have worked on highly scalable and available systems
  • Good at adapting and understanding architecture and overall design of the system
  • Exposure to design patterns is a plus
  • Must have exposure to agile development
  • Experience of creating and maintaining system documentation such as architecture, design, deployment plan etc.
  • The candidate must have excellent technical skills and must be willing to learn
  • new technologies on the go.
  • Good at communication
  • Good Exposure to Kafka and Redis

 

Read more
Lincode Labs India Pvt Ltd
at Lincode Labs India Pvt Ltd
1 video
4 recruiters
Malika Singh
Posted by Malika Singh
Bengaluru (Bangalore)
1 - 6 yrs
₹4L - ₹10L / yr
skill iconGo Programming (Golang)
skill iconRuby on Rails (ROR)
skill iconRuby
skill iconPython
skill iconJava
+7 more

Roles and Responsibilities

  • Develop data analysis and processing engines using Python
  • Develop server-side applications
  • Develop and deploy applications on AWS
  • Individually manage multiple projects with end-to-end oversight
  • Undertake POCs on new tech stacks and integrate them in applications on a functional level
  • Design small and large applications on an enterprise level
  • Understand business requirements and translate them into applications
  • Plan projects with complete details such as efforts, timelines, and wireframes
  • Work under tight timelines
  • Assist in project management of micro-innovation projects
  • Create tools, templates, SOPs / training manuals, process documents etc
  • Work with cross-functional / domain teams
  • Work in a fast-paced and agile development environment

 

Desired Candidate Profile

  • 3+ years of relevant experience with Object Oriented Programming.
  • Expertise in Web frameworks: Django, Flask.
  • Should have working knowledge in Programming: Python Advanced.
  • Hands on knowledge on Source Control: GIT.
  • And RESTFul Services.
  • Strong knowledge of MVC / MVT framework, Apache Web Server/IIS/nginx, Docker, etc
  • Proficiency in writing Web APIs / Rest APIs
  • Ability to develop client server architecture applications
  • Excellent understanding of relational databases such MySQL, MS SQL, and NoSQL(Mongodb)
  • Strong understanding of how to connect a database with a chosen back-end language, with adequate grip over architecture
  • Understanding of security-related concepts / within a server-side application
  • Adequate knowledge on SDLC
Read more
STREETMARK Info Solutions
Agency job
via STREETMARK Info Solutions by Mohan Guttula
Hyderabad
4 - 7 yrs
₹5L - ₹12L / yr
Spring
Hibernate (Java)
skill iconJava
J2EE
Struts
+1 more
 
Greetings.....!!!
 
We have a job opportunity for "Java Developer" with one of our esteemed product development organization             
Job description :

Role : 
Java Fullstack Developer
  • 3 - 8 yrs of IT Industry experience in Backend Development,
  • Minimum 3 Yrs of Hands-on experience on Java,Spring, Hibernate,
  • Communication should be good and decent.
 
Read more
Eco transport solution Private Limited
Lejitha Nair
Posted by Lejitha Nair
Gandhinagar
2 - 5 yrs
₹5.5L - ₹7L / yr
skill iconJava
J2EE
Spring
Hibernate (Java)
skill iconSpring Boot
Company: ECO TRANSPORT SOLUTION PVT LTD
Location: Sargasan, Gandhinagar
Experience – 3 to 5 years
Education –ME, BE in computer science , BCA & MCA
Salary Budget – Based on experience and interview ( normally 10% to 15% hike in current salary )

Job Description
We are looking for an analytical, results-driven Back-end Developer who will work with team members to troubleshoot and improve current back-end applications and processes. The Back-end Developer will use his or her understanding of programming languages and tools to analyze current codes and industry developments, formulate more efficient processes, solve problems, and create a more seamless experience for users. You should have excellent communication, computer, and project management skills.
To succeed as a Backend Developer, you should be focused on building a better, more efficient program and creating a better end-user experience. You should be knowledgeable, collaborative, and motivated.
Back-end Developer Responsibilities:
Compile and analyze data, processes, and codes to troubleshoot problems and identify areas for improvement.
Collaborating with the front-end developers and other team members to establish objectives and design more functional, cohesive codes to enhance the user experience.
Developing ideas for new programs, products, or features by monitoring industry developments and trends.
Recording data and reporting it to proper parties, such as clients or leadership.
Participating in continuing education and training to remain current on best practices, learn new programming languages, and better assist other team members.
Taking lead on projects, as needed.
Implement complex business application using Java (Spring Boot)
Build REST APIs that serve our frontend apps as well as other clients
Create scalable and distributed microservices
Rearchitect existing applications to move to a future-proof architecture
Streamline automated deployment and DevOps flow
Deploy on AWS

Back-end Developer Requirements:
Bachelor’s degree in computer programming, computer science, or a related field.
Design & development of J2EE applications using Java EE, Spring, hibernate & Linux
Should have exposure to multithreading and Concurrent Programming.
Extensive experience in application development using Java (Spring Boot and Spring REST)
Exposure to a microservices architecture
Exposure to RabbitMQ or Kafka is highly desirable
Experience in Hibernate or equivalent ORM Framework
Experience with CICD using Gitlab or AWS CodePipeline or AWS CodeDeploy
Familiarity with NoSQL Databases like MongoDB or Cassandra
Exposure to AWS is highly desirable
Exposure to Kubernetes is highly desirable
Strong understanding of the web development cycle and programming techniques and tools.
Focus on efficiency, user experience, and process improvement.
Excellent project and time management skills.
Strong problem solving and verbal and written communication skills.
Ability to work independently or with a group.
Willingness to sit at desk for extended periods.
Read more
Abhinav IT Solutions
at Abhinav IT Solutions
1 recruiter
Abhinav Bhutada
Posted by Abhinav Bhutada
Pune
2 - 4 yrs
₹1L - ₹2L / yr
skill iconJava
J2EE
Struts
Spring
Hibernate (Java)
+1 more
Technical & Professional requirements: 2-5 years Location: Kothrud, Pune. Responsibilites: Understand Architecture Requirements and ensure effective Design, Development, Validation and Support activities., • Good understanding of the technology and domain., • Ability to lead a team towards a desired goal., • Ensure continual knowledge management., • Adherence to the organizational guidelines and processes.
Read more
Aakash Edutech
at Aakash Edutech
1 recruiter
Sunil Yadav
Posted by Sunil Yadav
NCR (Delhi | Gurgaon | Noida)
2 - 6 yrs
₹8L - ₹17L / yr
skill iconJava
J2EE
skill iconSpring Boot
SQL
skill iconAmazon Web Services (AWS)

You’ll spend time on the following

Developing high-volume, low-latency applications for mission-critical systems and delivering high-availability and performance.

Write maintainable/scalable/efficient code.

Contributing in all phases of the development lifecycle.

Continue to innovate and build solutions to support business growth and launch new features.

Object-Oriented Analysis and design using common design patterns.

Given a fuzzy product requirement, work with other stakeholders, product to understand & refine the requirements and change them to tech requirements

Work in a cross-functional team, collaborating with peers during entire SDLC.

Managing the developed applications and live support.

 

We’re Excited About You If You Have

Excellent coding skills in Java/J2EE

Strong problem-solving skills, data structures and algorithms.

Have experience in building and maintaining large scale web applications in service-oriented architecture.

Good Understanding of Java 8 with proven hands-on skills

Experience in Spring Framework - Spring Boot, Spring Data, Spring REST

Experience in Spring Reactive

Good understanding of SQL and MYSQL

Knowledge of professional software engineering practices & best practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations

Understands version control branching strategies

Understands different major language paradigms (object oriented / functional /reactive)

Understanding of AWS is a plus

Can reason about complexity of algorithms (time and space)

Can debug code at ease and ensure quality code is produced

Good verbal and written communication skills

 

Read more
Joveo
at Joveo
1 recruiter
Praful Gupta
Posted by Praful Gupta
Hyderabad
3 - 7 yrs
₹18L - ₹28L / yr
skill iconJava
J2EE
Struts
Spring
Hibernate (Java)
+1 more

Job brief

We are looking for a Java Developer with experience in building high-performing, scalable, enterprise-grade applications.

You will be part of a talented software team that works on mission-critical applications. Java developer roles and responsibilities include managing Java/Java EE application development while providing expertise in the full software development lifecycle, from concept and design to testing.

Java developer responsibilities include designing, developing and delivering high-volume, low-latency applications for mission-critical systems.

Responsibilities

  • Contribute in all phases of the development lifecycle
  • Write well designed, testable, efficient code
  • Ensure designs are in compliance with specifications
  • Prepare and produce releases of software components
  • Support continuous improvement by investigating alternatives and technologies and presenting these for architectural review

Requirements

  • BS/MS degree in Computer Science, Engineering or a related subject
  • Proven hands-on Software Development experience
  • Proven working experience in Java development
  • Hands on experience in designing and developing applications using Java EE platforms
  • Object Oriented analysis and design using common design patterns.
  • Profound insight of Java and JEE internals (Classloading, Memory Management, Transaction management etc)
  • Excellent knowledge of Relational Databases, SQL and ORM technologies (JPA2, Hibernate)
  • Experience in the Spring Framework
  • Experience as a Sun Certified Java Developer
  • Experience in developing web applications using at least one popular web framework (JSF, Wicket, GWT, Spring MVC)
  • Experience with test-driven development
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos