Cutshort logo
For Employers
Technology service company logo
Sr. Spark Software Engineer
Technology service company
Sr. Spark Software Engineer
Jobdost's logo

Sr. Spark Software Engineer

at Technology service company

Agency job
5 - 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Ansible
skill iconGit
JIRA
Apache Spark
Spark
Apache Kafka
Microservices
skill iconKubernetes
Terraform
NOSQL Databases
API
skill iconDocker
  • Bachelor’s or master’s degree in Computer Engineering, Computer Science, Computer Applications, Mathematics, Statistics, or related technical field. Relevant experience of at least 3 years in lieu of above if from a different stream of education.

  • Well-versed in and 3+ hands-on demonstrable experience with: ▪ Stream & Batch Big Data Pipeline Processing using Apache Spark and/or Apache Flink.
    ▪ Distributed Cloud Native Computing including Server less Functions
    ▪ Relational, Object Store, Document, Graph, etc. Database Design & Implementation
    ▪ Micro services Architecture, API Modeling, Design, & Programming

  • 3+ years of hands-on development experience in Apache Spark using Scala and/or Java.

  • Ability to write executable code for Services using Spark RDD, Spark SQL, Structured Streaming, Spark MLLib, etc. with deep technical understanding of Spark Processing Framework.

  • In-depth knowledge of standard programming languages such as Scala and/or Java.

  • 3+ years of hands-on development experience in one or more libraries & frameworks such as Apache Kafka, Akka, Apache Storm, Apache Nifi, Zookeeper, Hadoop ecosystem (i.e., HDFS, YARN, MapReduce, Oozie & Hive), etc.; extra points if you can demonstrate your knowledge with working examples.

  • 3+ years of hands-on development experience in one or more Relational and NoSQL datastores such as PostgreSQL, Cassandra, HBase, MongoDB, DynamoDB, Elastic Search, Neo4J, etc.

  • Practical knowledge of distributed systems involving partitioning, bucketing, CAP theorem, replication, horizontal scaling, etc.

  • Passion for distilling large volumes of data, analyze performance, scalability, and capacity performance issues in Big Data Platforms.

  • Ability to clearly distinguish system and Spark Job performances and perform spark performance tuning and resource optimization.

  • Perform benchmarking/stress tests and document the best practices for different applications.

  • Proactively work with tenants on improving the overall performance and ensure the system is resilient, and scalable.

  • Good understanding of Virtualization & Containerization; must demonstrate experience in technologies such as Kubernetes, Istio, Docker, OpenShift, Anthos, Oracle VirtualBox, Vagrant, etc.

  • Well-versed with demonstrable working experience with API Management, API Gateway, Service Mesh, Identity & Access Management, Data Protection & Encryption.

    Hands-on experience with demonstrable working experience with DevOps tools and platforms viz., Jira, GIT, Jenkins, Code Quality & Security Plugins, Maven, Artifactory, Terraform, Ansible/Chef/Puppet, Spinnaker, etc.

  • Well-versed in AWS and/or Azure or and/or Google Cloud; must demonstrate experience in at least FIVE (5) services offered under AWS and/or Azure or and/or Google Cloud in any categories: Compute or Storage, Database, Networking & Content Delivery, Management & Governance, Analytics, Security, Identity, & Compliance (or) equivalent demonstrable Cloud Platform experience.

  • Good understanding of Storage, Networks and Storage Networking basics which will enable you to work in a Cloud environment.

  • Good understanding of Network, Data, and Application Security basics which will enable you to work in a Cloud as well as Business Applications / API services environment.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Unico Connect Private Limited
Mumbai
3 - 5 yrs
Best in industry
skill iconNodeJS (Node.js)
TypeScript
skill iconPostgreSQL
skill iconRedis
API
+4 more

About the Role

Unico Connect is an AI-first technology partner that builds custom mobile, web, and AI products for clients across multiple geographies. We are hiring a Backend Engineer for a dedicated client engagement building an AI-powered application builder platform.

The backend is the operational core of the product: it manages user projects and sessions, coordinates long-running AI agent workloads, maintains project state, and serves as the integration layer between the frontend, the AI system, and the underlying infrastructure.

The mandatory requirement is hands-on production experience shipping Node.js services, with end-to-end ownership of API design, data modelling, and at least one production system involving background job processing or event-driven patterns.


Responsibilities

API and service development: Design and build REST APIs in Node.js with TypeScript. Cover authentication, session management, input validation, structured error handling, streaming responses (SSE, WebSockets), and rate limiting. Maintain clean API contracts that the frontend and AI system can rely on.

Database design and management: Own PostgreSQL schema design for product domains including user accounts, projects, file trees, session state, and generated artefacts. Write efficient queries, manage migrations, and optimise for read patterns that serve a real-time editor experience.

Caching strategy: Implement and maintain caching with Redis for session data, project state, and frequently read configuration. Design cache invalidation logic that keeps the editor experience consistent without stale reads.

Queue and background job management: Implement and operate background job infrastructure using BullMQ or equivalent. AI agent runs are long-running and stateful; handle retries, failure states, priority queues, and concurrency limits.

AI system integration: Build the integration layer between the backend and the AI agent system. Manage job dispatch, result handling, streaming output to the frontend, and error propagation.

Multi-tenancy and access control: Implement tenant data isolation, RBAC, and resource ownership enforcement across all API surfaces.

Observability and reliability: Instrument services with structured logging, metrics, and tracing. Write defensive code with sensible timeouts, fallback behaviour, and circuit breaking on external dependencies.

Testing and code quality: Write unit and integration tests for the services you ship. Review the work of peers and contribute to shared engineering conventions.


Requirements

Hands-on production Node.js experience (mandatory) — must have personally shipped at least one feature area end to end in a production Node.js service, owning API design, data modelling, and testing.

3 to 5 years of professional backend engineering experience. Candidates with slightly less time but strong demonstrated ownership are welcome to apply.

Strong Node.js and TypeScript. Production experience with Express, NestJS, or Fastify. Solid with async patterns, streaming, error handling, and building services that run reliably under sustained load.

PostgreSQL depth. Schema design, query writing, indexing, and migrations on at least one production system.

Redis and caching. Production experience using Redis for caching and session management. Understands cache invalidation trade-offs.

Queue and background job systems. Hands-on with BullMQ, RabbitMQ, SQS, or equivalent. Experience managing retries, dead-letter queues, job priority, and concurrency control.

AWS working knowledge. Comfortable with EC2, S3, RDS, SQS, and IAM. Familiar with Docker and basic deployment and environment management.

Strong written and spoken English. Able to communicate clearly with engineers across disciplines and write precise technical documentation.


Nice to Have

Experience integrating with AI or LLM services (streaming responses, structured outputs, retry patterns); WebSocket or SSE implementation for real-time features; multi-tenant SaaS product experience; GraphQL; OpenTelemetry instrumentation; prior work on developer tools or editor-style products.

Read more
iris software
at iris software
2 candid answers
Parveen Kaur
Posted by Parveen Kaur
Pune, Noida
5 - 8 yrs
₹20L - ₹25L / yr
skill iconJava
Apache Kafka
06692
Multithreading
Microservices
+1 more

Job Role: We are seeking a skilled Java Developer to contribute to the development and enhancement renowned banking application, which supports automatic reconciliation and unified data reporting for their clients. This role involves working on high-impact enhancements, data pipeline integration, and platform modernization. The ideal candidate will be a quick learner, self-motivated, and able to ramp up quickly in a fast-paced environment. 


Key Responsibilities:

 Design, develop, and maintain Java-based applications using Java 17 and Spring Boot.

 Implement and manage message routing using Apache Camel.

 Develop and monitor data pipelines using Kafka.

 Support and enhance existing cloud-native applications.

 Work with OpenShift Container Platform (OCP 4) for container orchestration and deployments.

 Utilize Jenkins for CI/CD pipeline automation and management.

 Collaborate with cross-functional teams to integrate multiple data sources into a unified reporting platform.

 Participate in code reviews, unit testing, and performance tuning.

 Troubleshoot and resolve production issues in collaboration with operations teams.

 Document development processes and system configurations.



Required Skills:

 Strong proficiency in Java 17 and Spring Boot frameworks.

 Hands-on experience with Apache Camel for message routing and transformation.

 Solid experience in Kafka development and monitoring tools.

 Good understanding of cloud pipeline architectures and deployment strategies.

 Experience working with OpenShift (OCP 4).

 Familiarity with Jenkins for CI/CD and automated deployments.

 Understanding of cloud deployment platforms (AWS, Azure, or GCP preferred).

 Strong analytical and debugging skills.

 Ability to learn quickly and adapt to evolving project requirements.



Nice to Have:

 Experience in financial services or transaction reporting platforms.

 Familiarity with microservices architecture and containerization best practices.

 Knowledge of monitoring tools (e.g., Prometheus, Grafana).

Read more
Bengaluru (Bangalore)
4 - 8 yrs
₹10L - ₹15L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
RESTful APIs
+2 more

Reward360 powers a data-driven customer engagement ecosystem that enables the world’s leading organisations to earn customer loyalty every day. For over 10 years, R360’s loyalty and reward platforms have driven ambitious loyalty programs for some of the world’s biggest brands – including Axis Bank, Standard Chartered Bank, HDFC Bank and Emirates National Dubai Bank. We have 500+ global retail partnerships and offer our clients reward programs, nuanced customer segmentation, data-centric campaigns, and big data analytics.


You will architect, design & build large scale software systems for loyalty, rewards, commerce and payments that are directly used by customers of large banks. You will have the opportunity to build systems end to end and improve & influence customer behavior. You will also influence best practices and drive how we operate large systems in an efficient manner. If you are excited about this opportunity and meet the requirements laid out below, we would like to talk to you! 


What you’ ll do: 

1. Work as Core Java developer with prime focus on Backend 

2. End to end development from design to development 

3. Code & design review of peers 

4. Troubleshoot critical issues and guide team as well 

 

What we’ll need: 

1. Overall 4-6 years of experience 

2. 3+ years of hands-on experience in Java/J2EE technologies 

3. Strong Data structures & algorithm skill 

4. Strong communication & design skills 

 

Technical Skills 

1. Core Java (Collection, multi-threading, design patterns) 

2. Frameworks - Hibernate, Spring, REST Jersey 

3. Front end technologies – Java Script, jQuery, Angular 

4. Database – SQL & NoSQL 

5. Modelling – UML & ERD 

 

Bonus point if: Candidate from product company would be preferred

Read more
enterprise-grade, streaming integration company WFH
enterprise-grade, streaming integration company WFH
Agency job
via Jobdost by Mamatha A
Remote only
5 - 15 yrs
₹12L - ₹30L / yr
skill iconJava
Data Structures
HLD
Object Oriented Programming (OOPs)
Algorithms
+5 more

Job Description

·       Strong Core Java / C++ experience with Strong Handson Coding

·       Excellent understanding of Logical ,Object-oriented design patterns, algorithms and data structures.

·       Sound knowledge of application access methods including authentication mechanisms, API quota limits, as well as different endpoint REST, Java etc

·       Strong exp in databases - not just a SQL Programmer but with knowledge of DB internals

·       Sound knowledge of Cloud database available as service is plus (RDS, CloudSQL, Google BigQuery, Snowflake )

·       Experience working in any cloud environment and microservices based architecture utilizing GCP, Kubernetes, Docker, CircleCI, Azure or similar technologies

Read more
Nascentvision
at Nascentvision
1 recruiter
Shanu Mohan
Posted by Shanu Mohan
Gurugram, Bengaluru (Bangalore)
2 - 5 yrs
₹10L - ₹25L / yr
skill iconJava
J2EE
skill iconSpring Boot
Microservices
skill iconAmazon Web Services (AWS)

Role: Java developer

Location: Gurgaon 

Exp-3-5 yrs

 

Description:

 

  1. 3+ years of Coding and development experience
    2. Hands on technical experience in must have technical requirements.
    3. Strong working knowledge of Developing, Designing and implementing large scale enterprise applications.
    4. Possess strong analytical skills, organizational skills, attention to detail, and excellent verbal and written communication skills.
    5. Ability to establish and maintain effective working relationships with co-workers, managers and internal and/or external customers.
    6. Knowledge of Agile process
    REQUIRED TECHNICAL SKILL SET
    Must have: AWS, Java, J2EE, Angular, React, Javascript, Spring MVC, Webservices (REST), Servlets, Hibernate
    Nice to have: EXTJS, JBoss Drools Rules Engine, JQuery
    RESPONSIBILITIES
    1. Analyses and evaluates detailed business and technical requirements.
    2. Codes and maintains complex components of information systems.
    3. Develops and performs unit testing and fixes defects identified during testing and re-executes unit tests to validate results.
    4. Ensure code quality by performing technical design and code reviews
    5. Perform integration via Services/Batch with external and internal systems; develop presentation, business/application services and persistence components
    6. Module level ownership and ensure that any development that occurs in that module is as per the agreed solution.
    7. Profiling & Performance turning of Javaapplications

 

Read more
Octal Frames Technologies Pvt Ltd
Gopinath NAdig
Posted by Gopinath NAdig
Bengaluru (Bangalore)
3 - 5 yrs
₹9L - ₹14L / yr
Hybris
skill iconJava
Hibernate (Java)
Spring
PCM
+1 more
3 to 5 years plus experience on having implemented Hybris Commerce Solution.
Working experience of Java, Spring and Hibernate is must
Working experience of customizing Hybris Accelerators
Proficient in Hybris core concepts and commerce concepts including, but not limited to, Hybris PCM Data Modeling, Endeca/SOLR, WCMS/ Customer
Experience Manager, Cockpits, Cron jobs, internationalization,
personalization, security concepts and REST.
Proficient in catalog, order management, promotions, B2B commerce.
Should have experience of handling multi/Omni-channel architecture
through related Hybris Channel management modules.
Good understanding of integration patterns/methodologies of Hybris with
Organic SEO Search, Faceted Search and Commerce Search.
Should have exposure on the continuous integration build tools and code quality tools
Working experience of Integration with external services such as payment gateways, Order management solution using Web services such as REST and SOAP
Working experience of SOLR Search Engine is a plus
Read more
Innovative global sourcing and logistics solutions. (M1)
Innovative global sourcing and logistics solutions. (M1)
Agency job
via Multi Recruit by Santhosh Kumar KR
Bengaluru (Bangalore)
6 - 9 yrs
₹15L - ₹20L / yr
skill iconJava
skill iconReact.js
Oracle
Angular
  • Work with the team to develop user-facing web applications utilizing various languages (like Java, golang, scala, etc.), RDBMS and NoSQL Databases, and latest frontend frameworks (including React, Vue, JQuery, etc).
  • Assists in the technical evaluation, design, integration (utilizing an SOA), implementation, and support of projects.
  • Communicating status to the team, business, and leadership.
  • Participate in Code-Reviews

Required Skills:

  • Java 1.8 or higher
  • JavaScript and client-side libraries (such as jQuery, Ignite UI and bootstrap, Vue.js, React, etc)
  • Intellij Idea or any other development tool
  • Hibernate/ ibatis
  • Spring/Spring Boot
  • Oracle 12c and PL/SQL
  • HTML
  • CSS
  • Git
  • Web servers like Tomcat, Jetty, etc.

Nice to Have Skills:

  • .NET 4.5 or higher
  • NET MVC and Web API
  • Deployment Tools like Team City, Jenkins, Octopus, etc.
  • Experience Required:
  • Minimum of 5 years of hands-on Java experience.
  • Excellent understanding of web technologies.
  • Experience developing REST-based web services
  • Strong understanding of source control systems such as GIT knowledge of creating and managing GIT flows a plus.
  • Basic knowledge of distributed systems a plus.
  • Strong database skills using Oracle and PL/SQL.
  • Excellent oral and written communication skills.
  • Strong organizational skills and detail-oriented
Read more
Apisero
at Apisero
2 recruiters
Megham Gayakavad
Posted by Megham Gayakavad
Pune, Bengaluru (Bangalore), NCR (Delhi | Gurgaon | Noida), Mumbai, Chennai, Hyderabad
1 - 8 yrs
₹1L - ₹20L / yr
skill iconJava
skill iconPython
MuleSoft
J2EE
Struts
+4 more
We are looking for Java Developers & Python Developers
Talk about the role we are offering for Mulesoft and how we are considering trainable resources who are keen to learn and work on new technologies
Our Requirements:
We are looking for 1-8 years of experience in technical skills like Java, python etc and who will be willing to learn and move to mulesoft and related technologies
Ability to work in a fast paced, demanding, and rapidly changing environment
Preferred:
Basic knowledge about mulesoft
Responsibilities
Assist in translating business objectives into technical solutions through the use of MuleSoft Anypoint Platform
Coding, testing, debugging, implementing and documenting MuleSoft based flows and integrations
Apply integration design patterns such as message routing, content enrichment, batch processing, error handling and reconciliation mechanisms to deliver required functionality
WHAT WE ARE OFFERING
Learning and Certification
Best in Industry Salary
Health & Wellness Benefits
Employee Rewards Program
Retirement & Savings
Flexible Schedules
Maternity & Paternity Leave
Read more
Azine Technologies
at Azine Technologies
3 recruiters
Pri Mistry
Posted by Pri Mistry
Ahmedabad
5 - 10 yrs
₹5L - ₹10L / yr
skill iconPython
skill iconDjango
skill iconMongoDB
skill iconFlask
NOSQL Databases

Azine Technologies is known for our innovative technologies, products and services -- and for the people behind them. At Azine, we create identity verification products which are essentially apps, APIs, SDKs which have different modules that undergo OCR, Face Recognition, and other AI and machine learning. We’re looking for a Python Developer who can fulfil the following responsibilities.

Role and Responsibilities

 

  • Design & implement new software modules based on the product requirements
  • Debug existing software components, fix issues and avoid regressions
  • Be proactive, take ownership and be accountable
  • Familiar with Test Drive Development.
  • Participate in software architecture, design discussions and code reviews

 

 

 

Qualifications and Education Requirements

Bachelor’s degree and 3+ years of software development experience or equivalent, including Computer Vision and AI/ML.

Understanding of OCR, Neural network and Deep learning.

Expert in Python with knowledge of Python Frameworks (such as Django, Flask, etc.).

Expert understanding of threading and limitations of Python, and multi-process architecture.

Knowledge of user authentication and authorization between multiple systems, servers, and environments.

Proficient understanding with code versioning tools such as Git, SVN, etc.

Strong unit test and debugging skills.

Basic understanding of front-end technologies, such as Javascript, HTML5, and CSS3.

Preferred Skills

Django, Flask, Neural networks, Deep Learning, Optical character recognition, Self-organizing maps, Artificial Intelligence (AI), Machine Learning (ML), Software architecture, Celery, Object-relational mapping, NOSQL Databases, MongoDB, Computer Vision, GANs,

 

Additional Notes

We are offering amazing career growth opportunities, great compensation, and benefits. This begins with: weekly lunches, alternate weekends-off, annual medical checkups, social engagement, financial assistance and more.

 

Job Type: Full-time

Location: Iscon, Ahmedabad

 

Read more
BlueOptima
at BlueOptima
1 video
10 recruiters
Annu Rekha
Posted by Annu Rekha
Bengaluru (Bangalore), NCR (Delhi | Gurgaon | Noida)
1 - 4 yrs
₹7L - ₹12L / yr
J2EE
Spring MVC
skill iconNodeJS (Node.js)
Spring
Game Design
+3 more
Whom are we looking for? Our groundbreaking technology, requires highly skilled and talented Web Backend Developers to understand the depth of the problem and device a solution for it.We are seeking a Software Engineer, with a depth of experience in developing Web Applications enabled using REST APIs backed by a data warehouse solution, to join our growing company and be a part of our success story. We are looking for individual with great attention to detail, who is genuine, confident, committed and not only passionate about technology, but excited to work in a fun and friendly start-up environment. The ideal candidate will be passionate about technology and getting things to work while at the same time being able to mentor (and lead) other engineers by way of example to achieve excellence in their work.What does the role involve? As a Web Backend Software Engineer you will be responsible for creating REST APIs which are used to drive the User Interface. Given the nature of the application, these APIs needs to be very efficient and high performing. This requires optimising queries for faster execution and introducing database changes that may be required.You would be working with a complex technology stack which includes (but is not limited to) Spring, Hibernate, HornetQ, Quartz, etc. This requires extensive understanding of transaction management and data handling across different application layers.In addition to the technical ownership, you will also be involved in detailing requirements for requested functionalities and be responsible for providing technical insight into how requirements will be implemented and made available to users. Accurate estimation of tasks and planning are qualities we look for in our engineers.Responsibilities include:Develop, test, implement and maintain application softwareTake part in software and architectural development activitiesTransform requirements into implementation detailsDebug application issues and helping support respond to client queriesParticipate in application development meetingsProvide accurate estimates, clearly communicate status of tasks and identification of risksCommitment to accomplishing the task at hand and identify the fastest and most reliable way to solve a problemPerformance tuning of application code at different service levels Incorporate design changes to improve performance of the applicationInteract with customers of the application and help address issues reportedInteract with customers of the application and collect requirements or potential uses cases and draft technical and user requirementsESSENTIAL SKILLS / EXPERIENCE REQUIRED:Minimum Bachelor's degree in Computer Science or equivalentMinimum 1+ years experience with Java and J2EE/Java EEMinimum 1+ years experience with Spring MVC, Spring Security and HibernateStrong understanding of relational database and normal formsStrong understanding of SQL concepts and ability to write optimised and high performing queriesStrong understanding of Java concurrency, concurrency patterns, experience building thread safe codeExperience building RESTful web servicesExperience with web application servers like JBossStrong written and verbal communication skillsStrong interpersonal skills and time management skillsStrong problem solving and analytical skillsExperience using task tracking systems e.g. Jira and distributed version control systems e.g. GitDESIRABLE SKILLS / EXPERIENCE:Understanding of testNg/JUnitUnix/Windows shell and related command line toolsExperience in Continuous Integration and deployment tools such as JenkinsExperience with database partitioning and column IndexingExperience with query optimisation techniquesWhy work for us?Above market remunerationStimulating challenges that fully utilise your skillsWork on real-world technical problems to which solution cannot simply be found on the internetWorking alongside other passionate, talented engineersHardware of your choiceOur fast-growing company offers the potential for rapid career progressionClick below to applyhttps://hire.withgoogle.com/public/jobs/blueoptimacom/view/P_AAAAAAEAAAqA7wTF48UHQE?trackingTag=angelList
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos