Cutshort logo
Technology service company logo
Sr. Spark Software Engineer
Technology service company
Sr. Spark Software Engineer
Technology service company's logo

Sr. Spark Software Engineer

at Technology service company

Agency job
5 - 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Ansible
skill iconGit
JIRA
Apache Spark
Spark
Apache Kafka
Microservices
skill iconKubernetes
Terraform
NOSQL Databases
API
skill iconDocker
  • Bachelor’s or master’s degree in Computer Engineering, Computer Science, Computer Applications, Mathematics, Statistics, or related technical field. Relevant experience of at least 3 years in lieu of above if from a different stream of education.

  • Well-versed in and 3+ hands-on demonstrable experience with: ▪ Stream & Batch Big Data Pipeline Processing using Apache Spark and/or Apache Flink.
    ▪ Distributed Cloud Native Computing including Server less Functions
    ▪ Relational, Object Store, Document, Graph, etc. Database Design & Implementation
    ▪ Micro services Architecture, API Modeling, Design, & Programming

  • 3+ years of hands-on development experience in Apache Spark using Scala and/or Java.

  • Ability to write executable code for Services using Spark RDD, Spark SQL, Structured Streaming, Spark MLLib, etc. with deep technical understanding of Spark Processing Framework.

  • In-depth knowledge of standard programming languages such as Scala and/or Java.

  • 3+ years of hands-on development experience in one or more libraries & frameworks such as Apache Kafka, Akka, Apache Storm, Apache Nifi, Zookeeper, Hadoop ecosystem (i.e., HDFS, YARN, MapReduce, Oozie & Hive), etc.; extra points if you can demonstrate your knowledge with working examples.

  • 3+ years of hands-on development experience in one or more Relational and NoSQL datastores such as PostgreSQL, Cassandra, HBase, MongoDB, DynamoDB, Elastic Search, Neo4J, etc.

  • Practical knowledge of distributed systems involving partitioning, bucketing, CAP theorem, replication, horizontal scaling, etc.

  • Passion for distilling large volumes of data, analyze performance, scalability, and capacity performance issues in Big Data Platforms.

  • Ability to clearly distinguish system and Spark Job performances and perform spark performance tuning and resource optimization.

  • Perform benchmarking/stress tests and document the best practices for different applications.

  • Proactively work with tenants on improving the overall performance and ensure the system is resilient, and scalable.

  • Good understanding of Virtualization & Containerization; must demonstrate experience in technologies such as Kubernetes, Istio, Docker, OpenShift, Anthos, Oracle VirtualBox, Vagrant, etc.

  • Well-versed with demonstrable working experience with API Management, API Gateway, Service Mesh, Identity & Access Management, Data Protection & Encryption.

    Hands-on experience with demonstrable working experience with DevOps tools and platforms viz., Jira, GIT, Jenkins, Code Quality & Security Plugins, Maven, Artifactory, Terraform, Ansible/Chef/Puppet, Spinnaker, etc.

  • Well-versed in AWS and/or Azure or and/or Google Cloud; must demonstrate experience in at least FIVE (5) services offered under AWS and/or Azure or and/or Google Cloud in any categories: Compute or Storage, Database, Networking & Content Delivery, Management & Governance, Analytics, Security, Identity, & Compliance (or) equivalent demonstrable Cloud Platform experience.

  • Good understanding of Storage, Networks and Storage Networking basics which will enable you to work in a Cloud environment.

  • Good understanding of Network, Data, and Application Security basics which will enable you to work in a Cloud as well as Business Applications / API services environment.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Tradelab Software Private Limited
Pooja Sharma
Posted by Pooja Sharma
Bengaluru (Bangalore)
2 - 4 yrs
₹10L - ₹15L / yr
Phoenix
ecto
RESTful APIs
skill iconPostgreSQL
skill iconRedis
+3 more

About the Role

We’re looking for an Elixir Developer who is passionate about building scalable, high performance backend systems. You’ll work closely with our engineering team to design, develop, and maintain reliable applications that power mission-critical systems.


Key Responsibilities

• Develop and maintain backend services using Elixir and Phoenix framework.

• Build scalable, fault-tolerant, and distributed systems.

• Integrate APIs, databases, and message queues for real-time applications.

• Optimize system performance and ensure low latency and high throughput.

• Collaborate with frontend, DevOps, and product teams to deliver seamless solutions.

• Write clean, maintainable, and testable code with proper documentation.

• Participate in code reviews, architectural discussions, and deployment automation.


Required Skills & Experience

• 2–4 years of hands-on experience in Elixir (or strong functional programming background).

• Experience with Phoenix, Ecto, and RESTful API development.

• Solid understanding of OTP (Open Telecom Platform) concepts like GenServer, Supervisors, etc.

• Proficiency in PostgreSQL, Redis, or similar databases.

• Familiarity with Docker, Kubernetes, or cloud platforms (AWS/GCP/Azure).

• Understanding of CI/CD pipelines, version control (Git), and agile development.


Good to Have

• Experience with microservices architecture or real-time data systems.

• Knowledge of GraphQL, LiveView, or PubSub.

• Exposure to performance profiling, observability, or monitoring tools.


Why Join Us?

• Work with a team that expects and delivers excellence.

• A culture where risk-taking is rewarded, and complacency is not.

• Limitless opportunities for growth—if you can handle the pace.

• A place where learning is currency, and outperformance is the only metric that matters.

• The opportunity to build systems that move markets, execute trades in microseconds, and redefine

fintech.

Read more
Wissen Technology
at Wissen Technology
4 recruiters
Tony Tom
Posted by Tony Tom
Bengaluru (Bangalore)
5 - 7 yrs
₹1L - ₹25L / yr
skill iconJava
Cassandra

· 5+ years of experience in software development using Java.

· Proficiency in Spring Boot and Spring Batch.

· Experience with microservices architecture.

· Hands-on experience with Cassandra or similar NoSQL databases.

· Solid understanding of cloud platforms (AWS, GCP, Azure, etc.).

· Familiarity with Docker and Kubernetes.

· Experience with CI/CD tools such as Jenkins etc

· Strong problem-solving skills and attention to detail.

· Excellent communication and teamwork skills.

Important consideration:

· Core Java - 4 to 6 Yrs

· Spring and Spring Boot, Spring MVC, Spring Data, Spring Security - 4 to 6 Yrs

· DevOps (Jenkins, Junit, sonarQube, Maven) - 1 to 2 Yrs

· MongoDB, NOSql, Couch DB, Cassandra - 1 to 2 Yrs

Read more
Publicis Sapient
at Publicis Sapient
10 recruiters
Dipika
Posted by Dipika
Bengaluru (Bangalore), Delhi, Gurugram, Noida, Ghaziabad, Faridabad, Hyderabad, Pune
5 - 7 yrs
₹5L - ₹20L / yr
skill iconJava
Microservices
06692
Apache Kafka
Apache ActiveMQ
+3 more

1 Senior Associate Technology L1 – Java Microservices


Company Description

Publicis Sapient is a digital transformation partner helping established organizations get to their future, digitally-enabled state, both in the way they work and the way they serve their customers. We help unlock value through a start-up mindset and modern methods, fusing strategy, consulting and customer experience with agile engineering and problem-solving creativity. United by our core values and our purpose of helping people thrive in the brave pursuit of next, our 20,000+ people in 53 offices around the world combine experience across technology, data sciences, consulting and customer obsession to accelerate our clients’ businesses through designing the products and services their customers truly value.


Job Description

We are looking for a Senior Associate Technology Level 1 - Java Microservices Developer to join our team of bright thinkers and doers. You’ll use your problem-solving creativity to design, architect, and develop high-end technology solutions that solve our clients’ most complex and challenging problems across different industries.

We are on a mission to transform the world, and you will be instrumental in shaping how we do it with your ideas, thoughts, and solutions.


Your Impact:

• Drive the design, planning, and implementation of multifaceted applications, giving you breadth and depth of knowledge across the entire project lifecycle.

• Combine your technical expertise and problem-solving passion to work closely with clients, turning • complex ideas into end-to-end solutions that transform our clients’ business

• Constantly innovate and evaluate emerging technologies and methods to provide scalable and elegant solutions that help clients achieve their business goals.


Qualifications

➢ 5 to 7 Years of software development experience

➢ Strong development skills in Java JDK 1.8 or above

➢ Java fundamentals like Exceptional handling, Serialization/Deserialization and Immutability concepts

➢ Good fundamental knowledge in Enums, Collections, Annotations, Generics, Auto boxing and Data Structure

➢ Database RDBMS/No SQL (SQL, Joins, Indexing)

➢ Multithreading (Re-entrant Lock, Fork & Join, Sync, Executor Framework)

➢ Spring Core & Spring Boot, security, transactions ➢ Hands-on experience with JMS (ActiveMQ, RabbitMQ, Kafka etc)

➢ Memory Mgmt (JVM configuration, Profiling, GC), profiling, Perf tunning, Testing, Jmeter/similar tool)

➢ Devops (CI/CD: Maven/Gradle, Jenkins, Quality plugins, Docker and containersization)

➢ Logical/Analytical skills. Thorough understanding of OOPS concepts, Design principles and implementation of

➢ different type of Design patterns. ➢ Hands-on experience with any of the logging frameworks (SLF4J/LogBack/Log4j) ➢ Experience of writing Junit test cases using Mockito / Powermock frameworks.

➢ Should have practical experience with Maven/Gradle and knowledge of version control systems like Git/SVN etc.

➢ Good communication skills and ability to work with global teams to define and deliver on projects.

➢ Sound understanding/experience in software development process, test-driven development.

➢ Cloud – AWS / AZURE / GCP / PCF or any private cloud would also be fine

➢ Experience in Microservices

Read more
Deqode
at Deqode
1 recruiter
Roshni Maji
Posted by Roshni Maji
Pune, Bengaluru (Bangalore), Gurugram, Noida, Indore, Chennai
5 - 7 yrs
₹4L - ₹15L / yr
skill iconJava
06692
Microservices

Job Title: Java Developer (Immediate Joiners Only)

Experience: 5+ Years

Work Locations: Pune, Gurgaon, Noida, Bangalore, Ahmedabad

Work Mode: Hybrid

Joining: Immediate Joiners / Candidates who have completed their notice period only


About Us

At Deqode, we build high-performing engineering teams for cutting-edge technology solutions. We are currently looking for experienced Java Developers who are passionate about scalable systems, clean code, and modern architectures.


Key Responsibilities:

  • Design, develop, test, and maintain Java-based applications using Java 8 and Spring Boot
  • Build robust RESTful APIs and integrate with third-party services
  • Work on microservices architecture, including containerization and orchestration
  • Ensure the performance, quality, and responsiveness of applications
  • Identify bottlenecks and bugs and devise solutions to these problems
  • Participate in code reviews and contribute to technical discussions
  • Collaborate with cross-functional teams to define and deliver new features
  • Write unit and integration tests to maintain code quality


Mandatory Skills:

  • Strong hands-on experience with Java 8 or above
  • In-depth knowledge of Spring Boot and Microservices architecture
  • Experience in developing RESTful APIs
  • Proficient in object-oriented design principles and software design patterns
  • Good understanding of databases (SQL/NoSQL)
  • Familiarity with version control tools like Git
  • Exposure to CI/CD practices and tools


Good to Have:

  • Knowledge of containerization (Docker, Kubernetes)
  • Experience with messaging queues (Kafka, RabbitMQ)
  • Cloud exposure (AWS/Azure/GCP)
  • Basic knowledge of unit testing frameworks like JUnit, Mockito


Read more
Accelya
Accelya
Agency job
via Pinnacle by Rajan Vallinayagam
Mumbai
2 - 6 yrs
₹2L - ₹7L / yr
skill iconJava
SQL
Company - Accelya on 3rd party payroll of Pinnacle Technology
Role - Java Developer
Exp - 2+ Yrs
Skills - Java & SQL
Location - Vikhroli, Mumbai
*Need candidates from Mumbai location only*
NP - Immediate

Read more
JISA Softech Pvt
Aarti khatpe
Posted by Aarti khatpe
Pune
3 - 5 yrs
₹14L - ₹18L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Design patterns
+3 more

Job Location: Pune 

Experience: 4- 5 years

Functional Area - IT Software - Application Programming , Maintenance

Role Category : Programming & Design

 

Requirement / Job Description:

 

 Core Skills:

 Strong experience of Core Java (1.7 or higher), OOPS concepts and Spring framework (Core,     AOP, Batch, JMS)

 Demonstrated design using Web Services (SOAP and REST)

 Demonstrated Microservices APIs design experience using Spring, Springboot

 Demonstrable experience in Databases like MySQL, PostgreSQL, Oracle PL/SQL development etc

Strong coding skills, good analytical and problem-solving skills

Excellent understanding of Authentication, Identity Management, REST APIs, security and best practices

 Good understanding of web servers like Tomcat Apache, nginx or Vertex/ Grizzly, JBoss etc

 Experience in OAuth principles

 Strong understanding of various Design patterns

 

Other Skills:

  Familiarity with Java Cryptography Architecture (JCA)

 Understanding of API Gateways like Zuul, Eureka Server etc..

 Familiarity with Apache Kafka, MQTT etc.

 

Responsibilities:

 Design, develop, test and debug software modules for an enterprise security product

 Find areas of optimization and produce high quality code

 Collaborate with product managers and other members of the project team in requirements specification and detailed engineering analysis.

 Collaborate with various stake holders and help bring proactive closure on the issues

 Evaluate various technology trends and bring in the best practices

 Innovate and come out of the box solutions

Adapt, thrive and deliver in a highly evolving and demanding product development team

Come up with ways to provide an improved customer experience


Read more
Semperfi Solution
at Semperfi Solution
1 recruiter
Ambika Jituri
Posted by Ambika Jituri
Bengaluru (Bangalore)
2 - 4 yrs
₹10L - ₹15L / yr
skill iconJava
J2EE
Windows Azure
Google Cloud Platform (GCP)
skill iconPython
+1 more
-Should have experience in supporting the application and infrastructure 24x7.

 

- Should have good working knowledge on troubleshooting skills of Operating Systems (Linux/Windows)
- Good experience on Java/j2EE application supporting and AWS infra supporting.
- Ability to work with 3rd parties/FOPS and provide required instruction to troubleshoot and restore faults.
- Respond quickly and effectively to production issues, troubleshooting solutions, and taking responsibility for seeing those solutions through resolution.
- Identify root cause and corrective actions for highly complex availability, capacity, security, performance, and quality issues affecting the database.
- Strong knowledge of Linux/Unix operating systems.
- Good knowledge of scripting languages like Shell, Python.
- Good Knowledge of Databases like Mongo, My SQL, SQL Server.
- Respond to alerts and take corrective action to ensure the high availability of our production environments and participate in an after-hours on-call rotation.
- Experience/Knowledge of other cloud platforms (Azure, Google Cloud) is a plus
- Strong verbal and written communications skills are a must
- Must have production support experience as the requirement is 24X7X365 production support.
Read more
EnterpriseMinds
at EnterpriseMinds
2 recruiters
Rani Galipalli
Posted by Rani Galipalli
Remote only
4 - 8 yrs
₹8L - ₹25L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Microservices
  • Hands-on with Spring boot and Java coding. Core Java- Java 8/1.8.
  • Experience should be with Springboot, Hibernate & Microservices
  • Should be well versed with Microservices, OOPS, MVC Architecture, Web services & API development.
  • Should be really strong in concepts and should be able to work independently
  • Experience in web services connection
Read more
Bengaluru (Bangalore)
4 - 4 yrs
₹10L - ₹20L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Microservices
+1 more

Neokred is a FinTech company based in Bangalore and an ISO 9001 | 27001 & 20000-1 and PCIDSS certified firm in Information and Data security. The company builds Consumer Tech for Financial Infrastructure stack to provide curated versions of embedded banking in the payment ecosystem. We've created a platform which enables Corporates, Banks, FinTech’s, Retail Companies, and Start-ups to launch their own banking services or financial products, such as issuance of co-branded cards, facilitating lending, and virtual bank accounts and KYC for their customers or employees with the help of low code plug and play technology stack.


BRIEF DESCRIPTION OF THE ROLE:


We are looking for an analytical, result driven Senior Java Developer who will use his or her understanding of programming languages and tools to build and analyse codes, formulate more efficient processes, solve problems, and create more seamless experience for users. 


Your KRAs will include the following:


  • You will design, build, and own APIs and Services, which will be the core of the product.
  • You will participate in continuing education and training to remain current on best practices, learn new programming languages and better assist other team members.
  • You will part of developing ideas for new programs, products or features by monitoring industry developments and trends.
  • You will have to take lead on projects, compile and analyse data, processes, and codes to troubleshoot problems and identify areas of improvement. 


YOU SHOULD POSSESS: 


  • Minimum 4+ years of experience with Proficient understanding of Java, Hibernate, Springboot.
  • luency in JAVA, Operating System may be required and Experience on Database such as MySQL or Postgre SQL.
  • Proficiency with Springboot, Spring Security and Hibernate.
  • Strong understanding of Computer Science Fundamentals, Data Structures and Algorithms, SOLID Design Principles and REST Patterns.
  • Focus on efficiency, user experience and process improvement. • Excellent project and time management skills.
  • Strong problem solving and communication skills.
  • Ability to work independently or with a group. 
Read more
Global Investment Management Company
Global Investment Management Company
Agency job
via Enzyne HR Solutions by Shabna Baig
Bengaluru (Bangalore)
3 - 6 yrs
₹40L - ₹55L / yr
Algorithms
skill iconJava
Data Structures
Object Oriented Programming (OOPs)
 
Location : Bangalore
Experience : 3 – 6 Years
Function : Technology - IT & Systems
Vacancy : 20

Job Description :

 

The Team and Your Role

You will be a part of the Enterprise Engineering team, which is responsible for design and development of foundational software utilized by applications throughout AQR, including:

§  Enterprise Cloud Platform

§  Enterprise Messaging Fabric

§  Common Data Access Framework

§  Role Based Entitlements System

§  Application Monitoring and Alerting

§  Application Configuration Management

§  Business Notifications

These foundational services are part of a larger project that streamlines the entire SDLC from project inception through to production and post-production. We build and maintain common development tools and libraries that are implemented in Java, Python and Golang. The libraries provide business applications with core functionalities needed to build any application within our environment. In addition, we provide standardized cloud-based runtime platform with necessary tooling for all AQR applications.

What You Will Bring

§  Engineering degree in Computer Science or equivalent field from top schools

§  3 to 5 years of software development experience with substantial individual contribution

§  Outstanding coding, debugging and analytical skills

§  Experience working with complex projects through the software development lifecycle

§  Experience working in a geographically spread out team

§  Hands on programming experience with mastery over at least one programming language in Java or Python

§  Strong knowledge of: Spring, Multithreading, Open Source dbase

§  Microservice architecture

§  RESTful application design

§  Experience designing and developing distributed systems

§  OOP design patterns (especially Java or Python) and data modeling

 

Our technology platform includes:

 

§  AWS

§  Kafka

§  Mesos

§  Docker

§  Redis

§  Spring Boot

§  Excellent communication skills both verbal and written

§  Demonstrated contributions to open-source software is also a plus

 

Qualification : Bachelor of Engineering/ Bachelor of Technology 
Working Days : 5 Days a Week ( to )
Job Nature : Full Time
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos