Cutshort logo
Technology service company logo
Sr. Spark Software Engineer
Technology service company
Sr. Spark Software Engineer
Technology service company's logo

Sr. Spark Software Engineer

at Technology service company

Agency job
5 - 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Ansible
skill iconGit
JIRA
Apache Spark
Spark
Apache Kafka
Microservices
skill iconKubernetes
Terraform
NOSQL Databases
API
skill iconDocker
  • Bachelor’s or master’s degree in Computer Engineering, Computer Science, Computer Applications, Mathematics, Statistics, or related technical field. Relevant experience of at least 3 years in lieu of above if from a different stream of education.

  • Well-versed in and 3+ hands-on demonstrable experience with: ▪ Stream & Batch Big Data Pipeline Processing using Apache Spark and/or Apache Flink.
    ▪ Distributed Cloud Native Computing including Server less Functions
    ▪ Relational, Object Store, Document, Graph, etc. Database Design & Implementation
    ▪ Micro services Architecture, API Modeling, Design, & Programming

  • 3+ years of hands-on development experience in Apache Spark using Scala and/or Java.

  • Ability to write executable code for Services using Spark RDD, Spark SQL, Structured Streaming, Spark MLLib, etc. with deep technical understanding of Spark Processing Framework.

  • In-depth knowledge of standard programming languages such as Scala and/or Java.

  • 3+ years of hands-on development experience in one or more libraries & frameworks such as Apache Kafka, Akka, Apache Storm, Apache Nifi, Zookeeper, Hadoop ecosystem (i.e., HDFS, YARN, MapReduce, Oozie & Hive), etc.; extra points if you can demonstrate your knowledge with working examples.

  • 3+ years of hands-on development experience in one or more Relational and NoSQL datastores such as PostgreSQL, Cassandra, HBase, MongoDB, DynamoDB, Elastic Search, Neo4J, etc.

  • Practical knowledge of distributed systems involving partitioning, bucketing, CAP theorem, replication, horizontal scaling, etc.

  • Passion for distilling large volumes of data, analyze performance, scalability, and capacity performance issues in Big Data Platforms.

  • Ability to clearly distinguish system and Spark Job performances and perform spark performance tuning and resource optimization.

  • Perform benchmarking/stress tests and document the best practices for different applications.

  • Proactively work with tenants on improving the overall performance and ensure the system is resilient, and scalable.

  • Good understanding of Virtualization & Containerization; must demonstrate experience in technologies such as Kubernetes, Istio, Docker, OpenShift, Anthos, Oracle VirtualBox, Vagrant, etc.

  • Well-versed with demonstrable working experience with API Management, API Gateway, Service Mesh, Identity & Access Management, Data Protection & Encryption.

    Hands-on experience with demonstrable working experience with DevOps tools and platforms viz., Jira, GIT, Jenkins, Code Quality & Security Plugins, Maven, Artifactory, Terraform, Ansible/Chef/Puppet, Spinnaker, etc.

  • Well-versed in AWS and/or Azure or and/or Google Cloud; must demonstrate experience in at least FIVE (5) services offered under AWS and/or Azure or and/or Google Cloud in any categories: Compute or Storage, Database, Networking & Content Delivery, Management & Governance, Analytics, Security, Identity, & Compliance (or) equivalent demonstrable Cloud Platform experience.

  • Good understanding of Storage, Networks and Storage Networking basics which will enable you to work in a Cloud environment.

  • Good understanding of Network, Data, and Application Security basics which will enable you to work in a Cloud as well as Business Applications / API services environment.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Wissen Technology
at Wissen Technology
4 recruiters
Rutuja Patil
Posted by Rutuja Patil
Mumbai
4 - 10 yrs
Best in industry
skill iconJava
J2EE
Hibernate (Java)
skill iconSpring Boot
Spring MVC
+2 more

Company Name – Wissen Technology

Group of companies in India – Wissen Technology & Wissen Infotech

Work Location - Senior Backend Developer – Java (with Python Exposure)- Mumbai


Experience - 4 to 10 years


Kindly revert over mail if you are interested.


Java Developer – Job Description


We are seeking a Senior Backend Developer with strong expertise in Java (Spring Boot) and working knowledge of Python. In this role, Java will be your primary development language, with Python used for scripting, automation, or selected service modules. You’ll be part of a collaborative backend team building scalable and high-performance systems.


Key Responsibilities


  • Design and develop robust backend services and APIs primarily using Java (Spring Boot)
  • Contribute to Python-based components where needed for automation, scripting, or lightweight services
  • Build, integrate, and optimize RESTful APIs and microservices
  • Work with relational and NoSQL databases
  • Write unit and integration tests (JUnit, PyTest)
  • Collaborate closely with DevOps, QA, and product teams
  • Participate in architecture reviews and design discussions
  • Help maintain code quality, organization, and automation


Required Skills & Qualifications

  • 4 to 10 years of hands-on Java development experience
  • Strong experience with Spring Boot, JPA/Hibernate, and REST APIs
  • At least 1–2 years of hands-on experience with Python (e.g., for scripting, automation, or small services)
  • Familiarity with Python frameworks like Flask or FastAPI is a plus
  • Experience with SQL/NoSQL databases (e.g., PostgreSQL, MongoDB)
  • Good understanding of OOPdesign patterns, and software engineering best practices
  • Familiarity with DockerGit, and CI/CD pipelines


Read more
Remote only
2 - 3 yrs
₹5L - ₹9L / yr
skill iconPHP
MySQL
skill iconLaravel
skill iconCodeIgniter
skill iconJava
+1 more

The Company:


We are a growing EV infrastructure startup with offices in IIT-Madras Research Park and Noida.

Sonik Mobility is a brand of our company Azhar Engineering incubated at IIT-Madras Research Park, which is primarily focused on developing and deploying smartest, lOT enabled and the most user-friendly EV charging stations and semi-autonomous battery swap stations in India ranging from 3.3 kW to 22 kw.

We are a company founded by two graduates and friends namely Mohammad Safa Azhar and Preak Gupta from The Pennsylvania State University, USA and are the only company providing the dual solution of charging and semi-autonomous battery swapping stations under one roof.

Our ideal candidate for this position must have a penchant to learn new things and above all must have a passion to change the status quo of EV charging infrastructure in India.

We believe that charging your EV should be as easy as refueling your ice vehicle if not easier.


The Position: We're looking for a Software Engineer/ Full Stack Developer to work on our application and integration with third party APIs.


Objectives:

We are looking for a Software Engineer/Back-end Developer to work on our cloud-hosted application & integrate with 3rd party APIs. This will include the following:


  • Maintain and keep up-to-date our cloud-hosted application
  • Collaborate with the rest of the team to ensure applications align with organizational goals.
  • Oversee the performance of the application to ensure they're always running properly.

• Improve our overall application process and continuously find ways to advance our company vision.


Responsibilities: As a software engineer/ Back-end developer, these will be some of your responsibilities


  • Work closely with our hardware integration team to integrate the application with our hardware.
  • Ensure the application is hosted and fully functional on cloud (AWS).
  • Work closely with NPCI for integration into our system via APIs.
  • Carry out regular security and performance checks
  • Assesses feasibility of design and project parameters within time and cost constraints.


Requirements:


  • B-Tech/M-Tech in Computer Science/Electronics/Engineering
  • Proven experience of 2-3 vears (professional or otherwise)
  • Strong knowledge of programming languages such PHP, Python, C, or C++.
  • Knowledge of API integrations with 3rd party applications/hardware
  • Knowledge of software and hardware integration
  • Experience with hosting applications on cloud (AWS or Azure)
  • Working knowledge of software development tools and technologies
  • Desired skills:
  • Experience with Battery Management systems
  • Experience with CAN
  • Knowledge of OCPP protocol
  • AWS experience preferred
  • Strong communication and teamwork skills
  • Contribute individually to product solution development.


Read more
LeadSquared
Bengaluru (Bangalore)
6 - 12 yrs
₹1L - ₹24L / yr
Cloudera
TCP/IP
Customer Relationship Management (CRM)
Genesys
skill icon.NET
+7 more
LeadSquared is looking for Technical Manager to own the cloud telephony and contact center integration product as part of the engineering team at Bangalore. What we do? LeadSquared is a leading sales execution cloud platform used by over 25,000 users worldwide to accelerate revenue generation. Being a fast-growing cloud company, there are tons of exciting software engineering problems we solve that include integration, scalability, performance, automation, big-data analytics and machine learning. It is a great opportunity for engineers who love to solve complex problems and would like to be part of a journey to build world-class software.The Role :Being a sales execution platform, telephony plays a key role. We are seeking an individual who can completely own the integration of LeadSquared with major cloud telephony and contact center platforms. The role involves working closely with customers, partners and senior leadership of the company directly to define and refine a standard way to integrate with contact center platforms. Subsequently, work with a small team to build a high quality, maintainable and secure integration system. The ideal candidate would understand how to design and build applications involving integration with cloud services and will have some experience in contact center application development, CTI or cloud telephony. It is critical to have strong understanding of software engineering practices such as work item management, source control, test driven development and continuous integration. Key Requirements : - Passion for building and delivering great software with a strong sense of ownership. - Minimum of six-years full-stack experience in building cloud-based web applications using .NET or Java.- Experience in releasing software applications and supporting customers- Experience in leading small teams- Strong experience with Build and Release, Agile processes and Estimation/PlanningQuick Facts about LeadSquared :- Top rated product on crowd review site G2crowd- Listed as the best rated marketing automation vendor at TrustRadius - Listed among the top vendors globally at GetApp.- Listed as one of the top 10 Marketing Automation solutions on GetApp.- Featured as No.1 Marketing Automation Software in India by NASSCOM.- Featured twice in Deloitte's Technology Fast 50 India 2014, 2016 and 2017- Ranked as one of the Top 20 Most Popular Marketing Automation Software Solutions by CAPTERRA- Featured in India's Most Promising Startups in NextBigWhat List 2013 100+ Indian Startups- We are among the 14 fantastic startups out of 19,400 in India- We are in Red Herring Asia's Top 100 Finalists - 2014For more details about the product, please visit http://www.leadsquared.comHere are some other online resources that you can look at:https://www.g2crowd.com/products/leadsquared/reviewswww.facebook.com/leadsquaredhttps://www.linkedin.com/company/leadsquared Profiles of founders : http://www.leadsquared.com/teamTEAM TA
Read more
Tata Elxsi
Aishwarya Rani
Posted by Aishwarya Rani
Bengaluru (Bangalore), Chennai, Hyderabad, Calicut
4 - 10 yrs
₹6L - ₹16L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
skill iconAmazon Web Services (AWS)
+1 more

•Hands on experience in Object oriented programming

•Hands on experience in Java, SpringBoot (min 2 years) or kafka or Cassandra or MongoDB

•Experience with developing/enhancing applications connecting to different Databases : Oracle/MySQL/Cassandra/MongoDB

•Strong knowledge of common Data structures and algorithms and when to use them.

•Experience in Xpath or XML or REST or JSON or protobuff

• Experience with software version control (such as git)

•Experience in working in an agile environment such as Scrum.

Preferable:

•Experience in public cloud PaaS (AWS, GCP, Azure)

•Real time stream data handling (Kafka, Kinesis

Read more
Capgemini
at Capgemini
14 recruiters
Agency job
via Kadbit solutions by Kiran Sagar
Hyderabad
4 - 14 yrs
₹10L - ₹25L / yr
skill iconJava
skill iconSpring Boot
Hibernate (Java)
Data Structures
Microservices
+1 more

Job Description / Roles & Responsibilities (in Detail)Job Description

Work with Architect to define Application, Integration and Security Design for various components involved.

Design, development and build of java solution components/modules and integrations

Hands on knowledge in technology areas like Core Java, Java 8, Web services (SOAP and REST), Spring boot, Spring Frameworks, Spring Data JPA, REST/SOAP services, Spring cloud, Spring MVC, JSON & XML based processing. Strong command on Java/J2EE & OOPs concepts and current industry trends. Working knowledge of Java 8, 11 new features.

Working knowledge of cloud based server less application development on any of cloud platforms like AWS/Azure/GCP. Candidate with experience in Cloud native application development experience will be preferred.

Working knowledge in any of the databases like Mongo DB/Oracle/MySQL/SQL Server.

Working knowledge in any of messaging platforms like Apache Kafka/Rabbit MQ/JMS/AWS SQS/Azure Event Hub/Service Bus.

Production implementation experience for large enterprise applications using Java/J2EE will be preferred.

Experience in implementing Web services Security using WS-Security, SAML, OAUTH2, Kerberos and integrating with Identity providers, LDAP and ADFS. Experience working with credential vaults will be add-on.

Strong knowledge on design and integration patterns especially in applications involving Portals/SSO, legacy applications, B2B Applications, external partners using enterprise service bus.

Well versed with ensuring coding standards, DevOps CICD implementations, version management, branching strategy, security principles.

Ensure code quality and standards are followed. Experience in test automation is plus.

Up-to-date technical knowledge by attending educational workshops, reviewing publications

Read more
Siply Services
at Siply Services
1 recruiter
Ravi Chandra Soni
Posted by Ravi Chandra Soni
Bengaluru (Bangalore)
4 - 7 yrs
₹15L - ₹30L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
RESTful APIs
+4 more

About us:

Siply helps underserved masses inculcate savings behaviour to build a more productive and financially secure country. Our Vision is to build the Digital Bank for 40 Crore Underserved Indians.

Company Link - https://siply.in/">https://siply.in/

About the Role:

This is the Senior role where you will build systems and infrastructure to enable seamless user experience across all our offerings in the space of Micro-Savings, Micro-Credit, Micro-Insurance, and associated Value-Added Services. You will power the user experiences on the App and translate complex technical issues into Business opportunities.

Responsibilities:

  • Build the architecture for our Product platforms and take ownership for deliverables.
  • Good Understanding of all stage of software development and also mentoring team.
  • Design some of the most advanced & complex software systems / products in the industry.
  • Determine technical feasibility of medium to low complexity features or solutions by evaluating problem, possible solutions and technology requirements.
  • Exercise judgement in prioritizing tasks and selecting methods and techniques for obtaining solutions.
  • Collaborate and work closely with Engineering, Product and Design team.

Requirements:

  • 4 to 7 years of experience in software product development.
  • Degree in Computer Science or related field from top tier universities is preferred.
  • Excellent abstraction, coding and system design skills.
  • Strong hands-on technology experience building and running large scale systems handling multi-million sessions/transactions per day.
  • Strong experience in large scale Database systems like rdbms & NoSQL stores.
  • Excellent programming skills in Java/GO/NodeJS and expertise in multi- threading and performance-oriented programming.

Join us to be a part of our Growth Journey!




Read more
SKIT jaipur
at SKIT jaipur
2 recruiters
Devyani Devyani
Posted by Devyani Devyani
Bengaluru (Bangalore)
1 - 5 yrs
₹5L - ₹12L / yr
skill iconPython
skill iconDjango
skill iconFlask
API

Roles & Responsibilities:

  • You will be coordinating our enterprise account-specific teams called squads, consisting of members from engineering, machine-learning, and conversation-design teams.
  • There are five working groups in the organization, (i) Business (ii) Research (iii) Solutions (iv) Product, and (v) Operations, where you will be joining the Solutions, working group.
  • You will be collaborating with the sales team to design an appropriate solution to the customer's problems and help them showcase the value of the product.
  • You will be collaborating with the operations team to ensure we are not compromising on our quality standards.
  • You will also be co-working with the product working group to help them improve the overall platform and to prioritize the high-impact initiatives in the roadmap.

Work you will be doing:

  • You will be building bespoke voice bots for enterprise clients using internal tools.
  • You're expected to help build the Solutions stack whose goal is to reduce the amount of effort put into building our voice bots. 
  • You will be involved in analyzing client calls where you're expected to use either data pipelines or SQL to get insights into caller behavior.

Technical (Mandatory) Requirements

  • Professional experience of at least 1 year.
  • Has experience with integrating or building HTTP APIs
  • Has hands-on experience working with Python
  • Good communicator

Optional Requirements:

  • Has experience working in any of Django Rest Framework, Redis, Celery

Technical Stack

Skit uses a microservices architecture where we employ both HTTP and GRPC to communicate between our services

Read more
Hugobyte AI Labs
at Hugobyte AI Labs
1 recruiter
Allen Samuel
Posted by Allen Samuel
Remote only
1 - 5 yrs
₹4L - ₹14L / yr
skill iconGo Programming (Golang)
skill iconGit
Linux/Unix
Bash
skill iconDocker

Job Description

  • Develop p2p infrastructure systems to support blockchain interoperability
  • Improve engineering standards, tooling, and processes
  • Coding with concurrency, efficiency and scalability as primary motive
  • Rigor on Unit testing, coverage and best practices
  • Document systems, build runbooks, and automate those processes
  • Being hands on by writing, testing, and deploying high-performance networking code.

Required qualifications


1+ years of experience in Golang, Strong knowledge of Go programming language, paradigms, constructs, and idioms, willingness to learn on the go, ability to write clean code, a strong sense of responsibility.


Tech Stack


Go, git, linux, bash, ability to work with Docker.


Nice to have


Experience developing in c++, cryptography and system software development experience,understanding of design patterns, understanding of operating systems, networks.

Read more
Hugobyte AI Labs
at Hugobyte AI Labs
1 recruiter
Allen Samuel
Posted by Allen Samuel
Remote only
4 - 8 yrs
₹6L - ₹18L / yr
skill iconJava
Blockchain
skill iconGit
Linux/Unix
Bash
+1 more

Job Description:

  • Programming and optimizing smart contracts
  • Design, research and develop blockchain-based solutions
  • Developing decentralized high-performance systems
  • Building reliable and fast data storages
  • Security audits of third-party and internal solutions
  • Establishing policies and procedures that produce secure, high-quality software
  • Write and review technical proposals
  • Improve engineering standards, tooling, and processes
  • Coding with concurrency, efficiency and scalability as primary motive
  • Document systems, build runbooks, and automate those processes
  • Being hands on by writing, testing, and deploying high-performance networking code
  • Rigor on clean code, unit testing, code coverage and best practices
  • Developing infrastructure software

Required qualifications:


4+ years experience in JAVA, 1+ year of experience in Blockchain, willingness to learn on the go, ability to write clean code, a strong sense of responsibility.


Tech Stack:


JAVA, git, linux, bash, ability to work with Docker.

Nice to have:


cryptography and system software development experience, understanding of design patterns, understanding of operating systems and networks, ability to design algorithms and mathematical models.

Read more
Pune
4 - 9 yrs
₹4L - ₹12L / yr
skill iconJava
Hadoop
Spark
skill iconMachine Learning (ML)
Artificial Intelligence (AI)
We are looking to hire passionate Java techies who will be comfortable learning and working on Java and any open source frameworks & technologies. She/he should be a 100% hands-on person on technology skills and interested in solving complex analytics use cases. We are working on a complete stack platform which has already been adopted by some very large Enterprises across the world. Candidates with prior experience of having worked in typical R&D environment and/or product based companies with dynamic work environment will be have an additional edge. We currently work on some of the latest technologies like Cassandra, Hadoop, Apache Solr, Spark and Lucene, and some core Machine Learning and AI technologies. Even though prior knowledge of these skills is not mandatory at all for selection, you would be expected to learn new skills on the job.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos