Cutshort logo
Technology service company logo
Sr. Spark Software Engineer
Technology service company
Sr. Spark Software Engineer
Technology service company's logo

Sr. Spark Software Engineer

at Technology service company

Agency job
5 - 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Ansible
skill iconGit
JIRA
Apache Spark
Spark
Apache Kafka
Microservices
skill iconKubernetes
Terraform
NOSQL Databases
API
skill iconDocker
  • Bachelor’s or master’s degree in Computer Engineering, Computer Science, Computer Applications, Mathematics, Statistics, or related technical field. Relevant experience of at least 3 years in lieu of above if from a different stream of education.

  • Well-versed in and 3+ hands-on demonstrable experience with: ▪ Stream & Batch Big Data Pipeline Processing using Apache Spark and/or Apache Flink.
    ▪ Distributed Cloud Native Computing including Server less Functions
    ▪ Relational, Object Store, Document, Graph, etc. Database Design & Implementation
    ▪ Micro services Architecture, API Modeling, Design, & Programming

  • 3+ years of hands-on development experience in Apache Spark using Scala and/or Java.

  • Ability to write executable code for Services using Spark RDD, Spark SQL, Structured Streaming, Spark MLLib, etc. with deep technical understanding of Spark Processing Framework.

  • In-depth knowledge of standard programming languages such as Scala and/or Java.

  • 3+ years of hands-on development experience in one or more libraries & frameworks such as Apache Kafka, Akka, Apache Storm, Apache Nifi, Zookeeper, Hadoop ecosystem (i.e., HDFS, YARN, MapReduce, Oozie & Hive), etc.; extra points if you can demonstrate your knowledge with working examples.

  • 3+ years of hands-on development experience in one or more Relational and NoSQL datastores such as PostgreSQL, Cassandra, HBase, MongoDB, DynamoDB, Elastic Search, Neo4J, etc.

  • Practical knowledge of distributed systems involving partitioning, bucketing, CAP theorem, replication, horizontal scaling, etc.

  • Passion for distilling large volumes of data, analyze performance, scalability, and capacity performance issues in Big Data Platforms.

  • Ability to clearly distinguish system and Spark Job performances and perform spark performance tuning and resource optimization.

  • Perform benchmarking/stress tests and document the best practices for different applications.

  • Proactively work with tenants on improving the overall performance and ensure the system is resilient, and scalable.

  • Good understanding of Virtualization & Containerization; must demonstrate experience in technologies such as Kubernetes, Istio, Docker, OpenShift, Anthos, Oracle VirtualBox, Vagrant, etc.

  • Well-versed with demonstrable working experience with API Management, API Gateway, Service Mesh, Identity & Access Management, Data Protection & Encryption.

    Hands-on experience with demonstrable working experience with DevOps tools and platforms viz., Jira, GIT, Jenkins, Code Quality & Security Plugins, Maven, Artifactory, Terraform, Ansible/Chef/Puppet, Spinnaker, etc.

  • Well-versed in AWS and/or Azure or and/or Google Cloud; must demonstrate experience in at least FIVE (5) services offered under AWS and/or Azure or and/or Google Cloud in any categories: Compute or Storage, Database, Networking & Content Delivery, Management & Governance, Analytics, Security, Identity, & Compliance (or) equivalent demonstrable Cloud Platform experience.

  • Good understanding of Storage, Networks and Storage Networking basics which will enable you to work in a Cloud environment.

  • Good understanding of Network, Data, and Application Security basics which will enable you to work in a Cloud as well as Business Applications / API services environment.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

1HResource Solutions
Ankush Sethi
Posted by Ankush Sethi
Bengaluru (Bangalore)
3 - 6 yrs
₹3L - ₹7L / yr
skill iconJava
skill iconSpring Boot
RESTful APIs
Microservices

Java Developer (Backend) – 3+ Years Experience | Bangalore |


We are looking for a passionate and driven Backend Java Developer who thrives in building scalable systems from the ground up. If you enjoy solving complex problems, working in fast-paced environments, and owning your work end-to-end, this role is for you.


Key Responsibilities:

Design, develop, and maintain scalable backend systems using Java and Spring Boot.

Build and optimize RESTful APIs and microservices architectures.

Write clean, efficient, and high-performance code that can handle large-scale applications.

Collaborate closely with product and business teams to translate requirements into technical solutions.

Take ownership of features from design to deployment, ensuring reliability and performance.

Continuously improve system architecture, performance, and scalability.

Required Skills & Experience:

3+ years of experience in backend development using Java.

Strong hands-on experience with Spring Boot framework.

Proven experience working in product-based startups or fintech environments (preferred).

Solid understanding of microservices architecture and distributed systems.

Expertise in designing modular, scalable, and maintainable systems.

Strong problem-solving skills and ability to write optimized, production-grade code.

Ability to balance technical decisions with business impact.

Who Should Apply:

Candidates who enjoy building systems from scratch and working in early-stage/startup environments.

Individuals with a high sense of ownership, accountability, and initiative.

Developers who are self-driven, adaptable, and eager to learn.

Read more
Fintech
Fintech
Agency job
via PLEXO HR Solutions by Upashna Kumari
Gurugram
2 - 6 yrs
₹15L - ₹28L / yr
skill iconJavascript
06692
skill iconAmazon Web Services (AWS)
skill iconDocker
skill iconMachine Learning (ML)
+5 more

Responsibilities:

● Design, develop, and maintain scalable backend services and APIs using Java and Spring

Boot.

● Create and optimize SQL database schemas and queries in PostgreSQL to ensure efficient

data storage and retrieval.

● Implement RESTful APIs to facilitate seamless communication between frontend and backend

components.

● Configure and manage Nginx web servers to efficiently handle incoming requests and improve

application performance.

● Deploy and manage applications on AWS or GCP, ensuring scalability, reliability, and

security.

● Configure and optimize message broker systems using Kafka for real-time data processing

and communication.

● Containerize applications using Docker for easy deployment, scaling, and management.

● Create detailed Low-Level Designs (LLDs) and High-Level Designs (HLDs) to guide the

development and architecture of backend systems.

● Automating CI/CD pipelines and streamlining the software development lifecycle.


● Integrate AI/ML models into backend workflows using Python, PyTorch/TensorFlow, or

third-party AI APIs.

● Leverage AI tools (e.g., OpenAI APIs, Hugging Face, AWS AI services) to build intelligent

features.

● Collaborate closely with frontend developers, product managers, data scientists, and other

stakeholders to deliver high-quality AI-powered solutions.

● Monitor and troubleshoot production systems to ensure optimal performance, reliability, and

uptime.

What We’re Looking For:

● Bachelor’s degree in Computer Science, Engineering, or related field.

● 3-5 years of experience in backend development.

● Proficiency in Java, Spring Boot, PostgreSQL, SQL, and GitActions.

● Strong understanding of RESTful API design principles and best practices.

● Experience with configuring and optimizing Nginx web servers.

● Experience with configuring and optimizing Kafka service.

● Hands-on experience with AWS or GCP.

● Familiarity with Docker containers and container orchestration.

● Ability to create comprehensive Low-Level Designs (LLDs) and High-Level Designs (HLDs)

for backend systems.

● Experience with Python for AI/ML model integration in backend services.

● Familiarity with AI platforms and APIs such as OpenAI, Hugging Face, AWS AI/ML, or GCP

Vertex AI.

● Excellent problem-solving skills and attention to detail.

● Strong communication and collaboration skills, with the ability to work effectively in a team

environment.


Preferred Qualifications:

● Knowledge of microservices architecture and related technologies.

● Experience with cloud-native development and serverless computing.

● Understanding of software development best practices, including Agile methodologies

Read more
Into designing a generic ML platform team as a product
Into designing a generic ML platform team as a product
Agency job
via Qrata by Blessy Fernandes
Bengaluru (Bangalore)
3 - 6 yrs
₹20L - ₹25L / yr
skill iconPython
AWS Lambda
Spark

Requirements

  • 3+ years work experience with production-grade python. Contribution to open source repos is preferred
  • Experience writing concurrent and distributed programs, AWS lambda, Kubernetes, Docker, Spark is preferred.
  • Experience with one relational & 1 non-relational DB is preferred
  • Prior work in the ML domain will be a big boost

What You’ll Do

  • Help realize the product vision: Production-ready machine learning models with monitoring within moments, not months.
  • Help companies deploy their machine learning models at scale across a wide range of use-cases and sectors.
  • Build integrations with other platforms to make it easy for our customers to use our product without changing their workflow.
  • Write maintainable, scalable performant python code
  • Building gRPC, rest API servers
  • Working with Thrift, Protobufs, etc.
Read more
IntelliFlow Solutions Pvt Ltd
at IntelliFlow Solutions Pvt Ltd
2 candid answers
Divyashree Abhilash
Posted by Divyashree Abhilash
Bengaluru (Bangalore)
1 - 4 yrs
₹4L - ₹10L / yr
skill iconJava
J2EE

The ideal candidate should be a proactive individual with strong communication skills and a team player. He or she should have an experience of at least 1-2 years in Java development.



Should have hands-on experience in the following:


  1. Hands on experience in designing and developing applications using Java EE platforms and at least 1-2 years’ experience on the same.
  2. Should have excellent in-depth knowledge on Core Java
  3. Experience in multi-threaded server-side Java programming
  4. Working knowledge on web services.
  5. Working knowledge on hibernate and springs framework.
  6. Added advantage if worked in any of the BPM tools
  7. Should have worked in SDLC environment.
  8. Good communication skills.
  9. Experience in working effectively within a team.
Read more
Acceldata
at Acceldata
5 recruiters
Richa  Kukar
Posted by Richa Kukar
Bengaluru (Bangalore)
10 - 15 yrs
₹40L - ₹70L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Big Data
Greetings!
 
Please find the role details below and confirm your interest.

 

Founder and CEO- https://www.linkedin.com/in/rconline" target="_blank">linkedin.com/in/rconline

Fundings Discussion and Interviews-  https://www.youtube.com/watch?v=5J6jDS7mxXk&;t=2s" target="_blank">https://www.youtube.com/watch?v=5J6jDS7mxXk&t=2s

Acceldata Demo- https://www.youtube.com/watch?v=icveuPmfypM" target="_blank">https://www.youtube.com/watch?v=icveuPmfypM

Co-Founder- https://www.linkedin.com/in/w1nash" target="_blank">linkedin.com/in/w1nash 

Co-Founder- https://www.linkedin.com/in/raghumitra" target="_blank">linkedin.com/in/raghumitra
 
Acceldata is creating the Data observability space. We make it possible for data-driven enterprises to effectively monitor, discover, and validate Data pipelines at Petabyte scale. Our customers include a Fortune 500 company, one of Asia's largest telecom companies, and a unicorn fintech startup. We are lean, hungry, customer-obsessed, and growing fast. Our Solutions team values productivity, integrity, and pragmatism. We provide a flexible, remote-friendly work environment.
 
We are building software that can provide insights into companies' data operations and allows them to focus on delivering data reliably with speed and effectiveness. Join us in building an industry-leading data operations platform that focuses on optimizing modern data lakes for both on-premise and cloud environments.

Product Responsibilities:

 

As an Engineering Manager, you will be responsible for the end-to-end delivery of one or more products and solutions.

10+ years of relevant industry experience.

Be technically strong and deliver product excellence.

Collaborate with your team and cross-functional partners to define and influence strategy.

Drive roadmap creation and execution.

Collaborate with various functions, drive engineering initiatives, and have an impact at an organizational level.

Participate in technical design. You will be the owner of the technical direction of the products.

Define clear OKRs and measure the impact of your team and individual members.

Evangelize your products across various teams and also to external customers.

Work with the GTM team to deliver success for the products.

Collaborate with the Recruitment/HR team to hire exceptional talent for your own team and also for other teams.

 

Minimum Qualifications:

 

Bachelor degree preferably in Computer Science from a reputed engineering college.

10+ years of proven experience, with 2+ years of leading a team.

Very strong in hands-on coding.

8+ years of combined experience in JVM languages(Java, Scala, Kotlin, etc), any scripting language like python, relational and non-relational databases.

Very strong in system design. You should have designed and implemented large-scale Web applications or data systems.

Strong verbal and written communication skills.

Demonstrated experience recruiting and managing technical teams, including performance management.

 

 

Good to have:

Don't worry, we'll ramp you up, but experience in any of these areas will help you hit the ground running:

Familiarity with technologies such as Apache Spark, Apache Hadoop ecosystem, and modern warehouses like Snowflake, AWS Redshift, etc.

Experience working with public cloud systems such as AWS, GCP, or Azure.

Experience with containerization and technologies such as Kubernetes and Docker.

 Knowledge of large-scale, data-heavy distributed systems.

Read more
Cornertree
at Cornertree
1 recruiter
Pallavi M
Posted by Pallavi M
Bengaluru (Bangalore), Chennai
4 - 6 yrs
₹11L - ₹15L / yr
skill icon.NET
ASP.NET
skill iconC#
skill iconAngularJS (1.x)
skill iconAngular (2+)
+9 more
 Exp in  product design and support experience
 Required Skills: Angular 11/12, .NET framework, .NET Core, Web APIs, Web Security,
Microservices, Event driven architecture, Clean Code and 12 Factor principles, Azure
PaaS services experience, public facing web application development, web analytics,
Bootstrap v5, Angular Material, jQuery, HTML/CSS, SQL Server, Transact-SQL, Azure
SQL
 Experience working with software design, software development life cycle, and
development methodologies and implementation
 Experience working with product systems design principles
 Experience working with appropriate programming languages, operating systems,
hardware and software
 Experience working with company application development policies and procedures
 Experience working with company software and hardware products and related
business issues that may impact overall business plans
Read more
Chennai, Pune, Bengaluru (Bangalore), Jaipur
5 - 8 yrs
₹13L - ₹25L / yr
skill iconRuby on Rails (ROR)
skill iconRuby
skill iconPostgreSQL
AWS Lambda
skill iconGit
+6 more
ROR Developer
Location: Chennai, Pune,Banglore,jaipurExp: 5 yrs to 8 yrs

  • Implement best practices for the engineering team across code hygiene, overall architecture design, testing, and deployment activities
  • Drive technical decisions for building data pipelines, data lakes, and analyst access.
  • Act as a leader within the engineering team, providing support and mentorship for teammates across functions
  • Bachelor’s Degree in Computer Science or equivalent job experience
  • Experienced developer in large data environments
  • Experience using Git productively in a team environment
  • Experience with Docker
  • Experience with Amazon Web Services
  • Ability to sit with business or technical SMEs to listen, learn and propose technical solutions to business problems

·       Experience using and adapting to new technologies

·       Take and understand business requirements and goals

·       Work collaboratively with project managers and stakeholders to make sure that all aspects of the project are delivered as planned

·       Strong SQL skills with MySQL or PostgreSQL

  • Experience with non-relational databases and their role in web architectures desired

 Knowledge and Experience:

  • Good experience with Elixir and functional programming a plus
  • Several years of python experience
  • Excellent analytical and problem-solving skills
  • Excellent organizational skills

Proven verbal and written cross-department and customer communication skills

 

Read more
Nlb Services Pvt Ltd
at Nlb Services Pvt Ltd
4 recruiters
Nirosha Bandaru
Posted by Nirosha Bandaru
Hyderabad, Bengaluru (Bangalore), Mumbai
4 - 12 yrs
₹10L - ₹30L / yr
Hybris
skill iconJava
J2EE
skill iconSpring Boot
SOAP
+1 more
Experience with Hybris 6.x with knowledge of Hybris B2C-ACCELERATOR/HYBRIS
-B2B-ACCELERATOR, Hybris back-office, Hybris Frontend WCMS cockpit, product
cockpit, Hybris, Hybris core, Hybris Commerce, Hybris Search
 Experience working on Java, J2EE, Spring, Web Services (SOAP, REST), Design
Patterns, Apache, Tomcat, Build Tools- Ant/Maven/Jenkins, SCM Tools
CVS/SVN/GIT Hub
 Knowledge of one or more modules: HYBRIS-OCC, HYBRIS-PIM, HYBRIS-
PROMOTIONS
 Additional skills in SOA, ESB, JMS
 Passionate about writing world-class code
 High level of commitment to client satisfaction and agility
 Collaborate with others and build positive working relationships
 Possess a strong work ethic
 Strong written and verbal communication skills
Read more
Noida Sec-62
Noida Sec-62
Agency job
via Click1Solutions by Yukti K
NCR (Delhi | Gurgaon | Noida), Gaziabad
11 - 20 yrs
₹30L - ₹34L / yr
skill iconJava
J2EE
Multithreading
Spring
Data Structures
+10 more

Technical Competencies

  • Strong Java/J2EE development experience with demonstrated ability to develop and troubleshoot large mission applications & Software Products
  • Experience on exception handling, correct use of data structures, multi-threaded programming, memory management and application tuning
  • Excellent exposure in Object Oriented Design skills using Java/J2ee along with:
  • Core Java Language (Collections, Concurrency/Multithreading)
  • JDBC concepts (connection pooling, statement, result set)
  • Web Technologies (Struts/Struts 2, Spring (IOP, MVC, AOP), Hibernate, JSP, Web services)
  • Database optimization and profiling
  • Core/JEE/Integration Design patterns/UML
  • Should have experience in Unit Testing
  • Good hands on experience with RDBMS like MySQL/Oracle with ability to write SQL Queries/Stored Procedures/Triggers/Joins/View etc
  • Practical application of software product development standards and methodologies including Agile, XP, Kanban, RUP and UML
  • Ability to apply design patterns consistently and also accurate when building per design requirements
  • Good experience in source control, unit testing, code verification, documentation, automated build, continuous integration, metrics, and code reviews.
  • Demonstrated problem solving, analytic and troubleshooting skills.
  • Strong written and oral communication skills are required to effectively engage internal stakeholders and their technical representatives.
Read more
GoGo Air, Inflight Internet Company
GoGo Air, Inflight Internet Company
Agency job
Chennai
2 - 7 yrs
₹6L - ₹25L / yr
Spring
Microservices
skill iconJava
NOSQL Databases
Software deployment
+3 more
- In-depth development experience with Java, Java framework(Spring, Springboot and other microservices). - Experience building highly scalable distributed systems. - Design and develop globally deployed cloud based micro-services solutions with high availability. - Web Services, Web APIs, and micro-services. - Solid experience with SQL and NoSQL based solutions. Nice to Have Skills: - Some level of excellence such as alumnus of a premium institute, or work experience with companies like Indix, Amazon, Verizon, Cisco (mostly Prod companies with good hands-on) - Reactive programming - RxJava, Akka Play. - AWS deployments - Experience working in a DevOps environment with continuous deployments. - Functional programming.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos