Cutshort logo
Technology service company logo
Sr. Spark Software Engineer
Technology service company
Sr. Spark Software Engineer
Technology service company's logo

Sr. Spark Software Engineer

at Technology service company

Agency job
5 - 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Ansible
skill iconGit
JIRA
Apache Spark
Spark
Apache Kafka
Microservices
skill iconKubernetes
Terraform
NOSQL Databases
API
skill iconDocker
  • Bachelor’s or master’s degree in Computer Engineering, Computer Science, Computer Applications, Mathematics, Statistics, or related technical field. Relevant experience of at least 3 years in lieu of above if from a different stream of education.

  • Well-versed in and 3+ hands-on demonstrable experience with: ▪ Stream & Batch Big Data Pipeline Processing using Apache Spark and/or Apache Flink.
    ▪ Distributed Cloud Native Computing including Server less Functions
    ▪ Relational, Object Store, Document, Graph, etc. Database Design & Implementation
    ▪ Micro services Architecture, API Modeling, Design, & Programming

  • 3+ years of hands-on development experience in Apache Spark using Scala and/or Java.

  • Ability to write executable code for Services using Spark RDD, Spark SQL, Structured Streaming, Spark MLLib, etc. with deep technical understanding of Spark Processing Framework.

  • In-depth knowledge of standard programming languages such as Scala and/or Java.

  • 3+ years of hands-on development experience in one or more libraries & frameworks such as Apache Kafka, Akka, Apache Storm, Apache Nifi, Zookeeper, Hadoop ecosystem (i.e., HDFS, YARN, MapReduce, Oozie & Hive), etc.; extra points if you can demonstrate your knowledge with working examples.

  • 3+ years of hands-on development experience in one or more Relational and NoSQL datastores such as PostgreSQL, Cassandra, HBase, MongoDB, DynamoDB, Elastic Search, Neo4J, etc.

  • Practical knowledge of distributed systems involving partitioning, bucketing, CAP theorem, replication, horizontal scaling, etc.

  • Passion for distilling large volumes of data, analyze performance, scalability, and capacity performance issues in Big Data Platforms.

  • Ability to clearly distinguish system and Spark Job performances and perform spark performance tuning and resource optimization.

  • Perform benchmarking/stress tests and document the best practices for different applications.

  • Proactively work with tenants on improving the overall performance and ensure the system is resilient, and scalable.

  • Good understanding of Virtualization & Containerization; must demonstrate experience in technologies such as Kubernetes, Istio, Docker, OpenShift, Anthos, Oracle VirtualBox, Vagrant, etc.

  • Well-versed with demonstrable working experience with API Management, API Gateway, Service Mesh, Identity & Access Management, Data Protection & Encryption.

    Hands-on experience with demonstrable working experience with DevOps tools and platforms viz., Jira, GIT, Jenkins, Code Quality & Security Plugins, Maven, Artifactory, Terraform, Ansible/Chef/Puppet, Spinnaker, etc.

  • Well-versed in AWS and/or Azure or and/or Google Cloud; must demonstrate experience in at least FIVE (5) services offered under AWS and/or Azure or and/or Google Cloud in any categories: Compute or Storage, Database, Networking & Content Delivery, Management & Governance, Analytics, Security, Identity, & Compliance (or) equivalent demonstrable Cloud Platform experience.

  • Good understanding of Storage, Networks and Storage Networking basics which will enable you to work in a Cloud environment.

  • Good understanding of Network, Data, and Application Security basics which will enable you to work in a Cloud as well as Business Applications / API services environment.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos

Similar jobs

RABLIK PRIVATE LIMITED
at RABLIK PRIVATE LIMITED
2 candid answers
Aditya Kashyap
Posted by Aditya Kashyap
Remote, Raipur, Jagdalpur
0 - 5 yrs
₹3L - ₹12L / yr
skill iconPython
skill iconJava
skill iconNodeJS (Node.js)
skill iconPHP
skill iconRuby
+5 more

Company Overview

Rablik Private Limited is an expanding IT company registered in Jagdalpur, Chhattisgarh, with a work office located in Raipur. We provide a range of digital solutions, including website development, mobile app development, digital marketing, and SEO. As part of our growth, we’re looking for a skilled Backend Developer to join our team and help develop efficient, scalable, and secure back-end applications.


Job Summary

The Backend Developer will be responsible for server-side application logic, database management, and ensuring high performance and responsiveness of applications. This role is ideal for candidates with a strong background in back-end development, ready to work on cutting-edge projects and collaborate with front-end developers to create seamless, user-centered experiences.


Key Responsibilities

  • Develop and maintain server-side applications, ensuring security, performance, and scalability.
  • Create and manage APIs, facilitating efficient communication between the client and server.
  • Work with databases to design, develop, and maintain data structures that support web applications.
  • Troubleshoot, debug, and upgrade software systems.
  • Collaborate with front-end developers and other team members to integrate user-facing elements with server logic.
  • Optimize applications for maximum speed and scalability.
  • Stay updated with emerging technologies and trends in backend development.


Required Qualifications

  • Bachelor’s degree in Computer Science, Information Technology, or a related field.
  • Technical Skills:
  • Proficiency in back-end languages like Python, Java, Node.js, PHP, or Ruby.
  • Strong knowledge of SQL and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB).
  • Experience with RESTful APIs and/or GraphQL.
  • Familiarity with server management and deployment (e.g., AWS, Azure, or Google Cloud).


Experience Requirement

  • For Freshers: Candidates with relevant internships or academic projects in back-end development are encouraged to apply.
  • For Experienced Candidates: A minimum of 2+ years of experience in backend development, with a proven ability to develop robust and scalable back-end solutions.


Preferred Qualifications

  • Experience with cloud platforms (AWS, Azure, Google Cloud) and serverless architecture.
  • Familiarity with CI/CD pipelines and DevOps practices.
  • Understanding of front-end technologies (HTML, CSS, JavaScript) for integration purposes.
  • Strong problem-solving skills and attention to detail.


Salary

  • Freshers: Competitive starting salary based on skills and potential.
  • Experienced: Higher salary range based on experience level and expertise.


What We Offer

  • Opportunities for growth and advancement in a dynamic environment.
  • EPF and health insurance benefits.
  • Collaborative team culture and regular training sessions.


Read more
A leading company who makes multilingual conversational chatbots. Their platform uses real-time insights and cues to help users improve their experience
A leading company who makes multilingual conversational chatbots. Their platform uses real-time insights and cues to help users improve their experience
Agency job
via Jobdost by Saida Jabbar
Noida
2 - 6 yrs
₹7L - ₹12L / yr
MERN Stack
skill iconNodeJS (Node.js)
Multilingual
skill iconMongoDB
skill iconRedis
+5 more
Job Profile:-
We’re in search of a Back-End Software Engineer that specializes in server-side components. In this role,
you’ll primarily work on Node JS, Mongo DB, Redis, building scalable products and will bring a depth of
knowledge on algorithms and data structures. As a Back-End Software Engineer, on any given day you
might be architecting new features for our customers, refactoring existing code to be more scalable, and
seeing changes through to completion in a live environment.
Key Attributes you need to possess: -
- Prioritization- Should have a strong work ethics and show up on time at sessions with excellent skills
in predicting the amount of time needed to plan, coordinate, and perform on a task or managing their
clients as and when required.
- Quick Learning Ability- You should be an amazing self-learner who has the ability to learn new
technology on their own and are not threatened by new technologies. Someone who has an ability to pull
various bits of information and to process information on the fly with good logical and analytical skills.
- Deep and Broad Technical Experience- Someone who is able to hit the ground because they already
know the right technology.They should be able to meet coding principles and write code that is readable
and commented-on where appropriate.Through incorporating their cognitive abilities and extensive
industry experience, they are able to find optimal solutions easily.
- High-End User Focus-A good programmer does what they are asked to do, while a great programmer
thinks of the end user of the software and works to solve problems within the organization’s
capabilities.Someone who knows the functionality they’re creating is of high value.
-Business Acumen- Should have a great eye for Business acumen as the product build will be exposed to
millions of customers on-brand digital assets hence giving you exposure for handling a large user base in
a live environment.
-Teamplayer- Someone who is able to work in a challenging environment and requires complete
devotion, persistence and learning new things every day. As they will be involved in every fact of the
product development starting from product ideation, Interface design, user experience, analytics, and
engineering.
Typical work week look like:-
- Collaborating with the front-end developers and other team members to establish objectives and design
more functional, cohesive codes to enhance the user experience.
- Design and implementation of scalable applications by using asynchronous programming with
low-latency, high-availability, and performant applications between multiple systems, servers, and
environments.
-Integration of data storage solutions by creating database schemas that represent and support business
processes and also Integrating multiple data sources and databases into one system.
- Building reusable code and libraries for future use.
- Explore technical innovation and propose new solutions as and when required.
- Work with engineers, product managers and senior leadership to turn our product and technical vision
into a tangible roadmap every month.
Our ideal candidate should have:-
- 2+ years of relevant experience in a Tech Startup
- A solid grounding in Computer Science fundamentals (based on a BE/BTech or MS in Information
Technologies/Computer Science)
- Strong proficiency with JavaScript and knowledge of Node.js and frameworks.
- Strong hands on MongoDB and ability to write aggregation queries.
- Basic understanding of front-end technologies, such as HTML5, and CSS3.
- Hands-on on code versioning tools, such as Git, Redis, AWS, Sockets
Read more
Zono Tradetech Pvt Ltd
at Zono Tradetech Pvt Ltd
1 recruiter
Sidda Bhavana
Posted by Sidda Bhavana
Hyderabad
4 - 8 yrs
₹16L - ₹24L / yr
skill iconNodeJS (Node.js)
skill iconMongoDB
skill iconExpress
MERN Stack
JSON
+10 more

Position Overview: We are looking for a senior developer who must be capable of building services using modern microservices architecture with NodeJS & serverless frameworks. Should have strong knowledge of ObjectOriented Concepts, and Node. Js frameworks like loopback, RDBMS, and microservice patterns. The candidate should be comfortable with application coding based on design and specifications, and also be comfortable working with JSON and RESTful services. The candidate must be a top-notch developer committed to keeping learning new things and becoming an integral part of and fostering growth within our development team.


Roles & Responsibilities:

  • Developing and maintaining the backend systems that support the application
  • Designing and implementing APIs and Microservices architecture to handle the application workload
  • Developing and optimizing queries for RDBMS (MySQL) to manage data and ensure performance and scalability
  • Managing and deploying the application on AWS using Lambda, ECS and other related services
  • Collaborating with front-end developers to ensure smooth communication between front-end and back-end systems and back-end systems
  • Writing clean, neat and reusable code that follows coding standards and best practices.
  • Participating in code reviews and ensuring that coding standards are maintained
  • Troubleshooting and debugging issues that arise in production environments
  • Optimizing the application for performance, scalability, and security
  • Continuously learning and staying up-to-date with the latest technologies and best practices in software development
  • Documenting technical specifications, processes, and system design
Read more
Foxit Software
Chandra Bisht
Posted by Chandra Bisht
Noida
3 - 5 yrs
₹12L - ₹15L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Spring
+7 more

·       3+ yrs of experience in product development (Preferring SaaS based)

·       Must have experience in Java web-based application development

·       Hands on development experience on Java/J2EE, Springboot, Spring, Struts, Hibernate, REST Services

·       Experience on HTML, JavaScript, JQuery

·       Hands on experience on database-writing queries/procedures

·       Experience on SVN,GIT,

·       Knowledge of Server configuration

·       Knowledge of cloud preferably AWS

Read more
Zumen Software India Pvt Ltd
harishankar krishnamurthi
Posted by harishankar krishnamurthi
Chennai
2 - 6 yrs
₹7L - ₹15L / yr
skill iconJava
skill iconSpring Boot
Microservices
RESTful APIs
Company website http://www.zumen.com/" target="_blank">www.zumen.com

Zumen is a Cloud-based Source-to-Pay software for product manufacturing companies.Zumen enables product manufacturing companies to digitize their direct sourcing and procurement, and manage every detail of the process in a transparent, collaborative platform. With Zumen’s part life cycle management, BOM interface, supplier base visibility and product cost management, companies can build an agile, resilient supply chain and get their products to market faster. Zumen is headquartered in Delaware, USA

 

 

Responsibilities:

  • Develop features and modules independently based on the overall product architecture provided.
  • Research and find solutions to challenging new problems; align with technology needs of the future.
  • Fully grasp the product concept and think through challenging customer variations and use cases.
  • Proactively seek to identify issues and resolve them at the stages of design, deployment and QA.
  • Maintain quality and ensure responsiveness of applications.
  • Demonstrate a strong sense of milestone-based performance and adherence to overall development timelines.

 

Requirements:

Experience - 2 to 5 years experience in Java Tech stack

  • Strong hands-on experience in Java, Spring Boot, microservices and Rest API.
  • Good understanding of general data privacy and information security.
  • Exposure to cloud securities for SAAS application development would be an added advantage.
  • A good understanding of all facets of building and delivering data-centric products is desirable.
  • Knowledge of code versioning tools.
Read more
Sapper.ai
at Sapper.ai
2 recruiters
Amol K
Posted by Amol K
Pune
8 - 16 yrs
Best in industry
skill iconJava
Apache Kafka
skill iconSpring Boot
Technical Architecture
Apache Camel
+6 more
Sapper.AI is building the next generation intelligent automation software. We are a young startup and if you are looking at exciting work, long hours and lot of learning, have a passion to create new innovation and go-getter attitude, this is the place to be.

Built on a foundation of AI we are automating enterprise application integration, data integration, data preparation for Analytics and bot automation. We are looking to build our engineering development center in Pune with passionate and entrepreneurial developers at all levels (Interns, Fresh Graduates, Senior Software Engineers and Architects).


As a Architect/Technology Lead you will be involved in design and development of enterprise automation. Knowledge of building workflow engines, microservices design patterns, experience with large scale enterprise architectures, springboot, kafka, data management and caching is needed. At a startup you will be wearing multiple hats engineering, presales, talking to customers, setting up operational processes.
Read more
RUBRIK INDIA
at RUBRIK INDIA
1 recruiter
Aarthi Devi
Posted by Aarthi Devi
Bengaluru (Bangalore)
3 - 18 yrs
₹35L - ₹120L / yr
skill iconJava
skill iconPython
skill iconC++
Multithreading
Scalability
+5 more

ABOUT THE JOB

We are looking for a Senior Software Engineer to join our team. We believe in giving engineers responsibility, not tasks. Our goal is to motivate and challenge people to do their best work. To do that, we have a very fluid structure and give people flexibility to work on projects that they enjoy the most. This develops more capable engineers, and keeps everyone engaged and happy.

Responsibilities

  • Design, develop, test, deploy, maintain and improve the software.
  • Manage individual projects priorities, deadlines and deliverables with your technical expertise.
  • Identify and solve for bottlenecks within our software stack.

ABOUT YOU

Rubrik Software Engineers are self-starters, driven, and can manage themselves.  Bottom line, if you have a limitless drive and like to win, we want to talk to you - come make history! 

  • Bachelor’s or Master’s degree or equivalent in computer science or related field
  • 8+ years of relevant work experience, 
  • Proficiency in one or more general purpose programming languages like Java, C/C++, Scala, Python
  • Experience with Google Cloud Platform/AWS/Azure or other public cloud technologies is a plus
  • Experience working with two or more from the following: Unix/Linux environments, Windows environments, distributed systems, networking, developing large software systems, file systems, storage systems, hypervisors, databases and/or security software development.

 ABOUT THE TEAM

Galactus team owns the end to end development of Rubrik’s data management suite for commercial public clouds - AWS, Azure and GCP. Our objective is to bring the simplicity of Rubrik’s on-prem data protection and management offerings to our customers in the cloud through a solution designed from ground up to be highly scalable, available & secure and yet optimized to minimize our customer’s cloud costs. We achieve this by taking a cloud-first approach to design - leveraging technologies built for the scale, elasticity and automation needs of the cloud; and deploying on our brand new SaaS platform called Polaris.

Recently we have :-

  • Built policy based backup and recovery for Virtual Machines in AWS, Azure and GCP and managed databases in AWS.
  • Built features like granular file recovery leveraging managed Kubernetes Service in AWS for elastic compute

 ABOUT RUBRIK

Rubrik is one of the fastest-growing companies in Silicon Valley, revolutionising data protection, and management in the emerging multi-cloud world. We are the leader in cloud data management, delivering a single platform to manage and protect data in the cloud, at the edge, and on-premises. Enterprises choose Rubrik to simplify backup and recovery, accelerate cloud adoption, enable automation at scale, and secure against cyberthreats. We’ve been recognized as a Forbes Cloud 100 Company two years in a row and as a LinkedIn Top 10 startup. 

Rubrik provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability or genetics. In addition to federal law requirements, Rubrik complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.

Read more
Anveshak Technology and Knowledge Solutions
Sandeep Tonapi
Posted by Sandeep Tonapi
Pune
0 - 2 yrs
₹1L - ₹2L / yr
skill iconJava
J2EE
Struts
Spring
Hibernate (Java)
+1 more
Looking for fresh and experienced candidates with sound knowledge of Advanced Java with hands-on experience. Experience using frameworks like Spring and Hibernate will be an added advantage. Excellent logic and analytical skills are required. Ablity to work individually as well as part of diverse teams. Good communication skills are also required.
Read more
Planify
at Planify
2 recruiters
Rajesh Singla
Posted by Rajesh Singla
NCR (Delhi | Gurgaon | Noida)
1 - 5 yrs
₹3L - ₹6L / yr
Spring
skill iconPostgreSQL
skill iconJava
J2EE
Struts
+2 more
Candidate should have :
Strong technical background in Java, spring (MVC), RESTFUL Web services and Postgres DB
Thorough understanding of the responsibilities of the platform, database, API, caching layer, proxies, and other web services used in the system
Validating user actions on the client side and providing responsive feedback
Writing non-blocking code, and resorting to advanced techniques such as multi-threading, when needed
Read more
The Digital Group
at The Digital Group
1 recruiter
Kishor Nikalje
Posted by Kishor Nikalje
Mumbai, Pune, Bengaluru (Bangalore)
5 - 10 yrs
₹7L - ₹20L / yr
skill iconJava
Spring
skill iconMongoDB
Jobs for Data Integration Engineer @ TDG. Immediate Joiner Can Apply We are "THE DIGITAL GROUP INFOTECH PVT LTD" CMMI 5 Company, having an opening for Data Integration Engineer Position : 1 Location : Offshore Experience : 5+ Years Skill sets: JAVA AND Spring AND Mongodb Technical skills:  5+ years of experience in a Data Engineer role  Experience any Message queue.  Good to have: Spark (big data tool), Kafka (big data tool), storm (stream processing system)  Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.  Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.  Experience with object-oriented/object function scripting languages: Python, Java
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos