Sr. Spark Software Engineer
Technology service company
5 - 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
JavaJ2EE
Spring BootHibernate (Java)
Ansible
GitJIRA
Apache Spark
Spark
Apache Kafka
Microservices
KubernetesTerraform
NOSQL Databases
API
Docker-
Bachelor’s or master’s degree in Computer Engineering, Computer Science, Computer Applications, Mathematics, Statistics, or related technical field. Relevant experience of at least 3 years in lieu of above if from a different stream of education.
-
Well-versed in and 3+ hands-on demonstrable experience with: ▪ Stream & Batch Big Data Pipeline Processing using Apache Spark and/or Apache Flink.
▪ Distributed Cloud Native Computing including Server less Functions
▪ Relational, Object Store, Document, Graph, etc. Database Design & Implementation
▪ Micro services Architecture, API Modeling, Design, & Programming -
3+ years of hands-on development experience in Apache Spark using Scala and/or Java.
-
Ability to write executable code for Services using Spark RDD, Spark SQL, Structured Streaming, Spark MLLib, etc. with deep technical understanding of Spark Processing Framework.
-
In-depth knowledge of standard programming languages such as Scala and/or Java.
-
3+ years of hands-on development experience in one or more libraries & frameworks such as Apache Kafka, Akka, Apache Storm, Apache Nifi, Zookeeper, Hadoop ecosystem (i.e., HDFS, YARN, MapReduce, Oozie & Hive), etc.; extra points if you can demonstrate your knowledge with working examples.
-
3+ years of hands-on development experience in one or more Relational and NoSQL datastores such as PostgreSQL, Cassandra, HBase, MongoDB, DynamoDB, Elastic Search, Neo4J, etc.
-
Practical knowledge of distributed systems involving partitioning, bucketing, CAP theorem, replication, horizontal scaling, etc.
-
Passion for distilling large volumes of data, analyze performance, scalability, and capacity performance issues in Big Data Platforms.
-
Ability to clearly distinguish system and Spark Job performances and perform spark performance tuning and resource optimization.
-
Perform benchmarking/stress tests and document the best practices for different applications.
-
Proactively work with tenants on improving the overall performance and ensure the system is resilient, and scalable.
-
Good understanding of Virtualization & Containerization; must demonstrate experience in technologies such as Kubernetes, Istio, Docker, OpenShift, Anthos, Oracle VirtualBox, Vagrant, etc.
-
Well-versed with demonstrable working experience with API Management, API Gateway, Service Mesh, Identity & Access Management, Data Protection & Encryption.
Hands-on experience with demonstrable working experience with DevOps tools and platforms viz., Jira, GIT, Jenkins, Code Quality & Security Plugins, Maven, Artifactory, Terraform, Ansible/Chef/Puppet, Spinnaker, etc.
-
Well-versed in AWS and/or Azure or and/or Google Cloud; must demonstrate experience in at least FIVE (5) services offered under AWS and/or Azure or and/or Google Cloud in any categories: Compute or Storage, Database, Networking & Content Delivery, Management & Governance, Analytics, Security, Identity, & Compliance (or) equivalent demonstrable Cloud Platform experience.
-
Good understanding of Storage, Networks and Storage Networking basics which will enable you to work in a Cloud environment.
-
Good understanding of Network, Data, and Application Security basics which will enable you to work in a Cloud as well as Business Applications / API services environment.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma
Full Stack Developer - AverlonI had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
Similar jobs
Bangalore
6 - 10 yrs
₹35L - ₹40L / yr
JavaJ2EE
Spring BootHibernate (Java)
About the Company:
Company is a direct to consumer brand in affordable fast fashion space using full stack model to solve for high quality at affordable prices. We leverage in-house manufacturing coupled with strong usage of technology to drive efficiency. Rapidbox is funded by Top-Tier VC firms and
prominent angel investors.
Must Have Skills (Working Experience Needed):
Preferably a Graduate/Postgraduate from a Tier 1/2 college/university.
Core Java
Hibernate and any relational database – MySQL, Postgres, Oracle.
Redis Caching
Spring
Maven, Git
Ability to thrive in a dynamic environment with changing priorities
Spring
Experience with OO design, design patterns & deep understanding of JVM internals
(multithreading, garbage collection etc.)
Problem solver
Search solutions like ES, Solr
NoSQL data store like Cassandra/Mongo
Kafka
Microservices Architecture, Web services, API development, Enterprise integration
Experience on scalable and distributed systems
Good to have:
Distributed Cache
Performance testing tools - Jmeter, Locust, Gatling
Ecommerce background
Company is a direct to consumer brand in affordable fast fashion space using full stack model to solve for high quality at affordable prices. We leverage in-house manufacturing coupled with strong usage of technology to drive efficiency. Rapidbox is funded by Top-Tier VC firms and
prominent angel investors.
Must Have Skills (Working Experience Needed):
Preferably a Graduate/Postgraduate from a Tier 1/2 college/university.
Core Java
Hibernate and any relational database – MySQL, Postgres, Oracle.
Redis Caching
Spring
Maven, Git
Ability to thrive in a dynamic environment with changing priorities
Spring
Experience with OO design, design patterns & deep understanding of JVM internals
(multithreading, garbage collection etc.)
Problem solver
Search solutions like ES, Solr
NoSQL data store like Cassandra/Mongo
Kafka
Microservices Architecture, Web services, API development, Enterprise integration
Experience on scalable and distributed systems
Good to have:
Distributed Cache
Performance testing tools - Jmeter, Locust, Gatling
Ecommerce background
Read more
Mumbai
3 - 10 yrs
₹20L - ₹35L / yr
NodeJS (Node.js)GitAWS Lambda
About
A digital first, multi-brand consumer goods company owned and operated under one house, with each of its brands working together toward one mission: To help Indians lead a
more fulfilling life surrounded by wellness and grace.
The founders, Revant and Dhyanesh have more than a decade of experience building, advising and investing in consumer brands. This has allowed them to understand the Indian consumer in a level of detail about their health, habits, and more.
The business is creating a family of purposeful brands with products that solve a particular problem for a small segment of people. Each brand provides the essentials to make an individual segment of people lead a graceful life full of purpose and wellbeing. Each brand offers high quality, responsibly-made products that are inviting and easy to use, paired with access to ongoing guidance and support.
Role
As one of the first members of the backend development team, you will be responsible
for architecting and setting the standards for building our core backend/microservices. Also, you will be responsible for shaping up the entire system for scale and collaborating extensively with the frontend and design teams to create the best consumer experiences.
Responsibilities
● Develop microservices that will be used by the frontend through API endpoints.
● Translate business requirements into high quality code.
● Ensure that the code is deployed in a secure and scalable fashion.
● Focus on code maintainability and performance of application.
● Provide technical advice and assists in solving programming problems.
● Enhance Analytics and overall backend architecture for better performance.
Requirements
● 3+ years of backend/full-stack development experience
● 1+ years of experience on NodeJS
● 1+ years experience in building APIs in a microservice architecture
● Experience in PHP is a plus
● Experience with AWS services such as Lambda, CloudWatch, CloudFront
● Has experience managing other developers
● Has experience in code reviewing/being the gatekeeper for an entire project
● Experience with RabbitMQ or similar queuing system
● Experience with Redis/ElasticSearch is a plus
● Familiarity with CI/CD pipeline tools like Jenkins
● Good knowledge of working with Git
● A knack for benchmarking and optimization
A digital first, multi-brand consumer goods company owned and operated under one house, with each of its brands working together toward one mission: To help Indians lead a
more fulfilling life surrounded by wellness and grace.
The founders, Revant and Dhyanesh have more than a decade of experience building, advising and investing in consumer brands. This has allowed them to understand the Indian consumer in a level of detail about their health, habits, and more.
The business is creating a family of purposeful brands with products that solve a particular problem for a small segment of people. Each brand provides the essentials to make an individual segment of people lead a graceful life full of purpose and wellbeing. Each brand offers high quality, responsibly-made products that are inviting and easy to use, paired with access to ongoing guidance and support.
Role
As one of the first members of the backend development team, you will be responsible
for architecting and setting the standards for building our core backend/microservices. Also, you will be responsible for shaping up the entire system for scale and collaborating extensively with the frontend and design teams to create the best consumer experiences.
Responsibilities
● Develop microservices that will be used by the frontend through API endpoints.
● Translate business requirements into high quality code.
● Ensure that the code is deployed in a secure and scalable fashion.
● Focus on code maintainability and performance of application.
● Provide technical advice and assists in solving programming problems.
● Enhance Analytics and overall backend architecture for better performance.
Requirements
● 3+ years of backend/full-stack development experience
● 1+ years of experience on NodeJS
● 1+ years experience in building APIs in a microservice architecture
● Experience in PHP is a plus
● Experience with AWS services such as Lambda, CloudWatch, CloudFront
● Has experience managing other developers
● Has experience in code reviewing/being the gatekeeper for an entire project
● Experience with RabbitMQ or similar queuing system
● Experience with Redis/ElasticSearch is a plus
● Familiarity with CI/CD pipeline tools like Jenkins
● Good knowledge of working with Git
● A knack for benchmarking and optimization
Read more
Bengaluru (Bangalore)
4 - 6 yrs
₹1L - ₹1L / yr
JavaJ2EE
Spring BootHibernate (Java)
Data Structures
+1 more
Responsibilities:
- Participation in the requirements analysis, design, development and testing of applications.
- The candidate is expected to write code himself/herself.
- The candidate is expected to write high level code, code review, unit testing and deployment.
- Practical application of design principles with a focus on the user experience, usability, template designs, cross browser issues and client server concepts.
- Contributes to the development of project estimates, scheduling, and deliverables.
- Works closely with QA team to determine testing requirements to ensure full coverage and best quality of product.
- There is also the opportunity to mentor and guide junior team members in excelling their jobs.
Requirements:
- BE/B. Tech. Computer Science or MCA from a reputed University.
- 3.5 - 6.5 Years of experience in software development, with emphasis on JAVA/J2EE Server side programming.
- Hands on experience in Core Java, Multithreading, RMI, Socket programing, JDBC, NIO, webservices and Design patterns.
- Should have Knowledge of distributed system, distributed caching, messaging frameworks ESB etc.
- Knowledge of Linux operating system and PostgreSQL/MySQL/MongoDB/Cassandra database is essential.
- Additionally, knowledge of HBase, Hadoop and Hive are desirable.
- Familiarity with message queue systems and AMQP and Kafka is desirable.
- Should have experience as a participant in Agile methodologies.
- Should have excellent written and verbal communication skills and presentation skills.
Read more
Noida, Bengaluru (Bangalore), Pune
3 - 8 yrs
₹10L - ₹40L / yr
JavaJ2EE
Spring BootHibernate (Java)
Data Structures
+4 more
Requirements:
3+ years of server-side application development experience with Java, Spring boot, Microservice.
Deeply technical with a track record of successful delivery.
An entrepreneurial spirit combined with strong program and product management skills .
Excellent written and verbal communication skills with the ability to present complex plans and design.
Excellent judgment, organizational, and problem-solving skills.
Excellent design and architecture design.
Data driven decision making.
Preferred Qualifications : Bachelor's/Master's Degree in Computer Science or equivalent
Skills that will help you succeed in this role:
Language: Java/Node DB: RDBMS, Messaging: Kafka/RabbitMQ, Caching: Redis/Aerospike, Micro services, AWS.
Good experience in scaling, performance tuning & optimization at both API and storage layers
Read more
Bengaluru (Bangalore)
1 - 3 yrs
₹8L - ₹20L / yr
JavaJ2EE
Spring BootHibernate (Java)
Job Description |Software Development Engineer 1 & 2| NoBroker.com
We are looking for a Senior Software Engineer to produce and implement functional
software solutions. You will work with upper management to define software requirements
and take the lead on operational and technical projects.
In this role, you should be able to work independently with little supervision. You should
have excellent organization and problem-solving skills. If you also have hands-on
experience in software development and agile methodologies, we’d like to meet you.
Your goal will be to develop high-quality software that is aligned with user needs and
business goals.
Job Responsibilities:
● Develop high-quality software design and architecture
● Identify, prioritize and execute tasks in the software development life cycle
● Develop tools and applications by producing clean, efficient code
● Automate tasks through appropriate tools and scripting
● Building robust, secure, high-volume performing, scalable microservices that operate 24*7
to power the NoBroker platform for end customers.
● Working closely with our product team to build new and compelling experiences for our
customers.
● Collaborate with internal teams and vendors to fix and improve products
● Document development phases and monitor systems
● Ensure software is up-to-date with the latest technologies
Requirements:
B.Tech/B.E. from a reputed college or related technical discipline with 2- 5 years of
experience in following Technology and programming methodology :
● Work experience as a Java Software Engineer, Java Developer, or similar role
● In-depth knowledge of popular Java frameworks like JSF and Spring MVC
● Hands-on working experience with Scalable and fault-tolerant applications.
● Extensive experience in software development, scripting, and project management
● Working experience with an application. Working experience with databases like SQL and
NoSQL ( MySQL, MongoDB, Redis, Elasticsearch).
● Analytical mind with problem-solving aptitude
● Good delegation and time management skills
● High adaptability in a dynamic start-up environment.
We are looking for a Senior Software Engineer to produce and implement functional
software solutions. You will work with upper management to define software requirements
and take the lead on operational and technical projects.
In this role, you should be able to work independently with little supervision. You should
have excellent organization and problem-solving skills. If you also have hands-on
experience in software development and agile methodologies, we’d like to meet you.
Your goal will be to develop high-quality software that is aligned with user needs and
business goals.
Job Responsibilities:
● Develop high-quality software design and architecture
● Identify, prioritize and execute tasks in the software development life cycle
● Develop tools and applications by producing clean, efficient code
● Automate tasks through appropriate tools and scripting
● Building robust, secure, high-volume performing, scalable microservices that operate 24*7
to power the NoBroker platform for end customers.
● Working closely with our product team to build new and compelling experiences for our
customers.
● Collaborate with internal teams and vendors to fix and improve products
● Document development phases and monitor systems
● Ensure software is up-to-date with the latest technologies
Requirements:
B.Tech/B.E. from a reputed college or related technical discipline with 2- 5 years of
experience in following Technology and programming methodology :
● Work experience as a Java Software Engineer, Java Developer, or similar role
● In-depth knowledge of popular Java frameworks like JSF and Spring MVC
● Hands-on working experience with Scalable and fault-tolerant applications.
● Extensive experience in software development, scripting, and project management
● Working experience with an application. Working experience with databases like SQL and
NoSQL ( MySQL, MongoDB, Redis, Elasticsearch).
● Analytical mind with problem-solving aptitude
● Good delegation and time management skills
● High adaptability in a dynamic start-up environment.
Read more
Bengaluru (Bangalore)
10 - 15 yrs
₹40L - ₹60L / yr
NodeJS (Node.js)Java
Python
Scala
Kotlin +2 more
At least 10 years of experience in Software Development
• Proficient in software development from inception to production releases using modern
programming languages ( Preferably Java, NodeJS, and Scala)
• Hands-on experience with cloud infrastructure, solution architecture on AWS or Azure
• Prior experience working as a Full-stack engineer building cloud-native, SaaS products.
• Expertise in programming and designing circuit breakers, the localized impact of failures,
service mesh, event sourcing, distributed data transactions, and eventual consistency.
• Proficient in designing and developing SAAS on Microservices architecture
• Proficient in building Fault tolerance, High availability, and Autoscaling for microservices
• Proficient in Data Modelling for distributed computing
• Deeps Hands-on experience on Microservices in Spring Boot and in large scale projects in
Spring Framework
• Fluency in cloud-native solution architecture; designing HA and Fault-Tolerant deployment
topologies for API Gateway, Kafka, and Spark clusters on cloud.
• Fluency in AWS, Azure, Serverless Functions in AWS or Azure and in Docker and Kubernetes
• Avid practitioner and coach of Test-Driven Development
• Deep understanding of modeling real-world scheduling and process problems into algorithms
running on memory and compute efficient data structures.
• We value Polyglot engineers a lot, hence experience in programming in more than one
language is a must, preferably one of Groovy, Scala, Python or Kotlin
• Excellent communication skills and collaboration temperament
• Articulation of technical matters to Business Stakeholders, and the ability to translate business
concerns into technical specifications.
• Proficiency in working with cross-functional team on refining initiatives to objective features.
Good To Have:
• Hands-on experience with Continuous Delivery and DevOps automation
• SRE and Observability implementation experience
• Refactoring Legacy products to microservices
• Proficient in software development from inception to production releases using modern
programming languages ( Preferably Java, NodeJS, and Scala)
• Hands-on experience with cloud infrastructure, solution architecture on AWS or Azure
• Prior experience working as a Full-stack engineer building cloud-native, SaaS products.
• Expertise in programming and designing circuit breakers, the localized impact of failures,
service mesh, event sourcing, distributed data transactions, and eventual consistency.
• Proficient in designing and developing SAAS on Microservices architecture
• Proficient in building Fault tolerance, High availability, and Autoscaling for microservices
• Proficient in Data Modelling for distributed computing
• Deeps Hands-on experience on Microservices in Spring Boot and in large scale projects in
Spring Framework
• Fluency in cloud-native solution architecture; designing HA and Fault-Tolerant deployment
topologies for API Gateway, Kafka, and Spark clusters on cloud.
• Fluency in AWS, Azure, Serverless Functions in AWS or Azure and in Docker and Kubernetes
• Avid practitioner and coach of Test-Driven Development
• Deep understanding of modeling real-world scheduling and process problems into algorithms
running on memory and compute efficient data structures.
• We value Polyglot engineers a lot, hence experience in programming in more than one
language is a must, preferably one of Groovy, Scala, Python or Kotlin
• Excellent communication skills and collaboration temperament
• Articulation of technical matters to Business Stakeholders, and the ability to translate business
concerns into technical specifications.
• Proficiency in working with cross-functional team on refining initiatives to objective features.
Good To Have:
• Hands-on experience with Continuous Delivery and DevOps automation
• SRE and Observability implementation experience
• Refactoring Legacy products to microservices
Read more
Please find the JD Below:
Job title- ATL/Technical Lead
Experience
- Must have experience
- Extensive product development experience
- 5-10 years experience in back end Java Development
- Possess advanced knowledge of object-oriented design and development (OOA/OOD).
- Team task assignment, mentoring and helping resolve issues
- Self-starter, ability to work with minimal supervision.
- Skilled at working collaboratively in a team-oriented environment.
- Excellent problem-solving skills. Curious and adept at researching project-related issues and challenges.
- Excellent debugging skills
- Good to have
- Experience in SOA and microservice deployment model.
- GWT development experience
- Experience of working in an Agile development model
- Mixed experience in different type of organizations - product start up and large enterprises
Other Skills
- Strong Analytical skills
- Acumen for understanding customer's business goals
- Process oriented- Following current processes and partner in process improvement.
- Data oriented- Using data and knowledge base for solving current problem at hand and creating software knowledge base for future use.
- Ability to juggle multiple development and design tasks simultaneously.
Read more
Mumbai
4 - 6 yrs
₹16L - ₹26L / yr
JavaMicroservices
Spring BootThe Insurance ecosystem in India is currently fragmented and distributed. Claims in Insurance are stressful because of the lengthy processes and long wait times before they are settled. We are here to change that and make Insurance Simple.
We know that ours is a lofty vision, but we are in it for the long haul. Our work will give everyone the ability to sell Insurance to their customers and improve the economy. For this - we need co-creators who share our vision. We want to do it together with a team of like-minded people who are in it to reinvent the way we do Insurance and potentially connect the entire ecosystem.
We want to grow fast while creating a sustainable business and bring about disruption in an industry, which is a post-COVID world, needs to be disrupted for the better!
We are focused on democratizing Insurance through technology. It is a cloud-based platform connecting distributors to the Insurance Ecosystem to sell and manage Insurance programs. We are creating a middleware connecting consumers, traditional insurance institutions, intermediaries, and service partners on a single platform. Basically, give distributors the ability access to the entire Insurance ecosystem via 1 API / 1 platform.
Our goal is simple - Provide a new way to do Insurance, which is secure, easy, and focuses on the consumer while staying compliant with the frameworks laid down by the regulator.
Bachelor’s degree or higher in Computer / Technology domain.
4-7 years of relevant work experience, preferably in a start-up environment/ building SaaS products.
Excellent coding skills with the ability to deliver in a hyper-growth phase.
Hands-on experience in JAVA and practical experience in developing and designing
scalable software solutions.
Excellent Problem-solving skills & amp; understanding of data structures in a complex environment.
Extensive experience in Spring, Hibernate and SpringBoot
Experience in building REST Services
Experience in integrating third party APIs (Payment gateways, SMS gateways, Accounting software APIs, APIs of CRM tools, etc.) into web applications
Experience in working with SQL and no SQL DBs (Preferably Mongo DB)
Working knowledge of Kubernetes and Docker is a plus
Knowledge of how insurance processes and past experience in working on insurance
applications is a plus.
We know that ours is a lofty vision, but we are in it for the long haul. Our work will give everyone the ability to sell Insurance to their customers and improve the economy. For this - we need co-creators who share our vision. We want to do it together with a team of like-minded people who are in it to reinvent the way we do Insurance and potentially connect the entire ecosystem.
We want to grow fast while creating a sustainable business and bring about disruption in an industry, which is a post-COVID world, needs to be disrupted for the better!
We are focused on democratizing Insurance through technology. It is a cloud-based platform connecting distributors to the Insurance Ecosystem to sell and manage Insurance programs. We are creating a middleware connecting consumers, traditional insurance institutions, intermediaries, and service partners on a single platform. Basically, give distributors the ability access to the entire Insurance ecosystem via 1 API / 1 platform.
Our goal is simple - Provide a new way to do Insurance, which is secure, easy, and focuses on the consumer while staying compliant with the frameworks laid down by the regulator.
Bachelor’s degree or higher in Computer / Technology domain.
4-7 years of relevant work experience, preferably in a start-up environment/ building SaaS products.
Excellent coding skills with the ability to deliver in a hyper-growth phase.
Hands-on experience in JAVA and practical experience in developing and designing
scalable software solutions.
Excellent Problem-solving skills & amp; understanding of data structures in a complex environment.
Extensive experience in Spring, Hibernate and SpringBoot
Experience in building REST Services
Experience in integrating third party APIs (Payment gateways, SMS gateways, Accounting software APIs, APIs of CRM tools, etc.) into web applications
Experience in working with SQL and no SQL DBs (Preferably Mongo DB)
Working knowledge of Kubernetes and Docker is a plus
Knowledge of how insurance processes and past experience in working on insurance
applications is a plus.
Read more
Bengaluru (Bangalore)
4 - 7 yrs
₹4L - ₹6L / yr
Python
DjangoMySQL
NOSQL Databases
MongoDB +1 more
# In-depth knowledge in Core Python with Django building end to end applications development.
# Experience in Web technologies-HTML, CSS, Javascript.
# Database - SQL Server/PostGres/ No SQL database.
# Good understanding of Algorithms, data structures.
# Knowledge in ORM (Object Relational Mapper) libraries.
# Experience in integrating multiple data sources and databases into one system.
# Knowledge in version control tools like GIT.
# Experience with various cloud technologies.
Read more
Bengaluru (Bangalore)
3 - 5 yrs
₹10L - ₹13L / yr
JavaPythonImplementation
This person will be responsible for implementing several modules of the product, following the specifications from the system architect.
Education: Bachelors or Masters in Computer Science. Proficiency in Java
Experience: Minimum three years experience developing products or product components of moderate to high complexity.
Read more
Why apply to jobs via Cutshort
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
Follow CutshortUsers love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma
Full Stack Developer - AverlonI had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort