Cutshort logo
Technology service company logo
Sr. Spark Software Engineer
Technology service company
Sr. Spark Software Engineer
Technology service company's logo

Sr. Spark Software Engineer

at Technology service company

Agency job
5 - 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Ansible
skill iconGit
JIRA
Apache Spark
Spark
Apache Kafka
Microservices
skill iconKubernetes
Terraform
NOSQL Databases
API
skill iconDocker
  • Bachelor’s or master’s degree in Computer Engineering, Computer Science, Computer Applications, Mathematics, Statistics, or related technical field. Relevant experience of at least 3 years in lieu of above if from a different stream of education.

  • Well-versed in and 3+ hands-on demonstrable experience with: ▪ Stream & Batch Big Data Pipeline Processing using Apache Spark and/or Apache Flink.
    ▪ Distributed Cloud Native Computing including Server less Functions
    ▪ Relational, Object Store, Document, Graph, etc. Database Design & Implementation
    ▪ Micro services Architecture, API Modeling, Design, & Programming

  • 3+ years of hands-on development experience in Apache Spark using Scala and/or Java.

  • Ability to write executable code for Services using Spark RDD, Spark SQL, Structured Streaming, Spark MLLib, etc. with deep technical understanding of Spark Processing Framework.

  • In-depth knowledge of standard programming languages such as Scala and/or Java.

  • 3+ years of hands-on development experience in one or more libraries & frameworks such as Apache Kafka, Akka, Apache Storm, Apache Nifi, Zookeeper, Hadoop ecosystem (i.e., HDFS, YARN, MapReduce, Oozie & Hive), etc.; extra points if you can demonstrate your knowledge with working examples.

  • 3+ years of hands-on development experience in one or more Relational and NoSQL datastores such as PostgreSQL, Cassandra, HBase, MongoDB, DynamoDB, Elastic Search, Neo4J, etc.

  • Practical knowledge of distributed systems involving partitioning, bucketing, CAP theorem, replication, horizontal scaling, etc.

  • Passion for distilling large volumes of data, analyze performance, scalability, and capacity performance issues in Big Data Platforms.

  • Ability to clearly distinguish system and Spark Job performances and perform spark performance tuning and resource optimization.

  • Perform benchmarking/stress tests and document the best practices for different applications.

  • Proactively work with tenants on improving the overall performance and ensure the system is resilient, and scalable.

  • Good understanding of Virtualization & Containerization; must demonstrate experience in technologies such as Kubernetes, Istio, Docker, OpenShift, Anthos, Oracle VirtualBox, Vagrant, etc.

  • Well-versed with demonstrable working experience with API Management, API Gateway, Service Mesh, Identity & Access Management, Data Protection & Encryption.

    Hands-on experience with demonstrable working experience with DevOps tools and platforms viz., Jira, GIT, Jenkins, Code Quality & Security Plugins, Maven, Artifactory, Terraform, Ansible/Chef/Puppet, Spinnaker, etc.

  • Well-versed in AWS and/or Azure or and/or Google Cloud; must demonstrate experience in at least FIVE (5) services offered under AWS and/or Azure or and/or Google Cloud in any categories: Compute or Storage, Database, Networking & Content Delivery, Management & Governance, Analytics, Security, Identity, & Compliance (or) equivalent demonstrable Cloud Platform experience.

  • Good understanding of Storage, Networks and Storage Networking basics which will enable you to work in a Cloud environment.

  • Good understanding of Network, Data, and Application Security basics which will enable you to work in a Cloud as well as Business Applications / API services environment.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Wissen Technology
at Wissen Technology
4 recruiters
Sukanya Mohan
Posted by Sukanya Mohan
Bengaluru (Bangalore)
4 - 7 yrs
Best in industry
skill iconJava
Spring
DevOps

Job Title: Devops+Java Engineer

Location: Bangalore

Mode of work- Hybrid (3 days work from office)

 

Job Summary: We are looking for a skilled Java+ DevOps Engineer to help enhance and maintain our infrastructure and applications. The ideal candidate will have a strong background in Java development combined with expertise in DevOps practices, ensuring seamless integration and deployment of software solutions. You will collaborate with cross-functional teams to design, develop, and deploy robust and scalable solutions.

 

Key Responsibilities:

  • Develop and maintain Java-based applications and microservices.
  • Implement CI/CD pipelines to automate the deployment process.
  • Design and deploy monitoring, logging, and alerting systems.
  • Manage cloud infrastructure using tools such as AWS, Azure, or GCP.
  • Ensure security best practices are followed throughout all stages of development and deployment.
  • Troubleshoot and resolve issues in development, test, and production environments.
  • Collaborate with software engineers, QA analysts, and product teams to deliver high-quality solutions.
  • Stay current with industry trends and best practices in Java development and DevOps.



Required Skills and Experience:

  • Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent work experience).
  • Proficient in Java programming language and frameworks (Spring, Hibernate, etc.).
  • Strong understanding of DevOps principles and experience with DevOps tools (e.g., Jenkins, Git, Docker, Kubernetes).
  • Knowledge of containerization and orchestration technologies (Docker, Kubernetes).
  • Familiarity with monitoring and logging tools (ELK stack, Prometheus, Grafana).
  • Solid understanding of CI/CD pipelines and automated testing frameworks.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.
Read more
Mphasis
Mphasis
Agency job
via Vysystem pvt Ltd by hari prasath
Bengaluru (Bangalore)
5 - 10 yrs
₹20L - ₹30L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Data Structures
+3 more

Job Title: Java Developer

Location: Bangalore

Experience: 5+ years

Job Type: Full-time

Skills Required:

  • Java
  • J2EE
  • Spring Boot
  • Hibernate (Java)
  • Data Structures & Algorithms
  • Multi-threading
  • Design Patterns
  • Collections

Education Qualification:

  • B.Tech
  • BE
  • BCA
  • MCA
  • M.Tech
  • BSc

Job Description: We are seeking a highly skilled Java Developer with over 5 years of experience to join our dynamic team in Bangalore. The ideal candidate will have a strong background in Java, J2EE, Spring Boot, and Hibernate, along with expertise in Data Structures & Algorithms, Multi-threading, and Design Patterns. You will be responsible for designing, developing, and maintaining high-performance applications, ensuring code quality, and collaborating with cross-functional teams to deliver innovative solutions.

Responsibilities:

  • Design, develop, and maintain Java-based applications.
  • Implement and optimize algorithms and data structures.
  • Ensure code quality through unit testing and code reviews.
  • Collaborate with cross-functional teams to define, design, and ship new features.
  • Troubleshoot and resolve performance issues.
  • Stay updated with the latest industry trends and technologies.

Preferred Qualifications:

  • Strong problem-solving skills and attention to detail.
  • Excellent communication and teamwork abilities.
  • Experience with Agile development methodologies.


Read more
Platform connecting digital brands with "relevant" seller
Platform connecting digital brands with "relevant" seller
Agency job
via Qrata by Blessy Fernandes
NCR (Delhi | Gurgaon | Noida), Gurgaon
4 - 6 yrs
₹25L - ₹30L / yr
skill iconJava
Spring
skill iconReact.js
skill iconSpring Boot
MySQL
+3 more

Responsibilities of a Senior Software Engineer (Backend):

  • You will be a guide in the entire application lifecycle including research, design, development, testing (dev owns quality), along with continuous deployment and delivery
  • Lead design with a major focus on best user experience, performance, scalability and future expansion
  • You will act as a mentor for less-experienced peers through both your technical knowledge and leadership skills to bring in continuous improvements and implement best practices.
  • You will apply the latest technology thinking from our tech radar, adopt best design practices to solve complex problems and ensure our product is the best in usability.
  • You will work directly with the CEO and the cross functional product teams, align on the needs of the products and operations.
  • You will analyze business, technology challenges and suggest solutions
  • Build an “Awesome” team

 

This opportunity is for you if,

  • You have 4-6 Years of work experience in building highly-interactive applications using Java, Spring MVC, Spring JMS, Spring JDBC, Spring IOC, Spring Boot, MySQL, MiBatis, ReactJS, Java Script, jQuery, AWS, JMS and have knowledge on wide range of web technologies, tools and Frameworks.
  • You have experience in working with Restful webservices
  • You have strong knowledge and understanding of design patterns and domain driven design
  • You understand fundamental design principles behind building scalable, resilient, and maintainable applications 
  • You have functional knowledge of inclusive design: accessibility, and related tooling
  • You have consumer web development experience for high-traffic, public facing web applications
  • You have knack for writing clean, readable, re-usable code
  • You have good knowledge on TDD and CI/CD practices.
  • You have experience in managing and publishing releases using Git branching and tools like NPM and YARN.
  • You have penchant for learning
  • You are a great analytical & logical thinker and someone who loves solving problems
  • You are passionate, energetic, enthusiastic and a go-getter
  • You are “ FUN @ Work “

 

Read more
Bengaluru (Bangalore), Pune
5 - 13 yrs
₹1L - ₹15L / yr
skill iconJava
Microservices
Microsoft Windows Azure
J2EE
skill iconSpring Boot
+1 more

About AMAZECH SOLUTIONS

 

Amazech Solutions is a Consulting and Services company in the Information Technology Industry. Established in 2007, we are headquartered in Frisco, Texas, U.S.A. The leadership team at Amazech brings to the table expertise that stems from over 40-man years of experience in developing software solutions in global organizations in various verticals including Healthcare, Banking Services, and Media & Entertainment 

 

We currently provide services to a wide spectrum of clients ranging from start-ups to Fortune 500 companies. We are actively engaged in Government projects, being an SBA approved company as well as being HUB certified by the State of Texas. 

 

Our customer-centric approach comes from understanding that our clients need more than technology professionals. This is an exciting time to join Amazech as we look to grow our team in India which comprises of IT professionals with strong competence in both common and niche skill areas.  


Job Description

 

Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive and iterative delivery environment? You will be part of a large group of makers, breakers, doers, and disruptors, who love to solve real problems and meet real customer needs. 

 

We are seeking Software Engineers who are passionate about marrying data with emerging technologies to join our team. You will have the opportunity to be on the forefront of driving a major transformation and create various products that will disrupt and reimagine technology solutions by working with the best minds in the industry. 


Location: Bangalore, Pune (Hybrid / Remote)

Experience: 5-13 years

Employment type: Full time.

Permanent website: www.amazech.com

 

Role Description

 

This is a full-time Java Backend Developer role, based in Bengaluru with flexible remote work option. The Java Backend Developer will be responsible for designing, developing, and delivering complex Java-based applications and providing end-to-end support throughout the software development lifecycle. The successful candidate will collaborate with cross-functional team members, gather and analyze requirements, identify and prioritize technical and functional requirements and provide innovative solutions to address business challenges.

 

Qualifications


  • Bachelor's or Master's degree in Computer Science (or equivalent technical degree)
  • 5+ years of hands-on software development experience in Java/J2EE
  • Experience in defining software architecture, design patterns, and solution design
  • Strong experience in microservices architecture, Angular, Spring Boot Framework, Hibernate, and Web Services (SOAP and REST)
  • Experience in cloud infrastructure, ideally with Amazon Web Services
  • Strong knowledge in database design, SQL query optimization, and performance tuning
  • Demonstrated ability to lead technical teams and mentor team members
  • Excellent communication, analytical, and problem-solving skills
  • Experience and knowledge of Agile methodologies
  • Experience with AWS, GCP, Microsoft Azure, or another cloud services
  • Proven ability to work well under pressure and deliver high-quality work within tight deadlines

 

Other Requirements

 

  • Bachelor's or Master's degree in Computer Science (or equivalent technical degree)
  • Strong interpersonal and relationship-building skills. 
  • Ability to work independently and as part of a team. 
  • Excellent verbal and written communication skills and ability to communicate effectively with international clients. 


Read more
HeyMath
Remote, Chennai
7 - 15 yrs
₹14L - ₹24L / yr
skill iconJava
Spring
SaaS
Fullstack Developer
SOA
+1 more
About Us:

Developed in formal collaboration with the University of Cambridge in May 2000, HeyMath! is an Ed-Tech company whose mission is to Raise the Game in Maths for school systems around the world. We do this using technology to deliver engaging teaching methodologies and personalised learning paths for students. HeyMath! has been successfully adopted by CBSE schools since 2004, with positive outcomes for the entire ecosystem.

Check us out at www.heymath.com

We plan to work mainly from home in 2021 and the virtual office atmosphere is collegiate, informal and friendly, with small high-impact teams making a difference to customers.

What we are looking for:
• Experience in building and re-engineering cloud based solutions on AWS.
• Strong knowledge of Object Oriented Programming(OOPS) and design patterns is a must.
• Hands-on development on Spring MVC framework.
• Experience working on Java 8 or above.
• Must have very good knowledge of RDBMS such as MySQL and performance tuning of the same.
• Good knowledge of Javascript frameworks such as React JS.
• Exposure to server-side and client-side caching mechanisms.
• Basic understanding of proxy servers, load balancers and CDN.
• Ability to debug the applications and provide instant workable solutions.
• Experience working on Elastic Search / Kafka / Kubernetes or all is a nice to have.
Read more
Midsized fintech startup
Midsized fintech startup
Agency job
via Qrata by Revathi Satish
Bengaluru (Bangalore)
3 - 7 yrs
₹35L - ₹40L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)

About the company:

 

Company is building the platform to drive global careers for millennials from emerging

economies. Leap work at the exciting intersection of the 2 hottest trends around - edtech & fintech!

And we love that we succeed as a business while powering the dreams of talented students! They create modern financial products and services that help Indian students pursue a global career. From choosing the right university and the best financing option to lining up job interviews and introductions, Leap Finance invests heavily in your success.

 

Summary :

 

Leap is building the core engineering team and looking for an Android developer who can

take ownership and deliver independently.

 

The best candidates will check all OR many of these boxes :

 

● 3-6 years of experience in an engineering role

● Essential skills required are Java, Springboot, MySQL, PostgreSQL & Kotlin Backend

 

Technologies.

 

● Good to have experience in Node.js, Nest.js

● Experience with an early-stage start-up

 

Why is this a great opportunity for the right candidate :

 

● Experienced founding team

● Right to win - The founding team knows the business & its secrets inside out. We are

starting with a significant head start and a precise plan of action

● Barriers to entry - This is a specialized play with natural barriers to entry, allowing for

significant value creation for all equity holders

● Backed by marquee global investors

● Exposure to all aspects of company building - exposure to investors, fund-raising,

decision making, building the team & culture

● All of the above perks of joining a high potential company very early, along with a

competitive market salary.

Read more
Global diversified digital conglomerate company
Global diversified digital conglomerate company
Agency job
via Snapminds Technologies by Sindhu Narayan
Bengaluru (Bangalore)
3 - 8 yrs
₹4L - ₹9L / yr
skill iconMongoDB
skill iconJava
Data Structures
Spring
Design patterns
+6 more
Design and development of the Supply chain applications for the retail customers, making use of the open source technologies.
It can be taking our own product and customizing as per the customer requirements or developing applications from the scratch.
Read more
Niflr
at Niflr
1 recruiter
Ankur Sharma
Posted by Ankur Sharma
Bengaluru (Bangalore)
1 - 4 yrs
₹9L - ₹14L / yr
skill iconNodeJS (Node.js)
skill iconReact.js
Algorithms
Data Structures
skill iconPython
+3 more
The ideal person for this role is a problem-solver with an inquisitive and innovative mind, who loves to collaborate with other teams to drive the company forward. Requirements : You have understanding of basic algorithms and data structures, complexity analysis and software design. You have experience implementing event sourcing and micro-services architecture. You have 2 + years of hands-on experience creating technology systems using any of the languages such as Python, Node, Java Knowledge of front end frameworks such as React.js, Angular.js is a plus. You have some experience and good understanding of at least one open-source distributed system (such as RabbitMQ, Kafka, Redis, Elasticsearch, Cassandra, etc.). You have experience with web standards (like as REST APIs, web security mechanisms. Experience with a public cloud Cloud like AWS/GCP/Azure with exposure to Kubernetes is a preferred. You are an excellent communicator of ideas, both verbal and written. You take initiatives and do not depend on hand holding for implementing things which can make great impact. You can work coherently with a diverse set of engineers Responsibilities: a) Design and develop microservices and other technology framework for Omnichannel Retail. b) Build technology for unmanned retail. c) We have critical systems managing inventory, fulfilment, Point-of-sale, customer app etc and we will build many more such systems supporting omni-channel retail. Participate in our product development from ideation to deployment and beyond. Work with our data team to make our product smarter and more intuitive to use. Maintain and help optimise existing systems.
Read more
International design & Engineering solutions pvt ltd
Pune
2 - 6 yrs
₹4L - ₹12L / yr
skill iconC++
skill iconC#
Algorithms
skill iconJava
Data Structures
+3 more
Work with developers to design algorithms and flowcharts Prepare GUI dummy screens for proposed Software development using Excel VBA. (To Give a overview how the software buttons and flow of information should happen) Coordination with Software Developer team to explain the criteria Produce clean, efficient code based on specifications Integrate software components and third-party programs Verify and deploy programs and systems Troubleshoot, debug and upgrade existing software Gather and evaluate user feedback Recommend and execute improvements Create technical documentation for reference and reporting Proven experience as a Software Developer, Software Engineer or similar role Familiarity with development methodologies Experience with software design and development in a test-driven environment Knowledge of coding languages (e.g. C#, C++) and frameworks/systems Ability to learn new languages and technologies Excellent communication skills Resourcefulness and troubleshooting aptitude Attention to detail Sound technical knowledge, thorough knowledge of all related codes and section details is desired. Thorough Knowledge of Design of Components of Residential / Commercial Structures is Desired. Accuracy In Following The Process & Jobs Is Required. Experience in Interaction with International Client Will Be Preferred
Read more
Common Desk
at Common Desk
1 recruiter
Rima Sen
Posted by Rima Sen
Bengaluru (Bangalore)
3 - 7 yrs
₹3L - ₹4L / yr
skill iconJavascript
skill iconPython
skill iconPHP
skill iconNodeJS (Node.js)
NOSQL Databases
+2 more
Common desk is one of the best co-working space in Bangalore here you can easily get all the facilities and you can also get the chance to learn a new thing from the different co-workers.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos