Cutshort logo
Technology service company logo
Sr. Spark Software Engineer
Technology service company
Sr. Spark Software Engineer
Jobdost's logo

Sr. Spark Software Engineer

at Technology service company

Agency job
5 - 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Ansible
skill iconGit
JIRA
Apache Spark
Spark
Apache Kafka
Microservices
skill iconKubernetes
Terraform
NOSQL Databases
API
skill iconDocker
  • Bachelor’s or master’s degree in Computer Engineering, Computer Science, Computer Applications, Mathematics, Statistics, or related technical field. Relevant experience of at least 3 years in lieu of above if from a different stream of education.

  • Well-versed in and 3+ hands-on demonstrable experience with: ▪ Stream & Batch Big Data Pipeline Processing using Apache Spark and/or Apache Flink.
    ▪ Distributed Cloud Native Computing including Server less Functions
    ▪ Relational, Object Store, Document, Graph, etc. Database Design & Implementation
    ▪ Micro services Architecture, API Modeling, Design, & Programming

  • 3+ years of hands-on development experience in Apache Spark using Scala and/or Java.

  • Ability to write executable code for Services using Spark RDD, Spark SQL, Structured Streaming, Spark MLLib, etc. with deep technical understanding of Spark Processing Framework.

  • In-depth knowledge of standard programming languages such as Scala and/or Java.

  • 3+ years of hands-on development experience in one or more libraries & frameworks such as Apache Kafka, Akka, Apache Storm, Apache Nifi, Zookeeper, Hadoop ecosystem (i.e., HDFS, YARN, MapReduce, Oozie & Hive), etc.; extra points if you can demonstrate your knowledge with working examples.

  • 3+ years of hands-on development experience in one or more Relational and NoSQL datastores such as PostgreSQL, Cassandra, HBase, MongoDB, DynamoDB, Elastic Search, Neo4J, etc.

  • Practical knowledge of distributed systems involving partitioning, bucketing, CAP theorem, replication, horizontal scaling, etc.

  • Passion for distilling large volumes of data, analyze performance, scalability, and capacity performance issues in Big Data Platforms.

  • Ability to clearly distinguish system and Spark Job performances and perform spark performance tuning and resource optimization.

  • Perform benchmarking/stress tests and document the best practices for different applications.

  • Proactively work with tenants on improving the overall performance and ensure the system is resilient, and scalable.

  • Good understanding of Virtualization & Containerization; must demonstrate experience in technologies such as Kubernetes, Istio, Docker, OpenShift, Anthos, Oracle VirtualBox, Vagrant, etc.

  • Well-versed with demonstrable working experience with API Management, API Gateway, Service Mesh, Identity & Access Management, Data Protection & Encryption.

    Hands-on experience with demonstrable working experience with DevOps tools and platforms viz., Jira, GIT, Jenkins, Code Quality & Security Plugins, Maven, Artifactory, Terraform, Ansible/Chef/Puppet, Spinnaker, etc.

  • Well-versed in AWS and/or Azure or and/or Google Cloud; must demonstrate experience in at least FIVE (5) services offered under AWS and/or Azure or and/or Google Cloud in any categories: Compute or Storage, Database, Networking & Content Delivery, Management & Governance, Analytics, Security, Identity, & Compliance (or) equivalent demonstrable Cloud Platform experience.

  • Good understanding of Storage, Networks and Storage Networking basics which will enable you to work in a Cloud environment.

  • Good understanding of Network, Data, and Application Security basics which will enable you to work in a Cloud as well as Business Applications / API services environment.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Bengaluru (Bangalore)
1 - 11 yrs
₹10L - ₹19L / yr
skill iconJava
skill iconAmazon Web Services (AWS)
skill iconSpring Boot

Key Responsibilities

  • Frontend Development: Designing and building responsive, interactive user interfaces using React.js, HTML5, CSS3, and modern JavaScript (ES6+).
  • Backend Development: Developing robust, scalable server-side applications and microservices using Java and the Spring Boot framework.
  • API Integration: Creating and consuming RESTful APIs to ensure seamless communication between the React frontend and the Java backend.
  • Database Management: Designing and optimizing database schemas and queries using SQL (e.g., MySQL, PostgreSQL, Oracle) or NoSQL (e.g., MongoDB) databases.
  • State Management: Managing application state in React using tools like Redux, Hooks, or Context API.
  • Testing & Quality Assurance: Writing unit and integration tests using frameworks such as JUnit for backend and Jest or React Testing Library for frontend.
  • DevOps & Deployment: Collaborating on CI/CD pipelines and using containerization tools like Docker and Kubernetes for application deployment. 
  • Indeed
  •  +14

Required Skills & Qualifications

  • Core Technical Skills:
  • Deep proficiency in Java (8+) and the Spring ecosystem (Spring Boot, Spring Security, Spring Data JPA).
  • Expertise in React.js workflows, component-based architecture, and hooks.
  • Strong understanding of Microservices architecture and cloud platforms (AWS, Azure, or GCP).
  • Experience & Education:
  • Typically requires a Bachelor's degree in Computer Science or a related field.
  • Proven experience (often 1–5+ years depending on seniority) in full-stack development.
  • Tools: Version control systems like Git, build tools like Maven or Gradle, and Agile project management tools like Jira
  • Indeed
  •  +13

Typical Salary Ranges (India)

  • Freshers: ₹3.8 Lakh to ₹12 Lakh per year.
  • Experienced (5+ years): ₹18 Lakh to ₹30 Lakh+ per year.
  • Average (General): Approximately ₹29 Lakh per year for high-demand specialized roles. 


Read more
Wissen Technology
at Wissen Technology
4 recruiters
Sukanya Mohan
Posted by Sukanya Mohan
Bengaluru (Bangalore), Mumbai
6 - 14 yrs
Best in industry
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Payments
+6 more

Greetings!


Wissen Technology is hiring for Java developers/Lead.


Required Skillset

  • 6+ years of industrial experience
  • Java and related frameworks.
  • Experience in Core Java 1.8 and above, Data Structures, OOPS, Multithreading, Microservices, Spring and Swift Payments
  • Exposure on Fintech domain is mandatory
  • Should have the ability to analyse, design, develop and test complex, low-latency client-facing applications.
  • Good development experience with RDBMS
  • Good knowledge of multi-threading and high volume server side development
  • Excellent problem solving and coding skills in Java
  • Strong interpersonal, communication and analytical skills.


Company Profile:

Company Name : Wissen Technology

Group of companies in India : Wissen Technology & Wissen Infotech

Work Location - Bangalore

Website : www.wissen.com

Wissen Thought leadership : https://www.wissen.com/articles/

LinkedIn: https://www.linkedin.com/company/wissen-technology


Read more
Bengaluru (Bangalore)
4 - 9 yrs
₹10L - ₹15L / yr
skill iconAndroid Development
skill iconC
skill iconC++
skill iconGit
STS
+3 more
  • Experience: 4.5 to 10 Years.
  • Notice Period: Immediate to 15 days.
  • Location: Bangalore.
  • Budget:
  • 4.5 to 6 Years: 14 LPA.
  • 6.5 to 9 Years: 18 LPA.


Skills/Qualifications Required:

 

  • Strong knowledge of Android Architecture with experience in Java and C/C++.
  • Working experience in Android Generic Frameworks.
  • Hands-on experience with GIT/Gerrit and resolving conflicts while applying AOSP patches.
  • Proficiency in analyzing ANRs, tombstones, and system crashes.
  • Experience with analyzing Google compliance issues (STS, CTS, GTS, VTS).
  • Hands-on experience with JIRA.
  • Expertise in Binder IPC, Manager Service, System Services, AOSP customization, and custom ROM development.
Read more
Client on a mission to make crypto accessible to everyone.
Client on a mission to make crypto accessible to everyone.
Agency job
via wrackle by Naveen Taalanki
Bengaluru (Bangalore)
3 - 10 yrs
₹20L - ₹40L / yr
skill iconGo Programming (Golang)
golang
skill iconKubernetes
skill iconDocker

About the Role:

As a part of the Tech team, you will be involved in solving technical challenges, working with modern databases and systems, design and architecture of components/services, and handling highly critical secure data.

 

Responsibilities:

  • You’ll be working on our P2P and cryptocurrency exchange platforms to build more features around it.
  • Understand the way current users interact with the chatbot and how to optimize the existing content.
  • WazirX being a financial product, you’ll be involved in building tools to make our user’s data more secure.
  • You will be working on blockchain technologies
  • You will help maintain code quality and organization.
  • We expect you to learn about new software technologies, and proactively look for ways to make WazirX better.

 

You'll be a good fit if:

  • You’ve got 3 to 6 years of development experience.
  • You’re an expert in writing background tasks, test-driven development.
  • You’re an expert in Golang 
  • You’re good at understanding and implementing multithreaded environments to improve the speed of the execution
  • You enjoy collaborating with the front-end developers and other team members to establish objectives and design more functional, cohesive codes to enhance the user experience.
  • You’re committed to quality, and your code solves more problems than it creates ;)
Read more
Equal Experts
Remote, Bengaluru (Bangalore)
5 - 15 yrs
₹20L - ₹45L / yr
skill iconJava
Test driven development (TDD)
CI/CD
skill iconAmazon Web Services (AWS)
Windows Azure
+1 more
Equal Experts is a community of talented experienced software development consultants, specializing in Agile Delivery. A place where you are a polyglot, working alongside the client, enabling them, and adding real value to their products. A world where you are working with great, like-minded people, while you learn new technology on the go and implementing the best practices.

We indulge in all things that would excite you!!
  • Work on large-scale, custom distributed software systems using Java, Scala,
  • MongoDB, JavaScript (AngularJS, ReactJS), and the likes
  • We work almost exclusively on customer site providing a mix of delivery and consulting
  • services, so you'll be flexible about travel
  • Employ Agile development including task estimation, test automation, deployment automation, and Continuous Integration to improve overall execution speed and product quality
  • Work in a dynamic, collaborative, transparent, non-hierarchical, and ego-free culture where your talent is valued over a designation or title
  • Spread the word about best practices in software development inside and outside the Equal Experts community like Expert Talks

What we look for in you?
  • 6 + years of Hands-on development and delivery experience with Java, Scala, and the likes
  • Passion for software engineering and craftsman-like coding prowess
  • Great OO skills, including strong design patterns knowledge
  • Experience working with Agile, TDD, Lean, and/or Continuous Delivery approaches and best practices, such as Extreme Programming (XP)
  • Enthusiastic to work collaboratively with people and sharing your ideas to solve real business problems
Read more
Edumyra
at Edumyra
4 recruiters
Saumya Mishra
Posted by Saumya Mishra
Mumbai
2 - 5 yrs
₹4L - ₹6L / yr
skill iconPython
skill iconDjango
Relational Database (RDBMS)
skill iconDocker
skill iconGit
+4 more

We're looking for exprienced Python developers with over 2+ years of production experience and strong expertise in building web applications and APIs using Python, Django and DRF. We are looking for cadidates who are go-getters and are leaning towards leadership positions. Candidates must have a proven history of building, scaling, optimising and securing Python based backends and APIs using a microservice architecture.

 

Bonus Skills : Experience with ReactJs, Node.js, FastAPI

 

We would prefer candidates who can join immediately or are currently serving their notice period. Jumpers please excuse, your application will be ignored

 

Key Skills Required

  1. Proficiency in Python 3.x based web and backend development
  2. Solid understanding of Python concepts
  3. Strong experience in building web applications using Django
  4. Experience building REST APIs using DRF or Flask
  5. Experience with some form of Machine Learning (ML)
  6. Experience in using libraries such as Numpy and Pandas
  7. Hands on experience with RDBMS such as Postgres or MySQL including querying
  8. Comfort with Git repositories, branching and deployment using Git
  9. Working experience with Docker
  10. Basic working knowledge of ReactJs
  11. Experience in deploying Django applications to AWS,Digital Ocean or Heroku

 

Responsibilities

  1. Understanding requirement and congributing to engineering solutions at a conceptual stage to provide the best possible solution to the task/challenge
  2. Building high quality code using coding standards based on the SRS/Documentation
  3. Building component based, maintainable, scalable and reusable backend libraries/modules.
  4. Building & documenting scalable APIs on the Open Spec standard
  5. Unit testing development modules and APIs
  6. Conducting code reviews to ensure that the highest quality standard are maintained
  7. Securing backend applications and APIs using industry best practices
  8. Troubleshooting issues and fixing bugs raised by the QA team efficiently.
  9. Optimizing code
  10. Building and deploying the applications
  • Employment type

    Full-time
Read more
Smart joules
Smart joules
Agency job
via CareerBabu by shalini kumari
Remote, NCR (Delhi | Gurgaon | Noida)
3 - 5 yrs
₹7L - ₹19L / yr
skill iconNodeJS (Node.js)
Architecture
skill iconAmazon Web Services (AWS)
Microservices
skill iconJava
+1 more
Minimum 2 years of experience as a leading software engineer with IOT, data and cloud in an IOT development company.
o Minimum 8 years of overall experience in software development.
o Experience as a Lead developer .
o Experience with AWS,Architecture, Node js.
Read more
Qurix
at Qurix
1 recruiter
Teja Thota
Posted by Teja Thota
Hyderabad
1 - 3 yrs
₹2L - ₹6L / yr
Spring
Hibernate (Java)
skill iconJava
J2EE
Struts
+1 more
1. Strong fundamentals OOPS concepts, Exception Handling, Coding Standards, Logging
2. Demonstrable abilities to optimize code. Strong analytical skills for effective problem solving
3. Experience in Java Spring, Hibernate, Github. Spring boot optional
Read more
company logo
Agency job
via Vivriti Capital by Rama S
Chennai
3 - 8 yrs
₹7L - ₹25L / yr
skill iconRuby on Rails (ROR)
skill iconPython
skill iconJava
Data Structures
Algorithms
+1 more

 

Company profile

 

We are the pioneering player in the FinTech industry in India in the institutional credit space. We have created a one of a kind online marketplace for institutional credit ‘CredAvenue’, bringing together issuers and lenders, while also participating in the marketplace through their own balance sheet. Within a short span of two years, CredAvenue has gained immense traction and boasts of multiple clients across sectors, 120+ investors across multiple segments and a high volume of credit deal closures. To read about the latest numbers we have clocked, please visit http://www.credavenue.com">www.credavenue.com.

 

We are backed by two of the leading global Private Equity firms and have also been successful in attracting high quality talent from some of the leading companies and universities globally. With the fundamentals in place, we are now gearing up for our next phase of high growth, and we are further building up our team to take the company to the next level.

 

Primary Responsibilities

  • Responsible for full software life-cycle, system design and development of front-end & back-end systems
  • Writing high-quality code, participating in code reviews, designing/architecting systems of varying complexity and scope
  • Identify libraries and technologies worth experimentation
  • Build innovative solutions from scratch and liaise with architects and engineers to build solutions
  • Mentoring other team members

Required Skill

  •  Degree in Computer Science or relevant experience
  •  2-7 years of relevant hands-on software engineering experience doing software design and development
  •  Proven experience of working on back-end web frameworks like RoR (preferable) or Python/Django or Node.js
  •  Good command over at least one JavaScript frameworks like React.js, Vue.js or Angular
  •  Excellent understanding of relational database structures, having knowledge of unstructured databases (NoSQL) will be an  added advantage
  •  Expertise in object-oriented design, unit testing, integration testing, data structures, algorithms, scalable APIs, etc.
  •  Knowledge of working on cloud technologies and exposure of AWS services (EC2, RDS, S3, etc)
  •  Work in a fast-paced environment and make pragmatic engineering decisions in a short amount of time
  •  Experience with Agile Development and Scrum methodologies.

 

 

 

Work Environment Details

  • An opportunity to play a formative role in an ambitious financial services marketplace spanning investment banking, debt capital markets, institutional finance, retail lending and asset management
  • A journey that will challenge and reward you in a manner few others will
Read more
Swiggy
at Swiggy
1 video
13 recruiters
Surendra  Motamarri
Posted by Surendra Motamarri
Bengaluru (Bangalore)
8 - 20 yrs
₹50L - ₹80L / yr
skill iconJava
Data Structures
Algorithms
skill iconPython
NOSQL Databases
+6 more
Job description :- PSE at Swiggy not only contribute to the high-level Architecture of several systems but also contribute to the overall success of the product by driving technology and best practices in engineering in their respective teams.- They establish technology vision for respective teams and demonstrate how to solve a deeply complex and hard technical challenge, and help communicate that vision upward (leadership), inward (peers and engineering team) and outward (product & business teams)Job responsibilities :- Coming up with best practices to help the team achieve their technical tasks and continually thrive in improving the technology of the product/team.- Experiment with new & relevant technologies and tools, and drive adoption while measuring yourself on the impact you can create.- Implementation of long term technology vision for your team.- Responsible for end to end architecture, high level design/ low level design of various systems and applications that you are assigned to- Creating architectures & designs for new solutions around existing/new areas- Decide technology & tool choices for your team & be responsible for them.- Driving the adoption of best practices & regular Participation in code reviews, design reviews, architecture discussions.- Technically Hands-on, prior experience with scalable Architecture- Possess 8+ years of software engineering and product delivery experience, with strong- Excellent command over Data Structures and Algorithms- Exceptional coding skills in an Object-Oriented programming language (Java preferred)- Strong problem solving and analytical skills- Experience with web technologies, PHP/ Java, Python, Linux, Apache, MySQL, solr,- Good knowledge of distributed technologies, real time systems of high throughput, low latency and highly scalable systems- Experience with high performance websites catering to millions of daily traffic is a plusCompany profile : - Swiggy is India's largest food ordering and delivery platform. With a vision of Changing the Way India Eats, the company has more than 25,000 active restaurants partners across eleven cities in the country.- Swiggy's innovative technology, large and nimble delivery service, and customer focus enable a host of benefits including lightning fast deliveries, live order tracking, no restrictions on minimum order amounts, and strong customer support. With a huge a customer base and 5lac order per day. Swiggy is redefining the food tech industry.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos