Cutshort logo
Technology service company logo
Sr. Spark Software Engineer
Technology service company
Sr. Spark Software Engineer
Jobdost's logo

Sr. Spark Software Engineer

at Technology service company

Agency job
5 - 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Ansible
skill iconGit
JIRA
Apache Spark
Spark
Apache Kafka
Microservices
skill iconKubernetes
Terraform
NOSQL Databases
API
skill iconDocker
  • Bachelor’s or master’s degree in Computer Engineering, Computer Science, Computer Applications, Mathematics, Statistics, or related technical field. Relevant experience of at least 3 years in lieu of above if from a different stream of education.

  • Well-versed in and 3+ hands-on demonstrable experience with: ▪ Stream & Batch Big Data Pipeline Processing using Apache Spark and/or Apache Flink.
    ▪ Distributed Cloud Native Computing including Server less Functions
    ▪ Relational, Object Store, Document, Graph, etc. Database Design & Implementation
    ▪ Micro services Architecture, API Modeling, Design, & Programming

  • 3+ years of hands-on development experience in Apache Spark using Scala and/or Java.

  • Ability to write executable code for Services using Spark RDD, Spark SQL, Structured Streaming, Spark MLLib, etc. with deep technical understanding of Spark Processing Framework.

  • In-depth knowledge of standard programming languages such as Scala and/or Java.

  • 3+ years of hands-on development experience in one or more libraries & frameworks such as Apache Kafka, Akka, Apache Storm, Apache Nifi, Zookeeper, Hadoop ecosystem (i.e., HDFS, YARN, MapReduce, Oozie & Hive), etc.; extra points if you can demonstrate your knowledge with working examples.

  • 3+ years of hands-on development experience in one or more Relational and NoSQL datastores such as PostgreSQL, Cassandra, HBase, MongoDB, DynamoDB, Elastic Search, Neo4J, etc.

  • Practical knowledge of distributed systems involving partitioning, bucketing, CAP theorem, replication, horizontal scaling, etc.

  • Passion for distilling large volumes of data, analyze performance, scalability, and capacity performance issues in Big Data Platforms.

  • Ability to clearly distinguish system and Spark Job performances and perform spark performance tuning and resource optimization.

  • Perform benchmarking/stress tests and document the best practices for different applications.

  • Proactively work with tenants on improving the overall performance and ensure the system is resilient, and scalable.

  • Good understanding of Virtualization & Containerization; must demonstrate experience in technologies such as Kubernetes, Istio, Docker, OpenShift, Anthos, Oracle VirtualBox, Vagrant, etc.

  • Well-versed with demonstrable working experience with API Management, API Gateway, Service Mesh, Identity & Access Management, Data Protection & Encryption.

    Hands-on experience with demonstrable working experience with DevOps tools and platforms viz., Jira, GIT, Jenkins, Code Quality & Security Plugins, Maven, Artifactory, Terraform, Ansible/Chef/Puppet, Spinnaker, etc.

  • Well-versed in AWS and/or Azure or and/or Google Cloud; must demonstrate experience in at least FIVE (5) services offered under AWS and/or Azure or and/or Google Cloud in any categories: Compute or Storage, Database, Networking & Content Delivery, Management & Governance, Analytics, Security, Identity, & Compliance (or) equivalent demonstrable Cloud Platform experience.

  • Good understanding of Storage, Networks and Storage Networking basics which will enable you to work in a Cloud environment.

  • Good understanding of Network, Data, and Application Security basics which will enable you to work in a Cloud as well as Business Applications / API services environment.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Timble Technologies
at Timble Technologies
1 recruiter
Shefali Gupta
Posted by Shefali Gupta
Delhi, Gurugram, Noida, Ghaziabad, Faridabad
1 - 4 yrs
₹2L - ₹5L / yr
Advanced Linux Admin
Ansible
Terraform
skill iconDocker
skill iconJenkins
+7 more

Job Title: Devops Engineer

Location: Delhi, Arjan Garh

Job Type: Full-Time

IMMEDIATE JOINERS REQUIRED

 

About Us:

Timble is a forward-thinking organization dedicated to leveraging cutting-edge technology to solve real-world problems. Our mission is to drive innovation and create impactful solutions through artificial intelligence and machine learning.


About the Role

We are looking for a high-ownership Senior DevOps Engineer to architect and maintain the mission-critical infrastructure supporting our global algorithmic trading operations. You will be the bridge between development and live trading, ensuring zero-latency performance and 100% system availability.

Key Responsibilities

  • Infrastructure Architecture: Design scalable, fault-tolerant systems for high-frequency trading environments.
  • Performance Optimization: Tune Linux servers and Python environments for maximum speed and efficiency.
  • Incident Management: Lead real-time response for live trading systems, performing RCA and preventive fixes.
  • Automation & CI/CD: Build and enhance robust pipelines using Docker, Jenkins, and Ansible.
  • Proactive Monitoring: Implement advanced logging and alerting (Prometheus/Grafana) to ensure high uptime.
  • Database Admin: Manage relational databases and write optimized SQL for operational reporting.
  • Mentorship: Guide junior DevOps members and maintain rigorous system documentation.

Technical Requirements

  • OS/Scripting: Advanced Linux Admin and expert-level Python scripting.
  • IaC & Tools: Hands-on experience with Ansible, Terraform, and Docker.
  • CI/CD: Proficiency in Jenkins or GitLab CI.
  • Data: Strong SQL skills with experience in performance tuning.
  • Education: B.Tech/M.Tech in Computer Science or related engineering field.
Read more
Deqode
at Deqode
1 recruiter
Apoorva Jain
Posted by Apoorva Jain
Hyderabad
6 - 12 yrs
₹5L - ₹20L / yr
skill iconJava
Apache Kafka
skill iconSpring Boot
Spring MVC
Microservices

Job Summary

We are seeking an experienced Java + Kafka Developer to design, develop, and maintain high-performance, event-driven applications. The ideal candidate will have strong backend development skills in Java and hands-on experience with Apache Kafka for building scalable, real-time data processing systems.

Key Responsibilities

  • Design and develop event-driven microservices using Java and Apache Kafka
  • Build and maintain Kafka producers, consumers, topics, and streams
  • Implement message processing, retries, error handling, and idempotency
  • Develop and integrate RESTful APIs
  • Ensure high availability, scalability, and performance of Kafka-based systems
  • Monitor, troubleshoot, and optimize Kafka and application performance
  • Collaborate with architects, DevOps, and QA teams
  • Participate in code reviews and follow best practices
  • Contribute to system design and technical discussions

Required Skills

  • 6+ years of experience in Java backend development
  • Strong hands-on experience with Apache Kafka
  • Experience with event-driven and streaming architectures
  • Solid understanding of microservices architecture
  • Experience with REST APIs
  • Good knowledge of multithreading, concurrency, and JVM concepts
  • Familiarity with SQL / NoSQL databases
  • Strong problem-solving and debugging skills



Read more
Wissen Technology
at Wissen Technology
4 recruiters
Anurag Sinha
Posted by Anurag Sinha
Pune, Mumbai, Bengaluru (Bangalore)
5 - 9 yrs
Best in industry
skill iconPython
RESTful APIs
skill iconFlask
skill iconKubernetes
DevOps
+2 more
  • 5+ years of experience
  • FlaskAPI, RestAPI development experience
  • Proficiency in Python programming.
  • Basic knowledge of front-end development.
  • Basic knowledge of Data manipulation and analysis libraries
  • Code versioning and collaboration. (Git)
  • Knowledge for Libraries for extracting data from websites.
  • Knowledge of SQL and NoSQL databases
  • Familiarity with RESTful APIs
  • Familiarity with Cloud (Azure /AWS) technologies


Read more
Series A Funded product Startup
Agency job
via Qrata by Blessy Fernandes
Bengaluru (Bangalore)
3 - 5 yrs
₹10L - ₹22L / yr
skill iconJava
J2EE
skill iconSpring Boot
skill iconPython

Responsibilities:

• Collaborate with cross-functional teams, including front-end developers, product managers, and designers, to understand project requirements and translate them into technical specifications.

• Design and develop server-side logic, APIs, and database schema to support the functionality and performance requirements of our SaaS platform.

• Write clean, modular, and well-documented code using any relevant programming language preferably Java with SpringBoot.

• Optimize the backend systems for maximum speed and scalability, ensuring high performance and responsiveness of the application.

• Implement data storage solutions using PostgreSQL or other relational databases, ensuring data integrity and security.

• Conduct thorough testing and debugging to identify and resolve any issues or bugs in the backend code.

• Stay up-to-date with emerging technologies, industry trends, and best practices in backend development and contribute to the continuous improvement of our development processes.


Requirements:

• Proven work experience as a Backend Developer or similar role, with a focus on server-side development.

• Proficiency in working with relational databases, particularly PostgreSQL, and writing efficient SQL queries.

• Familiarity with SaaS concepts and architecture.

• Experience with API design and development, including RESTful APIs.

• Solid understanding of software development principles, including object-oriented programming, design patterns, and data structures.

• Experience with version control systems, such as Git.

• Strong problem-solving and analytical skills, with keen attention to detail.

• Excellent communication and teamwork skills, with the ability to collaborate effectively with cross-functional teams.

• Bachelor's degree in Computer Science, Engineering, or a related field is preferred, but not mandatory

Read more
Leading manufacturing company
Leading manufacturing company
Agency job
Chennai
3 - 6 yrs
₹3L - ₹6L / yr
skill iconPython
skill iconDjango
skill iconFlask
MySQL
API
+1 more

Primary Skills: Database Systems (SQL), Python Flask/Fast API/Django frameworks specifically
Requirements:

  • Highly proficient in fundamentals of Python web development frameworks like Flask, Django and Fast API
  • Demonstrated experience in developing APIs using Python frameworks
  • Should have deep knowledge in PostgreSQL, MS SQL Server and other SQL based Databases
Read more
Auxesis Infotech
at Auxesis Infotech
2 recruiters
Auxesis Infotech
Posted by Auxesis Infotech
Remote, Delhi, Gurugram, Noida, Ghaziabad, Faridabad
6 - 15 yrs
₹9L - ₹15L / yr
skill iconLaravel
skill iconCodeIgniter
skill iconPHP
Drupal
skill iconGit
+1 more

Are you an experienced, ambitious Software Developer looking for a challenging role where you can learn and grow a lot more?

We are looking for motivated technical leads with skills in PHP-based frameworks to come to join our fast-paced, fun, and rewarding agile team of professionals.

If you are passionate about technology, constantly seeking to learn and improve your skillset, then you are the type of person we are looking for!

We are offering superb career growth opportunities, great compensation, and benefits.

Responsibilities: 

  • Technical Leads to provide solutions to technical issues, and are responsible for meeting development schedules and ensuring the delivered solution meets the technical specifications and design requirements 
  • Determining project requirements and developing work schedules for the team.
  • Delegating tasks and achieving daily, weekly, and monthly goals. 
  • Liaising with team members, management, and clients to ensure projects are completed to standard.. 
  • Analyzing existing operations and scheduling training sessions and meetings to discuss improvements. 
  • Keeping up-to-date with industry trends and developments. 
  • Updating work schedules and performing troubleshooting as required.
  •  Writing progress reports and delivering presentations to the relevant stakeholders.
  • Framework Conduct peer-reviews and lead reviews and provide feedback.
  • Develop, maintain, troubleshoot, enhance and document

Requirements: 

 

  • 6+ Years of IT industry experience 
  • Sound knowledge of PHP Based frameworks (Word press, Laravel, Drupal, Codeigniter JavaScript, HTML, CSS 
  • Ability to manage multiple projects and juggle priorities 
  • Hands-on experience with SQL/MySQL schema design, SOLID principles, REST API design 
  • Sound knowledge of estimation technique & design patterns 
  • Excellent technical, diagnostic, and troubleshooting skills 
  • Excellent communication, motivational, and interpersonal skills

    Perks & Benefits:

  • Work from home/hybrid
  • 5 days working 
  • Leave compensations 
  • Flexible working hours 
  • Exposure to the international market
  • Medical Insurance
Read more
Omnirio
at Omnirio
3 recruiters
Ashwani Bhat
Posted by Ashwani Bhat
Remote only
8 - 12 yrs
₹26L - ₹30L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
SQL
+3 more
* 8+ years of experience in JAVA, J2EE, JavaScript, jQuery, MVC, web application framework, Spring framework, Hibernate, JPA, REST web services, Tomcat and Maven.
* Understanding of building architecture from product requirements.
* Experience of leading teams of developers to maximise performance.
* Knowledge of Multithreading, Thread Pooling, Background Jobs and Schedule Jobs with supporting tools and libraries.
* Working on Microservices based architecture using spring cloud, distributed application pattern and multiple data source management in the application.
* Working on Linux and Windows based OS and their command line tools.
* Working with unit testing frameworks.
* Object-Oriented development and Metaprogramming.
* Experience in working with the SQL Databases (MySQL or PostgreSQL) and No SQL. Databases (Cassandra or MongoDB).
* Knowledge of server configuration management and deployment techniques. Good to have experience in handling DevOps tools like Jenkins and containerization using Docker.
* Experience in working with different AWS cloud services.
Read more
Thinkdeeply
at Thinkdeeply
5 recruiters
Aditya Kanchiraju
Posted by Aditya Kanchiraju
Hyderabad
6 - 16 yrs
₹7L - ₹26L / yr
skill iconJava
Technical Architecture
Analytics
skill iconSpring Boot
Apache Kafka
+4 more

We are looking for an experienced engineer with superb technical skills. You will primarily be responsible for architecting and building large scale data pipelines that delivers AI and Analytical solutions to our customers. The right candidate will enthusiastically take ownership in developing and managing a continuously improving, robust, scalable software solutions. The successful candidate will be curious, creative, ambitious, self motivated, flexible, and have a bias towards taking action. As part of the early engineering team, you will have a chance to make a measurable impact in future of Thinkdeeply as well as having a significant amount of responsibility.

 

Although your primary responsibilities will be around back-end work, we prize individuals who are willing to step in and contribute to other areas including automation, tooling, and management applications. Experience with or desire to learn Machine Learning a plus.

 

Experience

12+ Years

 

Location

Hyderabad

 

Skills

Bachelors/Masters/Phd in CS or equivalent industry experience

10+ years of industry experience in java related frameworks such as Spring and/or Typesafe

Experience with scripting languages. Python experience highly desirable. 5+ Industry experience in python

Experience with popular modern web frameworks such as Spring boot, Play framework, or Django

Demonstrated expertise of building and shipping cloud native applications

Experience in administering (including setting up, managing, monitoring) data processing pipelines (both streaming and batch) using frameworks such as Kafka, ELK Stack, Fluentd

Experience in API development using Swagger

Strong expertise with containerization technologies including kubernetes, docker-compose

Experience with cloud platform services such as AWS, Azure or GCP.

Implementing automated testing platforms and unit tests

Proficient understanding of code versioning tools, such as Git

Familiarity with continuous integration, Jenkins

 

Responsibilities

 

Architect, Design and Implement Large scale data processing pipelines

Design and Implement APIs

Assist in dev ops operations

Identify performance bottlenecks and bugs, and devise solutions to these problems

Help maintain code quality, organization, and documentation

Communicate with stakeholders regarding various aspects of solution.

Mentor team members on best practices

 

Read more
Goscale Technologies
at Goscale Technologies
5 recruiters
Achintya Tiwari
Posted by Achintya Tiwari
Remote only
3 - 8 yrs
₹7L - ₹30L / yr
skill iconJava
J2EE
Struts
Spring
Hibernate (Java)
+1 more
Goscale - Apna Tech Collaboration
The present role is a Backend Developer – SDE role for Goscale - Apna Tech
Collaboration.
About Goscale
Goscale is a premium technology company focusing on helping companies building
world class scalable products. 
Goscale works with premium product companies (Indian and International) like - Swiggy,
ShareChat, Grab, Capillary, Uber, Workspan, Ovo and many more. We are responsible
for managing infrastructure for Swiggy as well.
We focus on building only world class tech product and our USP is building technology
can can handle scale from 1 million to 1 billion hits. 
We invite candidates who have a zeal to develop world class products to come and work
with us.
About Apna
apna is India’s most trusted and fastest growing professional platform. apna aims to
connect the right jobs to the right people in the shortest possible time and deliver a
delightful holistic experience to job seekers and recruiters.
It is a one-of-a-kind comprehensive professional app where alongside job search, you
can do a lot more like learn new skills, network with like minded people, get support to
start your business, engage with particular professional communities to hone your skills
and share your expertise.
In the words of our users, apna is one of the most rewarding interactive career apps in
India.

Required Skills:
Take ownership of end-to-end product development
Be champion of Test Driven Development methodology
Building reusable code and libraries for future use
Optimization of the application for maximum speed and scalability
Implementation of security and data protection
Technical Documentation around the owned product
Skills And Qualifications:
Expert level in OOPS concepts and REST API development. Typically 4+ years of
professional experience
Proficiency in one or more of the following languages: Python, Java, Ruby, Go
Knowledge around ElasticSearch, RabbitMQ, Redis
Integration of multiple data sources and databases into one system
Implementing automated testing platforms and unit tests
Proficient understanding of git
Knowledge of GCP would be a plus
Read more
True Value Infosoft Pvt Ltd
Vivek Goyal
Posted by Vivek Goyal
NCR (Delhi | Gurgaon | Noida)
2 - 5 yrs
₹3L - ₹8L / yr
Ionic
skill iconAngularJS (1.x)
API
Ionic Developer Experience of 2- 5 years in developing mobile applications with Ionic framework.

Build hybrid mobile applications using Ionic framework. Layout creation and API Integration.

Education
UG :Any Graduate in Any Specialization, Graduation Not Required
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos