Cutshort logo
Technology service company logo
Sr. Spark Software Engineer
Technology service company
Sr. Spark Software Engineer
Technology service company's logo

Sr. Spark Software Engineer

at Technology service company

Agency job
5 - 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
Java
J2EE
Spring Boot
Hibernate (Java)
Ansible
Git
JIRA
Apache Spark
Spark
Apache Kafka
Microservices
Kubernetes
Terraform
NOSQL Databases
API
Docker
  • Bachelor’s or master’s degree in Computer Engineering, Computer Science, Computer Applications, Mathematics, Statistics, or related technical field. Relevant experience of at least 3 years in lieu of above if from a different stream of education.

  • Well-versed in and 3+ hands-on demonstrable experience with: ▪ Stream & Batch Big Data Pipeline Processing using Apache Spark and/or Apache Flink.
    ▪ Distributed Cloud Native Computing including Server less Functions
    ▪ Relational, Object Store, Document, Graph, etc. Database Design & Implementation
    ▪ Micro services Architecture, API Modeling, Design, & Programming

  • 3+ years of hands-on development experience in Apache Spark using Scala and/or Java.

  • Ability to write executable code for Services using Spark RDD, Spark SQL, Structured Streaming, Spark MLLib, etc. with deep technical understanding of Spark Processing Framework.

  • In-depth knowledge of standard programming languages such as Scala and/or Java.

  • 3+ years of hands-on development experience in one or more libraries & frameworks such as Apache Kafka, Akka, Apache Storm, Apache Nifi, Zookeeper, Hadoop ecosystem (i.e., HDFS, YARN, MapReduce, Oozie & Hive), etc.; extra points if you can demonstrate your knowledge with working examples.

  • 3+ years of hands-on development experience in one or more Relational and NoSQL datastores such as PostgreSQL, Cassandra, HBase, MongoDB, DynamoDB, Elastic Search, Neo4J, etc.

  • Practical knowledge of distributed systems involving partitioning, bucketing, CAP theorem, replication, horizontal scaling, etc.

  • Passion for distilling large volumes of data, analyze performance, scalability, and capacity performance issues in Big Data Platforms.

  • Ability to clearly distinguish system and Spark Job performances and perform spark performance tuning and resource optimization.

  • Perform benchmarking/stress tests and document the best practices for different applications.

  • Proactively work with tenants on improving the overall performance and ensure the system is resilient, and scalable.

  • Good understanding of Virtualization & Containerization; must demonstrate experience in technologies such as Kubernetes, Istio, Docker, OpenShift, Anthos, Oracle VirtualBox, Vagrant, etc.

  • Well-versed with demonstrable working experience with API Management, API Gateway, Service Mesh, Identity & Access Management, Data Protection & Encryption.

    Hands-on experience with demonstrable working experience with DevOps tools and platforms viz., Jira, GIT, Jenkins, Code Quality & Security Plugins, Maven, Artifactory, Terraform, Ansible/Chef/Puppet, Spinnaker, etc.

  • Well-versed in AWS and/or Azure or and/or Google Cloud; must demonstrate experience in at least FIVE (5) services offered under AWS and/or Azure or and/or Google Cloud in any categories: Compute or Storage, Database, Networking & Content Delivery, Management & Governance, Analytics, Security, Identity, & Compliance (or) equivalent demonstrable Cloud Platform experience.

  • Good understanding of Storage, Networks and Storage Networking basics which will enable you to work in a Cloud environment.

  • Good understanding of Network, Data, and Application Security basics which will enable you to work in a Cloud as well as Business Applications / API services environment.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos

Similar jobs

UST Global
at UST Global
2 recruiters
Agency job
via Vysystem pvt Ltd by hari prasath
Bengaluru (Bangalore), Chennai, Cochin, Thiruvananthapuram
4 - 8 yrs
₹10L - ₹22L / yr
Java
Spring Boot
Hibernate (Java)
Microservices
  • 5+ years in java - backend application for programming - architecting highly scalable & performing Web Applications (Java)
  • Strong experience in JAVA, Hibernate, Spring boot, micro services
  • Strong experience in Cloud platform.
  • - 7+ years of experience in eCommerce Software development
  • - 4+ years of developing / architecting high transaction high throughput systems is a must
  • - 2+ years of experience with integrating 3rd party solutions in existing architecture
  • - 4+ years of developing / architecting high transaction high throughput systems is a must
  • - 2+ years of experience in agile ways of working in a distributed geographical model
Read more
Basik Marketing PVT LTD
at Basik Marketing PVT LTD
2 candid answers
Naveen G
Posted by Naveen G
Bengaluru (Bangalore)
2 - 5 yrs
₹5L - ₹8L / yr
Java
J2EE
Spring Boot
Hibernate (Java)
JUnit

Overview: 

We are seeking an experienced Spring Boot developer with a passion for esports to join our team. The ideal candidate will have a strong track record of building and maintaining web applications using Spring Boot and a proven ability to work effectively in a team environment. Experience in the esports industry is a plus. 

Responsibilities: 

  • Develop and maintain web applications using Spring Boot and related technologies 
  • Write clean, maintainable, and efficient code 
  • Collaborate with the design and product management teams to implement new features and functionality 
  • Work with the DevOps team to ensure proper deployment and monitoring of applications 
  • Troubleshoot and debug issues as they arise 
  • Write and maintain comprehensive documentation 

Requirements: 

  • Strong professional experience with Java and Spring Boot 
  • Experience with building and deploying web applications 
  • Familiarity with web development frameworks such as Spring MVC or Spring WebFlux 
  • Experience with Git and version control 
  • Strong problem-solving and communication skills 

Preferred: 

  • Experience in the esports industry 
  • Experience with cloud technologies such as AWS or Azure 
  • Familiarity with front-end development technologies such as HTML, CSS, and JavaScript 
  • Experience with data persistence technologies such as Hibernate or JPA 
  • Experience with testing frameworks such as JUnit or Mockito 
Read more
Zscaler
at Zscaler
2 recruiters
Saran Kumar
Posted by Saran Kumar
Remote only
7 - 14 yrs
₹25L - ₹45L / yr
NodeJS (Node.js)
TypeScript
Python
Database Design
Microservices

Description:

For over 10 years, Zscaler has been disrupting and transforming the security industry. Our 100% purpose-built cloud platform delivers the entire gateway security stack as a service through 150 global data centers to securely connect users to their applications, regardless of device, location, or network in over 185 countries protecting over 3,900 companies and have detected 100 Million threats/day. 

We work in a fast-paced, dynamic and make it happen culture. Our people are some of the brightest and passionate in the industry that thrives on being the first to solve problems.  We are always looking to hire highly passionate, collaborative and humble people that want to make a difference.

 

About the role :

This is a senior staff backend engineer role in the engineering team that designs, implements and maintains our state of the art product IllusionBLACK. The team is responsible for designing and implementing secure, highly performant and maintainable product.

 

Responsibilities:

  • Architect, develop and maintain high performance, fault tolerant and scalable cloud hosted service using NodeJS
  • End to end responsibility to continuously create and monitor the services you build
  • Help design reusable and clean API's for our frontend React app
  • Guide team members with handling complex issues
  • You will also be responsible for database schema design and development of migration scripts
  • Experiment with new technologies and ideas and help shape our stack and processes

 

Requirement:

  • 10+ years professional SW development experience
  • All our production applications are built with either Typescript or Python. You must have a strong understanding of NodeJS express apps written in Typescript and ES6
  • Must have good experience with Python
  • Solid experience with databases is a must. We use and love Postgres here at Smokescreen
  • You should be able to design a complex database SQL schema normalized to 3NF on the back of a napkin at 3am in the morning
  • Deep understanding and working knowledge of Redis cache
  • Experience with Solr or Elasticsearch is a must. We use Solr for our event analytics exclusively
  • Experience with AWS, Azure or GCP is a plus. We have a large distributed application running on AWS
  • Experience with Docker/Swarm is a plus
  • Experience in some stream processing platforms like Kafka/Redis stream is a plus
Read more
AirProbe
at AirProbe
1 recruiter
Gourav Kumar Singh
Posted by Gourav Kumar Singh
Remote, Bengaluru (Bangalore)
3 - 4 yrs
₹10L - ₹15L / yr
Python
RESTful APIs
PostgreSQL
Redis
Celery
+4 more
**Must Haves:**
Passionate about getting things done mindfully, rationally.
Good understanding of OOPS and Data structures
Proficiency in Python with at least 3-4 years of relevant experience
Solid understanding and deep knowledge of Flask, Docker, REST API's.
Knowledge of Databases - PostgreSQL
Working experience with Test Driven development

**Good to Have:**
Knowledge of Redis, Celery
Knowledge of Microsoft Azure.
End to End application Design, Development and Deployment

**Responsibilities:**
Interact and identify the gaps that exist between various products used in Airprobe and their needs.
Architect and build applications to address those gaps.
Create and improve the design, analytics, coding and testing for high-quality software and new products.
Write clean, maintainable code following best practices (unit testing, source control, continuous integration, automation, design patterns, etc.)
Debug code and troubleshoot problems
Build automation scripts/DevOps/CI-CD pipeline for the application over Azure.

**Expectation:**
Start up Culture, Push the Boundaries, Leadership Qualities, Problem Solving
Responsibility Driven: We’ll ask you to take end to end ownership of whatever you are doing. We believe that the best comes out of you when you ship something end to end.
You know how to maintain balance between perfectionism and pragmatism.
You are research oriented, and love to explore ways to find things that you don’t already know
Read more
The Solar Labs
at The Solar Labs
3 recruiters
Ruchika Prakash
Posted by Ruchika Prakash
Bengaluru (Bangalore)
2 - 3 yrs
₹12L - ₹14L / yr
Java
Python
Data Structures
Algorithms
Django
About the Company :

The Solar Labs was founded by IIT alumni in 2017 to accelerate solar adoption in the world. Our products empower the solar industry to help it succeed. We develop software that helps solar installers and developers in designing more optimized solar PV systems, increase energy yield per panel installed, reduce cost of installations and create quotations and reports for clients within 20 minutes. The software has been used to estimate 1200 MW+ of solar capacity across India and serves some of the largest companies in the world including Tata Power, Adani Solar, Renew Power and hundreds of MSMEs.

When we succeed, the solar industry wins, and the world wins.

About the Product :
It's a 3d simulation software, to replicate rooftops/commercial sites, place solar panels and generate the estimation of solar energy.

Responsibilities :
- Develop cloud-based Python Django software products
- Working closely with UX and Front-end Developers
- Participating in architectural, design and product discussions Designing and creating RESTful APIs for internal and partner consumption
- Working in an agile environment with an excellent team of engineers

Skills :
- Solid database skills in a relational database (i.e. PostgresSQL, MySQL, etc.) Knowledge of how to build and use with RESTful APIs
- Strong knowledge of version control (i.e. git, svn, etc.)
- Experience deploying Python applications into production
- Amazon Web Services (AWS) or Google cloud infrastructure knowledge is a plus
Read more
Loyalty Juggernaut Inc
at Loyalty Juggernaut Inc
2 recruiters
Shraddha Dhavle
Posted by Shraddha Dhavle
Hyderabad
0 - 3 yrs
₹5L - ₹15L / yr
Java
Python
AngularJS (1.x)
iOS App Development
Android Development

Loyalty Juggernaut, Inc. (LJI) is a next-generation loyalty and customer engagement solutions enterprise, helping brands re-imagine their loyalty initiatives in #theageofdigitalconsumer.

 

Headquartered in the Silicon Valley with R & D and Professional Services presence in Hyderabad, India and Distribution offices globally. LJI is founded by customer relationship management experts with decades of experience in delivering world-class technology innovations in CRM, Loyalty, AdTech and consulting for leading global brands across industries. 

LJI delivers GRAVTY – transformational digital platform for loyalty and customer engagement built on Big Data, Micro-services based, Serverless Architecture, AI/ML delivered on the Cloud to help brands execute innovative strategies aimed at attracting, acquiring, rewarding, recognizing, engaging, and leveraging customers in order to maximize revenue, profitability and customer lifetime value.

 

Visit us at http://www.lji.io/">www.lji.io

 

LJI is inviting applications for the position of Product Engineer in our R&D Team

 

YOUR RESPONSIBILITIES 

As a Product Engineer in R&D team, you will  be responsible for end-end Software development life-cycle involving Technical design, implementation, deployment, and support. You will 

  • Work actively with Product Specialists, Business Analysts and other stakeholders on the development of cutting-edge product features
  • Partner with Customer Success teams to review and implement business requirements
  • Build high-quality innovative and reusable code - design and implement new features in cooperation with the enterprise architect
  • Conduct software analysis, programming, testing and debugging
  • Ensure designs are in compliance with specifications
  • Identify production and non-production application issues and support them

 

OUR TECH STACK

  • Java(SpringBoot)
  • Python(Django)
  • PostgreSQL
  • REST, WebServices
  • Angular, Javascript, HTML
  • Jenkins, Maven, Git, Ansible
  • AWS

 

YOUR PROFILE

  1. B.Tech or M.Tech in CSE/IT OR MCA/BCA
  2. Strong programming skills
  3. Analytical mind and problem-solving aptitude   
  4. Excellent communication skills
  5. Attention to detail  

 

OUR OFFERING

  1. Opportunity to Innovate with and Learn from a World-class technology team
  2. Dabble into the future of technology - Enterprise Cloud Computing, Blockchain, Machine Learning and AI, Mobile, Digital Wallets, and much more...
  3. Grow with a fast growing company with global presence and recognition
Read more
A health care company
A health care company
Agency job
via Wenger and Watson Inc by DattatrayaKolangade
Remote, Bengaluru (Bangalore)
2 - 5 yrs
₹8L - ₹16L / yr
NodeJS (Node.js)
Java
Ruby on Rails (ROR)
Go Programming (Golang)
Python
  • A Bachelors or master’s degree in engineering.
  • 2-4 years of experience in software product development.
  • Excellent in Data structure, Algorithms & Problem-solving skills.
  • Should be willing to code in Node.js/Java/Python/ROR/Golang
  • Write extensive, efficient code to address complex modules and that handles interaction between multiple components.
  • Customer-focused, react well to changes, work with teams and able to multi-task.
  • Must be a proven performer and team player that enjoy challenging assignments in a high-energy, fast growing and start-up workplace.
  • Must be a self-starter who can work well with minimal guidance and in fluid environment
Read more
PickYourTrail
at PickYourTrail
4 recruiters
Gowri Shankar
Posted by Gowri Shankar
Chennai
3 - 10 yrs
₹4L - ₹20L / yr
Amazon Web Services (AWS)
Java
J2EE
Struts
Spring
+3 more
Senior Java Developer Enthusiastic about developing highly scalable, foolproof, end-to-end quality software? Then, you are the one we are looking for. You are very agile in planning your day, so you write thousand and thousand lines of code without breaking a sweat. You do this, day-in and day-out. You are flexible in working with multidisciplinary teams and you push your teammates to their limits & ensure that the work is done. Drop by, let's talk over a cup of Java. Soft skills Should be able to understand and appreciate that chaos / randomisation is the only constant at a startup. Should be a passionate self-starter; ready to get their hands dirty Should envision and manage the growth of tech vertical to complement business growth Should have a clarity in thought and articulation. Prior experience of high energy and intense environments - would be a plus Technical skills Core Java Spring framework GIT AWS REST API Mongo DB Node Basics
Read more
Smart Data Enterprises
Nagpur
3 - 5 yrs
₹3L - ₹8L / yr
jQuery
RESTful APIs
PHP
MySQL
CodeIgniter
+3 more
Job Description :When you wake up in the morning, do you go to work in an environment where you utilize cutting edge tools/technologies and analytic practices? Would you enjoy solving complex problems with a business that values your contributions? Is innovation a regular practice in your daily life?. If 'No' Give a thought to work with - smartData EnterprisesKey Skills Required : Cake PHP, Mysql, Jquery, API (Restful Service) CakePHP, Laravel, CodeIgniter. Here is an opportunity for a techie who will take care of the page layout, the design and the entire coding of the website in PHP format.Essential Responsibility Includes :- Integration of user-facing elements developed by front-end developers.- Build efficient, testable, and reusable PHP modules.- Solve complex performance problems and architectural challenges.- Integration of data storage solutions.- Advanced knowledge of building Content Management Systems, either from your own design or from frameworks such as , CakePHP, Laravel, CodeIgniter
Read more
Hvantage Technologies Inc.
Madhuri Dhiman
Posted by Madhuri Dhiman
Indore
0 - 4 yrs
₹1L - ₹1L / yr
PHP
MySQL
Java
Proficient in PHP, WebAPI Development Database : MySql, PostgreSQL Node.js Experience of Object Oriented Programming Skills PHP Frameworks: Laravel, CakePHP, Zend, CodeIgniter, Yii2 CMS: Wordpress, Magento 2 E-commerce: Shopify, Prestashop, Woocommerce Version Control: Git, SVN, GitLab Front End: AngularJS, jQuery Frameworks, JavaScript Frameworks, AJAX, HTML5, CSS3 XML, XSLT, JSON 1 years of extensive experience in PHP4 and PHP5.x, HTML, CSS, JAVASCRIPT, JQUERY, AJAX, API.Experience with MVC, Framework like Codeigniter and LARAVEL for developing enterprise applications.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos