Cutshort logo
Technology service company logo
Sr. Spark Software Engineer
Technology service company
Sr. Spark Software Engineer
Technology service company's logo

Sr. Spark Software Engineer

at Technology service company

Agency job
5 - 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Ansible
skill iconGit
JIRA
Apache Spark
Spark
Apache Kafka
Microservices
skill iconKubernetes
Terraform
NOSQL Databases
API
skill iconDocker
  • Bachelor’s or master’s degree in Computer Engineering, Computer Science, Computer Applications, Mathematics, Statistics, or related technical field. Relevant experience of at least 3 years in lieu of above if from a different stream of education.

  • Well-versed in and 3+ hands-on demonstrable experience with: ▪ Stream & Batch Big Data Pipeline Processing using Apache Spark and/or Apache Flink.
    ▪ Distributed Cloud Native Computing including Server less Functions
    ▪ Relational, Object Store, Document, Graph, etc. Database Design & Implementation
    ▪ Micro services Architecture, API Modeling, Design, & Programming

  • 3+ years of hands-on development experience in Apache Spark using Scala and/or Java.

  • Ability to write executable code for Services using Spark RDD, Spark SQL, Structured Streaming, Spark MLLib, etc. with deep technical understanding of Spark Processing Framework.

  • In-depth knowledge of standard programming languages such as Scala and/or Java.

  • 3+ years of hands-on development experience in one or more libraries & frameworks such as Apache Kafka, Akka, Apache Storm, Apache Nifi, Zookeeper, Hadoop ecosystem (i.e., HDFS, YARN, MapReduce, Oozie & Hive), etc.; extra points if you can demonstrate your knowledge with working examples.

  • 3+ years of hands-on development experience in one or more Relational and NoSQL datastores such as PostgreSQL, Cassandra, HBase, MongoDB, DynamoDB, Elastic Search, Neo4J, etc.

  • Practical knowledge of distributed systems involving partitioning, bucketing, CAP theorem, replication, horizontal scaling, etc.

  • Passion for distilling large volumes of data, analyze performance, scalability, and capacity performance issues in Big Data Platforms.

  • Ability to clearly distinguish system and Spark Job performances and perform spark performance tuning and resource optimization.

  • Perform benchmarking/stress tests and document the best practices for different applications.

  • Proactively work with tenants on improving the overall performance and ensure the system is resilient, and scalable.

  • Good understanding of Virtualization & Containerization; must demonstrate experience in technologies such as Kubernetes, Istio, Docker, OpenShift, Anthos, Oracle VirtualBox, Vagrant, etc.

  • Well-versed with demonstrable working experience with API Management, API Gateway, Service Mesh, Identity & Access Management, Data Protection & Encryption.

    Hands-on experience with demonstrable working experience with DevOps tools and platforms viz., Jira, GIT, Jenkins, Code Quality & Security Plugins, Maven, Artifactory, Terraform, Ansible/Chef/Puppet, Spinnaker, etc.

  • Well-versed in AWS and/or Azure or and/or Google Cloud; must demonstrate experience in at least FIVE (5) services offered under AWS and/or Azure or and/or Google Cloud in any categories: Compute or Storage, Database, Networking & Content Delivery, Management & Governance, Analytics, Security, Identity, & Compliance (or) equivalent demonstrable Cloud Platform experience.

  • Good understanding of Storage, Networks and Storage Networking basics which will enable you to work in a Cloud environment.

  • Good understanding of Network, Data, and Application Security basics which will enable you to work in a Cloud as well as Business Applications / API services environment.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Wissen Technology
at Wissen Technology
4 recruiters
Monika Sekaran
Posted by Monika Sekaran
Mumbai
3 - 7 yrs
Best in industry
skill iconJava
06692
skill iconPython
Spring
Data Structures
+2 more

Job Description:


  • He / She candidate must possess a strong technology background with advanced knowledge of Java and Python based technology stack.
  • Java, JEE, Spring MVC, Python, JPA, Spring Boot, REST API, Database, Playwright, CI/CD pipelines
  • * At least 3 years of Hand-on Java EE and Core Java experience with strong leadership qualities.
  • * Experience with Web Service development, REST and Services Oriented Architecture.
  • * Expertise in Object Oriented Design, Design patterns, Architecture and Application Integration.
  • * Working knowledge of Databases including Design, SOL proficiency.
  • * Strong experience with frameworks used for development and automated testing like SpringBoot, Junit, BDD etc.
  • * Experience with Unix/Linux Operating System and Basic Linux Commands.
  • * Strong development skills with ability to understand technical design and translate the same into workable solution.
  • * Basic knowledge of Python and Hand-on experience on Python scripting
  • * Build, deploy, and monitor applications using CI/CD pipelines, * Experience with agile development methodology.
  • Good to Have - Elastic Index Database, MongoDB. - No SQL Database Docker Deployments, Cloud Deployments Any Al ML. snowflake Experience


Read more
Webkul
at Webkul
1 recruiter
Damini Singh
Posted by Damini Singh
Noida, Lucknow
0.6 - 2 yrs
₹2L - ₹6L / yr
skill iconPHP
skill iconLaravel
skill iconCodeIgniter
MySQL
skill iconHTML/CSS
+4 more

Description:

  • Should have hands-on experience in Web Development
  • Good understanding of PHP and Object-oriented programming paradigm.
  • Able to understand project requirement and handle project independently.
  • Strong learning capability.
  • Having a good knowledge of Jquery.
  • Framework experience would be beneficial.
  • Should be comfortable to work with the team.
  • Should be comfortable with work on any MVC based framework.

Skills required:

  • Able to understand project requirement and handle project independently.
  • Strong learning capability.
  • Contribute in all phases of the development.
  • Knowledge of PHP/CodeIgniter will be preferred.
  • Basic Knowledge of JavaScript, Web Services.
  • Sound knowledge of PHP, mysql, JQuery etc.
Read more
Wissen Technology
at Wissen Technology
4 recruiters
Seema Srivastava
Posted by Seema Srivastava
Mumbai, Bengaluru (Bangalore)
5 - 10 yrs
Best in industry
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Microservices
+4 more

Experience: 5+ Years


• Experience in Core Java, Spring Boot

• Experience in microservices and angular

• Extensive experience in developing enterprise-scale systems for global organization. Should possess good architectural knowledge and be aware of enterprise application design patterns.

• Should be able to analyze, design, develop and test complex, low-latency client-facing applications.

• Good development experience with RDBMS in SQL Server, Postgres, Oracle or DB2

• Good knowledge of multi-threading

• Basic working knowledge of Unix/Linux

• Excellent problem solving and coding skills in Java

• Strong interpersonal, communication and analytical skills.

• Should be able to express their design ideas and thoughts

Read more
LOGICAL Soft Tech
at LOGICAL Soft Tech
1 recruiter
Sumit Aryan
Posted by Sumit Aryan
2nd floor, 388,PU4, Scheme 54 PU4, Next to Krozzon hotel, Infront of Old Eye Retina Hospital, Vijay Nagar, Indore, M.P
1 - 3 yrs
₹1L - ₹2L / yr
skill iconSpring Boot
MySQL

Urgently Hiring Java backend developer on Spring Boot for our IT company Logical Soft Tech Pvt Ltd, Indore(M.P)


Experience : Minimum 6 months as Java Backend developer on Spring boot


Job location : Indore(M.P) *****Only walkins interview so only local Indore candidate need to apply or who can come directly come for interview***


Roles and Responsibilities :-


1) Expert as backend developer building logics, creating api, database, admin panel and rest api development.


2) Working on 3rd party api , google map api, sms gateway api, payment gateway api, firebase chat , notification


3) Done some live project on backend , self and quick learner, able to manage timeline, target oriented to complete the projects on time, ability to work in individual and in a team.


**********************************************

Then Please come for Interview with the updated CV if you are expertise in Java backend spring boot developer Monday to Saturday 11 Am to 6 P.M


Company Name : Logical Soft Tech pvt Ltd, Indore(M.P)


Contact : -+91-821.025.182.4(technical Department ) , +91-786.973.159.5(HR), +91-826.982.972.9(HR), +91-741.595.091.9(HR)


Address: - 2nd floor, 388,PU4, Scheme 54 PU4, Next to Krozzon hotel, Infront of Old Eye Retina Hospital, Vijay Nagar, Indore, M.P


**********Notes : - No fresher please , for fresher we dont have any job vacancy only internship program****

Read more
One of our premium client
One of our premium client
Agency job
via People First Consultants by Aishwarya KA
Chennai
1 - 4 yrs
₹2L - ₹5.5L / yr
skill iconJava
skill iconSpring Boot
Hibernate (Java)

Software Engineer for Java

  • Understanding of object-oriented programming and design patterns
  • Strong with Java programming and Java Servlets.
  • Proficient in API design and development using RESTful services (JSON, XML etc)
  • Source code management using GIT
  • Knowledge in Mongo DB and SQL or any equivalent No-SQL and Relational databases. 
  • Experience working with Bootstrap, JavaScript, jQuery & HTML would be preferred.
  • Experience in Node JS would be an added advantage. 
Read more
NAVI (Sachin Bansal's new venture)
Agency job
via zyoin by Shubha N
Remote, Bengaluru (Bangalore)
8 - 14 yrs
₹50L - ₹90L / yr
Engineering Management
engineering manager
Technical Architecture
Software architecture
technical architect
+5 more

Responsibilities :

  • Lead the development of the backend systems for our client's first product.
  • Build reliable, secure, and performant backend systems.
  • Drive test coverage and continuous delivery automation within the team.
  • Mentor and provide feedback to teammates.
  • You should have a min of 8 years of software development experience and management.
  • Can write code that is readable, maintainable, secure, and performant.
  • Know the importance of tests and how to approach writing different types of tests, good intuition for REST API design
  • Deep understanding of relational databases, transactions, entity-relationship modeling.
  • Comfortable writing highly concurrent systems.
  • Experienced in using profilers, tuning garbage collection, optimizing SQL queries.

Desired Skills :
  • Golang, Java, Python, Ruby, Node.
Read more
Whitesnow Software Consultancy Pune
Rohan Navale
Posted by Rohan Navale
Pune
3 - 9 yrs
₹4L - ₹8L / yr
skill iconPython
skill iconDjango
skill icon.NET
skill iconJava
skill iconAngularJS (1.x)
  • Hands-on experience in backend programming languages.
  • Experience in Python 3.X & Django is a must. Knowledge of .NET, Java, PHP is an added advantage.
  • Hands-on experience in front-end technologies like Angular, jQuery, JavaScript, HTML, CSS, SCSS, etc.
  • Experience with leading technical teams and acting as a technical mentor.
  • Experience in client communication & reporting to the client-side management team.
  • Experience in AWS is an added advantage.
Read more
Equal efforts
at Equal efforts
1 recruiter
Heena Rathod
Posted by Heena Rathod
Ahmedabad
0 - 2 yrs
₹1.8L - ₹2.4L / yr
skill iconJava
J2EE
Struts
Spring
Hibernate (Java)
+1 more

Responsibility of / Expectations from the Role:

  • Document all technical requirements and design technical solutions utilizing enterprise architecture standards including documenting all solution components and configurations
  • Contribute to all phases of the development lifecycle.
  • Write well-designed, testable, efficient code.
  • Ensure designs follow specifications.
  • Ability to work independently.
  • Persistent problem solver but know when to ask for help.
  • Open-minded, transparent and able to learn and adapt.
  • Good communication skills – both written and verbal.
  • Teamwork skills with a problem-solving attitude.
Read more
Slam8
at Slam8
1 recruiter
Pratik Khedikar
Posted by Pratik Khedikar
Bengaluru (Bangalore)
2 - 7 yrs
₹0L / yr
skill iconNodeJS (Node.js)
Microservices
skill iconAmazon Web Services (AWS)
NOSQL Databases
MEAN stack
+2 more
PROBLEM SOLVING: Main: People aren’t able to look back, in detail,at different personally cherishable moments in life;moments that contain the essence and emotions of the different experiences in life. This is linked to 2 sub-problems : 1)People don’t have many memories recorded in digital format because they never got a push to capture majority of such happenings 2)A Lot of efforts are required to look for the very few moments captured, in photos and videos because they are scattered randomly and buried deep down in laptop folders or drives. People, who want to look at various moments experienced in life,aren’t able to do so. WHY IS THIS GOOD TIME TO START SLAM8? People are feeling discontented and frustated with social media especially facebook as they waste a lot of time & are just about other people.Encouraging people to save their own life’s simple memories,thoughts & emotions in details can be a more engaging option.We need to focus on the moments that one will want to look back to.This way the output will make people happy.Also the shared content will be far more relatable and useful to people. This combination between social and personal will be a much better companion to people Such product is absent in the market We are looking for an experienced (atleast 2 years) back-end developer who has worked on following: 1)Node.Js 2)MongoDB , graphDB(Neo4j) 3)AWS 4)Java-spring ,apache struts2 5)Micro services architecture 6)caching using reddis or memcached 7)RESTful services He/she should have sufficient knowledge on 1)Micro services 2)API gateway 3)Database maintanance Note: we are looking for co-founders who can join and work along with the existing team of 7 members based on equity.None of us is expecting any salary atleast till next six month(app development period).You can keep your old job while working for this 6 months if you can contribute 36 hours a week on average
Read more
Ideas2IT Technologies
at Ideas2IT Technologies
13 recruiters
Bavani T
Posted by Bavani T
Chennai
2 - 7 yrs
₹6L - ₹18L / yr
MySQL
skill iconMongoDB
Spark
Apache Hive
Full Stack Developer for Big Data Practice. Will include everything from architecture to ETL to model building to visualization.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos