Cutshort logo
Technology service company logo
Sr. Spark Software Engineer
Technology service company
Sr. Spark Software Engineer
Technology service company's logo

Sr. Spark Software Engineer

at Technology service company

Agency job
5 - 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Ansible
skill iconGit
JIRA
Apache Spark
Spark
Apache Kafka
Microservices
skill iconKubernetes
Terraform
NOSQL Databases
API
skill iconDocker
  • Bachelor’s or master’s degree in Computer Engineering, Computer Science, Computer Applications, Mathematics, Statistics, or related technical field. Relevant experience of at least 3 years in lieu of above if from a different stream of education.

  • Well-versed in and 3+ hands-on demonstrable experience with: ▪ Stream & Batch Big Data Pipeline Processing using Apache Spark and/or Apache Flink.
    ▪ Distributed Cloud Native Computing including Server less Functions
    ▪ Relational, Object Store, Document, Graph, etc. Database Design & Implementation
    ▪ Micro services Architecture, API Modeling, Design, & Programming

  • 3+ years of hands-on development experience in Apache Spark using Scala and/or Java.

  • Ability to write executable code for Services using Spark RDD, Spark SQL, Structured Streaming, Spark MLLib, etc. with deep technical understanding of Spark Processing Framework.

  • In-depth knowledge of standard programming languages such as Scala and/or Java.

  • 3+ years of hands-on development experience in one or more libraries & frameworks such as Apache Kafka, Akka, Apache Storm, Apache Nifi, Zookeeper, Hadoop ecosystem (i.e., HDFS, YARN, MapReduce, Oozie & Hive), etc.; extra points if you can demonstrate your knowledge with working examples.

  • 3+ years of hands-on development experience in one or more Relational and NoSQL datastores such as PostgreSQL, Cassandra, HBase, MongoDB, DynamoDB, Elastic Search, Neo4J, etc.

  • Practical knowledge of distributed systems involving partitioning, bucketing, CAP theorem, replication, horizontal scaling, etc.

  • Passion for distilling large volumes of data, analyze performance, scalability, and capacity performance issues in Big Data Platforms.

  • Ability to clearly distinguish system and Spark Job performances and perform spark performance tuning and resource optimization.

  • Perform benchmarking/stress tests and document the best practices for different applications.

  • Proactively work with tenants on improving the overall performance and ensure the system is resilient, and scalable.

  • Good understanding of Virtualization & Containerization; must demonstrate experience in technologies such as Kubernetes, Istio, Docker, OpenShift, Anthos, Oracle VirtualBox, Vagrant, etc.

  • Well-versed with demonstrable working experience with API Management, API Gateway, Service Mesh, Identity & Access Management, Data Protection & Encryption.

    Hands-on experience with demonstrable working experience with DevOps tools and platforms viz., Jira, GIT, Jenkins, Code Quality & Security Plugins, Maven, Artifactory, Terraform, Ansible/Chef/Puppet, Spinnaker, etc.

  • Well-versed in AWS and/or Azure or and/or Google Cloud; must demonstrate experience in at least FIVE (5) services offered under AWS and/or Azure or and/or Google Cloud in any categories: Compute or Storage, Database, Networking & Content Delivery, Management & Governance, Analytics, Security, Identity, & Compliance (or) equivalent demonstrable Cloud Platform experience.

  • Good understanding of Storage, Networks and Storage Networking basics which will enable you to work in a Cloud environment.

  • Good understanding of Network, Data, and Application Security basics which will enable you to work in a Cloud as well as Business Applications / API services environment.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

MAG Finserv Co Ltd
Pune
3 - 10 yrs
₹8L - ₹18L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Spring MVC
About Us:

For a decade and a half, MAG Finserv has assisted 1 lakh+ customers in overcoming their financial obstacles growing its loan book 60 times. Our partners include leading Banks like SBI, Federal Bank, City Union Bank among others. We are growing out of our home State Maharashtra and setting up a pan-India presence.
People are at the core of what we do. To meet the future growth targets, we are setting up a ninja technology team and offer a rewarding career with learning and growth. We offer a flexible hybrid model for maintaining a healthy work-life balance.

Responsibilities:
● Design, implementation, and deployment of successful LOS/LMS system features and services in support of our lending operations and the businesses they support
● Resolve bugs in the software features and deliver them on time with high quality
● Participate in the definition of secure, scalable, and low-latency services and efficient physical processes
● Work with cross-functional teams delivering on demanding projects
● Functionally decompose complex problems into simple, straight-forward solutions
● Understand system inter-dependencies and limitations

Requirements:
● Engineering degree in Computer Science/IT with a good academic performance throughout
● 5+ years of experience in developing applications end-to-end
● 1+ years of system design or architecture experience (architecture, design patterns, reliability and scaling) of new and current systems
● Expertise in Java, Spring Boot, Spring MVC, Angular and ruby on Rails tech stacks
● Functional understanding/experience of finance/lending domain is a plus
● Functional/Technical understanding of apache fineract/mifos is a plus

Location: Hybrid in Pune, Maharashtra
Read more
PeopleHum Technologies
VaraLakshmi Addepalli
Posted by VaraLakshmi Addepalli
Bengaluru (Bangalore)
4 - 7 yrs
Best in industry
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Microservices

Qualifications:


  • A Bachelor’s degree in Computer Science (or equivalent experience)
  • M-Tech or advanced degree a plus
  • Hackathon participation and accolades are a plus


Job Role:

  • 4+ years of object-oriented Java / J2EE development
  •  Full SDLC experience (requirements gathering, architecture, development, QA, etc)…
  •  Experience with Spring (MVC, IOP/DI, REST, Security) & Hibernate/Spring
  •  Experience with SOAP / REST web services
  •  Knowledge of SQL
  •  Knowledge of No SQL concepts, understanding of Solr, Redis and Mongo DB is desirable
  •  Must have worked on any one messaging solutions
  •  Bonus Points for micro service design and development experience
  •  Bonus points for any mobile development experience
  •  Used Agile methodology
  •  Bonus Points for experience working on Unix, shell scripting & Build Systems
  •  Experience in performance optimization is an added advantage
Read more
APPVENTUREZ MOBITECH PVTLTD
Noida, Delhi, Gurugram, Ghaziabad, Faridabad
4 - 12 yrs
₹4L - ₹12L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Nginx
+1 more

 

Minimum 2 years of experience in the software development, including Project Management and

 

interactions with customers

 

• Solid understanding of the full software development life cycle

 

• Working Experience of

 

a) Ubuntu 18.04.4 LTS

 

b) Java 1.8

 

c) Tomcat 9

 

d) Spring boot framework 2.2.2. RELEASE

 

e) Spring OAuth2 2.4.0. RELEASE

 

f) Spring Security JWT 1.1.0.RELEASE

 

g) Spring Log4j2

 

h) Hibernate 3.13.3

 

i) Nginx 1.14.0

 

j) Hikari Connection Pool

 

k) Mariaj Connector

 

l) Google Recaptcha

 

m) Redis client 3.3.0

 

Qualification

 

Read more
Hyderabad
5 - 6 yrs
₹12L - ₹18L / yr
skill iconJava
J2EE
skill iconSpring Boot
Microservices
skill iconAmazon Web Services (AWS)

Java Backend

Experience : 5+ years (Immediate Joiner)

Location: Hyderabad(Remote)

 

  • Core Java, SpringBoot, MicroServices
  • DB2 or any RDBMS database application development
  • Linux OS, shell scripting, Batch Processing
  • Troubleshooting Large Scale application
  • Experience in automation and unit test framework is a must
  • AWS Cloud experience desirable
  • Agile Development Experience
  • Complete Development Cycle ( Dev, QA, UAT, Staging)
  • Good Oral and Written Communication Skills
Read more
senrysa technologies (p) ltd
Sneha Chowdhury
Posted by Sneha Chowdhury
Remote only
3 - 9 yrs
₹10L - ₹15L / yr
skill iconRuby on Rails (ROR)
skill iconRuby
Microservices
AWS Lambda
skill iconDocker
+4 more

Job Description

We are looking for a ROR developer. If you're a creative problem solver who is eager to develop amazing products and hungry for a new adventure, a word class workplace is waiting for you.

  • Production experience in Ruby.
  • A completed technical degree in Computer Science or any related fields.
  • 3+ years of professional product development experience.
  • Being comfortable with microservices architectures, API-based
  • You are a pragmatic programmer who understands what is needed to get things done.
  • Problem solving and collaborative mindset.
  • Experience working with DevOps (Docker, Kubernetes, Terraform).
  • Experience with AWS (RDS, DDB, Lambda, CW, EC2, SQS, SNS, Cognito, Kinesis).
  • Experience with performance improvements (Caching Techniques, SQL Query Optimization, Performance monitoring and profiling.
  • Deep understanding of service-oriented and microservices architectural patterns, troubleshooting methods and best practices.
  • Takes end to end ownership of the development and operation of complete features.
Read more
India's top nothced Digital Payment Company
India's top nothced Digital Payment Company
Agency job
via Stepin Consulting LLP by Ashu Singh
Gurugram
3 - 9 yrs
₹10L - ₹25L / yr
skill iconJava
J2EE
Struts
Spring
Hibernate (Java)
+4 more
Immediate Joining Available

Location:-Gurgaon

Currently WFH

Exp with Product based organisation only

Exp Required:- 3 to 9 yrs

Responsibilities

- Work with a talented team to invent, design and build software that is stable and perform ant

- Primary role will be quality and timely delivery of the application/ feature/ module your team will be working on

- Adopt and execute good design philosophy and code writing practices

- Ensure the code goes through rigorous tests and quality checks before deployment.

- Work with other software engineers and database engineers to set excellent development practices and deliver innovative changes in new and existing products.

- Be hands-on technical, thus, leading by example using web, mobile and database technologies.

- Work on project ideas with customers, stakeholders and peers

- Be actively involved in code review process, design discussions, team planning

Basic Qualifications

- Bachelor's degree in Computer Science, Software Engineering, or a related technical discipline

- Experience in software design and development

- Proficiency with at least one Object Oriented language (e.g. Java)

- Computer Science fundamentals in object-oriented design, data structures, algorithm design, problem-solving, and complexity analysis

- A strong track record of project delivery for large, cross-functional projects

- Experience with building high-performance, highly available and scalable distributed systems

- Experience with API Design, ability to architect and implement an intuitive customer and third-party integration story

- Ability to think and analyse both breadthwise (client, server, DB, control flow) and depth-wise (threads, sessions, space-time complexity) while designing and implementing services
Read more
AIndra Systems
at AIndra Systems
2 recruiters
Evelyn Immanuel
Posted by Evelyn Immanuel
Bengaluru (Bangalore)
3 - 5 yrs
₹5L - ₹9L / yr
skill iconPython
skill iconJava
skill iconDjango
skill iconMongoDB
AIndra is building diagnostic tools for Cancer using Artificial Intelligence.
Read more
Affairal
at Affairal
1 video
1 recruiter
Govind Balakrishna
Posted by Govind Balakrishna
Bengaluru (Bangalore)
4 - 18 yrs
₹40L - ₹100L / yr
skill iconJava
skill iconPython
skill iconJavascript
skill iconAmazon Web Services (AWS)
Mobile App Development
+3 more
Hey Everyone, look forward to talk to you. We are a disruptive start up in fashion marketplace segment working on core personalization.Featured@tech crunch, websummit,voted top 100 start ups from the Asia region by Tech.co& Red herring. We are hiring! Team of Ex-flipkart,intel, myntra, intuit, ibm and others. We look forward to see you onboard in this amazing journey forward. Thanks & Regards Govind Founder/CEO @ Affairal +919972668335/+918904013330
Read more
RaiFox is a technology firm based out of  Bangalore.
RaiFox is a technology firm based out of Bangalore.
Agency job
via Gracira Technologies LLP by Sreeja Gummalla
HSR Layout, Bengaluru (Bangalore)
2 - 7 yrs
₹5L - ₹13L / yr
skill iconPython
skill iconDjango
skill iconHTML/CSS
skill iconGit
SVN
+2 more
Job Description We are looking for a Python Web Developer responsible for managing the interchange of data between the server and the users. Your primary focus will be the development of all server-side logic, ensuring high performance and responsiveness to requests from the front-end. You will also be responsible for integrating the front-end elements built by your co-workers into the application; therefore, a basic understanding of front-end technologies is necessary as well. Responsibilities Writing reusable, testable, and efficient code Design and implementation of low-latency, high-availability, and performant applications Integration of user-facing elements developed by front-end developers with server side logic Implementation of security and data protection Integration of data storage solutions (may include databases, key-value stores, blob stores, etc.) Skills And Qualifications Should be an Expert in Python and the Django Framework Knowledge of Any other Python Framework like Flask etc will be a bonus Familiarity with some ORM (Object Relational Mapper) libraries Able to integrate multiple data sources and databases into one system Understanding of the threading limitations of Python, and multi-process architecture Good understanding of server-side templating languages (such as Django Templating, Jinja 2, Mako, etc depending on your technology stack) Basic understanding of front-end technologies, such as JavaScript, HTML, and CSS Understanding of accessibility and security compliance Knowledge of user authentication and authorization between multiple systems, servers, and environments Understanding of fundamental design principles behind a scalable application Familiarity with event-driven programming in Python Understanding of the differences between multiple delivery platforms, such as mobile vs desktop, and optimizing output to match the specific platform Able to create database schemas that represent and support business processes Strong unit test and debugging skills Proficient understanding of code versioning tools (such as Git, Mercurial or SVN)
Read more
Logistimo
at Logistimo
1 recruiter
Gaurav Shetty
Posted by Gaurav Shetty
Bengaluru (Bangalore)
4 - 7 yrs
₹20L - ₹30L / yr
skill iconJava
skill iconScala
skill iconAngularJS (1.x)
Spring
MariaDB
+3 more
• 5-6 years of experience in building scalable web services and applications with service-oriented architecture. • Strong experience in Java/Scala programming language, writing performant, scalable and unit tested code. • Strong expertise in technologies / platforms: Springboot, JPA, No SQL (Cassandra) • Strong expertise in front end technologies - Angular JS. • Good object oriented design skills, and strong knowledge of design patterns. • Solid understanding of software deployment and infrastructure tuning on a cloud computing infrastructure (such as Amazon Web Services). • Strong experience with relational databases such as MariaDB/MySQL. • Proven commitment to quality and an ability to create maintainable and extensible code. • Strong in fundamentals of computer science and engineering. • Experience working with Agile software methodologies. • Experience in leading projects and mentoring people towards achieving high quality software. • Experience with Nginx, Tomcat, Redis, Cassandra,Zookeeper, ActiveMQ and Hadoop is a plus. • Bachelors or Masters in Computer Science engineering or related discipline.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos