Cutshort logo
Technology service company logo
Sr. Spark Software Engineer
Technology service company
Sr. Spark Software Engineer
Technology service company's logo

Sr. Spark Software Engineer

at Technology service company

Agency job
5 - 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Ansible
skill iconGit
JIRA
Apache Spark
Spark
Apache Kafka
Microservices
skill iconKubernetes
Terraform
NOSQL Databases
API
skill iconDocker
  • Bachelor’s or master’s degree in Computer Engineering, Computer Science, Computer Applications, Mathematics, Statistics, or related technical field. Relevant experience of at least 3 years in lieu of above if from a different stream of education.

  • Well-versed in and 3+ hands-on demonstrable experience with: ▪ Stream & Batch Big Data Pipeline Processing using Apache Spark and/or Apache Flink.
    ▪ Distributed Cloud Native Computing including Server less Functions
    ▪ Relational, Object Store, Document, Graph, etc. Database Design & Implementation
    ▪ Micro services Architecture, API Modeling, Design, & Programming

  • 3+ years of hands-on development experience in Apache Spark using Scala and/or Java.

  • Ability to write executable code for Services using Spark RDD, Spark SQL, Structured Streaming, Spark MLLib, etc. with deep technical understanding of Spark Processing Framework.

  • In-depth knowledge of standard programming languages such as Scala and/or Java.

  • 3+ years of hands-on development experience in one or more libraries & frameworks such as Apache Kafka, Akka, Apache Storm, Apache Nifi, Zookeeper, Hadoop ecosystem (i.e., HDFS, YARN, MapReduce, Oozie & Hive), etc.; extra points if you can demonstrate your knowledge with working examples.

  • 3+ years of hands-on development experience in one or more Relational and NoSQL datastores such as PostgreSQL, Cassandra, HBase, MongoDB, DynamoDB, Elastic Search, Neo4J, etc.

  • Practical knowledge of distributed systems involving partitioning, bucketing, CAP theorem, replication, horizontal scaling, etc.

  • Passion for distilling large volumes of data, analyze performance, scalability, and capacity performance issues in Big Data Platforms.

  • Ability to clearly distinguish system and Spark Job performances and perform spark performance tuning and resource optimization.

  • Perform benchmarking/stress tests and document the best practices for different applications.

  • Proactively work with tenants on improving the overall performance and ensure the system is resilient, and scalable.

  • Good understanding of Virtualization & Containerization; must demonstrate experience in technologies such as Kubernetes, Istio, Docker, OpenShift, Anthos, Oracle VirtualBox, Vagrant, etc.

  • Well-versed with demonstrable working experience with API Management, API Gateway, Service Mesh, Identity & Access Management, Data Protection & Encryption.

    Hands-on experience with demonstrable working experience with DevOps tools and platforms viz., Jira, GIT, Jenkins, Code Quality & Security Plugins, Maven, Artifactory, Terraform, Ansible/Chef/Puppet, Spinnaker, etc.

  • Well-versed in AWS and/or Azure or and/or Google Cloud; must demonstrate experience in at least FIVE (5) services offered under AWS and/or Azure or and/or Google Cloud in any categories: Compute or Storage, Database, Networking & Content Delivery, Management & Governance, Analytics, Security, Identity, & Compliance (or) equivalent demonstrable Cloud Platform experience.

  • Good understanding of Storage, Networks and Storage Networking basics which will enable you to work in a Cloud environment.

  • Good understanding of Network, Data, and Application Security basics which will enable you to work in a Cloud as well as Business Applications / API services environment.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

With Reputed company
With Reputed company
Agency job
via Jobdost by Saida Jabbar
Bengaluru (Bangalore), Udupi
3 - 12 yrs
₹7L - ₹15L / yr
skill iconJava
J2EE
skill iconSpring Boot
Microservices
DevOps
+2 more
Senior Java Developer to manage the software development life cycle, from planning and prioritizing to testing and release. Responsibilities include gathering system and user requirements, building Java modules and testing features before release. Should have hands-on experience developing software with agile methodologies and are ready to lead our junior developers.
Responsibilities:
• Contribute to all phases of the development lifecycle
• Write well designed, testable, efficient code
• Prepare and produce releases of software components
• Support continuous improvement by investigating alternatives and technologies and presenting these for architectural review • Designing, implementing, and maintaining Java applications that are often high-volume and low-latency.
• Identify bottlenecks and bugs, and devise solutions to these problems

Skills: • Expert hands on knowledge of latest technology, good exposure to web technologies and open to all technologies like Java, J2EE, Spring boot , Microservices, Cloud computing, any DB • Very good exposure to DevOps concepts and tools, Continuous Integration and Continuous Delivery • Quick learner, believes in continuous learning and acts as a catalyst for building the culture within the organization • Analytical thinking skills, problems solving with strong exposure to root causing tools and techniques and ability to come up with solutions in complex situations.
• Solid understanding of object-oriented programming
• Familiar with various design and architectural patterns
• Skill for writing reusable Java libraries
• Experience with both external and embedded databases
• Understanding fundamental design principles behind a scalable application
• Proficient understanding of code versioning tools, such as Git
• Familiarity with build tools such as Ant, Maven, and Gradle • Deep insight of Java and JEE internals such as memory management, transaction management, etc. • Implementation of API. • Problem solving skills, analytical mind, and a positive attitude. • Experience with test-driven development. • Experience in the Spring, Spring Boot, and Hibernate • Knowledge of developing REST API. • Results oriented and focused on meeting deliverable timelines. • Good communication skills • Problem-solving attitude • Ability to establish priorities • Teamwork and willingness to listen to others • Eagerness to learn new ideas, concepts, and technologies. • Understand Java EE Architecture
• Clear understanding of web services and SOA related standards like REST/OAuth/JSON • Good knowledge of MicroServices. • Expertise developing enterprise-level web applications and RESTful APIs using MicroServices, with demonstrable production-scale experience. • Working experience in Industry Standard protocols related API Security • Strong background working with Linux/UNIX environments. • should have hands-on experience in developing software with agile or scrum methodologies and are ready to lead our junior developer's team.
Read more
Hyderabad based Service Company
Hyderabad based Service Company
Agency job
via Vmultiply solutions by Mounica Buddharaju
Remote, Hyderabad, Visakhapatnam
6 - 10 yrs
₹5L - ₹15L / yr
skill icon.NET
Microservices
RESTful APIs
.Net Core
MVC Framework

Backend .Net Developers

Vizag/Hyderabad/Remote

Contract / Fulltime

UK shift : 2- 11 PM IST

Exp Level: 6-10 years


Details:


.Net Core

C#

Experience in developing Microservices.

Experience deploying MicroServices in Docker containers

MVC or other design patterns

Container services in AWS/Azure

Experience with MS-SQL or Postgress

Knowledge on Message Queuing

EXCELLENT COMMUNICATION MUST

 

This role is a US Client facing, hence we need someone with excellent communication skills and also someone with prior US Client facing experience.

 

 

Interview Process:

Online Assessment

Call with our VP

End Customer Interview

 

Read more
Radisys India
at Radisys India
1 recruiter
Sagar bh
Posted by Sagar bh
Bengaluru (Bangalore)
5 - 10 yrs
₹20L - ₹35L / yr
skill iconJava
J2EE
skill iconSpring Boot
Microservices
Apache Kafka
+3 more

Radisys Corporation is looking for JAVA Backend developers with 6-10 years of experience for their Bangalore location.


The ideal candidate will be able to design and develop code for tasks after brainstorming sessions and applying best practices and coding conventions.


This position requires experience in Java, Spring, Spring Boot, microservices, message broker, and DB knowledge. Candidates should be skilled in developing enterprise applications that consist of FE, BE, and DB integration.


If you have experience with Docker and Kubernetes, that's an added advantage.

Read more
Extramarks
at Extramarks
4 recruiters
Prachi Sharma
Posted by Prachi Sharma
Noida, Delhi, Gurugram (Gurgaon), Ghaziabad, Faridabad
2 - 5 yrs
₹7L - ₹20L / yr
skill iconJava
skill iconSpring Boot
Struts
Spring
Hibernate (Java)
+3 more
- 2+ years of experience developing web application, Backend, API and big data-based applications/software

- Experience with one of the major relational databases (MySQL, Oracle, Postgres) and NoSQL databases (Mongo DB, Cassandra, Dynamo DB or such)

- Expert object-oriented programming experience using Java

- Experience with Frontend technologies (React.js, Angular, JavaScript or Ruby-on-Rails)

- Experience in messaging protocol like MQTT and messaging middleware like ActiveMQ, RabbitMQ and/or Kafka

- Require experience and Strong understanding of entire Software Development Life Cycle (SDLC), Agile (Scrum), Software design/architecture process, CI/CD processes, unit testing & Test-Driven Development (TDD)

- Experience with web services (consuming or creating) with REST, MQTT, Web Sockets

- Experience with containerized environment Dockers, Rocket and Container orchestrator such as Kubernetes, Docker Swam, etc

- Experience managing Cloud infrastructure (resources and service) in AWS, Azure and/or GCP

- Strong knowledge of SOA, object-oriented programming, design patterns, multi-threaded application development

- Experience in reporting and analytics, queuing and real-time streaming systems

- Experience developing, maintaining, and innovating large scale, consumer facing web or mobile applications

- Git or similar distributed SCM tools experience

- Experience with open-source technologies (if no practical work experience w/ Big Data, or cutting-edge frontend technology, prototyping and/or researching the up and coming technology and solutions)
Read more
It is global leader in driving profitable loyalty through p
It is global leader in driving profitable loyalty through p
Agency job
via Reed & Willow Talent Advisory Group by Carol Mascarenhas
Pune
4 - 7 yrs
₹1L - ₹22L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Spring MVC
+1 more
Please find the Role Description below :
Who are we looking for? 
A passionate developer who has a strong working knowledge of OOPS and functional programming principles. Standard Definitions and abbreviations don't entice us that much. 
Key skills:
 • Strong Java and J2EE background. 
• Strong working experience in Multi-Threading, Exception Management and Use of Collections. 
• Sound knowledge of working with application aspects i.e. Caching, Asynchronous APIs, Logging etc. 
• Experience with web application frameworks like Spring Boot or Dropwizard. 
• Unit Testing is an everyday affair and hence demands very good unit testing skills using tools like Junit & TestNG. 
• Understanding of relational databases, RESTful services, and build tools like Maven & Gradle 
• Knows what and when to mock and have used frameworks like Mockito/Power mock. 
• Understanding of message queue such as ActiveMQ, Kafka, RabbitMQ. 
• Version Control is treated as important as programming skills. Fluent with version control tools like Git and Bitbucket. 
• Exposure to Agile/Scrum, TDD not in theory but in practice. 
• Experience with Continuous Integration, Continuous Deployment, Static Code Analysis, Jenkins and SonarQube. 
• Willingness to take ownership of the technical solution and ensure technical expectations of deliverables are met. 
• Strong communication skills along with the ability to articulate technical designs and concepts. 
• Exposure to cloud and containerization would be a plus. 
• Hands-on experience in application development in an enterprise setup. 
• Have a good Understanding of Distributed Application Architecture. 
 
Developers at Tavisca: 
• Believe in writing clean and maintainable code. 
• Work with cutting edge technologies like Akka, Docker, Reactive Programming, Functional programming languages and NoSQL databases. 
• Are the key technical influence in software architecture decisions. 
• Are responsible for technical design and the entire lifecycle of product development. 
• Guide, mentor teams and others. 
• Are a part of an open office culture which fosters knowledge sharing sessions. 
• Work in a collaborative team environment; engage in discussions and team-wide communication such as daily Standups, tech rally, and pair programming refactoring, code review.
• Love participating as a speaker, contributing to open source projects, writing blogs or articles. What you will get? 
• Awesome opportunity to work with Micro Services architecture getting shipped on Cloud. 
• Experience in working with automated build deploy powered by Code Analysis, Automated Tests, Functional and Nonfunctional analysis, Blue Green deployment and much more.
• Agile, Lean product development, Collaborative Development, TDD, BDD, SOLID, CI/CD would not be mere words but the true experience for you. 
• First-hand experience on broader enterprise application concerns like Message Bus, Queues, Caches, Concurrency and Parallelization. • Be a part of our product development team. 
• Lead a team to develop our next generation products from the ground up. 
• Develop your skills in cloud computing, truly scalable applications, and travel domain. 
• Be a part of our strategy in the US and India market; bring large online travel business to life. 
• Stay on the leading edge of technology and excellence. 
• Be part of an environment of excellent people, products, technology, and innovation 
• Be part of a flat organization which is open and rich in culture. 
• Fall in love with travel, tea and football. Technical Lead 
· Knowledge of software best practices like Refactoring, Clean Code, Domain Driven Design, Encapsulation etc. 
· Fundamental understanding of Design Patterns and Design Principles and decision-making ability to use those appropriately. 
· Must have art to translate business requirement or product features into high level and low-level design. 
· Very good understanding of SOA Architecture and SOLID design principles is a given aspect. 
· Exposure and understanding of Micro Services is mandatory.
· Expert knowledge of Domain Modeling (UML) and the ability to communicate it to developers and throughout organization
· Knowledge of No-SQL solutions and technologies, data and computing grids, ‘cloud’ solution
Read more
IT company
IT company
Agency job
via Kalibre global konnects by Sophiya Sama
Ahmedabad
2 - 5 yrs
₹2L - ₹10L / yr
skill iconPHP
skill iconLaravel
MVC Framework
SQL
NOSQL Databases

Organisation is looking for a thoughtful, talented, and mission-driven frontend engineer to join our growing team, shape our product.

 

  • Job Title:- Backend Developer and Sr. Backend Developer
  • Location:- Motera, Ahmedabad
  • Industry : eCommerce
  • Type:- Product base Firm
  • Trusted by 5500+ Clients
  • Work Experience:- Should have at least 2 years of experience in working over custom apps apps
  • Education:- B.E/B.Tech (10+2)
  • Opening:- 02 (One position for strong knowledge for mentioned technology, one for medium)

 

Skills And Qualifications:-

 

  • Strong knowledge ofPHP web frameworks (Laravel).
  • Understanding the fully synchronous behavior of PHP
  • Understanding ofMVC design patterns
  • Basic understanding of front-end technologies, such as JavaScript, HTML5, and CSS3
  • Knowledge of object-oriented PHP programming
  • Understanding accessibility and security compliance
  • Strong knowledge of the common PHP or web server exploits and their solutions
  • Understanding fundamental design principles behind a scalable application
  • Familiarity with limitations of PHP as a platform and its workarounds
  • Familiarity with SQL/NoSQL databases and their declarative query languages
  • Proficient understanding of code versioning tools, such as Git
Read more
Freelancer
at Freelancer
4 recruiters
Nirmala Hk
Posted by Nirmala Hk
Bengaluru (Bangalore)
4 - 7 yrs
₹28L - ₹38L / yr
skill iconJavascript
skill iconPython
skill iconGo Programming (Golang)
TypeScript
API
+3 more
  • Strong programming skills in Javascript/TypeScript, Python or Go.
  • Hands-on experience in API development and frameworks such Express, Loopback, Hapi.
  • Good Understanding of SQL and NoSQL database.
  • Experience in test driven development. (writing unit test and API test).
  • Understanding of basic cloud computing concepts and experience in using any of the major cloud service providers(AWS/GCP/Azure).
  • Ability to build and deploy the application in a containerized environment.
  • Understanding of application logging and monitoring systems like Prometheus or Kibana.

Qualification: 

  • B.E/B.Tech/M.E./M.Tech/M.S. from a reputed university with a good academic record.
  • Curiosity to explore the cutting edge technologies and bake them in the products.
  • Zeal and drive to take end to end ownership.
Read more
US Based Product Startup in Bangalore.
US Based Product Startup in Bangalore.
Agency job
via Gracira Technologies LLP by Bachal Hanamantaraya
Bengaluru (Bangalore)
7 - 12 yrs
₹15L - ₹30L / yr
skill iconJava
Spring
Hibernate (Java)
skill iconSpring Boot
skill iconAmazon Web Services (AWS)
+3 more

Preferred Skills: 


We want to really emphasize Spring Boot (2+ years although 1+ if candidate particularly strong) Using Redis as a caching technology with Spring Boot would be a strong plus 

Using Redisson (a particular java client library that can be easily configured with Spring Boot) would be a strong plus 

Knowledge of event based messaging systems (Amazon SNS, Amazon MQ, or Kafka (in AWS) Data Cleaning tools and techniques in CSV and Excel 

Strong Knowledge of Spring Boot Dependency Injection and Configuration 

Experience with APIs for popular e-commerce platforms (Magento, Shopify, Big Commerce, etc.) 

SDLC (Software Development Lifecycle) Tools in the context of AWS. (Tools classified under DevOps) 

Experience with managing AWS EC2 VM instances and using AWS managed Services (like S3, MySQL, VPC/Networking, Lambda, etc

Performance Analysis Tools (Code Profiling) on Java VM and particularly Spring Boot 

Experience in the development of Workflow or Business Process Applications

Nice to Have: 


Experience with Cassandra or MongoDB with Spring Boot 

Horizontal Scaling with Spring Boot (considerations running multiple instances of Spring Boot instances) 

Experience with placing Spring Boot applications in Docker/Kubernetes container ecosystems (especially in AWS) 

Search technologies such as Lucene/Solr
Read more
Virtusa
Remote only
5 - 9 yrs
₹12L - ₹13L / yr
skill iconNodeJS (Node.js)
skill iconJavascript
skill iconMongoDB
TypeScript
skill iconJava
Experience – 5 - 9 Years
Basic Skills/Qualifications

• Master’s/Bachelor’s degree in Computer Science, Computer Engineering (BE/MCA/BCA)
• 5-9 years of strong software design and development experience and building and administering large-scale distributed applications
• Strong communication skills
• Agility and quick learner
• Understanding of the Software development lifecycle
• Good Analytical and problem-solving skills
• Self-motivated with the ability to prioritize, meet deadlines, and manage changing priorities
• Should have a high level of energy working as an individual Contributor and as a part of Team.
• Ability to think out of the box and questioning everything


Technical Skills (Hands On)

• Apply Server-side software development expertise, to design, develop and implement horizontally scalable components with the ability to handle large transaction and query volumes with following experience :

• Backend - NodeJS, Server-Side Events (SSE)
• Programming languages - Typescript, JavaScript
• API – REST, GraphQL
• Databases – MySQL, PostgreSQL
• Additional useful programming languages – Java, Scala
• CI/CD experience with:
• Git/TFS, Containers, Ansible
• Test Driven Development (TDD)
• Real-time or near real-time data pipelines
• BPMN 2.0 (Camunda)
• Knowledge of Design Thinking
• Experience working in short agile release cycles
• Enterprise grade development best-practices for end-to-end interoperability and integration
• Design with operational requirements, and support challenges in perspective
Read more
Pion Global Solutions LTD
Anudeep G
Posted by Anudeep G
Chennai
4 - 8 yrs
₹7L - ₹10L / yr
skill iconJava
Data Structures
Object Oriented Javascript (OOJS)
Jasmine (Javascript Testing Framework)
Experience in developing commercial software using Python, Java script, or Java. • Working knowledge of object-oriented programming and/or functional programming paradigms. • Good understanding of Algorithms and Data Structures. • Should have valid US B1 Visa, and be willing to travel in a weeks’ time to US • Expected to be in US for a week for the training
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos