Cutshort logo
Technology service company logo
Sr. Spark Software Engineer
Technology service company
Sr. Spark Software Engineer
Technology service company's logo

Sr. Spark Software Engineer

at Technology service company

Agency job
5 - 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Ansible
skill iconGit
JIRA
Apache Spark
Spark
Apache Kafka
Microservices
skill iconKubernetes
Terraform
NOSQL Databases
API
skill iconDocker
  • Bachelor’s or master’s degree in Computer Engineering, Computer Science, Computer Applications, Mathematics, Statistics, or related technical field. Relevant experience of at least 3 years in lieu of above if from a different stream of education.

  • Well-versed in and 3+ hands-on demonstrable experience with: ▪ Stream & Batch Big Data Pipeline Processing using Apache Spark and/or Apache Flink.
    ▪ Distributed Cloud Native Computing including Server less Functions
    ▪ Relational, Object Store, Document, Graph, etc. Database Design & Implementation
    ▪ Micro services Architecture, API Modeling, Design, & Programming

  • 3+ years of hands-on development experience in Apache Spark using Scala and/or Java.

  • Ability to write executable code for Services using Spark RDD, Spark SQL, Structured Streaming, Spark MLLib, etc. with deep technical understanding of Spark Processing Framework.

  • In-depth knowledge of standard programming languages such as Scala and/or Java.

  • 3+ years of hands-on development experience in one or more libraries & frameworks such as Apache Kafka, Akka, Apache Storm, Apache Nifi, Zookeeper, Hadoop ecosystem (i.e., HDFS, YARN, MapReduce, Oozie & Hive), etc.; extra points if you can demonstrate your knowledge with working examples.

  • 3+ years of hands-on development experience in one or more Relational and NoSQL datastores such as PostgreSQL, Cassandra, HBase, MongoDB, DynamoDB, Elastic Search, Neo4J, etc.

  • Practical knowledge of distributed systems involving partitioning, bucketing, CAP theorem, replication, horizontal scaling, etc.

  • Passion for distilling large volumes of data, analyze performance, scalability, and capacity performance issues in Big Data Platforms.

  • Ability to clearly distinguish system and Spark Job performances and perform spark performance tuning and resource optimization.

  • Perform benchmarking/stress tests and document the best practices for different applications.

  • Proactively work with tenants on improving the overall performance and ensure the system is resilient, and scalable.

  • Good understanding of Virtualization & Containerization; must demonstrate experience in technologies such as Kubernetes, Istio, Docker, OpenShift, Anthos, Oracle VirtualBox, Vagrant, etc.

  • Well-versed with demonstrable working experience with API Management, API Gateway, Service Mesh, Identity & Access Management, Data Protection & Encryption.

    Hands-on experience with demonstrable working experience with DevOps tools and platforms viz., Jira, GIT, Jenkins, Code Quality & Security Plugins, Maven, Artifactory, Terraform, Ansible/Chef/Puppet, Spinnaker, etc.

  • Well-versed in AWS and/or Azure or and/or Google Cloud; must demonstrate experience in at least FIVE (5) services offered under AWS and/or Azure or and/or Google Cloud in any categories: Compute or Storage, Database, Networking & Content Delivery, Management & Governance, Analytics, Security, Identity, & Compliance (or) equivalent demonstrable Cloud Platform experience.

  • Good understanding of Storage, Networks and Storage Networking basics which will enable you to work in a Cloud environment.

  • Good understanding of Network, Data, and Application Security basics which will enable you to work in a Cloud as well as Business Applications / API services environment.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

NeoGenCode Technologies Pvt Ltd
Ritika Verma
Posted by Ritika Verma
Remote only
6 - 8 yrs
₹12L - ₹15L / yr
Perl
skill iconPython
SQL server
ADO
skill iconGit

Role: Perl Developer

Location: Remote

Experience: 6–8 years

Shift: General

Job Description

Primary Skills (Must Have):

  • Strong Perl development skills.
  • Good knowledge of Python and T-SQL / SQL Server to create compatible code.
  • Hands-on experience with ADO, Git, and release management practices.

Secondary Skills (Good to Have):

  • Familiarity with monitoring/alerting tools.
  • Exposure to automation tools.

Day-to-Day Responsibilities

  • Perform application code conversion for compatibility between Sybase and MS SQL.
  • Work on existing Perl-based codebase, ensuring maintainability and compatibility.
  • Convert code into Python where feasible (as part of the migration strategy).
  • Where Python conversion is not feasible, create compatible code in Perl.
  • Collaborate with the team on release management and version control (Git).


Read more
A global provider of Business Process Management.
A global provider of Business Process Management.
Agency job
via Jobdost by Sathish Kumar
Bengaluru (Bangalore)
3 - 7 yrs
₹12L - ₹20L / yr
skill iconC#
SQL
skill icon.NET
RabbitMQ
API
+5 more
Technical skills required
· Good understanding of OOPS, design principles and design patterns.
· C# development experience.
· Experience with WCF is required.
· Experience of working with web API is required.
· Experience with Windows services and Winforms will be useful.
· Experience of working with .NET Core is useful. Some exposure is expected.
· Experience of working with MS SQL Server.
· Experience of working with micro services will be useful.
· Experience of working with any queueing middleware like MSMQ, Rabbit MQ, WMQ will be useful.
· Exposure to cloud provisioning will be useful, in particular Azure.
· Exposure to security vulnerabilities and top 10 from OWASP will be useful.
· Exposure to front end technologies will be useful. Though it’s secondary but any experience with
SPA libs and frameworks in particular will be useful. Experience with either Angular or React will be
useful.
· Experience with any or all stated tools – TFS, Git, SOAP UI, Postman, Fiddler,
· Experience with CI/CD devOps tooling and practices is useful.
Soft skills required
· Good communication skills, both verbal and written. S/he should be able to articulate well.
Read more
Wekan Enterprise Solutions
at Wekan Enterprise Solutions
2 candid answers
ANANDREX A
Posted by ANANDREX A
Chennai, Bengaluru (Bangalore)
10 - 18 yrs
₹10L - ₹15L / yr
skill iconNodeJS (Node.js)
skill iconMongoDB
skill iconJava

Architect

Experience - 12+ yrs

About Wekan Enterprise Solutions

Wekan Enterprise Solutions is a leading Technology Consulting company and a strategic investment partner of MongoDB. We help companies drive innovation in the cloud by adopting modern technology solutions that help them achieve their performance and availability

requirements. With strong capabilities around Mobile, IOT and Cloud environments, we have an extensive track record helping Fortune 500 companies modernize their most critical legacy and on-premise applications, migrating them to the cloud and leveraging the most cutting-edge technologies.


Job Description

We are looking for passionate architects eager to be a part of our growth journey. The right candidate needs to be interested in working in high-paced and challenging environments leading technical teams, designing system architecture and reviewing peer code. Interested in

constantly upskilling, learning new technologies and expanding their domain knowledge to new industries. This candidate needs to be a team player and should be looking to help build a culture of excellence.


Do you have what it takes?

You will be working on complex data migrations, modernizing legacy applications and building new applications on the cloud for large enterprise and/or growth stage startups.


You will have the opportunity to contribute directly into mission critical projects directly interacting with business stakeholders, customer’s technical teams and MongoDB solutions Architects.


Location - Chennai or Bangalore

● Relevant experience of 12+ years building high-performance applications with at least

3+ years as an architect.

● Good problem solving skills

● Strong mentoring capabilities

● Good understanding of software development life cycle

● Strong experience in system design and architecture

● Strong focus on quality of work delivered

● Excellent verbal and written communication skills


Required Technical Skills

● Extensive hands-on experience building high-performance applications using Node.Js

(Javascript/Typescript) and .NET/ Golang / Java / Python.

● Strong experience with appropriate framework(s).

● Well versed in monolithic and microservices architecture.

● Hands-on experience with data modeling on MongoDB and any other Relational or NoSQL databases

● Experience working with 3rd party integrations ranging from authentication, cloud

services, etc.

● Hands-on experience with Kafka or RabbitMQ.

● Hands on experience with CI/CD pipelines and atleast 1 cloud provider - AWS / GCP / Azure

● Strong experience writing and maintaining clear documentation

Good to have skills:

● Experience working with frontend technologies - React.Js or Vue.Js or Angular.

● Extensive experience consulting with customers directly for defining architecture or system design.

● Technical certifications in AWS / Azure / GCP / MongoDB or other relevant technologies

Read more
Semperfi Solution
at Semperfi Solution
1 recruiter
Ambika Jituri
Posted by Ambika Jituri
Bengaluru (Bangalore)
0 - 1 yrs
₹3L - ₹6L / yr
skill iconGo Programming (Golang)
skill iconRuby on Rails (ROR)
skill iconRuby
skill iconPython
skill iconJava
+7 more

Job Description

Job Description SQL DBA - Trainee Analyst/Engineer

Experience : 0 to 1 Years

No.of Positions: 2

Job Location: Bangalore

Notice Period: Immediate / Max 15 Days

The candidate should have strong SQL knowledge, Here are few points

    • Implement and maintain the database design
    • Create database objects (tables, indexes, etc.)
    • Write database procedures, functions, and triggers

Good soft skills are a must (written and verbal communication)

Good team player

Ability to work in a 24x7 support model (rotation basis)

Strong fundamentals in Algorithms, OOPs and Data Structure

Should be flexible to support multiple IT platform

Analytical Thinking

 

Additional Information :

Functional Area: IT Software - DBA, Datawarehousing

Role Category: Admin/ Maintenance/ Security/ Datawarehousing

Role: DBA

 

Education :

B.Tech/ B.E

Skills

SQL DBA, IMPLEMENTATION, SQL, DBMS, DATA WAREHOUSING

Read more
 Saletancy Consulting Pvt Ltd
Remote only
6 - 10 yrs
₹6L - ₹16L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Microservices
+1 more

Responsibilities:

  • Experience and working knowledge of Java 8, Hibernate, Spring Boot, Microservices and REST API is mandatory
  • Expert understanding of the object-oriented design and programming concepts
  • Strong problem solving skills, data structures and algorithms and multithreading
  • Good understanding of AWS and cloud-native technologies
  • Knowledge of AWS services - RDS, DynamoDB, Elastic Search, Kinesis. Experience of working with AWS SDK is preferred.
  • Good understanding of CI/CD and Jenkins pipeline
  • Experience of writing unit tests using Junit/Mockito
  • Knowledge of Integration Testing framework like Cucumber is required.
  • Proficient in Git commands and branching concepts



Read more
MindHind
Vanish Jain
Posted by Vanish Jain
Remote only
3 - 7 yrs
₹10L - ₹15L / yr
skill iconVue.js
skill iconRuby on Rails (ROR)
skill iconRuby
skill iconHTML/CSS
skill iconjQuery
+3 more
Proven work experience as a Ruby on Rails developer
Proven work experience in software development
Demonstrable knowledge of front-end technologies such as JavaScript, HTML, CSS and JQuery
Experience developing highly interactive applications
A firm grasp of object oriented analysis and design
Passion for writing great, simple, clean, efficient code
Good knowledge of relational databases
Working knowledge of NoSQL databases
BS/MS degree in Computer Science, Engineering or in related field
Requirements
Write clean, maintainable and efficient code
Design robust, scalable and secure features
Contribute in all phases of the development lifecycle
Follow best practices (test-driven development, continuous integration, SCRUM, refactoring and code standards)
Drive continuous adoption and integration of relevant new technologies into design
Read more
Rapipay Fintech
Rapipay Fintech
Agency job
Noida
6 - 9 yrs
₹20L - ₹35L / yr
skill iconNodeJS (Node.js)
skill iconMongoDB
Mongoose
skill iconExpress
skill iconReact.js
+5 more
Expertise in designing back-end applications with Node.js
• Experience in design and development of Full Stack applications using one or
more JS frameworks like ReactJS
• Good architectural & design skills.
• Strong coding, data structures, and algorithms skills
• The ability to own end-to-end responsibility - right from the requirement to
release.
• The ability to produce bug-free and production-grade code.

Key Deliverables:
• Lead the team by example.
• Help design and code highly scalable and secure systems
• Work with a performance-oriented team driven by ownership and open to
experiments.
• Build stable and scalable applications that are unit and integration tested.
• Learn & Develop Leadership skills
• Understanding of CI/CD process and using Docker

TECHNICAL COMPETENCIES REQUIRED:
• Node.js, ReactJS. Experience building microservices (REST APIs) using
Node.js
• AWS experience integrating technologies like SQS, SNS, SES, Lambda, API
Gateway, Cognito
• Experience with one or more RDBMS databases like MySql, PostgreSQL
• Experience with one or more NoSQL databases like MongoDB, Cassandra,
DynamoDB, Aerospike, Elastic Search, Redis, neo4j, etc.
• Caching technologies like: Redis, Elastic cache,
• Cloud Providers like AWS/ Google Cloud / Azure
• CI / CD: Jenkins, Docker, Kubernetes
Read more
Stealth mode Ai. Domain startup of US.
Stealth mode Ai. Domain startup of US.
Agency job
via zyoin by RAKESH RANJAN
Remote, Bengaluru (Bangalore)
0 - 5 yrs
₹15L - ₹90L / yr
skill iconGo Programming (Golang)
skill iconNodeJS (Node.js)
skill iconJava
skill iconRuby on Rails (ROR)
skill iconPython
+2 more

Founder’s LinkedIn profile

Dheeraj Pandey

(Founder, Investor, & Then-CEO of Nutanix / One of the Indian origin guy out of 10 Board Member of- Adobe / Alumni- IIT, Kanpur & University of Texas, Austin)

https://www.linkedin.com/in/dpandey/">https://www.linkedin.com/in/dpandey/

 

&

Chandra Nath

(Vice President- Nutanix/ Vice President, Head of International- Ola (ANI Technologies Pvt Ltd) – Alumni- IIT, Kanpur, The University of Chicago Booth School of Business)

https://www.linkedin.com/in/chandranath/">https://www.linkedin.com/in/chandranath/

 

&

Manoj Agarwal

(Co-Founder at Stealth Startup, Previously SVP Engineering & GM Hybrid Cloud at Nutanix/ Alumni- IIT, Kanpur)

https://www.linkedin.com/in/devreveler/">https://www.linkedin.com/in/devreveler/


  • Headquarters: Austin, Texas, United States
  • Year founded: 2020.
  • Work Location: Bangalore
  • Team size: 35-40 (In US from companies like Google, Airbnb, Blizzard, Facebook, Palantir, Microsoft, CapitalOne, Nutanix and Confluent)
  • Funding: 50 M USD (raised the largest seed round in the history of Silicon Valley)

Note:

We already have a team of 30-35 people in San Jose, California, United States, now we are building a new team in india and they are hiring 0-5 years of rock stars from top notch colleges (Top 5 ranked IIT’s only & BITS) & companies only.

Note:

 

Basically, I did not have the exact JD with myself, but I can arrange an Exploratory call for you with above senior and core members of a company (Dheeraj/Chandra/Manoj).

Job Role – Backend developer.

If you think, you are one of them then please reply with your interest and we will take your candidature ahead for next level of evaluation. (No Bar of budget for strong candidate).

Looking forward to taking you to the next level of technology.

Warm Regards,

Rahul Rajput

Senior talent acquisition 

 

Read more
Applied Data Finance
at Applied Data Finance
1 recruiter
Abhilash Jeeva
Posted by Abhilash Jeeva
Remote, Chennai
2 - 6 yrs
₹4L - ₹12L / yr
skill iconJava
J2EE
Struts
Spring
Hibernate (Java)
+1 more

Qualification & Experience:

  • Bachelor of Engineering, preferably in Computer Science/or related fields or Masters, from a premier college
  • 2 to 6 years overall software development experience
  • Proven hands-on Software Development experience
  • Ability to work with an agile mindset
  • Having a polyglot mindset to think beyond one programming language/framework to choose the right tech stack for the right problem and exhibit learnability to pick up new technologies
  • Proven working experience in Java development/Python development with reasonable exposure to Python/Java respectively or willingness to learn Python/Java
  • Hands on experience in designing and developing applications using Java EE platforms/Python Frameworks
  • Object Oriented analysis and design using common design patterns
  • Good Understanding of Data Structures & Algorithms
  • Hands on multi-threading
  • Experience in the Relational Databases, SQL and ORM technologies (e.g. JDBC, JPA2, Hibernate, Django ORM)
  • Experience with test-driven development
Read more
Fintech Startup in India
Fintech Startup in India
Agency job
via Meyrahkee Advisors by Swati Khanna
Bengaluru (Bangalore)
3 - 7 yrs
₹30L - ₹50L / yr
skill iconGo Programming (Golang)
skill iconJava
skill iconPython
You will be a good technical fit at SETU if ● You have architected systems at scale and understand the nuances of building high throughput SaaS platforms. ● You have a strong working knowledge of the language, constructs, and paradigms of either Go— goroutines, dependency management, templating, routing, web frameworks, or Java— Core Java, multi-threading, Spring framework, ORM ● You are adept at entity modeling, query performance tuning, sharding, etc. using PostgreSQL / MySQL / NoSQL databases ● You have experience with Kubernetes / CI/CD / Terraform / Swagger. What you will do at SETU ● Write scalable, robust, automatable, efficient and maintainable code. ● Build frameworks and reusable components. ● Build REST APIs over the financial services infrastructure for developer consumption. ● Help design and architect a scalable, microservices-based platform. ● Solve complex business problems at scale to launch new products and services.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos