Cutshort logo
Technology service company logo
Sr. Spark Software Engineer
Technology service company
Sr. Spark Software Engineer
Technology service company's logo

Sr. Spark Software Engineer

at Technology service company

Agency job
5 - 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Ansible
skill iconGit
JIRA
Apache Spark
Spark
Apache Kafka
Microservices
skill iconKubernetes
Terraform
NOSQL Databases
API
skill iconDocker
  • Bachelor’s or master’s degree in Computer Engineering, Computer Science, Computer Applications, Mathematics, Statistics, or related technical field. Relevant experience of at least 3 years in lieu of above if from a different stream of education.

  • Well-versed in and 3+ hands-on demonstrable experience with: ▪ Stream & Batch Big Data Pipeline Processing using Apache Spark and/or Apache Flink.
    ▪ Distributed Cloud Native Computing including Server less Functions
    ▪ Relational, Object Store, Document, Graph, etc. Database Design & Implementation
    ▪ Micro services Architecture, API Modeling, Design, & Programming

  • 3+ years of hands-on development experience in Apache Spark using Scala and/or Java.

  • Ability to write executable code for Services using Spark RDD, Spark SQL, Structured Streaming, Spark MLLib, etc. with deep technical understanding of Spark Processing Framework.

  • In-depth knowledge of standard programming languages such as Scala and/or Java.

  • 3+ years of hands-on development experience in one or more libraries & frameworks such as Apache Kafka, Akka, Apache Storm, Apache Nifi, Zookeeper, Hadoop ecosystem (i.e., HDFS, YARN, MapReduce, Oozie & Hive), etc.; extra points if you can demonstrate your knowledge with working examples.

  • 3+ years of hands-on development experience in one or more Relational and NoSQL datastores such as PostgreSQL, Cassandra, HBase, MongoDB, DynamoDB, Elastic Search, Neo4J, etc.

  • Practical knowledge of distributed systems involving partitioning, bucketing, CAP theorem, replication, horizontal scaling, etc.

  • Passion for distilling large volumes of data, analyze performance, scalability, and capacity performance issues in Big Data Platforms.

  • Ability to clearly distinguish system and Spark Job performances and perform spark performance tuning and resource optimization.

  • Perform benchmarking/stress tests and document the best practices for different applications.

  • Proactively work with tenants on improving the overall performance and ensure the system is resilient, and scalable.

  • Good understanding of Virtualization & Containerization; must demonstrate experience in technologies such as Kubernetes, Istio, Docker, OpenShift, Anthos, Oracle VirtualBox, Vagrant, etc.

  • Well-versed with demonstrable working experience with API Management, API Gateway, Service Mesh, Identity & Access Management, Data Protection & Encryption.

    Hands-on experience with demonstrable working experience with DevOps tools and platforms viz., Jira, GIT, Jenkins, Code Quality & Security Plugins, Maven, Artifactory, Terraform, Ansible/Chef/Puppet, Spinnaker, etc.

  • Well-versed in AWS and/or Azure or and/or Google Cloud; must demonstrate experience in at least FIVE (5) services offered under AWS and/or Azure or and/or Google Cloud in any categories: Compute or Storage, Database, Networking & Content Delivery, Management & Governance, Analytics, Security, Identity, & Compliance (or) equivalent demonstrable Cloud Platform experience.

  • Good understanding of Storage, Networks and Storage Networking basics which will enable you to work in a Cloud environment.

  • Good understanding of Network, Data, and Application Security basics which will enable you to work in a Cloud as well as Business Applications / API services environment.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

xoxoday
at xoxoday
2 recruiters
Agency job
via Jobdost by Sathish Kumar
Bengaluru (Bangalore)
4 - 7 yrs
₹25L - ₹30L / yr
skill icon.NET
ASP.NET
skill iconC#
MS SQLServer
MVC Framework
+11 more

What is the role?

Xoxoday is looking for a candidate who has a strong background in the design and implementation of scalable architecture and a good understanding of Algorithms, Data structures, and design patterns. Candidates must be ready to learn new tools, languages, and technologies

Basic Qualifications:

  • At least 4 -7 years of experience as a software developer.
  • At Least 3 years of experience in .net core C#, aws stack, ms sql server, mvc, nodejs experience is a plus
  • Strong working knowledge in distributed event-driven messaging architecture/platform
  • Strong knowledge in data access layer especially ability to work with stored procedure
  • Established and stimulated software development standards and processes along with best practices for delivery of scalable and high-quality software.
  • Production experience with AWS stack
  • Fluent English speaker

Preferred Qualifications:

  • Experience working with OOP languages.
  • Experience designing and developing Microservices and SOA.
  • Experience working with AWS Kinesis, Lambda, SQS, S3, ElastiCache, ElasticSearch, Kubernetes, EventBridge, RDS, CloudWatch, APIGateway
  • Experience designing and building high-performance scalable web services.
  • Experience in REST API design and implementation.
  • Experience in unit testing, test automation, and continuous delivery.
  • Experience with stream-processing and message-broker software.

Nice to have:

  • Experience working with distributed teams.
  • Ability to work independently and as part of a team.
  • Ability to work quickly toward tight deadlines, and make smart tradeoffs between speed, accuracy, and maintainability.
  • Bachelor's or Master's degree in computer science (or equivalent professional experience).

What can you look for?

A wholesome opportunity in a fast-paced environment that will enable you to juggle between concepts, yet maintain the quality of content, interact, and share your ideas and have loads of learning while at work. Work with a team of highly talented young professionals and enjoy the benefits of being at Xoxoday.

We are

Xoxoday is a rapidly growing fintech SaaS firm that propels business growth while focusing on human motivation. Backed by Giift and Apis Partners Growth Fund II, Xoxoday offers a suite of three products - Plum, Empuls, and Compass. Xoxoday works with more than 2000 clients across 10+ countries and over 2.5 million users. Headquartered in Bengaluru, Xoxoday is a 300+ strong team with four global offices in San Francisco, Dublin, Singapore, New Delhi.

Way forward

We look forward to connecting with you. As you may take time to review this opportunity, we will wait for a reasonable time of around 3-5 days before we screen the collected applications and start lining up job discussions with the hiring manager. We however assure you that we will attempt to maintain a reasonable time window for successfully closing this requirement. The candidates will be kept informed and updated on the feedback and application status.

Read more
Aakash Educational Services Limited
Agency job
via Talentify by Kundan Kumar
Noida
3 - 6 yrs
₹20L - ₹35L / yr
skill iconJava
06692
Spring

 

Job Title: Senior Software Engineer

Division/ Department: Technology

Reports to: Engineering Manager

Work Location: Noida

Desired Work Experience: 4+ years

Weekly Off: Saturday & Sunday

About Aakash Technology Innovation Lab

Are you passionate about transforming the field of education as we know it?

The way education is imparted has been disrupted massively due to forces such as ed-tech digital revolution, the advancement in artificial intelligence technology and the pandemic. Given the rapid pace of transformation, the vision of the Technology Innovation Lab at Aakash is to make the education of the future a reality. The Technology Innovation Lab aims to leverage state-of-the-art technologies to develop industry-defining bleeding-edge solutions for a student-first world-class hybrid learning experience. This involves -

  • Reimagining and conceptualizing how education will be imparted in the future in the omni-channel and immersive learning environment
  • Building data platforms such as Power BI dashboards to facilitate students, parents, teachers and the business 
  • Creating applications to support the futuristic tech-enabled smart classrooms
  • Conceptualizing and developing mobile and web applications for seamless customer experience
  • Developing Internet of Things (IoT) driven integrations into applications to build futuristic learning experience
  • Leveraging Artificial Intelligence (AI) and Machine Learning (ML) to identity interventions to boost student performance

If this excites you, we might have the perfect opportunity for you in the world’s most valued ed-tech company!

About Aakash - AESL

Aakash Educational Services Limited (AESL), commonly known as Aakash, is one of the most leading educational services institution providing comprehensive test preparatory services for students preparing for medical and engineering entrance examinations, school/board exams and competitive and scholarship exams such as NTSE, KVPY, and Olympiads. 

AESL also partnered with Blackstone, a global investment management firm. 

With more than 32 years of operational experience in the test preparatory coaching industry, the company has a pan India network of 220+ Aakash centres with an annual student base 2,50,000+ students and an employee count of more than 4700.

Purpose of the Role


Develop software solutions that enable the students, parents and teachers to have superior learning and teaching experiences, both inside and outside the classroom.

Key Responsibilities


  • Develop state-of-the-art high performance and low latency software applications for mission critical systems
  • Contribute in all the phases of the software development lifecycle
  • Craft a well-designed, testable, efficient code
  • Perform object-oriented analysis and design using common design patterns.
  • Effectively and seamlessly manage communication with all stakeholders.
  • Manage and provide live support to the developed applications

Qualification/ Experience


Must-Have Preferred

Education B.E / B.Tech Information Technology / Computer Science/ Information Science

  • Experience 4+ years of hands-on experience in designing and developing applications using Java EE, Spring, Spring MVC, Spring Boot Frameworks
  • Experience with test-driven development
  • Experience with relational databases (MySql, Oracle, Postgres) or NoSql Databases (Cassandra, MongoDb, CouchDb) .
  • Agile programming (Sprint, Scrum) experience
  • Skills Understands version control branching strategies
  • Understands different major language paradigms (object oriented /functional /reactive)
  • Understanding and some experience in programming with AWS SDK
  • Knowledge of Kafka and Redis


Competencies


Behavioral Competencies Level Functional Competencies Level

1 Team Player Written and Verbal Communication

2


What We Offer

As a technology professional in Aakash Technology Innovation Lab we offer you an opportunity to - 

  • Become a pioneer of the education of the future by reimagining and building innovative solutions for the ed-tech industry leading hybrid learning experience
  • Be a force of technological disruption as a part of a passionate and high growth team on an exciting endeavor to transform the education industry
  • Belong to an upbeat, flexible and relaxed work culture with a specific focus on collaboration
  • Craft an excellent career at Aakash through a broad realm of career tracks and opportunities
  • Excel in your chosen stream and become a renowned technologist in the ed-tech industry with heavy investment from the business into your learning, exposure and growth
  • Have a highly competitive compensation and benefits package 
Read more
Wissen Technology
at Wissen Technology
4 recruiters
Sukanya Mohan
Posted by Sukanya Mohan
Bengaluru (Bangalore), Mumbai
4 - 8 yrs
Best in industry
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)

Primary Responsibilities:

Developer for IT Regulatory team, work with the development manager and key stakeholders to understand business requirements and develop moderately complex technical solutions.

Work collaboratively with the team to support existing functionality and build, implement, and support new solutions.

Draft and review technical diagrams, specifications documents and required project documentation.

Conduct code reviews of other developers.

Share experience and knowledge with the team to improve productivity & delivery timelines.

Continuously seek ways to improve our existing architecture, advises on complex code deficiencies, provides systemic proposals, and promote efficiencies where necessary.

 

Job Requirements:

Undergraduate degree in computer science or technology discipline

5+ years of Core Java Development experience & Integration Technologies (Spring, MQ, JSON, XML, SOAP).

Experience writing SQL queries (DB2, Snowflake).

Crystal reports/Excel Writer/Aspose.

Working knowledge of scripting languages (Perl, Unix Shell, Python).

Experience working with source code repositories (Bitbucket, GitHub)

JavaScript, Angular is a plus.

Sound understanding of Object-Oriented Design & Programming, Enterprise Architecture Patterns and GoF design.

A flexible, tenacious team player with a positive attitude and strong interpersonal skills, able to build collaborative relationships with globally distributed teams.

Strong analytical and design skills with attention to detail.

Excellent communication (verbal and written) skills; Able to communicate with different stakeholders effectively.

Experience developing technical solutions in Investment Management industry.

Understanding of portfolio accounting concepts and trade lifecycle

Read more
ProGrad
at ProGrad
3 recruiters
Heruba C
Posted by Heruba C
Hyderabad
4 - 4 yrs
₹10L - ₹15L / yr
skill iconPython
skill iconDjango
skill iconFlask
SQL
PL/SQL
+2 more

Job Description

  1. 5- 8 yrs IT industry experience preferably Banking domain
  2. Strong Python Skills and good understanding of Java and Microservices
  3. Should have handled banking customers and exposure to Production support processes
  4. Good in database and Pl/SQL – Ability to write SQL as and when needed  
  5. Good attitude and communication
  6. WFH not allowed – Working from Bank premises as per bank calendar in Saifabad or Hitech City – Saifabad Flexibility must



Read more
A top MNC in Pune.
A top MNC in Pune.
Agency job
via Jobdost by Riya Roy
Remote, Pune
3 - 8 yrs
₹7L - ₹15L / yr
skill iconPython
skill iconDjango
skill iconJavascript
skill iconFlask
NOSQL Databases
+4 more

The key aspects of this role include:


• Design, build, and maintain scalable applications using Python.
• Contribute to the entire implementation process including driving the definition of improvements
based on business need and architectural improvements.
• Act as a subject matter expert for Application Software developers and Engineers.
• Handle server-side code for a production platform and contribute to new features.


To be the right fit, you'll need:
• More than 4+ years of experience as a software developer in Python, with knowledge of at least one
Python web framework such as Django, Flask, etc.
• Good understanding of common design patterns and architecture principles to design reliable and
Scalable applications
• Strong communication skills
• Knowledge of databases line NoSQL or MongoDB
• Good to have AWS and Docker or Web services
• Basic understanding of front-end technologies, such as JavaScript, HTML5, and CSS3

Read more
ITS
at ITS
1 recruiter
Shruti Pandit
Posted by Shruti Pandit
Mumbai
3 - 7 yrs
₹10L - ₹15L / yr
skill icon.NET
skill iconC#
skill iconJavascript
skill iconNodeJS (Node.js)
NOSQL Databases
+2 more

Requisite Skills and Experience                                                                                                          

  • 5+ years of object-oriented software development of web applications
  • 5+ years of C# in a .NET environment
  • Preferable Experience in Cloud Technologies (AWS, AZURE)
  • Experience with MS SQL stored procedures, database design and optimization
  • Experience developing and utilizing web services
  • Experience with high volume consumer oriented web sites
  • Experience working in an Agile Scrum environment
  • Experience with formal test procedures, release management
  • Preferable Travel industry experience preferred, especially programming associated with GDS’s - SABRE, Farelogix, and Travelport
  • Ability to distill complex business needs into functional requirements
  • Excellent follow-up, verbal and written communication skills
  • Excellent problem solving skills and an ability to make good decisions
  • Team player with a professional attitude
  • Ability to manage multiple tasks and maintain tight schedules
  • Ability to work effectively with a geographically dispersed team in India

 

Strategic and Development Responsibilities

  • Ability to "think outside the box"
  • Ability to provide accurate and timely project estimates.

 

 

Pluses:

  • Experience with Angular JS frameworks and Mobile Development.
  • Experience with developing machine learning algorithms.
  • Experience on projects that required localization/globalization
  • Experience with MS SQL Reporting Services
  • Knowledge of web farm configuration and best practices

 

Software Tools/Languages

Required:        MS Visual Studio, MS SQL Server Management Studio, IIS, AWS

C#, Web Services, MS SQL (stored procedures), Jenkins, DevOps Tools.

 

Education

Bachelor of Science in CS, MIS, or equivalent
Read more
Deskfactors INC
at Deskfactors INC
1 recruiter
Bharathi N
Posted by Bharathi N
Koramangala, Bengaluru (Bangalore)
2 - 4 yrs
₹5L - ₹14L / yr
skill iconNodeJS (Node.js)
skill iconHTML/CSS
skill iconJavascript
Fullstack Developer
TypeScript
+1 more
Full Stack Developer:2-4 years backend server side micro services based applications development experience with the following skill set:

1. Rest Services using NodeJS & Express
2. Micro services based application development using Kubernetes, Dockers, WAF
4. Languages : Javascript is mandatory. Preferred if you are also hands-on with Typescript, Java.
5. Database : Working experience in one of these document databases- Dynamodb, Cosmos db, MangoDB. Preferred if you also have working experience in any of these RDBMS - MySQL,  Postgres, SQL Server
6. Storage :  Working experience in any one of these storage technologies - S3, Blob or any cloud storages
7. DevOps : JIRA, Jenkins, ELK, CI/CD, Git, AWS or Azure cloud compute
 
Read more
DROR LABS
at DROR LABS
2 recruiters
Manisha Kumari
Posted by Manisha Kumari
Gurgaon
1 - 2 yrs
₹3L - ₹3L / yr
skill iconJavascript
skill iconReact Native
skill iconHTML/CSS
API
skill iconiOS App Development
+1 more

We are looking for a React Native developer interested in building mobile apps on both the iOS and Android platforms. You will be responsible for architecting and building these applications, as well as coordinating with the teams responsible for other layers of the product infrastructure. Building a product is a highly collaborative effort, and as such, a strong team player with a commitment to perfection is required.

Responsibilities

  • Leverage native APIs for deep integrations with both iOS and Android platforms.
  • Diagnose and fix bugs and performance bottlenecks for performance that feels native.
  • Maintain code and write automated tests to ensure the product is of the highest quality.
  • Transition existing iOS and Android apps to React Native.
Read more
DutchView IT
at DutchView IT
1 recruiter
Simran Sandhu
Posted by Simran Sandhu
Bengaluru (Bangalore)
3 - 6 yrs
₹4L - ₹12L / yr
skill iconJava
Spring
skill iconKotlin
Hibernate (Java)
Microservices
+3 more

Title

Senior Java Backend Developer

 

Introduction

Are you a passionate backend developer looking for a new challenge in an international company? Do terms like spring-boot, Redis, Amazon EC2, REST-API and document based databases like MongoDB make you smile and would you like to work in an international company that values your personal growth? We are expanding in India and are looking for an enthusiastic and experienced Java Developer to join the team.

 

Your new job

Together with the team, you will be responsible for the development and migration of our FlexWhere application from a PHP based application to a java application. You report to the Manager Development & Support and collaborate with our Dutch IT Team, who work from our headquarters in the Netherlands. We work with two-week sprints, in which features and improvements are tested in an alpha and beta environment, after which you will release the services in our Kubernetes cluster. Our applications are being used by thousands of customers in Europe on a daily basis. By being in close contact with our helpdesk, you know what our users struggle with and how you can improve their experience.

 

You are not afraid to take ownership and have good interpersonal skills. You believe a good user experience is the ultimate goal and you continuously discover, evaluate and implement new technologies to maximize development efficiency. All in all: you have an innovative spirit and cannot wait to get aboard into an international IT-organization!

 

What you’ll bring

  • A degree in Engineering (B.Tech or BE);
  • Minimum of 3-year work experience as a Java developer in Java and/or Kotlin, Groovy;
  • Proficient understanding of code versioning tools (Git);
  • Experience with third-party API’s and third-party libraries like MongoDB, Redis, MySQL, ElasticSearch;
  • Familiar with automation testing tools;
  • Knowledge about scaling architectures in the cloud like EC2.

 

What you’ll get

  • Competitive salary;
  • Place within a company that is committed to diversity and inclusion;
  • Excellent career progression opportunity within an international organization;
  • The chance to discover the land of tulips and windmills!

 

Where you’ll work

We are Dutchview. An innovative IT company based in the Netherlands with offices in Germany, the United Kingdom and India. Our solutions make it possible for organisations to work smartly and effectively. So that they can focus all their energy on what they do best. It is precisely this freedom that leads to greater job satisfaction: the basis for better results. We make it easy for you.

Read more
BlazeClan Technologies Pvt Ltd
Gurmeet Singh
Posted by Gurmeet Singh
Pune, Mumbai
3 - 7 yrs
₹4L - ₹12L / yr
skill iconJavascript
skill iconPython
skill iconRuby on Rails (ROR)
skill iconNodeJS (Node.js)
LAMP Stack
+3 more
Description • Must have development background and should have hands-on experience in Java, or Node.Js or Ruby or Python, angular.js as an application developer. • Must have experience with Continuous integration and deployment tools eg. Jenkins, Ansible, Github, Subversion, Nexus etc. • Good to have strong understanding & working experience on either of the Public Cloud like AWS, Azure or GCP. • Experience on AWS services like EC2, S3, VPC, IAM, Lambda, ECS, RDS, DynamoDB • Good hands on experience in setting up enterprise cloud security, networking configurations • Must have excellent understanding of typical multi-tier application architectures: web servers (Apache, nginx, IIS), caching, application servers, load balancing. • Knowledge of RESTful Web Services, XML, JSON. Documenting of Webservices using Swagger. • Must have worked on micro-services applications, containerization of applications. • Must be aware of version control of code, code coverage, automated code testing. • Exposure to log management and log analysis tools like Splunk. Roles and Responsibilities: • Helping with application migration to Public clouds like AWS, Azure or GCP. • The candidate will have to present AWS Cloud services offerings and solutions to clients • Application optimization on Cloud. • Containerize/ Dockeriseexisting applications & migration to Public Cloud. • Must be able to identify & implementapplication deployment automation; define continuous integration process as per best practices.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos