Cutshort logo
Technology service company logo
Sr. Spark Software Engineer
Technology service company
Sr. Spark Software Engineer
Jobdost's logo

Sr. Spark Software Engineer

at Technology service company

Agency job
5 - 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Ansible
skill iconGit
JIRA
Apache Spark
Spark
Apache Kafka
Microservices
skill iconKubernetes
Terraform
NOSQL Databases
API
skill iconDocker
  • Bachelor’s or master’s degree in Computer Engineering, Computer Science, Computer Applications, Mathematics, Statistics, or related technical field. Relevant experience of at least 3 years in lieu of above if from a different stream of education.

  • Well-versed in and 3+ hands-on demonstrable experience with: ▪ Stream & Batch Big Data Pipeline Processing using Apache Spark and/or Apache Flink.
    ▪ Distributed Cloud Native Computing including Server less Functions
    ▪ Relational, Object Store, Document, Graph, etc. Database Design & Implementation
    ▪ Micro services Architecture, API Modeling, Design, & Programming

  • 3+ years of hands-on development experience in Apache Spark using Scala and/or Java.

  • Ability to write executable code for Services using Spark RDD, Spark SQL, Structured Streaming, Spark MLLib, etc. with deep technical understanding of Spark Processing Framework.

  • In-depth knowledge of standard programming languages such as Scala and/or Java.

  • 3+ years of hands-on development experience in one or more libraries & frameworks such as Apache Kafka, Akka, Apache Storm, Apache Nifi, Zookeeper, Hadoop ecosystem (i.e., HDFS, YARN, MapReduce, Oozie & Hive), etc.; extra points if you can demonstrate your knowledge with working examples.

  • 3+ years of hands-on development experience in one or more Relational and NoSQL datastores such as PostgreSQL, Cassandra, HBase, MongoDB, DynamoDB, Elastic Search, Neo4J, etc.

  • Practical knowledge of distributed systems involving partitioning, bucketing, CAP theorem, replication, horizontal scaling, etc.

  • Passion for distilling large volumes of data, analyze performance, scalability, and capacity performance issues in Big Data Platforms.

  • Ability to clearly distinguish system and Spark Job performances and perform spark performance tuning and resource optimization.

  • Perform benchmarking/stress tests and document the best practices for different applications.

  • Proactively work with tenants on improving the overall performance and ensure the system is resilient, and scalable.

  • Good understanding of Virtualization & Containerization; must demonstrate experience in technologies such as Kubernetes, Istio, Docker, OpenShift, Anthos, Oracle VirtualBox, Vagrant, etc.

  • Well-versed with demonstrable working experience with API Management, API Gateway, Service Mesh, Identity & Access Management, Data Protection & Encryption.

    Hands-on experience with demonstrable working experience with DevOps tools and platforms viz., Jira, GIT, Jenkins, Code Quality & Security Plugins, Maven, Artifactory, Terraform, Ansible/Chef/Puppet, Spinnaker, etc.

  • Well-versed in AWS and/or Azure or and/or Google Cloud; must demonstrate experience in at least FIVE (5) services offered under AWS and/or Azure or and/or Google Cloud in any categories: Compute or Storage, Database, Networking & Content Delivery, Management & Governance, Analytics, Security, Identity, & Compliance (or) equivalent demonstrable Cloud Platform experience.

  • Good understanding of Storage, Networks and Storage Networking basics which will enable you to work in a Cloud environment.

  • Good understanding of Network, Data, and Application Security basics which will enable you to work in a Cloud as well as Business Applications / API services environment.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

NeoGenCode Technologies Pvt Ltd
Bengaluru (Bangalore)
5 - 12 yrs
₹15L - ₹35L / yr
skill iconNodeJS (Node.js)
Relational Database (RDBMS)
SQL
Data modeling
RESTful APIs
+4 more

Job Title : Senior Software Engineer – Backend

Experience Required : 6 to 12 Years

Location : Bengaluru (Hybrid – 3 Days Work From Office)

Number of Openings : 2

Work Hours : 11:00 AM – 8:00 PM IST

Notice Period : 30 Days Preferred

Work Location : SmartWorks The Cube, Karle Town SEZ, Building No. 5, Nagavara, Bangalore – 560045

Note : Face-to-face interview in Bangalore is mandatory during the second round.


Role Overview :

We are looking for an experienced Senior Backend Developer to join our growing team. This is a hands-on role focused on building cloud-based, scalable applications in the mortgage finance domain.


Key Responsibilities :

  • Design, develop, and maintain backend components for cloud-based web applications.
  • Contribute to architectural decisions involving microservices and distributed systems.
  • Work extensively with Node.js and RESTful APIs.
  • Implement scalable solutions using AWS services (e.g., Lambda, SQS, SNS, RDS).
  • Utilize both relational and NoSQL databases effectively.
  • Collaborate with cross-functional teams to deliver robust and maintainable code.
  • Participate in agile development practices and deliver rapid iterations based on feedback.
  • Take ownership of system performance, scalability, and reliability.

Core Requirements :

  • 5+ Years of total experience in backend development.
  • Minimum 3 Years of experience in building scalable microservices or delivering large-scale products.
  • Strong expertise in Node.js and REST APIs.
  • Solid experience with RDBMS, SQL, and data modeling.
  • Good understanding of distributed systems, scalability, and availability.
  • Familiarity with AWS infrastructure and services.
  • Development experience in Python and/or Java is a plus.

Preferred Skills :

  • Experience with frontend frameworks like React.js or AngularJS.
  • Working knowledge of Docker and containerized applications.

Interview Process :

  1. Round 1 : Online technical assessment (1 hour)
  2. Round 2 : Virtual technical interview
  3. Round 3 : In-person interview at the Bangalore office (2 hours – mandatory)
Read more
online group buying platform that helps people connect with
online group buying platform that helps people connect with
Agency job
via Qrata by Rayal Rajan
Remote only
3 - 6 yrs
₹15L - ₹30L / yr
skill iconPython
skill iconJava
skill iconFlask
skill iconNodeJS (Node.js)
skill iconDjango

Online group buying platform that helps people connect with likeminded people who want to buy the same item/product at a discounted price.

Job Duties and Responsibilities

 

  • Overlook development of all consumer products in JAVA and
  • Optimize components for maximum performance across a vast array of web-capable devices and
  • Focus on code maintainability and performance of
  • Provide technical advice and assists in solving programming
  • Continuously create new and interactive features that would help to improve user experience and user engagement.
  • Assist with troubleshooting of issues as
  • Lead the design and architecture of software
  • Assist in developing and maintaining continuous integration.

Skills Required:

 

  • Skills required: JAVA, Python (Flask and Django), Spring/Spring Boot, React, Hibernate,
  • 2+ years of experience in Java and Python
  • Linux, REST, Kafka, Mysql,, AWS, ELK Stack (Elasticsearch), CI/CD
  • Good experience in Java and/or Python based
  • Experience in designing databases and system
  • Experience in building products from scratch at well-funded start-ups

 


 

Read more
Xemplar
Xemplar
Agency job
via Fruges IT services by Nishanthi Y
Hyderabad
10 - 15 yrs
₹10L - ₹15L / yr
skill iconGo Programming (Golang)
skill iconRuby on Rails (ROR)
skill iconRuby
skill iconPython
skill iconJava
+7 more

Job Responsibilities

✓ Perform the role of Technical Lead on assigned projects to drive solution design (especially backend) and API services development.

✓ Be the thought leader and champion for above mentioned technologies.

✓ Drive technical analysis for new projects including planning and driving proof-of-concepts, if needed.

✓ Drive tasks related to backend development by providing architectural and technical leadership to mid-tier and database developers.

✓ Conduct peer reviews as the lead into Git to confirmed that developed code meets acceptable standards and guidelines.

✓ Work closely with the rest of the leads, mid-tier development, front-end developers, database developers, etc. to ensure end-to-end integrity of the solution being developed.

✓ Work closely with the rest of the tech leads and senior engineering leadership team to ensure reuse where applicable to increase productivity and throughput.

✓ Conduct technical interview to staff open positions in the backend team.

✓ Delegate work and assignments to team members

✓ Collaborate with their team to identify and fix technical problems

✓ Analyze users' needs and then finding applications to serve them

✓ Drive assigned tasks related to SOC 2 certification and ensure compliance to defined controls for areas under lead’s purview.

✓ Guiding their team through technical issues and challenges

✓ Prepare Technical design documents which would help the team to understand the technical flow

✓ Active participation in customer calls especially discussions related to Technical/Architectural and provide inputs.

 

Required Experience: 

✓ Backend Lead around 14 years of experience

✓ Server less Computing Architecture

✓ NodeJS, MySQL, Jenkins, Python, GitLab Technologies

✓ Good knowledge of AWS Cloud

✓ Full cycle AWS implementation experience

✓ Project experience in development and maintenance support for AWS web service and Cloudbased implementations

✓ Experience leading teams of up to 10 + professionals

Ability to manage multiple tasks and projects in a fast-moving environment 

 

Educational Qualifications: 

Engineering graduate or B. Tech/MCA with relevant major subjects like Computer Science

Read more
Fintech leader on global transaction in banking
Fintech leader on global transaction in banking
Agency job
via The Hub by Sridevi Viswanathan
Kolkata, Mumbai, Pune, Hyderabad, Chennai, Nagpur, Aurangabad, Bhubaneswar, Indore, Visakhapatnam, Warangal, Coimbatore, Madurai, Lucknow, Gurugram
2 - 8 yrs
₹3L - ₹15L / yr
skill iconJava
skill iconSpring Boot
Microservices
JSP
RESTful APIs
+6 more

Who we are looking for

A candidate who can design, build and configure applications to meet business process and application requirements.

Key Role Requirements:

  • Experience in Java-J2EE Development
  • Hands-on experience in Struts (Core Java, JSP, Servlets, EJB) framework.
  • Hands-on experience in Oracle SQL, Procedures
  • Hands-on experience in Spring boot, Spring batch
  • Should have worked on application servers like IBM WAS / Jboss / Web logic.
  • Knowledge of basic Linux commands and BIRT reporting tool is an added advantage.
  • Knowledge in SVN or any other version control is an added advantage.
  • Knowledge in Build tool like ANT, Maven is an added advantage
  • Strong problem solving and analytical capabilities.
Read more
Hiring for a Leading InsureTech Platform in Mumbai/Pune
Hiring for a Leading InsureTech Platform in Mumbai/Pune
Agency job
via XL Recruiters by Ishani Bahukhandi
Mumbai, Pune
4 - 7 yrs
₹19L - ₹20L / yr
skill iconJava
skill iconSpring Boot
RESTful APIs
Experience designing, developing, delivering, and scaling modern web applications
- Strong experience with one or more general purpose programming languages including but
not limited to: Python, Java, C/C++, C#
- Demonstrated expertise working with at least one modern enterprise application frameworks like
Spring Boot, Play Framework, Django
- Demonstrated expertise in building scalable distributed applications in microservices architecture
- Expert knowledge of best practice software engineering methodologies and coding standards
- Strong and proven advocacy for Test Driven Development is preferred
- Experience with SQL (mySQL, Postgres, etc) and NoSQL (MongoDb, DynamoDB, Aerospike or Redis)
- Production experience in running cloud-based enterprise-grade systems at scale
- Natural ability to process requirements, figure out multiple execution options, their complexity, and
estimate the scope of work required to get tasks done
- DevOps experience
- Cloud experience (AWS required, Google Cloud Platform bonus
Read more
NIRA
at NIRA
1 recruiter
Nupur Gupta
Posted by Nupur Gupta
Bengaluru (Bangalore)
4 - 7 yrs
₹20L - ₹30L / yr
skill iconJava
AWS Lambda
skill iconAmazon Web Services (AWS)
DynamoDB
skill iconAndroid Development
NIRA is a new fintech venture, on a mission for financial inclusion. Our vision is a world where everyone can get access to credit in a manner that is fast, frictionless and fair. This statement of intent guides all our decisions and strategy. We are planning to launch in Q1 2018. Currently, only 10% of Indians can use banks when they need credit: banks typically require a high credit score or collateral, something most people don't have. It need not be this way. Using a combination of traditional data and the vast amount of digital data available, it is now possible to score the unscored. We want to reimagine the way loans are underwritten and bring access to credit to millions of underbanked in India. We can economically empower them to have greater control of their lives and provide downside protection in difficult times. We are addressing head-on a big challenge. It's also a great opportunity from both a commercial and societal impact perspective. We can improve lives for millions. It is no exaggeration to say that our addressable market will be 400mm within 5 years. It's pretty exciting we think. If our mission resonates with you, and you are a talented and hardworking individual that wants to commit yourself to an incredible yet surmountable challenge, then we want to hear from you. You'll work closely with the founders and share the responsibility to ensure the alignment of the technology strategy with the long term goals of the business. Within a small team of engineers, you'll facilitate the in house migration of product from software development partners, while managing business continuity during the launch phase. Roles & responsibilities: *Execute lean and fast experiments on a serverless microservices architecture *Understand the first product that has been built *Build new features in the existing product and launch new products *Contribute to instating the early internal security policies *Contribute in building the initial data infrastructure to process and consume the growing streams of data *Contribute to hiring and engineering team building efforts Skills & Qualifications: *Strong experience with Java *Experience with Android SDK gained while building and scaling mobile consumer products *1-2 years of experience in software development on AWS Lambda and NoSQL databases *Familiarity with AWS products - EC2, DynamoDB, S3, EMR etc *Familiarity with multiple layers of infrastructure and application stack - UI, application layer, database *Comfortable dealing with operational aspects like reporting, and infrastructure sizing *Be excited about the power of technology to transform finance for the better! Other keywords to help you find the job: fintech, India, social impact, early stage, lead engineer, senior engineer, Android engineer, Java engineer, consumer credit, startup
Read more
BUDDIAI
at BUDDIAI
1 video
2 recruiters
Dhana Lakshmi A
Posted by Dhana Lakshmi A
Chennai
3 - 10 yrs
₹4L - ₹15L / yr
skill iconJava
Data Structures
Algorithms
skill iconScala
skill iconC++
+7 more

Job description

 

We are looking for a passionate Software Development Engineer to develop, test, maintain and document program code in accordance with user requirements and system technical specifications. As a Software Development Engineer, you will work with other Developers and Product Managers throughout the software development life cycle.

Software Development Engineer responsibilities include analysing requirements, define system functionality and writing code in the companys current technology stack. The candidate is expected to be familiar with the software development life cycle (SDLC) process from preliminary system analysis to tests and deployment. Ultimately, the role of the Software Engineer is to build high-quality, innovative and fully performing software that complies with coding standards and technical design. Your goal will be to build efficient programs and systems that serve user needs.

To be qualified for this role, you should hold a minimum of Bachelor’s degree in a relevant field, like Computer Science, IT or Software Engineering. You should be a team player with a keen eye for detailed and problem-solving skills. If you also have experience in SDLC, Agile frameworks and popular coding languages (e.g., Java), strong computer science fundamentals we’d like to meet you.

Years of experience : 2 to 10 years.

Roles & Responsibilities

The overview of this position (based in Chennai, India) includes:

  • Develops, enhances, debugs, supports, maintains and tests software applications that support business units or supporting functions. These application program solutions may involve diverse development platforms, software, hardware, technologies and tools.
  • Participates in the design, development and implementation of complex applications, often using new technologies.
  • Technology professional with experience in designing and managing the implementation of future looking, flexible and reusable, enterprise applications and components.
  • Expert in translating business requirements into an application design that includes Data Model, Web Screens, Web Services, and batch processing.
  • May provide technical direction and system architecture for individual initiatives.
  • Serves as a fully seasoned/proficient technical resource.
  • Deploy programs, gather and evaluate user feedback
  • Recommend and execute improvements
  • Create technical documentation for reference and reporting
  • Develop software verification plans and quality assurance procedures
  • Document and maintain software functionality
  • Ensure software is updated with latest features
  • Good interpersonal and technology understanding skills
  • Evaluate open-source components and integrate into product pipeline

Skills and Qualifications

  • Hands-on experience in analysis, design, coding, and implementation of complex, custom-built applications.
  • Strong Java, development skills (JAVA, J2EE, STRUTS, SPRING, Web Services, Eclipse, UI screens, AngularJS, React.JS)
  • Excellent debugging skills
  • Strong knowledge on databases (MySQL, MSSQL Server and NoSQL databases)
  • Understanding of various deployment servers (Apache Tomcat is a must)
  • Understanding of OO skills, including strong design patterns knowledge is a must.
  • Strong understanding in creating and maintaining web services.
  • Understanding of the software development life cycle
  • Experience with Implementation and release management activities
  • Good understanding of unit/system and functional testing methodology
  • Experience working in large transaction-based systems
  • Knowledge of software best practices, like Test-Driven Development (TDD) and Continuous Integration (CI)
  • Experience documenting technical functions
  • Desire to contribute to the wider technical community through collaboration, coaching, and mentoring of other technologists.
  • Experience in Linux based systems, development of shell-based scripts.

Job Training

  • Training on the coding paradigms, guidelines, frameworks, usage of the applications would be provided by the engineers
  • Periodic training sessions would be conducted by the technical architects in terms of technology and skills to be learnt
  • Periodic, structured training would be provided on the applications Hours & Environment
  • Typical 40 hours of work a week
  • Depending on the requirements, work hours may have to be extended during the day, weekend
Read more
Niki.ai
at Niki.ai
6 recruiters
Suchandni Verma
Posted by Suchandni Verma
Bengaluru (Bangalore)
4 - 6 yrs
₹10L - ₹25L / yr
skill iconJava
skill iconPython
Distributed Systems
skill iconMachine Learning (ML)
Object Oriented Programming (OOPs)
+2 more
- Niki is an artificially intelligent personal shopping assistant (http://niki.ai/app). Our founding team is from IIT Kharagpur, and we are looking for a Backend Developer to join us in the core software development and maintenance. - We work mostly in Java and Python and object oriented concepts are a must to fit in the team. If you have experience in :1. Working at a high-traffic consumer facing company for minimum 5 years. 2. Architecting scalable systems in terms of making key decisions about database options, server frameworks, sync vs async, distributed vs monolithic, redundancy etc. 3. Ensuring fault tolerance and optimal latency of distributed and concurrent systems. 4. Mitigating and recovering from large scale system crashes and disasters. 5. Automation and consumer centric machine learning implementations - setting up ground truth, feedback loops and A/B testing. 6. Large scale monitoring and alarm systems. 7. Thinking backwards from a customer POV and relentlessly pursuing customer's cause in tech and product decisions. And you are always ready to get your hands dirty with coding and shipping products and services covering all the aspects yourselves - requirements gathering, resource allocation, testing, deploying, monitoring and iterating. Basic eligibility criteria are : 1. Graduate/Post-Graduate in Computer Science/Mathematics/Physics or allied fields. 2. Industry experience of 5-9 years in developing scalable software. 3. Have some experience in leading a team big or small.
Read more
CloudOptics
at CloudOptics
1 recruiter
Aseem R
Posted by Aseem R
Bengaluru (Bangalore)
1 - 3 yrs
₹3L - ₹7L / yr
skill iconJava
MySQL
J2EE
Spring
Hibernate (Java)
+2 more
Are you a person who wants to be part of shaping the future in CyberSecurity? Are you a lifelong learner who happens to love backend java development of scalable Web Services platform? What We Have: • Startup in CyberSecurity domain, creating a platform to ease security & compliance process by bringing disrupting solutions to this field. • A team of go-getters to hang-out with • Open mind for new ideas, methodologies & unknown challenges • Abundance of Web Service pipeline to be created You Might Have: • Ability & Willingness to learn new things • Experience of building Java REST Web Services along with MySQL database • Knowledge of Deployment of Web Services on Linux • Experience with entire SDLC • Attention to details You might ALSO Have: • Knowledge of Node.JS • Knowledge of Google Cloud, Azure &/OR AWS is a plus • Awareness of application security In case this isn’t you, perhaps you may have some friends who would be a fit? Send them this job.
Read more
Catalyst Management LLP
Fazal S
Posted by Fazal S
NCR (Delhi | Gurgaon | Noida)
1 - 3 yrs
₹2L - ₹4L / yr
skill iconJavascript
skill iconPHP
skill iconPython
skill iconRuby on Rails (ROR)
skill iconNodeJS (Node.js)
+2 more
Candidate having good langues knowledge.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos