Cutshort logo
Technology service company logo
Sr. Spark Software Engineer
Technology service company
Sr. Spark Software Engineer
Jobdost's logo

Sr. Spark Software Engineer

at Technology service company

Agency job
5 - 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Ansible
skill iconGit
JIRA
Apache Spark
Spark
Apache Kafka
Microservices
skill iconKubernetes
Terraform
NOSQL Databases
API
skill iconDocker
  • Bachelor’s or master’s degree in Computer Engineering, Computer Science, Computer Applications, Mathematics, Statistics, or related technical field. Relevant experience of at least 3 years in lieu of above if from a different stream of education.

  • Well-versed in and 3+ hands-on demonstrable experience with: ▪ Stream & Batch Big Data Pipeline Processing using Apache Spark and/or Apache Flink.
    ▪ Distributed Cloud Native Computing including Server less Functions
    ▪ Relational, Object Store, Document, Graph, etc. Database Design & Implementation
    ▪ Micro services Architecture, API Modeling, Design, & Programming

  • 3+ years of hands-on development experience in Apache Spark using Scala and/or Java.

  • Ability to write executable code for Services using Spark RDD, Spark SQL, Structured Streaming, Spark MLLib, etc. with deep technical understanding of Spark Processing Framework.

  • In-depth knowledge of standard programming languages such as Scala and/or Java.

  • 3+ years of hands-on development experience in one or more libraries & frameworks such as Apache Kafka, Akka, Apache Storm, Apache Nifi, Zookeeper, Hadoop ecosystem (i.e., HDFS, YARN, MapReduce, Oozie & Hive), etc.; extra points if you can demonstrate your knowledge with working examples.

  • 3+ years of hands-on development experience in one or more Relational and NoSQL datastores such as PostgreSQL, Cassandra, HBase, MongoDB, DynamoDB, Elastic Search, Neo4J, etc.

  • Practical knowledge of distributed systems involving partitioning, bucketing, CAP theorem, replication, horizontal scaling, etc.

  • Passion for distilling large volumes of data, analyze performance, scalability, and capacity performance issues in Big Data Platforms.

  • Ability to clearly distinguish system and Spark Job performances and perform spark performance tuning and resource optimization.

  • Perform benchmarking/stress tests and document the best practices for different applications.

  • Proactively work with tenants on improving the overall performance and ensure the system is resilient, and scalable.

  • Good understanding of Virtualization & Containerization; must demonstrate experience in technologies such as Kubernetes, Istio, Docker, OpenShift, Anthos, Oracle VirtualBox, Vagrant, etc.

  • Well-versed with demonstrable working experience with API Management, API Gateway, Service Mesh, Identity & Access Management, Data Protection & Encryption.

    Hands-on experience with demonstrable working experience with DevOps tools and platforms viz., Jira, GIT, Jenkins, Code Quality & Security Plugins, Maven, Artifactory, Terraform, Ansible/Chef/Puppet, Spinnaker, etc.

  • Well-versed in AWS and/or Azure or and/or Google Cloud; must demonstrate experience in at least FIVE (5) services offered under AWS and/or Azure or and/or Google Cloud in any categories: Compute or Storage, Database, Networking & Content Delivery, Management & Governance, Analytics, Security, Identity, & Compliance (or) equivalent demonstrable Cloud Platform experience.

  • Good understanding of Storage, Networks and Storage Networking basics which will enable you to work in a Cloud environment.

  • Good understanding of Network, Data, and Application Security basics which will enable you to work in a Cloud as well as Business Applications / API services environment.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Deqode
at Deqode
1 recruiter
Alisha Das
Posted by Alisha Das
Bengaluru (Bangalore), Delhi, Gurugram, Noida, Ghaziabad, Faridabad, Mumbai, Pune, Hyderabad, Kolkata, Indore
2 - 4 yrs
₹3L - ₹17L / yr
skill iconJava
skill iconKotlin
skill iconSpring Boot

Job Summary:

As a Java Spring Boot Developer, you will play a key role in designing, developing, and maintaining robust backend services and APIs. With 2.5+ years of experience, including knowledge in Kotlin, you will work alongside a cross-functional team to build scalable and performant systems.

Key Responsibilities:

  • Design, develop, and maintain efficient, reusable, and reliable Java and Kotlin code
  • Build and consume RESTful APIs and microservices using Spring Boot
  • Ensure the best possible performance, quality, and responsiveness of applications
  • Collaborate with product managers, QA engineers, and DevOps for end-to-end delivery
  • Troubleshoot and resolve performance bottlenecks, bugs, and technical issues
  • Participate in code reviews, knowledge sharing, and continuous improvement

Required Skills & Qualifications:

  • 2.5+ years of experience with Java and Spring Boot
  • Strong understanding of RESTful APIs, MVC, and microservices architecture
  • Experience with relational and NoSQL databases
  • Proficiency with Git and Agile/Scrum methodologies

Preferred Skills:

  • Familiarity with Docker, Kubernetes, and CI/CD tools
  • Exposure to cloud platforms such as AWS or Azure
  • Experience with unit testing and test automation frameworks


Read more
Livello India Private Limited
Hyderabad
3 - 4 yrs
₹10L - ₹15L / yr
skill iconNodeJS (Node.js)
skill iconMongoDB
Mongoose
skill iconExpress
GraphQL
+5 more

Company Profile:

Livello India Private Limited is a start up company with its parent company based in Germany in the city of Dusseldorf. We started in the year 2016 with a vision to create revolution in the domain of retail technology to automate and simplify the shopping experience of our customers. We have started our R&D division in India with a vision to strengthen and expand our R&D team to come up with the products that will make the shopping experience of our customers fast and hassle free. Our expertise consists of fullstack, IoT,cloud, data science, computer vision, embedded systems, test automation, electronics and mechanical engineering.


For more information, please visit our website https://www.livello.com/technologies?lang=en

 

Tasks:

· You will take part in the design of the architecture and the development of modern software-based applications in the back-end (Node.JS &TypeScript)

· You support the technological conception, programming and implementation of new features

· You help manage IoT-to-Cloud services, Microservices and GCP

· Experience of working with MongoDB


Mandatory Requirements:

· Bachelor or Master student in an IT-related field of study

· 3-4 Years of Experience in Backend along with Software Deployment

· Ability to holistically conceive applications in multiple technologies in the backend

· Experience with Node.JS, TypeScript and Mongo DB.

· Hands on exposure to cloud infrastructure (GCP/AWS/Azure)


Nice to Have:

· Experience with GraphQL, Nest.JS, Docker and Kubernetes

· Understanding of IoT device management and message brokers like AMQP or MQTT

· Good to have DevOps experience

· Exposure to Agile Scrum Framework


Benefits:

· A responsible position in a fast-growing and highly innovative start-up

· An agile and diverse team with colleagues from all over the world

· English speaking open work environment, with flat hierarchies and short decision-making paths

· Advanced technology stack leveraging cutting-edge IoT hardware and software

· Creative freedom for own ideas, projects and personal development

· Team building, learning and start-up events

· Opportunity for diversifying your technical learning.

Read more
TOP MNC
TOP MNC
Agency job
via TCDC by Sheik Noor
Bengaluru (Bangalore), Mangalore, Chennai, Coimbatore, Pune, Mumbai, Kolkata
6 - 10 yrs
₹10L - ₹21L / yr
skill iconJava
06692
Google Cloud Platform (GCP)

Java Developer with GCP

Skills : Java and Spring Boot, GCP, Cloud Storage, BigQuery, RESTful API, 

EXP : SA(6-10 Years)

Loc : Bangalore, Mangalore, Chennai, Coimbatore, Pune, Mumbai, Kolkata

Np : Immediate to 60 Days.


Kindly share your updated resume via WA - 91five000260seven

Read more
Start up Social Commerce based in Indonesia
Start up Social Commerce based in Indonesia
Agency job
via Qrata by Revathi Satish
Bengaluru (Bangalore)
1 - 4 yrs
₹10L - ₹25L / yr
Odoo (OpenERP)
Odoo
odoo
skill iconJava
Spring
+1 more
Job Duties and Responsibilities
We are looking for an experienced full-stack engineer to implement both back-end and front-end
software solutions to serve both internal and external customers. The position entails working in
an agile team to develop Java- and React-based projects that support our system.
● 1 - 4 yrs of Odoo development experience.
● Design, implement and test full-stack solutions using Java, Spring and React
● Design robust spring system that can support 2-5mil users.
● Work alongside other team members to integrate various components into finished
product
● Work closely with product owner to create stories
● Continuously create new and interactive features that would help to improve user
experience and user engagement.
● Assist with troubleshooting of issues as needed
● Participate in the design and architecture of software solutions
● Assist in developing and maintaining continuous integration pipelines
Read more
Chennai, Pune, Bengaluru (Bangalore), Jaipur
5 - 8 yrs
₹13L - ₹25L / yr
skill iconRuby on Rails (ROR)
skill iconRuby
skill iconPostgreSQL
AWS Lambda
skill iconGit
+6 more
ROR Developer
Location: Chennai, Pune,Banglore,jaipurExp: 5 yrs to 8 yrs

  • Implement best practices for the engineering team across code hygiene, overall architecture design, testing, and deployment activities
  • Drive technical decisions for building data pipelines, data lakes, and analyst access.
  • Act as a leader within the engineering team, providing support and mentorship for teammates across functions
  • Bachelor’s Degree in Computer Science or equivalent job experience
  • Experienced developer in large data environments
  • Experience using Git productively in a team environment
  • Experience with Docker
  • Experience with Amazon Web Services
  • Ability to sit with business or technical SMEs to listen, learn and propose technical solutions to business problems

·       Experience using and adapting to new technologies

·       Take and understand business requirements and goals

·       Work collaboratively with project managers and stakeholders to make sure that all aspects of the project are delivered as planned

·       Strong SQL skills with MySQL or PostgreSQL

  • Experience with non-relational databases and their role in web architectures desired

 Knowledge and Experience:

  • Good experience with Elixir and functional programming a plus
  • Several years of python experience
  • Excellent analytical and problem-solving skills
  • Excellent organizational skills

Proven verbal and written cross-department and customer communication skills

 

Read more
Transcodex Technologies Pvt Ltd
Elissa Bedamatta
Posted by Elissa Bedamatta
Remote, Bengaluru (Bangalore)
5 - 8 yrs
₹17L - ₹29L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Object Oriented Programming (OOPs)
+9 more
  • Work with business analysts to estimate and design effective, scalable and maintainable solutions that meet business initiatives and objectives
  • Develop and unit test software that meets business requirements and technical design
  • Troubleshoot pre- and post-production implementations
  • Propose new ideas when there is strong business value and stay up to date on the latest technology trends and techniques

 

Critical Skills & Experiences:

  • At least 5+ years of experience developing in Java technologies with equivalent experience in systems analysis, OO design, OO programming and debugging skills
  • At least 5 years of experience in Java Spring Boot Framework development
  • 2 years of experience in any Cloud platform, preferably AWS.
  • At least 3 years of web services and relational database experience (preferably Mysql)
  • At least a year of Elastic search experience
  • Experience developing RESTful web services (preferably micro services)
  • Experience with UNIX/Linux command line and shell scripting
  • Experience working in cross-functional Agile/Scrum teams
  • Any level of experience with JIRA or any other issue tracking technology
  • Experience working directly with business stakeholders
  • Experience with Java application profiling and profiling tools
  • Exceptional written and verbal communication skills.
  • Drive performance to accomplish team goals in a fast-paced environment
  • Bachelor’s degree or the above equivalent skills and years of experience

 

 

 

 

Keywords:

Experience: +5 Years

Technical skills: Java, Spring boot and Node JS  

 

Read more
CEDRETO MARKETING PRIVATE LIMITED
Ankit Agarwal
Posted by Ankit Agarwal
Bengaluru (Bangalore)
0 - 1 yrs
₹3.5L - ₹4.5L / yr
skill iconPython
skill iconDjango
skill iconFlask
RESTful APIs
skill iconAmazon Web Services (AWS)
+4 more

JOB DESCRIPTION 

DYT - Do Your Thng, is an app, where all social media users can share brands they love with their followers and earn money while doing so! We believe everyone is an influencer. Our aim is to democratise social media and allow people to be rewarded for the content they post. How does DYT help you? It accelerates your career through collaboration opportunities with top brands and gives you access to a community full of experts in the influencer space. 

RESPONSIBILITIES 

  • Expert in Python with knowledge of Python best practices (PEP8) 
  • Strong knowledge of python web frameworks such as Django, Flask • Strong knowledge of building RESTful APIs using Django Rest Framework • Good Understanding of Django ORM Libraries 
  • Able to integrate multiple data sources and databases into one system • Strong experience on Linux 
  • Solid database skills in a relational database (i.e. PostgresSQL,MYSql) • Able to create database schemas that represent and support business processes • Strong unit test and debugging skills 
  • Proficient understanding of code versioning tools (git) 
  • Experience deploying on AWS is desirable 
  • Experience with Docker,Test Drive Development will be a plus 
  • Excellent interpersonal, leadership, influence and communication skills • Experience in designing scalable micro-services is desirable 

QUALIFICATIONS 

  • 0-1 years of experience as a backend developer 
  • At least one product build and published 
  • SKILLS Contribute in all phases of the development lifecycle 
  • Write well designed, testable, efficient code 
  • Work well under pressure and meet deadlines without sacrificing quality • Work with distributed development teams 
Read more
www.Houseitt.in
at www.Houseitt.in
1 recruiter
Houseitt .
Posted by Houseitt .
Remote only
2 - 4 yrs
₹2.4L - ₹3L / yr
skill iconPython
skill iconDjango
skill iconHTML/CSS
skill iconJavascript
skill iconReact.js
+6 more
ABOUT HOUSEITT:
HouseItt is a student-run start up recognized by the start-up India initiative by the
Government of India. It provides student residences across and around Delhi University
colleges. It provides easy to book, better service, and affordable rental homes to students
within the campus and thrives on building a robust support system for handling student
accommodations. It bridges the gap between the demand (students looking for PGs/Flats)
and supply (owners) of rentals.
JOB PROFILE: BACKEND DEVELOPER (FULL-TIME JOB)
REQUIREMENTS:
• Good knowledge of MongoDB or framework like Django (Python).
• Proficient in MySQL, PostgreSQL.
• Proficient understanding of Git & Github.
• Knowledge of user authentication and authorization between multiple systems, servers,
and environments.
• A solid understanding of how Web Apps work including security and session
management.
• Adequate knowledge of relational database systems and OOPconcepts.
• Experience with testing tools like Sentry.
• Ability to learn and research about things you don't know.
ROLES AND RESPONSIBILITIES:
• Understanding and interpreting the task assigned by Team Lead.
• Getting the assigned work done in the given deadline.
• Giving suggestions to improve our web application and solve business problem.
TENURE: Full-time job
LOCATION: Work from Home
SALARY: Rs. 20000/- to Rs. 25000 (IN HAND)
BENEFITS:
• Certificate of Experience
• Letter of Recommendation
Read more
Livspace
at Livspace
1 video
11 recruiters
Christopher Menezes
Posted by Christopher Menezes
Bengaluru (Bangalore)
3 - 12 yrs
Best in industry
skill iconJava
skill iconJavascript
Data Structures
Algorithms
skill iconScala
+5 more
As a Senior software developer you will:
➢ Design, implement and enhance new components of the Livspace design
platform and content management platform
➢ Design new features for the e-commerce properties and front-end products
and mobile apps
➢ Maintain engineering infrastructure
➢ Have significant impact on current and future technology roadmap
➢ Contribute creatively in strategic products that will reach large audience
➢ Build a web product that users love.
Who you are:
➢ You earned B.Tech or equivalent degree in computer science or related
engineering field
➢ You have at least 3+ yrs of experience working with large scale web
products
➢ You can learn new technologies quickly
➢ You have strong communication and collaboration skills
➢ You have prior ownership of the delivery of an entire feature/subsystem
You know your way around these:
➢ Linux, Apache, MySQL and PHP
➢ Javascript, AngularJS, JQuery, HTML, CSS
➢ Object oriented programming with Java/Python/Ruby
➢ HTTP and REST web services
Read more
zorang
at zorang
6 recruiters
Shikha Yadav
Posted by Shikha Yadav
NCR (Delhi | Gurgaon | Noida)
7 - 10 yrs
₹0L / yr
skill iconJava
skill iconJavascript
Mobile App Development
skill iconGo Programming (Golang)
Job description Java Architect/Tech Lead "Do you want to work on consumer-facing, high transaction, eCommerce projects?" Zorang is currently seeking a Java Technical Architect with demonstrably strong Java development experience to join the Technical Architecture team. In the Agile SCRUM environment, you'll deliver some of the most innovative and cutting-edge technology solutions to date. If you are: · A smart, results-oriented individual with a mix of passion for solid application architecture, hands-on coding, and project management, who also has the soft skills of building relationships and consensus; · A curious individual with the ability and desire to see the big picture beyond the happy path, and bend the lens to see what's around the corner - we're software professionals and we think in terms of what happens 'when,' not what happens 'if;' · An economical mind with an intuition for understanding scope versus value and placing emphasis on the 80/20 rule; · An empathetic person who mindfully intends to make it easier for the producers and consumers of their work to effectively do their jobs; · An architectural thinker that values availability and scalability. We use distributed systems to make it all happen. We want people that think that is cool; · Not afraid to make mistakes, and willing to take ownership of projects: gain a good understanding of the problem, work to negotiate an acceptable technology solution, find the tools and answers, and proactively build and deliver code; · A voice helping to define best practices and standards with the development leadership team, and champion them to the team; Then this might be the right role and team for you. Experience and Skills: We'll be looking for you to demonstrate your skills in these areas: 8+ years Java JEE development and experience driving Java web application architectural conversations Understand abstract problems and provide innovative solutions Write technical specifications to address business requirements. Develop architecture and technical design for eCommerce projects Formulate an implementation plan, prepare estimates for eCommerce projects Contribute to and Enforce the organizational best practices/policies Mentor 6-8 developers and lead of team of developers and QA engineers Work on more than one E-commerce projects simultaneously as a lead Setup coding best practices, version control processes, build procedure and continuous integration Writing solution and technical design documentation for projects Previous experience of working on at least 2-3 e-Commerce/PIM/Content Management implementation projects Integration with 3rd party web services, ERP systems, Salesforce, Endeca, Solr and other tools Experience working on at least one e-commerce Platforms- IBM-WCS, Oracle-ATG, SAP-Hybris, Demandware. Familiarity with PHP and Magento would be a plus. Familiarity with mobile programming (Android and iOS) would be a plus.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos