Cutshort logo
Technology service company logo
Sr. Spark Software Engineer
Technology service company
Sr. Spark Software Engineer
Jobdost's logo

Sr. Spark Software Engineer

at Technology service company

Agency job
5 - 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Ansible
skill iconGit
JIRA
Apache Spark
Spark
Apache Kafka
Microservices
skill iconKubernetes
Terraform
NOSQL Databases
API
skill iconDocker
  • Bachelor’s or master’s degree in Computer Engineering, Computer Science, Computer Applications, Mathematics, Statistics, or related technical field. Relevant experience of at least 3 years in lieu of above if from a different stream of education.

  • Well-versed in and 3+ hands-on demonstrable experience with: ▪ Stream & Batch Big Data Pipeline Processing using Apache Spark and/or Apache Flink.
    ▪ Distributed Cloud Native Computing including Server less Functions
    ▪ Relational, Object Store, Document, Graph, etc. Database Design & Implementation
    ▪ Micro services Architecture, API Modeling, Design, & Programming

  • 3+ years of hands-on development experience in Apache Spark using Scala and/or Java.

  • Ability to write executable code for Services using Spark RDD, Spark SQL, Structured Streaming, Spark MLLib, etc. with deep technical understanding of Spark Processing Framework.

  • In-depth knowledge of standard programming languages such as Scala and/or Java.

  • 3+ years of hands-on development experience in one or more libraries & frameworks such as Apache Kafka, Akka, Apache Storm, Apache Nifi, Zookeeper, Hadoop ecosystem (i.e., HDFS, YARN, MapReduce, Oozie & Hive), etc.; extra points if you can demonstrate your knowledge with working examples.

  • 3+ years of hands-on development experience in one or more Relational and NoSQL datastores such as PostgreSQL, Cassandra, HBase, MongoDB, DynamoDB, Elastic Search, Neo4J, etc.

  • Practical knowledge of distributed systems involving partitioning, bucketing, CAP theorem, replication, horizontal scaling, etc.

  • Passion for distilling large volumes of data, analyze performance, scalability, and capacity performance issues in Big Data Platforms.

  • Ability to clearly distinguish system and Spark Job performances and perform spark performance tuning and resource optimization.

  • Perform benchmarking/stress tests and document the best practices for different applications.

  • Proactively work with tenants on improving the overall performance and ensure the system is resilient, and scalable.

  • Good understanding of Virtualization & Containerization; must demonstrate experience in technologies such as Kubernetes, Istio, Docker, OpenShift, Anthos, Oracle VirtualBox, Vagrant, etc.

  • Well-versed with demonstrable working experience with API Management, API Gateway, Service Mesh, Identity & Access Management, Data Protection & Encryption.

    Hands-on experience with demonstrable working experience with DevOps tools and platforms viz., Jira, GIT, Jenkins, Code Quality & Security Plugins, Maven, Artifactory, Terraform, Ansible/Chef/Puppet, Spinnaker, etc.

  • Well-versed in AWS and/or Azure or and/or Google Cloud; must demonstrate experience in at least FIVE (5) services offered under AWS and/or Azure or and/or Google Cloud in any categories: Compute or Storage, Database, Networking & Content Delivery, Management & Governance, Analytics, Security, Identity, & Compliance (or) equivalent demonstrable Cloud Platform experience.

  • Good understanding of Storage, Networks and Storage Networking basics which will enable you to work in a Cloud environment.

  • Good understanding of Network, Data, and Application Security basics which will enable you to work in a Cloud as well as Business Applications / API services environment.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

kbstechsolutions
Bengaluru (Bangalore), Pune, Hyderabad, Chennai
6 - 12 yrs
₹12L - ₹35L / yr
skill iconJava
skill iconC++
ITK
SOA
Product Lifecycle Management (PLM)
+1 more

Role: Teamcenter Lead Developer

Experience: 6+yrs

Location: Bangalore/Hyderabad/Pune/Chennai

Notice Period: Immediate and 15 days only or max Upto 30 days

 

Key Responsibilities

  • Core PLM Support & Expertise
  • Manage and support key Teamcenter functionalities including:
  • Parts & Components Management
  • CAD Data Management & Integration
  • BOM Management
  • Change Management
  • Supplier Collaboration
  • Enterprise Data Integration
  • Configuration & Customization
  • Configure and customize Teamcenter modules to meet evolving business requirements
  • Ensure alignment with PLM industry best practices and internal process standards
  • Troubleshooting & End-User Support
  • Investigate, diagnose, and resolve Teamcenter-related issues
  • Deliver Tier 2/3 application support and guidance to end-users and business stakeholders
  • Maintain system uptime and performance, ensuring minimal business disruption
  • Code Implementation
  • Develop and maintain clean, efficient code using Teamcenter-specific technologies such as:
  • Java, C++, ITK (Integration Toolkit), SOA frameworks
  • Support enhancements and new functionality development
  • System Integration
  • Collaborate with IT and engineering teams to integrate Teamcenter with ERP, CAD, and other enterprise platforms
  • Enable seamless data flow and automation across interconnected systems
  • Solution Development
  • Design and deliver custom solutions within the Teamcenter platform, including:
  • Workflows, UI modifications, reports, and extension modules
  • Support ongoing innovation and platform optimization

 

Qualifications

  • Bachelor’s degree in computer science, Engineering, or related technical field preferred
  • 6+ years of experience supporting and developing within the Teamcenter PLM ecosystem
  • Strong hands-on experience with Java, C++, ITK, and SOA for Teamcenter development
  • Solid understanding of PLM best practices and enterprise system integration
  • Proven problem-solving skills and the ability to manage technical escalations

 

Nice to Have

  • Experience working in a global engineering or manufacturing environment
  • Familiarity with Agile methodologies and DevOps principles
  • Knowledge of enterprise systems like SAP, Oracle, or other major ERP platforms


Read more
Hubbler Pvt Ltd
Bengaluru (Bangalore)
3 - 9 yrs
Best in industry
skill iconPython
skill iconDjango
skill iconFlask
skill iconMongoDB
RESTful APIs
+2 more

Company Description

Hubler is a NoCode platform located in Bangalore Urban that helps businesses digitally transform and manage every aspect of their business onto a single platform. Our clutter-free app-building platform offers ready-to-deploy apps and app canvas to digitize any business process into mobile and web apps overnight, as well as actionable insights in real-time.


Role Description

This is a full-time on-site role for a Senior Software Engineer (Python) at Hubler. The Senior Software Engineer will be responsible for designing, developing, and maintaining high-quality software applications while working within a team of developers and collaborating with cross-functional teams to identify and develop software solutions that meet client needs.


Qualifications

  • 5+ years of experience in developing, and maintaining high-quality software applications using Python
  • Must enjoy Coding with Passion
  • Strong knowledge of software engineering principles, algorithms, data structures and design patterns
  • Experience working with Django, Flask, Python-based web frameworks and Restful APIs
  • Experience in database design and management with MongoDB
  • Experience in distributed source control, such as Git
  • Experience with scrum development methodology
  • Bachelor's or Master's degree in Computer Science, or a related field
  • Good communication skills, both written and verbal, to facilitate clear communication with team members and stakeholders
  • The ability to work in a collaborative team environment with willingness to share skills and knowledge


Read more
Engage2Serve Private Limited
Chennai
5 - 8 yrs
₹20L - ₹23L / yr
skill iconJava
Microservices
MySQL

Technical skills required:

 

Skills: Java 8 and above, Rest Web services, MySQL.

        

 

Strong background in Core Java and good knowledge of collection Framework.

 

Proficient in developing high-performance, less memory-intensive micro-services applications using the Java framework.

       

Should have deep knowledge of Micro-service development.

       

        

Read more
BeyondSkool
at BeyondSkool
1 recruiter
Vibidesh Tugave
Posted by Vibidesh Tugave
Mumbai
6 - 10 yrs
₹12L - ₹25L / yr
skill iconNodeJS (Node.js)
skill iconMongoDB
Mongoose
skill iconExpress
MySQL
+5 more

About Beyondskool:


BeyondSkool aims to be the No.1 destination for BeyondSkool courses for kids aged 4-15yrs by building knowledge and skills in areas that are not typically covered by school to constantly expand learning and stay ahead. We do this through our programs, which are designed by experts covering both breadth and depth of expertise, delivered by certified and trained teachers through LIVE online classes on our engaging and interactive platform. Mission of BeyondSkool is that just like a school, to build a community of highly motivated BeyondSkoolers who have an infinite hunger of learning, which goes beyond school curriculum for continuously expanding knowledge and skills to excel and stay ahead.


Founded by experienced professionals and alumni of prestigious institutes namely Kellogg and MDI with 20+ years of experience in various industries handling leadership roles across business functions. We are at a stage of hiring our core team members who are young, passionate individuals with keen interest in making a difference in the education sector.

Role and Responsibilities

  • Research, design and build highly reliable, available, and scalable platforms.
  • Explore design implications and work towards an appropriate balance between functionality, performance, and maintainability.
  • Lead by example, mentor, and guide team members on everything from structured problem solving to development of best practices.
  • Own large technical deliverables and execute in an exemplary way
  • Be able to conceptualize and develop prototype quickly
  • Working with a cross-discipline team (Design, Product, Engineer, Operations, Sales, Marketing).
  • Active participation in the hiring process to bring quality engineers in the team. 
  • Lead-out team meetings, stand-ups, and architecture/design discussions
  • Writing bug-free code, participating in code reviews, designing/architecting systems of varying complexity and scope, and creating high-quality documentation supporting the design/coding tasks
  • Identify areas of improvement in our frameworks, tools, processes and strive to make them better.
  • Researching new technologies and adapting them to BeyondSkool’s requirements
  • Own and commit to all your work, and be accountable for your results
  • Using and understanding code from Open-Source projects
  • Participate in a culture of code reviews, writing tech specs, and collaborating closely with other people
  • Produce highly reliable systems that are thoroughly tested and benchmarked.
  • Develop multi-tier scalable, high-volume performing, and reliable user-centric infrastructure that operates 24x7
  • Scale distributed applications, make architectural trade-offs applying synchronous and asynchronous design patterns, and deliver with speediness and quality.


Qualifications and Education Requirements

  • Bachelor's degree in Computer Science or any other relevant field.
  • Experience of 5 - 7 years as a back-end engineer preferably in a microservice environment.
  • Strong proficiency of Node.js and frameworks available for it such as Express.js
  • Strong proficiency in Javascript and TypeScript

Preferred Skills

  • Must have worked building 2+ backend system using node.js and Express.js
  • Strong understanding and experience of creating highly scalable and complex database design.
  • Good understanding of Data Modeling using RDBMS and NoSQL (Cassandra, MongoDB, ElasticSearch, Redis) data stores
  • Strong problem-solving skills with a good understanding of data structures and algorithms
  • Strong understanding of front-end technologies, such as HTML5, and CSS3
  • User authentication and authorization between multiple systems, servers, and environments
  • Experience of creating highly scalable, fault tolerant, resilient distributed systems
  • Strong knowledge of creating scalable system design and good understanding of microservice based architectures
  • Understanding of caching enabled, PubSub and event driven architectures
  • Hands on experience and good knowledge of AWS services
  • Understanding automated testing platforms like selenium and unit tests like Chai, Mocha, Jasmine etc
  • Proficient understanding of code versioning tools, such as Git
  • Curiosity to explore the cutting-edge technologies and bake them in the products.
  • Zeal and drive to take end to end ownership.
Read more
DelaPlex Software
at DelaPlex Software
2 recruiters
Sunil Kandukuri
Posted by Sunil Kandukuri
Pune, Nagpur, Bengaluru (Bangalore), Hyderabad
4 - 7 yrs
₹4L - ₹8L / yr
skill iconJava
Spring
skill iconSpring Boot
NOSQL Databases
DynamoDB
+4 more

Role: Java developer
Experience: 4+ years

Job description

○ Working experience on JAVA,Spring Boot. (on building web services?)

○ NOSQL DynamoDB knowledge is plus

○ Working experience in building micro services and distributed systems

○ Working experience on using messaging queues RabbitMQ/Kafka is plus

Read more
Lentra
at Lentra
2 recruiters
Madhushree Kumra
Posted by Madhushree Kumra
Pune
2 - 4 yrs
₹7L - ₹15L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
About Lentra:
Lentra is a new-age, domain-native platform built from the ground up, designed and developed to empower financial institutions with tomorrow’s lending ecosystem, today. With its full-stack, fully digital, secured
products and solutions, Lentra is the future of smart, seamless, secure digital lending.

Our solutions cover the Indian lending stack effectively for digital origination by providing capabilities like eKYC, vKYC, eSign, eNACH, etc., besides MultiBureau(R), a comprehensive BRE for faster decisioning and configurable onboarding workflows. Reliability and minimal TATs are the key takeaways from Lentra’s offerings.

Our Marquee Clients including the topmost private banks in India are now future-ready and encashing business opportunities. Lentra's zero-risk instant lending solution will empower the FIs to leapfrog into the future.

About the Role:
Lentra AI Pvt. Ltd looking for a Software Developer to manage the software development life cycle, from planning and prioritizing to testing and release. Software Developer responsibilities include gathering system
and user requirements, building Java modules and testing features before release. If you have hands-on experience developing software with agile methodologies and are ready to lead our junior developers, we'd like
to meet you. Ultimately, you will deploy and maintain functional, secure and high-quality applications.

Responsibilities:
The candidate has to perform the below responsibilities.
● Identify and analyze user requirements
● Prioritize, assign and execute tasks throughout the software development life cycle
● Develop Java EE applications
● Write well-designed, efficient code
● Review, test and debug team members' code
● Design database architecture
● Schedule product releases with internal teams
● Document development phases
● Ensure our applications are secure and up-to-date.
Candidate requirements
● Engineering graduate specializing in computers, Masters's degree in Computers
● Candidates should have a minimum of 3 years of experience in Java Development.
● Core Java, Hibernate, SpringMvc
● C++, Bootstrap, Angularjs, Node.Js, JQuery, SQL Server
● ASP.Net, ASP.Net MVC, MySQL, HTML
● JSTL,SOAP, C, J2Ee, JSP, Servlets, JEE

Location & commitments:
● This is a permanent opportunity
● Job location is in Pune
Read more
Cloud Database
Cloud Database
Agency job
via CareerXperts Consulting by Shruthi Shetty
Bengaluru (Bangalore)
4 - 10 yrs
₹18L - ₹40L / yr
skill iconGo Programming (Golang)
skill iconRuby on Rails (ROR)
skill iconRuby
skill iconPython
skill iconJava
+2 more
Senior/Lead Golang Developer - Your job will be to design and implement cutting-edge distributed, scale-out data cloud software systems. You will be part of a team working on hard problems, including distributed caching, distributed key-value and document data stores, data replication & conflict resolution, scale-out fault tolerance and data-layer reliability. You’ll work with Golang, and possibly a few other languages thrown in for good measure
Read more
Matellio India Private Limited
Matellio HR
Posted by Matellio HR
Remote only
3 - 6 yrs
₹10L - ₹22L / yr
skill iconGo Programming (Golang)
Microservices
skill iconDocker
skill iconPostgreSQL
gRPC

• Have strong experience in Go 

 • Have expertise in implementing microservices (using tools and technologies for messaging, GraphQL, GRPC, REST API, etc)

 • Have implementation experience in data visualization (knowledge graph, for example), workflow or business process management 

 • Have expertise in design and development using PostresSQL

 • Have experience with Containerization (Docker, Kubernetes, AWS)

 • Experience of Cloud AWS based instances and services (e.g. EC2, S3, ELB, RDS, IAM, Route53, CloudFront, ElastiCache)

 • In practice of writing clean code.

 • Strong experience in enterprise application development, data structures, modern design patterns and microservices architecture

 
Read more
Hvantage Technologies Inc.
Madhuri Dhiman
Posted by Madhuri Dhiman
Indore
0 - 4 yrs
₹1L - ₹1L / yr
skill iconPHP
MySQL
skill iconJava
Proficient in PHP, WebAPI Development Database : MySql, PostgreSQL Node.js Experience of Object Oriented Programming Skills PHP Frameworks: Laravel, CakePHP, Zend, CodeIgniter, Yii2 CMS: Wordpress, Magento 2 E-commerce: Shopify, Prestashop, Woocommerce Version Control: Git, SVN, GitLab Front End: AngularJS, jQuery Frameworks, JavaScript Frameworks, AJAX, HTML5, CSS3 XML, XSLT, JSON 1 years of extensive experience in PHP4 and PHP5.x, HTML, CSS, JAVASCRIPT, JQUERY, AJAX, API.Experience with MVC, Framework like Codeigniter and LARAVEL for developing enterprise applications.
Read more
Zibtek
at Zibtek
8 recruiters
Allen Paul
Posted by Allen Paul
Bengaluru (Bangalore)
6 - 10 yrs
₹9L - ₹16L / yr
skill iconMongoDB
skill iconNodeJS (Node.js)
skill iconAngular (2+)
skill iconExpress
skill iconJava
+1 more
Needed a Fullstack Developer. Candidate should have an experience of leading a team size of 6-12.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos