Cutshort logo
Technology service company logo
Sr. Spark Software Engineer
Technology service company
Sr. Spark Software Engineer
Technology service company's logo

Sr. Spark Software Engineer

at Technology service company

Agency job
5 - 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Ansible
skill iconGit
JIRA
Apache Spark
Spark
Apache Kafka
Microservices
skill iconKubernetes
Terraform
NOSQL Databases
API
skill iconDocker
  • Bachelor’s or master’s degree in Computer Engineering, Computer Science, Computer Applications, Mathematics, Statistics, or related technical field. Relevant experience of at least 3 years in lieu of above if from a different stream of education.

  • Well-versed in and 3+ hands-on demonstrable experience with: ▪ Stream & Batch Big Data Pipeline Processing using Apache Spark and/or Apache Flink.
    ▪ Distributed Cloud Native Computing including Server less Functions
    ▪ Relational, Object Store, Document, Graph, etc. Database Design & Implementation
    ▪ Micro services Architecture, API Modeling, Design, & Programming

  • 3+ years of hands-on development experience in Apache Spark using Scala and/or Java.

  • Ability to write executable code for Services using Spark RDD, Spark SQL, Structured Streaming, Spark MLLib, etc. with deep technical understanding of Spark Processing Framework.

  • In-depth knowledge of standard programming languages such as Scala and/or Java.

  • 3+ years of hands-on development experience in one or more libraries & frameworks such as Apache Kafka, Akka, Apache Storm, Apache Nifi, Zookeeper, Hadoop ecosystem (i.e., HDFS, YARN, MapReduce, Oozie & Hive), etc.; extra points if you can demonstrate your knowledge with working examples.

  • 3+ years of hands-on development experience in one or more Relational and NoSQL datastores such as PostgreSQL, Cassandra, HBase, MongoDB, DynamoDB, Elastic Search, Neo4J, etc.

  • Practical knowledge of distributed systems involving partitioning, bucketing, CAP theorem, replication, horizontal scaling, etc.

  • Passion for distilling large volumes of data, analyze performance, scalability, and capacity performance issues in Big Data Platforms.

  • Ability to clearly distinguish system and Spark Job performances and perform spark performance tuning and resource optimization.

  • Perform benchmarking/stress tests and document the best practices for different applications.

  • Proactively work with tenants on improving the overall performance and ensure the system is resilient, and scalable.

  • Good understanding of Virtualization & Containerization; must demonstrate experience in technologies such as Kubernetes, Istio, Docker, OpenShift, Anthos, Oracle VirtualBox, Vagrant, etc.

  • Well-versed with demonstrable working experience with API Management, API Gateway, Service Mesh, Identity & Access Management, Data Protection & Encryption.

    Hands-on experience with demonstrable working experience with DevOps tools and platforms viz., Jira, GIT, Jenkins, Code Quality & Security Plugins, Maven, Artifactory, Terraform, Ansible/Chef/Puppet, Spinnaker, etc.

  • Well-versed in AWS and/or Azure or and/or Google Cloud; must demonstrate experience in at least FIVE (5) services offered under AWS and/or Azure or and/or Google Cloud in any categories: Compute or Storage, Database, Networking & Content Delivery, Management & Governance, Analytics, Security, Identity, & Compliance (or) equivalent demonstrable Cloud Platform experience.

  • Good understanding of Storage, Networks and Storage Networking basics which will enable you to work in a Cloud environment.

  • Good understanding of Network, Data, and Application Security basics which will enable you to work in a Cloud as well as Business Applications / API services environment.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Nebula Tech
Nebula Tech
Agency job
via TIGI HR Solution Pvt. Ltd. by Vaidehi Sarkar
Ahmedabad
7 - 10 yrs
₹12L - ₹15L / yr
skill iconReact.js
skill iconPHP
skill iconLaravel
Symfony
skill iconMongoDB
+6 more

Job Title: Senior PHP & React.js Developer

Experience Required: 7+ Years

Location: Ahmedabad

Employment Type: Full-Time


Required Skills & Qualifications:

  • 7+ years of professional experience in full-stack development.
  • Strong proficiency in PHP and at least one modern PHP framework. 
  • Solid experience with JavaScript, HTML5, CSS3, and React.js (Hooks, Context API, Redux, etc.).
  • Experience building and consuming RESTful APIs.
  • Proficiency in database technologies such as MySQL, PostgreSQL, or MongoDB.
  • Familiarity with version control systems like Git, Bitbucket. 
  • Experience with CI/CD pipelines and automated testing is a plus.
  • Strong problem-solving skills and attention to detail.
  • Excellent communication and collaboration skills.


Read more
CropData Technology Pvt Ltd
Reena D
Posted by Reena D
Remote only
5 - 10 yrs
₹15L - ₹20L / yr
skill iconSpring Boot
RESTful APIs
Microservices
skill iconJava
Apache Kafka
+6 more

Job Description:

Engage in code design, testing, integration, deployment, and enhancements

Write high-quality code and take responsibility for tasks

Solve performance bottlenecks

Communicate and collaborate with product manager, QA, and UI/UX teams

Deliver with quality, on-time in a fast-paced start-up environment

Have a strong sense of code quality


Candidate Profile:

Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)

At least 5+ years of relevant experience as a back-end engineer

Excellent Java and object-oriented development skills

Experience in building and scaling microservices

Strong problem-solving skills, technical troubleshooting, and diagnosing

Solid knowledge of RDBMS and NoSQL technologies

Experience in developing back-ends for enterprise systems

Knowledge of debugging performance and optimization techniques

Experience in Java, Mongo, MySQL, AWS technologies, ELK stack, Spring boot, Kafka

Good knowledge of cloud technologies eg. AWS

Demonstrated ability to deliver in a fast-paced environment

Read more
Convene India Pvt Ltd
at Convene India Pvt Ltd
1 recruiter
Nisha Lachwani
Posted by Nisha Lachwani
Noida, Delhi, Gurugram, Ghaziabad, Faridabad
1 - 3 yrs
₹5L - ₹9L / yr
skill iconJava
J2EE
Data Structures
Algorithms
skill iconScala
+4 more
About Company: Convene India Private Limited is a subsidiary of Azeus Systems Holdings (Azeus). Azeus was built by some of the brightest minds in the field of information technology. Starting out with just a core team of three individuals led by an MIT alumnus, it has now evolved into one of the most dynamic and promising organizations with over 300 professionals across its global offices in the UK, US, Malaysia, Canada, Australia, India, the Middle East, South Africa, the Philippines and Hong Kong to name a few. We are one of the first 30 companies worldwide to achieve CMMI Level 5 status a distinction shared with institutions such as the US Air Force, Boeing and contractors for the US Department of National Defense.

Responsibilities:

- Programming
- Full stack system development
- Product Design
- Technical risk assessment and estimation
- Technical investigation/research, assessment, and recommendation
- Providing solutions and preparing proof-of-concept for technical proposals and demonstrations
- Product maintenance and support

Qualifications:

- Bachelor's degree in computer science, Computer Engineering, or any course related to Information Technology, Engineering and Mathematics
- Ability to execute full software development life cycle (SDLC)
- 1+ year experience in product development
- 1+ years Java development experience
- 1+ year experience in agile product development methodology/process
- Develop flowcharts, layouts, and documentation to identify requirements and solutions
- Experience of relational databases, SQL / MySql / PL SQL / Oracle
- Experience in JAVA Frameworks (Spring / Spring MVC / Spring boot / Hibernate)
- Integrate software components into a fully functional software system
- Develop software verification plans and quality assurance procedures
- Document and maintain software functionality
- Troubleshoot, debug and upgrade existing systems
- Experience in Unit testing is a plus

Knowledge in:

- JavaScript / ES6 / JavaScript Reactive Framework (Vue.js / java servlets is a huge plus)
- REST Concepts
- VCS - Git
- AWS
- Excellent programming and problem-solving skills
- Experience with test-driven development
- Good communication skills
- Fast learner, detail-oriented
- Able to work under pressure
- Self-managing and able to collaborate with offsite team members
- Can render extra hours whenever necessary.

Training

After a rigorous training program of up to one month, you'll immediately get to work on one of our projects. We're working on mission-critical government systems or commercial products that are levelling up the way the world does business.
Read more
The company is located in Bangalore.
The company is located in Bangalore.
Agency job
Bengaluru (Bangalore)
3 - 5 yrs
₹3L - ₹11L / yr
skill iconJava
skill iconSpring Boot
Hibernate (Java)

Technical Skills:

  • Enterprise: Java, J2EE, Microservices
  • OS: Linux
  • Database: Oracle, Postgres
  • Networking, Multithreading, Socket programming
  • Technologies: Struct, Spring, Spring-boot, Hibernate, Hibernate, Event sourcing
  • Worked in RESTFul APIs, security and security-related areas especially where financial transactions are involved

Good to Know: ● Docker ● Jenkins ● CI/CD

 

Additional requirements:

  • Strong work ethics, Disciplined, Value-driven, honest, respectful, honours commitment
  • Has startup experience or willing to work in small companies
  • Has knowledge/experience on the latest trends and technologies
  • Has Github profile with own projects
  • Participate in stack overflow, open source etc
  • Has their own blog
  • Excellent communication skills
  • Extraordinary problem-solving skills
  • Having standout/unique resume layout/design
Read more
A top MNC in Pune.
A top MNC in Pune.
Agency job
via Jobdost by Riya Roy
Remote, Pune
3 - 8 yrs
₹7L - ₹15L / yr
skill iconPython
skill iconDjango
skill iconJavascript
skill iconFlask
NOSQL Databases
+4 more

The key aspects of this role include:


• Design, build, and maintain scalable applications using Python.
• Contribute to the entire implementation process including driving the definition of improvements
based on business need and architectural improvements.
• Act as a subject matter expert for Application Software developers and Engineers.
• Handle server-side code for a production platform and contribute to new features.


To be the right fit, you'll need:
• More than 4+ years of experience as a software developer in Python, with knowledge of at least one
Python web framework such as Django, Flask, etc.
• Good understanding of common design patterns and architecture principles to design reliable and
Scalable applications
• Strong communication skills
• Knowledge of databases line NoSQL or MongoDB
• Good to have AWS and Docker or Web services
• Basic understanding of front-end technologies, such as JavaScript, HTML5, and CSS3

Read more
NIRA
at NIRA
1 recruiter
Nupur Gupta
Posted by Nupur Gupta
Bengaluru (Bangalore)
4 - 7 yrs
₹20L - ₹30L / yr
skill iconJava
AWS Lambda
skill iconAmazon Web Services (AWS)
DynamoDB
skill iconAndroid Development
NIRA is a new fintech venture, on a mission for financial inclusion. Our vision is a world where everyone can get access to credit in a manner that is fast, frictionless and fair. This statement of intent guides all our decisions and strategy. We are planning to launch in Q1 2018. Currently, only 10% of Indians can use banks when they need credit: banks typically require a high credit score or collateral, something most people don't have. It need not be this way. Using a combination of traditional data and the vast amount of digital data available, it is now possible to score the unscored. We want to reimagine the way loans are underwritten and bring access to credit to millions of underbanked in India. We can economically empower them to have greater control of their lives and provide downside protection in difficult times. We are addressing head-on a big challenge. It's also a great opportunity from both a commercial and societal impact perspective. We can improve lives for millions. It is no exaggeration to say that our addressable market will be 400mm within 5 years. It's pretty exciting we think. If our mission resonates with you, and you are a talented and hardworking individual that wants to commit yourself to an incredible yet surmountable challenge, then we want to hear from you. You'll work closely with the founders and share the responsibility to ensure the alignment of the technology strategy with the long term goals of the business. Within a small team of engineers, you'll facilitate the in house migration of product from software development partners, while managing business continuity during the launch phase. Roles & responsibilities: *Execute lean and fast experiments on a serverless microservices architecture *Understand the first product that has been built *Build new features in the existing product and launch new products *Contribute to instating the early internal security policies *Contribute in building the initial data infrastructure to process and consume the growing streams of data *Contribute to hiring and engineering team building efforts Skills & Qualifications: *Strong experience with Java *Experience with Android SDK gained while building and scaling mobile consumer products *1-2 years of experience in software development on AWS Lambda and NoSQL databases *Familiarity with AWS products - EC2, DynamoDB, S3, EMR etc *Familiarity with multiple layers of infrastructure and application stack - UI, application layer, database *Comfortable dealing with operational aspects like reporting, and infrastructure sizing *Be excited about the power of technology to transform finance for the better! Other keywords to help you find the job: fintech, India, social impact, early stage, lead engineer, senior engineer, Android engineer, Java engineer, consumer credit, startup
Read more
digital business enablememt company
digital business enablememt company
Agency job
via Explorer by Pallavi Karnatake
Pune
5 - 12 yrs
₹10L - ₹40L / yr
skill iconJava
J2EE
Struts
Spring
Hibernate (Java)
+1 more
Skill Required:

Java/ Core Java
Frames works: Springboot
Web Services: REST API
Spring stack: Spring integration, Jersey, Spring boot, annotations based Spring configuration, Spring Data
Micro services – Must have

Roles & Responsibility:

Requirement gathering & understanding, effort estimation, technical design, project planning and monitoring in Agile environment
Work proactively & independently to address project requirements, and articulate issues/challenges with enough lead time to address project delivery risks
Providing expertise in technical analysis and solving technical issues during project delivery
Customer interfacing - understand customer requirements, propose technical solutions
Full Software Development Lifecycle (Agile)
Code reviews, test case reviews and ensure code developed meets the requirements
Component Design/ Coding/ Unit Testing/ Debugging / Test Driven Development / Continuous Integration
Carry out adaptive changes necessitated by changes in Business Requirements and Technology
Read more
Dremio
at Dremio
4 recruiters
Kiran B
Posted by Kiran B
Hyderabad, Bengaluru (Bangalore)
15 - 20 yrs
Best in industry
skill iconJava
Data Structures
Algorithms
Multithreading
Problem solving
+7 more

About the Role

The Dremio India team owns the DataLake Engine along with Cloud Infrastructure and services that power it. With focus on next generation data analytics supporting modern table formats like Iceberg, Deltalake, and open source initiatives such as Apache Arrow, Project Nessie and hybrid-cloud infrastructure, this team provides various opportunities to learn, deliver, and grow in career. We are looking for technical leaders with passion and experience in architecting and delivering high-quality distributed systems at massive scale.

Responsibilities & ownership

  • Lead end-to-end delivery and customer success of next-generation features related to scalability, reliability, robustness, usability, security, and performance of the product
  • Lead and mentor others about concurrency, parallelization to deliver scalability, performance and resource optimization in a multithreaded and distributed environment
  • Propose and promote strategic company-wide tech investments taking care of business goals, customer requirements, and industry standards
  • Lead the team to solve complex, unknown and ambiguous problems, and customer issues cutting across team and module boundaries with technical expertise, and influence others
  • Review and influence designs of other team members 
  • Design and deliver architectures that run optimally on public clouds like GCP, AWS, and Azure
  • Partner with other leaders to nurture innovation and engineering excellence in the team
  • Drive priorities with others to facilitate timely accomplishments of business objectives
  • Perform RCA of customer issues and drive investments to avoid similar issues in future
  • Collaborate with Product Management, Support, and field teams to ensure that customers are successful with Dremio
  • Proactively suggest learning opportunities about new technology and skills, and be a role model for constant learning and growth

Requirements

  • B.S./M.S/Equivalent in Computer Science or a related technical field or equivalent experience
  • Fluency in Java/C++ with 15+ years of experience developing production-level software
  • Strong foundation in data structures, algorithms, multi-threaded and asynchronous programming models and their use in developing distributed and scalable systems
  • 8+ years experience in developing complex and scalable distributed systems and delivering, deploying, and managing microservices successfully
  • Subject Matter Expert in one or more of query processing or optimization, distributed systems, concurrency, micro service based architectures, data replication, networking, storage systems
  • Experience in taking company-wide initiatives, convincing stakeholders, and delivering them
  • Expert in solving complex, unknown and ambiguous problems spanning across teams and taking initiative in planning and delivering them with high quality
  • Ability to anticipate and propose plan/design changes based on changing requirements 
  • Passion for quality, zero downtime upgrades, availability, resiliency, and uptime of the platform
  • Passion for learning and delivering using latest technologies
  • Hands-on experience of working projects on AWS, Azure, and GCP 
  • Experience with containers and Kubernetes for orchestration and container management in private and public clouds (AWS, Azure,  and GCP) 
  • Understanding of distributed file systems such as  S3, ADLS or HDFS
  • Excellent communication skills and affinity for collaboration and teamwork

 

Read more
Finsall Resources Pvt. Ltd.
Prabal Khanna
Posted by Prabal Khanna
Bengaluru (Bangalore)
6 - 9 yrs
₹5L - ₹10L / yr
skill iconJava
skill iconSpring Boot
Hibernate (Java)
skill iconAmazon Web Services (AWS)
MVC Framework
+5 more
Looking for 6+ years of hands-on development experience using Core Java, J2ee, Spring / Hibernate, Web Services, Spring- Boot, MVC, Security and Postgres/ MS SQL Server.

1. Technical skills include Java/JDK 6 and above, web services SOAP, REST, Micro Webservice, XML Parsing and schema design skills, JDBC, ORM, Multi-Threading.

2. Hands-on experience in design (HLD/LLD) and design patterns and Design principles is mandatory.

3. Excellent communication and client handling skills are required.

4. Server-side component design, detailed technical design, development, implementation and maintenance

5. In depth knowledge of core java. Solid on coding fundamentals e.g. Object-Oriented design, data structures and dependency injection

6. Hands-on experience in widely used third party frameworks (e.g. Spring, Hibernate)

7. Experience with Java Script framework like EXTJS, Jquery , Angular etc.

8. Strong background Object Oriented analysis and design

9. Hands on experience with Databases technologies preferably MS SQL Server.

10.Knowledge of deployment platforms Jboss/ Wildfly/Tomcat.

11.Experience working in high performing development teams using Agile/Scrum methodologies and tools (eg.Agile,Jira)

12 Experience with automated code review tools and build process.

13.Experience in performance optimization by code optimization, profiling, detecting bottle neck and finding contended locks in system

14.Proven track record of being a successful developer and lead and mentor by accomplishing tasks on schedule with strong initiative, commitment to quality, team blending and leadership skills.

15.The candidate must be highly self-motivated confident and mature, well developed analytical and problem-solving skills with the aptitude to learn as well as a flexibility to adapt to change.

16. Candidate should have worked on end-to-end life cycle of the project (ideation to go-live)

The right candidate will be offered ESOPs as well in their compensation.
Read more
Pion Global Solutions LTD
Anudeep G
Posted by Anudeep G
Chennai
4 - 10 yrs
₹8L - ₹20L / yr
skill iconPython
skill iconDjango
skill iconJava
skill iconJavascript
Experience in developing commercial software using Python, Java script, or Java.  Working knowledge of object-oriented programming and/or functional programming paradigms.  Good understanding of Algorithms and Data Structures.  Should have valid US B1 Visa, and be willing to travel in a weeks’ time to US  Expected to be in US for a week for the training;  Experience: 4 – 8 years
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos