Cutshort logo
Technology service company logo
Sr. Spark Software Engineer
Sr. Spark Software Engineer
Technology service company's logo

Sr. Spark Software Engineer

Agency job
5 - 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Ansible
skill iconGit
JIRA
Apache Spark
Spark
Apache Kafka
Microservices
skill iconKubernetes
Terraform
NOSQL Databases
API
skill iconDocker
  • Bachelor’s or master’s degree in Computer Engineering, Computer Science, Computer Applications, Mathematics, Statistics, or related technical field. Relevant experience of at least 3 years in lieu of above if from a different stream of education.

  • Well-versed in and 3+ hands-on demonstrable experience with: ▪ Stream & Batch Big Data Pipeline Processing using Apache Spark and/or Apache Flink.
    ▪ Distributed Cloud Native Computing including Server less Functions
    ▪ Relational, Object Store, Document, Graph, etc. Database Design & Implementation
    ▪ Micro services Architecture, API Modeling, Design, & Programming

  • 3+ years of hands-on development experience in Apache Spark using Scala and/or Java.

  • Ability to write executable code for Services using Spark RDD, Spark SQL, Structured Streaming, Spark MLLib, etc. with deep technical understanding of Spark Processing Framework.

  • In-depth knowledge of standard programming languages such as Scala and/or Java.

  • 3+ years of hands-on development experience in one or more libraries & frameworks such as Apache Kafka, Akka, Apache Storm, Apache Nifi, Zookeeper, Hadoop ecosystem (i.e., HDFS, YARN, MapReduce, Oozie & Hive), etc.; extra points if you can demonstrate your knowledge with working examples.

  • 3+ years of hands-on development experience in one or more Relational and NoSQL datastores such as PostgreSQL, Cassandra, HBase, MongoDB, DynamoDB, Elastic Search, Neo4J, etc.

  • Practical knowledge of distributed systems involving partitioning, bucketing, CAP theorem, replication, horizontal scaling, etc.

  • Passion for distilling large volumes of data, analyze performance, scalability, and capacity performance issues in Big Data Platforms.

  • Ability to clearly distinguish system and Spark Job performances and perform spark performance tuning and resource optimization.

  • Perform benchmarking/stress tests and document the best practices for different applications.

  • Proactively work with tenants on improving the overall performance and ensure the system is resilient, and scalable.

  • Good understanding of Virtualization & Containerization; must demonstrate experience in technologies such as Kubernetes, Istio, Docker, OpenShift, Anthos, Oracle VirtualBox, Vagrant, etc.

  • Well-versed with demonstrable working experience with API Management, API Gateway, Service Mesh, Identity & Access Management, Data Protection & Encryption.

    Hands-on experience with demonstrable working experience with DevOps tools and platforms viz., Jira, GIT, Jenkins, Code Quality & Security Plugins, Maven, Artifactory, Terraform, Ansible/Chef/Puppet, Spinnaker, etc.

  • Well-versed in AWS and/or Azure or and/or Google Cloud; must demonstrate experience in at least FIVE (5) services offered under AWS and/or Azure or and/or Google Cloud in any categories: Compute or Storage, Database, Networking & Content Delivery, Management & Governance, Analytics, Security, Identity, & Compliance (or) equivalent demonstrable Cloud Platform experience.

  • Good understanding of Storage, Networks and Storage Networking basics which will enable you to work in a Cloud environment.

  • Good understanding of Network, Data, and Application Security basics which will enable you to work in a Cloud as well as Business Applications / API services environment.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos

About Technology service company

Founded
Type
Size
Stage
About
N/A
Company social profiles
N/A

Similar jobs

Hyderabad
2 - 6 yrs
₹7L - ₹20L / yr
Apache Kafka
skill iconJava
skill iconSpring Boot
Hibernate (Java)
Spring
+3 more
MUST HAVE : 
  • Proven experience in any high-level programming languages like Java (Preferably)
  • Strong knowledge of data structure, algorithms and coding
  • Experience with any Messaging technologies like Kafka or Rab-bitMQ, etc.
  • Proven experience in database technologies like NoSQL
  • Hands-on experience with Spring, Spring Security, Spring boot, and Hibernate framework.
  • Working knowledge of developing Restful Micro services.
  • Strong analytical, problem-solving skills.
  • Attend team meetings to discuss projects, brainstorm ideas, and put forward solutions to any issues.
  • Ability to understand the Platform/domain of the business in detail & Ability to multi-task.
  • Good communication and organizational skill
Read more
Concentric AI
at Concentric AI
7 candid answers
1 product
Gopal Agarwal
Posted by Gopal Agarwal
Pune
3 - 12 yrs
₹10L - ₹60L / yr
skill iconJava
skill iconSpring Boot
Apache Kafka
NOSQL Databases
RESTful APIs
+1 more

Requirements:

  • Energetic self-starter, with a desire to work in a startup environment.
  • Proficient in advanced Java programming skills.
  • Expert in Application development cloud/on premise end to end. Middle layer, DB layer.
  • Nice to have understanding on MQ and DB
  • Good hands on in Complex Event Processing systems.
  • Solved scale and performance issues while dealing with huge sets of data. Pre compute or data aggregation frameworks to achieve good response time.
  • Real world experience working with large datasets and NoSQL database technologies
  • Experience of debugging applications running on Unix like systems (e.g. Ubuntu, CentOS)
  • Experience developing RESTful APIs for complex data sets
  • Knowledge of container based development & deployment (e.g. Dockers, rkt)
  • Expertise in software security domain, a plus


Read more
Milestone Technologies Inc
Lavanya Muthum
Posted by Lavanya Muthum
Remote only
3 - 6 yrs
₹15L - ₹27L / yr
skill iconPython
skill iconDjango
skill iconFlask
skill iconXML
skill iconJava
What will you need to succeed 
  • Working knowledge of XML, JAVA, REST, SOAP etc
  • Basic knowledge of SQL, including the ability to author ad-hoc database queries.
  • Is comfortable writing code in Ruby, Python, JavaScript, and Java and enjoys learning new languages and technologies.
  • Has experience integrating  APIs (major plus)
  • Experienced integrating RESTful APIs into web applications (a plus)
  • Is experienced with Github or the likes.
  • Should have worked on Payment Gateway Applications.
  • Has a technical degree in Computer Science, Engineering or Mathematics (MBA is an asset)
  • Technical Product/Software certifications an asset
  • Has 3 to 5 years of experience in a similar client-facing role
  • Has previous experience in a traditional software engineering or Implementation role.
  • Has strong analytical and debugging skills.
  • Experienced with Salesforce is a plus
  • Solution-driven, able to grasp new concepts quickly and efficiently, able to work alone or in a team, able to work with no supervision and under pressure
  • Excels in a collaborative and cross-functional environment.
  • Demonstrates professional communication skills on technical and business-related subjects
  • Experience working with payment gateways a major plus including ecommerce and Retail Experience with continuous integration and test-driven development methodologies a plus
  • Excellent time management, organization, and planning skills are essential
  • Flexibility to travel as required to meet with clients
  • Ability to comprehend and translate complex technical issues and apply to business solutions
  • Demonstrate ability to articulate complex technical terms or processes into business language
  • Ability to synthesize technical information and apply to business solutions
  • Able to set priorities, influence others, and manage customer and partner expectations
  • Demonstrated success in customer and partner relationship management
  • You are motivated, think outside of the box, and understand the purpose of process and procedures
Read more
Everest Engineering
at Everest Engineering
1 video
4 recruiters
Rijuthaa Kanagaraj
Posted by Rijuthaa Kanagaraj
Remote only
5 - 8 yrs
₹17L - ₹25L / yr
skill iconJava
J2EE
skill iconGo Programming (Golang)
skill iconPython
skill iconAmazon Web Services (AWS)
+8 more
EverestEngineering works with startups to large enterprises solving exciting problems. We use emerging and effective technologies and processes for solving these problems. We provide solutions that are scalable, maintainable, and easy to deploy. 
 
We want our company, EverestEngineering, to be a high-performance team. Part of this is focusing on each other and our clients with an explicit goal of creating a human-centric environment in which we are connected and supported. The other part is focusing on performance, doing the job and doing it well. The following principles and practices help us act together; read them and work on mastering them. 

“One of the most important things is helping you to be yourself without being judged.” While this can be achieved in many ways, we believe in being a people first organization. One of the most important things is helping you to be yourself without being judged. We respect you for who you are.
It does not mean you are always right, or you can do bad work. We believe and strive for better ways of working. We do it with continuous feedback and improvement. We take and provide feedback and that’s how we improve. We have a flexible environment, sustainable pace, and high expectations for learning new technologies. We’ve built a company we truly love working for, and we think you will too. That is part of our culture. If you want to know more about our culture - https://github.com/everest-engineering/manifesto" target="_blank">https://github.com/everest-engineering/manifesto

To see the quality of our code, you can check out some of our open source projects: https://github.com/everest-engineering" target="_blank">https://github.com/everest-engineering

At Everest, we innovate at the intersection of design and engineering to produce outstanding products. The work we do is meaningful and challenging - which makes it interesting. Imagine each line of your code, making the world a better place. We work on five workdays weeks and overtime is a rarity.
This Fullstack JD is for your reference only. We have openings for Frontend and Backend also.
 
  • Can write reliable, scalable, testable and maintainable code.

  • Familiarity with Agile methodologies and clean code.

  • Design and/or contribute to client-side and server-side architecture.

  • Well versed with fundamentals of REST.

  • Knowledge of one or more front-end languages and libraries (e.g. HTML / CSS, JavaScript, XML, jQuery, Typescript) JavaScript frameworks (e.g. Angular, React, Redux, Vue.js)

  • Knowledge of one or more back-end languages (e.g. C#, Java, Python, Go, Node.js and frameworks like SpringBoot, .NET Core) 

  • Well versed with fundamentals of database design.

  • Familiarity with databases - RDBMS like MySQL, Postgres & NoSQL like MongoDB, DynamoDB.

  • Well versed with one or more cloud platforms like - AWS, Azure, GCP.

  • Familiar with Infrastructure as Code - CloudFormation & Terraform & deployment tools like Docker, Kubernetes.

  • Familiarity with CI/CD tools like Jenkins, CircleCI, Github Actions.

  • Unit testing tools like Junit, Mockito, Chai, Mocha, Jest

Read more
Mobile Programming India Pvt Ltd
at Mobile Programming India Pvt Ltd
1 video
17 recruiters
Ankit Sharma
Posted by Ankit Sharma
Remote only
3 - 7 yrs
₹10L - ₹15L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Microservices
+2 more

Job Requirements :

 

- 4+ years of Java development experience

 

- 4+ years of microservice development experience with Spring boot framework

 

- Core & Advanced Java (Threading, Design Patterns, Data Structures) J2EE, REST web services

 

- Excellent knowledge of Enterprise Design Patterns

 

- Full stack development with Angular 8 experience will be a plus

 

- Experience with test driven software development

 

- Exposure to telecom domain

 

- ETOM/ SID which make the TM Forum framework

Read more
Whitesnow Software Consultancy Pune
Rohan Navale
Posted by Rohan Navale
Pune
3 - 9 yrs
₹4L - ₹8L / yr
skill iconPython
skill iconDjango
skill icon.NET
skill iconJava
skill iconAngularJS (1.x)
  • Hands-on experience in backend programming languages.
  • Experience in Python 3.X & Django is a must. Knowledge of .NET, Java, PHP is an added advantage.
  • Hands-on experience in front-end technologies like Angular, jQuery, JavaScript, HTML, CSS, SCSS, etc.
  • Experience with leading technical teams and acting as a technical mentor.
  • Experience in client communication & reporting to the client-side management team.
  • Experience in AWS is an added advantage.
Read more
Ahmedabad
3 - 12 yrs
₹5L - ₹12L / yr
ASP.NET
skill iconC#
skill icon.NET
Windows Azure
AWS CloudFormation
+6 more

Rules & Responsibilities:

Technical Skills:

  1. .Net– Net, C#, .Net core, MVC, Framework, Web API, Web Services, Micro Service and SQL
  2. Azure – Azure Cloud, SaaS, PaaS, IaaS, Azure Relational, and No-SQL Database, Big Data Services

Responsibilities

  • Good understanding of and experience in working on Microsoft Azure (IAAS/PAAS/SAAS)
  • Ability to architect, design, and implement cloud-based solutions
  • Proven track record of designing and implement the IoT-based solutions/Big Data solutions/applications to the Azure cloud platform.
  • Experience in building .Net-based enterprise distributed solutions in Windows and Linux.
  • Experience in using CI and CD tools. Jenkins/ Azure pipeline and Terraform. Experience in using another tooling such as Ansible, CloudFormation, etc.
  • Good understanding of HA/DR Setups in Cloud
  • Experience and working knowledge of Virtualization, Networking, Data Center, and Security
  • Deep hands-on experience in the design, development, and deployment of business software at scale.
  • Strong hands-on experience in Azure Cloud Platform
  • Experience in Kubernetes, Docker, and other cloud deployment, container technologies
  • Experience / knowledge of other cloud offerings (e.g. AWS, GCP) will be added advantage
  • Experience with monitoring tools like Prometheus, Grafana, Datadog, etc.
Read more
SmartDocs
at SmartDocs
4 recruiters
Ananda Bala
Posted by Ananda Bala
Hyderabad
3 - 6 yrs
₹6L - ₹12L / yr
skill iconJava
J2EE
Spring
skill iconJavascript
skill iconMongoDB
+3 more
Are you a fun loving and passionate to be a part of Global Innovator team? Are you planning to grow your career, which enhance your skills in technology? A career at SmartDocs can open many doors for you in the world of technology. If you are looking for a company that is dedicated to your ideas, recognizes you for your unique competency & contributions and provides a fun, flexible and delightful work atmosphere. Then, we are the right place to ignite your passion. We are totally committed about our employees, our Clients & Customers, our work culture and especially our technology. We are an organization who encourages new ideas of employees through collaboration and creativity. We are seeking for a dedicated individual to join SmartDocs Business Solutions. The candidate will work with the product development team and must be a subject matter expert in-order to deliver the best practices; an ideal candidate must possess excellent business skills with outstanding communication, professionalism & leadership and must have minimum 3 - 6 years of experience in JAVA as a full stack developer. Desirable Skills & Expertise:  Minimum 3 – 6 years of experience as a full stack developer (Preferable from product based entity). At least a year of experience in managing a team is mandatory.  Master’s or bachelor’s degree in Engineering (CSE / IT / MCA / Software) are preferred.  Work exp. in Java, Frame-works like : Spring, Spring boot; J2EE technologies like Servlets, JSP and Web Application Server is mandatory.  Strong skills in HTML, Java Script, XML, CSS and Mango DB (Optional).  Product development in Linux environment is an added advantage.  Possesses intellectual humility; smart, driven, creative and able to learn things from slipups, willing to raise others up.  Excellent Communication & Analytical skills with integrated professionalism at all levels. Key Responsibilities:  The role is responsible for designing, coding and deploying of high-performance applications.  Deep expertise and hands on experience as a Core JAVA Developer.  Team Management, Excellent interpersonal, Communication and effective organizational skills and solid technical skills.  Should be able to communicate effectively with both technical and non-technical personnel.  Excellent trouble shootings & problem-solving skills.  Experience with SDLC from requirement analysis through testing and deployment.  Must be an expert in technologies like J2EE, JSP, Servlets, Web Application, HTML, Java Script, XML, CSS, Mango DB and JAVA frameworks – Spring boot.  Develop and maintain strong product knowledge.  Guide the clients through various stages of the project and transition to support organization.  Review existing business processes and participate in the Process Improvement Program. SmartDocs, provides equal employment opportunity to all its employees and all qualified applicants for employment without regard to their race, caste, religion, color, ancestry, marital status, gender, sexual orientation, age, nationality, ethnic origin or disability. Our resource policies shall promote diversity and equality in the workplace while encouraging the adoption of international best practices.
Read more
Diligent Force Labs Pvt Ltd
anusha padamata
Posted by anusha padamata
Rajahmundry
1 - 3 yrs
₹2L - ₹3L / yr
skill iconJava
skill iconC++
Data Structures
Algorithms
skill iconScala
+3 more

Immediate Interviewing for Developer for Rajahmundry  Location.

Job Description:

1+ Years Experience on software development on any software language.

Experience with software design and development in a test-driven environment

Knowledge of coding languages (e.g. C++, Java, JavaScript) and frameworks/systems (e.g. AngularJS, Git)

Ability to learn new languages and technologies

Problem-solving aptitude

Excellent communication and presentation skills

Read more
Porter.in
at Porter.in
1 recruiter
Zeba Malik
Posted by Zeba Malik
Bengaluru (Bangalore)
3 - 7 yrs
₹12L - ₹20L / yr
skill iconRuby on Rails (ROR)
skill iconJava
skill iconKotlin
skill iconJavascript
Technical Overview
 You will be expected to design, develop and maintain large-scale complex backend web
applications.
 You will be expected to rapidly learn and apply relevant new technologies.
 You will be having a high level of interaction with business and product stakeholders.
 You will be working on the entire web application stack, which includes:
o Web server hosting
o RESTful communication
o Message brokering
o Backend application layer, which includes the service and domain layers
o Data layer for persistence or caching
 You will be participating in an agile software development cycle, which includes:
o Design
o Development
o Code Review
o Unit and Integration Testing
o Release
 As a senior developer, you will be expected to contribute to design, code review, refactoring, and
project management.
 You will be exposed to the following technologies:
o Web application frameworks: Ruby on Rails, Node.js, Java Play, Vert.x, AIOHTTP, AWS
Lambda
o Languages: Ruby, Java, Kotlin, Javascript, Python
o Data stores: PostgreSQL, Aerospike, Redis, Amazon Redshift
o Communication: HTTP, Amazon SQS, Sidekiq, Amazon SNS
o Server Management: Amazon ECS, Docker

Product Overview
 You will be contributing to products concerning both customers and partner drivers.
 Product sectors include:
o Growth: You’ll build tools to help boost user growth on the platform including our industry
best driver on-boarding, training and certification system, referral system, and lead
management models.
o Lifecycle Management:  Build tools to help users engage with the platform better, which
includes rewards and recognition module, subscription service, account management tools,
partner and customer wallets and payout modules, and churn detection systems among
others.
o Transaction Experience: You’ll help deliver the most delightful booking experience to our
customers and drivers. As part of this team, you’ll be responsible for our core booking
system, pricing and payment systems, location tracking and filtering services, fraud
prevention systems, and in-app ticketing and support among others.
o Fulfilment: As part of the fulfilment team, you’ll work on systems which ensure high degree
of ride fulfilment on the platform. Tools including allocation methodologies and system,
dynamic pricing, dynamic partner routing, and partner re-activation tools among others.
o Enterprise Solutions: You’ll help Porter’s enterprise customers achieve delivery excellence.
You’ll build tools for contract management, fleet management, fleet and route optimisation
tools, alerting and monitoring tools, and analytics suite among others.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos