Cutshort logo
Technology service company logo
Sr. Spark Software Engineer
Technology service company
Sr. Spark Software Engineer
Technology service company's logo

Sr. Spark Software Engineer

at Technology service company

Agency job
5 - 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Ansible
skill iconGit
JIRA
Apache Spark
Spark
Apache Kafka
Microservices
skill iconKubernetes
Terraform
NOSQL Databases
API
skill iconDocker
  • Bachelor’s or master’s degree in Computer Engineering, Computer Science, Computer Applications, Mathematics, Statistics, or related technical field. Relevant experience of at least 3 years in lieu of above if from a different stream of education.

  • Well-versed in and 3+ hands-on demonstrable experience with: ▪ Stream & Batch Big Data Pipeline Processing using Apache Spark and/or Apache Flink.
    ▪ Distributed Cloud Native Computing including Server less Functions
    ▪ Relational, Object Store, Document, Graph, etc. Database Design & Implementation
    ▪ Micro services Architecture, API Modeling, Design, & Programming

  • 3+ years of hands-on development experience in Apache Spark using Scala and/or Java.

  • Ability to write executable code for Services using Spark RDD, Spark SQL, Structured Streaming, Spark MLLib, etc. with deep technical understanding of Spark Processing Framework.

  • In-depth knowledge of standard programming languages such as Scala and/or Java.

  • 3+ years of hands-on development experience in one or more libraries & frameworks such as Apache Kafka, Akka, Apache Storm, Apache Nifi, Zookeeper, Hadoop ecosystem (i.e., HDFS, YARN, MapReduce, Oozie & Hive), etc.; extra points if you can demonstrate your knowledge with working examples.

  • 3+ years of hands-on development experience in one or more Relational and NoSQL datastores such as PostgreSQL, Cassandra, HBase, MongoDB, DynamoDB, Elastic Search, Neo4J, etc.

  • Practical knowledge of distributed systems involving partitioning, bucketing, CAP theorem, replication, horizontal scaling, etc.

  • Passion for distilling large volumes of data, analyze performance, scalability, and capacity performance issues in Big Data Platforms.

  • Ability to clearly distinguish system and Spark Job performances and perform spark performance tuning and resource optimization.

  • Perform benchmarking/stress tests and document the best practices for different applications.

  • Proactively work with tenants on improving the overall performance and ensure the system is resilient, and scalable.

  • Good understanding of Virtualization & Containerization; must demonstrate experience in technologies such as Kubernetes, Istio, Docker, OpenShift, Anthos, Oracle VirtualBox, Vagrant, etc.

  • Well-versed with demonstrable working experience with API Management, API Gateway, Service Mesh, Identity & Access Management, Data Protection & Encryption.

    Hands-on experience with demonstrable working experience with DevOps tools and platforms viz., Jira, GIT, Jenkins, Code Quality & Security Plugins, Maven, Artifactory, Terraform, Ansible/Chef/Puppet, Spinnaker, etc.

  • Well-versed in AWS and/or Azure or and/or Google Cloud; must demonstrate experience in at least FIVE (5) services offered under AWS and/or Azure or and/or Google Cloud in any categories: Compute or Storage, Database, Networking & Content Delivery, Management & Governance, Analytics, Security, Identity, & Compliance (or) equivalent demonstrable Cloud Platform experience.

  • Good understanding of Storage, Networks and Storage Networking basics which will enable you to work in a Cloud environment.

  • Good understanding of Network, Data, and Application Security basics which will enable you to work in a Cloud as well as Business Applications / API services environment.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

a global provider of Business Process Management company
a global provider of Business Process Management company
Agency job
via Jobdost by Saida Jabbar
Bengaluru (Bangalore), Pune
3 - 10 yrs
₹12L - ₹16L / yr
Process automation
RPA
Blueprism
RPAS
skill icon.NET
+3 more

Job Description

  • Design technical specifications for RPA (Blue Prism) that meets the requirements and handled all the non functional requirements of concurrency, scalability, security requirements, restart and recovery.
  • Develops and configures automation processes as per the technical design document to meet the defined requirements. Works on the coding the more complicated automations or reusable components, and delegates and mentors junior developers for the less complex components.
  • Develops new processes/tasks/objects using core workflow principles that are efficient, well structured, maintainable and easy to understand.
  • Complies with and helps to enforce design and coding standards, policies and procedures.
  • Ensures documentation is well maintained.
  • Ensures quality of coded components by performing thorough unit testing.
  • Works collaboratively with test teams during the Product test and UAT phases to fix assigned bugs with quality.
  • Reports status, issues and risks to tech leads on a regular basis
  • Improves skills in automation products by completing automation certification.
  • Mentors junior developers and performs code reviews for quality control.

Qualifications

Bachelor degree in Engineering / Computer Science

Additional Information

  •  5- 8 years of IT experience and having good understanding of programming concepts.  Should be from a programming background on any coding language (.Net, Java).
  • Working experience in RPA for a minimum of 2 years and having project experience of a minimum 3 RPA implementations.
  • Understands development methodology and lifecycle
  • Should be trained on RPA tools (Blue Prism).
  • Self-motivated, team player, action and results oriented.
  • Well organized, good communication and reporting skills.

 

Read more
Next gen email marketing platform startup
Next gen email marketing platform startup
Agency job
via Qrata by Blessy Fernandes
Remote only
2 - 6 yrs
₹15L - ₹35L / yr
skill iconNodeJS (Node.js)
NOSQL Databases

Responsibilities

  • Take product ideas from ideation to implementation
  • Design and develop backend services that expand the capabilities of the product
  • Write high quality, structured application/interface code and tests
  • Lead engineering discussions to ensure the best practices, maintainability and security of the application
  • Participate in design and code reviews

We are looking for

  • 3+ years of experience building quality applications
  • Proficient in Node JS, NoSQL databases
  • Strong working knowledge of Web technologies and APIs
  • Passion for best design and coding practices and a desire to develop new bold ideas
  • Experience in planning, designing architecture and working with teams
  • Experience with SaaS product or an early stage startup is a plus
Read more
Digital and Analytics solutions, ML and AI
Digital and Analytics solutions, ML and AI
Agency job
via Jobdost by Sathish Kumar
Bengaluru (Bangalore)
9 - 12 yrs
₹12L - ₹18L / yr
skill iconJava
skill iconPython
SQL
skill iconSpring Boot
Webservices
+7 more

Job responsibility The Lead Developer contributes, to create a customer’s solution, in the building phase of the software development lifecycle. The Software Engineer is responsible for performing the detailed design of application and technical architecture components and classes in accordance to the specification provided by the Solution Architect, for coding of SW components, and for the early testing phases (component testing), and system testing support

Should have handled and leaded a team of front end and back developer and deliver projects on time.

Hands on experience in Java, Python, scripting
- Design, implement, deploy and support web-based applications and web services using server technologies stacks that include Java, MySQL
- Experience in Java/J2EE using web frameworks Play or Spring boot, REST API Development and ORM (JPA, Hibernate eBean etc.)
- In depth knowledge of Design patterns and Data structures
- Databases - MySQL, Oracle, SQL
- Solid understanding of concepts like Web Services, SOA, REST APIs, Message Queue, Caching, Distributed/Scalable Architecture
- Secure application development best practices, such as OWASP
- Document and maintain all design documents and involve in review process.
- Experienced problem solving and debugging skills.
- Good verbal and written communication and interpersonal skills
- Experience in Agile methodology is added advantage
- Knowledge of Cloud Knowledge /Azure
- Must know about Unix knowledge
- experience in Elastic search

 

Read more
Egnyte
at Egnyte
4 recruiters
Prasanth Mulleti
Posted by Prasanth Mulleti
Remote, Mumbai
5 - 10 yrs
Best in industry
skill iconPython
skill iconGo Programming (Golang)
Distributed Systems
Scalability
DevOps
+5 more
Job Description

As our company continues to grow, we’re looking for a Software Engineer to contribute to our cloud migration solutions that enable enterprise customers’ journey to the cloud, and lifecycle of their data in the cloud.

In This Role, You Will (But Not Limited To)
  • End-to-end ownership of new feature development, from design, through implementation, testing, deployment, and maintenance in production
  • Translating of high-level requirements and end-user use cases into design proposals, including integration with external services and constraints of underlying service infrastructure
  • Maintaining constant focus on scalability, performance and robustness of a feature, on the top of base functional implementation
  • Designing and implementing logging, monitoring and alerting functions as core parts of overall software solution
  • Documenting your own work and design solutions
  • Decomposing complex features into smaller, short-term deliverable tasks
  • Managing priorities of multiple tasks, providing up-to-date estimates for a milestone delivery
The Successful Candidate Needs To Demonstrate
  • 5+ of industry experience in technical leadership roles
  • Solid knowledge of Go-Lang, Python, C/C++, SQL, shell scripting and Linux operating environment.
  • End-to-end experience in design and development of highly scalable enterprise and cloud data products.
  • Ability to challenge and redefine existing architectural fundamentals in order to provide next level of performance and scalability; ability to foresee post-deployment challenges.
  • Hands-on experience with design and troubleshooting of scalable web services, advanced file systems, geographic replication, distributed databases and modern operating systems.
  • Experience with modern DevOps technologies such as Docker and container orchestration, service deployment, monitoring and scaling
  • Ability to work with multi-cultural, globally distributed teams to a common unifying product vision and closely coordinate with cross-functional teams in different time-zones.
  • Passion to deliver enterprise-grade products to customers and to continuously work with engineering team to refine the product in the field.
About Egnyte

In a content critical age, Egnyte fuels business growth by enabling content-rich business processes, while also providing organizations with visibility and control over their content assets. Egnyte’s cloud-native content services platform leverages the industry’s leading content intelligence engine to deliver a simple, secure, and vendor-neutral foundation for managing enterprise content across business applications and storage repositories. More than 16,000 customers trust Egnyte to enhance employee productivity, automate data management, and reduce file-sharing cost and complexity. Investors include Google Ventures, Kleiner Perkins, Caufield & Byers, and Goldman Sachs. For more information, visit www.egnyte.com
Read more
Beauto Systems Private Limited
Beauto Systems
Posted by Beauto Systems
Remote, Pune
4 - 6 yrs
₹4L - ₹8L / yr
skill iconJava
Spring
Apache Tomcat
JIRA
skill iconSpring Boot
+1 more
Key responsibilities Areas:
  • Understand the requirement and convert that into API design.
  • Write the code independently 
  • Unit testing and bug fixing
  • Write code with standards and conventions and follow best practices.
  • Know how to engineer a full-fledged system and not just write code to make things work.
  • Knowledge of agile methodologies, scrum.
  • Should be able to guide juniors.
  • Communication with clients for requirement understanding.
  • Code Merging and deployment

Required Skills:
  • REST APIs in Spring Boot and Spring Framework
  • MySQL Database, complex SQL queries (like joining multiple tables)
  • Spring Security, JWT Tokens
  • Third party Integration
  • Unix basic commands
  • Apache Tomcat, Deployment of War in Unix environment.
  • Jira or any other Issue/Task tracking systems.

Qualification:

BE \ B.Tech \ MCA





Read more
Recro
at Recro
1 video
32 recruiters
Amrita Singh
Posted by Amrita Singh
Bengaluru (Bangalore)
3 - 6 yrs
₹5L - ₹20L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Microservices
+3 more
  • 3+ year of experience in Development in JAVA technology.
  • Strong Java Basics
  • SpringBoot or Spring MVC
  • Hands on experience on Relationl Databases (SQL query or Hibernate) + Mongo (JSON parsing)
  • Proficient in REST API development
  • Messaging Queue (RabitMQ or Kafka)
  • Microservices
  • Any Caching Mechanism
  • Good at problem solving


Good to Have Skills:


  • 3+ years of experience in using Java/J2EE tech stacks
  • Good understanding of data structures and algorithms.
  • Excellent analytical and problem solving skills.
  • Ability to work in a fast paced internet start-up environment.
  • Experience in technical mentorship/coaching is highly desirable.
  • Understanding of AI/ML algorithms is a plus.
Read more
The DataTech Labs
at The DataTech Labs
1 recruiter
Priyanka Deshmukh
Posted by Priyanka Deshmukh
Remote only
5 - 8 yrs
₹10L - ₹15L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
AWS CloudFormation

Responsibilities:

  • Design and deliver scalable web services, APIs and backend data modules.
  • Understand requirements and develop reusable code using design patterns & component architecture and write unit test cases
  • Collaborate with product management and engineering teams to elicit and understand the requirements and develop solutions
  • Stay current with latest tools, technology ideas and methodologies; share knowledge by clearly articulating results and ideas to key decision makers.

Required Qualifications:

  • 6+ years of experience writing multithreaded programs running in Java
  • Experience on Java, Spring Boot,, Apache Nifi ,  workingDocker, EKS, Azkaban, Jenkins
  • Experience with Git and build tools like Gradle/Maven/SBT.
  • Strong understanding of object-oriented design, data structures, algorithms, profiling, and optimization.
  • Have elegant, readable, maintainable and extensible code style.
  • Experience on AWS is preferable
  • Knowledge on top algorithms like sorting, heap/stack, queue, search, etc.
  • Familiarity with test-driven development
  • Thrive in a fast-paced environment, with ability to deliver code of quality quickly.
  • Attention to details. Strong communication and collaboration skills.
  • BS in Computer Science or equivalent

 

Read more
Nest Pro Inc
at Nest Pro Inc
1 recruiter
Suraj Gaydhane
Posted by Suraj Gaydhane
Mumbai, Navi Mumbai
1 - 3 yrs
₹4L - ₹8L / yr
skill iconGo Programming (Golang)
skill iconAmazon Web Services (AWS)
skill iconKubernetes
skill iconDocker
RESTful APIs
+4 more

Nest is a gamified investment platform for the next-generation and young millennials of the world, to invest, play and earn returns more than a regular savings bank account. The world of gaming is merging with finance to offer a more immersive user experience and help users learn how to manage their money. We’re creating a new breed of asset managers and fin-fluencers with Nest.

We are seeking a dedicated Golang developer to join our growing company.

You will collaborate with other technical staff to deliver and maintain a fully-functional mobile application. We hope you can put your passion for software engineering to work for creating highly immersive user applications.

Your duties will include maintaining code repositories via GitHub and internal server storage modules.

 

Responsibilities

Below are some of the responsibilities a Golang developer is expected to undertake in their position:

  • Implement AWS containers to support Go implementation and successful repository maintenance
  • Utilize Kubernetes to ensure successful application development, deployment, and scaling
  • Implement Docker for smaller-scale applications that require simpler deployments
  • Employ Linux Terminal command structures to allow easy back-end operations for less-expert technical staff
  • Structure our user interface with React and ensure REST API access is available for enterprise-grade finance customers on-demand
  • Collaborate with other technical staff to ensure consistent and smooth DevOps workflows
  • Choose and implement other JavaScript libraries that will optimize performance without sacrificing security and base functionality
  • Manage multiple projects within reasonable design specifications and budget restrictions
  • QA design for errors
  • Implement feedback and changes whenever possible
  • Create visualizations that convey accurate messaging for the project.

Job Qualifications and Skill Sets

Bachelor’s degree in computer science, IT, or a related field, such as programming. Other critical skills required are:

  • Provable proficiency in Go programming
  • Excellent written and verbal communication skills
  • Minimum of two years’ experience working in programming or information technology
  • Attention to detail and Knowledge in Java is recommended
  • Portfolio of work with examples that showcase technical skill
  • Strong analytical skills
  • Time management and organizational skills
  • Knowledge of Go templating, common frameworks, and tools
  • Experience working with a team

What you’ll receive

  • A compensation competitive to premier firms
  • Incredible learning and exposure to every aspect of a funded financial startup as an early member, working directly with the founders.
  • Recognition and experience of working on a platform with an exponential user growth curve.
  • A fun and receptive work culture which promises to never get mundane!
  • If you love party, it is on us!

 

Read more
EPAM Systems
at EPAM Systems
6 recruiters
Ranjith Perumalla
Posted by Ranjith Perumalla
Hyderabad
3 - 8 yrs
₹8L - ₹21L / yr
skill iconJava
Microservices
skill iconSpring Boot
Data Structures
Algorithms

Basic Qualifications

  • Solid knowledge of algorithms/data structures is a must
  • Strong Java software development experience – with a focus on Java 8 & 9
  • Experience with NoSql databases – ideally with MongoDB
  • Experience implementing REST apis – ideally with JAX-RS
  • Experience with Reactive Programming – ideally with RxJava
  • Experience implementing unit tests

 

Preferred Qualifications

  • Experience developing applications in fintech or established financial institutions
  • Experience with microservice architectures
  • Experience developing systems that can scale to large amounts of data
  • Experience working in Agile Scrum
  • Experience working on a globally distributed team
Read more
Omnicuris Healthcare
at Omnicuris Healthcare
4 recruiters
priyank Jain
Posted by priyank Jain
Bengaluru (Bangalore)
0 - 4 yrs
₹10L - ₹15L / yr
skill iconJava
Spring
J2EE
Struts
Hibernate (Java)
+1 more
• Compile and analyze data, processes, and codes to troubleshoot problems and identify areas for improvement. • Collaborating with the front-end developers and other team members to establish objectives and design more functional, cohesive codes to enhance the user experience. • Should be able to understand the business requirements and any technical limitations, and document, design, develop and deliver high quality Product Features. • Design and implement extremely high-volume, fault-tolerant, scalable web-based systems solutions. • Hands-On Experience in Java or Python. •Hands-On Experience on RESTful API Design and Development. •Hands-On Experience in SQL.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos