Cutshort logo
Technology service company logo
Sr. Spark Software Engineer
Technology service company
Sr. Spark Software Engineer
Technology service company's logo

Sr. Spark Software Engineer

at Technology service company

Agency job
5 - 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Ansible
skill iconGit
JIRA
Apache Spark
Spark
Apache Kafka
Microservices
skill iconKubernetes
Terraform
NOSQL Databases
API
skill iconDocker
  • Bachelor’s or master’s degree in Computer Engineering, Computer Science, Computer Applications, Mathematics, Statistics, or related technical field. Relevant experience of at least 3 years in lieu of above if from a different stream of education.

  • Well-versed in and 3+ hands-on demonstrable experience with: ▪ Stream & Batch Big Data Pipeline Processing using Apache Spark and/or Apache Flink.
    ▪ Distributed Cloud Native Computing including Server less Functions
    ▪ Relational, Object Store, Document, Graph, etc. Database Design & Implementation
    ▪ Micro services Architecture, API Modeling, Design, & Programming

  • 3+ years of hands-on development experience in Apache Spark using Scala and/or Java.

  • Ability to write executable code for Services using Spark RDD, Spark SQL, Structured Streaming, Spark MLLib, etc. with deep technical understanding of Spark Processing Framework.

  • In-depth knowledge of standard programming languages such as Scala and/or Java.

  • 3+ years of hands-on development experience in one or more libraries & frameworks such as Apache Kafka, Akka, Apache Storm, Apache Nifi, Zookeeper, Hadoop ecosystem (i.e., HDFS, YARN, MapReduce, Oozie & Hive), etc.; extra points if you can demonstrate your knowledge with working examples.

  • 3+ years of hands-on development experience in one or more Relational and NoSQL datastores such as PostgreSQL, Cassandra, HBase, MongoDB, DynamoDB, Elastic Search, Neo4J, etc.

  • Practical knowledge of distributed systems involving partitioning, bucketing, CAP theorem, replication, horizontal scaling, etc.

  • Passion for distilling large volumes of data, analyze performance, scalability, and capacity performance issues in Big Data Platforms.

  • Ability to clearly distinguish system and Spark Job performances and perform spark performance tuning and resource optimization.

  • Perform benchmarking/stress tests and document the best practices for different applications.

  • Proactively work with tenants on improving the overall performance and ensure the system is resilient, and scalable.

  • Good understanding of Virtualization & Containerization; must demonstrate experience in technologies such as Kubernetes, Istio, Docker, OpenShift, Anthos, Oracle VirtualBox, Vagrant, etc.

  • Well-versed with demonstrable working experience with API Management, API Gateway, Service Mesh, Identity & Access Management, Data Protection & Encryption.

    Hands-on experience with demonstrable working experience with DevOps tools and platforms viz., Jira, GIT, Jenkins, Code Quality & Security Plugins, Maven, Artifactory, Terraform, Ansible/Chef/Puppet, Spinnaker, etc.

  • Well-versed in AWS and/or Azure or and/or Google Cloud; must demonstrate experience in at least FIVE (5) services offered under AWS and/or Azure or and/or Google Cloud in any categories: Compute or Storage, Database, Networking & Content Delivery, Management & Governance, Analytics, Security, Identity, & Compliance (or) equivalent demonstrable Cloud Platform experience.

  • Good understanding of Storage, Networks and Storage Networking basics which will enable you to work in a Cloud environment.

  • Good understanding of Network, Data, and Application Security basics which will enable you to work in a Cloud as well as Business Applications / API services environment.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos

Similar jobs

Sadup Softech
at Sadup Softech
1 recruiter
madhuri g
Posted by madhuri g
Chennai
3 - 7 yrs
₹10L - ₹15L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)

PayPal is Hiring !!


Designation: Java back-end developer


Experience:3-7yrs


Location: Chennai, Tamilnadu (Work from OFFICE)


Job description :


Must have skills

3 to 5 years

Java, Spring Boot, Hibernate, REST API

Design Patterns

SQL, Oracle, Table design

Read more
SmartCoin
at SmartCoin
1 recruiter
Suchoritha Chatterjee
Posted by Suchoritha Chatterjee
Bengaluru (Bangalore)
6 - 9 yrs
₹24L - ₹40L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
skill iconRedis
+1 more
Roles & Responsibilities:
• Determining project requirements and developing work schedules for the team.
• Delegating tasks and achieving daily, weekly, and monthly goals.
• Liaising with team members, management, and clients to ensure projects are completed
to standard.
• Identifying risks and forming contingency plans as soon as possible.
• Analyzing existing operations and scheduling training sessions and meetings to discuss
improvements.
• Keeping up-to-date with industry trends and developments.
• Updating work schedules and performing troubleshooting as required.
• Motivating staff and creating a space where they can ask questions and voice their
concerns.
• Being transparent with the team about challenges, failures, and successes.
• Writing progress reports and delivering presentations to the relevant stakeholders.
Technical Lead Requirements:
• Bachelor’s degree in computer science, engineering, or a related field.
• Relevant Management certification may be required.
• Experience in a similar role would be advantageous.
• Excellent technical, diagnostic, and troubleshooting skills.
• Strong leadership and organizational abilities.
• Willingness to build professional relationships with staff and clients.
• Excellent communication, motivational, and interpersonal skills
Read more
[x]cube LABS
at [x]cube LABS
2 candid answers
1 video
Samudrala SaiAnvesh
Posted by Samudrala SaiAnvesh
Hyderabad
3 - 8 yrs
₹9L - ₹15L / yr
skill iconSpring Boot
skill iconJava
Hibernate (Java)
Microservices
skill iconDocker
  • Skilled in Java / J2EE including frameworks like Microservices, Spring boot, hibernate etc
  • Experience with microservices-based architecture including building
  • Good knowledge of SQL (MySQL / Oracle / SQL Server / Postgres), NoSQL (MongoDB / Cassandra), App server Knowledge (Tomcat/JBoss etc.), OSGi, REST Web Services
  • Working / Usage experience of Docker, Microservices, Jenkins, Multithreading, Design patterns, Java 1.8 and Container
  • Experience with Cloud computing in added advantage (AWS / Azure)
  • Strong Debugging and Troubleshooting Expertise.
  • Strong communication skills (oral and written)
Read more
Right Hemisphere
at Right Hemisphere
1 recruiter
Barsha Deka
Posted by Barsha Deka
Remote, Guwahati
2 - 4 yrs
₹6L - ₹10L / yr
skill iconJava
skill iconJavascript
skill iconReact.js
skill iconReact Native
skill iconKubernetes
+2 more
  • Develop new functionalities on the Company platform, in close collaboration with the Product team
  • Analyse and correct anomalies across the various environments
  • Propose and participate in the platform evolution
  • Contribute to the platform architecture, ensure strong code quality (tests & code reviews) and adherence to best practices
  • Mentor and support junior developers
Read more
Eagle Power
at Eagle Power
2 recruiters
Hrushikesh Mande
Posted by Hrushikesh Mande
Remote only
1 - 5 yrs
₹8L - ₹12L / yr
skill iconGo Programming (Golang)
GO
skill iconAmazon Web Services (AWS)
Microservices
NOSQL Databases
+2 more

Intro

EAGLE Power Holdings aims to launch a portfolio of new energy retail brands, all of which enjoy the efficiency of a single technology platform. We want to do more than offer cheap "green" tariffs, and believe that our range of engaging brands can identify with shifts in consumer preferences (e.g. growth of EV usage), with the value of local communities, and with proactive support of broader ESG causes.


Our long-term strategy is technology-driven, and involves unlocking value through the digitalisation of processes around customer acquisition, engagement, and retention.
Developers at EAGLE flourish in an agile process where collaboration and ego-free communication is valued. We believe in developing working software throughout the entire product development process. We engage in product thinking as a team and cross-functionality among product managers, designers, and domain experts is promoted.


How you fit in

Engineering is the executional function of EAGLE's software delivery wing. As a server-side developer at Eagle, you will take the lead on implementing various software services of our core energy retail infrastructure. Not only are you expected to write clean, tested, and maintainable code, you will also be a central part of a product team that iterates constantly, ships regularly, and learns continuously. You will have the creative freedom for learning, experimenting, and responsible risk-taking in a startup environment.


What your role consists of:

  • Develop enterprise-scale backend services using Golang
    • Collaborate with engineers, UI/UX designers, and product owners to build & ship new features and maintain/enhance existing ones
  • Independently come up with extensible low-level software design. Write modular, tested, readable and performant code
    • Debug production issues across services and multiple levels of the stack
  • Help inform product prioritisation and scoping decisions by evaluating technical complexity and risk
  • Improve engineering standards, tooling, and processes
  • Maintain technical documentation

What you bring to this role:

  • At least 1-3 years of demonstrated ability to rely on an iterative process to maintain momentum on projects in a distributed, collaborative, agile environment
  • An ownership mindset: you should look not only at what you’re asked to do, but ask why you’re doing it and how it impacts on the rest of the product, our customers, and whether it makes sense
  • Comfort with low-level engineering and ability to write efficient, performant and tested code
  • Think deeply about systems and services and write high-quality code. We work mostly in Golang, with AWS Cloudformation. However, languages can be learned: we care much more about your general engineering skill than - knowledge of a particular language or framework.
  • Excellent communication skills and ability to give and receive constructive feedback
  • Passion for the whole product process. You will have your specific areas of focus, but we find those that are passionate about the bigger picture collaborate best with cross-functional teams

Where we are

While the company is registered in the UK, the software delivery wing is built to be remote-first. Whether you prefer to be in situ or a digital nomad (or anything in between), you are welcome. We are not inclined to support relocation to London for candidates that are not already based there, as we are a remote-first company. 


What’s in it for you

We offer competitive salaries based on prevailing rates in your local employment market, but there is further room to negotiate if you are the right candidate. In addition to your basic package, you can expect to receive the following benefits:

  • Flexible working hours
  • Unlimited annual leave
  • On-the-job coaching, and access to mentorship by industry and domain thought leaders
  • Full or partial sponsorship for professional/skill development courses, certifications, and other learning opportunities (evaluated on a case-by-case basis)
  • Monthly allowance package for remote working (coworking membership or cash allowance)

About EAGLE Power Holdings

In a nutshell: Transforming energy retail and supply through cutting-edge software and AI technology


The venture is in ‘stealth mode’ as we lay the foundations for blast-off. It has been launched by a team with a history of entrepreneurial successes. These include one in the climate change space which services the Californian and North America carbon markets, and another which provides highly refined machine learning software to the energy arena in Asia. Both companies were acquired last year. 


This start-up was launched in London at the end of 2020, and will focus on the deregulated energy market in GB. The mission is to discover, or invent, a viable business and operational model for energy retail within the near-zero-cost energy ecosystem that the world is moving towards. This transformation is driven by the ever-decreasing prices of renewables/alternative generation, and by the exponentially growing volumes of national energy system data. We believe these factors have yet to truly disrupt the market, and intend to accelerate the sharing of value back to consumers.

Read more
WeInvest
at WeInvest
1 recruiter
Vinaya Yadgiri
Posted by Vinaya Yadgiri
Bengaluru (Bangalore)
5 - 8 yrs
₹15L - ₹22L / yr
skill iconRuby
skill iconRuby on Rails (ROR)
skill iconJava
Data Structures
Algorithms
+2 more

Key responsibilities for this role include:

• Lead one of the product verticals in the development of technology strategy, planning, hiring and execution of the next iteration of the WeInvest platform.

• Institutionalize a strong software engineering culture and facilitate a rapid, iterative, layered development approach.

• Be hands on with the coding, evaluate design and architecture choices, do in-depth code reviews, and implement standards and practices for software development.

• Inspire the engineering team to build quality, scalable code by pairing with team members periodically.

• Participate in the definition and management of high-quality product roadmaps based on business, product & tech strategy.

• Proactively identify and resolve strategic issues that may impair the team’s ability to meet strategic, financial, and technical goals.

The ideal candidate will have:

• Masters /BE/ B.Tech from a reputed institute

• About 6-10 years professional experience in software development.

• Excellent logical and analytical reasoning capabilities combined with strong knowledge of core

computer science concepts like algorithms, data structures, software design patterns, OOP etc.

• Should have experience in all the phases of SDLC

• Must have experience in leading a team. (At least 2-3 people)

• Be an expert in ruby on rails with experience OR from Fintech, Wealth Management OR Investment

• Management Domain with experience in any of the programming languages (Java/Python/Ruby).

• Breadth of experience in multiple technologies, tools, frameworks and processes is a big plus.

• Excellent understanding of core computer science concepts like algorithms, data structure,

Software design patterns, OOP etc. Be able to lead the team in design & architecture discussions,

introduce new tools, concepts & process to the team and guide other members of the team.

• Experience working in an agile team with software engineering practices like automated testing,

test- driven-development, continuous integration etc is a big plus.

• Excellent oral and written communication.

Read more
InnovatorsBay
at InnovatorsBay
3 recruiters
Kanika Batra
Posted by Kanika Batra
Bengaluru (Bangalore)
3 - 6 yrs
₹7L - ₹10L / yr
skill iconAngular (2+)
skill iconReact.js
skill iconNodeJS (Node.js)
Progressive Web Apps (PWA)
Spring MVC
+3 more
We are actively looking for a technology rockstar - a full stack developer. We expect the candidate to be a dynamic programmer by heart. Pro-active, interest to create disruptive solutions, love for learning is a must along with following: - Hands-on experience in building applications with Angular 4+, best practices, pitfalls, and commonly used libraries - Good understanding of React and state management libraries like Redux/Flux - Experience in handling real-time data - Understanding of CSS box model - Experience in writing modular and maintainable code - Good understanding of the semantic meaning of HTML elements - Integration of APIs and WebSockets - Developing APIs - Knowledge of CSS flexbox (good to have) - Experience with test frameworks - Comfortable with agile methodologies - Excellent communication skills
Read more
OkayGo
at OkayGo
2 recruiters
Saurav Chawla
Posted by Saurav Chawla
NCR (Delhi | Gurgaon | Noida)
1 - 3 yrs
₹5L - ₹8L / yr
skill iconJava
Spring
J2EE
Struts
Hibernate (Java)
+1 more
We need a backend java developer who is willing to work in a fast paced and exciting environment of a startup. 
OkayGo is the fastest staffing solution for blue collared and grey collared workers for businesses. 
Read more
Oust Labs
at Oust Labs
1 video
3 recruiters
Prabhakar Kulkarni
Posted by Prabhakar Kulkarni
Bengaluru (Bangalore)
5 - 8 yrs
₹7L - ₹11L / yr
RESTful APIs
Object Oriented Programming (OOPs)
Database Design
skill iconJava
skill iconAmazon Web Services (AWS)
+3 more
Job Description : PROFESSIONAL QUALIFICATIONS / SKILLS 1) 2 - 4 years of extensive experience in developing Client-Server (Web) applications using Java and J2EE Technologies 2) Expertise in developing applications using JDBC/DBCP2 3) Very Strong Core Java ( Collections, multithreading etc) 4) Expertise in Java Server programming 5) Must have work experience in RESTful Web services 6) Strong in OOPS and designing solutions 7) Good in MYSQL queries scripting and database concepts 8) Good problem solving ability 9) Ability to debug complex issues 10) Hands on in Git 11) Comfortable in working in Linux environment 12) Understanding of JSON 13) Experience in Tomcat 14) Experience in using tools like Eclipse, IntelliJ Good to have: 1) Caching concept and hands-on 2) AWS 3) Messaging Queue (JMS/SQS etc) 4) NoSQL database Thank you
Read more
Transfin Media Private Limited
Simi Sebastian
Posted by Simi Sebastian
NCR (Delhi | Gurgaon | Noida)
3 - 7 yrs
₹7L - ₹8L / yr
skill iconJavascript
skill iconNodeJS (Node.js)
skill iconPHP
skill iconRuby on Rails (ROR)
LAMP Stack
+1 more
Full Stack efficient Digital Media platform
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos