Cutshort logo
Technology service company logo
Sr. Spark Software Engineer
Technology service company
Sr. Spark Software Engineer
Technology service company's logo

Sr. Spark Software Engineer

at Technology service company

Agency job
5 - 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Ansible
skill iconGit
JIRA
Apache Spark
Spark
Apache Kafka
Microservices
skill iconKubernetes
Terraform
NOSQL Databases
API
skill iconDocker
  • Bachelor’s or master’s degree in Computer Engineering, Computer Science, Computer Applications, Mathematics, Statistics, or related technical field. Relevant experience of at least 3 years in lieu of above if from a different stream of education.

  • Well-versed in and 3+ hands-on demonstrable experience with: ▪ Stream & Batch Big Data Pipeline Processing using Apache Spark and/or Apache Flink.
    ▪ Distributed Cloud Native Computing including Server less Functions
    ▪ Relational, Object Store, Document, Graph, etc. Database Design & Implementation
    ▪ Micro services Architecture, API Modeling, Design, & Programming

  • 3+ years of hands-on development experience in Apache Spark using Scala and/or Java.

  • Ability to write executable code for Services using Spark RDD, Spark SQL, Structured Streaming, Spark MLLib, etc. with deep technical understanding of Spark Processing Framework.

  • In-depth knowledge of standard programming languages such as Scala and/or Java.

  • 3+ years of hands-on development experience in one or more libraries & frameworks such as Apache Kafka, Akka, Apache Storm, Apache Nifi, Zookeeper, Hadoop ecosystem (i.e., HDFS, YARN, MapReduce, Oozie & Hive), etc.; extra points if you can demonstrate your knowledge with working examples.

  • 3+ years of hands-on development experience in one or more Relational and NoSQL datastores such as PostgreSQL, Cassandra, HBase, MongoDB, DynamoDB, Elastic Search, Neo4J, etc.

  • Practical knowledge of distributed systems involving partitioning, bucketing, CAP theorem, replication, horizontal scaling, etc.

  • Passion for distilling large volumes of data, analyze performance, scalability, and capacity performance issues in Big Data Platforms.

  • Ability to clearly distinguish system and Spark Job performances and perform spark performance tuning and resource optimization.

  • Perform benchmarking/stress tests and document the best practices for different applications.

  • Proactively work with tenants on improving the overall performance and ensure the system is resilient, and scalable.

  • Good understanding of Virtualization & Containerization; must demonstrate experience in technologies such as Kubernetes, Istio, Docker, OpenShift, Anthos, Oracle VirtualBox, Vagrant, etc.

  • Well-versed with demonstrable working experience with API Management, API Gateway, Service Mesh, Identity & Access Management, Data Protection & Encryption.

    Hands-on experience with demonstrable working experience with DevOps tools and platforms viz., Jira, GIT, Jenkins, Code Quality & Security Plugins, Maven, Artifactory, Terraform, Ansible/Chef/Puppet, Spinnaker, etc.

  • Well-versed in AWS and/or Azure or and/or Google Cloud; must demonstrate experience in at least FIVE (5) services offered under AWS and/or Azure or and/or Google Cloud in any categories: Compute or Storage, Database, Networking & Content Delivery, Management & Governance, Analytics, Security, Identity, & Compliance (or) equivalent demonstrable Cloud Platform experience.

  • Good understanding of Storage, Networks and Storage Networking basics which will enable you to work in a Cloud environment.

  • Good understanding of Network, Data, and Application Security basics which will enable you to work in a Cloud as well as Business Applications / API services environment.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos

Similar jobs

Molecular Connections
at Molecular Connections
4 recruiters
Molecular Connections
Posted by Molecular Connections
Remote, Bengaluru (Bangalore), Mumbai
5 - 10 yrs
₹7L - ₹15L / yr
skill iconGo Programming (Golang)
skill iconRuby on Rails (ROR)
skill iconRuby
skill iconPython
skill iconJava
+8 more

Responsibilities:

- Design, develop, and implement robust and efficient backend services using microservices architecture principles.

-  Write clean, maintainable, and well-documented code using C# and the .NET framework.

-  Develop and implement data access layers using Entity Framework.

-  Utilize Azure DevOps for version control, continuous integration, and continuous delivery (CI/CD) pipelines.

-  Design and manage databases on Azure SQL.

-  Perform code reviews and participate in pair programming to ensure code quality.

-  Troubleshoot and debug complex backend issues.

-  Optimize backend performance and scalability to ensure a smooth user experience.

-  Stay up-to-date with the latest advancements in backend technologies and cloud platforms.

-  Collaborate effectively with frontend developers, product managers, and other stakeholders.

-  Clearly communicate technical concepts to both technical and non-technical audiences.

Qualifications:

-  Strong understanding of microservices architecture principles and best practices.

-  In-depth knowledge of C# programming language and the .NET framework (ASP.NET MVC/Core, Web API).

-  Experience working with Entity Framework for data access.

-  Proficiency with Azure DevOps for CI/CD pipelines and version control (Git).

-  Experience with Azure SQL for database design and management.

-  Experience with unit testing and integration testing methodologies.

-  Excellent problem-solving and analytical skills.

-   Ability to work independently and as part of a team.

-   Strong written and verbal communication skills.

-   A passion for building high-quality, scalable, and secure software applications.

Read more
Getapp
Remote only
5 - 15 yrs
₹5L - ₹20L / yr
skill icon.NET
skill iconC#
ASP.NET MVC
Microsoft SQL Server
Microservices
+3 more
  • Participate in requirements analysis and design 
  • Development of Web applications and RESTful APIs using C#, .NET Core, ASP.NET Core, .NET Framework 4.7, C#, ASP.NET MVC, LINQ, Entity Framework 6.0, EF Core
  • Development of Microservices using Clean Architecture, CQRS, .NET Design Patterns, SOLID Principles and Object-oriented design & analysis (OOA & OOD)
  • Development of Microservices using Microsoft Azure or AWS, Dockers and Kubernetes
  • Write clean, scalable code using .NET programming languages (C#)
  • Write Microsoft SQL queries and optimize both external and internal DB processes and procedures.
  • Use automation tools, following CI/CD best practices in an established DevOps team.
  • Write unit and integration tests using Moq
  • Collaborate with internal teams to produce software design and architecture
  • Develop documentation throughout the software development life cycle (SDLC)
  • Serve as an expert on applications and provide technical support  


Read more
company logo
Agency job
via TIGI HR by Abhishek Guthuru
Mumbai
2 - 4 yrs
₹6L - ₹12L / yr
skill iconJava
skill iconGo Programming (Golang)

Job Title: Jr Software Engr Java

 

Experience: 2+ Years

CTC: 6-12 LPA

Location: Mumbai
Face-to-face interview at the office

           

 

What we want:
We are looking for someone who has has strong knowledge and 2+years’ of experience in Core Java, Spring MVC, Restful API, SOAP, Golang


What you will do:
•Developing REST APIs for the platform
•Developing & maintaining an UX Panel
•Integration with third party applications using APIs
•Design, Develop and execute performance tests to simulate traffic of large-scale events
•Analyse complex problems/issues in load tests, production servers, and identify the bottlenecks and optimize performance.
•Analyse usage patterns, and application behaviours and translate that into performance optimizations.
•Determine how to meet scalability requirements while ensuring reliability within a platform
•Design and maintain tools for reporting on performance metrics.

Detailed Requirements:
Excellent knowledge of Golang, Core Java, Spring MVC, Restful API,SOAP
Additional knowledge of Java internals, GO Lang, plus.
Experience in developing, optimizing and operating high traffic projects/websites is a plus.
Experience in using Java Profilers and performance engineering.
Experience in writing multithreaded web applications.
Good knowledge of basic Linux commands to debug system issues and limitations a must.
Experience in Agile/SCRUM is a big plus
Experience in hibernate and spring MVC framework is a plus.
Ability to manage multiple modules simultaneously
Ability to work under pressure & deal with people diplomatically
Should have experience of leading a team & a strong motivator
Strong academic record is a big plus.

 

Read more
Mobile Programming LLC
at Mobile Programming LLC
1 video
34 recruiters
Chandni oli
Posted by Chandni oli
Bengaluru (Bangalore)
4 - 8 yrs
₹7L - ₹12L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)

Technical Skills/Requirements

 Demonstrated expertise in building, shipping and supporting innovative, scalable

enterprise-class applications

 Strong familiarity with Object Orientation concepts

 Strong Experience in Java, J2EE, Core Java, Advance Java is must

 Strong Experience in working with database server is must

 Experience with web development frameworks like Spring is must.

 Experienced in using Websphere, WebLogic, JBOSS or TomCat application

servers

 Must be knowledgeable in at least one of the relational DBs (Oracle, DB2 or MS-

SQL)

 Experience is Javascript

 Experience in CSS, Angular, EXTJS, Bootstrap, JQuery is preferred

 Experience in JSP, Servlet, Tag Libray,, XSLT, Restful API’s is preferred

 Good understanding of Java, J2EE, SOA/Web services, EAI patterns, long

running business processes, UML and OOAD.

 4+ years of overall software development experience, preferably in a product

development company

Read more
Deuex Solutions
at Deuex Solutions
1 recruiter
Saloni Shah
Posted by Saloni Shah
Remote, Mumbai
5 - 10 yrs
₹5L - ₹20L / yr
skill iconJava
skill iconSpring Boot
Hibernate (Java)
J2EE
class Deuex
{
     public static void main (String[] args)
    {
         System.out.println("WE'RE HIRING!");
     }
}
 
Greetings of the day!!

Company Name: Deuex Solutions Pvt. Ltd.

Company Profile: Deuex Solutions is a global software development company that specialises in Product Development, Web Application Development, Big Data Solutions, and Mobile Application Development by converting complex ideas into elegant user experiences. Our agile development process & unique skill sets help assist early-stage startup companies throughout their lifecycle. At Deuex Solutions, we have a team of pragmatic developers and designers, which allows us to provide a full-suite service to our clients.

Deuex Solutions is based in India and is a trusted technical partner of various companies from all around the globe.

Company Website: https://deuexsolutions.com/" target="_blank">https://deuexsolutions.com
LinkedIn URL: https://www.linkedin.com/company/deuexsolutions/" target="_blank">https://www.linkedin.com/company/deuexsolutions/  (For more project-related details, kindly Checkout our LinkedIn Profile)
 
Please find the below links to one of our projects.
 
Open Source Project: https://open-metadata.org/" target="_blank">https://open-metadata.org/
Open Source Repo: https://github.com/open-metadata/OpenMetadata" target="_blank">https://github.com/open-metadata/OpenMetadata
Job Brief
We are looking for an experienced Senior Java Developer to join our IT team. You will be responsible for the server-side of our web applications.
If you have excellent programming skills and a passion for developing applications or improving existing ones, we would like to meet you. As a Back-end developer, you’ll work closely with our engineers to ensure system consistency and improve user experience. Ultimately, you should be able to develop and maintain functional and stable web applications to meet our company’s needs.

Responsibilities

  1. Participate in the entire application lifecycle, focusing on coding and debugging
  2. Write clean code to develop functional web applications
  3. Troubleshoot and debug applications
  4. Perform UI tests to optimise performance
  5. Manage cutting-edge technologies to improve legacy applications
  6. Collaborate with Front-end developers to integrate user-facing elements with server-side logic
  7. Gather and address technical and design requirements
  8. Provide training and support to internal teams
  9. Build reusable code and libraries for future use
  10. Liaise with developers, designers and system administrators to identify new features
  11. Follow emerging technologies
Requirements
  1. Proven work experience as a Java Developer
  2. In-depth understanding of the entire web development process (design, development and deployment)
  3. Hands-on experience with programming languages like Java (Spring Boot, hibernate, dropwizard, etc.) 
  4. Familiarity with cloud services such as AWS
  5. Familiarity with front-end languages (e.g. HTML, JavaScript and CSS)
  6. Excellent analytical and time management skills
  7. Teamwork skills with a problem-solving attitude


Read more
Amazon India
at Amazon India
1 video
58 recruiters
Prangya Paramita Behera
Posted by Prangya Paramita Behera
Bengaluru (Bangalore), Hyderabad, Delhi
3 - 9 yrs
₹20L - ₹60L / yr
skill iconJava
Microservices
Distributed Systems
HLD
Design patterns
+3 more

As a Software Development Engineer at Amazon, you have industry-leading technical abilities and demonstrate breadth and depth of knowledge. You build software to deliver business impact, making smart technology choices. You work in a team and drive things forward. 

Top Skills

•    You write high quality, maintainable, and robust code, often in Java or C++.

•    You recognize and adopt best practices in software engineering: design, testing, version control, documentation, build, deployment, and operations.

•    You have experience building scalable software systems that are high-performance, highly-available, highly transactional, low latency and massively distributed.

Roles & Responsibilities

•    You solve problems at their root, stepping back to understand the broader context.

•    You develop pragmatic solutions and build flexible systems that balance engineering complexity and timely delivery, creating business impact.

•    You understand a broad range of data structures and algorithms and apply them to deliver high-performing applications.

•    You recognize and use design patterns to solve business problems.

•    You understand how operating systems work, perform and scale.

•    You continually align your work with Amazon’s business objectives and seek to deliver business value.

•    You collaborate to ensure that decisions are based on the merit of the proposal, not the proposer.

•    You proactively support knowledge-sharing and build good working relationships within the team and with others in Amazon.

•    You communicate clearly with your team and with other groups and listen effectively. 

Skills & Experience

•    Bachelors or Masters in Computer Science or relevant technical field.

•    Experience in software development and full product life-cycle.

•    Excellent programming skills in any object oriented programming languages - preferably Java, C/C++/C#, Perl, Python, or Ruby.

•    Strong knowledge of data structures, algorithms, and designing for performance, scalability, and availability.

•    Proficiency in SQL and data modeling.

Read more
Innovaeps Technologies
at Innovaeps Technologies
1 recruiter
shreya choubey
Posted by shreya choubey
Indore
1 - 3 yrs
₹1.9L - ₹4.8L / yr
skill iconAngularJS (1.x)
skill iconAngular (2+)
Angular
skill iconJavascript
skill iconJava
+2 more

Job Description: 

We are looking to hire an experienced angularJS developer to join our dynamic team. As a lead developer, you will be responsible for creating a top-level coding base using Angular best practices. Your role will require you to implement an exciting and streamlined user experience in the form of a Java-based desktop and mobile web app.

Responsibilities:

  • Designing and developing user interfaces using angularJS best practices.
  • Adapting interface for modern internet applications using the latest front-end technologies.
  • Writing JavaScript, CSS, and HTML.
  • Developing product analysis tasks.
  • Making complex technical and design decisions for AngularJS projects.
  • Developing application codes and unit tests in AngularJS, Java Technologies, and Rest Web Services.
  • Conducting performance tests.
  • Consulting with the design team.
  • Ensuring high performance of applications and providing support. 

    Requirements:

    • Bachelor’s degree in computer science, computer engineering, or similar.
    • Previous work experience as an AngularJS developer.
    • Proficient in CSS, HTML, and writing cross-browser compatible code.
    • Experience using JavaScript building tools like Gulp or Grunt.
    • Knowledge of JavaScript MV-VM/MVC frameworks including AngluarJS.
    • Excellent project management skills.
    • Proven experience implementing back-end JavaScript applications.
    • Excellent communication skills.
    • Critical thinker and good problem-solver.
Read more
Leading American ride-hailing, food delivery and Logistics c
Leading American ride-hailing, food delivery and Logistics c
Agency job
via posterity consulting by Manpreet Kaur
Bengaluru (Bangalore)
7 - 10 yrs
₹30L - ₹80L / yr
skill iconJava
skill iconGo Programming (Golang)
Big Data
• 8+ years Strong meaningful Individual contributor experience as a software engineer
• Architecture: Knowledge of data structures and an eye for architecture. 
• Strong coding/debugging abilities: You have advanced knowledge of at least one
programming language, and are happy to learn more. Either Go or Java
• Distributed Systems: Experience building distributed systems at scale.
• Fast learner: 
• A team player:
• Design and business acumen
Basic Qualifications
• 8 years of experience profeciency in Java or Go language and in handling large data systems
• Proficiency in Spark and related big data handling architectures• Proficiency in SQL
Read more
Connecting new-age digital-first brands and end consumers
Connecting new-age digital-first brands and end consumers
Agency job
via Qrata by Mrunal Kokate
NCR (Delhi | Gurgaon | Noida)
4 - 8 yrs
₹25L - ₹30L / yr
skill iconJava
Spring
Microservices
About the Company:

It is a platform that connects new-age digital-first brands with "relevant" sellers to sell their products and services to trust deficit, less tech-savvy users by building trust through assisted sales and support. It acts as a bridge between brands and the end consumers who need a physical touchpoint, in-person interactions, training, push, and motivation before buying a product/service.

We are looking for a passionate, self-driven, motivated, hands-on Tech enthusiast who has a strong understanding and is willing to shape, drive, and implement technology at our company. We are looking for someone who can build a product from scratch with a successful track record of building scalable software systems. If you are someone who believes in our core values and loves working in early-stage startups and enjoys working in a challenging environment, we welcome you with open arms!

This opportunity is for you if

● You have 4-6 Years of work experience in building highly-interactive applications using Java, Spring MVC, Spring JMS, Spring JDBC, Spring IOC, Spring Boot, MySQL, MiBatis, ReactJS, JavaScript, jQuery, AWS, JMS and have knowledge on a wide range of web technologies, tools, and Frameworks.
● You have experience in working with Restful web services
● You have strong knowledge and understanding of design patterns and domain-driven design
● You understand fundamental design principles behind building scalable, resilient, and
maintainable applications 
● You have functional knowledge of inclusive design: accessibility, and related tooling
● You have consumer web development experience for high-traffic, public-facing web
applications
● You have a knack for writing clean, readable, reusable code
● You have good knowledge of TDD and CI/CD practices.
● You have experience in managing and publishing releases using Git branching and tools like NPM and YARN.
● You have a penchant for learning
● You are a great analytical & logical thinker and someone who loves solving problems
● You are passionate, energetic, enthusiastic and a go-getter
● You are “ FUN @ Work “
Read more
Uber
at Uber
1 video
10 recruiters
Suvidha Chib
Posted by Suvidha Chib
Bengaluru (Bangalore)
7 - 15 yrs
₹0L / yr
skill iconJava
skill iconPython
skill iconGo Programming (Golang)
skill iconScala
Distributed Systems

Data Platform engineering at Uber is looking for a strong Technical Lead (Level 5a Engineer) who has built high quality platforms and services that can operate at scale. 5a Engineer at Uber exhibits following qualities: 

 

  • Demonstrate tech expertise Demonstrate technical skills to go very deep or broad in solving classes of problems or creating broadly leverageable solutions. 
  • Execute large scale projects Define, plan and execute complex and impactful projects. You communicate the vision to peers and stakeholders.
  • Collaborate across teams Domain resource to engineers outside your team and help them leverage the right solutions. Facilitate technical discussions and drive to a consensus.
  • Coach engineers Coach and mentor less experienced engineers and deeply invest in their learning and success. You give and solicit feedback, both positive and negative, to others you work with to help improve the entire team.
  • Tech leadership Lead the effort to define the best practices in your immediate team, and help the broader organization establish better technical or business processes.

What You’ll Do

  • Build a scalable, reliable, operable and performant data analytics platform for Uber’s engineers, data scientists, products and operations teams.
  • Work alongside the pioneers of big data systems such as Hive, Yarn, Spark, Presto, Kafka, Flink to build out a highly reliable, performant, easy to use software system for Uber’s planet scale of data. 
  • Become proficient of multi-tenancy, resource isolation, abuse prevention, self-serve debuggability aspects of a high performant, large scale, service while building these capabilities for Uber's engineers and operation folks.

 

What You’ll Need

  • 7+ years experience in building large scale products, distributed systems in a high caliber environment.
  • Architecture: Identify and solve major architectural problems by going deep in your field or broad across different teams. Extend, improve, or, when needed, build solutions to address architectural gaps or technical debt.
  • Software Engineering/Programming: Create frameworks and abstractions that are reliable and reusable. advanced knowledge of at least one programming language, and are happy to learn more. Our core languages are Java, Python, Go, and Scala.
  • Platform Engineering: Solid understanding of distributed systems and operating systems fundamentals such as concurrency, multithreading, file systems, locking etc.
  • Execution & Results: You tackle large technical projects/problems that are not clearly defined. You anticipate roadblocks and have strategies to de-risk timelines. You orchestrate work that spans multiple teams and keep your stakeholders informed.
  • A team player: You believe that you can achieve more on a team that the whole is greater than the sum of its parts. You rely on others’ candid feedback for continuous improvement.
  • Business acumen: You understand requirements beyond the written word. Whether you’re working on an API used by other developers, an internal tool consumed by our operation teams, or a feature used by millions of customers, your attention to details leads to a delightful user experience.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos