Cutshort logo
Technology service company logo
Sr. Spark Software Engineer
Technology service company
Sr. Spark Software Engineer
Jobdost's logo

Sr. Spark Software Engineer

at Technology service company

Agency job
5 - 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Ansible
skill iconGit
JIRA
Apache Spark
Spark
Apache Kafka
Microservices
skill iconKubernetes
Terraform
NOSQL Databases
API
skill iconDocker
  • Bachelor’s or master’s degree in Computer Engineering, Computer Science, Computer Applications, Mathematics, Statistics, or related technical field. Relevant experience of at least 3 years in lieu of above if from a different stream of education.

  • Well-versed in and 3+ hands-on demonstrable experience with: ▪ Stream & Batch Big Data Pipeline Processing using Apache Spark and/or Apache Flink.
    ▪ Distributed Cloud Native Computing including Server less Functions
    ▪ Relational, Object Store, Document, Graph, etc. Database Design & Implementation
    ▪ Micro services Architecture, API Modeling, Design, & Programming

  • 3+ years of hands-on development experience in Apache Spark using Scala and/or Java.

  • Ability to write executable code for Services using Spark RDD, Spark SQL, Structured Streaming, Spark MLLib, etc. with deep technical understanding of Spark Processing Framework.

  • In-depth knowledge of standard programming languages such as Scala and/or Java.

  • 3+ years of hands-on development experience in one or more libraries & frameworks such as Apache Kafka, Akka, Apache Storm, Apache Nifi, Zookeeper, Hadoop ecosystem (i.e., HDFS, YARN, MapReduce, Oozie & Hive), etc.; extra points if you can demonstrate your knowledge with working examples.

  • 3+ years of hands-on development experience in one or more Relational and NoSQL datastores such as PostgreSQL, Cassandra, HBase, MongoDB, DynamoDB, Elastic Search, Neo4J, etc.

  • Practical knowledge of distributed systems involving partitioning, bucketing, CAP theorem, replication, horizontal scaling, etc.

  • Passion for distilling large volumes of data, analyze performance, scalability, and capacity performance issues in Big Data Platforms.

  • Ability to clearly distinguish system and Spark Job performances and perform spark performance tuning and resource optimization.

  • Perform benchmarking/stress tests and document the best practices for different applications.

  • Proactively work with tenants on improving the overall performance and ensure the system is resilient, and scalable.

  • Good understanding of Virtualization & Containerization; must demonstrate experience in technologies such as Kubernetes, Istio, Docker, OpenShift, Anthos, Oracle VirtualBox, Vagrant, etc.

  • Well-versed with demonstrable working experience with API Management, API Gateway, Service Mesh, Identity & Access Management, Data Protection & Encryption.

    Hands-on experience with demonstrable working experience with DevOps tools and platforms viz., Jira, GIT, Jenkins, Code Quality & Security Plugins, Maven, Artifactory, Terraform, Ansible/Chef/Puppet, Spinnaker, etc.

  • Well-versed in AWS and/or Azure or and/or Google Cloud; must demonstrate experience in at least FIVE (5) services offered under AWS and/or Azure or and/or Google Cloud in any categories: Compute or Storage, Database, Networking & Content Delivery, Management & Governance, Analytics, Security, Identity, & Compliance (or) equivalent demonstrable Cloud Platform experience.

  • Good understanding of Storage, Networks and Storage Networking basics which will enable you to work in a Cloud environment.

  • Good understanding of Network, Data, and Application Security basics which will enable you to work in a Cloud as well as Business Applications / API services environment.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

IT Services Firm
IT Services Firm
Agency job
Pune
3 - 5 yrs
₹2L - ₹9L / yr
skill iconJava
skill iconSpring Boot
J2EE
RESTful APIs
Hibernate (Java)
+14 more
Hi,
We are looking for java developers with the following skill sets
Experience - 3+ years of experience in IT sector with exposure to non-banking porjects
 
 
MUST to Have
  • 3+ years of Experience in software Design and development and familiar with technologies - Java, Java-J2EE, Spring Boot, Hibernate, Ajax, REST API, Micro services etc.
  • Working knowledge of JVM internals
  • Working knowledge of any database (MySQL or HSQLDB)
  • Working knowledge of No-SQL database (Mongo or Dynamo DB)
  • Working experience with messaging (JMS/RabbitMQ)
  • R & D on new advanced cloud-based technologies in a test-driven agile development.
  • Knowledge in designing and architecting systems with high scalability and performance requirements.
  • Ability to understand infrastructure for performance evaluation and reporting of cloud-based services, namely AWS
  • knowledge of key AWS services like EC2, S3, Lambda, CloudWatch etc.
  • Certification on AWS Fundamendals
  • Excellent communication skills
  • ability to effectively articulate technical challenges and solutions
  • skilled in interfacing with internal and external technical resources
  • Good in debugging problems and mentoring teams on technical front
 
 
Read more
Ambab Infotech Pvt ltd
at Ambab Infotech Pvt ltd
4 recruiters
Pooja Sapkal
Posted by Pooja Sapkal
Remote only
4 - 12 yrs
₹5L - ₹11L / yr
Magento
skill iconGit
Bitbucket
skill iconAmazon Web Services (AWS)
Unit testing
Senior Magento Engineers
Experience is 4-7 years candidate who has working experience in Magento2.
Strong hands on experience in all Magento Major modules.
Able to analyze and debug the issues quickly and provide resolution
Experience in Magento2 design , technical solution providing,
Strong attention to details and outstanding skills in Magento 2 problem solving.
Knowledge in GIT, BitBucket, AWS
Experience in Magento2 unit tests, code reviews, architecture reviews
Read more
JetSynthesys Pvt. Ltd.
at JetSynthesys Pvt. Ltd.
1 recruiter
Agency job
via Jobdost by Mamatha A
Remote, Pune
3 - 6 yrs
₹12L - ₹15L / yr
Game Design
Game development
2D animation
Unity 3D
skill iconC#
+10 more
This is a very exciting role where you will be working on games in close collaboration with the UK studio of one of our prestigious MNC gaming clients. You will be integrated directly into their UK team and will be working alongside the other team members from the UK or across the globe on this game. You will be reporting into their team and will be following all their procedures, process, and timeline for developing their games. This will be a great learning and enriching experience for the selected candidate.

Primary Skills
● Exceptional problem solving skills
● Significant coding experience in C#
● Strong knowledge Unity Game Engine
● Good understanding of unity art pipeline specially 2D.
● Good experience in developing multi platform user interfaces.
● Strong Debugging and Optimization skills.
● Experience in integrating REST API
● Strong knowledge of Object Oriented Programming and Design Patterns.
● Strong understanding of Data Structures and algorithms.
● Good written and oral communication skills. Secondary Skills
● Good knowledge of 2D/3D maths, Linear Algebra , Matrices etc.
● Experience in using JIRA and Confluence etc
● Experience in using SVN, GIT etc. 

Experience Required

Min 0-6 Years of professional experience in developing games for MOBILE platforms - iOS and Android. 

Salary INR 12-15 LPA

Job Location Work From Home/ Pune.

Work Timing IST 12:PM - 9:00PM
Read more
Nexsys
at Nexsys
2 recruiters
Kiran Basavaraj  Nirakari
Posted by Kiran Basavaraj Nirakari
Bengaluru (Bangalore)
2 - 7 yrs
₹15L - ₹30L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
skill iconMongoDB
+1 more
About Embibe
At Embibe, we have just one mission - to truly personalize education. Because every child deserves it. This has led us to embark on this noblest of journeys to deliver life and learning outcomes for every student! Rooted in consumer behavior, we are leveraging AI and Data Science to deliver personalized achievement journeys for every student.
We are a tribe of intellectually fierce people from diverse backgrounds, focused on building cutting-edge products that empower everyone in the education ecosystem - students, teachers, educational institutes and parents. We enable a deeper understanding of student behavior, their strengths and weaknesses through analysis at a granular level. It is this shared vision of democratizing and personalizing education that unites us all.
Embibe is powered by AI and data science algorithms, using these contents being recommended across platforms and millions of learning outcomes delivered to students. Since its inception, millions of students have used the imbibe platform for learning concepts and outcomes. Academic users have spent 52mins on average with an average of 3 sessions daily. Embibe has been launched for 12 languages across India with support for 361 Exams (English), and 120 Exams (Hindi) for K6-K12 having 22.6L+ Qs and 58k+ Tests, 29k videos, 50k+ 3D assets. Embibe is the world's largest live online public sector implementation in edtech for test preparation, NTA app which is powered by Embibe has 3.1Mn+ downloads, and 14.3Mn hours spent by users with total 13.4Mn sessions and 1.64Bn attempts.SchoolApp is currently being used by 1000s of schools across India and we are planning to scale it to 100Mn students with 1Mn schools with 10Mn teachers in the period of the next 3yrs.
Prerequisite
We are looking for a Software Engineer across levels who have ever contributed to any large-scale systems be it content platform e.g. Quora/Medium, streaming platform e.g. Netflix or Hotstar, activity log system e.g. Twitter feeds or payment systems like Razorpay to name a few. I/O, Read-Writes, DB connections, Distributed Locking, Memory, Bandwidth, High Throughput, Low Latency and minimal CPU cycles excite you!! You are deep thinkers and can bring ideas to the table, before starting writing the code!!
Interested? We'd love to hear from you.
Who are you?
● 2-14yrs years of relevant large-scale product company experience ideally in a fast-moving B2C/B2B environment.
● Programming. Proficiency in object-oriented and multi-threaded programming in at least one of the following languages: Java, Python,React.js, Node.js, Next.js, PHP, Golang etc.
● Deep understanding & experience of high-performance web-scale & real-time response systems, and large scale distributed systems.
● CS Fundamentals – exposure to a wide variety of problem spaces, Good in Data Structures and Algorithms Design, Problem Solving.
● Open source contributors and can do quick POC of technologies will catch our eyes.
● Expertise in designing, implementing and operating distributed Systems architectures and concepts, especially on public cloud infrastructure (AWS/Azure)
● Demonstrated expertise in applying systems patterns (e.g., Client-server, N-tier, Master/Slave, MVC) and API constructions (e.g., Swagger, OpenAPI).
● Experience in a high-availability 24/7 environment (cloud platforms are a plus). Expertise should include several of the following:
○ High-performance,up-time (99.999%) and self-recoverable systems.
○ Control, orchestration and automation platforms leveraging containers or VMs. ○ RPC frameworks (e.g., Protobuf/gRPC, Thrift, Bond)
● Experience with one or more Data Stores like (MySql, Postgres ) and NoSQL DataStores ( Mongo, Cassandra, Scylladb, Hbase, Redis, Aerospike etc.).
● Experience with Agile software development, TDD, and Continuous Integration. ● Experience in building Web/RESTFul/GraphQL services.
● Sound knowledge of *Nix, ORM(Hibernate, JPA), Spring ecosystem, Messaging platforms like Kafka/RMQ, build framework like Maven/Gradle etc.
● Very strong system design and object-oriented skills with a nifty ability to craft clean interfaces and operate at the right levels of abstraction.
● Solid coding skills with the ability to drive teams through massive refactoring exercises & improve coding standards across large code bases.
● Deep knowledge, understanding & experience of working with a large variety of multi-tier architectures. Awareness of pitfalls & use cases for a large variety of solutions. ● Exposure to complete product development cycles – from inception to production to scaling up, supporting new requirements, and re-architectures.
● Having experience building web infrastructure in cloud environments (such as AWS or Azure/GCP) is a plus. You understand and are always excited about learning new e.g.docker, Kubernetes.
● Education. M.Tech/M.Eng in Computer Science/Engineering or B.Tech/B.E in the same disciplines with equivalent years of experience would be a plus.
We'd particularly love it if:
● You’re a steward for engineering quality, reliability, scalability, availability, maintainability, flexibility habits and mindset in the organization under your purview, You know SOLID,12 factor App and Design Principles which you can apply or help the team in applying as needed. You can assure that our architectures are consistent with industry best practices. ● Version control tools like Git, SVN etc are good to have.
● Gather, understand, and prioritize requirements, research potential solutions, rapidly build prototypes, and distill and communicate what was learned, expected risks, resources & security concerns.
● Mentoring more junior engineers to instill engineering best practices and driving high standards in documentation, code reviews, design reviews, architecture discussions and strategy roadmap development.
● Actively participate in development along with team members - creating modules & systems that can then be treated as a working reflection of the best practices.
● Set the vision of the domain architecture and technology stack for technology in your organization, You understand LLD and HLD.
● Be an evangelist for technology - drive a culture of curiosity and active debate around technology in your organization.
● Experiment with new & relevant technologies and tools, and drive adoption while measuring yourself on the impact you are able to create.
Note: We just use degrees to measure the Temperature!!
Read more
Suven Consultants
at Suven Consultants
3 recruiters
Nidhi Vohra
Posted by Nidhi Vohra
Mumbai
5 - 9 yrs
₹15L - ₹24L / yr
skill iconJava
skill iconSpring Boot
MVC Framework
Spring MVC
RESTful APIs
+5 more
Job Description :

Exp - 5 - 9 years

Skills : Java, Spring MVC, Spring Boot, HTML, CSS, JavaScript, Angular.js, RESTful APIs

- Looking for Senior Java Developers with strong core java skills and event-driven - microservices development.

- Exp. in Banking Domain added as advantage

Responsibilities:

1. Experience working in Lean and agile environments and practising Scrum

2. Designing of robust and scalable solutions to support Enterprise application

3. Develop and support middle ware applications using Java / Open Source

4. Provide second level support to fixes and solutions for issues in production

5. Enhance and maintain applications and components for Liquidity functions.

6. Experience in Designing scalable solutions

7. Engineering architecture, platform configuration, and documentation experience.

8. Knowledge of modern development lifecycles, such as Agile and iterative development

9. Knowledge of Biodata with HBase and spark is an added advantage

10. Collaborate with BA, QA and PM team members for effective testing and delivery.

Requirements :

1. 5+ years of experience in core Java

2. Experience in Spring MVC, Spring Boot

3. Strong database and data management experience in relational databases

4. Excellent verbal and written communication skills in English Desired Qualifications

5. Knowledge of HTML, CSS, JavaScript, Angular.js

6. Experience in event-driven workflow processing using Kafka, ActiveMQ, or Netflix OSS or similar

7. Exp. in Banking Domain added as advantage
Read more
Bijnis
at Bijnis
2 recruiters
Vidhyotma Singh
Posted by Vidhyotma Singh
NCR (Delhi | Gurgaon | Noida)
5 - 8 yrs
₹10L - ₹30L / yr
skill iconPython
skill iconGo Programming (Golang)
skill iconJava
skill iconNodeJS (Node.js)

You will:

    • Build services that serve millions of users
    • Build for performance, reliability, and scalability
    • Design easy-to-use APIs, systems, and tools
    • Work with small teams of engineers, product, design, operation and other teams
    • Lead projects, achieve goals, celebrate success with your teams

What you bring:

    • 5+ years as individual contributor
    • Strong background in Computer Science
    • Strong technical expertise in robust and scalable server platform
    • Helpful experiences include Java, Python, AWS, GCP, DevOps
    • Leadership at bijnis is a service - you must be influential, patient, compassionate, able to prioritize, and able to inspire
    • Ability to collaborate across multiple and cross functional teams
    • Strategic mindset combined with pragmatic execution, and bias for action
Read more
Impulsive Web Private Limited
Kunal Pawar
Posted by Kunal Pawar
Remote, NCR (Delhi | Gurgaon | Noida)
2 - 7 yrs
₹2L - ₹5L / yr
skill iconJava
J2EE
Struts
Spring
Hibernate (Java)
+2 more
-Strong coding experience with  Core Java, Springboot, Hibernate, Spring Microservices.
- Strong experience with REST/SOAP web services, JSON, XML and design patterns.
- Good knowledge of Data Structures and Advance DS
- Proficient in test-driven development, latency problem solving, architecture solving and high-level troubleshooting.
- Good understanding of Database and SQL queries.
- Highly proficient in analytical and problem-solving skills with attention to details.
- Demonstrated Agile (Scrum) experience.
- Experience with full software lifecycle and deploying applications to Production.
- Must be a self-starter/self-directed member of the team.
- Must have the ability to translated user requirements into design and implementation.
- Highly proficient in written and communication skills.
Read more
Unio labs Private Limited
Mahender Verma
Posted by Mahender Verma
NCR (Delhi | Gurgaon | Noida)
1 - 2 yrs
₹1L - ₹3L / yr
skill iconBootstrap
skill iconAngularJS (1.x)
skill iconJavascript
skill iconPHP
skill iconNodeJS (Node.js)
+3 more
We are the fast growing company in the field of IOT and other core hardware equipment.
Read more
Diligent Force Labs Pvt Ltd
anusha padamata
Posted by anusha padamata
Rajahmundry
1 - 3 yrs
₹2L - ₹3L / yr
skill iconJava
skill iconC++
Data Structures
Algorithms
skill iconScala
+3 more

Immediate Interviewing for Developer for Rajahmundry  Location.

Job Description:

1+ Years Experience on software development on any software language.

Experience with software design and development in a test-driven environment

Knowledge of coding languages (e.g. C++, Java, JavaScript) and frameworks/systems (e.g. AngularJS, Git)

Ability to learn new languages and technologies

Problem-solving aptitude

Excellent communication and presentation skills

Read more
UnitedHealth Group Inc. iS 5th largest company in the world , in the Fortune lis
UnitedHealth Group Inc. iS 5th largest company in the world , in the Fortune lis
Agency job
via Next Step Services by shakun shahi
Hyderabad
5 - 13 yrs
₹15L - ₹26L / yr
skill iconJava
Agile/Scrum
ITIL
DevOps
Big Data
+2 more
Full Stack Developer belongs to Self-Organizing and Cross Functional development team and is able to convert sprint backlog items to shippable product. He collectively owns end to end development responsibility for a given Agile Team / POD. He will design, code and test the user stories committed for a sprint. Works independently under limited supervision. Possess skills to effectively deal with issues,challenges within field of specialization to develop application solutions. Primary Responsibilities:  Lead an agile team within a Release Team/Value Stream or IT Support Team.  Accountable for team delivery.  Develop and automate business solutions by creating new and modifying existing software applications.  Develop innovation, strategies, processes, and best practices  Technically hands on and excellent in Design, Coding and Testing.  Collectively responsible for end to end product quality.  Creation of high/low level application design.  Participates and contributes in Sprint Ceremonies.  Promote and develop the culture of collaboration, accountability & quality.  Provides technical support to team. Helps team in resolving technical issues .  Closely working Business Teams, Onshore partners, deployment and infrastructure teams.  <Others – If any> Required Qualifications:  8 - 13 Years of experience - working on multiple layer of technology  Excellent verbal, written and interpersonal communication skills  Demonstrate capability to create high/low level designs.  Engineering Practices o Agile:  Working experience of 2+ year in “Agile team”.  Understanding of various agile methodologies such as Scrum, Kanban  Working experience of Test Driven Development. o ITIL/ITSM: Good understanding of IT Support / Production Support o Data / Information Security – Working knowledge on the below –  Common security vulnerabilities, their causes and implementations to fix the same.  Security scanning methodologies and tools (e.g. HP Fortify, Whitehat, Webinspect) o Good in Data Structure, Algorithms and Design Patterns. o Demonstrates excellent problem solving skills. o Good in design thinking and approach to solve business problem by applying suitable technologies (cost efficient, high performance, resilient and scalable).  Common Technical Skills o Database: 2+ year working experience of database (SQL or PL/SQL), Good knowledge of. Exposure to Big Data, NoSQL/Flat Database. o API /Web Services: 1+ year working experience in Web Services / API, REST Architecture etc. o DevOps:  Working experience in set up or maintenance of CI/CD pipeline (test, build , deployment and monitoring automation)  2+ years working experience of software configuration management and packaging.  Experience in using automated deployment and release management tools such as XL Deploy, XL Release, Jenkins.  2+ years working knowledge of build tools such as Maven/Gradle o Cloud: Working experience or good knowledge of cloud platforms (e.g OpenShift, Azure, AWS). Capable of demonstrating how to develop a sample cloud based application / micro- services architecture. o Open Source:  Demonstrate hands on knowledge of OpenSource adoption and use cases.  Real implementation experience of one or more open source technology (MySQL, JBoss Platform, Apache Camel)  Good to have - Contributing to one or more technical forums related to an open source technology.  Product / Project / Program Related Tech Stack : o Front End – <Desired Technologies and Tools> o Back End – <Desired Technologies and Tools> o Middleware – <Desired Technologies and Tools> o Testing - <Desired Technologies and Tools> o DevOps - <Desired Tools> o Others – <Desired Technologies and Tools> o Certifications - <Desired Certifications> o Development Methodology / Engineering Practices – Agile (SCRUM / KANBAN / SAFe) Preferred Qualifications:  Excellent verbal, written and interpersonal communication skills  Ability to work collaboratively in a global team with a positive team spirit  Knowledge of US Healthcare domain  Knowledge or certification – SAFe  Knowledge of certification – ITIL  Work experience in product engineering
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos