Cutshort logo
MNC logo
Data Engineer (Pyspark Developer)
MNC
Data Engineer (Pyspark Developer)
MNC's logo

Data Engineer (Pyspark Developer)

at MNC

Agency job
4 - 12 yrs
₹15L - ₹30L / yr
Remote, Bengaluru (Bangalore)
Skills
PySpark
Pyspark Developer
skill iconScala
DevOps

EXP-Developer-4 to 12 years

 

 

         Must have low-level design and development skills.  Should able to design a solution for given use cases. 

  • Agile delivery-  Person must able to show design and code on a daily basis
  • Must be an experienced PySpark developer and  Scala coding.   Primary skill is PySpark
  • Must have experience in designing job orchestration, sequence, metadata design, Audit trail, dynamic parameter passing and error/exception handling
  • Good experience with unit, integration and UAT support
  • Able to design and code reusable components and functions
  • Should able to review design, code & provide review comments with justification
  • Zeal to learn new tool/technologies and adoption
  • Good to have experience with Devops and CICD
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

NeoGenCode Technologies Pvt Ltd
Shivank Bhardwaj
Posted by Shivank Bhardwaj
Remote, Bengaluru (Bangalore), Chennai, Kolkata, Pune
9 - 12 yrs
₹10L - ₹42L / yr
skill iconJava
skill iconAmazon Web Services (AWS)
CI/CD
06692
AWS CloudFormation
+3 more

Job Description:

We are looking for a Lead Java Developer – Backend with a strong foundation in software engineering and hands-on experience in designing and building scalable, high-performance backend systems. You’ll be working within our Digital Engineering Studios on impactful and transformative projects in a fast-paced environment.


Key Responsibilities:

  • Lead and mentor backend development teams.
  • Design and develop scalable backend applications using Java and Spring Boot.
  • Ensure high standards of code quality through best practices such as SOLID principles and clean code.
  • Participate in pair programming, code reviews, and continuous integration processes.
  • Drive Agile, Lean, and Continuous Delivery practices like TDD, BDD, and CI/CD.
  • Collaborate with cross-functional teams and clients for successful delivery.


Required Skills & Experience:

  • 9–12+ years of experience in backend development (Up to 17 years may be considered).
  • Strong programming skills in Java and backend frameworks such as Spring Boot.
  • Experience in designing and building large-scale, custom-built, scalable applications.
  • Sound understanding of Object-Oriented Design (OOD) and SOLID principles.
  • Hands-on experience with Agile methodologies, TDD/BDD, CI/CD pipelines.
  • Familiarity with DevOps practices, Docker, Kubernetes, and Infrastructure as Code.
  • Good understanding of cloud technologies – especially AWS, and exposure to GCP or Azure.
  • Experience working in a product engineering environment is a plus.
  • Startup experience or working in fast-paced, high-impact teams is highly desirable.


Read more
Wissen Technology
at Wissen Technology
4 recruiters
Lokesh Manikappa
Posted by Lokesh Manikappa
Mumbai
4 - 9 yrs
₹15L - ₹32L / yr
skill iconJava
ETL
SQL
Data engineering
skill iconScala

Java/Scala + Data Engineer

 

Experience: 5-10 years

Location: Mumbai

Notice: Immediate to 30 days

Required Skills:

·       5+ years of software development experience.

·       Excellent skills in Java and/or Scala programming, with expertise in backend architectures, messaging technologies, and related frameworks.

·       Developing Data Pipelines (Batch/Streaming). Developing Complex data transformations, ETL Orchestration, Data Migration, Develop and Maintain Datawarehouse / Data Lakes.

·       Extensive experience in complex SQL queries, database development, and data engineering, including the development of procedures, packages, functions, and handling exceptions.

·       Knowledgeable in issue tracking tools (e.g., JIRA), code collaboration tools (e.g., Git/GitLab), and team collaboration tools (e.g., Confluence/Wiki).

·       Proficient in Linux/Unix, including shell scripting.

·       Ability to translate business and architectural features into quality, consistent software design.

·       Solid understanding of programming practices, emphasizing reusable, flexible, and reliable code.

Read more
Multinational Company providing energy & Automation digital
Multinational Company providing energy & Automation digital
Agency job
via Jobdost by Sathish Kumar
Hyderabad
3 - 5 yrs
₹10L - ₹14L / yr
Microservices
skill iconJava
Ansible
skill iconSpring Boot
Spring MVC
+8 more

Roles and Responsibilities

Java + Microservices Developer Responsibilies Hands-on experience of minimum 3-5 Years in development of scalable and extensible systems using Java. Hands-on experience into Microservices. Experience into frameworks like Spring, Spring MVC, Spring Boot, Hibernate etc. Good knowledge or hands-on experience with a minimum 1 year in Java Script Good working exposure into any Bigdata Technologies like Hadoop, Spark, Scala etc. Experience into Jenkins, Maven, Git. Solid and fluent understanding of algorithm and data structures. Excellent software design, problem-solving and analytical skills. Candidates graduated from Good schools like IIT's, NIIT's, IIIT's (Preferred). Excellent Communication Skills Experience in Database technology such as SQL & No SQL. Good understanding of Elastic Search, Redis, Routines Sync & Async
Read more
Research and Development Engineering Services Firm
Research and Development Engineering Services Firm
Agency job
via Jobdost by Sathish Kumar
Hyderabad
6 - 10 yrs
₹15L - ₹24L / yr
skill iconPython
skill iconDjango
skill iconFlask
skill iconAmazon Web Services (AWS)
Google Cloud Platform (GCP)
+4 more
We are a tech venture which provides Product Engineering, QA Automation, Infrastructure, Data, and Market Research services.

Technical Proficiency : 
Must have

  • Strong development experience in Python in the environment of Unix/Linux/Ubuntu
  • Strong practical knowledge of Python and its libraries.
  • Current working experience with cloud deployment of AWS/Azure/GCP, Microservice architecture, and Docker in Python.
  • Good knowledge of CI/CD and DevOps practices
  • Good Experience of Python with Django/ Scrapy/ Flask frameworks.
  • Good Experience in Jupyter/ Docker/ Elastic Search, etc.
  • Solid understanding of software development principles and best practices.
  • Strong analytical thinking and problem-solving skills.
  • Proven ability to drive large-scale projects with a deep understanding of Agile SDLC, high collaboration, and leadership.

Good to have : 
  • Expected to have migration experience from one version to the other, as this project is about migration to the latest version.
  • Preferred if had an OpenEdx platform experience or any LMS platform. 
Read more
Publicis Sapient
at Publicis Sapient
10 recruiters
Pooja Singh
Posted by Pooja Singh
Bengaluru (Bangalore), Mumbai, Gurugram, Noida, Hyderabad, Pune
4 - 19 yrs
₹1L - ₹15L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Microservices
+7 more
  • Experience building large scale, large volume services & distributed apps., taking them through production and post-production life cycles
  • Experience in Programming Language: Java 8, Javascript
  • Experience in Microservice Development or Architecture
  • Experience with Web Application Frameworks: Spring or Springboot or Micronaut
  • Designing: High Level/Low-Level Design
  • Development Experience: Agile/ Scrum, TDD(Test Driven Development)or BDD (Behaviour Driven Development) Plus Unit Testing
  • Infrastructure Experience: DevOps, CI/CD Pipeline, Docker/ Kubernetes/Jenkins, and Cloud platforms like – AWS, AZURE, GCP, etc
  • Experience on one or more Database: RDBMS or NoSQL
  • Experience on one or more Messaging platforms: JMS/RabbitMQ/Kafka/Tibco/Camel
  • Security (Authentication, scalability, performance monitoring)
Read more
Publicis Sapient
at Publicis Sapient
10 recruiters
Ankush Khatkar
Posted by Ankush Khatkar
Bengaluru (Bangalore)
1 - 8 yrs
₹4L - ₹12L / yr
skill iconJava
Spring
Design patterns
Multithreading
Databases
+8 more
Primary Responsibilities
 Providing technical expertise for every phase of the project lifecycle—from concept
development to solution design, implementation, optimization and support. Interacts
with a set of clients (client senior developers and architects) to create technology
specifications from business requirements for one of the modules within the project.
 Prepares the technical design of the more complex technology components within the
module (one or more of client/web presentation tier, server tier, data access and data
model, integration component, package function customization).
 Assists the architect in articulating the pros and cons of using a certain technology stack
or component or design pattern versus another to the clients and project team and
drives selection of technologies, designs to come up with the optimal architecture.
Drives the performance tuning, re-design and re-factoring for a module.
 Contributes to designing and implementing the build, releases process as well as system
configuration and deployment characteristics of the application.
Required Tech Stack
 2+ years of strong development skills in Java with JDK 1. 8 & above version &
Microservices with Spring boot/ Spring.
 Should have strong acumen in Data Structures, Algorithms, problem-solving and Logical/
Analytical skills.
 Thorough understanding of OOPS concepts, Design principles and implementation of
different type of Design patterns.
 Sound understanding of concepts like Exceptional handling, Serialization/Deserialization
and Immutability concepts, etc.
 Good fundamental knowledge in Enums, Collections, Annotations, Generics, Auto
boxing, etc. Experience with Multithreading, Concurrent Package and Concurrent APIs Basic
understanding of Java Memory Management (JMM) including garbage collections
concepts.
 Experience in RDBMS or NO SQL databases and writing SQL queries (Joins, group by,
aggregate functions, etc.)
 Experience with at-least one NoSQL (Any of Cassandra/Couch base/Hadoop), Hands-on
experience with JMS
 Hands-on experience in creating RESTful webservices and consuming webservices
 Hands-on experience with Spring.
 Hands-on experience with any of the logging frameworks (SLF4J/LogBack/Log4j)
 Experience of writing Junit test cases using Mockito / Powermock frameworks.
 Should have practical experience with Maven/Gradle and knowledge of version control
systems like Git/SVN etc.
 Good communication skills and ability to work with global teams to define and deliver
on projects.
 Sound understanding/experience in software development process, test-driven
development
Read more
RaRa Now
at RaRa Now
3 recruiters
Puneeta Mishra
Posted by Puneeta Mishra
Remote only
5 - 8 yrs
₹7L - ₹15L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
skill iconNodeJS (Node.js)
+5 more

About Rara Delivery

Not just a delivery company…

RaRa Delivery is revolutionising instant delivery for e-commerce in Indonesia through data driven logistics.

RaRa Delivery is making instant and same-day deliveries scalable and cost-effective by leveraging a differentiated operating model and real-time optimisation technology. RaRa makes it possible for anyone, anywhere to get same day delivery in Indonesia. While others are focusing on ‘one-to-one’ deliveries, the company has developed proprietary, real-time batching tech to do ‘many-to-many’ deliveries within a few hours.. RaRa is already in partnership with some of the top eCommerce players in Indonesia like Blibli, Sayurbox, Kopi Kenangan and many more.

We are a distributed team with the company headquartered in Singapore 🇸🇬 , core operations in Indonesia 🇮🇩 and technology team based out of India 🇮🇳

Future of eCommerce Logistics.

  • Data driven logistics company that is bringing in same day delivery revolution in Indonesia 🇮🇩
  • Revolutionising delivery as an experience
  • Empowering D2C Sellers with logistics as the core technology


About the Role
  • 5 - 7 years Experience with the following technologies: Core Java/J2EE, Spring Boot, Creating API, Hibernate, JDBC, SQL/PLSQL, messaging architecture, REST/Web services, Linux
  • Expertise in application, data and infrastructure architecture disciplines
  • Advanced knowledge of architecture, design and business processes
  • 4+ years of Java, J2EE development experience
  • Strong technical development experience in effectively writing code, performing code reviews, and implementing best practices on configuration management and code refactoring
  • Experience in working with vendor applications
  • Experience in making optimized queries to MySQL database
  • Proven problem solving and analytical skills
  • A delivery-focused approach to work and the ability to work without direction
  • Experience in Agile development techniques, including Scrum
  • Experience implementing and/or using Git
  • Ability to work collaboratively in teams and develop meaningful relationships to achieve common goals
  • Bachelor degree in Computer Science or related discipline preferred
Read more
Artivatic
at Artivatic
1 video
3 recruiters
Layak Singh
Posted by Layak Singh
Bengaluru (Bangalore)
3 - 7 yrs
₹6L - ₹15L / yr
skill iconPython
skill iconJava
RESTful APIs
skill iconScala
Cassandra
+4 more
About Artivatic :Artivatic is technology startup that uses AI/ML/Deeplearning to build intelligent products & solutions for finance, healthcare & insurance businesses. It is based out of Bangalore with 20+ team focus on technology. Artivatic building is cutting edge solutions to enable 750 Millions plus people to get insurance, financial access and health benefits with alternative data sources to increase their productivity, efficiency, automation power and profitability, hence improving their way of doing business more intelligently & seamlessly. Artivatic offers lending underwriting, credit/insurance underwriting, fraud, prediction, personalization, recommendation, risk profiling, consumer profiling intelligence, KYC Automation & Compliance, automated decisions, monitoring, claims processing, sentiment/psychology behaviour, auto insurance claims, travel insurance, disease prediction for insurance and more. We have raised US $300K earlier and built products successfully and also done few PoCs successfully with some top enterprises in Insurance, Banking & Health sector. Currently, 4 months away from generating continuous revenue.Skills : - Building server-side logic that powers our APIs, in effect deploying machine learning models in production system that can scale to billions of API calls - Scaling and performance tuning of database to handle billions of API calls and thousands of concurrent requests - Collaborate with data science team to build effective solutions for data collection, pre-processing and integrating machine learning into the workflow - Collaborate, provide technical guidance, and engage in design and code review for other team members. - Excellent Scala, cassandara, architect, api, software, python, Java programming and software design skills, including debugging, performance analysis and test design - Proficiency with at least one Scala, GoLang, Python micro frameworks like Flask, Tornado, Play, Spring etc. with experience in building REST APIs - Experience or understanding in building web crawlers, data fetching bots etc. - Experience with design and optimisation of Neo4j, cassandra, NoSQL databases, PostGreSQL, Redis, Elastic Search - Familiarity with one of the cloud service providers, AWS or Google Compute Engine - Computer Science degree with 4+ years of backend programming experience Experience : 3 Years+ Location : Sony World Signal, Koramangala 4th Block, Bangalore
Read more
Diligent Force Labs Pvt Ltd
anusha padamata
Posted by anusha padamata
Rajahmundry
1 - 3 yrs
₹2L - ₹3L / yr
skill iconJava
skill iconC++
Data Structures
Algorithms
skill iconScala
+3 more

Immediate Interviewing for Developer for Rajahmundry  Location.

Job Description:

1+ Years Experience on software development on any software language.

Experience with software design and development in a test-driven environment

Knowledge of coding languages (e.g. C++, Java, JavaScript) and frameworks/systems (e.g. AngularJS, Git)

Ability to learn new languages and technologies

Problem-solving aptitude

Excellent communication and presentation skills

Read more
International design & Engineering solutions pvt ltd
Pune
2 - 6 yrs
₹4L - ₹12L / yr
skill iconC++
skill iconC#
Algorithms
skill iconJava
Data Structures
+3 more
Work with developers to design algorithms and flowcharts Prepare GUI dummy screens for proposed Software development using Excel VBA. (To Give a overview how the software buttons and flow of information should happen) Coordination with Software Developer team to explain the criteria Produce clean, efficient code based on specifications Integrate software components and third-party programs Verify and deploy programs and systems Troubleshoot, debug and upgrade existing software Gather and evaluate user feedback Recommend and execute improvements Create technical documentation for reference and reporting Proven experience as a Software Developer, Software Engineer or similar role Familiarity with development methodologies Experience with software design and development in a test-driven environment Knowledge of coding languages (e.g. C#, C++) and frameworks/systems Ability to learn new languages and technologies Excellent communication skills Resourcefulness and troubleshooting aptitude Attention to detail Sound technical knowledge, thorough knowledge of all related codes and section details is desired. Thorough Knowledge of Design of Components of Residential / Commercial Structures is Desired. Accuracy In Following The Process & Jobs Is Required. Experience in Interaction with International Client Will Be Preferred
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos