Cutshort logo
MNC logo
Data Engineer (Pyspark Developer)
MNC
Data Engineer (Pyspark Developer)
MNC's logo

Data Engineer (Pyspark Developer)

at MNC

Agency job
4 - 12 yrs
₹15L - ₹30L / yr
Remote, Bengaluru (Bangalore)
Skills
PySpark
Pyspark Developer
skill iconScala
DevOps

EXP-Developer-4 to 12 years

 

 

         Must have low-level design and development skills.  Should able to design a solution for given use cases. 

  • Agile delivery-  Person must able to show design and code on a daily basis
  • Must be an experienced PySpark developer and  Scala coding.   Primary skill is PySpark
  • Must have experience in designing job orchestration, sequence, metadata design, Audit trail, dynamic parameter passing and error/exception handling
  • Good experience with unit, integration and UAT support
  • Able to design and code reusable components and functions
  • Should able to review design, code & provide review comments with justification
  • Zeal to learn new tool/technologies and adoption
  • Good to have experience with Devops and CICD
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Financial Services Industry
Financial Services Industry
Agency job
via Peak Hire Solutions by Dhara Thakkar
Hyderabad
4 - 5 yrs
₹10L - ₹20L / yr
skill iconPython
CI/CD
SQL
skill iconKubernetes
Stakeholder management
+14 more

Required Skills: CI/CD Pipeline, Kubernetes, SQL Database, Excellent Communication & Stakeholder Management, Python

 

Criteria:

Looking for 15days and max 30 days of notice period candidates.

looking candidates from Hyderabad location only

Looking candidates from EPAM company only 

1.4+ years of software development experience

2. Strong experience with Kubernetes, Docker, and CI/CD pipelines in cloud-native environments.

3. Hands-on with NATS for event-driven architecture and streaming.

4. Skilled in microservices, RESTful APIs, and containerized app performance optimization.

5. Strong in problem-solving, team collaboration, clean code practices, and continuous learning.

6.  Proficient in Python (Flask) for building scalable applications and APIs.

7. Focus: Java, Python, Kubernetes, Cloud-native development

8. SQL database 

 

Description

Position Overview

We are seeking a skilled Developer to join our engineering team. The ideal candidate will have strong expertise in Java and Python ecosystems, with hands-on experience in modern web technologies, messaging systems, and cloud-native development using Kubernetes.


Key Responsibilities

  • Design, develop, and maintain scalable applications using Java and Spring Boot framework
  • Build robust web services and APIs using Python and Flask framework
  • Implement event-driven architectures using NATS messaging server
  • Deploy, manage, and optimize applications in Kubernetes environments
  • Develop microservices following best practices and design patterns
  • Collaborate with cross-functional teams to deliver high-quality software solutions
  • Write clean, maintainable code with comprehensive documentation
  • Participate in code reviews and contribute to technical architecture decisions
  • Troubleshoot and optimize application performance in containerized environments
  • Implement CI/CD pipelines and follow DevOps best practices
  •  

Required Qualifications

  • Bachelor's degree in Computer Science, Information Technology, or related field
  • 4+ years of experience in software development
  • Strong proficiency in Java with deep understanding of web technology stack
  • Hands-on experience developing applications with Spring Boot framework
  • Solid understanding of Python programming language with practical Flask framework experience
  • Working knowledge of NATS server for messaging and streaming data
  • Experience deploying and managing applications in Kubernetes
  • Understanding of microservices architecture and RESTful API design
  • Familiarity with containerization technologies (Docker)
  • Experience with version control systems (Git)


Skills & Competencies

  • Skills Java (Spring Boot, Spring Cloud, Spring Security) 
  • Python (Flask, SQL Alchemy, REST APIs)
  • NATS messaging patterns (pub/sub, request/reply, queue groups)
  • Kubernetes (deployments, services, ingress, ConfigMaps, Secrets)
  • Web technologies (HTTP, REST, WebSocket, gRPC)
  • Container orchestration and management
  • Soft Skills Problem-solving and analytical thinking
  • Strong communication and collaboration
  • Self-motivated with ability to work independently
  • Attention to detail and code quality
  • Continuous learning mindset
  • Team player with mentoring capabilities


Read more
BigRio
Disha Bhardwaj
Posted by Disha Bhardwaj
Remote only
5 - 12 yrs
₹35L - ₹38L / yr
skill icon.NET
skill iconC#
CI/CD
skill iconKubernetes
Terraform
+3 more

Key Responsibilities:

●    Software Development: Iteratively and incrementally design, develop, test and maintain applications and services using C# and .NET.

●    CI/CD Pipelines: Develop, maintain, and optimize continuous integration and continuous delivery pipelines using GitLab, Devtron and Kubernetes.

●    Teamwork and Pair/Mob Programming: Engage with developers, operations, and team members via pair or mob programming sessions to ensure the highest quality product delivery.

●    Containerization: Contribute to the push toward full containerization and zero-downtime deployment goals

●    DevOps Practices: Implement and maintain infrastructure as code (IaC) using tools such as bicep and Terraform.

●    Monitoring and Logging: Implement and manage monitoring, logging, and alerting solutions using tools like OpenTelemetry, Prometheus, Grafana to make our products more supportable.

●    Design and Architecture: Contribute to on-going discussion of our evolving software design and architecture.

●    Cloud Management: Assist in managing and optimizing our private cloud infrastructure (VMWare Tanzu) to ensure high availability, scalability, and efficient resource usage.

●    Security: Implement security best practices and ensure compliance with relevant regulations and standards.

●    Automation: Identify opportunities for automation to improve efficiency, reduce manual efforts and deskilling in deployment, testing and maintenance tasks.

●    Troubleshooting: Diagnose and resolve infrastructure and application issues promptly and effectively.

●    Documentation: Create and maintain comprehensive documentation for applications, infrastructure, processes, and procedures.

●    Continuous Improvement: Advocate for and implement best practices promoting a culture of continuous improvement.

Qualifications:

Minimum of 5 years of experience in software development, particularly with C# and .NET.

Must have skills:

●    Strong knowledge of C# programming language and .NET stack

●    Familiarity with CI/CD tools and practices, including TDD.

●    Understanding of DevOps principles

●    Strong collaboration and communication skills.

Nice to have skills

●    Familiarity with containerization and orchestration tools like Docker and Kubernetes is a plus.

●    Knowledge of infrastructure as code (IaC).

●    Experience in scripting languages such as Python, Bash, or PowerShell is a bonus.

●    Excellent problem-solving skills and attention to detail.

●    Experience with pair/mob programming.

●    Understanding of networking concepts and security best practices.

Read more
Simprosys Infomedia
Careers Simprosys
Posted by Careers Simprosys
Ahmedabad
3 - 8 yrs
₹6L - ₹12L / yr
skill iconPython
skill iconDjango
FastAPI
skill iconFlask
SQL
+8 more

About Simprosys InfoMedia:

Simprosys is a diverse team of E-commerce enthusiasts with a simple yet powerful goal of empowering E-commerce merchants with easily adaptable product listings’ and Ad management solutions. 


Our crew consists of budding techies developers who build and maintain the technological interventions to automate our product listing and ad management solutions. Support executives who are digital marketers themselves. Passionate designers with exceptional UI designing, motion graphics, animation, and video editing skills. Our marketing team consists of versatile content creators and brand strategists. 


Be a part of our E-commerce enthusiasts crew.


Job Title: Sr. Python Developer

Location: Ahmedabad (Onsite)

 

Skill Set: Python, JavaScript, Python frameworks (Flask, Django, Django Rest Framework), AWS, Data Science, Machine Learning.

 Responsibilities:

  1. Develop and maintain Python applications, using frameworks like Flask or Django to create and manage APIs and web services.
  2. Integrate various data sources and databases, including SQL (MySQL, PostgreSQL) and NoSQL (MongoDB, Redis) systems, into a unified solution.
  3. Model data for reporting and analysis, leveraging libraries like NumPy, Pandas, and Matplotlib to provide insights and communicate results to stakeholders.
  4. Utilize AWS services, such as DynamoDB and Lambda, to build and deploy efficient, cloud-based solutions.
  5. Manage code versions with GIT, ensuring effective tracking and collaborative development practices.
  6. Employ strong debugging and optimization skills to ensure high performance and resolve issues promptly.

Requirements:

  1. Strong knowledge and hands-on experience with Python, including its standard libraries, toolkits, and APIs.
  2. Experience with web frameworks like Flask or Django, and familiarity with REST framework principles for web services.
  3. Proficiency in database structures, with practical experience in SQL (MySQL, PostgreSQL) and NoSQL (MongoDB, Redis) databases.
  4. Experience with cloud platforms, especially AWS, and knowledge of services like DynamoDB and Lambda.
  5. Skilled in Python libraries for data analysis, such as NumPy, Pandas, and Matplotlib, with an understanding of big data frameworks.
  6. Excellent analytical and problem-solving skills, capable of debugging and resolving complex issues efficiently.
  7. Strong grasp of data structures and algorithms, crucial for building efficient applications.
  8. Thoroughly understand version control systems, particularly GIT, for effective code management and collaboration.


Read more
Xebia IT Architects
at Xebia IT Architects
2 recruiters
Vijay S
Posted by Vijay S
Bengaluru (Bangalore), Pune, Hyderabad, Chennai, Jaipur, Bhopal, Gurugram
5 - 11 yrs
₹30L - ₹40L / yr
skill iconScala
Microservices
CI/CD
DevOps
skill iconAmazon Web Services (AWS)
+2 more

Dear,


We are excited to inform you about an exclusive opportunity at Xebia for a Senior Backend Engineer role.


📌 Job Details:

  • Role: Senior Backend Engineer
  •  Shift: 1 PM – 10 PM
  • Work Mode: Hybrid (3 days a week) across Xebia locations
  • Notice Period: Immediate joiners or up to 30 days


🔹 Job Responsibilities:


✅ Design and develop scalable, reliable, and maintainable backend solutions

✅ Work on event-driven microservices architecture

✅ Implement REST APIs and optimize backend performance

✅ Collaborate with cross-functional teams to drive innovation

✅ Mentor junior and mid-level engineers


🔹 Required Skills:


✔ Backend Development: Scala (preferred), Java, Kotlin

✔ Cloud: AWS or GCP

✔ Databases: MySQL, NoSQL (Cassandra)

✔ DevOps & CI/CD: Jenkins, Terraform, Infrastructure as Code

✔ Messaging & Caching: Kafka, RabbitMQ, Elasticsearch

✔ Agile Methodologies: Scrum, Kanban


⚠ Please apply only if you have not applied recently or are not currently in the interview process for any open roles at Xebia.


Looking forward to your response! Also, feel free to refer anyone in your network who might be a good fit.


Best regards,

Vijay S

Assistant Manager - TAG

https://www.linkedin.com/in/vijay-selvarajan/

Read more
eNation Solutions Pvt. Ltd
Chennai, Bengaluru (Bangalore), Hyderabad
9 - 20 yrs
₹15L - ₹30L / yr
skill iconJava
skill iconAmazon Web Services (AWS)
skill iconDocker
skill iconKubernetes
skill iconJavascript
+1 more

Experience of atleast 9 + years in developing Java Solutions and Architecture


Mandatory Experience of working on AWS, Microservices architecture, Dockers, Kubernetes


Experience in creating architecture for Cloud Applications in AWS


Should have worked on large scale Saas application for atleast 3 years


Knowledge and experience in any of the following

Javascript, AngularJS, Python, Ruby, PHP


Driving DevOps best practices by using Docker, Kubernetes.


Excellent interpersonal, verbal and written communication skills


Location Chennai, Bengaluru, Hyderabad,

Read more
Persistent System Ltd
Persistent System Ltd
Agency job
via Milestone Hr Consultancy by Haina khan
Pune, Bengaluru (Bangalore), Hyderabad
4 - 9 yrs
₹8L - ₹27L / yr
skill iconPython
PySpark
skill iconAmazon Web Services (AWS)
Spark
skill iconScala
Greetings..

We have urgent requirement of Data Engineer/Sr Data Engineer for reputed MNC company.

Exp: 4-9yrs

Location: Pune/Bangalore/Hyderabad

Skills: We need candidate either Python AWS or Pyspark AWS or Spark Scala
Read more
Udaan.com
at Udaan.com
6 recruiters
Asha Jayaram
Posted by Asha Jayaram
Remote, Bengaluru (Bangalore)
5 - 15 yrs
₹20L - ₹50L / yr
skill iconJava
skill iconScala
skill iconGo Programming (Golang)
skill iconPython
Algorithms
+2 more
Key Responsibilities
● We believe that the role of an engineer at a typical product company in India has to evolve from just working in a request response mode to something more involved.
● Typically an engineer has very little to no connection with the product, its users, overall success criteria or long term vision of the product that he/she is working on.
● The system is not setup to encourage it. Engineers are evaluated on their tech prowess and very little attention is given to other aspects of being a successful engineer.
● We don’t hold appraisals as we don’t believe that evaluation of work and feedback is a constant affair rather than every 6 or 12 months. Besides there is no better testament of your abilities than the growth of the product.
● We don’t have a concept of hierarchy and hence we don’t have promotions. All we have in Udaan are Software Engineers.

Skills & Knowledge:
○ 4-15 years of experience
○ Sound knowledge in Programming,
○ High Ownership & Impact oriented
○ Creative thinker & Implementation
○ Highly Customer Obsessed & Always Insisting on Highest Standards
Read more
wwwemotcoin
at wwwemotcoin
1 recruiter
Shiv Garg
Posted by Shiv Garg
Bengaluru (Bangalore)
1 - 2 yrs
₹1L - ₹3L / yr
skill iconPython
skill iconDjango
skill iconRedis
Internet of Things (IOT)
DevOps
+3 more

We are looking for Interns or 0-1 Year experienced person for our IoT Division based out of Bangalore. Option for Work from Home is also available.  


 

Qualification:

Any Graduate in Computer Science / Electronics / Information Science / Instrumentation from reputed institutions


 

Required Skills Experience:

  • 1+ years of experience in Python with FastAPI must.
  • 1+ years of experience in working with a database like PostgreSQL.
  • Experience of working on any Linux based OS
  • Experience of working on AWS
  • Understanding of micro-services.
  • Should be able to meet SLAs as per the priorities.
  • Good communication skills.
  • Ability to prioritize and execute tasks in a high-pressure environment.

 

Desired Skills Experience:

  • Knowledge of Python, Django Framework or REST API.
  • Knowledge of Docker and Redis.
  • AWS Certified Solutions Architect Associate is a plus.
  • Experience with Fast API.
  • Exposure to CI/CD practices.
  • Awareness of Shell scripting

 

Keywords: #AWS #EC2 #Python #Psql #Django #Docker #Redis #Kafka.

 

 

 

Read more
Several years of experience in designing web applications
Several years of experience in designing web applications
Agency job
via Jobdost by Ankitha Vyas
Bengaluru (Bangalore), Hyderabad, Chennai
5 - 7 yrs
₹12L - ₹15L / yr
skill icon.NET
ASP.NET
Object Oriented Programming (OOPs)
Fortify
Microsoft IIS
+25 more
Basic Qualifications: (what are the skills required to this job with minimum years of experience on each, including education)

• Should have 5+ years of work experience in design, develop, Code and Unit Test web and desktop-based applications written in .Net framework starting from 4.x and above.
• Strong analytical skills to understand a given requirement and provide work estimates.
• Strong Object-Oriented Programming knowledge.
• Strong experience with Static Code Analyzers like Fortify.
• Should have good understanding of web servers such as IIS and Front-end such as HTML’s and Razor based engines.
• Strong debugging skills using .net front end and backend.
• Strong coding experience and thorough understanding of programming languages such as C#, VB.NET, ASP.Net, ADO.Net, JQuery, JavaScript, Traditional Web Services, WCF, Web API and other Scripting languages such as pythons.
• Strong working knowledge on various design patterns such as MVC, MVVM, DDD, Repository Pattern and any custom/hybrid framework as designed by the Architects.
• Should have a strong working knowledge of Azure DevOps.
• Strong knowledge and understanding of data sharing medium using JSON, XML and other media types.
• Strong knowledge on Entity Framework (6 and above) and other ORM such as Dapper.
• Strong knowledge and programming skills in Database such SQL SERVER, Oracle, My SQL and SQL Express. Additionally, nice to know-how knowledge in MS ACCESS.
• Strong knowledge and coding experience in REST based web services and service-oriented design patterns using WCF and other API’s.
• Should have used IDE such as Visual Studio and Visual Studio Code for Front-end development.
• 1+ years of building SPA web solutions using Angular 6/7/8 , BackBone, Bootstrap
• 5+ years building HTML5 complaint pages
• 3+ years of experience using TypeScript
• 3+ years of writing automated testing using Jamine or others

Day to Day job Duties: (what this person will do on a daily/weekly basis)

• Co-ordinate/mentor other Junior developers on a day to day basis.
• Understand the use cases/User Story, code and develop on a designed platform/pattern.
• Strict adherence to coding standards.
• Participate self-code review/peer reviews and correct errors wherever applicable before checking in the final code into the Branch/code repo.
• Create code documentations wherever applicable and as set guidelines by the team.
• Create and perform Unit Tests wherever applicable as set guidelines by the team.
• Provide feedback and assist in estimation planning.
• Merge code branches as and when required.
• Create and publish release documentations and application deployments as and when requested.
• Report out statuses to the leads onshore daily during the Stand-up calls.
• Additionally, update efforts on a given work item on everyday basis.
• Provide true estimates on work assigned prior development. Also ask questions/provide comments on User Stories/work items assigned.
• Be a team player and flexible towards availability in case of any urgent issues that need immediate attention.
• Plan out vacations in advance (min. 2 weeks of adv. Notice).


Nice to have(not a must) experience, skills

• Good understanding of Service Workers.
• Prior coding experience using FORTRAN.
• Experience on 3rd party tools like Spire.Pdf, PDF.Js.
• Knowledge of Rapid application development framework like DevExpress, Code on Time, HighCharts.
• Knowledge of code clean up tools like CodeMaid.
• Knowledge of Power BI and O365 Suites of applications.
• knowledge of SQL Data tools like SSIS and SSRS.
Read more
Unifytech
at Unifytech
20 recruiters
Sunil Bolisetty
Posted by Sunil Bolisetty
Mumbai
4 - 10 yrs
₹4L - ₹30L / yr
skill iconScala
skill iconJava
skill iconPython
  1. Should be very strong Scala development(Coding)
  2. With Any combination of Java/Python/Spark/Bigdata
  3. 3+ years experience in Core Java/Scala with good understanding of multithreading
  4. The candidate must be good with Computer Science fundamentals
  5. Exposure to python/perl and Unix / K-Shell scripting
  6. Code management tools such as Git/Perforce.
  7. Experience with large batch-oriented systems 
  8. DB2/Sybase or any RDBMS
  9. Prior experience with financial products, particularly OTC Derivatives
  10. Exposure to counterparty risk, margining, collateral or confirmation systems
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos