Cutshort logo
MNC logo
Data Engineer (Pyspark Developer)
MNC
Data Engineer (Pyspark Developer)
MNC's logo

Data Engineer (Pyspark Developer)

at MNC

Agency job
4 - 12 yrs
₹15L - ₹30L / yr
Remote, Bengaluru (Bangalore)
Skills
PySpark
Pyspark Developer
skill iconScala
DevOps

EXP-Developer-4 to 12 years

 

 

         Must have low-level design and development skills.  Should able to design a solution for given use cases. 

  • Agile delivery-  Person must able to show design and code on a daily basis
  • Must be an experienced PySpark developer and  Scala coding.   Primary skill is PySpark
  • Must have experience in designing job orchestration, sequence, metadata design, Audit trail, dynamic parameter passing and error/exception handling
  • Good experience with unit, integration and UAT support
  • Able to design and code reusable components and functions
  • Should able to review design, code & provide review comments with justification
  • Zeal to learn new tool/technologies and adoption
  • Good to have experience with Devops and CICD
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Client based at Pune location.
Client based at Pune location.
Agency job
Pune
6 - 8 yrs
₹8L - ₹11L / yr
Windows Presentation Foundation(WPF)
ASP.NET
skill iconC#
SOLID
API
+12 more

Technical Skill Set:

1. ASP. NET Development – Strong expertise in C#, ASP.NET, WPF, and solid understanding of SOLID principles, API development, and databases.

2. Cloud Technologies – Hands-on experience with AWS, Azure, or Google Cloud.

3. Software Development & Architecture – Proficiency in SDLC, Agile, Scrum, and DevOps frameworks.

4. Project Planning & Management – Experience in task allocation, tracking, estimations, and deliverables management.

5. Repository & Version Control – Familiarity with Git, SVN, or similar tools, along with basic networking concepts.

6. Product Lifecycle Management – Knowledge of requirement analysis, documentation, testing, and release management.

7. Project Planning Tools – Experience with tools like Microsoft Project Plan, JIRA, Redmine, or HP ALM/Quality Centre.

Leadership & Soft Skills:

1. Team Leadership – Ability to guide, mentor, and manage a team while ensuring high-quality deliverables within tight deadlines.

2. Client Engagement & Requirement Gathering – Skilled in collaborating with stakeholders to enhance and refine project requirements.

3. Strong Communication & Problem-Solving – Effective at handling challenges, making decisions, and ensuring smooth project execution.

Read more
Deqode
at Deqode
1 recruiter
Shraddha Katare
Posted by Shraddha Katare
Remote only
5 - 7 yrs
₹10L - ₹20L / yr
skill iconDocker
skill iconAmazon Web Services (AWS)
skill iconJava
skill iconKubernetes
DevOps

 Profile: Senior Java Developer

🔷 Experience: 5+ Years

🔷 Location: Remote

🔷 Shift: Day Shift

(Only immediate joiners & candidates who have completed notice period)


✨ What we want:

✅ AWS cloud services (MANDATORY)

✅ Docker containerization (MANDATORY)

✅ Spring/Spring Boot framework

✅ RESTful API development

✅ Microservices architecture

✅ Database experience (SQL/NoSQL)

✅ Git version control & CI/CD

✅ Kubernetes orchestration

Read more
Wissen Technology
at Wissen Technology
4 recruiters
Vijayalakshmi Selvaraj
Posted by Vijayalakshmi Selvaraj
Pune, Mumbai, Bengaluru (Bangalore)
4 - 9 yrs
Best in industry
Rancher
skill iconKubernetes
K8s
DevOps
Puppet

Job Summary:

We are seeking a skilled DevOps Engineer to join our dynamic team. The ideal candidate will be responsible for managing, maintaining, and troubleshooting Rancher clusters, with a strong emphasis on Kubernetes operations. This role requires expertise in automation through shell scripting and proficiency in configuration management tools like Puppet and Ansible. Candidates should be highly self-motivated, capable of working on a rotating schedule, and committed to owning tasks through to delivery.

Key Responsibilities:

  • Set up, operate, and maintain Rancher and Kubernetes (K8s) clusters, including on bare-metal environments.
  • Perform upgrades and manage the lifecycle of Rancher clusters.
  • Troubleshoot and resolve Rancher cluster issues efficiently.
  • Write, maintain, and optimize shell scripts to automate Kubernetes-related tasks.
  • Work collaboratively with the team to implement best practices for system automation and orchestration.
  • Utilize configuration management tools like Puppet and Ansible (preferred but not mandatory).
  • Participate in a rotating schedule, with the ability to work until 1 AM as required.
  • Take ownership of tasks, ensuring timely delivery with high-quality standards.

Key Requirements:

  • Strong expertise in Rancher and Kubernetes operations and maintenance.
  • Experience in setting up and managing Kubernetes clusters on bare-metal systems is highly desirable.
  • Proficiency in shell scripting for task automation.
  • Familiarity with configuration management tools like Puppet and Ansible (good to have).
  • Strong troubleshooting skills for Kubernetes and Rancher environments.
  • Ability to work effectively in a rotating schedule and flexible hours.
  • Strong ownership mindset and accountability for deliverables.


Read more
Injala
at Injala
1 video
3 recruiters
Krupali Gangani
Posted by Krupali Gangani
Remote, Bhopal, Ahmedabad, Cochin, Hyderabad, Indore, Visakhapatnam, Coimbatore, Thiruvananthapuram
7 - 10 yrs
₹12L - ₹15L / yr
ASP.NET MVC
ASP.NET
ADO.NET
skill icon.NET
Entity Framework
+6 more

Technical Lead - .NET

 

Responsibilities:

 

  • Develop and deliver technical systems
  • Maintain adherence to architectural standards/principles, global product-specific guidelines, usability design standards, etc.
  • Participate in the development and review of documents to comply with SDLC methodologies [e.g., Engineering Work Breakdown Structure (WBS), estimation, Solution Design Document (SDD) and Software Architecture Documents (SAD)]
  • Provide support and documentation to assist in sustaining the project during the transition to production where necessary
  • Adhere to Application Engineering methodologies, standards, code reviews
  • Provide feedback regarding application engineering methodologies, standards, and leading practices when appropriate
  • Identify potential points of contention for missed activities and notify project leadership of situation and remediation plan
  • Minimize technical exposure and risk on projects
  • Provide technical guidance to development team members
  • Technical deliverables (i.e., code and documentation) on projects assigned
  • Translate detailed Requirements and Design and Solution Architecture deliverables into detailed design specifications
  • Maintain effective and consistent communication within the team, with peers, the leadership team, and the peers in other IT groups
  • Proactively raise issues to Technical and Group Leads when necessary
  • Produce high-quality application engineering deliverables in accordance with the project timeline
  • Build and unit test a project to detailed design specifications
  • Provide thought leadership and technical guidance to engineering staff
  • Review of code completed
  • Review performance of developers
  • Proactively anticipate project issues before they occur; define the problem; identify possible causes; work with the team to identify solutions; select and implement the most appropriate solution
  • Apply judgment in implementing Application Engineering methodologies, processes, and practices to specific requirements of projects/programs which may include product design engineering, information security, code maintainability and reliability

 


 

Requirements:

 

Must Have:

  • Bachelor’s OR master’s degree in a technical field and/or equivalent work experience
  • At least 3 years acting a senior architecture / technical lead role in a comparable organization
  • Significant experience of deploying large, enterprise-wide implementations to significant user volumes
  • At least 5 years of hands-on experience leading a team of developers - defining work breakdown structures/tasks, assigning the teamwork items, monitoring, and ensuring quality and adherence to standards etc.
  • At least 8 years of relevant hands-on work experience building, integrating, and delivering enterprise-wide web and windows applications using Microsoft and other technologies for large organizations on complex projects
  • 8+ years of ASP.Net MVC, ASP.Net experience
  • 8+ years of experience of working with applications that have a SQL Server backend
  • 5+ years of experience with Object-Relational Mappers such as Entity Framework, ADO.NET, Dapper
  • Expert level knowledge of .NET Web API is required. .NET Core knowledge is preferred, but Web API experience with legacy .NET is ok
  • 5+ years of experience with GIT
  • 3+ years of experience of Azure Devops
  • In-depth knowledge of object-oriented analysis and design (OOAD) principles, and familiarity with many design patterns for Software applications.
  • Demonstrated expertise in application design and construction, work breakdown structure of items, design and code reviews, unit test and build activities, deployment and performance related activities, documentation, support, and training/mentoring
  • Excellent communication skills, verbal and written

 

Nice to have:

  • Ideally experience working with SSRS, SSIS
  • Experience with MongoDB or another document database would be a plus
  • Knowledge and experience with working on N-Tier applications.
  • Demonstrated ability to build strong working relationships
  • Experience working on projects following Agile methodologies would be ideal
  • Experience working with Azure or other cloud providers would be ideal
  • Ability to work within diverse, global, virtual teams.
  • Proven ability to thrive under pressure
  • Some experience with design and prototyping tools and diagramming is desired
Read more
Mumbai, Navi Mumbai
5 - 10 yrs
₹15L - ₹25L / yr
PL/SQL
skill iconJava
SQL
skill iconXML
XSLT
+5 more

Job Description:  

As a L3 analyst, you will play a key role within the Application Management team, leading services for its customer(s). This service has responsibility for the smooth daily operational running of the Client platform both in the cloud and on-premises. The Client application is business critical and centrally manages data for trading, settlement, risk, client and regulatory reporting systems. As a L3 analyst, you will be responsible for supporting complex infrastructure and application issues raised by L1/L2 support teams, and business analysts. You would also be working on client requests for enhancements, fixes, maintaining custom code, and following the best practices such as Agile, DevOps, etc.

 

The role is a technical role requiring a good technical knowledge of SQL/PLSQ, Core Java along with good debugging skill while supporting client implementations. You should have basic understanding on Unix system and commands. The ability to troubleshoot issues, assist users and help write specifications is essential. This position also works with product management to improve the software engineering processes and practices associated with continuously building, deploying, and updating software and environments.

 

  • Accountability and primary responsibility/duties:
  • A typical day would look like as follows: -
    • 40% support issues.
    • 40% configuration/development work.
    • 20% continuous improvement, automation, CICD, so on.
  • Activities would range across the lifecycle from discovery to post-implementation support.
  • Understanding client’s requirement, replicate the problem and providing the solution
  • Understanding and developing new requirements coming in from BAs (Business Analysts) and customers.
  • Update the existing functionality based on client needs.
  • Develop changes that cater to enhancing the product and/or fixing production issues
  • Prepare product releases of software components. (Java/SQL-PLSQL)
  • Contribute in all phases of the development cycle. (development/Deployment/Testing, peer review)
  • Create technical document for all changes made.

 

Required Qualifications/Knowledge/Skills

  • Bachelor’s degree in Computer Science or related field
  • Strong basics and working experience in following technologies: -
    • Core Java.
    • SQL / PLSQL coding.
    • Object Oriented Programming concepts and data structures.
  • Working knowledge on Unix platform
  • Working knowledge on XSLT and XML handling
  • Basic understanding App & web server working knowledge (JBOSS, WebLogic and WebSphere) and debugging skills.
  • Advantageous to have:
    • Working understanding on CICD, Dev-ops technologies.
    • Queuing technologies including Kafka, MQ, Solace.
    • Scripting including Python, Unix, java.
  • Hands on knowledge of Dev ops processes and tools Good interpersonal and communication skills.

Read more
Ather Energy
at Ather Energy
4 recruiters
Shabin Belliappa
Posted by Shabin Belliappa
Bengaluru (Bangalore)
2 - 5 yrs
₹11L - ₹25L / yr
skill iconNodeJS (Node.js)
skill iconMongoDB
Mongoose
skill iconExpress
skill iconJava
+1 more

You’ll be our: Application Developer 

You’ll be based at: IBC Knowledge Park, Bengaluru

You’ll be Aligned with: Application Development Lead 

You’ll be the member of:VehicleSoftware Team 

What you’ll do at Ather:

  • You will be developing the various Applications for the cloud to process data connecting with the vehicle 

  • You shall work with the Lead and product team to define and deliver features. 

  • Be part of the Agile team, to define Sprint work content definition. 

  • Work with cross functional teams to drive overall feature delivery. 

  • Be part of the initiatives that achieve the functional requirements of the team. Explore technical feasibility of solutions, propose and evaluate tech stacks. 

  • Performance tuning and benchmarking of the features 


Here’s what we are looking for: 

  • Strong knowledge and Hands on experience with Nodejs, RestAPI, Java Script, Java Development experience in cloud based infrastructure 

  • Strong fundamentals in any fullstack of your choice, OOPS concepts, Google Cloud Platform. Knowledge of Java, React, React Native, Android Native , HTML5, Firebase and Go Programming is a plus. 

  • Knowledge on CI/CD pipelines, JIRA, UML, Static Code Analysis tools and Unit test framework is required 

  • Knowledge on the S/W communication protocols like gRPC, HTTP, MQTT is a plus Cross platform development experience would be needed. 

  • Knowledge of Cloud Based solutions would be a plus. 

  • App development for a product which is beyond a mobile platform would be a plus. Experience with Telematics/Infotainment projects would be a great advantage. 

  • Strong experience with Agile methodology, along with tools such as JIRA, Confluence. 

  • Flashing and debugging tools experience is a plus.


You bring to Ather: 

  • Bachelor’s/Master’s in computer science or any other equivalent degree

Read more
"MNC Company" strong set up across borders
"MNC Company" strong set up across borders
Agency job
via Select Source International by Bhumika Garg
Remote, Bengaluru (Bangalore)
4 - 8 yrs
₹8L - ₹25L / yr
skill iconJava
Data Structures
Algorithms
DevOps
Microservices
Java 8
Libraries, Interface, Language Fundamentals
Data Structures, Algorithms, Collections
Design Patterns, Singletons
Multithreading
Messaging, CI/CD
Databases
Tooling:
Application Layering, Architectural Design
Unit Testing/ Integration Testing
Any Devops tooling experience (Docker/ Kubernates/ Terraforms)
Tool Configuration and Log Monitoring
Read more
PayPal
at PayPal
2 recruiters
Sai Sree Dasani
Posted by Sai Sree Dasani
Bengaluru (Bangalore)
3 - 9 yrs
₹15L - ₹25L / yr
skill iconJava
skill iconSpring Boot
Microservices
J2EE
Apache Kafka
+1 more

Job Description:

Perform high quality software analysis, development, testing and maintenance for the client’s core technology platform  

* Work with Product owners, Architects and X-Vertical teams to analyse requirements.

* Implement the features based on the design.

* Follow good development practices.

* Product deployment and support.

* Mentor junior developers.

 

Job Requirements

* Excellent analytical skills and problem solving skills.

* Expert in JEE/ Java programming.

* Competent in delivering a high quality product.

* Competent in software engineering tools and best practices

* Conversant in web front-end technologies - HTML5/CSS/JavaScript
* Object-oriented Design and Analysis (OOA and OOD)

* Estimate engineering effort; plan implementation, and rollout system changes.

* Exhibit creativity and resourcefulness at problem solving while collaborating and working effectively   with best in class designers, engineers of different technical backgrounds, architects and product managers.

* Expert in data structures and algorithms.

* Aware of Agile methodology of Software Development Life Cycle.

* Should be a self-starter and a good team player.

* Great communication skills both verbal and written to ensure effective communication across product teams, functions and locations.

* Can make decisions without always asking others what has to be done.

* Ability to mentor junior developers.

* Experience working with remote teams.

* Flexible to work on any technology as per project demand.

Read more
Globant
at Globant
2 recruiters
Risha P
Posted by Risha P
Mumbai
5 - 10 yrs
₹12L - ₹20L / yr
Object Oriented Programming (OOPs)
Shell Scripting
skill iconJava
SOAP
JSON
+8 more
We are looking for a Java developer for one of our major investment banking client- who can take ownership for the whole end to end delivery, performing analysis, design, coding, testing and maintenance of large- scale and distributed applications. Please find JD for your reference . Job Profile : Java Developer : Location : Mumbai Description: A core Java developer is required for a Tier 1 investment bank supporting the Delta One Structured Products IT group. This is a global front-office team that supports the global OTC Equity Swap Portfolio, Single Name, and Index derivative businesses. We are designing a complete restructure of the Equity Swaps trading platform, and this particular role is within the core cash flow and valuations area. The role will require the candidate to work closely with the cash flow engines team to solve problems that combine both finance and technology. This is an exciting hands-on role for a self-starter who has a thirst for new challenges as well as new technologies. The candidate should possess good analytical skills, strong software engineering skills, a logical approach to problem-solving, be able to work in a fast paced environment liaising with demanding stakeholders to understand complex requirements and be able to prioritize work under pressure with minimal supervision. The candidate should be a problem solver, and be able to bring with them some positivity and enthusiasm in trying to think about and offer potential solutions for architectural considerations. Position Profile: We are looking for someone to help own problems and be able to demonstrate leadership and responsibility for the delivery of new features. As part of the development cycle, you would be expected to write quality unit tests, supply documentation if relevant for new feature build-outs, and be involved in the test cycle (UAT, integration, regression) for the delivery and fixing of bugs for your new features. Although the role is predominantly Java, we require someone who is flexible with the development environment, as some days you might be writing Java, and other days you might be fixing stored procedures or Perl scripts. You would be expected to get involved in the Level 3 production support rota which is shared between our developers on a monthly cycle, and to occasionally help with weekend deployment activities to deploy and verify any code changes you have been involved in. Team Profile: The team and role are ideal for someone looking for a strong career development path with many opportunities to grow, learn and develop. The role requires someone who is flexible and able to respond to a dynamic business environment. The candidate must be adaptable to work across multiple technologies and disciplines, with a focus on delivering quality solutions for the business in a timely fashion. This role suits people experienced in complex data domains. Required Skills: * Experience of agile and scrum methodologies. * Core Java. * Unix shell scripting. * SQL and Relational Databases such as DB2. * Integration technologies - MQ/Xml/SOAP/JSON/Protocol Buffers/Spring. * Enterprise Architecture Patterns, GoF design * Build & agile - Ant, Gradle/Maven, Sonar, Jenkins/Hudson, GIT/perforce. * Sound understanding of Object Oriented Analysis, Design and Programming. * Strong communication and stakeholder management skills * Scala / spark or bigdata will be an added advantage * Candidate must have good experience in database. * Excellent communication and problem solving skill. Desired Skills: * Experience in banking and regulatory reporting (SFTR, MAS/ASIC etc.) * Knowledge of OTC, listed and cash products * Domain driven design and micro-services
Read more
InfoVision Labs India Pvt. Ltd. Pune
Shekhar Singh kshatri
Posted by Shekhar Singh kshatri
Pune
5 - 10 yrs
₹5L - ₹5L / yr
Hadoop
skill iconScala
Spark
We at InfoVision Labs, are passionate about technology and what our clients would like to get accomplished. We continuously strive to understand business challenges, changing competitive landscape and how the cutting edge technology can help position our client to the forefront of the competition.We are a fun loving team of Usability Experts and Software Engineers, focused on Mobile Technology, Responsive Web Solutions and Cloud Based Solutions. Job Responsibilities: ◾Minimum 3 years of experience in Big Data skills required. ◾Complete life cycle experience with Big Data is highly preferred ◾Skills – Hadoop, Spark, “R”, Hive, Pig, H-Base and Scala ◾Excellent communication skills ◾Ability to work independently with no-supervision.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos