Cutshort logo
MNC logo
Data Engineer (Pyspark Developer)
MNC
Data Engineer (Pyspark Developer)
MNC's logo

Data Engineer (Pyspark Developer)

at MNC

Agency job
4 - 12 yrs
₹15L - ₹30L / yr
Remote, Bengaluru (Bangalore)
Skills
PySpark
Pyspark Developer
skill iconScala
DevOps

EXP-Developer-4 to 12 years

 

 

         Must have low-level design and development skills.  Should able to design a solution for given use cases. 

  • Agile delivery-  Person must able to show design and code on a daily basis
  • Must be an experienced PySpark developer and  Scala coding.   Primary skill is PySpark
  • Must have experience in designing job orchestration, sequence, metadata design, Audit trail, dynamic parameter passing and error/exception handling
  • Good experience with unit, integration and UAT support
  • Able to design and code reusable components and functions
  • Should able to review design, code & provide review comments with justification
  • Zeal to learn new tool/technologies and adoption
  • Good to have experience with Devops and CICD
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Deqode
at Deqode
1 recruiter
purvisha Bhavsar
Posted by purvisha Bhavsar
Gurugram, Delhi, Noida, Ghaziabad, Faridabad
6 - 10 yrs
₹5L - ₹15L / yr
Google Cloud Platform (GCP)
skill iconPython
PySpark
skill icon.NET
skill iconScala

🚀 Hiring: Data Engineer | GCP + Spark + Python + .NET |

| 6–10 Yrs | Gurugram (Hybrid)


We’re looking for a skilled Data Engineer with strong hands-on experience in GCP, Spark-Scala, Python, and .NET.


📍 Location: Suncity, Sector 54, Gurugram (Hybrid – 3 days onsite)

💼 Experience: 6–10 Years

⏱️ Notice Period :- Immediate Joiner


Required Skills:

  • 5+ years of experience in distributed computing (Spark) and software development.
  • 3+ years of experience in Spark-Scala
  • 5+ years of experience in Data Engineering.
  • 5+ years of experience in Python.
  • Fluency in working with databases (preferably Postgres).
  • Have a sound understanding of object-oriented programming and development principles.
  • Experience working in an Agile Scrum or Kanban development environment.
  • Experience working with version control software (preferably Git).
  • Experience with CI/CD pipelines.
  • Experience with automated testing, including integration/delta, Load, and Performance
Read more
Reliable Group IN
Airoli, Navi Mumbai
5 - 10 yrs
₹10L - ₹30L / yr
skill iconPython
skill iconDjango
skill iconFlask
RESTful APIs
skill iconDocker
+5 more

Job Overview:


We are seeking an experienced Senior Python Developer to join our dynamic team. The ideal candidate will have a strong background in Python development, with a focus on API development, integration, and experience in the deployment of machine learning pipelines. This is a crucial role in designing, implementing, and maintaining scalable and compliant Generative AI applications.


Must have:

  • Expertise in programming languages - Python (primary), JavaScript, SQL, NodeJS
  • Expertise in configuring and designing SQL and NoSQL databases (eg. Mongo)
  • Expertise in API integration and APP serving frameworks (Flask, Django, FAST API)
  • Experience in Schema definitions, parsing payload types (XSD/XML, JSON, Byte/Binary Encoded images,), etc.,
  • Experience in User Authentication and Authorization frameworks and Active Directory Integration (SAML, OAuth, etc.,)
  • Exposure to Large Language Models (LLMs) and Generative AI application development is a must.
  • Experience working on Azure AI/ML stack is required.
  • Familiarity with cloud platforms (e.g., AWS, Azure) and containerization (e.g., Docker).
  • Solid understanding of software development best practices, including version control, code reviews, and testing.
  • Lead code reviews, mentor junior developers, and provide technical guidance to the team.
  • Strong communication and collaboration skills.
  • Ability to work independently and lead technical initiatives.
  • Familiarity with continuous integration and continuous deployment (CI/CD) pipelines.


Good to have:

  • Previous experience with healthcare-related projects or HIPAA compliance is a plus.
  • Experience with Django or Flask frameworks for web development.
  • Knowledge of front-end technologies (HTML, CSS, JavaScript).


Qualifications:

  • Bachelor's degree in Computer Science, Software Engineering, or related field.
  • 6-8 years of proven experience as a Python Developer, with a strong focus on backend development.



Read more
Talentika
at Talentika
3 recruiters
Agency job
via Talentika by Priya Ujlambkar
Pune
4 - 7 yrs
₹5L - ₹15L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
skill iconAmazon Web Services (AWS)
+3 more

Hello ,

Greetings from Talentika !!

we are having a job vacancy for Java Developer Along with the Skills

Java, Microservices, Kubernetes, AWS/Azure, devops background .

Best Regards,

Priya.

Read more
DeepSource
at DeepSource
8 recruiters
Anupama Bara
Posted by Anupama Bara
Bengaluru (Bangalore)
3 - 5 yrs
₹12L - ₹18L / yr
skill iconScala
skill iconJava
Linux/Unix

DeepSource is working on building tools that help developers ship good code. There are over 40 million developers in the world, and all of them write and review code in some form. There’s a massive opportunity to impact how software is built right from where the code is written using automation and intelligence, that not only improves developer productivity but also increases software’s robustness.

The Language Engineering team works on the source code analyzers, including both programming languages and configuration-as-code systems. As a member of the Language Engineering team, you will work on building the best, most comprehensive, Scala analyzer in the world. You will add new rules and Autofixes for finding more issues with code and automatically fixing them. You will be involved with the community to understand the problems with static analysis tools in the Scala ecosystem.

As a member of the Language Engineering team, you will:

  • Identify bad code practices in Scala and write new analyzers to detect them.

  • Improve the coverage of automatically fixable issues.

  • Ensure fewer false-positives are reported by the analyzer.

  • Work on the internal tools that support analysis runtimes.

  • Contribute to open-source static analysis tools.

We’re looking for someone who has:

  • Strong foundational knowledge in Computer Science.

  • At least 3 years of professional software development experience in Scala and Java.

  • Understanding of the nuances of execution of the source code (AST, data flow graphs, etc).

  • Familiarity with Scala best practices followed in the industry.

  • Native experience with Linux/Unix environment.

  • A focus on delivering high-quality code through strong testing practices.

We offer competitive compensation with meaningful stock options, a generous vacation policy, and a workstation of your choice, to name a few of the perks.

 

Read more
neovisara
at neovisara
1 recruiter
pratap p
Posted by pratap p
Hyderabad
1 - 7 yrs
₹2L - ₹7L / yr
ASP.NET MVC
ASP.NET
Data Structures
Algorithms
skill iconScala
+5 more
·       Knowledge in MS-SQL - writing Queries,Store Proc, Triggers
·       Good understanding of IIS configuration
·       Familiarity with version control tools TFS/Git/Subversion etc.
·       Ability to independently deliver complex development projects
·       Must enjoy hands-on programming work

Benifits

Support for Continuous learning
Competetive Salary
Quarterly webinars and Annual conferences
Read more
BlazeClan Technologies Pvt Ltd
Gurmeet Singh
Posted by Gurmeet Singh
Pune, Kuala Lumpur
8 - 12 yrs
₹12L - ₹18L / yr
Magento
Technical Architecture
Architecture
Continuous Integration
DevOps
+3 more
8+ years of Magento development and architecting that includes complex catalog / pricing structure; multi-channel support based design exposure.  At least 2 project implementation of building brand new sites(not support maintenance or bug fixes)  Must possess good understanding of Magentos overall architecture, design-related system configuration and theming components.  Strong Experience with the LAMP stack, MVC and OOPS.  Good knowledge of relational databases, version control tools and of developing web services Clear understanding on different editions of Magento(Community/Enterprise).  Working knowledge of front end web technologies such as HTML5, CSS3, JavaScript, jQuery etc.  Must have ability to develop Magento Modules and Customization, Extension Development.  Experience working with third-party Magento extensions.  Integrating Magentos E-Commerce functionality seamlessly with other back-end systems  Experience with Magento Theme Customization and Scalability of Magento systems would be an advantage.  Understanding of cloud concepts would be plus. Proactively offer solutions to complex technical problems, Proven Skills & Technical Requirements:  Expert understanding of Magento's code structure, extension architecture, theming hierarchy, and fallback components  Expertise in authoring and extending Magento extensions  Thorough experience in customizing Magento's front-end components using layout XML, blocks, and templates  Ability and experience working on live high volume stores  Experience with deploying and tuning magento on AWS and Linux  Thorough knowledge of vanilla Magento feature set and configuration  Competent knowledge of e-commerce data organization and relationships, Store catalog (categories/products/attributes), Sales orders (quotes /orders /invoices/ shipments/ credits)  Competent in authoring JavaScript and using libraries such as jQuery  Competent in web services integrations (REST/SOAP)  A desire to be personally responsible for production-level code
Read more
Wibmo
at Wibmo
2 recruiters
Shirin AM
Posted by Shirin AM
Bengaluru (Bangalore)
10 - 15 yrs
₹15L - ₹18L / yr
MS SQLServer
Design patterns
Oracle Application Express (APEX)
DevOps
Responsibilities : - Implement CI/CD methodology across our product lines. - Evaluates technological choices (network/hardware related and technology/code related) by querying providers and providing evaluations of each solution include ROI - evaluations in the present and future implications, limitations, and opportunities - Managing and directly administering a staff of DevOps Engineers and Software Engineers with overall responsibility for our DevOps platform Architecture, Builds and configuration/release management. - Responsible for the promoting the software builds across various systems (development, QA, staging and production). You will be first point of contact between Dev, support teams and Production Environments, and responsible for build life-cycle management, maintain the sanity of the production environments. You will also be responsible for the upgrading the deployment automation scripts, that are created and for new implementations. - Platform Architecture Design - Understanding the end to end Infrastructure for DevOps and configuring highly available application written in Java and Database architectures. - Configuration Management tool sets - Architect and implement CM tools and solutions such as Jenkins. Implement CI/CT methodology across our product lines. - Basic of Java coding experience Database : Knowledge of SQL and working experience on MS-SQL, MYSQL or Oracle. - Knowledge of DNS / Networking systems will be added advantage Education : BE / B.Sc Maths / B. Tech Experience : 10 - 12 years
Read more
Whyable
at Whyable
1 recruiter
Gopinath P
Posted by Gopinath P
Bengaluru (Bangalore)
3 - 7 yrs
₹8L - ₹10L / yr
Fullstack Developer
MEAN stack
DevOps
About company Founded 3 years ago. Technical co-founder has 14 years of experience and has worked with major companies like Wipro, Huawei, Ericsson, CISCO, Juniper, etc. The business co-founder is a serial entrepreneur who has founded multiple startups in the U.K. Organization was founded with the idea of establishing an honest, anti-corporate place where people do what they are good at and have fun doing it. Please find the job description mentioned below for your reference, · 3 to 5 years of experience in the MEAN stack · Drive and motivation to provide technical leadership to a team of talented developers · Good understanding of web development principles · Very strong Devops skills - familiar with automated deployment, AWS infrastructure, Docker or similar containers · Capability to work independently and build reusable modules and widgets · Has worked in an Agile process and is familiar with standard development tools and processes Viz., code reviews, Bitbucket/Git, JIRA, etc. · Ability to drive and motivate the team to technical and process excellence · A working understanding of HTTP, databases and overall web application fundamentals · Good to have - Exposure to Behaviour Driven Development and related frameworks like protractor and Selenium · Understanding of Ionic and hybrid application development frameworks
Read more
AutoHangar India
at AutoHangar India
1 recruiter
Ankur Gupta
Posted by Ankur Gupta
Mumbai
2 - 6 yrs
₹6L - ₹8L / yr
skill iconDjango
skill iconPython
DevOps
Autohangar India group is leading dealers of mercedes, indian motor cycle. They are investing huge in technology and want to build products using their inhouse team. Please see http://autohangaradvantage.com
Read more
InfoVision Labs India Pvt. Ltd. Pune
Shekhar Singh kshatri
Posted by Shekhar Singh kshatri
Pune
5 - 10 yrs
₹5L - ₹5L / yr
Hadoop
skill iconScala
Spark
We at InfoVision Labs, are passionate about technology and what our clients would like to get accomplished. We continuously strive to understand business challenges, changing competitive landscape and how the cutting edge technology can help position our client to the forefront of the competition.We are a fun loving team of Usability Experts and Software Engineers, focused on Mobile Technology, Responsive Web Solutions and Cloud Based Solutions. Job Responsibilities: ◾Minimum 3 years of experience in Big Data skills required. ◾Complete life cycle experience with Big Data is highly preferred ◾Skills – Hadoop, Spark, “R”, Hive, Pig, H-Base and Scala ◾Excellent communication skills ◾Ability to work independently with no-supervision.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos