Cutshort logo
MNC logo
Data Engineer (Pyspark Developer)
MNC
Data Engineer (Pyspark Developer)
MNC's logo

Data Engineer (Pyspark Developer)

at MNC

Agency job
4 - 12 yrs
₹15L - ₹30L / yr
Remote, Bengaluru (Bangalore)
Skills
PySpark
Pyspark Developer
skill iconScala
DevOps

EXP-Developer-4 to 12 years

 

 

         Must have low-level design and development skills.  Should able to design a solution for given use cases. 

  • Agile delivery-  Person must able to show design and code on a daily basis
  • Must be an experienced PySpark developer and  Scala coding.   Primary skill is PySpark
  • Must have experience in designing job orchestration, sequence, metadata design, Audit trail, dynamic parameter passing and error/exception handling
  • Good experience with unit, integration and UAT support
  • Able to design and code reusable components and functions
  • Should able to review design, code & provide review comments with justification
  • Zeal to learn new tool/technologies and adoption
  • Good to have experience with Devops and CICD
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos

Similar jobs

Reliable Group IN
Airoli, Navi Mumbai
5 - 10 yrs
₹10L - ₹30L / yr
skill iconPython
skill iconDjango
skill iconFlask
RESTful APIs
skill iconDocker
+5 more

Job Overview:


We are seeking an experienced Senior Python Developer to join our dynamic team. The ideal candidate will have a strong background in Python development, with a focus on API development, integration, and experience in the deployment of machine learning pipelines. This is a crucial role in designing, implementing, and maintaining scalable and compliant Generative AI applications.


Must have:

  • Expertise in programming languages - Python (primary), JavaScript, SQL, NodeJS
  • Expertise in configuring and designing SQL and NoSQL databases (eg. Mongo)
  • Expertise in API integration and APP serving frameworks (Flask, Django, FAST API)
  • Experience in Schema definitions, parsing payload types (XSD/XML, JSON, Byte/Binary Encoded images,), etc.,
  • Experience in User Authentication and Authorization frameworks and Active Directory Integration (SAML, OAuth, etc.,)
  • Exposure to Large Language Models (LLMs) and Generative AI application development is a must.
  • Experience working on Azure AI/ML stack is required.
  • Familiarity with cloud platforms (e.g., AWS, Azure) and containerization (e.g., Docker).
  • Solid understanding of software development best practices, including version control, code reviews, and testing.
  • Lead code reviews, mentor junior developers, and provide technical guidance to the team.
  • Strong communication and collaboration skills.
  • Ability to work independently and lead technical initiatives.
  • Familiarity with continuous integration and continuous deployment (CI/CD) pipelines.


Good to have:

  • Previous experience with healthcare-related projects or HIPAA compliance is a plus.
  • Experience with Django or Flask frameworks for web development.
  • Knowledge of front-end technologies (HTML, CSS, JavaScript).


Qualifications:

  • Bachelor's degree in Computer Science, Software Engineering, or related field.
  • 6-8 years of proven experience as a Python Developer, with a strong focus on backend development.



Read more
RaRa Now
at RaRa Now
3 recruiters
N SHUBHANGINI
Posted by N SHUBHANGINI
Remote only
5 - 7 yrs
₹7L - ₹15L / yr
skill iconNodeJS (Node.js)
skill iconMongoDB
Mongoose
skill iconExpress
skill iconGo Programming (Golang)
+5 more
About RARA NOW
Not just a delivery company

RARA NOW is revolutionising instant delivery for e-commerce in Indonesia through data-driven logistics.

RARA NOW is making instant and same-day deliveries scalable and cost-effective by leveraging a differentiated operating model and real-time optimisation technology. RARA makes it possible for anyone, anywhere to get same day delivery in Indonesia. While others are focusing on one-to-one' deliveries, the company has developed proprietary, real-time batching tech to do many-to-many' deliveries within a few hours. RARA is already in partnership with some of the top eCommerce players in Indonesia like Blibli, Sayurbox, Kopi Kenangan and many more.

We are a distributed team with the company headquartered in Singapore, core operations in Indonesia and technology team based out of India

Future of eCommerce Logistics.

Data driven logistics company that is bringing in same day delivery revolution in Indonesia
Revolutionising delivery as an experience
Empowering D2C Sellers with logistics as the core technology

**About the Role**

Integration of user-facing elements developed by front-end developers with server side logic
Implementation of security and data protection
Integration of data storage solutions
Strong proficiency with JavaScript
Knowledge of Node.js and frameworks available for it
Understanding the nature of asynchronous programming and its quirks and workarounds
Good understanding of server-side templating languages and CSS preprocessor
Basic understanding of front-end technologies, such as HTML5 and CSS3
User authentication and authorization between multiple systems, servers, and environments
Understanding differences between multiple delivery platforms, such as mobile vs. desktop, and optimizing output to match the specific platform
Implementing automated testing platforms and unit test
Strong technical development experience in effectively writing code, performing code reviews, and implementing best practices on configuration management and code refactoring
Experience in working with vendor applications
Experience in making optimized queries to MySQL database
Proven problem solving and analytical skills
A delivery-focused approach to work and the ability to work without direction
Experience in Agile development techniques, including Scrum
Experience implementing and/or using Git
Ability to work collaboratively in teams and develop meaningful relationships to achieve common goals
Bachelor degree in Computer Science or related discipline preferred
Read more
Talentika
at Talentika
3 recruiters
Agency job
via Talentika by Priya Ujlambkar
Pune
4 - 7 yrs
₹5L - ₹15L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
skill iconAmazon Web Services (AWS)
+3 more

Hello ,

Greetings from Talentika !!

we are having a job vacancy for Java Developer Along with the Skills

Java, Microservices, Kubernetes, AWS/Azure, devops background .

Best Regards,

Priya.

Read more
GrayQuest
at GrayQuest
1 video
2 recruiters
Rishab Mehta
Posted by Rishab Mehta
Mumbai
2 - 7 yrs
₹9L - ₹16L / yr
skill iconPython
RESTful APIs
skill iconJava
skill iconDjango
Fullstack Developer
+5 more

We are hiring for a Software Engineer Team Lead - Backend, to join our education-focused fintech lending startup, GrayQuest. Our core product is a combination of a lending product, a rewards product and an insurance product to redefine the education fees payment across the country.

 

You will be joining a young and vibrant team of developers who are pushing the boundaries of consumer financing through technology.

Key Responsibilities :
  • Participate in all stages of the Software Development Lifecycle
  • Develop back-end components, services, and APIs. Support integration of user-facing elements, and collaborate closely with the design and front-end development team.
  • Write elegant, effective, and scalable code while maintaining the highest level of coding standards.
  • Take complete ownership of projects and ensure timely deliveries
  • Ability to debug, refine, review, and deploy code
  • Work closely with the QA team to test, and document project features.
  • Ability to interact with all stakeholders. Understand business requirements, and effectively convert them into technical specifications
  • Mentor junior developers and participate in peer Review

Requirements:

  • Demonstrable experience as a Python Developer (3+ years)
  • Strong knowledge of Python frameworks (Django Rest, Flask)
  • Experience working on REST APIs
  • Strong knowledge of SQL and JavaScript
  • Experience with Amazon Web Services (AWS)
  • Working knowledge of React
  • Familiarity with Agile development methodology
  • Good understanding of task breakup, milestone definition, and work delegation.
  • Past experience of working in a fintech/financial services domain or a consumer internet startup will be preferable but not required
  • Work experience in early-stage startups (0 ->1) is a big plus
  • Bachelors or equivalent degree from premier institutes is a plus
  • Most importantly, the biggest skill we look for our prospective candidates is "Learnability" - how quickly can you learn. 

Why is this a great opportunity for the right candidate:

 

  1. Work with a young dynamic core team backed by marquee investors from the financial services space
  2. Work on a product/business that has achieved product market fit and take it to scale
  3. Equity compensation and competitive market salaries
  4. Work environment that prioritizes talent, hustle and dedication

We will also ensure we give a preference to applicants who directly email us with their background/context and why they think they should be a strong candidate for this position at GrayQuest. Email us at work (at the rate) grayquest (dot) com and cc Sonal (at the rate)grayquest (dot) com

Read more
Artivatic
at Artivatic
1 video
3 recruiters
Layak Singh
Posted by Layak Singh
Bengaluru (Bangalore)
3 - 7 yrs
₹6L - ₹15L / yr
skill iconPython
skill iconJava
RESTful APIs
skill iconScala
Cassandra
+4 more
About Artivatic :Artivatic is technology startup that uses AI/ML/Deeplearning to build intelligent products & solutions for finance, healthcare & insurance businesses. It is based out of Bangalore with 20+ team focus on technology. Artivatic building is cutting edge solutions to enable 750 Millions plus people to get insurance, financial access and health benefits with alternative data sources to increase their productivity, efficiency, automation power and profitability, hence improving their way of doing business more intelligently & seamlessly. Artivatic offers lending underwriting, credit/insurance underwriting, fraud, prediction, personalization, recommendation, risk profiling, consumer profiling intelligence, KYC Automation & Compliance, automated decisions, monitoring, claims processing, sentiment/psychology behaviour, auto insurance claims, travel insurance, disease prediction for insurance and more. We have raised US $300K earlier and built products successfully and also done few PoCs successfully with some top enterprises in Insurance, Banking & Health sector. Currently, 4 months away from generating continuous revenue.Skills : - Building server-side logic that powers our APIs, in effect deploying machine learning models in production system that can scale to billions of API calls - Scaling and performance tuning of database to handle billions of API calls and thousands of concurrent requests - Collaborate with data science team to build effective solutions for data collection, pre-processing and integrating machine learning into the workflow - Collaborate, provide technical guidance, and engage in design and code review for other team members. - Excellent Scala, cassandara, architect, api, software, python, Java programming and software design skills, including debugging, performance analysis and test design - Proficiency with at least one Scala, GoLang, Python micro frameworks like Flask, Tornado, Play, Spring etc. with experience in building REST APIs - Experience or understanding in building web crawlers, data fetching bots etc. - Experience with design and optimisation of Neo4j, cassandra, NoSQL databases, PostGreSQL, Redis, Elastic Search - Familiarity with one of the cloud service providers, AWS or Google Compute Engine - Computer Science degree with 4+ years of backend programming experience Experience : 3 Years+ Location : Sony World Signal, Koramangala 4th Block, Bangalore
Read more
GST Edge
at GST Edge
2 recruiters
Kshitij Tarkas
Posted by Kshitij Tarkas
Mumbai
2 - 7 yrs
₹6L - ₹10L / yr
skill iconPHP
MySQL
skill iconAmazon Web Services (AWS)
DevOps
skill iconJavascript
+1 more
You will be responsible for developing high-quality software and involved in all aspects of software development, from architecture to design right through the delivery of the code, testing and deployment support. Other responsibilities include: -Ensure software development by utilizing best practices and maintain high quality, security, and performance. -Protects intellectual property and source code and adheres to company source code management processes and procedures. -Identifies architecture solutions & making use of relevant Open Source technologies -Actively participates in Agile processes to provide feedback to improve team delivery and performance -Meets deadlines and ensure quality and security is of high standards -Participate in a culture whereby optimum quality and performance is delivered. -Supports colleagues within the Product & Technology teams to mitigate problems toward common company goals. -Establishment of effective and professional relationships with all levels of employees MINIMUM POSITION REQUIREMENTS: -Undergraduate degree in Computer Science (or equivalent discipline) -2+ years of PHP development, ideally. Experience with Laravel or Symfony frameworks is an addon -1+ years working within an agile software development team -3+ years working on Linux platforms -1+ years of relational database experience including schema design and SQL -Strong knowledge of OOP and SOLID design principles is a must. -Understands REST architectural style -Experience in writing and maintaining a comprehensive suite of unit and integration tests -Ability to junior developers through the code and design reviews, and pair programming -Capable of implementing complex solutions from architectural diagrams and documentation -Basic understanding of AWS services such as Cloud Formation, EC2, Lambda, API Gateway, Route 53, EBS, ELB etc...
Read more
Healofy
at Healofy
3 recruiters
Shubham Maheshwari
Posted by Shubham Maheshwari
Bengaluru (Bangalore)
5 - 10 yrs
₹15L - ₹50L / yr
Cassandra
skill iconJava
skill iconScala
Aerospike
Spark
+6 more
RESPONSIBILITIES:   1. Full ownership of Tech right from driving product decisions to architect to deployment. 2. Develop cutting edge user experience and build cutting edge technology solutions like instant messaging in poor networks, live-discussions, live-videos optimal matching. 3. Using Billions of Data Points to Build User Personalization Engine.  4. Building Data Network Effects Engine to increase Engagement & Virality.  5. Scaling the Systems to Billions of Daily Hits. 6. Deep diving into performance, power management, memory optimization & network connectivity optimization for the next Billion Indians.  7. Orchestrating complicated workflows, asynchronous actions, and higher order components.  8. Work directly with Product and Design teams. REQUIREMENTS:   1. Should have Hacked some (computer or non-computer) system to your advantage. 2. Built and managed systems with a scale of 10Mn+ Daily Hits 3. Strong architectural experience.  4. Strong experience in memory management, performance tuning and resource optimizations.  5. PREFERENCE- If you are a woman or an ex-entrepreneur or having a CS bachelors degree from IIT/BITS/NIT. P.S. If you don't fulfill one of the requirements, you need to be exceptional in the others to be considered.
Read more
Toabh
at Toabh
1 recruiter
Riana Saini
Posted by Riana Saini
Mumbai
3 - 7 yrs
₹5L - ₹9L / yr
skill iconRuby on Rails (ROR)
Data Structures
Algorithms
skill iconNodeJS (Node.js)
Database Design
+3 more
We need a strong Ruby on Rails developer who has as strong understanding of Rest API's and also a experience on Node.js is plus point. Database understanding and AWS deployment is a must.
Read more
Poshmiles Online Solutions Private Limited
Bengaluru (Bangalore)
4 - 6 yrs
₹6L - ₹12L / yr
skill iconPython
skill iconDjango
SQLAlchemy
Celery
skill iconElastic Search
+3 more
We are a funded start-up. Poshmiles aims to help point travellers to long weekend trips to popular and undiscovered destinations, based on your interests, tastes and personality. As a Senior Python Django Developer, you will be part of our core team building a disruptive platform in the hospitality industry. This is a full-time role The selected candidate will join a very fast-paced start-up environment. Be able to come up with best practices/guidelines. Be biased towards action. Be a team-player. Be articulate and should have strong communication skills (Verbal/Written). Be a Problem Solver. As a potential recruit, you should: Have a minimum of 4 Years of Industry experience. Be able to write clean, re-usable standards-based code. Be able to design and implement low-latency, high-availability, and performant applications Be able to integrate user-facing elements developed by front-end developers with server-side logic Be able to integrate third-party APIs. Be able to Implement security and data protection. Be able to create database schemas that represent and support business processes Have a strong understanding of the threading limitations of Python, and multi-process architecture. Have knowledge of user authentication and authorization between multiple systems, servers, and environments. Have familiarity with event-driven programming in Python. Have strong Unit Testing and Debugging Skills. Be aware of latest industry trends/frameworks and be able to continuously update yourself with the same. Be able to mentor junior members. Be able to come up with best practices/guidelines for development. Be biased towards action. Be a team-player. Be articulate and should have strong communication skills (Verbal/Written). Be a Problem Solver. Be self-driven and be able to work in fast-paced environment and with minimal supervision. Contributions to FOSS, StackOverflow and GitHub profile with your side projects, if available will definitely be an added advantage. In-depth understanding of UI Frameworks, HTML, CSS, SASS, LESS is required. Knowledge of Machine Learning/AI Concepts is a big plus. Skills: Python 2.7 or higher, Django 1.8 or higher or Flask, ORM (Django-ORM, SQL Alchemy) Server Side Templating Languages (Jinja2, Mako, Django Templates), Celery, Elastic Search/Solr, Django Rest Framework, JWT, Pandas, NumPy, SciPy, HTML5, CSS3, Object Oriented Javascript, Linux OS, GIT, DevOps, Docker, AWS.
Read more
JDA Software
at JDA Software
1 recruiter
Ashish Laddha
Posted by Ashish Laddha
Bengaluru (Bangalore), Bengaluru (Bangalore)
7 - 10 yrs
₹14L - ₹20L / yr
skill iconJava
skill iconC++
Algorithms
skill iconC#
Data Structures
+4 more
New team getting formed. Great learning opportunity to work on building team with Engineering focus. Multitude of opportunities across technology spectrum.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos