Cutshort logo
MNC logo
Data Engineer (Pyspark Developer)
MNC
Data Engineer (Pyspark Developer)
MNC's logo

Data Engineer (Pyspark Developer)

at MNC

Agency job
4 - 12 yrs
₹15L - ₹30L / yr
Remote, Bengaluru (Bangalore)
Skills
PySpark
Pyspark Developer
skill iconScala
DevOps

EXP-Developer-4 to 12 years

 

 

         Must have low-level design and development skills.  Should able to design a solution for given use cases. 

  • Agile delivery-  Person must able to show design and code on a daily basis
  • Must be an experienced PySpark developer and  Scala coding.   Primary skill is PySpark
  • Must have experience in designing job orchestration, sequence, metadata design, Audit trail, dynamic parameter passing and error/exception handling
  • Good experience with unit, integration and UAT support
  • Able to design and code reusable components and functions
  • Should able to review design, code & provide review comments with justification
  • Zeal to learn new tool/technologies and adoption
  • Good to have experience with Devops and CICD
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Simprosys Infomedia
Careers Simprosys
Posted by Careers Simprosys
Ahmedabad
3 - 8 yrs
₹6L - ₹12L / yr
skill iconPython
skill iconDjango
FastAPI
skill iconFlask
SQL
+8 more

About Simprosys InfoMedia:

Simprosys is a diverse team of E-commerce enthusiasts with a simple yet powerful goal of empowering E-commerce merchants with easily adaptable product listings’ and Ad management solutions. 


Our crew consists of budding techies developers who build and maintain the technological interventions to automate our product listing and ad management solutions. Support executives who are digital marketers themselves. Passionate designers with exceptional UI designing, motion graphics, animation, and video editing skills. Our marketing team consists of versatile content creators and brand strategists. 


Be a part of our E-commerce enthusiasts crew.


Job Title: Sr. Python Developer

Location: Ahmedabad (Onsite)

 

Skill Set: Python, JavaScript, Python frameworks (Flask, Django, Django Rest Framework), AWS, Data Science, Machine Learning.

 Responsibilities:

  1. Develop and maintain Python applications, using frameworks like Flask or Django to create and manage APIs and web services.
  2. Integrate various data sources and databases, including SQL (MySQL, PostgreSQL) and NoSQL (MongoDB, Redis) systems, into a unified solution.
  3. Model data for reporting and analysis, leveraging libraries like NumPy, Pandas, and Matplotlib to provide insights and communicate results to stakeholders.
  4. Utilize AWS services, such as DynamoDB and Lambda, to build and deploy efficient, cloud-based solutions.
  5. Manage code versions with GIT, ensuring effective tracking and collaborative development practices.
  6. Employ strong debugging and optimization skills to ensure high performance and resolve issues promptly.

Requirements:

  1. Strong knowledge and hands-on experience with Python, including its standard libraries, toolkits, and APIs.
  2. Experience with web frameworks like Flask or Django, and familiarity with REST framework principles for web services.
  3. Proficiency in database structures, with practical experience in SQL (MySQL, PostgreSQL) and NoSQL (MongoDB, Redis) databases.
  4. Experience with cloud platforms, especially AWS, and knowledge of services like DynamoDB and Lambda.
  5. Skilled in Python libraries for data analysis, such as NumPy, Pandas, and Matplotlib, with an understanding of big data frameworks.
  6. Excellent analytical and problem-solving skills, capable of debugging and resolving complex issues efficiently.
  7. Strong grasp of data structures and algorithms, crucial for building efficient applications.
  8. Thoroughly understand version control systems, particularly GIT, for effective code management and collaboration.


Read more
Snaphyr
Snaphyr
Agency job
via SnapHyr by MUKESHKUMAR CHAUHAN
Remote only
6 - 9 yrs
₹20L - ₹70L / yr
skill iconJava
skill iconSpring Boot
RESTful APIs
Microservices
DevOps
+6 more

🚀 We’re Hiring: Senior Software Engineer – Backend | Remote | Full-time


Are you a backend engineering expert who thrives in high-growth startup environments?

Do you enjoy solving complex challenges with the latest technologies like Java 18+, Spring Boot 3+, and scalable microservices?


We’re looking for a Senior Software Engineer – Backend to help us build a world-class data science platform that powers cutting-edge AI solutions.


What You’ll Do:

🔹 Build and optimize scalable, secure backend systems

🔹 Collaborate with product owners & architects to shape business solutions

🔹 Deliver high-quality, production-ready code with best practices (unit testing, CI/CD, automation)

🔹 Work with modern tools like Kubernetes, Docker, NodeJS, React

🔹 Contribute to a high-performance engineering culture and drive innovation


What We’re Looking For:

✔️ 6+ years of experience with Java/Python, Spring Boot, REST APIs, microservices

✔️ Strong CS fundamentals, algorithms, and system design skills

✔️ Experience in secure web applications & scalable backend architectures

✔️ Knowledge of cloud (AWS/GCP/Azure), GitHub Actions, and Unix scripting

✔️ Startup mindset – fast learner, problem solver, impact-driven


🌍 Remote | High-growth environment | Global impact

Read more
Advance Web Software Pvt Ltd
krutika bandyopadhyay
Posted by krutika bandyopadhyay
Remote only
4 - 10 yrs
₹3L - ₹7L / yr
skill icon.NET
Microsoft Windows Azure
Terraform
DevOps
skill iconGitHub
+1 more

JD:

 

  • Demonstrable hands-on experience working with Azure technologies.
  • Extensive experience with Azure DevOps and pipelines.
  • Experience working with Jira and Github.
  • Experience of Infrastructure as Code using Terraform to model cloud infrastructure.
  • Practical experience of engineering best practices with continuous improvement.

 

Required

  • HashiCorp Certified: Terraform Associate
  • Microsoft Certified: Azure Fundamentals

 

Desirable

Microsoft Certified: Azure Administrator Associate


Location- Remote

Job Type: Full time on contract

Read more
Synapsica Technologies Pvt Ltd
at Synapsica Technologies Pvt Ltd
6 candid answers
1 video
Human Resources
Posted by Human Resources
Bengaluru (Bangalore)
4 - 8 yrs
₹8L - ₹20L / yr
skill iconNodeJS (Node.js)
skill iconExpress
koajs
Meteor JS Framework
hapijs
+8 more

Synapsica is a growth stage HealthTech startup founded by alumni from IIT Kharagpur, AIIMS New Delhi, and IIM Ahmedabad. We believe healthcare needs to be transparent and objective, while being affordable. Every patient has the right to know exactly what is happening in their bodies and they don’t have to rely on cryptic 2 liners given to them as diagnosis.

Towards this aim, we are building an artificial intelligence enabled cloud based platform to analyze medical images and create 2.0 of advanced radiologist reporting.

We are backed by YCombinator and other marquee investors from India, US and Japan. We are proud to have GE, AIIMS, the Spinal Kinetics as our partners.

Join us, if you find this as exciting as we do!

Description:

Synapsica is looking for a Node.js/Python developer who is passionate about designing and implementing scalable solutions with highest quality. You will be responsible for creating high performance, responsive, and secure server-side programs to manage Synapsica platform. You will be responsible for designing, managing and supporting cloud platform and scaling our database. This role is ideal for you if you have a background in bakcned development and are looking for the next level of career growth in a fast paced, learning based and merit driven work environment.

Responsibilities:
- Design and development of our new platform modules from scratch. 
- Hands on implementation of our APIs and integrations. 
- Design, scaling and integration of new/existing databases.
- Ensuring the entire stack is designed and built for speed and scalability
- Design and construction of our REST APIs with best secutiry mechanisms.
- Design and implementation of continuous integration and deployment pipelines in tandem with the respective team members.
- Performance tuning and improvements in large scale systems.
- Ensuring responsiveness and cross-platform compatibility of applications.
- Owning and delivering end-to-end products, features, enhancements.

Requirements:
- Degree in Computer Science or related discipline with strong competencies in data structures, algorithms, and software design
- At least 4+ years of experience with writing Python/NodeJS/PHP/Ruby on Rails. 
- Prior experience of database design and management in MongoDB, including being up on the latest practices and associated versions.
- Experience in building highly scalable business applications, which involve implementing large complex business flows and dealing with huge amount of data.
- Familiarity with AWS (or equivalent) ecosystem with end-to-end cloud deployment.
- Experience implementing code level unit tests.
- Proficiency with Git / Version control.
- Appreciation for clean and well documented code

- Excellent verbal communication skills.
- Good problem solving skills.
- Attention to detail.
- Very high sense of ownership.
- Deep interest and passion for technology

Read more
t3cogno pvt ltd
at t3cogno pvt ltd
1 recruiter
Gunjan Anand
Posted by Gunjan Anand
Chennai
2 - 6 yrs
₹4L - ₹15L / yr
skill iconPostgreSQL
skill icon.NET
skill iconVisual Studio
ASP.NET
skill iconC#
+7 more

 2+ years of .NET Development experience


- Exceptional skills Experience with .NET,  technologies (WPF, Web Forms, .NET Core). Also skilled in MS SQL and PostgreSQL, Bootstrap and DevOps.


- Experience with DevExpress, Elasticsearch.Net, VS Studio is preferred SolarSearch


- Great business process understanding and written and verbal communication skills


- GitHub and Git experience.

Read more
Vah Vah
at Vah Vah
3 recruiters
Freya Patel
Posted by Freya Patel
Remote only
2 - 5 yrs
₹12L - ₹22L / yr
skill iconJava
skill iconPython
skill iconRuby
skill iconRuby on Rails (ROR)
skill iconGo Programming (Golang)
+4 more

Vah Vah! is an ed-tech company that offers online makeup courses in micro-batches to students across India to learn from the leading teachers in top cities. We provide holistic education with lots of practical training that makes our students job-ready with not just the base skills but also the soft skills for great customer service. Our teachers have more than 15+ years of experience in training makeup and have certified more than 1000+ students. Vah Vah! is founded by executives with extensive experience running consumer business and mobile games at scale (over 100 million players) at Zynga. Vah Vah! is backed by a leading investment firm.

Website Link: https://vahvah.com/

The Mission

Vah Vah teaches professional makeup to budding makeup artists and influencers through live online classes. We have students from Srinagar, all the way to the Andamans. And experienced teachers who have worked in Bridal Makeup, Ramp Shoots, Film and more. We empower our students to join the workforce as fully trained makeup artists. This is the future of vocational education, and you can help build it.

Our Culture

  • Amazing workplace and colleagues to work with
  • We have the right mixture of creativity, analytics and hustle to move fast in the right direction.
  • You will work with colleagues who don’t take themselves too seriously but move mountains.
  • See yourself evolving every month with new problems to solve and new skill to master.
  • Work with the smartest engineers so you can learn from them.
  • Competitive salary at par with the best in the industry
  • Great stock options so you can benefit from the company's growth.
  • Immense exposure to new technologies

Responsibilities:

  • Compile and analyze data, processes, and codes to troubleshoot problems and identify areas for improvement.
  • Collaborating with the front-end developers and other team members to establish objectives and design more functional, cohesive codes to enhance the user experience.
  • Participating in continuing education and training to remain current on best practices, learn new programming languages, and better assist other team members. Taking lead on projects, as needed.

Requirements:

  • Overall experience of 2-5 years in building backend services using languages like NodeJs, Java etc
  • Fluency or understanding of specific languages, such as Java, Node.Js, Python, and operating systems may be required.
  • Strong understanding of the web development cycle and programming techniques and tools.
  • Focus on efficiency, user experience, and process improvement.
  • Strong problem solving and verbal and written communication skills.
  • Ability to work independently or with a group.
  • Sound knowledge on source control and DevOps

What you get:

  • Amazing workplace and colleagues to work with
  • Competitive salary at par with the best in the industry
  • Immense exposure to new technologies
Read more
Photon Commerce
at Photon Commerce
1 recruiter
Photon Commerce
Posted by Photon Commerce
Remote only
5 - 10 yrs
₹12L - ₹25L / yr
skill iconPython
skill iconNodeJS (Node.js)
skill iconJavascript
skill iconHTML/CSS
DevOps
+2 more

Company

Photon Commerce (http://www.photoncommerce.com">www.photoncommerce.com)

 

Title

Senior engineer

 

Commitment

Full-time. Remote. Starting as soon as possible.

 

About the company

Photon Commerce is the AI platform for finance, invoices, and payments. Photon empowers financial services and eCommerce businesses with computer vision to automate invoices and receipts. Photon turns paper and pdf invoices, receipts, POs, and packing slips into a modern collaboration platform for commerce, preventing problems before they become costly. Backed by the Nasdaq Entrepreneurial Center, its leadership brings experience from eCommerce and SaaS unicorns, Google AI, Y Combinator, Stanford, and 4 exits and an IPO.

 

What you will do

·     Build a python/flask app that processes PDFs, images, invoices, and receipts for Quickbooks and Shopify using OCR

·     Lead a team of 8+ engineers and interns

·     Create integrations, APIs, webhooks, and payments for the captured structured data

·     Build a document and invoice collaboration app with embedded chat, like Slack for documents/invoices

·     Deploy the app into production and own AWS devops

·     Own the shipped product, including QA

 

Experience

·     5-10 years of experience having launched apps in production with real users in Python, Flask, Django, Javascript, SQL, AWS, and full-stack web development

·     1+ years of engineering leadership, including as a team lead, tech lead, or manager

·     Have repos and/or demos to show your previous work

·     Knowledge in and/or passion for enterprise SaaS, and AWS devops

·     Excellent communication, critical thinking, problem-solving, and team skills

 

What you’ll receive

·     Join an exciting, high growth startup led by serial entrepreneurs and backed by top tier Silicon Valley investors and billionaire industry leaders in tech

·     Competitive compensation commensurate with experience and performance

 

Read more
fast-paced startup environment and desire to solve
fast-paced startup environment and desire to solve
Agency job
via Jobdost by Ankitha Vyas
Remote, Bengaluru (Bangalore)
2 - 6 yrs
₹6L - ₹15L / yr
skill iconPython
skill iconFlask
skill iconDjango
DevOps
CI/CD
+7 more
Senior Backend Developer - JD
If you love to work in a fast-paced startup environment and desire to solve some very
challenging problems using technology, we want to hear from you.
We are looking for an enthusiastic and energetic individual to work as a Senior Software
Developer. You will be involved in working on multiple products for the scaling and growth
stage of the lifecycle.
We work closely with the real world,. If you are interested to grow and learn in your career
and at the same time work on products for the 1Bn user market, we encourage you to apply.
Responsibilities
● Managing and guiding a team of junior developers for timely delivery of product and
milestones
● Optimization of the application for maximum speed and scalability
● Implementation of security and data protection
● Design and implementation of data storage solutions
● Design & Build: Designing and developing high-volume, low-latency applications for
mission-critical systems, and delivering high-availability and performance.
● Collaborate - Collaborating within your product streams and team to bring best
practices and leverage a world-class tech stack.
● Measurable Outcome - You will need to set quantifiable objectives that encapsulate
the quality attributes of a system. The fitness of the application is measured against
set marks.
● DevOps - You will need to set up every essential (tracking/alerting) to make sure the
infrastructure/software you built is working as expected.
● Design and development of our REST APIs
● Help maintain code quality, architecture, and automation
Required Knowledge and Skills
● Over 3 years of experience working in backend development technologies and
DevOps
● Highly curious and ready to dive into complex technical challenges.
● Proficiency in development and scripting in Python, Django/Flask framework.
● Some experience in Angular 6+, JavaScript or TypeScript would be a plus.
● Database design and management, including being up on the latest practices -
bonus points for MySQL and MongoDB
● User authentication and authorization between multiple systems, servers, and
environments
● Integration of multiple data sources and databases into one system
● Management of hosting environment, including database administration and scaling
an application to support load changes
● Setup and administration of backups
● Understanding differences between multiple delivery platforms such as mobile vs
desktop, and optimizing output to match the specific platform
● Creating database schemas that represent and support business processes
● Implementing automated testing platforms and unit tests
● Understanding of “session management” in a distributed server environment
● Server management and deployment for the relevant environment
● Appreciation for clean and well-documented code
● Hands-on experience with architecture and structural design patterns
● Expertise in designing, developing, deploying, and integrating RESTful APIs
● Ability to understand business requirements and translate them into technical
requirements
● A knack for benchmarking and optimization
● Proficient understanding of code versioning tools, such as Git
Personality
● Requires excellent communication skills – written, verbal, and presentation.
● You should be a team player.
● You should be positive towards problem-solving, have a very structural thought
process to solve problems
● Interest to work in a high paced start-up environment with a large amount of learning.
● Good understanding of different frameworks, and be able to pick up new
technologies at ease.
● You should be agile enough to figure out a need for new technologies/frameworks
and learn new technology for better product performance.
Read more
Finaxar Technology Solutions Private limited
Remote, Pune
4 - 9 yrs
₹5L - ₹25L / yr
skill iconScala
ORM
skill iconAmazon Web Services (AWS)
JIRA Agile
Play Framework

Roles and responsibilities

    • Develop well-designed, performant and scalable microservices
    • Write reusable, testable, and efficient code that follow software development best practices
    • Integrate data storage solutions including databases, key-value stores, blob stores, etc.
    • Expose business functionality to frontend/mobile applications and partner systems through secure and scalable APIs.
    • Build integrations with 3rd party applications through apis’ to ingest and process data
    • Ensure security and data protection aspects within the applications
    • Contribute to devops by building CD/CI pipelines to automate releases
    • Ensure high performance and availability of distributed systems and applications
    • Interact directly with client project team members and operational staff to support live customer deployments and production issues.
Requirements
  • 4+ years of experience in developing applications using Scala and related technologies.
  • Thorough understanding of multithreading concepts and async execution using Actor model.
  • Thorough understanding of Play framework, GraphQL and GRPC technologies.
  • Experience in using DAL and ORM (Object Relational Mapper) libraries for data access.
  • Experiencing in developing and hosting APIs and integration with external applications.
  • Experience in building data models and repositories using relational and NoSql databases.
  • Knowledge of JIRA, Bitbucket and agile methodologies.
  • Good to have knowledge of AWS services like Lambda, dynamodb, kinesis and others.
  • Understanding of fundamental design principles behind a scalable application.
  • Familiarity with event-driven programming and distributed architectures.
  • Strong unit test and debugging skills
  • Affinity for learning and applying new technologies and solving new problems
  • Effective organizational skills with strong attention to detail
  • Experience in working with docker is a plus
  • Comfortable in working with Unix/Linux environment
  • Strong communication skills — both written and verbal
Read more
Poshmiles Online Solutions Private Limited
Bengaluru (Bangalore)
4 - 6 yrs
₹6L - ₹12L / yr
skill iconPython
skill iconDjango
SQLAlchemy
Celery
skill iconElastic Search
+3 more
We are a funded start-up. Poshmiles aims to help point travellers to long weekend trips to popular and undiscovered destinations, based on your interests, tastes and personality. As a Senior Python Django Developer, you will be part of our core team building a disruptive platform in the hospitality industry. This is a full-time role The selected candidate will join a very fast-paced start-up environment. Be able to come up with best practices/guidelines. Be biased towards action. Be a team-player. Be articulate and should have strong communication skills (Verbal/Written). Be a Problem Solver. As a potential recruit, you should: Have a minimum of 4 Years of Industry experience. Be able to write clean, re-usable standards-based code. Be able to design and implement low-latency, high-availability, and performant applications Be able to integrate user-facing elements developed by front-end developers with server-side logic Be able to integrate third-party APIs. Be able to Implement security and data protection. Be able to create database schemas that represent and support business processes Have a strong understanding of the threading limitations of Python, and multi-process architecture. Have knowledge of user authentication and authorization between multiple systems, servers, and environments. Have familiarity with event-driven programming in Python. Have strong Unit Testing and Debugging Skills. Be aware of latest industry trends/frameworks and be able to continuously update yourself with the same. Be able to mentor junior members. Be able to come up with best practices/guidelines for development. Be biased towards action. Be a team-player. Be articulate and should have strong communication skills (Verbal/Written). Be a Problem Solver. Be self-driven and be able to work in fast-paced environment and with minimal supervision. Contributions to FOSS, StackOverflow and GitHub profile with your side projects, if available will definitely be an added advantage. In-depth understanding of UI Frameworks, HTML, CSS, SASS, LESS is required. Knowledge of Machine Learning/AI Concepts is a big plus. Skills: Python 2.7 or higher, Django 1.8 or higher or Flask, ORM (Django-ORM, SQL Alchemy) Server Side Templating Languages (Jinja2, Mako, Django Templates), Celery, Elastic Search/Solr, Django Rest Framework, JWT, Pandas, NumPy, SciPy, HTML5, CSS3, Object Oriented Javascript, Linux OS, GIT, DevOps, Docker, AWS.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos