Cutshort logo
MNC logo
Data Engineer (Pyspark Developer)
MNC
Data Engineer (Pyspark Developer)
MNC's logo

Data Engineer (Pyspark Developer)

at MNC

Agency job
4 - 12 yrs
₹15L - ₹30L / yr
Remote, Bengaluru (Bangalore)
Skills
PySpark
Pyspark Developer
skill iconScala
DevOps

EXP-Developer-4 to 12 years

 

 

         Must have low-level design and development skills.  Should able to design a solution for given use cases. 

  • Agile delivery-  Person must able to show design and code on a daily basis
  • Must be an experienced PySpark developer and  Scala coding.   Primary skill is PySpark
  • Must have experience in designing job orchestration, sequence, metadata design, Audit trail, dynamic parameter passing and error/exception handling
  • Good experience with unit, integration and UAT support
  • Able to design and code reusable components and functions
  • Should able to review design, code & provide review comments with justification
  • Zeal to learn new tool/technologies and adoption
  • Good to have experience with Devops and CICD
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Wissen Technology
at Wissen Technology
4 recruiters
Vijayalakshmi Selvaraj
Posted by Vijayalakshmi Selvaraj
Pune, Mumbai, Bengaluru (Bangalore)
4 - 9 yrs
Best in industry
Rancher
skill iconKubernetes
K8s
DevOps
Puppet

Job Summary:

We are seeking a skilled DevOps Engineer to join our dynamic team. The ideal candidate will be responsible for managing, maintaining, and troubleshooting Rancher clusters, with a strong emphasis on Kubernetes operations. This role requires expertise in automation through shell scripting and proficiency in configuration management tools like Puppet and Ansible. Candidates should be highly self-motivated, capable of working on a rotating schedule, and committed to owning tasks through to delivery.

Key Responsibilities:

  • Set up, operate, and maintain Rancher and Kubernetes (K8s) clusters, including on bare-metal environments.
  • Perform upgrades and manage the lifecycle of Rancher clusters.
  • Troubleshoot and resolve Rancher cluster issues efficiently.
  • Write, maintain, and optimize shell scripts to automate Kubernetes-related tasks.
  • Work collaboratively with the team to implement best practices for system automation and orchestration.
  • Utilize configuration management tools like Puppet and Ansible (preferred but not mandatory).
  • Participate in a rotating schedule, with the ability to work until 1 AM as required.
  • Take ownership of tasks, ensuring timely delivery with high-quality standards.

Key Requirements:

  • Strong expertise in Rancher and Kubernetes operations and maintenance.
  • Experience in setting up and managing Kubernetes clusters on bare-metal systems is highly desirable.
  • Proficiency in shell scripting for task automation.
  • Familiarity with configuration management tools like Puppet and Ansible (good to have).
  • Strong troubleshooting skills for Kubernetes and Rancher environments.
  • Ability to work effectively in a rotating schedule and flexible hours.
  • Strong ownership mindset and accountability for deliverables.


Read more
An Agri-Tech start-up in Bangalore backed up by VC
An Agri-Tech start-up in Bangalore backed up by VC
Agency job
via Qrata by Prajakta Kulkarni
Bengaluru (Bangalore)
2 - 5 yrs
₹15L - ₹20L / yr
skill iconPython
skill iconDjango
skill iconFlask
DevOps
Senior Backend Developer - JD
If you love to work in a fast-paced startup environment and desire to solve some very
challenging problems using technology, we want to hear from you.
We are looking for an enthusiastic and energetic individual to work as a Senior Software
Developer. You will be involved in working on multiple products for the scaling and growth
stage of the lifecycle.
We work closely with the real world,. If you are interested to grow and learn in your career
and at the same time work on products for the 1Bn user market, we encourage you to apply.

Responsibilities

● Managing and guiding a team of junior developers for timely delivery of product and
milestones
● Optimization of the application for maximum speed and scalability
● Implementation of security and data protection
● Design and implementation of data storage solutions
● Design & Build: Designing and developing high-volume, low-latency applications for
mission-critical systems, and delivering high-availability and performance.
● Collaborate - Collaborating within your product streams and team to bring best
practices and leverage a world-class tech stack.
● Measurable Outcome - You will need to set quantifiable objectives that encapsulate
the quality attributes of a system. The fitness of the application is measured against
set marks.
● DevOps - You will need to set up every essential (tracking/alerting) to make sure the
infrastructure/software you built is working as expected.
● Design and development of our REST APIs
● Help maintain code quality, architecture, and automation

Required Knowledge and Skills

● 3 - 5 years of experience working in backend development technologies and DevOps
● Highly curious and ready to dive into complex technical challenges.
● Proficiency in development and scripting in Python, Django/Flask framework.
● Database design and management, including being up on the latest practices -
bonus points for MySQL and MongoDB
● User authentication and authorization between multiple systems, servers, and
environments
● Integration of multiple data sources and databases into one system
● Management of hosting environment, including database administration and scaling
an application to support load changes
● Setup and administration of backups
● Understanding differences between multiple delivery platforms such as mobile vs
desktop, and optimizing output to match the specific platform
● Creating database schemas that represent and support business processes
● Implementing automated testing platforms and unit tests
● Understanding of “session management” in a distributed server environment
● Server management and deployment for the relevant environment
● Appreciation for clean and well-documented code
● Hands-on experience with architecture and structural design patterns
● Expertise in designing, developing, deploying, and integrating RESTful APIs
● Ability to understand business requirements and translate them into technical
requirements
● A knack for benchmarking and optimization
● Proficient understanding of code versioning tools, such as Git

Personality

● Requires excellent communication skills – written, verbal, and presentation.
● You should be a team player.
● You should be positive towards problem-solving, have a very structural thought
process to solve problems
● Interest to work in a high paced start-up environment with a large amount of learning.
● Good understanding of different frameworks, and be able to pick up new
technologies at ease.
● You should be agile enough to figure out a need for new technologies/frameworks
and learn new technology for better product performance
Read more
Recro
at Recro
1 video
32 recruiters
Jisha  Emmanuel
Posted by Jisha Emmanuel
Bengaluru (Bangalore)
3 - 5 yrs
₹12L - ₹18L / yr
skill iconNodeJS (Node.js)
skill iconJavascript
API
Microservices
MySQL
+9 more

Key Responsibilities: 

  • Rewrite existing APIs in NodeJS. 
  • Remodel the APIs into Micro services-based architecture. 
  • Implement a caching layer wherever possible. 
  • Optimize the API for high performance and scalability. 
  • Write unit tests for API Testing.
  • Automate the code testing and deployment process.

 

Skills Required: 

  • At least 3 years of experience developing Backends using NodeJS — should be well versed with its asynchronous nature & event loop, and know its quirks and workarounds. 
  • Excellent hands-on experience using MySQL or any other SQL Database. 
  • Good knowledge of MongoDB or any other NoSQL Database. 
  • Good knowledge of Redis, its data types, and their use cases. 
  • Experience with graph-based databases like GraphQL and Neo4j. 
  • Experience developing and deploying REST APIs. 
  • Good knowledge of Unit Testing and available Test Frameworks. 
  • Good understanding of advanced JS libraries and frameworks. 
  • Experience with Web sockets, Service Workers, and Web Push Notifications. 
  • Familiar with NodeJS profiling tools. 
  • Proficient understanding of code versioning tools such as Git. 
  • Good knowledge of creating and maintaining DevOps infrastructure on cloud platforms. 
  • Should be a fast learner and a go-getter — without any fear of trying out new things Preferences. 
  • Experience building a large scale social or location-based app.
Read more
RaRa Now
at RaRa Now
3 recruiters
N SHUBHANGINI
Posted by N SHUBHANGINI
Remote only
5 - 7 yrs
₹7L - ₹15L / yr
skill iconNodeJS (Node.js)
skill iconMongoDB
Mongoose
skill iconExpress
skill iconGo Programming (Golang)
+5 more
About RARA NOW
Not just a delivery company

RARA NOW is revolutionising instant delivery for e-commerce in Indonesia through data-driven logistics.

RARA NOW is making instant and same-day deliveries scalable and cost-effective by leveraging a differentiated operating model and real-time optimisation technology. RARA makes it possible for anyone, anywhere to get same day delivery in Indonesia. While others are focusing on one-to-one' deliveries, the company has developed proprietary, real-time batching tech to do many-to-many' deliveries within a few hours. RARA is already in partnership with some of the top eCommerce players in Indonesia like Blibli, Sayurbox, Kopi Kenangan and many more.

We are a distributed team with the company headquartered in Singapore, core operations in Indonesia and technology team based out of India

Future of eCommerce Logistics.

Data driven logistics company that is bringing in same day delivery revolution in Indonesia
Revolutionising delivery as an experience
Empowering D2C Sellers with logistics as the core technology

**About the Role**

Integration of user-facing elements developed by front-end developers with server side logic
Implementation of security and data protection
Integration of data storage solutions
Strong proficiency with JavaScript
Knowledge of Node.js and frameworks available for it
Understanding the nature of asynchronous programming and its quirks and workarounds
Good understanding of server-side templating languages and CSS preprocessor
Basic understanding of front-end technologies, such as HTML5 and CSS3
User authentication and authorization between multiple systems, servers, and environments
Understanding differences between multiple delivery platforms, such as mobile vs. desktop, and optimizing output to match the specific platform
Implementing automated testing platforms and unit test
Strong technical development experience in effectively writing code, performing code reviews, and implementing best practices on configuration management and code refactoring
Experience in working with vendor applications
Experience in making optimized queries to MySQL database
Proven problem solving and analytical skills
A delivery-focused approach to work and the ability to work without direction
Experience in Agile development techniques, including Scrum
Experience implementing and/or using Git
Ability to work collaboratively in teams and develop meaningful relationships to achieve common goals
Bachelor degree in Computer Science or related discipline preferred
Read more
Talentika
at Talentika
3 recruiters
Agency job
via Talentika by Priya Ujlambkar
Pune
4 - 7 yrs
₹5L - ₹15L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
skill iconAmazon Web Services (AWS)
+3 more

Hello ,

Greetings from Talentika !!

we are having a job vacancy for Java Developer Along with the Skills

Java, Microservices, Kubernetes, AWS/Azure, devops background .

Best Regards,

Priya.

Read more
Banyan Data Services
at Banyan Data Services
1 recruiter
Sathish Kumar
Posted by Sathish Kumar
Bengaluru (Bangalore)
3 - 15 yrs
₹6L - ₹20L / yr
skill iconPython
skill iconDjango
skill iconFlask
API
MySQL
+6 more

Senior Python Backend Developer 

Notice Period: 45 days / Immediate Joining

 

Banyan Data Services (BDS) is a US-based Infrastructure Services Company, headquartered in San Jose, California, USA. It provides full-stack managed services to support business applications and data infrastructure.  We are looking for a Senior Python Developer to join our development team based out of Bangalore. This teamwork on building the next-generation SAS application on the Hybrid Cloud platform.  

It's a once-in-a-lifetime opportunity to join our rocket ship startup run by a world-class executive team. We are looking for candidates that aspire to be a part of the cutting-edge solutions and services we offer that address next-gen data evolution challenges.  

 

Key Qualificatisons

· Ability to write high-quality code efficiently.

· Design and develop new services/micro-services.

· Participate in planning and management of development process.

· Share architectural design vision with both technical and non-technical team members, including fellow engineers.

· Works on improvements in development toolset including testing frameworks, deployment scripts, and monitoring libraries.

· Experience solving complex problems and implementing solutions for performance and scalability.

· Write clean, well-structured, and maintainable code with automated test coverage and corresponding documentation.

· Explore new latest relevant technology, techniques, frameworks, tools, methodologies, and processes.

· Comfortable working with all aspects of software development; including dev-ops, quality assurance, research, and design.

Requirements

· Minimum 3 years of experience as a Python Developer in application development.

· Experience in Developing applications/software using Python, developing web services using Django/Flask, working with REST API, and working with any databases technology.

· Strong in Reg expression and string handling.

· Strong in python programming and should be able to develop both API, UI, and backend validations.

· Integration of user-facing elements developed by front-end developers with server-side logic and Implementation of security and data protection.

· Experience in Developing applications, software using Python, developing web services using Django, Flask, working with REST API, and working with any databases technology.

· Worked on open-source tools for logging, monitoring, search engine, caching, etc.

· Exposure to any of relation database technologies MySQL/Postgres/Oracle or any No-SQL database.

· Experience working on DevOps tools for continuous integration.

· Performed App servers, application deployments, web server deployments.

· Design and implementation of low-latency, high-availability, and performant applications.

· Working knowledge of AWS, enough to be able to set up the environment for application development.

· Good good analytical and execution skills.

· Worked on open-source software for development, logging, monitoring, search engine, caching, etc.

http://www.banyandata.com" target="_blank">www.banyandata.com 

Read more
Leading Logistics-tech Platform
Leading Logistics-tech Platform
Agency job
via Unnati by Rakhi Gayen
Bengaluru (Bangalore)
1 - 3 yrs
₹14L - ₹18L / yr
skill iconJava
Software Development
Logistics
skill iconRuby
Clojure
+4 more
Work with a new-age, reliable logistics platform aiming to disrupt on-time delivery with ultimate efficiency! Read more.
 
Our client is a leading intra-city delivery solutions provider, that focuses on sorting out the largely unorganised logistics space in the country. It is also an aggregator of inter-city mini trucks and large transport vehicles for the Retail, Ecommerce and FMCG sectors. Their app is a platform used by their clients and truck owners, providing GPS enable vehicles, 24X7 support, economical pricing and multi-capacity loaders. Truckers can use their location and choose their transport jobs, while the companies get to pick the drivers as per their ratings.
 
With a fleet of over 44000 trucks and clients like Britannia, Bisleri, Amazon, Flipkart, Metro CashnCarry, Gati, Delhivery and more, the 5-year old platform has raised over $20Mn across multiple funding rounds. Founded and led by IIT-KG alumni, the company has operations in major cities across the country and looking to make inroads in other sectors and verticals.
 
As a Software Development Engineer -1, you will solve complex and interesting problems, converting design into code fluently.
 
What you will do:
  • Working with Databases and Linux platform
  • Understanding algorithms, databases and their space and time complexities
  • Writing unit and integration tests with reasonable coverage of code and interfaces
  • Solving complex and interesting problems
  • Taking up a high level of ownership and commitment towards the business and product vision
 

What you need to have:

  • Minimum 1-year experience
  • Strong problem-solving skills
  • Good understanding of data structures & algorithms and their space & time complexities
  • Strong hands-on and practical working experience with at least one programming language: C/Java/C++/C#
  • Excellent coding skills – should be able to convert the design into code fluently
  • Strong technical aptitude and a good knowledge of CS fundamentals
  • Hands-on experience working with Databases and Linux platform is a plus
  • B-Tech in Computer Science or equivalent from a reputed college
  • Good experience in at least one general programming language (Java, Ruby, Clojure, Scala, C/C++, Python and SQL)
  • A solid foundation in computer science, with strong competencies in data structures, algorithms, and software design.
  • Have a penchant for solving complex and interesting problems, Worked in startup like environment with high levels of ownership and commitment
  • Excellent coding skills – should be able to convert design into code fluently
  • Good skills to write unit & integration tests with reasonable coverage of code & interfaces
  • TDD is a plus
Read more
Education Loans Fintech |Delhi
Education Loans Fintech |Delhi
Agency job
via Unnati by Rakhi Gayen
NCR (Delhi | Gurgaon | Noida)
1 - 8 yrs
₹8L - ₹19L / yr
skill iconRuby
skill iconRuby on Rails (ROR)
Regression Testing
skill iconJavascript
skill iconAmazon Web Services (AWS)
+1 more
Do you wish to be a part of a disruptive team, passionate towards democratizing education for students across India? Then read more.

 


Our client is an expert in education financing and counselling related to higher studies abroad. They help students to understand about scholarships in various colleges abroad, whether they are eligible and how to apply for such esteemed institutions. Their dedicated page enlists every scholarship available across the globe, apart from other facilities required by students like visa counselling, forex, accommodation, Peer contacts etc.

 


They also offer the best resources for exams like IELTS, TOEFL and GRE apart from organising webinars and events to connect with industry experts, alumni and fellow students - which helps to prepare for travels, loans and more. Partnered with the most prominent Banking and non-banking financiers, the team is led by FinTech-experienced IIT Kanpur alumni, passionate about offering sustainable financial offerings.
 
As a Software/ Sr. Software Developer (Ruby On Rails), you will be a part of the product development team.
 
What you will do:
  • Improving customer experience, not only for borrowers but also other partners on the platform
  • Ensuring seamless integration with data/ service providers and lending partners
  • When not doing any of the above, writing tests to prevent any regressions

 

 

What you need to have:

  • Must have skills:
  1. Good Experience in Ruby On Rails
  2. Experience in Modular Javascript programming
  3. Self-starter: Someone who can develop independently
  4. Passionate about problem-solving, ability to see the big picture
  5. Realizes the value of 80-20
  • Good to have skills:
  1. DevOps experience (Managing web application on AWS)
  2. Prior experience in the Fintech or Banking industry as a tech role.
  3. Test case writing

Software Developer: 1 to 4 yrs
Sr. Software Developer: 4 to 8 yrs
Read more
senrysa technologies (p) ltd
Sneha Chowdhury
Posted by Sneha Chowdhury
Remote only
3 - 9 yrs
₹10L - ₹15L / yr
skill iconRuby on Rails (ROR)
skill iconRuby
Microservices
AWS Lambda
skill iconDocker
+4 more

Job Description

We are looking for a ROR developer. If you're a creative problem solver who is eager to develop amazing products and hungry for a new adventure, a word class workplace is waiting for you.

  • Production experience in Ruby.
  • A completed technical degree in Computer Science or any related fields.
  • 3+ years of professional product development experience.
  • Being comfortable with microservices architectures, API-based
  • You are a pragmatic programmer who understands what is needed to get things done.
  • Problem solving and collaborative mindset.
  • Experience working with DevOps (Docker, Kubernetes, Terraform).
  • Experience with AWS (RDS, DDB, Lambda, CW, EC2, SQS, SNS, Cognito, Kinesis).
  • Experience with performance improvements (Caching Techniques, SQL Query Optimization, Performance monitoring and profiling.
  • Deep understanding of service-oriented and microservices architectural patterns, troubleshooting methods and best practices.
  • Takes end to end ownership of the development and operation of complete features.
Read more
Cooptech Management Pte Ltd
Bengaluru (Bangalore)
3 - 5 yrs
₹4L - ₹8L / yr
skill iconJava
skill iconC++
Data Structures
Algorithms
skill iconScala
+3 more
COOPTECH MANAGEMENT PTE. LTD. (the "Company") is a Exempt Private Company Limited by Shares, incorporated on 31 July 2012 in Singapore. The address of the Company's registered office is at the BEACH CENTRE building. The Company's principal activity is development of software and programming activities n.e.c. with business and management consultancy services (general) as the secondary activity. An ideal candidate will operate at all levels, diving deep into the details while providing strategic inputs for the product in a fast paced environment. our Sr. SDEs don’t just define the technical approach, but also have a seat at the table to help make the right product decisions. As a software developer you will be working with business partners, testers UI/UX designers to design, implement, test, launch, document, and maintain complex software applications, tools, and systems. You will have significant influence on our overall strategy by helping define these product features, drive the system architecture, and spearhead the best practices that enable a quality product. You will learn a variety of cutting-edge technologies and mobile development processes, and develop well-rounded skills on technology, leadership, and effective project management. You will also mentor junior software development engineers. Not only do we deliver high-impact customer facing features, we also focus on learning, sharing, innovating and having fun at work Responsibilities ● Unit-testing code for robustness, including edge cases, usability, and general reliability ● Bug fixing and improving application performance ● Collaborate with cross-functional teams to define, design, and ship new features ● Work with outside data sources and APIs ● Unit-test code for robustness, including edge cases, usability, and general reliability ● Work on bug fixing and improving application performance ● Continuously discover, evaluate, and implement new technologies to maximize development efficiency ● Develop and implement new software programs ● Maintain and improve the performance of existing software ● Clearly and regularly communicate with management ● Provide technical support to colleagues in headquarter Requirements ● BS/MS degree in Computer Science, Engineering or a related subject ● Good social, verbal, and communication skills ● Ability to manage multiple projects and deadlines at once ● Keen eye for design and ideas into development ● 2-3 years of Android App Development experience (4.0 and higher) ● Excellent communication skills with the ability to effectively communicate with both technical and non-technical team members ● Experience with providing Technical Leadership on Full Life-Cycle Development supporting Mission Critical apps ● Proven software development experience and Android skills development ● Proven working experience in Android app development and ● Have published at least one original Android app ● Experience with Android SDK ● Experience with third-party libraries and APIs ● Working knowledge of the general mobile landscape, architectures, trends, and emerging technologies ● Solid understanding of the full mobile development life cycle.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos