Cutshort logo
MNC logo
Data Engineer (Pyspark Developer)
MNC
Data Engineer (Pyspark Developer)
MNC's logo

Data Engineer (Pyspark Developer)

at MNC

Agency job
4 - 12 yrs
₹15L - ₹30L / yr
Remote, Bengaluru (Bangalore)
Skills
PySpark
Pyspark Developer
skill iconScala
DevOps

EXP-Developer-4 to 12 years

 

 

         Must have low-level design and development skills.  Should able to design a solution for given use cases. 

  • Agile delivery-  Person must able to show design and code on a daily basis
  • Must be an experienced PySpark developer and  Scala coding.   Primary skill is PySpark
  • Must have experience in designing job orchestration, sequence, metadata design, Audit trail, dynamic parameter passing and error/exception handling
  • Good experience with unit, integration and UAT support
  • Able to design and code reusable components and functions
  • Should able to review design, code & provide review comments with justification
  • Zeal to learn new tool/technologies and adoption
  • Good to have experience with Devops and CICD
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Wissen Technology
at Wissen Technology
4 recruiters
Anurag Sinha
Posted by Anurag Sinha
Pune, Mumbai, Bengaluru (Bangalore)
5 - 9 yrs
Best in industry
skill iconPython
RESTful APIs
skill iconFlask
skill iconKubernetes
DevOps
+2 more
  • 5+ years of experience
  • FlaskAPI, RestAPI development experience
  • Proficiency in Python programming.
  • Basic knowledge of front-end development.
  • Basic knowledge of Data manipulation and analysis libraries
  • Code versioning and collaboration. (Git)
  • Knowledge for Libraries for extracting data from websites.
  • Knowledge of SQL and NoSQL databases
  • Familiarity with RESTful APIs
  • Familiarity with Cloud (Azure /AWS) technologies


Read more
Wissen Technology
at Wissen Technology
4 recruiters
Vijayalakshmi Selvaraj
Posted by Vijayalakshmi Selvaraj
Mumbai, Bengaluru (Bangalore)
5 - 10 yrs
Best in industry
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
skill iconScala
+1 more

Skills Required:


- 4+ years of technical experience in a developer role

- Strong proficiency with Core Java

- Database experience preferably with DB2, Sybase, or Oracle

- Complete SDLC process and Agile Methodology (Scrum)

- Strong oral and written communication skills

- Excellent interpersonal skills and professional approach

- Bachelor’s degree in Computer Science, MIS, or other technology/engineering discipline


Skill Desired:


-Strong proficiency with Scala on Spark

- Previous experience in front office and back office reports

- Strong understanding Order Life Cycle management from Equities or Listed derivatives perspective

- Previous experience in Trade Surveillance or working with data from the order lifecycle

- Good to have knowledge on Hadoop Technologies

- High quality software architecture and design methodologies and patterns

- Work experience as level-3 support for applications

- Layered Architecture, Component based Architecture

- XML-based technologies

- Unix OS, Scripting, Python or Perl

- Experience in development on other application types (Web applications, batch, or streaming)

Read more
Leading Consulting firm in the World
Leading Consulting firm in the World
Agency job
Remote, Bengaluru (Bangalore)
10 - 20 yrs
₹40L - ₹55L / yr
skill icon.NET
skill iconJava
skill iconGo Programming (Golang)
skill iconScala
Architecture
+11 more
  • Bachelor's or Master’s degree in Computer Science or equivalent area
  • 10 to 20 years of experience in software development
  • Hands-on experience designing and building B2B or B2C products
  • 3+ years architecting SaaS/Web based customer facing products, leading engineering teams as software/technical architect
  • Experiences of engineering practices such as code refactoring, microservices, design and enterprise integration patterns, test and design-driven development, continuous integration, building highly scalable applications, application and infrastructure security
  • Strong cloud infrastructure experience with AWS and/or Azure
  • Experience building event driven systems and working with message queues/topics
  • Broad working experience across multiple programming languages and frameworks with in-depth experience in one or more of the following: .Net, Java, Scala or Go-lang
  • Hands-on experience with relational databases like SQL Server, PostgreSQL and document stores like Elasticsearch or MongoDB
  • Hands-on experience with Big Data processing technologies like Hadoop/Spark is a plus
  • Hands-on experience with container technologies like Docker, Kubernetes
  • Knowledge of Agile software development process
Read more
Recro
at Recro
1 video
32 recruiters
Mohit Arora
Posted by Mohit Arora
Bengaluru (Bangalore), Delhi, Gurugram, Noida
2.5 - 7 yrs
Best in industry
skill iconNodeJS (Node.js)
skill iconMongoDB
Mongoose
skill iconExpress
GraphQL
+4 more

Key Responsibilities: 

  • Rewrite existing APIs in NodeJS. 
  • Remodel the APIs into Micro services-based architecture. 
  • Implement a caching layer wherever possible. 
  • Optimize the API for high performance and scalability. 
  • Write unit tests for API Testing.
  • Automate the code testing and deployment process.


Skills Required: 

  • At least 2 years of experience developing Backends using NodeJS — should be well versed with its asynchronous nature & event loop, and know its quirks and workarounds. 
  • Excellent hands-on experience using MySQL or any other SQL Database. 
  • Good knowledge of MongoDB or any other NoSQL Database. 
  • Good knowledge of Redis, its data types, and their use cases. 
  • Experience with graph-based databases like GraphQL and Neo4j. 
  • Experience developing and deploying REST APIs. 
  • Good knowledge of Unit Testing and available Test Frameworks. 
  • Good understanding of advanced JS libraries and frameworks. 
  • Experience with Web sockets, Service Workers, and Web Push Notifications. 
  • Familiar with NodeJS profiling tools. 
  • Proficient understanding of code versioning tools such as Git. 
  • Good knowledge of creating and maintaining DevOps infrastructure on cloud platforms. 
  • Should be a fast learner and a go-getter — without any fear of trying out new things Preferences. 
  • Experience building a large scale social or location-based app.


Read more
Banyan Data Services
at Banyan Data Services
1 recruiter
Sathish Kumar
Posted by Sathish Kumar
Bengaluru (Bangalore)
3 - 15 yrs
₹6L - ₹20L / yr
skill iconPython
skill iconDjango
skill iconFlask
API
MySQL
+6 more

Senior Python Backend Developer 

Notice Period: 45 days / Immediate Joining

 

Banyan Data Services (BDS) is a US-based Infrastructure Services Company, headquartered in San Jose, California, USA. It provides full-stack managed services to support business applications and data infrastructure.  We are looking for a Senior Python Developer to join our development team based out of Bangalore. This teamwork on building the next-generation SAS application on the Hybrid Cloud platform.  

It's a once-in-a-lifetime opportunity to join our rocket ship startup run by a world-class executive team. We are looking for candidates that aspire to be a part of the cutting-edge solutions and services we offer that address next-gen data evolution challenges.  

 

Key Qualificatisons

· Ability to write high-quality code efficiently.

· Design and develop new services/micro-services.

· Participate in planning and management of development process.

· Share architectural design vision with both technical and non-technical team members, including fellow engineers.

· Works on improvements in development toolset including testing frameworks, deployment scripts, and monitoring libraries.

· Experience solving complex problems and implementing solutions for performance and scalability.

· Write clean, well-structured, and maintainable code with automated test coverage and corresponding documentation.

· Explore new latest relevant technology, techniques, frameworks, tools, methodologies, and processes.

· Comfortable working with all aspects of software development; including dev-ops, quality assurance, research, and design.

Requirements

· Minimum 3 years of experience as a Python Developer in application development.

· Experience in Developing applications/software using Python, developing web services using Django/Flask, working with REST API, and working with any databases technology.

· Strong in Reg expression and string handling.

· Strong in python programming and should be able to develop both API, UI, and backend validations.

· Integration of user-facing elements developed by front-end developers with server-side logic and Implementation of security and data protection.

· Experience in Developing applications, software using Python, developing web services using Django, Flask, working with REST API, and working with any databases technology.

· Worked on open-source tools for logging, monitoring, search engine, caching, etc.

· Exposure to any of relation database technologies MySQL/Postgres/Oracle or any No-SQL database.

· Experience working on DevOps tools for continuous integration.

· Performed App servers, application deployments, web server deployments.

· Design and implementation of low-latency, high-availability, and performant applications.

· Working knowledge of AWS, enough to be able to set up the environment for application development.

· Good good analytical and execution skills.

· Worked on open-source software for development, logging, monitoring, search engine, caching, etc.

http://www.banyandata.com" target="_blank">www.banyandata.com 

Read more
Amazon India
at Amazon India
1 video
58 recruiters
Nithya Nagarathinam
Posted by Nithya Nagarathinam
Bengaluru (Bangalore), Chennai, Hyderabad, Pune, Gurugram, India
3 - 9 yrs
₹1L - ₹15L / yr
skill iconJava
Data Structures
Algorithms
skill iconScala
skill iconC++
+6 more

Role- Software Development Engineer-2

As a Software Development Engineer at Amazon, you have industry-leading technical abilities and demonstrate breadth and depth of knowledge. You build software to deliver business impact, making smart technology choices. You work in a team and drive things forward.

Top Skills

You write high quality, maintainable, and robust code, often in Java or C++ or C#

You recognize and adopt best practices in software engineering: design, testing, version control, documentation, build, deployment, and operations.

You have experience building scalable software systems that are high-performance, highly-available, highly transactional, low latency and massively distributed.

Roles & Responsibilities

You solve problems at their root, stepping back to understand the broader context.

You develop pragmatic solutions and build flexible systems that balance engineering complexity and timely delivery, creating business impact.

You understand a broad range of data structures and algorithms and apply them to deliver high-performing applications.

You recognize and use design patterns to solve business problems.

You understand how operating systems work, perform and scale.

You continually align your work with Amazon’s business objectives and seek to deliver business value.

You collaborate to ensure that decisions are based on the merit of the proposal, not the proposer.

You proactively support knowledge-sharing and build good working relationships within the team and with others in Amazon.

You communicate clearly with your team and with other groups and listen effectively.

Skills & Experience

Bachelors or Masters in Computer Science or relevant technical field.

Experience in software development and full product life-cycle.

Excellent programming skills in any object-oriented programming languages - preferably Java, C/C++/C#, Perl, Python, or Ruby.

Strong knowledge of data structures, algorithms, and designing for performance, scalability, and availability.

Proficiency in SQL and data modeling.

Read more
healthcare client that deals in home sleeping industry
healthcare client that deals in home sleeping industry
Agency job
via Success Pact by Priya Sariyal
Bengaluru (Bangalore)
3 - 7 yrs
₹10L - ₹20L / yr
skill iconJavascript
skill iconReact Native
skill iconNodeJS (Node.js)
skill iconHTML/CSS
skill iconAmazon Web Services (AWS)
+2 more
Experience with building backend applications in microservice architecture

Fluency in modern JavaScript (ES6/7) and other frontend fundamentals (HTML5,
CSS3) and Node.js

Exposure to React( native) basics

Experience with AWS, CI/CD and DevOps

Experience with Web Security

Basic exposure to Go is valuable but not necessary

Willingness to travel for onsite assignments outside India
Read more
Springer Nature
at Springer Nature
2 recruiters
Anagha Malvade
Posted by Anagha Malvade
Pune
4.5 - 10 yrs
₹5L - ₹20L / yr
skill iconScala
skill iconJava
skill iconJavascript
Akka
Play Framework

We are on a quest to find a Senior Software Developer - Scala with several years of experience who will help us in extending and maintaining our platform

 You will join a cross functional team with different nationalities, backgrounds and experience levels. The agile team is co-located including the Product Managers

You will collaborate with all team members in order to deliver the best solutions that enhance our platform

About Springer Nature India Pvt. Ltd:

 Springer Nature opens the doors to discovery for researchers, educators, clinicians and other professionals. Every day, around the globe, our imprints, books, journals, platforms and technology solutions reach millions of people. For over 175 years our brands and imprints have been a trusted source of knowledge to these communities and today, more than ever, we see it as our responsibility to ensure that fundamental knowledge can be found, verified, understood and used by our communities – enabling them to improve outcomes, make progress, and benefit the generations that follow.

Visit: http://group.springernature.com">group.springernature.com and follow @SpringerNature

 

If you are still wondering, why should you work with us. Here are 5 reasons why?

  1. Springer Nature is one of the world's largest publishing company. Nobel laureates publish their research at Springer.
  2. We are truly a digital organization and Springer Nature Pune is at the helm of this digitization.
  3. We not only believe but preach providing good work life balance to our employees.
  4. We are investing in building our products using machine learning and NLP.
  5. We work in latest technologies like AWS and Scala.

About the team:

Backend - Adis – PV is a scientific analysis platform being built for extracting content from scientific articles and providing meaningful insights

Insights are then published in a structured way, so that they can be made accessible to end users, via feeds delivery or through the platform

Backend - Adis – PV will be a production system for all databases under one IT landscape and under one umbrella.

Job Type: Permanent    
                                   

Job Location: Magarpatta City, Pune - India  (Work from home until further notice)

Years of Experience 6 to 10 years

What we are looking for

Educational Qualification:

B.Sc., BCA, BCS, B.E., B.Tech, M.Tech, MCA and M.Sc.

Skill Matrix:

Primary Language Skills: Java 8, Scala

Framework: Play Framework

Messaging: Rabbit MQ

Ideologies: TDD / ATDD, Pair Programming

Database: SQL and NoSQL

Challenges

  • You will help us continuously improving our platform
  • Together we will create best in class services that support the needs of our customers
  • Taking part of team ceremonies like grooming, planning and retrospective
  • Develop new features
  • Improve code quality by doing pair programming or code reviews
  • Continuously improve and monitor our product

Key Responsibilities

  • Own and consistently deliver high quality end-to-end product features keeping in view technical & business expectations
  • Add meaty features to the product which will deliver substantial business value
  • Pioneer clean coding and continuous code refactoring
  • Understands and appreciates existing design and architecture of the product
  • Understands pros and cons of various technology options available
  • Takes technical ownership of some of sub-systems of the product
  • Makes changes in the product designs to achieve required business value / mileage
  • Identify and addresses technical debts
  • Understands technical vision and road-map of the product and expectations
  • Understands purview of key pieces of deliverables and own few of these pieces

Day at work

  • Pioneer proof of concepts of new technologies keeping in view product road-map and business priorities
  • Self-study and share his / her learning within the team and across teams
  • Provide required help to other team-members
  • Pioneer in various team events and work towards objectives of these events
  • Make meaningful suggestions to make ceremonies more effective

About You

  • You have several years of experience with Software Development
  • You have worked successfully with product teams in the past and ideally have some experience with mentoring junior developers
  • You like working in a collaborative environment where there is collective ownership of the code
  • You work in a Continuous Integration and always strive for Continuous Delivery
  • You like to share and enable others to increase your whole team's performance
Read more
Transportation | Warehouse Optimization
Keith Moore
Posted by Keith Moore
Remote only
2 - 20 yrs
₹10L - ₹35L / yr
skill iconC++
Microsoft Windows Azure
skill iconDocker
skill iconGit
skill iconScala
+3 more

Company Introduction

AutoScheduler is looking for a remote senior software developer to join our talented team. The ideal candidate is a self-starter who is interested in constant learning. We want this person to join our dynamic team as we take an established software and re-develop it from scratch as a part of a new start up.

Job Description

We are looking for a Backend C++ developer responsible for maintaining and developing algorithmic C++ for new and existing customers. Your primary responsibilities will be to design and develop applications and services, and to coordinate with the rest of the team working on different layers of the infrastructure. Therefore, a commitment to collaborative problem solving, robust design, and quality product is essential.

Responsibilities

  • Work with non-technical personnel to translate business requirements into stories and epics
  • Translate application storyboards and use cases into functional applications / features
  • Design, build, and maintain efficient, reusable, and reliable code
  • Ensure the best possible performance, quality, and responsiveness of applications
  • Identify bottlenecks and bugs, and devise solutions to these problems
  • Help maintain code quality, organization, and automation
  • Write and maintain unit/functional/integration tests

 

Requirements

  • Bachelor’s degree with STEM concentration + 2 years’ work experience, or equivalent work experience
  • Fluent in English
  • Demonstrably proficient in C/C++ and the ability to parse C/C++ code
  • Proficiency in Node.js and Javascript
  • Basic understanding of Common Language Runtime (CLR), its limitations, weaknesses, and workarounds
  • Working knowledge of at least two other programming languages (e.g. Go and Python)
  • Proficient understanding of modern distributed code versioning tools (like ‘git’)
  • Thorough understanding of SQL, and in-depth experience with at least one RDBMS (e.g. PostgreSQL or Microsoft SQL Server)
  • Experience with automated testing frameworks and unit tests
  • Solid understanding of object-oriented programming and principles
  • Knowledge of functional programming principals / concepts

 

Desired Skills

  • Experience building applications with C++
  • Experience building cross-platform applications with Scala
  • Experience with functional programming
  • Familiarity with concurrency patterns in Scala
  • Experience building distributed systems and/or decoupled microservices
  • Experience building software using cloud-based services (in any cloud platform)
  • Experience using “gRPC” and Protocol Buffers (“protobuf”) and/or experience creating services that exchange non-JSON data over non-HTTP protocols
  • Familiarity with continuous integration
  • Familiarity with Docker / containerization
Read more
Navia Life Care
at Navia Life Care
1 video
4 recruiters
Sakshi Dixit
Posted by Sakshi Dixit
NCR (Delhi | Gurgaon | Noida)
5 - 10 yrs
₹12L - ₹30L / yr
skill iconPython
Data Structures
Strategic technology planning
skill iconDjango
DevOps
+2 more
Navia Life Care is looking for a Chief Technology Officer.

An ideal candidate should have well-rounded experience (5-10 years) in various technologies - backend/web development (Python/Django), DevOps, Android and iOS - or at least 2 out of the above

The person would be managing an expanding team of developers and guide the product development, along with contributing significantly to the core decisions of the company.

An entrepreneurial spirit, and the passion to make a difference in the healthcare ecosystem of the country is recommended.

The candidate will be well compensated with a combination of cash + equity, depending on experience and expertise.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos