Cutshort logo
MNC logo
Data Engineer (Pyspark Developer)
MNC
Data Engineer (Pyspark Developer)
MNC's logo

Data Engineer (Pyspark Developer)

at MNC

Agency job
4 - 12 yrs
₹15L - ₹30L / yr
Remote, Bengaluru (Bangalore)
Skills
PySpark
Pyspark Developer
skill iconScala
DevOps

EXP-Developer-4 to 12 years

 

 

         Must have low-level design and development skills.  Should able to design a solution for given use cases. 

  • Agile delivery-  Person must able to show design and code on a daily basis
  • Must be an experienced PySpark developer and  Scala coding.   Primary skill is PySpark
  • Must have experience in designing job orchestration, sequence, metadata design, Audit trail, dynamic parameter passing and error/exception handling
  • Good experience with unit, integration and UAT support
  • Able to design and code reusable components and functions
  • Should able to review design, code & provide review comments with justification
  • Zeal to learn new tool/technologies and adoption
  • Good to have experience with Devops and CICD
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos

Similar jobs

codersbrain
at codersbrain
1 recruiter
Tanuj Uppal
Posted by Tanuj Uppal
Remote only
6 - 10 yrs
₹5L - ₹12L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Databases
+6 more
Job Description
  • Experience in API development using Java will be a plus.
  • Excellent knowledge and experience in writing testable, scalable, flexible, robust and efficient web applications using JavaEE 6/7 technologies, specifically, Spring core, Spring Boot Spring Data, spring batch and JPA
  • Experience in successfully deploying Java-based applications in production and understanding load-balancing, authentication, and fault tolerance through Tom Cat.
  • Experience in database modeling (MySQL/NoSQL databases such as Mongo DB)
  • Knowledge of integrating with Ant, Maven, GIT and Shell scripting.
  • Strong backend experience to develop Data Layer using at least one of the ORM frameworks like Hibernate, JPA etc.
  • Strong RDBMS Skills and SQL skills. Experience in MySQL, Teradata and warehousing databases.
  • Experience in Analytics frameworks and visualization products.

  • Excellent knowledge and experience of Maven, Continuous Integration, and Continuous Delivery with Jenkins.
    • Experience with JavaScript frameworks, especially Angular is a definite plus.
Tools/Technology needs:

Java 8, J2EE , Spring Boot, Microservices, Apache Spark, DevOps, Advanced SQL, preferably with

expertise in Data engineering/Data analytics,

ELK(Elastic Search, Logstash , Kibana) stack, Teradata, any No SQL database, Hands on experience in

maintaining products on Cloud Technologies like PCF, Azure, Docker, Kubernetes, etc, NodeJS,

Angular 2x, GitLab with CI/CD, Hands on experience in Unix server, Shell scripting, Large data

processing, Performance tuning, Experience in working in various Test Automation frameworks like

Selenium, Test NG, Python, Cucumber, Karma, Karate/ Jasmine, etc

Experience in using Eclipse, Spring tool suite, Project building tools - Maven, Gradle, etc, JIRA for ALM.


Read more
Publicis Sapient
at Publicis Sapient
10 recruiters
Pooja Singh
Posted by Pooja Singh
Bengaluru (Bangalore), Mumbai, Gurugram, Noida, Hyderabad, Pune
4 - 19 yrs
₹1L - ₹15L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Microservices
+7 more
  • Experience building large scale, large volume services & distributed apps., taking them through production and post-production life cycles
  • Experience in Programming Language: Java 8, Javascript
  • Experience in Microservice Development or Architecture
  • Experience with Web Application Frameworks: Spring or Springboot or Micronaut
  • Designing: High Level/Low-Level Design
  • Development Experience: Agile/ Scrum, TDD(Test Driven Development)or BDD (Behaviour Driven Development) Plus Unit Testing
  • Infrastructure Experience: DevOps, CI/CD Pipeline, Docker/ Kubernetes/Jenkins, and Cloud platforms like – AWS, AZURE, GCP, etc
  • Experience on one or more Database: RDBMS or NoSQL
  • Experience on one or more Messaging platforms: JMS/RabbitMQ/Kafka/Tibco/Camel
  • Security (Authentication, scalability, performance monitoring)
Read more
SUVI(provide upto 18LPA)
SUVI(provide upto 18LPA)
Agency job
via SUVI BUSINESS VENTURE by VINOTH KUMAR
Bengaluru (Bangalore)
5 - 6 yrs
₹5L - ₹15L / yr
skill iconGo Programming (Golang)
skill iconRuby on Rails (ROR)
skill iconRuby
skill iconPython
skill iconJava
+7 more
REQUIREMENTS AND RESPONSIBILITES
• Strong proficiency with Java programming & DevOps
• -Must have experience on Micro-Services using Spring boot/Jersy/Swagger.
• Must havegood knowledge on Dockers.
• Must have at least 1to 2 years’ experience of Web application
• Knowledge of OOP concepts, industry best practices and design
• Well versed Back-end build pipelines and tools-Professional, precise communication
skills
• Work experience writing Unit Tests
• Work experience on applying the best practices ofWeb Applicationdevelopment
• Working experience in an Agile team especially with SCRUM

• Good understandingof DevOps, CI/CD principles and practices
toimprove Software Quality & Efficienc
• Good understanding of web technology/enterprise level applications
• Good to have experience in in JavaScript frameworks
• Good to have experience in Agile Methodology
• Good to have previously worked on distributed systems
• Good to have working knowledge on Kafka and Redis
• Good to have exposure to stream processing and functional
programming


CANDIDATES MUST HAVE
• JAVA 8 or above
• DevOps
• 1+years of Web Development experience
• Javascript Framework
• Hibernate &Mircroservices
Read more
Jivox Software India Pvt Ltd
Remote only
3 - 6 yrs
₹15L - ₹23L / yr
Object Oriented Programming (OOPs)
skill iconAmazon Web Services (AWS)
skill iconJava
J2EE
skill iconSpring Boot
+4 more

Your Opportunity

  • Own and drive business features into tech requirements
  • Design & develop large scale real time server side systems
  • Quickly create quality prototypes
  • Staying updated on emerging technologies
  • Ensuring that all deliverables adhere to our world class standards
  • Promote coding best practices
  • Mentor and develop junior developers in the team

 

Required Experience:

  • 4+ years of relevant experience as described below
  • Excellent grasp of Core Java, Multi Threading and OO design patterns
  • Experience with Scala, functional, reactive programming and Akka/Play is a plus
  • Excellent understanding of data structures and algorithms
  • Solid grasp of large scale distributed real time systems
  • Prior experience on building a scalable and resilient micro service
  • Solid understanding of relational databases, NoSQL databases and Caching systems
  • Good understanding of Big Data technologies such as Spark, Hadoop is a plus
  • Experience on one of AWS, Azure or GCP

 

Who you are :

  • You have excellent and effective communication and collaborative skills
  • You love problem solving
  • You stay up to date with the latest technologies and then apply them in real life
  • You love paying attention to detail
  • You thrive in meeting tight deadlines and prioritising workloads
  • Ability to collaborate across multiple functions

 

Education:

Bachelor’s degree in Engineering or equivalent experience within the field

Read more
Strata
at Strata
1 recruiter
Lavanya G
Posted by Lavanya G
Bengaluru (Bangalore)
4 - 8 yrs
₹20L - ₹22L / yr
skill iconPython
skill iconDjango
Web applications
skill iconAmazon Web Services (AWS)
skill iconJavascript
+2 more

About us:

Strata is a commercial real estate investment platform that offers investors the opportunity to invest in pre-leased commercial assets such as offices, warehouses, and retail spaces across India.


We are one of the fastest-growing PropTech platforms in India and are backed by Elevation Capital, Mayfield, Kotak Investment Advisors, Gruhas (a venture by Nikhil Kamath of Zerodha) and DLF Family Office.

Our headquarter is in Bangalore, India.

We are a small yet close-knit team of 35+ people.


About you:

You have a knack for product and strongly equipped with engineering skills to make it a reality. You don’t jump into implementation unless you have clearly understood the problem/requirements and have a written design. You don’t hesitate asking questions and giving critical reviews while respecting others’ opinions. You are a fearless engineer, and not afraid to fail, not on production though ;) You have a strong sense of ownership. You have a startup experience. You don’t feel annoyed if required to work on off days in case of production incidents (no development).


Your responsibilities:

You will primarily work on the backend maintaining the existing platform and writing new enhancements and features. Apart from your own features, as a senior member of the team you will be expected to be actively involved in overall design discussions and peer code reviews. You will factor in extensibility, maintainability, scalability and security in designs and code. You will ensure that best engineering practices are followed. You will support your team members when they are facing challenges, and mentor them when appropriate. You will strive for overall engineering excellence.


Must-have Skills:

  • 4-8 years of total experience
  • 2+ years of experience in Django and DRF. You must be pro at it. The team will be looking up to you for making most out of DRF.
  • Designing and building  scalable web applications
  • Good understanding of REST principles
  • SQL database design and queries
  • Working knowledge of AWS

Good-To-Have Skills:

  • Angular or any other JavaScript frontend framework
  • Designing microservices
  • DevOps experience


FAQ's.

1. Your technology ingredients?

Programming languages:
Our backend is written in Python using Django framework. And the frontend is in AngularJS. Currently there is no mobile app.

Infrastructure:
We are an AWS shop and use their services for most needs, Docker for containerization and ECS as orchestrator, RDS as database, S3 for storage and SQS as messaging backend.

Other tools:
BitBucket for Git and CI/CD pipeline, Trello for project management; and Google Meets and Slack for communication.

2. Your hiring plan?

Currently the engineering team comprises of 3 engineers, and we plan to grow it to 8 by the end of 2021.

3. Your Interview process?

We will try to finish the process within two weeks. In case we can’t go ahead with  your candidature, we will clearly and immediately let you know. But in case of competing applications, we may request you to wait for a week or two.

  1. 15 minutes introductory call to discuss requirements and expectations
  2. 30 minutes online coding assignment on a screen sharing session
  3. 1 hour technical interview covering problem solving, code review and aptitude
  4. 15 minutes call with co-founder for final discussion

In case of inability to come to a conclusion from either side, we may go for an additional round.

4. Your WFH and WFO policy?

Due to Covid-19 the team is working from home and will continue till March-2022. After that we will work from the Bangalore or Pune office (yet to be finalised). You should be open to relocate to any of the cities.

5. Your funding status?

In March 2020, Strata raised $1.5 million in seed funding; and $6 million in Series-A in July 2021.

Read more
Amazon India
at Amazon India
1 video
58 recruiters
Neeta Singh Mehta
Posted by Neeta Singh Mehta
Bengaluru (Bangalore), Hyderabad, Noida, gurugram, Mumbai, Pune, NCR (Delhi | Gurgaon | Noida)
3 - 8 yrs
₹6L - ₹32L / yr
skill iconJava
skill iconPython
skill iconRuby
skill iconPHP
skill iconC++
+9 more

Greetings from Amazon...!                                       

 

It is our pleasure in personally inviting you to apply job with Amazon Development Centre India (ADCI). At Amazon we are inclined to hire people with passion for technology and you happened to be one of the shortlisted candidates. Our business is committed to recognizing potential and creating teams that embrace innovation.

 

Please find the Eligible criteria and requirements:

 

Job title                             :             SDE – II (Software Development Engineer)
Role Opportunity
            :             Permanent/Full Time/FTE/Regular

Work Location                 :             Hyderabad/Bangalore/ Gurgaon

 

Must Have

  • Strong Exposure to Data Structures, Algorithms, Coding, System Design (LLD, HLD, OOAD), Distributed systems, problem solving skills, Architecture (MVC/Microservices), logical thinking.

Amazon (ADCI) - If you are looking for an opportunity to solve deep technical problems and build innovative solutions in a fast paced environment working with smart, passionate software developers, this might be the role for you. Amazon’s transportation systems get millions of packages to customers worldwide faster and cheaper while providing world class customer experience – from checkout to shipment tracking to delivery. Our software systems include services that handle thousands or requests per second, make business decisions impacting billions of dollars a year, integrate with a network of small and large carriers worldwide, manage business rules for millions of unique products, and improve experience for millions of online shoppers. With rapid expansion into new geographies, innovations in supply chain, delivery models and customer experience, increasingly complex transportation network, ever expanding selection of products and growing number of shipments worldwide, we have an opportunity to build software that scales the business, leads the industry through innovation and delights millions of customers worldwide.

 

As an SDE, you will develop a deep understanding of our business, work closely with development teams and own the architecture and end-to-end delivery of software components.

About Amazon India:

Amazon teams in India work on complex business challenges to innovate and create efficient solutions that enable various Amazon businesses, including Amazon websites across the world as well as support Payments, Transportation, and Digital products and services like the Kindle family of tablets, e-readers and the store. We are proud to have some of the finest talent and strong leaders with proven experience working to make Amazon the Earth’s most customer-centric company.

We made our foray into the Indian market with the launch of Junglee.com, enabling retailers in India to advertise their products to millions of Indian shoppers and drive targeted traffic to their stores. In June 2013, we launched http://www.amazon.in">www.amazon.in for shoppers in India. With http://www.amazon.in">www.amazon.in, we endeavor to give customers more of what they want – low prices, vast selection, fast and reliable delivery, and a trusted and convenient online shopping experience. In just over a year of launching our India operations, we have expanded our offering to over 18 million products across 36 departments and 100s of categories! Our philosophy of working backwards from the customers is what drives our growth and success.

We will continue to strive to become a trusted and meaningful sales and logistics channel for retailers of all sizes across India and a fast, reliable and convenient online shopping destination for consumers. For us, it is always “Day 1” and we are committed to aggressively invest over the long-term and relentlessly focus on raising the bar for customer experience in India. Amazon India offers opportunities where you can dive right in, work with smart people on challenging problems and make an impact that contributes to the lives of millions. Join us so you can - Work Hard, Have Fun and Make History.

 

Basic Qualifications:

 

  • 3+ years’ experience building successful production software systems
  • A solid grounding in Computer Science fundamentals (based on a BS or MS in CS or related field)
  • The ability to take convert raw requirements into good design while exploring technical feasibility tradeoffs
  • Expertise in System design (design patterns, LLD, HLD, Solid principle, OOAD, Distributed systems etc..), Architecture (MVC/Micro services).
  • Good understanding of at least some of the modern programming languages (Java) and open-source technologies (C++, Python, Scala, C#, PHP, Ruby etc..)
  • Excellence in technical communication
  • Has experience in mentoring other software developers

 

Preferred Qualifications:

 

  • BS/MS in Computer Science or equivalent
  • Experience developing service oriented architectures and an understanding of design for scalability, performance and reliability
  • Demonstrated ability to mentor other software developers to maintain architectural vision and software quality
  • Demonstrated ability to achieve stretch goals in a highly innovative and fast paced environment
  • Expertise in delivering high-quality, innovative application
  • Strong desire to build, sense of ownership, urgency, and drive
  • Strong organizational and problem solving skills with great attention to detail
  • Ability to triage issues, react well to changes, work with teams and ability to multi-task on multiple products and projects.
  • Experience building highly scalable, high availability services
  • The ideal candidate will be a visionary leader, builder and operator.
  • He/she should have experience leading or contributing to multiple simultaneous product development efforts and initiatives.
  • He/she needs to balance technical leadership with strong business judgment to make the right decisions about technology choices.
  • He/she needs to be constantly striving for simplicity, and at the same time demonstrate significant creativity, innovation and judgment
  • Proficiency in, at least, one modern programming language.
  • Experience in SQL or Non-SQL database.
  • Strong sense of ownership, urgency, and drive.
  • Demonstrated leadership abilities in an engineering environment in driving operational excellence and best practices.
  • Demonstrated ability to achieve stretch goals in a highly innovative and fast paced environment.
  • Excellent communication, collaboration, reporting, analytical and problem solving skills.

 

 

Good to Have:

  • Knowledge of professional software engineering practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations
  • Experience with enterprise-wide systems
  • Experience influencing software engineers best practices within your team
  • Hands-on expertise in many disparate technologies, typically ranging from front-end user interfaces through to back-end systems and all points in between
  • Strong written and verbal communication skills preferred

 

Key Points to remember:

 

  • Strong knowledge of the Software Development Life Cycle methodology
  • Technical design, development and implementation decisions on the use of technology in area(s) of specialization.
  • Write or modify programming code to suit customer's needs.
  • Unit test to assure meets requirements, including integration test as needed.
  • Ability to understand and analyze issues and uses judgment to make decisions.
  • Strong problem solving & troubleshooting skills
  • Strong communication skills
  • Responsible for self-development according to professional development plan

 

 

 

 

 

 

Read more
Supr Infotech Solutions
at Supr Infotech Solutions
6 recruiters
Cibi Thomas
Posted by Cibi Thomas
Remote, Bengaluru (Bangalore)
3 - 7 yrs
₹18L - ₹40L / yr
Data Structures
skill iconJava
Algorithms
skill iconScala
skill iconC++
+1 more
We are looking for smart coders who are cognisant of business, product and quality. Requirements Have a taste for solving complex and interesting problems. A solid foundation in computer science, with strong competencies in data structures, algorithms and software design. Extensive and expert programming experience in any one programming language. Strong object oriented design skills, ability to apply design patterns, and an uncanny ability to design intuitive module and class-level interfaces. Experience with multi-threading and concurrency programming is must. Worked in a startup like environment with high levels of ownership and commitment. Should have basic operational experience including deployments and maintenance of aws services like ec2, rds, sns, sqs, route53 etc. Strongly practice writing unit and integration tests with reasonable coverage of code. Experience building highly scalable business applications, which involve implementing large complex business flows. Bachelors or higher degree in Computer Science or related technical discipline. Regards, Cibi M Thomas
Read more
Artivatic
at Artivatic
1 video
3 recruiters
Akanksha naini
Posted by Akanksha naini
Bengaluru (Bangalore)
2 - 5 yrs
₹6L - ₹15L / yr
skill iconJava
skill iconPython
Performance tuning
Performance analysis
skill iconScala
+1 more
About Artivatic :- Artivatic is a technology startup that uses AI/ML/Deep learning to build intelligent products & solutions for finance, healthcare & insurance businesses. It is based out of Bangalore with 20+ team focus on technology. The artivatic building is cutting edge solutions to enable 750 Millions plus people to get insurance, financial access, and health benefits with alternative data sources to increase their productivity, efficiency, automation power, and profitability, hence improving their way of doing business more intelligently & seamlessly. - Artivatic offers lending underwriting, credit/insurance underwriting, fraud, prediction, personalization, recommendation, risk profiling, consumer profiling intelligence, KYC Automation & Compliance, automated decisions, monitoring, claims processing, sentiment/psychology behaviour, auto insurance claims, travel insurance, disease prediction for insurance and more. - We have raised US $300K earlier and built products successfully and also done few PoCs successfully with some top enterprises in Insurance, Banking & Health sector. Currently, 4 months away from generating continuous revenue.Skills : - Building server-side logic that powers our APIs, in effect deploying machine learning models in production system that can scale to billions of API calls - Scaling and performance tuning of database to handle billions of API calls and thousands of concurrent requests - Collaborate with data science team to build effective solutions for data collection, pre-processing and integrating machine learning into the workflow - Collaborate, provide technical guidance, and engage in design and code review for other team members. - Excellent Scala, cassandara, architect, api, software, python, Java programming and software design skills, including debugging, performance analysis and test design - Proficiency with at least one Scala, GoLang, Python micro frameworks like Flask, Tornado, Play, Spring etc. with experience in building REST APIs - Experience or understanding in building web crawlers, data fetching bots etc. - Experience with design and optimisation of Neo4j, cassandra, NoSQL databases, PostGreSQL, Redis, Elastic Search - Familiarity with one of the cloud service providers, AWS or Google Compute Engine - Computer Science degree with 4+ years of backend programming experience Experience : 3 Years+ Location : Sony World Signal, Koramangala 4th Block, Bangalore
Read more
A Product company working in emerging technologies.
A Product company working in emerging technologies.
Agency job
via Techhire by Manu M
Hyderabad
11 - 16 yrs
₹25L - ₹35L / yr
skill iconJava
Spring
Hibernate (Java)
GIS analysis
skill iconScala
+2 more
1) Excellent verbal and written communication skills as well as interpersonal skills 2) Sound hands on experience in Core Java, Java Servlets, JavaScript, Web Programming Skills, spring, hibernate, springboot 3) Experience in Coding, Designing and architect 4) Good at Design Specifications 5) Capable of leading a Team 6) Expertise in making high-level design 7) Well equipped with software coding standards 8) Knowledge of designing Frameworks 9) Must be able to work independently and complete projects with minimal supervision. 10) Background or knowledge of GIS or Map concepts is a plus 11) Responsible for Project estimation and scheduling process.
Read more
Toabh
at Toabh
1 recruiter
Riana Saini
Posted by Riana Saini
Mumbai
3 - 7 yrs
₹5L - ₹9L / yr
skill iconRuby on Rails (ROR)
Data Structures
Algorithms
skill iconNodeJS (Node.js)
Database Design
+3 more
We need a strong Ruby on Rails developer who has as strong understanding of Rest API's and also a experience on Node.js is plus point. Database understanding and AWS deployment is a must.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos