Cutshort logo
MNC logo
Data Engineer (Pyspark Developer)
MNC
Data Engineer (Pyspark Developer)
MNC's logo

Data Engineer (Pyspark Developer)

at MNC

Agency job
4 - 12 yrs
₹15L - ₹30L / yr
Remote, Bengaluru (Bangalore)
Skills
PySpark
Pyspark Developer
skill iconScala
DevOps

EXP-Developer-4 to 12 years

 

 

         Must have low-level design and development skills.  Should able to design a solution for given use cases. 

  • Agile delivery-  Person must able to show design and code on a daily basis
  • Must be an experienced PySpark developer and  Scala coding.   Primary skill is PySpark
  • Must have experience in designing job orchestration, sequence, metadata design, Audit trail, dynamic parameter passing and error/exception handling
  • Good experience with unit, integration and UAT support
  • Able to design and code reusable components and functions
  • Should able to review design, code & provide review comments with justification
  • Zeal to learn new tool/technologies and adoption
  • Good to have experience with Devops and CICD
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Brudite Private Limited
Jaipur
0 - 2 yrs
₹4.5L - ₹6L / yr
skill iconPython
skill iconAmazon Web Services (AWS)
Artificial Intelligence (AI)
skill iconMachine Learning (ML)
skill iconDocker
+2 more

Brudite is an IT Training and Services company shaping the future of technology with Fortune 500 clients. We specialize in empowering young engineers to achieve their dreams through cutting-edge training, innovative products, and comprehensive services.

Proudly registered with iStart Rajasthan and Startup India, we are supported by industry leaders like NVIDIA and AWS.


Roles and Responsibilities - 


  • A can-do attitude to new challenges.
  • Strong understanding of computer science fundamentals, including operating systems, Databases, and Networking.
  • Knowledge of Python or any other programming language.
  • Basic knowledge of Cloud Computing(AWS/Azure/GCP) will be a Plus.
  • Basic Knowledge of Any Front-end Framework will be a Plus.
  • We operate in a fast-paced, startup-like environment, so the ability to work in a dynamic, agile environment is essential.
  • Strong written and verbal communication skills are essential for this role. You'll need to communicate with clients, team members, and stakeholders.
  • Ability to learn and adapt to new technology trends and a curiosity to learn are essential


Read more
Hiringdog Interview Platform
Noida
2 - 4 yrs
₹12L - ₹18L / yr
DevOps
CI/CD
skill iconJenkins
skill iconAmazon Web Services (AWS)
skill iconGit
+1 more

Summary


We are seeking a highly skilled and motivated Software Engineer with expertise in both backend development and DevOps practices. The ideal candidate will have a proven track record of designing, developing, and deploying robust and scalable backend systems, while also possessing strong knowledge of cloud infrastructure and DevOps principles. This role requires a collaborative individual who thrives in a fast-paced environment and is passionate about building high-quality software.


Responsibilities


Design, develop, and maintain backend services using appropriate technologies.

Implement and maintain CI/CD pipelines.

Manage and monitor cloud infrastructure (e.g., AWS, Azure, GCP).

Troubleshoot and resolve production issues.

Collaborate with frontend developers to integrate backend services.

Contribute to the design and implementation of database schemas.

Participate in code reviews and ensure code quality.

Contribute to the improvement of DevOps processes and tools.

Write clear and concise documentation.

Stay up-to-date with the latest technologies and best practices.


Qualifications


Bachelor's degree in Computer Science or a related field.

3+ years of experience in backend software development.

2+ years of experience in DevOps.

Proficiency in at least one backend programming language (e.g., Java, Python, Node.js, Go).

Experience with cloud platforms (e.g., AWS, Azure, GCP).

Experience with containerization technologies (e.g., Docker, Kubernetes).

Experience with CI/CD tools (e.g., Jenkins, GitLab CI, CircleCI).

Experience with monitoring and logging tools (e.g., Prometheus, Grafana, ELK stack).

Strong understanding of database technologies (e.g., SQL, NoSQL).

Excellent problem-solving and debugging skills.

Strong communication and collaboration skills.



Bonus Points


Experience with specific technologies used by our company (list technologies if applicable).

Experience with serverless architectures.

Experience with infrastructure as code (e.g., Terraform, CloudFormation).

Contributions to open-source projects.

Relevant certifications.

Read more
Research and Development Engineering Services Firm
Research and Development Engineering Services Firm
Agency job
via Jobdost by Sathish Kumar
Hyderabad
6 - 10 yrs
₹15L - ₹24L / yr
skill iconPython
skill iconDjango
skill iconFlask
skill iconAmazon Web Services (AWS)
Google Cloud Platform (GCP)
+4 more
We are a tech venture which provides Product Engineering, QA Automation, Infrastructure, Data, and Market Research services.

Technical Proficiency : 
Must have

  • Strong development experience in Python in the environment of Unix/Linux/Ubuntu
  • Strong practical knowledge of Python and its libraries.
  • Current working experience with cloud deployment of AWS/Azure/GCP, Microservice architecture, and Docker in Python.
  • Good knowledge of CI/CD and DevOps practices
  • Good Experience of Python with Django/ Scrapy/ Flask frameworks.
  • Good Experience in Jupyter/ Docker/ Elastic Search, etc.
  • Solid understanding of software development principles and best practices.
  • Strong analytical thinking and problem-solving skills.
  • Proven ability to drive large-scale projects with a deep understanding of Agile SDLC, high collaboration, and leadership.

Good to have : 
  • Expected to have migration experience from one version to the other, as this project is about migration to the latest version.
  • Preferred if had an OpenEdx platform experience or any LMS platform. 
Read more
Xebia IT Architects
at Xebia IT Architects
2 recruiters
Vijay S
Posted by Vijay S
Bengaluru (Bangalore), Pune, Hyderabad, Chennai, Jaipur, Bhopal, Gurugram
5 - 11 yrs
₹30L - ₹40L / yr
skill iconScala
Microservices
CI/CD
DevOps
skill iconAmazon Web Services (AWS)
+2 more

Dear,


We are excited to inform you about an exclusive opportunity at Xebia for a Senior Backend Engineer role.


📌 Job Details:

  • Role: Senior Backend Engineer
  •  Shift: 1 PM – 10 PM
  • Work Mode: Hybrid (3 days a week) across Xebia locations
  • Notice Period: Immediate joiners or up to 30 days


🔹 Job Responsibilities:


✅ Design and develop scalable, reliable, and maintainable backend solutions

✅ Work on event-driven microservices architecture

✅ Implement REST APIs and optimize backend performance

✅ Collaborate with cross-functional teams to drive innovation

✅ Mentor junior and mid-level engineers


🔹 Required Skills:


✔ Backend Development: Scala (preferred), Java, Kotlin

✔ Cloud: AWS or GCP

✔ Databases: MySQL, NoSQL (Cassandra)

✔ DevOps & CI/CD: Jenkins, Terraform, Infrastructure as Code

✔ Messaging & Caching: Kafka, RabbitMQ, Elasticsearch

✔ Agile Methodologies: Scrum, Kanban


⚠ Please apply only if you have not applied recently or are not currently in the interview process for any open roles at Xebia.


Looking forward to your response! Also, feel free to refer anyone in your network who might be a good fit.


Best regards,

Vijay S

Assistant Manager - TAG

https://www.linkedin.com/in/vijay-selvarajan/

Read more
Chennai, Bengaluru (Bangalore), Hyderabad
8 - 12 yrs
₹10L - ₹25L / yr
skill icon.NET
ASP.NET
skill iconC#
Microsoft Windows Azure
SQL
+13 more

Senior .NET Cloud (Azure) Practitioner

Job Description Experience: 5-12 years (approx.)

Education: B-Tech/MCA

 

Mandatory Skills

  • Strong Restful API, Micro-services development experience using ASP.NET CORE Web APIs (C#);
  • Must have exceptionally good software design and programming skills in .Net Core (.NET 3.X, .NET 6) Platform, C#, ASP.net MVC, ASP.net Web API (RESTful), Entity Framework & LINQ
  • Good working knowledge on Azure Functions, Docker, and containers
  • Expertise in Microsoft Azure Platform - Azure Functions, Application Gateway, API Management, Redis Cache, App Services, Azure Kubernetes, CosmosDB, Azure Search, Azure Service Bus, Function Apps, Azure Storage Accounts, Azure KeyVault, Azure Log Analytics, Azure Active Directory, Application Insights, Azure SQL Database, Azure IoT, Azure Event Hubs, Azure Data Factory, Virtual Networks and networking.
  • Strong SQL Server expertise and familiarity with Azure Cosmos DB, Azure (Blob, Table, queue) storage, Azure SQL etc
  • Experienced in Test-Driven Development, unit testing libraries, testing frameworks.
  • Good knowledge of Object Oriented programming, including Design Patterns
  • Cloud Architecture - Technical knowledge and implementation experience using common cloud architecture, enabling components, and deployment platforms.
  • Excellent written and oral communication skills, along with the proven ability to work as a team with other disciplines outside of engineering are a must
  • Solid analytical, problem-solving and troubleshooting skills

Desirable Skills:

 

Roles & Responsibilities

  • Defining best practices & standards for usage of libraries, frameworks and other tools being used;
  • Architecture, design, and implementation of software from development, delivery, and releases.
  • Breakdown complex requirements into independent architectural components, modules, tasks and strategies and collaborate with peer leadership through the full software development lifecycle to deliver top quality, on time and within budget.
  • Demonstrate excellent communications with stakeholders regarding delivery goals, objectives, deliverables, plans and status throughout the software development lifecycle.
  • Should be able to work with various stakeholders (Architects/Product Owners/Leadership) as well as team - Lead/ Principal/ Individual Contributor for Web UI/ Front End Development;
  • Should be able to work in an agile, dynamic team environment;

 

Read more
Education Loans Fintech |Delhi
Education Loans Fintech |Delhi
Agency job
via Unnati by Rakhi Gayen
NCR (Delhi | Gurgaon | Noida)
1 - 8 yrs
₹8L - ₹19L / yr
skill iconRuby
skill iconRuby on Rails (ROR)
Regression Testing
skill iconJavascript
skill iconAmazon Web Services (AWS)
+1 more
Do you wish to be a part of a disruptive team, passionate towards democratizing education for students across India? Then read more.

 


Our client is an expert in education financing and counselling related to higher studies abroad. They help students to understand about scholarships in various colleges abroad, whether they are eligible and how to apply for such esteemed institutions. Their dedicated page enlists every scholarship available across the globe, apart from other facilities required by students like visa counselling, forex, accommodation, Peer contacts etc.

 


They also offer the best resources for exams like IELTS, TOEFL and GRE apart from organising webinars and events to connect with industry experts, alumni and fellow students - which helps to prepare for travels, loans and more. Partnered with the most prominent Banking and non-banking financiers, the team is led by FinTech-experienced IIT Kanpur alumni, passionate about offering sustainable financial offerings.
 
As a Software/ Sr. Software Developer (Ruby On Rails), you will be a part of the product development team.
 
What you will do:
  • Improving customer experience, not only for borrowers but also other partners on the platform
  • Ensuring seamless integration with data/ service providers and lending partners
  • When not doing any of the above, writing tests to prevent any regressions

 

 

What you need to have:

  • Must have skills:
  1. Good Experience in Ruby On Rails
  2. Experience in Modular Javascript programming
  3. Self-starter: Someone who can develop independently
  4. Passionate about problem-solving, ability to see the big picture
  5. Realizes the value of 80-20
  • Good to have skills:
  1. DevOps experience (Managing web application on AWS)
  2. Prior experience in the Fintech or Banking industry as a tech role.
  3. Test case writing

Software Developer: 1 to 4 yrs
Sr. Software Developer: 4 to 8 yrs
Read more
Strata
at Strata
1 recruiter
Lavanya G
Posted by Lavanya G
Bengaluru (Bangalore)
4 - 8 yrs
₹20L - ₹22L / yr
skill iconPython
skill iconDjango
Web applications
skill iconAmazon Web Services (AWS)
skill iconJavascript
+2 more

About us:

Strata is a commercial real estate investment platform that offers investors the opportunity to invest in pre-leased commercial assets such as offices, warehouses, and retail spaces across India.


We are one of the fastest-growing PropTech platforms in India and are backed by Elevation Capital, Mayfield, Kotak Investment Advisors, Gruhas (a venture by Nikhil Kamath of Zerodha) and DLF Family Office.

Our headquarter is in Bangalore, India.

We are a small yet close-knit team of 35+ people.


About you:

You have a knack for product and strongly equipped with engineering skills to make it a reality. You don’t jump into implementation unless you have clearly understood the problem/requirements and have a written design. You don’t hesitate asking questions and giving critical reviews while respecting others’ opinions. You are a fearless engineer, and not afraid to fail, not on production though ;) You have a strong sense of ownership. You have a startup experience. You don’t feel annoyed if required to work on off days in case of production incidents (no development).


Your responsibilities:

You will primarily work on the backend maintaining the existing platform and writing new enhancements and features. Apart from your own features, as a senior member of the team you will be expected to be actively involved in overall design discussions and peer code reviews. You will factor in extensibility, maintainability, scalability and security in designs and code. You will ensure that best engineering practices are followed. You will support your team members when they are facing challenges, and mentor them when appropriate. You will strive for overall engineering excellence.


Must-have Skills:

  • 4-8 years of total experience
  • 2+ years of experience in Django and DRF. You must be pro at it. The team will be looking up to you for making most out of DRF.
  • Designing and building  scalable web applications
  • Good understanding of REST principles
  • SQL database design and queries
  • Working knowledge of AWS

Good-To-Have Skills:

  • Angular or any other JavaScript frontend framework
  • Designing microservices
  • DevOps experience


FAQ's.

1. Your technology ingredients?

Programming languages:
Our backend is written in Python using Django framework. And the frontend is in AngularJS. Currently there is no mobile app.

Infrastructure:
We are an AWS shop and use their services for most needs, Docker for containerization and ECS as orchestrator, RDS as database, S3 for storage and SQS as messaging backend.

Other tools:
BitBucket for Git and CI/CD pipeline, Trello for project management; and Google Meets and Slack for communication.

2. Your hiring plan?

Currently the engineering team comprises of 3 engineers, and we plan to grow it to 8 by the end of 2021.

3. Your Interview process?

We will try to finish the process within two weeks. In case we can’t go ahead with  your candidature, we will clearly and immediately let you know. But in case of competing applications, we may request you to wait for a week or two.

  1. 15 minutes introductory call to discuss requirements and expectations
  2. 30 minutes online coding assignment on a screen sharing session
  3. 1 hour technical interview covering problem solving, code review and aptitude
  4. 15 minutes call with co-founder for final discussion

In case of inability to come to a conclusion from either side, we may go for an additional round.

4. Your WFH and WFO policy?

Due to Covid-19 the team is working from home and will continue till March-2022. After that we will work from the Bangalore or Pune office (yet to be finalised). You should be open to relocate to any of the cities.

5. Your funding status?

In March 2020, Strata raised $1.5 million in seed funding; and $6 million in Series-A in July 2021.

Read more
neovisara
at neovisara
1 recruiter
pratap p
Posted by pratap p
Hyderabad
1 - 7 yrs
₹2L - ₹7L / yr
ASP.NET MVC
ASP.NET
Data Structures
Algorithms
skill iconScala
+5 more
·       Knowledge in MS-SQL - writing Queries,Store Proc, Triggers
·       Good understanding of IIS configuration
·       Familiarity with version control tools TFS/Git/Subversion etc.
·       Ability to independently deliver complex development projects
·       Must enjoy hands-on programming work

Benifits

Support for Continuous learning
Competetive Salary
Quarterly webinars and Annual conferences
Read more
ByteAlly
at ByteAlly
1 recruiter
Anand Sukumaran
Posted by Anand Sukumaran
Chennai
1 - 4 yrs
₹4L - ₹8L / yr
skill iconHaskell
skill iconScala
OCaml
We are looking for Haskell developers to join our team. We are a leader in Haskell consulting and one of the very few companies based out of Asia to provide development services in Haskell. We have made several contributions to the Haskell world by open-sourcing our efforts as libraries and frameworks.

We are looking for someone who:
- has 1+ years of professional software engineering experience.
- is familiar with the paradigms of functional programming
- is familiar with at least one FP language (Haskell, Scala, OCaml, etc.)
- has the ability to participate in entire product development life-cycle
- is self motivated to learn new technologies
- can play leadership role in terms of coming up with solutions
Read more
Bengaluru (Bangalore)
3 - 7 yrs
₹8L - ₹9L / yr
skill iconJava
skill iconScala
Distributed Systems
NOSQL Databases
Multithreading
+26 more
Systems EngineerAbout Intellicar Telematics Pvt LtdIntellicar Telematics Private Limited is a vehicular telematics organization founded in 2015 with the vision of connecting businesses and customers to their vehicles in a meaningful way. We provide vehicle owners with the ability to connect and diagnose vehicles remotely in real-time. Our team consists of individuals with an in-depth knowledge and understanding in automotive engineering, driver analytics and information technology. By leveraging our expertise in the automotive domain, we have created solutions to reduce operational and maintenance costs of large fleets, and ensure safety at all times.Solutions :- Enterprise Fleet Management, GPS Tracking- Remote engine diagnostics, Driver behavior & training- Technology Integration : GIS, GPS, GPRS, OBD, WEB, Accelerometer, RFID, On-board Storage.Intellicar's team of accomplished automotive Engineers, hardware manufacturers, Software Developers and Data Scientists have developed the best solutions to track vehicles and drivers, and ensure optimum performance, utilization and safety at all times.We cater to the needs of our clients across various industries such as: Self drive cars, Taxi cab rentals, Taxi cab aggregators, Logistics, Driver training, Bike Rentals, Construction, ecommerce, armored trucks, Manufacturing, dealership and more. Desired skills as a developer :- Education: BE/B.Tech in Computer Science or related field.- 4+ years of experience with scalable distributed systems applications and building scalable multi-threaded server applications.- Strong programming skills in Java or Scala on Linux or a Unix based OS.- Understanding of distributed systems like Hadoop, Spark, Cassandra, Kafka.- Good understanding of HTTP, SQL, Database internals.- Good understanding of Internet and how it works- Create new features from scratch, enhance existing features and optimize existing functionality, from conception and design through testing and deployment.- Work on projects that make our network more stable, faster, and secure.- Work with our development QA and system QA teams to come up with regression tests that cover new changes to our software
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos