Cutshort logo
MNC logo
Data Engineer (Pyspark Developer)
MNC
Data Engineer (Pyspark Developer)
MNC's logo

Data Engineer (Pyspark Developer)

at MNC

Agency job
4 - 12 yrs
₹15L - ₹30L / yr
Remote, Bengaluru (Bangalore)
Skills
PySpark
Pyspark Developer
skill iconScala
DevOps

EXP-Developer-4 to 12 years

 

 

         Must have low-level design and development skills.  Should able to design a solution for given use cases. 

  • Agile delivery-  Person must able to show design and code on a daily basis
  • Must be an experienced PySpark developer and  Scala coding.   Primary skill is PySpark
  • Must have experience in designing job orchestration, sequence, metadata design, Audit trail, dynamic parameter passing and error/exception handling
  • Good experience with unit, integration and UAT support
  • Able to design and code reusable components and functions
  • Should able to review design, code & provide review comments with justification
  • Zeal to learn new tool/technologies and adoption
  • Good to have experience with Devops and CICD
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Wissen Technology
at Wissen Technology
4 recruiters
Vijayalakshmi Selvaraj
Posted by Vijayalakshmi Selvaraj
Mumbai, Bengaluru (Bangalore)
5 - 10 yrs
Best in industry
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
skill iconScala
+1 more

Skills Required:


- 4+ years of technical experience in a developer role

- Strong proficiency with Core Java

- Database experience preferably with DB2, Sybase, or Oracle

- Complete SDLC process and Agile Methodology (Scrum)

- Strong oral and written communication skills

- Excellent interpersonal skills and professional approach

- Bachelor’s degree in Computer Science, MIS, or other technology/engineering discipline


Skill Desired:


-Strong proficiency with Scala on Spark

- Previous experience in front office and back office reports

- Strong understanding Order Life Cycle management from Equities or Listed derivatives perspective

- Previous experience in Trade Surveillance or working with data from the order lifecycle

- Good to have knowledge on Hadoop Technologies

- High quality software architecture and design methodologies and patterns

- Work experience as level-3 support for applications

- Layered Architecture, Component based Architecture

- XML-based technologies

- Unix OS, Scripting, Python or Perl

- Experience in development on other application types (Web applications, batch, or streaming)

Read more
Wissen Technology
at Wissen Technology
4 recruiters
Sukanya Mohan
Posted by Sukanya Mohan
Bengaluru (Bangalore)
4 - 7 yrs
Best in industry
skill iconJava
Spring
DevOps

Job Title: Devops+Java Engineer

Location: Bangalore

Mode of work- Hybrid (3 days work from office)

 

Job Summary: We are looking for a skilled Java+ DevOps Engineer to help enhance and maintain our infrastructure and applications. The ideal candidate will have a strong background in Java development combined with expertise in DevOps practices, ensuring seamless integration and deployment of software solutions. You will collaborate with cross-functional teams to design, develop, and deploy robust and scalable solutions.

 

Key Responsibilities:

  • Develop and maintain Java-based applications and microservices.
  • Implement CI/CD pipelines to automate the deployment process.
  • Design and deploy monitoring, logging, and alerting systems.
  • Manage cloud infrastructure using tools such as AWS, Azure, or GCP.
  • Ensure security best practices are followed throughout all stages of development and deployment.
  • Troubleshoot and resolve issues in development, test, and production environments.
  • Collaborate with software engineers, QA analysts, and product teams to deliver high-quality solutions.
  • Stay current with industry trends and best practices in Java development and DevOps.



Required Skills and Experience:

  • Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent work experience).
  • Proficient in Java programming language and frameworks (Spring, Hibernate, etc.).
  • Strong understanding of DevOps principles and experience with DevOps tools (e.g., Jenkins, Git, Docker, Kubernetes).
  • Knowledge of containerization and orchestration technologies (Docker, Kubernetes).
  • Familiarity with monitoring and logging tools (ELK stack, Prometheus, Grafana).
  • Solid understanding of CI/CD pipelines and automated testing frameworks.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.
Read more
JK Technosoft Ltd
Akanksh Gupta
Posted by Akanksh Gupta
Leeds United Kingdom
7 - 12 yrs
₹45L - ₹50L / yr
ASP.NET
Windows Azure
Microservices
skill icon.NET
skill iconC#
+10 more

Roles and Responsibilities:

JKTech Ltd. is looking for a.Net Development Lead who will be responsible for architecting, creating, and deploying product updates, identifying production issues, and establishing integrations that suit the needs of our customers. The ideal applicant will have a strong background in software engineering and be familiar with.Net Core, ASP.Net Core, C#, WPF, Web API, WCF, SQL Server (T-SQL), and will collaborate with developers and engineers to ensure that software development adheres to established processes and functions as intended. The Development Lead will also assist with delivery planning and will be involved in project management decisions.

 

Role and Responsibilities

  • Design and architect complex, scalable web applications
  • Maintain and enhance existing applications
  • Proven experience in web application development with Microsoft .NET technologies including, .net Core, ASP.NET, Azure and DevOps.
  • Proficient in .Net Core, ASP.Net Core. C#, WPF, Web API, WCF, SQL Server (T-SQL), PowerShell, HTML, JavaScript should have working knowledge on Azure Service Bus and Rabbit MQ
  • Experience in client-side development using JavaScript, HTML, and CSS.
  • Proficient in CI/ CD and release management using Azure pipeline (Infrastructure as Code using ARM templates)
  • Should have experience in the implementation of microservice/ micro database projects.
  • Minimum 3-4 years of experience in SQL Server, Stored procedures.
  • Ability to adapt quickly to an existing, complex environment.
  • Ability to communicate clearly with business users and stakeholders.
  • Write and supervise the technical product documentation
  • Technical design, mentoring and implementation of best practices and processes
  • Develop the software architecture based on the business requirements and constraints
  • Be responsible to deliver proof of concepts which validates technical choices
  • Organize knowledge sharing and continuous learning
  • Testing and examining code written by others and analysing results
  • Identifying technical problems and developing software updates and fixes
  • Working with software developers to ensure that development follows established processes and works as intended

 

Qualifications and Education Requirements

  • Experience as a Dot .net Software Engineer with Azure DevOps role
  • Proficient in .Net Core, ASP.Net Core. C#, WPF, Web API, WCF, SQL Server (T-SQL), PowerShell, HTML, JavaScript should have working knowledge on Azure Service Bus and Rabbit MQ
  • Good working knowledge of Azure cloud services and moving on-prem applications to the Cloud
  •  Working knowledge of databases and SQL
  • Problem-solving attitude
  • Collaborative team spirit

 

Preferred Skills

  • Bachelor of science degree (or equivalent) in computer science, engineering, or relevant field
  • Experience in developing/engineering applications for a large company
  • Azure Certification is a plus.

 

Primary Skills:

  • Proficient in .Net Core, ASP.Net Core. C#, VB .NET, WPF, Web API, WCF, SQL Server (T-SQL), PowerShell, HTML, JavaScript should have working knowledge on Azure


Read more
global business process management company
global business process management company
Agency job
via Jobdost by Saida Jabbar
Bengaluru (Bangalore), Pune
3 - 8 yrs
₹6L - ₹12L / yr
DNN
DotNetNuke
skill icon.NET
skill iconC#
ASP.NET
+7 more

Job Summary

  • Candidate will be responsible for providing full life-cycle development (design, coding, and testing) and maintenance of web-based system on Azure
  • Candidate should have experience in GitHub, knowledge of DevOps is a plus
  • Experienced in designing and implementing web portals, experience with DNN is must
  • Ability to work with multiple languages including C#, ASP.Net, MVC, Javascript and related libraries, HTML, Complex SQL queries, CSS, BootStrap, JSON.
  • Experience in Agile project management methodology
  • Developing and Delivering Excellent Web based solutions/portals/sites based on customer’s requirement within the stipulated timeline
  • The candidate should be flexible to learn new technology and platform and should be creative, innovative for improvement ideas, detail oriented, diligent, and eager to learn and grow

Duties and Responsibilities

  • Understand business requirements to apply logic to integrate functionalities
  • Identify and understand any technical bugs on the server, site, log files or modules and work on resolving the bugs
  • Understand how FTP server is setup for the site
  • Understand system/site technical requirements and suggest enhancements if applicable
  • Designing, coding, unit Testing, and integration with Database
  • Handle site deployment
  • Designing, coding, debugging, technical problem solving, and writing Unit Test cases, etc.

Qualifications

Education / Certification

  • B.E. / B.Tech. /MSC in Computer Science or IT.
  • MCAD/MCSD/MSITP/MCPD

Technical Expertise

  • ASP,ASP.NET,VB.NET,MVC,C#,SQL Server 2012+
  • HTML, Javascript, Jquery, CSS, Bootstrap
  • GitHub/ 
  • Web API/ Web Services, Email Services

Skills and Abilities

  • Be able to work with diverse global teams and in an individual contributor role as needed
  • Excellent English written and verbal communication skills (for local team and global stakeholders/team members)
  • Strong task management skills including time management, and ability to manage multiple projects simultaneously
  • Flexibility required to attend late evening meetings with global team members
  • Attention to detail and delivering quality projects and knowledge assets
Read more
eNation Solutions Pvt. Ltd
Chennai, Bengaluru (Bangalore), Hyderabad
9 - 20 yrs
₹15L - ₹30L / yr
skill iconJava
skill iconAmazon Web Services (AWS)
skill iconDocker
skill iconKubernetes
skill iconJavascript
+1 more

Experience of atleast 9 + years in developing Java Solutions and Architecture


Mandatory Experience of working on AWS, Microservices architecture, Dockers, Kubernetes


Experience in creating architecture for Cloud Applications in AWS


Should have worked on large scale Saas application for atleast 3 years


Knowledge and experience in any of the following

Javascript, AngularJS, Python, Ruby, PHP


Driving DevOps best practices by using Docker, Kubernetes.


Excellent interpersonal, verbal and written communication skills


Location Chennai, Bengaluru, Hyderabad,

Read more
Chennai, Bengaluru (Bangalore), Hyderabad
8 - 12 yrs
₹10L - ₹25L / yr
skill icon.NET
ASP.NET
skill iconC#
Microsoft Windows Azure
SQL
+13 more

Senior .NET Cloud (Azure) Practitioner

Job Description Experience: 5-12 years (approx.)

Education: B-Tech/MCA

 

Mandatory Skills

  • Strong Restful API, Micro-services development experience using ASP.NET CORE Web APIs (C#);
  • Must have exceptionally good software design and programming skills in .Net Core (.NET 3.X, .NET 6) Platform, C#, ASP.net MVC, ASP.net Web API (RESTful), Entity Framework & LINQ
  • Good working knowledge on Azure Functions, Docker, and containers
  • Expertise in Microsoft Azure Platform - Azure Functions, Application Gateway, API Management, Redis Cache, App Services, Azure Kubernetes, CosmosDB, Azure Search, Azure Service Bus, Function Apps, Azure Storage Accounts, Azure KeyVault, Azure Log Analytics, Azure Active Directory, Application Insights, Azure SQL Database, Azure IoT, Azure Event Hubs, Azure Data Factory, Virtual Networks and networking.
  • Strong SQL Server expertise and familiarity with Azure Cosmos DB, Azure (Blob, Table, queue) storage, Azure SQL etc
  • Experienced in Test-Driven Development, unit testing libraries, testing frameworks.
  • Good knowledge of Object Oriented programming, including Design Patterns
  • Cloud Architecture - Technical knowledge and implementation experience using common cloud architecture, enabling components, and deployment platforms.
  • Excellent written and oral communication skills, along with the proven ability to work as a team with other disciplines outside of engineering are a must
  • Solid analytical, problem-solving and troubleshooting skills

Desirable Skills:

 

Roles & Responsibilities

  • Defining best practices & standards for usage of libraries, frameworks and other tools being used;
  • Architecture, design, and implementation of software from development, delivery, and releases.
  • Breakdown complex requirements into independent architectural components, modules, tasks and strategies and collaborate with peer leadership through the full software development lifecycle to deliver top quality, on time and within budget.
  • Demonstrate excellent communications with stakeholders regarding delivery goals, objectives, deliverables, plans and status throughout the software development lifecycle.
  • Should be able to work with various stakeholders (Architects/Product Owners/Leadership) as well as team - Lead/ Principal/ Individual Contributor for Web UI/ Front End Development;
  • Should be able to work in an agile, dynamic team environment;

 

Read more
Leading Logistics-tech Platform
Leading Logistics-tech Platform
Agency job
via Unnati by Rakhi Gayen
Bengaluru (Bangalore)
1 - 3 yrs
₹14L - ₹18L / yr
skill iconJava
Software Development
Logistics
skill iconRuby
Clojure
+4 more
Work with a new-age, reliable logistics platform aiming to disrupt on-time delivery with ultimate efficiency! Read more.
 
Our client is a leading intra-city delivery solutions provider, that focuses on sorting out the largely unorganised logistics space in the country. It is also an aggregator of inter-city mini trucks and large transport vehicles for the Retail, Ecommerce and FMCG sectors. Their app is a platform used by their clients and truck owners, providing GPS enable vehicles, 24X7 support, economical pricing and multi-capacity loaders. Truckers can use their location and choose their transport jobs, while the companies get to pick the drivers as per their ratings.
 
With a fleet of over 44000 trucks and clients like Britannia, Bisleri, Amazon, Flipkart, Metro CashnCarry, Gati, Delhivery and more, the 5-year old platform has raised over $20Mn across multiple funding rounds. Founded and led by IIT-KG alumni, the company has operations in major cities across the country and looking to make inroads in other sectors and verticals.
 
As a Software Development Engineer -1, you will solve complex and interesting problems, converting design into code fluently.
 
What you will do:
  • Working with Databases and Linux platform
  • Understanding algorithms, databases and their space and time complexities
  • Writing unit and integration tests with reasonable coverage of code and interfaces
  • Solving complex and interesting problems
  • Taking up a high level of ownership and commitment towards the business and product vision
 

What you need to have:

  • Minimum 1-year experience
  • Strong problem-solving skills
  • Good understanding of data structures & algorithms and their space & time complexities
  • Strong hands-on and practical working experience with at least one programming language: C/Java/C++/C#
  • Excellent coding skills – should be able to convert the design into code fluently
  • Strong technical aptitude and a good knowledge of CS fundamentals
  • Hands-on experience working with Databases and Linux platform is a plus
  • B-Tech in Computer Science or equivalent from a reputed college
  • Good experience in at least one general programming language (Java, Ruby, Clojure, Scala, C/C++, Python and SQL)
  • A solid foundation in computer science, with strong competencies in data structures, algorithms, and software design.
  • Have a penchant for solving complex and interesting problems, Worked in startup like environment with high levels of ownership and commitment
  • Excellent coding skills – should be able to convert design into code fluently
  • Good skills to write unit & integration tests with reasonable coverage of code & interfaces
  • TDD is a plus
Read more
Amazon India
at Amazon India
1 video
58 recruiters
Srilalitha K
Posted by Srilalitha K
Hyderabad, Bengaluru (Bangalore), Delhi, Gurugram, Pune, Chennai
3 - 9 yrs
₹2L - ₹15L / yr
skill iconC
skill iconC++
skill iconC#
skill iconPython
skill icon.NET
+14 more

Software Development Engineer – SDE 2.            

 

As a Software Development Engineer at Amazon, you have industry-leading technical abilities and demonstrate breadth and depth of knowledge. You build software to deliver business impact, making smart technology choices. You work in a team and drive things forward.

 

 Top Skills

You write high quality, maintainable, and robust code, often in Java or C++ or C#

You recognize and adopt best practices in software engineering: design, testing, version control, documentation, build, deployment, and operations.

You have experience building scalable software systems that are high-performance, highly-available, highly transactional, low latency and massively distributed.

Roles & Responsibilities

You solve problems at their root, stepping back to understand the broader context.

You develop pragmatic solutions and build flexible systems that balance engineering complexity and timely delivery, creating business impact.

You understand a broad range of data structures and algorithms and apply them to deliver high-performing applications.

You recognize and use design patterns to solve business problems.

You understand how operating systems work, perform and scale.

You continually align your work with Amazon’s business objectives and seek to deliver business value.

You collaborate to ensure that decisions are based on the merit of the proposal, not the proposer.

You proactively support knowledge-sharing and build good working relationships within the team and with others in Amazon.

You communicate clearly with your team and with other groups and listen effectively.

 

Skills & Experience

Bachelors or Masters in Computer Science or relevant technical field.

Experience in software development and full product life-cycle.

Excellent programming skills in any object-oriented programming languages - preferably Java, C/C++/C#, Perl, Python, or Ruby.

Strong knowledge of data structures, algorithms, and designing for performance, scalability, and availability.

Proficiency in SQL and data modeling.

Read more
Artivatic
at Artivatic
1 video
3 recruiters
Layak Singh
Posted by Layak Singh
Bengaluru (Bangalore)
4 - 10 yrs
₹8L - ₹20L / yr
skill iconPython
skill iconJava
skill iconMachine Learning (ML)
skill iconData Science
skill iconScala
+3 more
About Artivatic : Artivatic is a technology startup that uses AI/ML/Deep learning to build intelligent products & solutions for finance, healthcare & insurance businesses. It is based out of Bangalore with 25+ team focus on technology. The artivatic building is cutting edge solutions to enable 750 Millions plus people to get insurance, financial access, and health benefits with alternative data sources to increase their productivity, efficiency, automation power, and profitability, hence improving their way of doing business more intelligently & seamlessly.  Skills :  - Building server-side logic that powers our APIs, in effect deploying machine learning models in production system that can scale to billions of API calls  - Scaling and performance tuning of database to handle billions of API calls and thousands of concurrent requests  - Collaborate with data science team to build effective solutions for data collection, pre-processing and integrating machine learning into the workflow  - Collaborate, provide technical guidance, and engage in design and code review for other team members.  - Excellent Scala, cassandara, architect, api, software, python, Java programming and software design skills, including debugging, performance analysis and test design  - Proficiency with at least one Scala, GoLang, Python micro frameworks like Flask, Tornado, Play, Spring etc. with experience in building REST APIs  - Experience or understanding in building web crawlers, data fetching bots etc.  - Experience with design and optimisation of Neo4j, cassandra, NoSQL databases, PostGreSQL, Redis, Elastic Search  - Familiarity with one of the cloud service providers, AWS or Google Compute Engine  - Computer Science degree with 4+ years of backend programming experience  Experience : 5 Years+  Location : Sony World Signal, Koramangala 4th Block, Bangalore Job Perks Insurance, Travel Benefits and others
Read more
edwisor
at edwisor
2 recruiters
Ramandeep Singh Arora
Posted by Ramandeep Singh Arora
NCR (Delhi | Gurgaon | Noida)
5 - 7 yrs
₹16L - ₹21L / yr
skill iconAngular (2+)
skill iconNodeJS (Node.js)
skill iconMongoDB
skill iconReact.js
skill iconAmazon Web Services (AWS)
+1 more
edWisor.com was founded 3 years ago to solve for lack of job skills & low employability problem faced by working professionals, fresh graduates & unemployed engineers worldwide. Our mission is to make 1,000,000 people employable into high growth tech careers by 2021 & we are on track to achieve this goal. Currently, our platform is visited by more than 50k users per month and we have grown from 2 people to a team of 85 people in our Gurgaon offices. With our international expansion to US, UK & Europe we are looking to hire for a leader to scale our technology architecture which is built on full stack web stacks- Node.js, Angular, Reactjs, Cloud, Devops. Given that our new product pipeline requires the application of Machine learning & AI stacks, if you possess a combination of full stack web along with AI skills, you might be the right fit for this role. You should have atleast built & scaled up a team of 10-15 engineers for web & mobile products along with AI and now you must be looking for the next big thing to grow. This role can also offer you learning opportunities into product management if you are keen to learn that skill while scaling up tech. Min. exp 5-7 yrs into product based companies
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos