Cutshort logo
A LEADING US BASED MNC logo
Senior Data Engineering Role - Google Cloud Platform with Spark
A LEADING US BASED MNC
Senior Data Engineering Role - Google Cloud Platform with Spark
A LEADING US BASED MNC's logo

Senior Data Engineering Role - Google Cloud Platform with Spark

at A LEADING US BASED MNC

Agency job
5 - 10 yrs
₹14L - ₹15L / yr
Bengaluru (Bangalore), Hyderabad, Delhi, Gurugram
Skills
Google Cloud Platform (GCP)
Spark
PySpark
Apache Spark
"DATA STREAMING"

Data Engineering : Senior Engineer / Manager


As Senior Engineer/ Manager in Data Engineering, you will translate client requirements into technical design, and implement components for a data engineering solutions. Utilize a deep understanding of data integration and big data design principles in creating custom solutions or implementing package solutions. You will independently drive design discussions to insure the necessary health of the overall solution.


Must Have skills :


1. GCP


2. Spark streaming : Live data streaming experience is desired.


3. Any 1 coding language: Java/Pyhton /Scala



Skills & Experience :


- Overall experience of MINIMUM 5+ years with Minimum 4 years of relevant experience in Big Data technologies


- Hands-on experience with the Hadoop stack - HDFS, sqoop, kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, hive, oozie, airflow and other components required in building end to end data pipeline. Working knowledge on real-time data pipelines is added advantage.


- Strong experience in at least of the programming language Java, Scala, Python. Java preferable


- Hands-on working knowledge of NoSQL and MPP data platforms like Hbase, MongoDb, Cassandra, AWS Redshift, Azure SQLDW, GCP BigQuery etc.


- Well-versed and working knowledge with data platform related services on GCP


- Bachelor's degree and year of work experience of 6 to 12 years or any combination of education, training and/or experience that demonstrates the ability to perform the duties of the position


Your Impact :


- Data Ingestion, Integration and Transformation


- Data Storage and Computation Frameworks, Performance Optimizations


- Analytics & Visualizations


- Infrastructure & Cloud Computing


- Data Management Platforms


- Build functionality for data ingestion from multiple heterogeneous sources in batch & real-time


- Build functionality for data analytics, search and aggregation

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Lorven technologies Inc
Bengaluru (Bangalore), Pune
7 - 10 yrs
₹2L - ₹8L / yr
Migration
Active Directory

Who are we looking for?

We are seeking an experienced Active Directory Migration Specialist to lead and execute the migration of legacy directory services to a modern, scalable, and secure Active Directory environment . The candidate will work with cross-functional teams to design, plan, and implement migration strategies, ensuring minimal disruption to business operations and adherence to security and compliance standards.

Technical Experience:

  • Preferable Experience Minimum 7 to 10 year’s over-all experience with minimum 3 to 5 years in active directory migration and administration role handling Complex multi-technology projects in Enterprise. Hands on active directory migration Implementation Experience.

Key Responsibilities:

  • Assess current Active Directory environments (on-premises and/or cloud-integrated)
  • Develop and document AD migration strategy, roadmap, and technical design
  • Execute forest/domain consolidation, domain controller upgrades, and AD object migrations
  • Coordinate with infrastructure, security, and application teams to identify AD dependencies
  • Configure and manage AD tools like Quest migration Tools, PowerShell, etc.
  • Perform group policy (GPO) rationalization and migration
  • Migrate users, groups, computers, and service accounts with minimal impact
  • Ensure coexistence and trust setup between source and target AD environments
  • Implement and verify replication, DNS, DHCP, and authentication services
  • Perform post-migration validation, testing, and issue remediation
  • Document processes, provide knowledge transfer, and support stabilization
  • Configuration and troubleshooting

Required Skills and Qualifications:

  • Strong experience with Active Directory Domain Services (AD DS)
  • Hands-on experience with AD migration tools (e.g., Quest tools, PowerShell scripting)
  • Proficient in DNS, DHCP, Group Policy, OU structure, Sites and Services
  • Experience with hybrid environments including Azure AD and Microsoft Entra ID
  • Knowledge of identity and access management best practices
  • Ability to analyze, troubleshoot, and resolve complex directory-related issues
  • Familiarity with security/compliance implications of identity migrations
  • Experience working in enterprise environments with 1,000+ users
  • Effective interpersonal, team building and communication skills
  • Good verbal and written communications and presentation skills demonstrate an aptitude for assimilation of new technologies and solutions.
  • Independently handle all consulting related activity and assist sales organization in driving the medium & large consulting opportunities.
  • Preferable knowledge in competition products across networks, security and data center solutions.
  • Should have worked in similar capacity in earlier organizations

Qualification:

  • Desired Candidate Profile Industry IT-Hardware & Networking Qualification B. E / B. Tech in Electronics/Telecommunications computer science or equivalent degree in IT related field.
  • Microsoft Certified: Identity and Access Administrator Associate or similar
  • Familiarity with Entra ID Connect, SSO, MFA, and conditional access policies
  • Prior experience with mergers, acquisitions, or divestiture-based AD migrations
  • Exposure to tools like SCCM, JAMF, or Intune in integrated identity scenarios
  • Certification – Quest Migration tool certification, Windows Server, Microsoft Azure


Read more
Wissen Technology
at Wissen Technology
4 recruiters
Vijayalakshmi Selvaraj
Posted by Vijayalakshmi Selvaraj
Bengaluru (Bangalore), Pune
4 - 12 yrs
Best in industry
PySpark
Data engineering
Big Data
Hadoop
Spark
+1 more

Requirements:

•            Bachelor’s degree in computer science, Engineering, or a related field.

•            Strong understanding of distributed data processing platforms like Databricks and BigQuery.

•            Proficiency in Python, PySpark, and SQL programming languages.

•            Experience with performance optimization for large datasets.

•            Strong debugging and problem-solving skills.

•            Fundamental knowledge of cloud services, preferably Azure or GCP.

•            Excellent communication and teamwork skills.

Nice to Have:

•            Experience in data migration projects.

•            Understanding of technologies like Delta Lake/warehouse.

Read more
InstaWeb Labs Pvt Ltd
at InstaWeb Labs Pvt Ltd
2 recruiters
Kartik Raichura
Posted by Kartik Raichura
Mumbai
3 - 7 yrs
₹1L - ₹3L / yr
skill iconJava
skill iconPython
skill iconJavascript
skill iconAmazon Web Services (AWS)
skill iconGo Programming (Golang)
+1 more
We're looking for a Cofounder / CTO for our startup - Websites.co.in We're looking for someone who is from a premier technology institute (IIT). We can't promise you a high paid salary or offices like Google or other Tech Companies, but we promise you a challenging job that "will" make you into a millionaire in the next 3 years. Simply put, this job entails being self-motivated in a fast-growing company. We are building a great Product and are now looking at taking it to the market. You will Lead technology function for our rapidly growing start-up in the SaaS CIM play located in Mumbai. The position requires experience in working in fast-paced & dynamic setup and building consumer centric & highly scalable mobile first platforms on open source technology stacks. The candidate will need to relocate to Mumbai. You will be a part of the Core team and will be working closely with Co-founders (CEO). In exchange of your dedication we give you an opportunity to prove yourself and your entrepreneurial drive. To achieve great things, we need more awesome people. We're looking for sharp, entrepreneurial people with extremely high learn ability and ambition to grow. It doesn't matter if you have the relevant experience or not, or in case you have failed in your last attempt. As long as you have the desire and fire to create value and leave a mark, and can think of solutions on the go that makes you interesting enough for us to know you better. In case you believe you can overcome the below and have it in you to prove yourself, we would like to meet you and hear your story. - At some point you will feel like the king of the world and Equally you will also feel like an utter failure - You will work harder than you ever have and You will still be behind schedule - Your friends will be sick of hearing about Websites. You will ignore them and keep talking about it - At the end of the day you will be proud of what you have achieved and You will have changed the world While working like an entrepreneur you cannot be bound within the Scope of Roles & Responsibilities however for the sake of formalities, here's what you will be doing in the office: Co-Founder-Technology - Responsible for managing company's technology roadmap as well day to day operations to support business - Responsible for Digital Assets of company including Portal, Blog, Android and IOS Mobile Apps - Driving integration projects for unifying two companies (eCommerce portal and brick and mortar business) technology landscape - Responsible for IT Infrastructure of the company including Datacenter servers and Cloud Servers management and efficient operation. - Responsible for Store Infra including connectivity, software, security etc. - Launching of Mobile Apps - Hands on coder at heart. You like hard problems, but know how to keep things simple. - Would love to do more coding yourself, but accept that you can bring most value by helping others to excel. - Should be able to deal with (and ideally limit) lots of complexity. - Should be a fast thinker, hands on manager and strong communicator; think and act like an entrepreneur - Should know agile. Not just from books. Should know how to do fast release cycles without compromising on quality. - You will be a core member of the founding team and the lead on all the technical aspects of the venture. - Own the full development process from understanding the product / business objectives, - Crafting architecture, product design, development, test, release, maintenance and scalability. - Architectural design for the multi-layered system. - Process identification and deciding the future scope of work - Code Review - Architect solutions for new project requirements - including web, storage, database layers, And APIs to interact with client-apps We are seeking likeminded professionals between 2-5 yrs from premier Institutes with a background in Software Engineering. Prior experience in a start up environment or a relevant industry is a must. PS: This is complete EQUITY based role. People looking for salary do not apply. Apply Now and empower India's 6 crore small businesses get online instantly.
Read more
Surat
Surat
Agency job
via Office day Innovation by OfficedayInnovation Ahmedabad
Surat
3 - 8 yrs
₹4L - ₹6L / yr
skill icon.NET
ASP.NET
skill iconC#
MVC Framework

 Should have good knowledge of OOPS Concept, Web application concepts, Architecture and Cloud/Infra.

 Must have hands-on experience on Asp.net Core MVC.

 SQL Server with Entity Framework

 Web API

 Should be ready to learn new Technical languages and explore.

 Good communication skills will be an added advantage.

 Must be logically sound.

 Should be an active team player.

 Good verbal and written communication will be an added advantage.  Must have worked in a team.

Read more
Simandhar Education
Simandhar Education
Agency job
via Fruges IT services by N bhargavi
Hyderabad
5 - 7 yrs
₹8L - ₹14L / yr
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconNodeJS (Node.js)
skill iconMongoDB
+1 more
Job Role – Front-End Developer
Experience – 5+ years
Job Location- Hyderabad
Mode of Work- Work from office
Eligibility Criteria
 Should have an aggregate of 60% in the academics till date.
 Any Graduate/Post Graduate.
 Frontend Developer (React JS & Next JS)
 Primary Skills: Next JS, Angular JS 8, MERN Stack, HTML 5, CSS3, Bootstrap 5, Java, Relational and NonSQL Database (added advantage) (SQL and Mongodb), JIRA
Required skills, Roles & Responsibilities
 Developing new user-facing features using React.js
 Building reusable components and front-end libraries for future use
 Translating designs and wireframes into high quality code
 Optimizing components for maximum performance across a vast array of
 web-capable devices and browsers
 Strong proficiency in JavaScript, including DOM manipulation and the JavaScript object model
 Good knowledge of HTML5 and CSS3 with Bootstrap5
 Good working Knowledge of Angular JS, Node.js and Next JS
 Thorough understanding of React.js and its core principles and implementations
 Experience with popular React.js workflows (such as Context API, Hooks, Flux and Redux)
 Familiarity with newer specifications of Ecma Script
 Experience with data structure libraries (e.g., Immutable.js)
 Knowledge of isomorphic React is a plus
 Knowledge on Database (Relational and No SQL Database) is highly recommended
 Familiarity with RESTful APIs
 Knowledge of modern authorization mechanisms, such as JSON Web Token
 Familiarity with modern front-end build pipelines and tools
 Experience with common front-end development tools such as Babel, Webpack, NPM, etc.
 Ability to understand business requirements and translate them into technical requirements
 A knack for benchmarking and optimization
 Familiarity with code versioning tools such as Git and SVN.
 Leading the team in the correct direction
 Preparing the necessary technical and non-technical documents
 Assisting the team in internal auditing and external auditing if needed
 Code Reviews and Code deployments (as he will be doing the changes in the live window for now and push the
changes to Prod)
 Assisting the QA team in testing and making them understand the business requirement
Read more
Disruptive Digital Learning Startup
Disruptive Digital Learning Startup
Agency job
via Unnati by Seemi Ejaz
NCR (Delhi | Gurgaon | Noida)
2 - 3 yrs
₹8L - ₹10L / yr
skill iconNodeJS (Node.js)
Web
Analytics
Web API
skill iconAmazon Web Services (AWS)
+4 more
Are you looking to work in an education sector and give your best to the growth of education in India? Then here is your chance.
 
Our client is a social education technology organisation delivering enjoyable & personalised digital learning to schools, NGOs, coaching institutes and learners including the last mile learners. They design, deliver and support tablet and mobile based digital learning solutions with English medium and local languages. Their vision is to facilitate access to enjoyable and life shaping digital learning to every student irrespective of their social, economic, cultural, locational and language status.

Founded by two MDI alumnus, it is a student centric and personalised learning platform that delivers enjoyable learning content as per the state boards. This ed-tech provides a solution which is easy to use, lets students enjoy learning, makes life easy for a teacher and delivers learning in the language that students are most comfortable. The organisation has worked in 14 states across India and awarded Google India under "Impacting Change through Digital".
 
As a Web Developer, you will manage all web and server side development and enhancements as per product growth vision and management plans.
 
What you will do:
  • Taking ownership of the current web based reporting backends of our current solutions/ apps and developing/ stabilizing/ scaling them further as per product plans
  • Ensuring development and ongoing growth of a web based content management engine as the central node of our apps and tablet based learning products.
  • Licensing, Encryption, Reporting & Analytics for all our products have to be integrated into a single user and licensing management backend.

Desired Candidate Profile

 

What you need to have:
  • Deep and Practical experience with Node. JS (primary work component), Firebase, AWS/ Heroku, SQL/ NoSQL Databases with Server side integration.
  • 2-3 years of deep hands-on experience with web based solutions, backend development and web development in the above mentioned tech.
  • Should have worked on a web based backend in Node.JS for preferably an android app based solution which had scaled to a large number of users. 
  • Developed, managed and scaled usage/ analytics and reporting of end user based solutions.
  • Should have developed and managed APIs.
  • Should have practical experience of integrating and managing online payment systems.
  • Built and managed online learning platforms with login, video security, online payment and reports.
Read more
AirFi Aero
at AirFi Aero
2 recruiters
AirFi Careers
Posted by AirFi Careers
Remote only
6 - 12 yrs
₹5L - ₹15L / yr
skill iconNodeJS (Node.js)
skill iconMongoDB
skill iconExpress
skill iconAmazon Web Services (AWS)

Backend Developer - Node.JS - AirFi


AirFi is a market leader in providing portable Onboard Passenger Entertainment and Mobile Crew Sales Solutions to various passenger travel segments. Founded in 2011 in The Hague, Netherlands - AirFi is the world's fastest-growing company in mobile InFlight Entertainment space and in providing ancillary sales solutions to enterprise customers.


AirFi brings disruptive innovations in a cost-effective manner to the airline cabin and other modes of passenger transport mediums and is making thousands of passengers and crew happy every day all over the globe!


Your key responsibilities

  • Responsible for ideating, designing, developing, and supporting the backend services of AirFi web apps for different modes of passenger transport including major airlines across the world.
  • Manage your components independently, including but not limited to: gather requirements; communicate design decisions to cross-functional teams including data science, engineering, analytics, and operations; proactively seek user feedback.
  • You will help AirFi to quickly iterate and scale web app development to different segments of customers with standard processes, automation, monitoring, and rapid quality assurance.
  • Proactively monitor the web apps space for continuous improvements and optimisations, looking for new opportunities and challenges.

What we look for

  • Exposure to product development, self-driven, highly motivated and you must be independent in managing on your own components or features
  • You must be extremely collaborative and enjoy working cross-functionally with other engineers, designers, and stakeholders
  • You must possess an affinity for metrics and analytics - You must be proactive and must move fast or pivot to meet the changing needs of the product
  • You are a problem solver and can use everything from front end to command-line tools to help you identify and fix issues.
  • You should be diligent, thoughtful, have an eye for detail and have great oral and written communication skills
  • Work with product and engineering teams on different data driven products and help drive/implement the Data flows for the same.
  • Designing, integrating and documenting technical components for seamless data extraction and analysis

Must have technical skills

  • MUST: Experience in Javascript or any modern-day JS frameworks - 7+ years
  • Experience NodeJS, MongoDB or any other NoSQL DB - 7+ years
  • Experience on building RESTful services and MVC patterns - 5+ years

You get bonus point for

  • Responsive web-frameworks (e.g. Foundation, Bootstrap)
  • Experience in AngularJS, React, etc - 2+ years
  • Linux skills (we run on embedded Linux)
  • Expertise HTML5, CSS,
  • Experience on Cloudant, AWS, GCP etc.
  • Experience on eCommerce or payments related domains

What you can expect

We promise to provide opportunities that not only satisfy your creative instincts but also let you make a significant impact on the products that we create and ultimately the business we are in. We provide a great platform to take up multiple roles based on individual interests or skills and collaborate with different global teams. We boast of a professional, fun work environment with a flat hierarchy and super supportive people to work with. We also encourage a work culture where - no idea is a bad idea and the team can shout it out to be heard!



What more do we offer?

Some of our benefits that our employees cherish:

  • Flexible work timings, remote working and work from home options
  • Liberal employee policies including genuine open-door policy and special focus on keeping the work culture non toxic
  • A very liberal leave policy that includes paternity, adoption and sabbatical leaves
  • We provide Skill enhancement sponsorships
  • Celebratory team events, regular team virtual GupShups and fun engagement activities including the annual team (destination) meetings and the annual family gala dinner!
  • Meal coupons and random gift vouchers
  • Career longevity perks and so on!

When we're in office some of the things that make AirFi an interesting place to work are - healthy breakfast, snacks and a fully loaded pantry (read: health alert!); we try to keep AirFi as a fun place to work at and have interesting team activities on Fridays with occasional beers. 

You get the opportunity to work and socialise with our global team when they visit or when you visit our customer offices/hangers. Last but not the least, in case you are an aviation geek - the opportunity to be on test flights and learn how the aviation industry works!

 

Follow and engage with Us!

 

Read more
Banyan Data Services
at Banyan Data Services
1 recruiter
Sathish Kumar
Posted by Sathish Kumar
Bengaluru (Bangalore)
3 - 15 yrs
₹6L - ₹20L / yr
skill iconData Science
Data Scientist
skill iconMongoDB
skill iconJava
Big Data
+14 more

Senior Big Data Engineer 

Note:   Notice Period : 45 days 

Banyan Data Services (BDS) is a US-based data-focused Company that specializes in comprehensive data solutions and services, headquartered in San Jose, California, USA. 

 

We are looking for a Senior Hadoop Bigdata Engineer who has expertise in solving complex data problems across a big data platform. You will be a part of our development team based out of Bangalore. This team focuses on the most innovative and emerging data infrastructure software and services to support highly scalable and available infrastructure. 

 

It's a once-in-a-lifetime opportunity to join our rocket ship startup run by a world-class executive team. We are looking for candidates that aspire to be a part of the cutting-edge solutions and services we offer that address next-gen data evolution challenges. 

 

 

Key Qualifications

 

·   5+ years of experience working with Java and Spring technologies

· At least 3 years of programming experience working with Spark on big data; including experience with data profiling and building transformations

· Knowledge of microservices architecture is plus 

· Experience with any NoSQL databases such as HBase, MongoDB, or Cassandra

· Experience with Kafka or any streaming tools

· Knowledge of Scala would be preferable

· Experience with agile application development 

· Exposure of any Cloud Technologies including containers and Kubernetes 

· Demonstrated experience of performing DevOps for platforms 

· Strong Skillsets in Data Structures & Algorithm in using efficient way of code complexity

· Exposure to Graph databases

· Passion for learning new technologies and the ability to do so quickly 

· A Bachelor's degree in a computer-related field or equivalent professional experience is required

 

Key Responsibilities

 

· Scope and deliver solutions with the ability to design solutions independently based on high-level architecture

· Design and develop the big data-focused micro-Services

· Involve in big data infrastructure, distributed systems, data modeling, and query processing

· Build software with cutting-edge technologies on cloud

· Willing to learn new technologies and research-orientated projects 

· Proven interpersonal skills while contributing to team effort by accomplishing related results as needed 

Read more
Kuants
at Kuants
2 recruiters
Ayush Gangwar
Posted by Ayush Gangwar
Gurugram
1 - 3 yrs
₹7L - ₹12L / yr
skill iconPython
skill iconDjango
skill iconFlask
RESTful APIs

About the company, Kuants is a fintech startup offering products in the Wealth tech space. We are the market leaders in Algo trading software and 

We are looking for a Back-End Web Developer responsible for managing the interchange of data between the server and the users. Your primary focus will be the development of all server-side logic, definition, and maintenance of the central database, and ensuring high performance and responsiveness to requests from the front-end. You will also be responsible for integrating the front-end elements built by your coworkers into the application. A basic understanding of front-end technologies is therefore necessary as well.

Responsibilities

  • Integration of user-facing elements developed by front-end developers with server-side logic
  • Building reusable code and libraries for future use
  • Optimization of the application for maximum speed and scalability
  • Implementation of security and data protection
  • Design and implementation of data storage solutions

Skills And Qualifications

  • Basic understanding of front-end technologies and platforms, such as JavaScript, HTML5, and CSS3
  • Good understanding of server-side CSS preprocessors, such as LESS and SASS
  • User authentication and authorization between multiple systems, servers, and environments
  • Integration of multiple data sources and databases into one system
  • Management of hosting environment, including database administration and scaling an application to support load changes
  • Data migration, transformation, and scripting
  • Setup and administration of backups
  • Outputting data in different formats
  • Understanding differences between multiple delivery platforms such as mobile vs desktop, and optimizing output to match the specific platform
  • Creating database schemas that represent and support business processes
  • Implementing automated testing platforms and unit tests
  • Proficient knowledge of a Django, REDIS, MySQL
  • Proficient understanding of code versioning tools, such as Git
  • Proficient understanding of OWASP security principles
  • Understanding of “session management” in a distributed server environment
Read more
Huawei Telecommunications
Mridul Taneja
Posted by Mridul Taneja
NCR (Delhi | Gurgaon | Noida)
3 - 7 yrs
₹3L - ₹7L / yr
Compensation & Benefits
Payroll Management
Recruitment/Talent Acquisition
Training & Development
Huawei urgently requires 2 Male HR Candidate for its Gurgaon HQ with experience strictly into Payroll Management and Training & Development. Anybody with some prior experience in Telecom & who could join immediately will be entertained at the first.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos