Cutshort logo
Kloud9 Technologies logo
Senior Data Engineer - GCP
Senior Data Engineer - GCP
Kloud9 Technologies's logo

Senior Data Engineer - GCP

Akhila Chandan's profile picture
Posted by Akhila Chandan
8 - 14 yrs
₹35L - ₹45L / yr
Remote only
Skills
Google Cloud Platform (GCP)
Agile/Scrum
SQL
skill iconPython
Apache Kafka
databricks

Senior Data Engineer


Responsibilities:

●      Clean, prepare and optimize data at scale for ingestion and consumption by machine learning models

●      Drive the implementation of new data management projects and re-structure of the current data architecture

●      Implement complex automated workflows and routines using workflow scheduling tools 

●      Build continuous integration, test-driven development and production deployment frameworks

●      Drive collaborative reviews of design, code, test plans and dataset implementation performed by other data engineers in support of maintaining data engineering standards 

●      Anticipate, identify and solve issues concerning data management to improve data quality

●      Design and build reusable components, frameworks and libraries at scale to support machine learning products 

●      Design and implement product features in collaboration with business and Technology stakeholders 

●      Analyze and profile data for the purpose of designing scalable solutions 

●      Troubleshoot complex data issues and perform root cause analysis to proactively resolve product and operational issues

●      Mentor and develop other data engineers in adopting best practices 

●      Able to influence and communicate effectively, both verbally and written, with team members and business stakeholders






Qualifications:

●      8+ years of experience developing scalable Big Data applications or solutions on distributed platforms

●      Experience in Google Cloud Platform (GCP) and good to have other cloud platform tools

●      Experience working with Data warehousing tools, including DynamoDB, SQL, and Snowflake

●      Experience architecting data products in Streaming, Serverless and Microservices Architecture and platform.

●      Experience with Spark (Scala/Python/Java) and Kafka

●      Work experience with using Databricks (Data Engineering and Delta Lake components

●      Experience working with Big Data platforms, including Dataproc, Data Bricks etc

●      Experience working with distributed technology tools including Spark, Presto, Databricks, Airflow

●      Working knowledge of Data warehousing, Data modeling


●      Experience working in Agile and Scrum development process

●      Bachelor's degree in Computer Science, Information Systems, Business, or other relevant subject area


Role:

Senior Data Engineer

Total No. of Years:

8+ years of relevant experience 

To be onboarded by:

Immediate

Notice Period:

 

Skills

Mandatory / Desirable

Min years (Project Exp)

Max years (Project Exp)

GCP Exposure 

Mandatory Min 3 to 7

BigQuery, Dataflow, Dataproc, AI Building Blocks, Looker, Cloud Data Fusion, Dataprep .Spark and PySpark

Mandatory Min 5 to 9

Relational SQL

Mandatory Min 4 to 8

Shell scripting language 

Mandatory Min 4 to 8

Python /scala language 

Mandatory Min 4 to 8

Airflow/Kubeflow workflow scheduling tool 

Mandatory Min 3 to 7

Kubernetes

Desirable 1 to 6

Scala

Mandatory Min 2 to 6

Databricks

Desirable Min 1 to 6

Google Cloud Functions

Mandatory Min 2 to 6

GitHub source control tool 

Mandatory Min 4 to 8

Machine Learning

Desirable 1 to 6

Deep Learning

Desirable Min 1to 6

Data structures and algorithms

Mandatory Min 4 to 8

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos

About Kloud9 Technologies

Founded :
2014
Type :
Products & Services
Size :
100-1000
Stage :
Profitable
About

Kloud9 was founded with the vision of enabling our customers to transform into an intelligent enterprise with our “AI-First” approach. We help our customers in their data transformation and insights transformation journeys and enable them to make smart business decisions.

At Kloud9, we know AI & ML is one of the key technologies that can help organizations to significantly improve their customer experiences and transform their business operations to enable them to survive & thrive in this global competitive market.

Read more
Photos
Company featured pictures
Company featured pictures
Company social profiles
bloginstagramlinkedintwitterfacebook

Similar jobs

IndieFolio Network Pvt Ltd
at IndieFolio Network Pvt Ltd
5 candid answers
1 video
Talent and Culture Team
Posted by Talent and Culture Team
Remote only
1 - 2 yrs
₹3.6L - ₹6L / yr
Account Management
Effective communication
Client Servicing
Negotiation


About us:


IndieFolio is disrupting the traditional creative agency model by allowing leading brands to assemble custom creative teams, delivering world-class quality. We connect top brands with India's finest creative talent in design, video, and content, leveraging advanced technology and industry expertise to streamline the process. Our curated network of professionals, combined with a data-driven approach, ensures exceptional results and unmatched efficiency. With a proven track record and a commitment to innovation, IndieFolio is transforming how businesses access and collaborate with top-tier creative talent. We are scaling our team and operations, seeking independent, responsible, and accountable individuals to join our dynamic team.


About the role:


The Account Executive plays a crucial role in supporting the Key Account Manager in managing client relationships and driving revenue growth. This position involves assisting with large projects, independently running micro-projects and managing SME accounts, and making critical decisions regarding pricing and talent selection for all projects.


Responsibilities:

  • Project Management: Assist the KAM in managing large-scale client projects, including project planning, resource allocation, timeline management, and client communication.
  • Micro-Project & SME Account Management: Independently manage micro-projects and small-to-medium enterprise (SME) accounts, acting as the primary point of contact for clients, understanding their needs, and ensuring project success.
  • Pricing & Talent Approval: Evaluate project requirements, negotiate pricing with talent, and select the appropriate talent from our network of creative professionals to ensure the highest quality deliverables.
  • Sales Support: Assist the KAM in identifying and pursuing new business opportunities, preparing proposals, and closing deals.
  • Reporting & Analysis: Track project progress, monitor key performance metrics, and provide regular reports to the KAM and leadership team.


Why Join Us?

  • Work with the best: Collaborate with some of the best global brands and top leadership in the industry.
  • Hypergrowth Opportunity: Be part of a company experiencing explosive 500%+ annual growth with the potential to scale by 100x in just 3 years!
  • Continuous Development: Refine your skills and leadership through continuous training and the support of a collaborative team.
  • Own Your Impact: Enjoy a high-trust environment where your contributions are valued, your voice is heard, and your ownership mindset is celebrated.
  • Flexibility & Autonomy: Embrace a remote-first culture that empowers you to design your ideal workday, focusing on results and maximizing your productivity.
  • Vibrant & Collaborative Community: Connect with a passionate team of creative thinkers and innovators who share your dedication to excellence and making a difference.
  • Competitive Compensation & Perks: Benefit from a competitive salary, comprehensive benefits package, and opportunities for professional development to fuel your growth.
Read more
Coconut Media Box LLP
at Coconut Media Box LLP
3 recruiters
HR Manager
Posted by HR Manager
Mumbai
5 - 10 yrs
₹5L - ₹10L / yr
Business Development
Sales
Sales and operations planning
Business Development Manager
  • Generating leads into exhibitions & events industry, targeting high potential clients participating in the exhibitions (Domestic as well as International).
  • Developing business by cold calling, client pitching through research or references.
  • Deliver scripted sales pitch to the clients.
  • Keep accurate and detailed records of calls made and results achieved.
  • Mailing Introductory Profile to prospective clients.
  • Scheduling appointments and to get maximum meetings done with the clients.
  • To get sound brief from the client and ensure maximum clients are converted.
  • Client follow ups & feedback till the completion of the project.
  • To ensure timely payment is made by the client after the completion of the project.
  • To be a single point of contact between the client and the production team.
Read more
B2B Foodtech Startup
B2B Foodtech Startup
Agency job
via Unnati by Astha Bharadwaj
Bengaluru (Bangalore)
7 - 9 yrs
₹10L - ₹15L / yr
Project Management
FMCG
Join a leading FMCG research company, and give your career a great step forward. Read on to know more.
 
Our client is an R&D solutions company, specializing in food and nutrition helping brands create commercially viable food products. The entire gamut of solutions they offer includes everything from designing and developing an innovative product line, understanding its concept and ingredients, defining the regulatory and nutritional aspects, developing innovative and robust packaging, to eventually using technology to improve shelf-life while maintaining the quality of the food products.
 
The company is founded by an experienced Food Consultant with 20+ years of experience and is backed by a team with members who hold decades of experience across functions like manufacturing, nutrition, logistics, and food technology. With an enviable and diverse client base consisting of brands like Unilever and Britannia and fast-growing startups like Licious and Tasty Tales, the company surely has amarket presence that cannot be ignored.
 
As a Project Manager, you will be responsible for leading NPD projects on end-to-end R&D and product development for developing food products in the area of Herbals/Naturals, Functional Foods, and Neutraceuticals.

What you will do:

  • Handling product and process development, nutrition profiling, claims development, shelf life testing, manufacturing scale up
  • Managing projects - working with team on product, process, packaging development, regulatory, nutrition, manufacturing scaling up
  • Being the point of contact for client - weekly project tracking, working with the client and other stakeholders to ensure on time in full delivery of the project

 

Desired Candidate Profile

What you need to have:

  • Masters degree in Food Science/ Technology
  • 7-8 years of experience in the development of food products in the area of herbals (Ayurveda), Neutraceuticals
  • Very good technical skills and understanding
  • Good project management skills
  • Good communication and leadership skills    

 

Read more
Climate Connect Digital
at Climate Connect Digital
4 recruiters
Sarika Shukla
Posted by Sarika Shukla
Remote only
4 - 7 yrs
₹8L - ₹12L / yr
skill iconPHP
MySQL
skill iconLaravel
skill iconJavascript
AJAX
+2 more

About Climate Connect Digital

Our team is inspired to change the world by making energy more intelligent, greener, and affordable. Established in 2011 in London, UK, and now headquartered in Gurgaon, India. We have become a leading energy-AI software player from unassuming beginnings at the vanguard of accelerating the global energy transition.

 

In 2020, Renew Power, India’s largest renewables developer, acquired Climate Connect. Following ReNew’s listing on NASDAQ during summer 2021, Climate Connect has become the technology anchor of a new fully independent subsidiary - Climate Connect Digital. With backing from ReNew as the anchor investor to pursue an ambitious and visionary new strategy for rapid organic and inorganic growth.

 

Our mission has technology at its core and involves unlocking value through intelligent software, digitalisation, and ‘horizontal integration’ across the energy ecosystem. However, the application of computational power and machine learning to the energy sector has yet to be fully leveraged and can create massive value.

 

How you fit in

 

  • Curious. You love learning about new tools and technologies
  • Exposure. You have plenty of experience in executing projects successfully. You have a client-side exposure on project management
  • Team player. You have no problem working in a team setting. You can effectively collaborate with people to reach a solution.
  • Problem solver. You are the person your peers turn to for solving problems.
  • Talented. You are an expert in database designing.
  • Leader. You know how to prioritize work and inspire your colleagues. You are great with project planning and working on multiple things at once. You know you can effectively lead a group of people.
  • Honesty. You work diligently and honestly. You have strong moral principles.

 

Job Responsibilities

 

You will be working at the epicenter of energy transformation. You will be creating data-driven software solutions for forecasting and scheduling data in the renewables power market, while guiding your junior team members for the same. Ultimately, through your contribution to the renewable energy revolution, you will be doing your bit to mitigate the effects of climate change. These are a few things you can look forward to working on:

 

  • Designing and implementing low-latency, high-availability, and performance applications
  • Identifying and mitigating security-related threats to the application.
  • Using your expertise in database designing and application architecture planning for Core & MVC projects
  • Debugging browser extensions & server tools
  • Solving complex technical issues
  • Ensuring quality projects are delivered within defined timelines
  • Designing new frameworks, debugging and modifying existing frameworks
  • Maintaining databases to ensure strong optimization and functionalities
  • Working on multiple Renewables & Utilities projects in Power Market
  • Guiding your peers and motivating them to do their best
  • Designing and implementing the software as per the project requirements
  • Taking responsibility to lead the project teams

 

Job Requirements

 

  • PHP/Python
  • MVC Framework Laravel / Python Flask.
  • AJAX, HTML/HTML5 & CSS/CSS3, JavaScript and JavaScript frameworks (preferably jQuery)
  • Web services (SOAP, REST)
  • SQL and NoSQL scripting and databases like MYSQL and Mongo DB administration
  • Code versioning tools, such as Git
  • AngularJS / ReactJS
  • B.E / B. Tech / M. Tech / BSC in CS or IT
  • 4-6 years of experience in the field

 

What’s in it for you

 

We offer competitive salaries based on prevailing market rates. In addition to your introductory package, you can expect to receive the following benefits:

 

• Flexible working hours and leave policy

• Learning and development opportunities

• Medical insurance/Term insurance, Gratuity benefits over and above the salaries

• Access to industry and domain thought leaders.

 

At Climate Connect, you get a rare opportunity to join an established company at the

early stages of a significant and well-backed global growth push. We are building a remote-first organisation ingrained in the team ethos. We understand its importance for the success of any next-generation technology company. The team includes passionate and self-driven people with unconventional backgrounds, and we’re seeking a similar spirit with the right potential.

 
Read more
Bytelearn
at Bytelearn
3 recruiters
Surbhi Saxena
Posted by Surbhi Saxena
Remote only
2 - 5 yrs
₹15L - ₹15L / yr
skill iconData Science
skill iconMachine Learning (ML)
Natural Language Processing (NLP)
Computer Vision
recommendation algorithm
What does an AI Scientist do?

Proactively fetches information from various sources and analyzes it for a better understanding of how the business performs, and to build AI tools that automate certain processes within the company.

Roles & Responsibilities
- Develop novel computer vision/NLP algorithms
- Build large datasets that will be used to train the models
- Empirically evaluate related research works
- Train and evaluate deep learning architectures on multiple large scale datasets
- Collaborate with the rest of the research team to produce high quality research
- Manage a team of 2+ interns

Must-have skills
- 2+years of experience in building deep learning models
- Strong basics around probability and statistics, linear algebra, data structure & algorithms
- Good knowledge of classic ML algorithms (regression, SVM, PCA etc.), deep learning
- Strong programming skills
Nice to have skills
- Familiarity with pytorch
- Knowledge of SOTA techniques in NLP and Vision
Benefits
- High level of responsibility and ownership for a product impacting billions of lives.
- Extremely high-quality talent to work with. Work with a global team between US / India.
- Work from anywhere anytime!
- Best of breed industry benefits packages.
Read more
E-commerce company
E-commerce company
Agency job
via Kalibre global konnects by Taksh Rawal
Thaltej cross road
0 - 1 yrs
₹1.2L - ₹1.8L / yr
Telesales
Sales
telecalling
Hello!
Greetings from Kalibre Global

(1) Job Title:- Telesales Executive
(2) Can speak fluently in Hindi & Gujarati
(3) Exp.:- 06M to 1yrs.
(4) Edu:- Any Graduate
(5) Working days:- Mon to Sat
6) Location:- Thaltej Cross Road, Ahmedabad
Description:-
Leads will be provided by company, Experience with Ms-office, Generate prospects over the phone, Follow up with incoming leads, Ability to develop maintain positive working relationships with clients, Good communication skills, Search for new lead online portals. etc.
Read more
Advanced technology to Solve Business Problems.( A1)
Advanced technology to Solve Business Problems.( A1)
Agency job
via Multi Recruit by Ranjini A R
Hyderabad
3 - 4.5 yrs
₹6L - ₹9L / yr
skill iconPHP
skill iconLaravel
lumen
MySQL
Lavarel
+1 more
  • Looking for a talented PHP Developer having experience in writing clean PHP code.
  • Someone very good at understanding requirements and developing services & features quickly.
  • Good communication skills & team player, who engages with all stakeholders of the project to add clarity for all aspects of the ongoing software development project.

Your responsibilities will include:

  • Having good attention to detail & requirements.
  • Building software applications in PHP.
  • Developing applications using best design and coding practices.
  • Writing, maintaining & upgrading middleware & back-end code and building efficient PHP modules.
  • Troubleshooting application and code issues.
  • Integrating code with Databases & data storage solutions.
  • Finalizing back-end features and testing web services.
  • Updating and altering application features to enhance performance.

Key Requirements :

  • Degree in Computer Science, Engineering or a related field.
  • Must have Experience in PHP (Lumen & Laravel).
  • Experience in creating scalable service-oriented & serverless applications.
  • Experience with secure coding.
  • Proficient BitBucket and Git.
  • Should be experienced in following Agile methodologies. Tools - Jira & Confluence.
  • Must have experience in RDBMS - Postgres/MySql and NoSql - MongoDB/Redis.
  • Additional knowledge/experience in Python and NodeJs will be good to have.
  • Good to have experience in AWS.
  • Good problem solving, decision making and prioritization skills.

 

 

 

Read more
Trading in Cryptocurrencies.
Trading in Cryptocurrencies.
Agency job
via I-Block Technology Pvt. Ltd. by Himanshi Verma
Remote, NCR (Delhi | Gurgaon | Noida)
2 - 4 yrs
₹1L - ₹3L / yr
skill iconVue.js
skill iconAngularJS (1.x)
skill iconJavascript
skill iconHTML/CSS
Job Summary We are looking for an expert JavaScript developer who is highly skilled with Vue.js. Your primary focus will be developing user-facing web applications and components. You’ll implement them with the Vue.js framework, following generally accepted practices and workflows. You will ensure that you produce robust, secure, modular, and maintainable code. You will coordinate with other team members, including back-end developers and UX/UI designers. Responsibilities and Duties Develop User interfaces for Modern Rich Internet Applications with the latest Front End Technologies Perform product analysis and development tasks of increasingly complex nature which may require extensive research and analysis. Writing tested and documented JavaScript, HTML, and CSS Make design and technical decisions for AngularJS projects. Develop application code and unit test in the AngularJS, Rest Web Services and Java technologies for the Application Development Center. Ensuring high performance Key Skills Strong expertise with HTML, CSS, and writing cross-browser compatible code. Good understanding of AJAX and JavaScript Dom manipulation Techniques Experience with RESTful services Experience in JavaScript build tools like grunt or gulp Expert in any one of the modern JavaScript MV-VM/MVC frameworks (AngularJS, JQuery, NodeJS, GruntJS) Familiar with testing frameworks Test runner framework Required Experience and Qualifications 2-3 years *6 Days Working Job Type: Full-time
Read more
Estrella Headhunters
at Estrella Headhunters
3 recruiters
kajal fernandes
Posted by kajal fernandes
Mumbai
0 - 2 yrs
₹3L - ₹5L / yr
Recruitment/Talent Acquisition
Account Management
Recruitment
Internet recruiting
Outbound Recruitment
Role: Research Associate Position Description Research • Understanding the requirement of the client and creating a long list of the target organizations. • Mapping of various organizations and determining designations/ organization structures with accuracy. • Creatively network with people to get insight into organizational changes and developments to augment the database. • Track newspapers/ websites for developments in Financial Services (Private Equity Investments, Investment Banking Deals etc..) and related sectors. Delivery / Execution • Carry out widespread research to find suitable candidates for on-going positions. • Network extensively to gather meaningful data on the trends in the industry, challenges in the sector etc. in order to tap into the right area for sourcing. • Assist the team in managing Candidate – Client expectations. • Facilitate seamless Candidate – Client communication viz, interview scheduling. • Assist the team in handling the entire life cycle and thereby ensure smooth closure of the position. Report – Writing, Presentation & Database Management • Create mapping report basis the research done for various positions. • Report writing for on-going mandates – Long Lists, Candidate Evaluation, Comparative Analysis etc. • Update internal databank on real time basis. Desired Skills and Experience • Headhunting • Mapping • Cold Calling • Online Research • Professional Networking
Read more
Vitwit
at Vitwit
5 recruiters
LingaMurthy M
Posted by LingaMurthy M
Hyderabad
1 - 3 yrs
₹3L - ₹4L / yr
skill iconAngularJS (1.x)
skill iconExpress
skill iconMongoDB
skill iconNodeJS (Node.js)
We are looking for Developers with 1-3 years of experience in PHP and related framework. We need developers who are very passionate to identify and solve the problems. About Us: Vitwit is an IT Services and Products based company established in 2015. We provide Technology Consulting Services, Web & Enterprise Applications, Database Solutions, Data Analytics and Cloud Services. We are working on couple of products related to Internet of Things (IoT) and Artificial Intelligence (AI). Our mission is to build intelligent applications and systems, to help the businesses to be profitable and successful. Our Problem Solving culture and Design Thinking process makes us unique in providing inventive and innovative solutions to clients. Our high learnability and collaborative workplace builds confluence of passionate talents to establish their career. Job Description and responsibilities: Able to write reusable, testable and efficient code Design and implementation of low- latency, high-availability and performant applications Implementation of security and data protection Integration of data storage solutions( may include databases, key-value stores, blob stores, etc.) Strong proficiency with PHP and its frameworks like Codeigntor, Laravel etc,. Good understanding of front-end technologies like HTML5, CSS Understanding fundamental design principles behind a scalable application Creating database schemas that represent and support business processes Implemented automated and testing platforms and unit test Proficient understanding of code versioning tools, such as GIT Open source portfolio is a plus
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos