Cutshort logo
Experiencecom logo
Senior GCP Data engineer
Senior GCP Data engineer
Experiencecom's logo

Senior GCP Data engineer

Avinash S's profile picture
Posted by Avinash S
7 - 12 yrs
₹20L - ₹35L / yr
Remote only
Skills
Google Cloud Platform (GCP)
Big Data
skill iconPython
SQL
pandas
ETL
Data processing
PySpark

Description


Come Join Us


Experience.com - We make every experience matter more

Position: Senior GCP Data Engineer

Job Location: Chennai (Base Location) / Remote

Employment Type: Full Time


Summary of Position

A Senior Data Engineer is a professional who specializes in preparing big data infrastructure for analytical or operational uses. He/She is responsible for develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity. They collaborate with data scientists and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organisation.


Responsibilities:

  • Collaborate with cross-functional teams to define, prioritize, and execute data engineering initiatives aligned with business objectives.
  • Design and implement scalable, reliable, and secure data solutions by industry best practices and compliance requirements.
  • Drive the adoption of cloud-native technologies and architectural patterns to optimize the performance, cost, and reliability of data pipelines and analytics solutions.
  • Mentor and lead a team of Data Engineers.
  • Demonstrate a drive to learn and master new technologies and techniques.
  • Apply strong problem-solving skills with an emphasis on building data-driven or AI-enhanced products.
  • Coordinate with ML/AI and engineering teams to understand data requirements.


Experience & Skills:

  • 8+ years of Strong experience in ETL and ELT data from various sources in Data Warehouses
  • 8+ years of experience in Python, Pandas, Numpy, and SciPy.
  • 5+ years of Experience in GCP 
  • 5+ years of Experience in BigQuery, PySpark, and Pub/Sub
  • 5+ years of Experience working with and creating data architectures.
  • Certified in Google Cloud Professional Data Engineer.
  • Advanced proficiency in Google Cloud services such as Dataflow, Dataproc, Dataprep, Data Studio, and Cloud Composer.
  • Proficient in writing complex Spark (PySpark) User Defined Functions (UDFs), Spark SQL, and HiveQL.
  • Good understanding of Elastic search.
  • Experience in assessing and ensuring data quality, data testing, and addressing data quality issues.
  • Excellent understanding of Spark architecture and underlying frameworks including storage management.
  • Solid background in database design and development, database administration, and software engineering across full life cycles.
  • Experience with NoSQL data stores like MongoDB, DocumentDB, and DynamoDB.
  • Knowledge of data governance principles and practices, including data lineage, metadata management, and access control mechanisms.
  • Experience in implementing and optimizing data security controls, encryption, and compliance measures in GCP environments.
  • Ability to troubleshoot complex issues, perform root cause analysis, and implement effective solutions in a timely manner.
  • Proficiency in data visualization tools such as Tableau, Looker, or Data Studio to create insightful dashboards and reports for business users.
  • Strong communication and interpersonal skills to effectively collaborate with technical and non-technical stakeholders, articulate complex concepts, and drive consensus.
  • Experience with agile methodologies and project management tools like Jira or Asana for sprint planning, backlog grooming, and task tracking.


Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Experiencecom

Founded :
2015
Type :
Product
Size :
100-500
Stage :
Raised funding

About

We believe that experience is everything. Amazing experiences create customers for life, and poor ones destroy brands and businesses. That's why Experience.com has built the most impactful Experience Management Platform (XMP) available anywhere, with features to drive operational and behavioral change, in real-time, during the moments that matter. XMP delivers impactful business outcomes including increased customer satisfaction, brand loyalty, online reputation and visibility, as well as improved employee engagement, and compliance - making every experience matter more. Founded in 2015 and originally founded as SocialSurvey, Experience.com is headquartered in San Ramon, Calif. and backed by SavantGrowth (fka Kennet Partners), Silicon Valley Data Capital, Tri-Valley Ventures, and Wilson Sonsini Goodrich & Rosati. For more information, visit www.experience.com or call +1 (888) 701 4512.
Read more

Company social profiles

instagramlinkedinfacebook

Similar jobs

Codebuddy Pvt. Ltd.
at Codebuddy Pvt. Ltd.
2 recruiters
Abhishek Gupta
Posted by Abhishek Gupta
Remote, Kolkata
1 - 3 yrs
₹3L - ₹6L / yr
Project Management
IT project management
Team Management
Performance Evaluation
We are looking for a Project Manager to join our agile team of professionals.
Apply now for the role of a Project Manager at CodeBuddy that is opening doors for skilled, energetic project managers looking for challenging roles.
If you are passionate about technology, constantly seeking to learn and improve your skill set, you would fit here perfectly.

Technical Competency:

-Analysing business requirements, creating proposals, financial and resource planning & preparing project plan
-Identify project roadblocks, risks and mitigation plan
-Handling multiple projects end to end across multiple domains with cross functional teams (Engineering, Quality, Design etc)
-Interacting with customers on a regular basis across the development lifecycle
-Ensuring smooth delivery of projects and day to day project management activities.
-Participate in HOD calls to discuss the nature, urgency and root cause of the problems -and appropriately take decisions in collaboration with the HOD
-Should successfully manage the complete development life cycle using Software Best Practices, Analytical and communicate well to successfully deliver high-tech projects/products.
-Liaising with team members, HOD, and management to ensure projects are completed to standard.
-Excellent leadership skills. 1+ years of experience managing an engineering team of at least 5 engineers
-Keeping track of tasks, defects assigned to the team and delegating tasks and achieving daily, weekly, and monthly goals.

Interpersonal skills:

-Good communicator and able to present both Technical and non-Technical information.
-Very effective at disseminating information with a strong belief in transparency.
-Strong team player with capabilities working with globally distributed teams
-Problem solving capabilities with ability to identify root cause, patience and commitment to solve
-Ability to handle escalations and follow-up to resolve issues
-Excellent verbal and written communication, presentation and articulation skills
-Proven management skills with the ability to optimize team performance and development
-Strong interpersonal, negotiation and influencing skills
-Excellent attention to detail skills

What You Need To Apply:

-Self-motivated with the ability to work independently or jointly in a self-directed way.
-Demonstrated successful development of web or mobile-based applications
-Proven analytical and problem-solving capabilities
-Keen attention to detail
-Strong work ethic and desire to build industry-leading products
-Proactive instead of reactive
-Looking for ways to improve self and projects
If you have it all in you, we are happy to have you with us!

Perks:

-We at Codebuddy believe our team is our biggest strength and we believe in paying our team members fair remuneration because we respect everyone's effort. Also, you will have the chance to work with accomplished co-founders with strong business backgrounds and acumen along with a strong network.
-Review in every 9-12 months (Approx 10% to 30% hike based on performance)
-Opportunity to learn new technologies at the company's expense
-On-Time Salary
-Fair Pay Policy
-Easy Leave Structure
-Quarterly Performance Awards
-Festival Gifts
-Annual Picnic
-Monthly Dinner Parties

We will be even happier if you have:

-Ability to discover functional and non-functional requirements of an app, based on various levels of inputs from clients,
-Ability to transform customer ideas to business model and scope understandable by technical experts,
-Having excellent stakeholder management and client-facing skills.

Joining Codebuddy Means:

-Working in a comfortable and stimulating environment that boosts productivity,
-Being involved in challenging projects,
-Taking part and initiating knowledge-sharing initiatives,
-Working with clients from around the world,
-Having the opportunity to bounce your ideas off our experienced team,
-Enjoying flextime and flexplace: adjust your daily schedule to your individual needs!
-We decide together and value equality: there is no strong hierarchy in our teams, and every opinion is more than welcome,
-Processes based on Scrum and Agile methodologies,
-The constant development of your hard and soft skills
-Having a smooth start: your leader and a buddy will support you and mentor you.

What will happen next?

-Fill out the form
-Give us some time to review your application
-Meet us for an interview
-Complete a recruitment task to see how we work
Join our team!
Read more
company logo
Agency job
via Molecular Connections by Molecular Connections
Bengaluru (Bangalore)
3 - 4 yrs
₹3L - ₹7L / yr
skill iconJava
J2EE
skill iconSpring Boot
skill iconElastic Search
skill iconXML
+6 more

Mentoring teams to carry forward recognised and optimised solutions, building conducive environments for knowledge transfer and maintaining standards in terms of deliveries form a major part of responsibilities.

 

 

Responsibilities

  • Design and develop robust scalable database systems
  • Design, build and deploy internal applications to support our native technical ecosystem
  • Collaborate with Subject-Matter experts to design data-driven modules for analysis

 

Qualifications

  • Bachelor's or Master's degree in Computer Science, Information Systems, Engineering or equivalent
  • 3-4 years of experience in Java

 

 

Skills

  • Expertise in object-oriented programming concepts and data structures
  • Strong knowledge of working with XMLs/Jsons
  • Experience with large-scale distributed storage and database systems (MySQL, MongoDB, GraphDB)
  • Good knowledge of indexing/search libraries like Lucene/Solr/Elasticsearch
  • Exposure to Spring MVC architecture and RESTful APIs
  • Well-versed with Agile methodology of SDLC
  • Good to have: Knowledge of standard DevOps skills like Build tools (Maven/gradle), Continuous integration (Jenkins), Version Control (Github/Gitlab)
Documentation and reproducibility of codes and standards will be greatly appreciated
Read more
US based startup that offers an open source authentication
US based startup that offers an open source authentication
Agency job
via Qrata by Rayal Rajan
Remote only
2 - 7 yrs
₹20L - ₹45L / yr
skill iconGo Programming (Golang)
skill iconRuby on Rails (ROR)
skill iconRuby
skill iconPython
skill iconJava

What kind of work will you get?

We are looking for a Golang developer.

Examples of technical tasks:

Working on our backend SDK to implement APIs that will be consumed by the frontend widgets

Designing APIs for different auth recipes

Architecting auth flows

You will also be given non technical tasks like product brain storming, competitor analysis and writing documentation.

Note: Compensation is as per the applicant's geography

Requirements

Well versed in Golang with 2+ years of professional experience

Familiar with and comfortable working with Web frameworks like FastAPI, Django and Flask

Familiar with HTTP networking in Golang

Strong understanding of async and sync modes in Golang

Bonus:

Contributed to open source, or have your own open source repo with a community and many github stars

Built an in-house authentication or authorization solution or worked with solutions such as Keycloak, Auth0, Ory, Okta etc

Read more
Infosec Ventures
Pulkit Jain
Posted by Pulkit Jain
Gurugram
0 - 0 yrs
₹0 / mo
MS-Office

Key Responsibilities


• Sourcing resumes through Job portals, other sources, head hunting and references.


• Screening profiles according to the job specifications.


• Conducting the first level of interviews.


• Coordination with the candidates till successful on boarding.


• Coordinating with various departments for the hiring process.


• Posting job advertisements to job boards and social media platforms.


• Removing job advertisements from job boards and social media platforms once vacancies have been filled.


• Assisting the HR team in gathering market information regarding HR policies, employee benefits, and other HR-related matters.


Key Competencies:


• Superior Communication and Interaction skills.


• Demonstrated management presentation abilities.


• Should be sincere and hardworking and must be open to handle pressure.


Perks


• Certificate


• Letter of recommendation


Duration: 3-6 months

Vacancy: 2

Read more
Eloelo
at Eloelo
1 recruiter
Vikas Saini
Posted by Vikas Saini
Bengaluru (Bangalore)
5 - 7 yrs
₹40L - ₹50L / yr
skill iconKotlin
Model-View-View-Model (MVVM)
KMP
jetpack
Android vital

What You will do

  • Website and software application designing, building, or maintaining.
  • Using scripting or authoring languages, management tools, content creation tools, applications, and digital media.
  • Conferring with teams to resolve conflicts, prioritise needs, develop content criteria, or choose solutions.
  • Directing or performing Website updates.
  • Developing or validating test routines and schedules to ensure that test cases mimic external interfaces and address all browser and device types.
  • Editing, writing, or designing Website content, and directing team members who produce content.
  • Maintaining an understanding of the latest Web applications and programming practices through education, study, and participation in conferences, workshops, and groups.
  • Back up files from Web sites to local directories for recovery.
  • Identifying problems uncovered by customer feedback and testing, and correcting or referring problems to appropriate personnel for correction.
  • Evaluating code to ensure it meets industry standards, is valid, is properly structured, and is compatible with browsers, devices, or operating systems.
  • Determining user needs by analyzing technical requirements.


What you will need

  • 5-7 Years of Experience 
  • Bachelor's degree in Web development or related field, or relevant experience.
  • Solid knowledge and experience in programming applications.
  • Skills Knowledge React JS & Next JS
  • Proficient in JavaScript, HTML,CSS.
  • Proficient in Routing, Api Management & Security.
  • Dedicated team player.
  • Ability to thrive in a fast-paced environment.
  • Solid ability in both written and verbal communication.
  • Knowledge of programming language and technical terminology.
  • Able to develop ideas and processes and clearly express them.
  • High degree of independent judgement.
  • Able to solve complex problems


Read more
CoreStack
at CoreStack
2 recruiters
Dhivya R
Posted by Dhivya R
Chennai
1 - 8 yrs
₹4L - ₹40L / yr
skill iconPython
skill iconDjango
skill iconFlask

CoreStack, an AI-powered multi-cloud governance solution, empowers enterprises to rapidly achieve Continuous and Autonomous Cloud Governance at Scale. CoreStack enables enterprises to realize outcomes such as 40% decrease in cloud costs and 50% increase in operational efficiencies by governing operations, security, cost, access, and resources. CoreStack also assures 100% compliance with standards such as ISO, FedRAMP, NIST, HIPAA, PCI-DSS, AWS CIS & Well Architected Framework (WAF). We work with many large global customers across multiple industries including Financial Services, Healthcare, Retail, Education, Telecommunications, Technology and Government.

CoreStack closed a $8.5 million Series A financing recently. CoreStack was recognized as IDC Innovator in Cloud Management Solutions and in the Gartner Magic quadrant for Cloud Management Platforms in 2020. Earlier in 2019, Gartner named CoreStack as a Cool Vendor in Cloud Computing. CoreStack is a Microsoft Azure Gold & Co-Sell Partner and Amazon AWS Advanced Technology Partner.

Job Description
• Lead a team of open source developers in building Cloud Products/Solutions
• Participate in R&D activities led by architects
• Contribute in product engineering and system integration
• Perform system integration for various private cloud platforms
• Communicate effectively with various stake-holders involved in the delivery process and getting stuff done
Skills Required
• Experience integrating/working with Openstack Cloud Platform is a must
• Must be well versed with Openstack EcoSystem
• An inquisitiveness to understand the intricacies at the code-level and at the same time understand the constituents of the bigger picture
• Hands-on hacker mentality with excellent coding skills and a passion to develop high-quality code
• Understand design patterns and their significance in software development
• Ability to context-switch between different problems at the same time efficiently and prioritize them properly before tackling them
• Must be able to inspire juniors and command the respect of peers with technical acumen and attitude
• Contribution to any open-source projects, blogging on technical topics, creation of any tool/framework/library, taking part in hackathons/coding challenges/workshops, being part of any technical group/forum will all be valued

CoreStack Offers

  • Competitive salary
  • Competitive benefit package with appreciable equity
  • Exciting, fast-paced and entrepreneurial culture
  • Health insurance and other company benefits
Read more
CADeploy
at CADeploy
2 recruiters
bhavani bhavani
Posted by bhavani bhavani
Coimbatore, Hyderabad
4 - 7 yrs
₹2L - ₹6L / yr
Tekla
SDS2
tekla
sds2
reber
+7 more

Greeting from Cadeploy!!!

We are hiring for Tekla / SDS2 / Rebar - Sr.Modeller / Sr.Checker / Sr.Detailer.

Read more
Project Eagle
at Project Eagle
1 recruiter
Tarang Sanghi
Posted by Tarang Sanghi
Jaipur
0 - 0 yrs
₹1L - ₹1L / yr
MS-Office
Business administration
BBA
MBA - Business Administration
ALTERNATE TITLES Business Admin Intern, Management Intern
STIPPEND 5K- 7K
DEPARTMENT Operations


We are looking for an enthusiastic and driven Business Intern to perform various administrative tasks and support our CEO in daily activities.

If you’re ready to kickstart your career in the startup world and build real-world experience working multiple business functions, this is the internship for you.

ABOUT THE COMPANY

Founded by Tarang Sanghi in Jaipur, RJ (India), TS Studio is a strategic design, business, and tech consulting practice with offerings ranging from venture-creation, strategy, branding, digital marketing to; space, graphic, web & app design.
We believe in finding simple solutions to complex problems that people love and use. With our deeply integrated teams from start to finish, we analyze human behaviors to develop new ideas and solutions that enable better experiences. We place a strong emphasis on craft in every detail.
Currently, we are putting together a team of the best and the brightest! We look forward to receiving your application!!
SCENARIO

Environment- Consulting Startup

Fresh / Established You will be working with a fresh team.

AREA OF RESPONSIBILITIES

Some of your responsibilities will include:

ASSISTANCE

  • Manage diaries, schedule and document meetings and appointments.
  • Reminding the manager/executive of important tasks and deadlines.
  • Booking and arranging travel, transport and accommodation.
  • Assist in resolving day-to-day business issues.
  • Typing, compiling and preparing internal and external - reports, presentations, emails and correspondence.
  • Conducting research and analysis on behalf of the manager.

COORDINATION

  • Acting as a first point of contact for the CEO.
  • Organising events and conferences.
  • Implementing and maintaining procedures/administrative systems.
  • Help plan,design and launch business new processes, initiatives and make recommendations for improvement.
  • Act as a mediator to help manage various tasks, assignments and projects.
  • Manage databases and information systems.
  • Manage information flow in a timely and accurate manner.

PURCHASE & SOURCING

  • Identifying requirements, and finding products and solutions.
  • Find vendors & suppliers, and get quotations.
  • Create pricing and feature comparison sheets.
  • Do end-to-end, order management; ordering, order tracking, and quality-check on delivery.
  • Manage refund & replacement process including customer care interactions, and coordinating with the finance department.

*May be required to perform additional responsibilities and projects upon request.

Requirements
  • Duration Available: for a minimum duration of 6 months.
  • Pay: You will be paid a stipend.
  • Location Availability: for full time (in-office) internship in Jaipur.
  • Education & Work experience: Relevant degree in Business Management. Additional training will be a plus. Some experience in an office environment is preferred.
  • Software and Applications: Experience with Microsoft Office Suite, emailing, calendaring and productivity software.

Qualities & Capabilities:

  • Tech Savvy.
  • Excellent interpersonal and communication skills.
  • Ability to work in a fast-paced, team-oriented environment.
  • Solid organisational skills and attention to detail.
Benefits
Develop experience working on a wide variety of projects and functions.

Gain exposure to a fast-paced, collaborative startup environment.

Opportunity for a permanent job offer after the completion of the internship.

Attractive stipend.
Read more
Chariot Tech
at Chariot Tech
1 recruiter
Raj Garg
Posted by Raj Garg
NCR (Delhi | Gurgaon | Noida)
1 - 5 yrs
₹15L - ₹16L / yr
skill iconMachine Learning (ML)
Big Data
skill iconData Science
We are looking for a Machine Learning Developer who possesses apassion for machine technology & big data and will work with nextgeneration Universal IoT platform.Responsibilities:•Design and build machine that learns , predict and analyze data.•Build and enhance tools to mine data at scale• Enable the integration of Machine Learning models in Chariot IoTPlatform•Ensure the scalability of Machine Learning analytics across millionsof networked sensors•Work with other engineering teams to integrate our streaming,batch, or ad-hoc analysis algorithms into Chariot IoT's suite ofapplications•Develop generalizable APIs so other engineers can use our workwithout needing to be a machine learning expert
Read more
Promobi Technologies
at Promobi Technologies
1 video
15 recruiters
Shruti Datta
Posted by Shruti Datta
Pune, NCR (Delhi | Gurgaon | Noida)
3 - 11 yrs
₹6L - ₹25L / yr
skill iconRuby on Rails (ROR)
skill iconAngularJS (1.x)
skill iconReact.js
Fullstack Developer
Ruby on Rails architecture best practices  ● Strong OOP knowledge in Ruby.  ● Good Knowledge on Angular or React JS  ● Asynchronous Networking in Ruby   ● Designing RESTFul HTTP APIs using JSON-Schema or JSON API (​jsonapi.org​).  ● Ability to architect and develop API only backend  ● Experience in using Active Record Serializer  ● Understanding O-Auth2 or JWT (Json Web Token) authentication mechanisms.  ● How to use RSpec  ● Rails Security Best Practices  ● PostgreSQL and Rails.  ● SQL concepts like Joins, Relationships etc.  ● Understanding DB Partition strategies.  ● Knowledge about refactoring ActiveRecord Models (read this - “7 Patterns to Refactor Fat  ActiveRecord Models”).  ● Understanding scaling strategies for a high-traffic Rails applications (2 million+ requests a  day).  ● Background Job processing using Redis and Sidekiq  ● Experience in using Amazon Web Services (AWS) tools.  ● Writing automated Deployment Scripts using Capistrano, Ansible etc.  ● Sending emails in Rails  ● Knowledge in Linux and Git is mandatory
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos