Cutshort logo
Experiencecom logo
Senior GCP Data engineer
Senior GCP Data engineer
Experiencecom's logo

Senior GCP Data engineer

Avinash S's profile picture
Posted by Avinash S
7 - 12 yrs
₹20L - ₹35L / yr
Remote only
Skills
Google Cloud Platform (GCP)
Big Data
skill iconPython
SQL
pandas
ETL
Data processing
PySpark

Description


Come Join Us


Experience.com - We make every experience matter more

Position: Senior GCP Data Engineer

Job Location: Chennai (Base Location) / Remote

Employment Type: Full Time


Summary of Position

A Senior Data Engineer is a professional who specializes in preparing big data infrastructure for analytical or operational uses. He/She is responsible for develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity. They collaborate with data scientists and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organisation.


Responsibilities:

  • Collaborate with cross-functional teams to define, prioritize, and execute data engineering initiatives aligned with business objectives.
  • Design and implement scalable, reliable, and secure data solutions by industry best practices and compliance requirements.
  • Drive the adoption of cloud-native technologies and architectural patterns to optimize the performance, cost, and reliability of data pipelines and analytics solutions.
  • Mentor and lead a team of Data Engineers.
  • Demonstrate a drive to learn and master new technologies and techniques.
  • Apply strong problem-solving skills with an emphasis on building data-driven or AI-enhanced products.
  • Coordinate with ML/AI and engineering teams to understand data requirements.


Experience & Skills:

  • 8+ years of Strong experience in ETL and ELT data from various sources in Data Warehouses
  • 8+ years of experience in Python, Pandas, Numpy, and SciPy.
  • 5+ years of Experience in GCP 
  • 5+ years of Experience in BigQuery, PySpark, and Pub/Sub
  • 5+ years of Experience working with and creating data architectures.
  • Certified in Google Cloud Professional Data Engineer.
  • Advanced proficiency in Google Cloud services such as Dataflow, Dataproc, Dataprep, Data Studio, and Cloud Composer.
  • Proficient in writing complex Spark (PySpark) User Defined Functions (UDFs), Spark SQL, and HiveQL.
  • Good understanding of Elastic search.
  • Experience in assessing and ensuring data quality, data testing, and addressing data quality issues.
  • Excellent understanding of Spark architecture and underlying frameworks including storage management.
  • Solid background in database design and development, database administration, and software engineering across full life cycles.
  • Experience with NoSQL data stores like MongoDB, DocumentDB, and DynamoDB.
  • Knowledge of data governance principles and practices, including data lineage, metadata management, and access control mechanisms.
  • Experience in implementing and optimizing data security controls, encryption, and compliance measures in GCP environments.
  • Ability to troubleshoot complex issues, perform root cause analysis, and implement effective solutions in a timely manner.
  • Proficiency in data visualization tools such as Tableau, Looker, or Data Studio to create insightful dashboards and reports for business users.
  • Strong communication and interpersonal skills to effectively collaborate with technical and non-technical stakeholders, articulate complex concepts, and drive consensus.
  • Experience with agile methodologies and project management tools like Jira or Asana for sprint planning, backlog grooming, and task tracking.


Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Experiencecom

Founded :
2015
Type :
Product
Size :
100-500
Stage :
Raised funding

About

We believe that experience is everything. Amazing experiences create customers for life, and poor ones destroy brands and businesses. That's why Experience.com has built the most impactful Experience Management Platform (XMP) available anywhere, with features to drive operational and behavioral change, in real-time, during the moments that matter. XMP delivers impactful business outcomes including increased customer satisfaction, brand loyalty, online reputation and visibility, as well as improved employee engagement, and compliance - making every experience matter more. Founded in 2015 and originally founded as SocialSurvey, Experience.com is headquartered in San Ramon, Calif. and backed by SavantGrowth (fka Kennet Partners), Silicon Valley Data Capital, Tri-Valley Ventures, and Wilson Sonsini Goodrich & Rosati. For more information, visit www.experience.com or call +1 (888) 701 4512.
Read more

Company social profiles

instagramlinkedinfacebook

Similar jobs

Moshi Moshi
at Moshi Moshi
3 candid answers
Human Resource
Posted by Human Resource
Bengaluru (Bangalore), Mumbai, Gurugram
2 - 5 yrs
₹8L - ₹12L / yr
Sales
Business Development

About Us:

We are not just an AD agency or a creative agency, we are a Communication Company. Founded in 2014, Moshi Moshi is a young, creative, gutsy, and committed communication company that wants its clients to always Expect the EXTRA from it. Our primary clientele consists of Startups and corporations like Ola, Zoomcar, Mercedes Benz, ITC, Aditya Birla Group, TATA Group, MTV, IHCL, Jaquar, Sobha, Simple Energy, and Godrej amongst others. We have a huge team of creative folks, marketers, learners, developers, and coders who believe Moshi Moshi is an experience rather than a company.


Job Description:


We are looking for a BDM with experience in generating sales and developing new business for our company. This is the perfect opportunity for someone who is excited by the prospect of growing with the company in a friendly environment and having a key role in the process.


Responsibilities:

1. Developing, generating, and growing new business- branding, website, marketing, and creating innovative business plans for clients.

2. Managing both our existing sales pipeline and developing new business opportunities. Identifying opportunities for new business development through following up on leads and conducting research

on target clients.

3. Selling Web and Digital marketing services/solutions including SEO, Google, PPC, social media marketing, B2B marketing, Branding, website development, and other services.

4. Create effective and persuasive proposals.

5. Excellent presentation, pitches, proposal, negotiation, and customer relationship skills.

6. Maintain an active schedule of prospecting calls.

7. Assist in the coordination and implementation of marketing strategies, and delegate tasks that achieve strategic goals

Read more
Agami Tech
at Agami Tech
3 recruiters
Digish Shah
Posted by Digish Shah
Surat, Mumbai, Pune
1 - 3 yrs
Best in industry
skill iconJava
skill iconSpring Boot
MVC Framework
Hibernate (Java)
J2EE
+2 more

Responsibilities-


  • Writing back-end code & front –end code and building efficient Java modules
  • Contribute in all phases of the development lifecycle, Write well designed, testable, Design, build, and maintain efficient, reusable, and reliable Java code code
  • Help maintain code quality, organization, and automatization
  • Ensure designs are in compliance with specifications
  • Prepare and produce releases of software components
  • Support continuous improvement by investigating alternatives and technologies and presenting these for architectural review
  • Translate application storyboards and use cases into functional applications
  • Ensure the best possible performance, quality, and responsiveness of the applications
  • Identify bottlenecks and bugs, and devise solutions to these problems
  • Align with organizational security protocols and data protection requirements and
  • Implement the required feature
  • Participate in all phases of the SDLC

Skills and Experience-

  • BS/MS Degree in Computer Science, Engineering or a related subject
  • Hands-on experience in designing and developing applications using Java EE platforms
  • Object-oriented analysis and design using common design patterns.
  • Profound insight of Java and JEE internals (Class loading, Memory Management, Transaction management, etc.)
  • excellent knowledge of Relational Databases, SQL, and ORM technologies (JPA2, Hibernate)
  • Experience in the Spring Framework
  • Hands-on experience in designing and developing applications using JavaScript, j Query, and AJAX.
  • Ensure that the APIs and services are adequate to support the application
  • Profound insight of Java and JEE internals (Class loading, Memory Management, Transaction management etc.)
  • Excellent knowledge of Relational Databases, SQL, and ORM technologies (JPA2, Hibernate)
  • Experience with test-driven development
  • excellent written and verbal communication skills Ability to quickly adapt and learn new technologies.
  • Collaborate with other parts of the technology team, including product, QA, etc. to deliver a solid product.
Read more
Wisemonk
Delhi
5 - 12 yrs
₹10L - ₹15L / yr
skill iconPHP
skill iconLaravel
MySQL
skill iconCodeIgniter
RESTful APIs
+13 more
We are looking for a Technical Lead specialized in developing web applications using Laravel Framework within the PHP programming language together with REST-based API design and development. The candidate should also have experience in handling DevOps on AWS and expertise in GIT code pipeline management.
 
Key Responsibilities
• Develop, record and maintain cutting edge web-based PHP applications on portal plus premium service platforms
• Ensure HTML, CSS, and shared JavaScript is valid and consistent across applications
• Utilize backend data services and contribute to increase existing data services API
• Defining and setting development, test, release, update, and support processes for DevOps operation
• Have the technical skill to review, verify, and validate the software code developed in the project.
• Troubleshooting techniques and fixing the code bugs
• Incidence management and root cause analysis
• Coordination and communication within the team and with customers
• Selecting and deploying AWS CI/CD tools
• Strive for continuous improvement and build continuous integration, continuous development, and constant deployment pipeline (CI/CD Pipeline)
• Coordinate with co-developers and keeps project manager well informed of the status of development effort and serves as liaison between development staff and project manager

Requirements

 
• Strong Experience developing web applications in PHP (Laravel), REST-based API design and development, MySQL
• PHP w/ OOPs development and Laravel experience is a Must
• Strong experience in JQuery, JavaScript, XML, HTML, CSS, JSON.
• Third party API integration
• Integration of Email, Instagram, WhatsApp, Facebook and other APIs
• Excellent knowledge of data structures, SDLC, HTTP/HTTPS, RDBMS and PHP/MySQL concepts.
• Exceptional understanding of and practice using Object Oriented Coding principles
• Ability to effectively communicate your work with both technical and non-technical peers
• Understanding of Restful web service design, implementation, and maintenance
• Working knowledge of Agile/Scrum development practices with JIRA tool
• Experience in manging AWS Devops including automated CI/CD pipeline
• Experience of other technologies related to development, such as version control systems (SVN, Git), NoSQL, and cloud hosting platforms, especially AWS, is a must
Read more
EnterpriseMinds
at EnterpriseMinds
2 recruiters
phani kalyan
Posted by phani kalyan
Bengaluru (Bangalore)
3 - 6 yrs
₹5L - ₹25L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Microservices

Job Description:


1) Good experience in Java

2) Hands-on experience in Spring boot

3) Hands-on experience in Microservices

Read more
Hiring for Fintech Company
Hiring for Fintech Company
Agency job
via Sunrise Job Consultancy by Sharad Gupta
Bengaluru (Bangalore)
2 - 7 yrs
₹9L - ₹15L / yr
skill iconNodeJS (Node.js)
skill iconMongoDB
Mongoose
skill iconExpress
2+years of experience in NodeJS
Experience working with ExpressJS
Good Understanding of OOPS , Data Structure and Algorithms is required
Read more
MNC
MNC
Agency job
via Fragma Data Systems by Evelyn Charles
Remote, Chennai
2 - 5 yrs
₹11L - ₹15L / yr
skill iconPython
API
skill iconDjango
skill iconFlask

Job Description:

Candidate must have 2 to 5-years of experience in various phase of development of a python-based application or API development.

 

Requirements:

Must Have:  Strong expertise in PYTHON and its built-in data structures, developing API using flask or fastapi, data wrangling using standard python frameworks like pandas, NumPy etc., integration of various applications (third party or inhouse) with python.

Good to Have: Deployment using Nginx, GUnicorn, IIS, docker and Kubernetes etc. Good understanding of optimization solutions like differential evolution. Hands on experience with python packages like Scipy.  Tkinter to make python-based applications.

 

Roles and Responsibilities:

  • Understanding/gathering the requirements from stakeholder, formulating the problem, and leveraging AI/ML to solve the business problems.
  • Integration of third party or in house application with python solution.
  • Working on Deployment and optimization of various engineering problems using Numerical/Constraint optimization frameworks such as Differential Evolution and deploy a web-based API using Flask and Nginx/IIS.
  • Unit testing of various python modules developed and testing of the API.
Read more
Nexopay
at Nexopay
2 recruiters
Meenal Sharma
Posted by Meenal Sharma
Bengaluru (Bangalore)
2 - 4 yrs
₹3L - ₹13L / yr
skill iconData Science
skill iconMachine Learning (ML)
Natural Language Processing (NLP)
Computer Vision
recommendation algorithm

About us: Nexopay helps transforming digital payments and enabling instant financing for parents, across schools and colleges world-wide.

Responsibilities:

  • Work with stakeholders throughout the organisation and across entities to identify opportunities for leveraging internal and external data to drive business impact
  • Mine and analyze data to improve and optimise performance, capture meaningful insights and turn them into business advantages
  • Assess the effectiveness and accuracy of new data sources and data gathering techniques
  • Develop custom data models and algorithms to apply to data sets
  • Use predictive modeling to predict outcomes and identify key drivers
  • Coordinate with different functional teams to implement models and monitor outcomes
  • Develop processes and tools to monitor and analyze model performance and data accuracy

 

Requirements:

  • Experience in solving business problem using descriptive analytics, statistical modelling / machine learning
  • 2+ years of strong working knowledge of SQL language
  • Experience with visualization tools e. g., Tableau, Power BI
  • Working knowledge on handling analytical projects end to end using industry standard tools (e. g., R, Python)
  • Strong presentation and communication skills
  • Experience in education sector is a plus
  • Fluency in English
Read more
techiejack systems LLP
at techiejack systems LLP
1 recruiter
Saifudeen Khan
Posted by Saifudeen Khan
Bengaluru (Bangalore), Chennai
3 - 5 yrs
₹3L - ₹6L / yr
ERlang
React Native
JQuery
GraphQL
pub nub
+1 more
We at techiejack are buiding a next Gen Genealogy product. We finished wrapping up the conceptualization and started designing now. The target is mobile at this point and would require the following skill sets preferably in Bangalore and on our roles. We are open to consider remote working option as well, once we find the resource comfortable. The following is the requirement Seeking seasoned Software Developers with strong multidisciplinary experience, especially Erlang, ReactNative, RabbitMQ, GraphQL and PostGRES and Chart/Graph API(JQuery, Javascript, NoSQL databases, NodeJS, etc. are bonuses). We need people with strong programming and software development skills, have demonstrable exposure to multiple toolsets and technologies especially in mobile app development. We require individuals who are team players, have decent communication skills, who think logically and work very hard, are able to work independently in a very employee friendly and flexible work environment, and, most important, are eager to learn. This is a great opportunity for the right person. We don't believe in hiring in large numbers, we are looking for only a few very good people who are great team players. Moreover, this is a place where your opinion will count, and your ideas will translate into reality.
Read more
TRADEJINI
at TRADEJINI
2 recruiters
Prateek Gupta
Posted by Prateek Gupta
Bengaluru (Bangalore)
0 - 2 yrs
₹1L - ₹2L / yr
Graphic Designing
skill iconAdobe Illustrator
Adobe Indesign
cdr
Adobe Photoshop
+1 more
Hello Graphic Designers We are one of the leaders in the broking field, incorporated in the year 2012 by Mr. Kishore Kumar J (CEO) & Mr. Dinesh Kumar M (Managing Director). Our growth over the past years has been predominantly stemming from the referrals of our client base and those of other professionals. The growth of our team has evolved in a similar manner which has scaled our operations from a 6 to 77+ member team, with a turnover of 2000+ crores per day reaching 15250+ customers across 1160+ cities around the Globe. We are currently looking for a Graphic Designer who is passionate towards his work. The individual should not only carry his job duties but also identify and take steps for new scope of improvement in his space.
Read more
zeotap India Pvt Ltd
at zeotap India Pvt Ltd
2 recruiters
Projjol Banerjea
Posted by Projjol Banerjea
Bengaluru (Bangalore)
6 - 10 yrs
₹5L - ₹40L / yr
skill iconPython
Big Data
Hadoop
skill iconScala
Spark
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos