Cutshort logo
Egen Solutions logo
GCP Data Engineer
GCP Data Engineer
Egen Solutions's logo

GCP Data Engineer

Hemavathi Panduri's profile picture
Posted by Hemavathi Panduri
4 - 8 yrs
₹12L - ₹25L / yr
Hyderabad
Skills
skill iconPython
Google Cloud Platform (GCP)
ETL
Apache Airflow

We are looking for a skilled and motivated Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data pipelines. The role involves working with various GCP services, implementing data ingestion and transformation logic, and ensuring data quality and consistency across systems.


Key Responsibilities:

  • Design, develop, test, and maintain scalable ETL data pipelines using Python.
  • Work extensively on Google Cloud Platform (GCP) services such as:
  • Dataflow for real-time and batch data processing
  • Cloud Functions for lightweight serverless compute
  • BigQuery for data warehousing and analytics
  • Cloud Composer for orchestration of data workflows (based on Apache Airflow)
  • Google Cloud Storage (GCS) for managing data at scale
  • IAM for access control and security
  • Cloud Run for containerized applications
  • Perform data ingestion from various sources and apply transformation and cleansing logic to ensure high-quality data delivery.
  • Implement and enforce data quality checks, validation rules, and monitoring.
  • Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver efficient data solutions.
  • Manage version control using GitHub and participate in CI/CD pipeline deployments for data projects.
  • Write complex SQL queries for data extraction and validation from relational databases such as SQL Server, Oracle, or PostgreSQL.
  • Document pipeline designs, data flow diagrams, and operational support procedures.

Required Skills:

  • 4–8 years of hands-on experience in Python for backend or data engineering projects.
  • Strong understanding and working experience with GCP cloud services (especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.).
  • Solid understanding of data pipeline architecture, data integration, and transformation techniques.
  • Experience in working with version control systems like GitHub and knowledge of CI/CD practices.
  • Strong experience in SQL with at least one enterprise database (SQL Server, Oracle, PostgreSQL, etc.).



Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Egen Solutions

Founded :
2009
Type :
Services
Size :
100-1000
Stage :
Profitable

About

We build next-generation cloud-native data platforms and applications. Our clients rely on us to architect and execute next generation technology strategies. From building and migrating to cloud-native data platforms to designing new modern business models.
Read more

Company social profiles

bloglinkedintwitterfacebook

Similar jobs

Ceryneian Partners LLC
Mridu Srivastava
Posted by Mridu Srivastava
Remote, Noida
0 - 4 yrs
₹12L - ₹28L / yr
svelte
skill iconC++
Erlang
skill iconRust
skill iconPython
+2 more

About the Role

At Ceryneian, we’re building a next-generation, research-driven algorithmic trading platform aimed at democratizing access to hedge fund-grade financial analytics. Headquartered in California, Ceryneian is a fintech innovation company dedicated to empowering traders with sophisticated yet accessible tools for quantitative research, strategy development, and execution.

Our flagship platform is currently under development. As a Backend Engineer, you will play a foundational role in designing and building the core trading engine and research infrastructure from the ground up. Your work will focus on developing performance-critical components that power backtesting, real-time strategy execution, and seamless integration with brokers and data providers. You’ll be responsible for bridging core engine logic with Python-based strategy interfaces, supporting a modular system architecture for isolated and scalable strategy execution, and building robust abstractions for data handling and API interactions. This role is central to delivering the reliability, flexibility, and performance that our users will rely on in fast-moving financial markets.

We are a remote-first team and are open to hiring exceptional candidates globally.

Core Tasks

·      Build and maintain the trading engine core for execution, backtesting, and event logging.

·      Develop isolated strategy execution runners to support multi-user, multi-strategy environments.

·      Implement abstraction layers for brokers and market data feeds to offer a unified API experience.

·      Bridge the core engine language with Python strategies using gRPC, ZeroMQ, or similar interop technologies.

·      Implement logic to parse and execute JSON-based strategy DSL from the strategy builder.

·      Design compute-optimized components for multi-asset workflows and scalable backtesting.

·      Capture real-time state, performance metrics, and slippage for both live and simulated runs.

·      Collaborate with infrastructure engineers to support high-availability deployments.

Top Technical Competencies

·      Proficiency in distributed systems, concurrency, and system design.

·      Strong backend/server-side development skills using C++, Rust, C#, Erlang, or Python.

·      Deep understanding of data structures and algorithms with a focus on low-latency performance.

·      Experience with event-driven and messaging-based architectures (e.g., ZeroMQ, Redis Streams).

·      Familiarity with Linux-based environments and system-level performance tuning.

 

Bonus Competencies

·      Understanding of financial markets, asset classes, and algorithmic trading strategies.

·      3–5 years of prior Backend experience.

·      Hands-on experience with backtesting frameworks or financial market simulators.

·      Experience with sandboxed execution environments or paper trading platforms.

·      Advanced knowledge of multithreading, memory optimization, or compiler construction.

·      Educational background from Tier-I or Tier-II institutions with strong computer science fundamentals, a passion for scalable system design, and a drive to build cutting-edge fintech infrastructure.

What We Offer

·      Opportunity to shape the backend architecture of a next-gen fintech startup.

·      A collaborative, technically driven culture.

·      Competitive compensation with performance-based bonuses.

·      Flexible working hours and a remote-friendly environment for candidates across the globe.

·      Exposure to financial modeling, trading infrastructure, and real-time applications.

·      Collaboration with a world-class team from Pomona, UCLA, Harvey Mudd, and Claremont McKenna.

Ideal Candidate

You’re a backend-first thinker who’s obsessed with reliability, latency, and architectural flexibility. You enjoy building scalable systems that transform complex strategy logic into high-performance, real-time trading actions. You think in microseconds, architect for fault tolerance, and build APIs designed for developer extensibility.

 


Read more
Tech logistics solution provider
Tech logistics solution provider
Agency job
via The Hub by Sridevi Viswanathan
Remote, Bengaluru (Bangalore)
3 - 9 yrs
₹14L - ₹20L / yr
skill iconNodeJS (Node.js)
Algorithms
skill iconPython
skill iconJavascript

About Our Client

 

It is a last-mile tech-logistics solution provider for intra-state deliveries based in Bangalore. It offers reliable, affordable, and professional services, structured to serve enterprises.

Our Client aggregates light commercial vehicles for urban logistics and has onboarded 55,000+ truckers on its platform across 14 cities. Our Client works across industry sectors like organized retail, FMCG and e-commerce, distribution and 3PL companies. Some of its clients include Amazon, Flipkart, Bisleri, Vishal Mega Mart, Future Supply Chain, Coca-Cola, Delhivery, and Udaan.

The company offers customized logistics solutions for clients, along with other value-added services such as screened drivers, audited and GPS-enabled vehicles, point-to-point billing, status updates, 24x7 service, and greater efficiency, all at transparent and economical pricing.

Our Client, as a brand, is known as one of the market leaders in the enterprise segment, and first movers to identify and empathize with the underserved urban trucker community, playing a huge role in making them a part of the mainstream economy. This series-B funded tech-logistics company aims to disrupt the primitive $35bn+ urban-logistics industry by leveraging technology and help enterprises to reach consumers faster.

Our Client is India's largest enterprise urban-logistics provider in India, with 55,000+ Light Commercial Vehicles on its platform.

 

Why Our Client?

1) Young Startup growing and well funded.

 

What will I do?

- Designing user flows and converting them into logical entities in the code.

- Integration of user-facing elements developed by front-end developers with server-side logic.

- Designing Database schemas.

- Building reusable code and libraries for future use

- Optimization of the application for maximum speed and scalability

- Implementation of security and data protection

- Design and implementation of data storage solutions

 

What skills should I have?

 

- 3+ years of experience in Backend Development.
- Language: NodeJs
- Additional knowledge of Python will be a plus
- Understanding of microservices architecture.
- User authentication and authorization between multiple systems, servers, and environments
- Integration of multiple data sources and databases into one system

- Management of hosting environment, including database administration and scaling an application to support load changes

- Data migration, transformation, and scripting

- Understanding differences between multiple delivery platforms such as mobile vs desktop, and optimizing output to match the specific platform
- Creating database schemas that represent and support business processes
- Implementing automated testing platforms and unit tests
- Proficient understanding of code versioning tools, such as Git

 

Read more
Curl Analytics
Curl Analytics
Agency job
via wrackle by Naveen Taalanki
Bengaluru (Bangalore)
5 - 12 yrs
₹10L - ₹20L / yr
skill iconJava
Microservices
skill iconSpring Boot
skill iconPython
skill iconDocker
+10 more
Job Description:

We are looking for a qualified team leader to manage our team and provide effective guidance. The lead should be an excellent coder with proficiency and a clear understanding of different aspects of a project. You will be responsible for
supervising, managing, and motivating team members regularly. As a team leader, you will be the contact point for all Interactions with the architect and the team, so You must possess excellent communication skills. You should also be able to act proactively to ensure smooth team operations and effective collaboration.

Who are we looking for?

• Bachelors / Masters in Computer Science or equivalent with at least 7-10 years of professional experience.
●Strong software design and architectural skills in object-oriented and functional programming styles.
• Java 8, Microservices using Spring boot, Spring Cloud, Docker, Kubernetes orchestrator.
• Experience in working with Spring Framework - Spring Boot, Spring REST, Spring Security, Spring Data JPA, OAuth2, hibernate.
• Experience in Reactjs or Angular.
• Experience in RabbitMQ
• Experience in Unit Testing Tools like Junit/TestNG
• Experience in working with SQL & NoSQL databases such as MySQL, Mongo DB.
• Knowledge of CI/CD architecture.
• Knowledge of tools like Jenkins, SonarQube, Maven, Gitlab
• Experience in cloud technologies.
• Team management using Scrum methodologies.
You demonstrate the ability to work in a fast-paced and hyper-growth environment where the requirements are
constantly changing.
• Solid understanding of design patterns, data structures, and advanced programming techniques.
● Must have experience leading a team of at least 8- 10 people.
• Nice to have Python 3.6+, Image and textual data processing technologies.
Read more
Bengaluru (Bangalore)
5 - 8 yrs
Best in industry
skill iconGo Programming (Golang)
skill iconPython
skill iconJava

At F5, we strive to bring a better digital world to life. Our teams empower organizations across the globe to create, secure, and run applications that enhance how we experience our evolving digital world. We are passionate about cybersecurity, from protecting consumers from fraud to enabling companies to focus on innovation.
Everything we do centers around people. That means we obsess over how to make the lives of our customers, and their customers, better. And it means we prioritize a diverse F5 community where each individual can thrive.

F5, Inc. is seeking a Software Engineer III with experience in building highly available and highly scalable services on public cloud like AWS, Azure and GCP. In this role you will help develop networking and security technologies as a service (SaaS) to solve customers’ multi-cloud problem. You will be part of Cloud Orchestration team working on F5 Distributed Cloud platform.

 

Primary Responsibilities 

  • Design and development of highly available and highly scalable services using public cloud and F5 Distributed Cloud services.

  • Understand product requirements related to multi-cloud and propose solutions.

  • Follow software development lifecycle for feature development i.e., design, develop, test and support the features

  • Creating prototypes to validate use cases and get feedback from product team and architects.

  • Work cohesively with geographically distributed team

 

Knowledge, Skills and Abilities

  • Experience in designing and implementing solutions for services in public cloud

  • Experience in developing software in a SaaS environment

  • Extensive hands-on experience in using Infrastructure as code (IsC) tools like terraform (preferred), cloud formation etc

  • Extensive hands-on experience in programming languages such as Golang(preferred), python, Java, Rust

  • Solid understanding of AWS VPC Networking Services like Transit Gateway, Virtual Private Gateway, Direct Connect, Gateway Load balancer, Private link etc.

  • Solid understanding of Azure Networking Services like Virtual Network (Vnet), Express route, Azure load balancers etc

  • Solid understanding of GCP networking services

  • Good understanding and experience in L2 to L7 networking protocols including but not limited to Ethernet, TCP/IP, VLAN, BGP, HTTP

  • Good understanding of container technologies such as Docker, Kubernetes etc.,

  • Working knowledge of CI/CD tools like GitLab, Argo

  • Ability to implement all phases of a development cycle for a software product from understanding requirements, going through design, development and deploy phases

  • Self-motivated and willing to delve into new areas and take on new challenges in a proactive manner

  • Excellent written and verbal communication skills.

 

Qualifications

  • Minimum of 5 years of related experience with a Bachelor's degree in Computer Science/related field 

Read more
Looking for MNC as python web developer for Gurgaon and NCR
Looking for MNC as python web developer for Gurgaon and NCR
Agency job
via Natalie Consultants by Swati Bansal
Gurugram, Delhi, Noida, Ghaziabad, Faridabad
2 - 6 yrs
₹12L - ₹28L / yr
skill iconPython
skill iconDjango
RESTful APIs
Web Development

Requirements

  • Previous working experience as a Python Web Developer for min 2 years.

  • Hands-on experience with Django, Flask, or other Python frameworks.

  • Experience with Design implementation of objects and data models.

  • Working knowledge in JavaScript, HTML5, CSS3.

  • Understanding of CI/CD practices.

  • Familiarity with some ORM (Object Relational Mapper) libraries.

  • Proficient understanding of code versioning tools such as Git, Mercurial, or SVN.

  • Hands-on experience with complex scripts in Python to capture business logic and automate system management tasks.

 

Read more
golden eagle it technologies pvt ltd
Indore
1 - 6 yrs
₹3L - ₹12L / yr
skill iconPython
skill iconDjango
NumPy
pandas
RESTful APIs

Skills/Requirements:

  • Python
  • Django

GEITPL is looking for Python Developer Please find below the JD- 1-6 years Ambitious, hardworking and self-motivated optimistic individual Eager to learn diverse open source technologies and work in dynamic work environment requiring constant learning Good understanding of OOPs concepts Should have clear understanding of classes, functions and data types in Python Knowledge of advanced Python concepts like decorators and memory management Should have knowledge of Django framework and Flask framework Should have working knowledge of ReactJS Good analytical and problem-solving skills with ability to work in groups Good communication skills Fast paced self-learning individual with clear thinking and analytical-logical approach to intellectual work Open source contributions would be considered as a plus point So, if you have 1+ years of experience developing applications with Python Developer, apply today! We will love to talk! Please submit Your complete application with salary expectations

Read more
Emxcel Travel Solutions
at Emxcel Travel Solutions
4 recruiters
Swati Nagal
Posted by Swati Nagal
Pune, Ahmedabad, Bengaluru (Bangalore)
3 - 7 yrs
₹0L - ₹7L / yr
skill iconPython
Odoo (OpenERP)
TensorFlow
skill iconMachine Learning (ML)
skill iconData Science

Responsibilities:

  • Writing reusable, testable, and efficient code
  • Design and implementation of low-latency, high-availability, and performant applications
  • Integration of user-facing elements developed by front-end developers with server side logic
  • Implementation of security and data protection
  • Integration of data storage solutions (may include databases, key-value stores, blob stores, etc.)
  • Expert in Python, with knowledge of at least one Python web framework (such as Django, Flask, etc depending on your technology stack)
  • Familiarity with some ORM (Object Relational Mapper) libraries
  • Able to integrate multiple data sources and databases into one system
  • Understanding of the threading limitations of Python, and multi-process architecture
  • Good understanding of server-side templating languages (such as Jinja 2, Mako, etc depending on your technology stack)
  • Basic understanding of front-end technologies, such as JavaScript, HTML5, and CSS3
  • Understanding of accessibility and security compliance (depending on the specific project)
  • Knowledge of user authentication and authorization between multiple systems, servers, and environments
  • Understanding of fundamental design principles behind a scalable application
  • Familiarity with event-driven programming in Python
  • Understanding of the differences between multiple delivery platforms, such as mobile vs desktop, and optimizing output to match the specific platform
  • Able to create database schemas that represent and support business processes
  • Strong unit test and debugging skills
  • Basic knowledge of machine learning algorithm and libraries like keras, tensorflow, sklearn.
Read more
Affairal
at Affairal
1 video
1 recruiter
Govind Balakrishna
Posted by Govind Balakrishna
Bengaluru (Bangalore)
3 - 15 yrs
₹8L - ₹48L / yr
skill iconJavascript
skill iconPHP
skill iconPython
skill iconNodeJS (Node.js)
skill iconJava
+1 more
Hey Everyone, look forward to talk to you. We are a disruptive start up in fashion marketplace segment working on core personalization.Featured@tech crunch, websummit,voted top 100 start ups from the Asia region by Tech.co& Red herring. We are hiring! Team of Ex-flipkart,intel, myntra, intuit, ibm and others. We look forward to see you onboard in this amazing journey forward. Thanks & Regards Govind Founder/CEO @ Affairal +919972668335/+918904013330 Job Perks Free lunch
Read more
Hyderabad
3 - 5 yrs
₹4L - ₹7L / yr
skill iconJavascript
skill iconPHP
skill iconPython
skill iconRuby on Rails (ROR)
skill iconNodeJS (Node.js)
+2 more
Proxim Quest IT Solutions is looking for a Full Stack Developer- Job Description: 3+ years working with Javascript on either the front-end or the back-end of a web application Significant exposure to Angular development. Experienced and interested in Node.JS or other back-end programming language or framework Proficiency in front-end languages like HTML, CSS, JavaScript, and jQuery Solid understanding of OO and application design particularly as it relates to web development Must be familiar with all stages of the development life cycle including analysis, design, development and support. Exposure to agile approaches is advantageous especially test driven development. Solid understanding of web heuristics and design. If interested, please share the details below: 1. Current CTC 2. Expected CTC 3. Notice Period Job Type: Full-time
Read more
Pepipost
at Pepipost
1 video
2 recruiters
Dibya Prakash
Posted by Dibya Prakash
Mumbai
3 - 7 yrs
₹5L - ₹10L / yr
skill iconJavascript
skill iconPython
skill iconPHP
LAMP Stack
skill iconMongoDB
+2 more
In early 2015, we started Pepipost with a single mission – to help startups and businesses send transactional emails in the most efficient way and at the most disruptive pricing ever. Our mission has never changed. We believe that communication in any business scenario should be free, and this philosophy is at the core of Pepipost. That’s why we came up with a pricing model in which you only pay for emails that are unopened by your customers. The emails that are clicked, opened, or engaged with are free. Forever. We promise. With our reliable and scalable cloud-based email infrastructure, we’ve helped hundreds of businesses send millions of emails every day without any hassle. We follow the best delivery guidelines, protocols, and industry standards to fight against spam and make sure that emails get delivered and reach recipients’ inboxes in the blink of an eye. Pepipost is looking for a design-oriented, risk-taking software engineer who can take initiative and think creatively to solve complex UX/UI and backend application ​problems with the advanced programming skills. This role will complement our hardcore engineering and product team. This individual will be part of a team of evangelists who contributes into both, the tech and the business side of the product. Yes, we really need champs!! Who understands both sides of the world and can directly contribute towards the growth of the company.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos