Cutshort logo
Egen Solutions logo
GCP Data Engineer
GCP Data Engineer
Egen Solutions's logo

GCP Data Engineer

Hemavathi Panduri's profile picture
Posted by Hemavathi Panduri
4 - 8 yrs
₹12L - ₹25L / yr
Hyderabad
Skills
skill iconPython
Google Cloud Platform (GCP)
ETL
Apache Airflow

We are looking for a skilled and motivated Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data pipelines. The role involves working with various GCP services, implementing data ingestion and transformation logic, and ensuring data quality and consistency across systems.


Key Responsibilities:

  • Design, develop, test, and maintain scalable ETL data pipelines using Python.
  • Work extensively on Google Cloud Platform (GCP) services such as:
  • Dataflow for real-time and batch data processing
  • Cloud Functions for lightweight serverless compute
  • BigQuery for data warehousing and analytics
  • Cloud Composer for orchestration of data workflows (based on Apache Airflow)
  • Google Cloud Storage (GCS) for managing data at scale
  • IAM for access control and security
  • Cloud Run for containerized applications
  • Perform data ingestion from various sources and apply transformation and cleansing logic to ensure high-quality data delivery.
  • Implement and enforce data quality checks, validation rules, and monitoring.
  • Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver efficient data solutions.
  • Manage version control using GitHub and participate in CI/CD pipeline deployments for data projects.
  • Write complex SQL queries for data extraction and validation from relational databases such as SQL Server, Oracle, or PostgreSQL.
  • Document pipeline designs, data flow diagrams, and operational support procedures.

Required Skills:

  • 4–8 years of hands-on experience in Python for backend or data engineering projects.
  • Strong understanding and working experience with GCP cloud services (especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.).
  • Solid understanding of data pipeline architecture, data integration, and transformation techniques.
  • Experience in working with version control systems like GitHub and knowledge of CI/CD practices.
  • Strong experience in SQL with at least one enterprise database (SQL Server, Oracle, PostgreSQL, etc.).



Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Egen Solutions

Founded :
2009
Type :
Services
Size :
100-1000
Stage :
Profitable

About

We build next-generation cloud-native data platforms and applications. Our clients rely on us to architect and execute next generation technology strategies. From building and migrating to cloud-native data platforms to designing new modern business models.
Read more

Company social profiles

bloglinkedintwitterfacebook

Similar jobs

NeoGenCode Technologies Pvt Ltd
Gurugram
3 - 6 yrs
₹2L - ₹12L / yr
skill iconPython
skill iconDjango
skill iconPostgreSQL
Payment gateways
skill iconRedis
+16 more

Job Title : Python Django Developer

Experience : 3+ Years

Location : Gurgaon Sector - 48

Working Days : 6 Days WFO (Monday to Saturday)


Job Summary :

We are looking for a skilled Python Django Developer with strong foundational knowledge in backend development, data structures, and operating system concepts.

The ideal candidate should have experience in Django and PostgreSQL, along with excellent logical thinking and multithreading knowledge.


Main Technical Skills : Python, Django (or Flask), PostgreSQL/MySQL, SQL & NoSQL ORM, Microservice Architecture, Third-party API integrations (e.g., payment gateways, SMS/email APIs), REST API development, JSON/XML, strong knowledge of data structures, multithreading, and OS concepts.


Key Responsibilities :

  • Write efficient, reusable, testable, and scalable code using the Django framework
  • Develop backend components, server-side logic, and statistical models
  • Design and implement high-availability, low-latency applications with robust data protection and security
  • Contribute to the development of highly responsive web applications
  • Collaborate with cross-functional teams on system design and integration

Mandatory Skills :

  • Strong programming skills in Python and Django (or similar frameworks like Flask).
  • Proficiency with PostgreSQL / MySQL and experience in writing complex queries.
  • Strong understanding of SQL and NoSQL ORM.
  • Solid grasp of data structures, multithreading, and operating system concepts.
  • Experience with RESTful API development and implementation of API security.
  • Knowledge of JSON/XML and their use in data exchange.

Good-to-Have Skills :

  • Experience with Redis, MQTT, and message queues like RabbitMQ or Kafka.
  • Understanding of microservice architecture and third-party API integrations (e.g., payment gateways, SMS/email APIs).
  • Familiarity with MongoDB and other NoSQL databases.
  • Exposure to data science libraries such as Pandas, NumPy, Scikit-learn.
  • Knowledge in building and integrating statistical learning models.
Read more
Deqode
at Deqode
1 recruiter
Sneha Jain
Posted by Sneha Jain
Bengaluru (Bangalore), Mumbai, Delhi, Gurugram, Noida, Ghaziabad, Faridabad, Pune, Hyderabad
3.5 - 9 yrs
₹3L - ₹13L / yr
skill iconPython
skill iconAmazon Web Services (AWS)
AWS Lambda
skill iconDjango
Amazon S3

Job Summary:

We are looking for a skilled and motivated Python AWS Engineer to join our team. The ideal candidate will have strong experience in backend development using Python, cloud infrastructure on AWS, and building serverless or microservices-based architectures. You will work closely with cross-functional teams to design, develop, deploy, and maintain scalable and secure applications in the cloud.

Key Responsibilities:

  • Develop and maintain backend applications using Python and frameworks like Django or Flask
  • Design and implement serverless solutions using AWS Lambda, API Gateway, and other AWS services
  • Develop data processing pipelines using services such as AWS Glue, Step Functions, S3, DynamoDB, and RDS
  • Write clean, efficient, and testable code following best practices
  • Implement CI/CD pipelines using tools like CodePipeline, GitHub Actions, or Jenkins
  • Monitor and optimize system performance and troubleshoot production issues
  • Collaborate with DevOps and front-end teams to integrate APIs and cloud-native services
  • Maintain and improve application security and compliance with industry standards

Required Skills:

  • Strong programming skills in Python
  • Solid understanding of AWS cloud services (Lambda, S3, EC2, DynamoDB, RDS, IAM, API Gateway, CloudWatch, etc.)
  • Experience with infrastructure as code (e.g., CloudFormation, Terraform, or AWS CDK)
  • Good understanding of RESTful API design and microservices architecture
  • Hands-on experience with CI/CD, Git, and version control systems
  • Familiarity with containerization (Docker, ECS, or EKS) is a plus
  • Strong problem-solving and communication skills

Preferred Qualifications:

  • Experience with PySpark, Pandas, or data engineering tools
  • Working knowledge of Django, Flask, or other Python frameworks
  • AWS Certification (e.g., AWS Certified Developer – Associate) is a plus

Educational Qualification:

  • Bachelor's or Master’s degree in Computer Science, Engineering, or related field


Read more
Nference
Nference
Agency job
via zyoin by Shubha N
Remote, Bengaluru (Bangalore)
4 - 9 yrs
₹20L - ₹50L / yr
skill iconJava
skill iconGo Programming (Golang)
skill iconPython
Must have :
  • 4+ years exp with solid backend/engineering experience.
  • Knowledge of data structures and an eye for architecture.
  • Solid CS fundamentals, fluent in multi-threaded and asynchronous programming, a strong inclination for architecting at scale.
  • Excellent technical design, problem-solving, debugging, and communication skills.
  • Rapid prototyping worked on distributed systems at scale.
  • Basic knowledge of SQL as well as NoSQL databases.
  • Proficient in Golang, it's design, and concurrency patterns.
Read more
Egregore Labs
at Egregore Labs
2 recruiters
Agency job
via InvokHR by Sandeepa Kasala
NCR (Delhi | Gurgaon | Noida)
2 - 6 yrs
₹7L - ₹12L / yr
skill iconPython
SaaS
API
Microsoft Windows Azure
Microservices
+2 more

Company and Founders
Egregore Labs (http://www.egregorelabs.com/" target="_blank">www.egregorelabs.com) is a financial software company founded in 2017 by Prashant Vijay (ISB, Tulane) & Hari Balaji (IIM Ahmedabad, IIT Madras) both of whom have spent over a decade each in Financial Services, with a majority of their experience at Goldman Sachs across New York, Hong Kong & Singapore in roles across Trading, Quant & Technology. More about the founders is available here and here

We operate at the intersection of Unstructured Data and Finance. We run multiple products, including Romulus (http://www.romulus.co/" target="_blank">www.romulus.co) and Robana (http://www.robana.ai/" target="_blank">www.robana.ai) - all our products work on the same underlying principles and set of technologies.


Ideal Background

  • At least 2 years experience in back-end development in a fast-paced environment, working in Python
  • Deep understanding of technologies used in web-deployed SaaS products, including Rest APIs
  • Exposure to AWS, Azure, or other cloud providers
  • Sound understanding of computer science principles
  • Exposure to any of the following
    • Financial services
    • Natural Language Processing
    • Robotic Process Automation
    • Intelligent Document Processing
    • Document Management and Repositories

Opportunity
We will share our workload as a team and we expect you to work on a broad range of tasks. Here’s are some of the things you might have to do on any given day:

  • Developing APIs and endpoints for deployments of our product
  • Infrastructure Development such as building databases, creating and maintaining automated jobs
  • Build out the back-end to deploy and scale our product
  • Build POCs for client deployments
  • Integrate our products with 3rd party products/tools/services
  • Document your code, write test cases, etc.

Skills

  • Hands-on experience with Python (2+ years)
  • Sound understanding of Postgres and NoSQL databases such as MongoDB
  • Deep familiarity with UNIX, major cloud platforms (AWS, Azure), DevOps
  • Understanding of databases, and related tools, paradigms
  • A computer science education would be great, but other engineering disciplines are ok as well

Desirables
We are looking for a person who has :

  • Resourcefulness- - we're looking for versatile developers who are good at figuring out what they need to use, learn, build, re-purpose to get the job done quickly and efficiently.
  • Ownership- - We like to be directive and not prescriptive in our management. We- d love for you to take ownership of what you work on, and tell us what to do, rather than the other way round.
  • Work Ethic- - We've grown up on Wall Street. We work hard and have aggressive goals. We want our teammates to be focused, goal-oriented, and consistent high achievers.
  • Execution Focus- - Our business is about getting things done and getting things done right. We want outcome-focused colleagues who can multi-task, and execute quickly and elegantly.

Interested?
We are an early-stage company. Working here is not for the faint-hearted. An intense and unstructured work environment, lots of excitement, and a group of motivated colleagues are what we bring to the table. We ask you to bring your undivided attention, strong worth ethic & resourcefulness. We are Delhi-based and work 6 days a week. Currently, due to the pandemic, we are operating remotely since Feb 2020.

Read more
KAFQA
KAFQA
Agency job
via InvokHR by Sandeepa Kasala
Bengaluru (Bangalore)
1 - 6 yrs
₹8L - ₹11L / yr
skill iconPython
skill iconPostgreSQL
skill iconMongoDB
skill iconAmazon Web Services (AWS)
skill iconDjango

About KAFQA

At Kafqa, we are building the next generation performing arts platform. Our mission is to transform how India learns, performs & watchers performing arts. We are currently in stealth mode with a target public launch date in April. Our launch services consist of technology enabled dance classes in our proprietary studios, production facilities and social media broadcasting & competitions.

Founder & Team

The founder is Shariq Plasticwala. He is a graduate of IIT Bombay & Stanford GSB. He was part of the founding team of Amazon India where he played a key role for over 8 years. Among his roles at Amazon, he was the CEO of Amazon’s first joint venture in India and a Board Member of Amazon’s payments business. The other members of the founding team consist of senior executives from Shiamak Davar & Byju’s.

Background

  • At least 1+ years’ experience in back-end development in a fast-paced environment, working in Python & Django Framework
  • Deep understanding of technologies used in web-deployed SaaS products, including Rest APIs
  • Exposure to AWS, Azure or other cloud providers

 

Opportunity


We will share our workload as a team and we expect you to work on a broad range of tasks. Here’s are some of the things you might have to do on any given day:

  • Developing APIs and endpoints for deployments of our product
  • Infrastructure Development such as building databases, creating and maintaining automated jobs
  • Build out the back-end to deploy and scale our product
  • Build POCs for client deployments
  • Document your code, write test cases, etc.

 

Skills

  • Hands-on experience with Python (1+ years)
  • Sound understanding of Postgres and NoSQL databases such as MongoDB
  • Deep familiarity with UNIX, major cloud platforms (AWS, Azure), DevOps
  • Understanding of databases, and related tools, paradigms

 

Read more
marsdevs.com
Vishvajit Pathak
Posted by Vishvajit Pathak
Remote, Pune
2 - 5 yrs
₹4L - ₹15L / yr
skill iconDjango
skill iconFlask
FastAPI
skill iconPython
skill iconDocker
+3 more

We are having an immediate requirement for a Python web developer.

 

You have:

  • At least 2 years of experience developing web applications with Django/Flask/FastAPI
  • Familiarity with Linux
  • Experience in both SQL and NoSQL databases.
  • Uses Docker and CI/CD
  • Writes tests
  • Experienced in application deployments and scaling them on AWS or GCP

 

You are:

  • Eager to work independently without being watched
  • Easy going.
  • Able to handle clients on your own

 

Location: Remote (in India)

 

Read more
Gamma Networks Inc.
at Gamma Networks Inc.
1 recruiter
Nikhil Garg
Posted by Nikhil Garg
NCR (Delhi | Gurgaon | Noida)
3 - 7 yrs
₹25L - ₹50L / yr
skill iconPython
Software architecture
RESTful APIs
Relational Database (RDBMS)
skill iconDocker
+3 more
Gamma is seeking for a motivated and self-driven senior Fullstack engineer. You’ll be part of a star team from across top institutes (like IITs, Stanford) having industry experience with top silicon valley companies like Google, Coursera and LinkedIn.

You will be building product features solving complex business problems using state of the art technologies (Docker, Kubernetes, GCP, Python, Angular, ML/AI) in an ownership and integrity driven culture.

What will you do:
- Architect full-stack solutions for complex business requirements in a fast-paced environment while optimising for scalability, performance, concurrency, availability, security and code quality.
- Own and execute engineering projects end to end including API design, DB design, project planning, coding, and fluent communication with the rest of the team.

What we’re looking for:
- Bachelors/Masters in Computer Science or a related field
- Experience 3-6 years
- Strong ownership, integrity and drive to succeed individually and as a startup
- Good grasp on algorithms and data structures
Read more
Geospoc geospatial services
smitha Nair
Posted by smitha Nair
Pune, Mumbai
2 - 5 yrs
₹6L - ₹10L / yr
skill iconDjango
skill iconPython
skill iconFlask
Pyramid

GeoSpoc is looking for passionate backend developers who would like to solve complex business problems using location-aware data and cutting-edge tools and technologies such as microservices and cloud platforms such as AWS.

 

General skill

  • A passionate developer with solid understanding of software basics  
  • Always willing to learn and explore upcoming technologies
  • Pro-active, reliable and result oriented
  • Someone who can continuously perform in a fast-paced environment

 

Key Skills Required

  • Write effective, scalable code
  • Develop back-end components to improve responsiveness and overall performance
  • Integrate user-facing elements into applications
  • Test and debug programs
  • Improve functionality of existing systems
  • Implement security and data protection solutions
  • Assess and prioritize feature requests
  • Coordinate with internal teams to understand user requirements and provide technical solutions

 

Skills and Experience

  • Expertise in at least one popular Python framework (like Django, Flask or Pyramid)
  • Knowledge of object-relational mapping (ORM)
  • Familiarity with front-end technologies (like JavaScript and HTML5)

 

Responsibilities

  • Writing and testing code, debugging programs and integrating applications with third-party web services
  • Work closely with small teams of designers, frontend developers, GIS experts as well as business stakeholders
  • Own the development lifecycle of backend systems from design to deployment
  • Go above and beyond to deliver great quality software solutions on time
Read more
Doctor Insta
at Doctor Insta
3 recruiters
Ruchika Chauhan
Posted by Ruchika Chauhan
NCR (Delhi | Gurgaon | Noida)
2 - 7 yrs
₹7L - ₹12L / yr
skill iconAngularJS (1.x)
skill iconHTML/CSS
skill iconJava
skill iconPython
skill iconJavascript
+4 more
Skills Required: 1. Hands on experience with Python, Django, Databases like MySQL 2. Hands-on software development, team management and project management experience. 3. Experience with Cloud technologies like AWS, CI/CD Processes 4. Good understanding of HTML, CSS, JAVA Script, Angular JS 5. Data structure and implementing optimized algorithms 6. Experience using code versioning systems like SVN, GIT is desirable 7. Additional Qualifications –node.js, npm, NoSQL (Redis) 8. Quick Learner, Creative Problem Solver and Resourceful Education Qualifications: BTech/ BE
Read more
Heartface
at Heartface
1 video
1 recruiter
Urvesh Vasani
Posted by Urvesh Vasani
Mumbai
3 - 7 yrs
₹6L - ₹12L / yr
0360
skill iconPython
skill iconDjango
MySQL
Heartface is a social video platform for shoppers. We believe shopping online should be a fun and interactive experience. Our product lets people watch and share videos of the things they love - hauls, unboxings and reviews are only a start to a future the world experiences (window) shopping in an incredibly fun way. We are looking for a Software Engineer to join team Heartface. Working from our engineering department in Mumbai, you will play a key role in building and shaping key features that people use every day. What you'll do: Create great user experiences and push the limits of mobile devices. Build fun products Develop new features from the drawing board through implementation and launch Perform code reviews and QA that guarantee code quality Evaluate the tech of every decision Work with a team of unbelievably talented people that love what they do What we're looking for: Really, really, really good software engineers Bachelors degree in a technical field such as computer science (or equivalent years of experience) Strong fundamentals and problem solving skills Hard-working attitude - 40-hour workweeks are a ghost at Heartface! Expert in Python, Web Services, SQL and APIs An individual who cares deeply about building outstanding user experiences Someone who loves a good challenge Someone who loves learning and teaching Someone who's great to work with - we are a bunch of very smart people that love and respect each other. 3+ year experience in developing internet products Plus points: Past experience being an entrepreneuer or founding member of a startup Experience creating and launching internet products Experience with video or social shopping platforms
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos