GCP Data Engineer at Egen Solutions · Hyderabad · 4 - 8 years · ₹12L - ₹25L / yr · Profitable · Posted 11 Aug 2025

We are looking for a skilled and motivated Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data pipelines. The role involves working with various GCP services, implementing data ingestion and transformation logic, and ensuring data quality and consistency across systems.
Key Responsibilities:
- Design, develop, test, and maintain scalable ETL data pipelines using Python.
- Work extensively on Google Cloud Platform (GCP) services such as:
- Dataflow for real-time and batch data processing
- Cloud Functions for lightweight serverless compute
- BigQuery for data warehousing and analytics
- Cloud Composer for orchestration of data workflows (based on Apache Airflow)
- Google Cloud Storage (GCS) for managing data at scale
- IAM for access control and security
- Cloud Run for containerized applications
- Perform data ingestion from various sources and apply transformation and cleansing logic to ensure high-quality data delivery.
- Implement and enforce data quality checks, validation rules, and monitoring.
- Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver efficient data solutions.
- Manage version control using GitHub and participate in CI/CD pipeline deployments for data projects.
- Write complex SQL queries for data extraction and validation from relational databases such as SQL Server, Oracle, or PostgreSQL.
- Document pipeline designs, data flow diagrams, and operational support procedures.
Required Skills:
- 4–8 years of hands-on experience in Python for backend or data engineering projects.
- Strong understanding and working experience with GCP cloud services (especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.).
- Solid understanding of data pipeline architecture, data integration, and transformation techniques.
- Experience in working with version control systems like GitHub and knowledge of CI/CD practices.
- Strong experience in SQL with at least one enterprise database (SQL Server, Oracle, PostgreSQL, etc.).

About Egen Solutions
About
Similar jobs (10)
Job Title : Senior Python Scripting Engineer (Testing)
Experience : 7 to 8 Years
Location : Bangalore
Employment Type : Full-Time
Job Overview :
- We are looking for a Senior Python Scripting Engineer with 4 to 5 Years of advanced Python scripting experience and 2 years of testing experience.
- The ideal candidate will be responsible for developing robust automation scripts, ensuring software quality, and collaborating with cross-functional teams to enhance product reliability.
Key Responsibilities :
- Develop and maintain advanced Python scripts for automation and software development.
- Design, implement, and execute test cases, automation scripts, and testing frameworks to ensure software quality.
- Collaborate with developers and QA teams to identify and resolve software defects.
- Optimize existing scripts and test cases to improve efficiency and accuracy.
- Work on test automation, debugging, and continuous integration pipelines.
- Maintain clear documentation for scripts, test cases, and processes.
Required Skills & Qualifications :
- 7 to 8 Years of overall experience in software development/testing.
- 4 to 5 Years of strong hands-on experience in Python scripting (Advanced Level).
- 2 Years of experience in Software Testing (manual and automation).
- Experience with test automation frameworks like PyTest, Selenium, or Robot Framework.
- Proficiency in debugging, troubleshooting, and optimizing scripts.
- Knowledge of CI/CD pipelines, version control systems (Git), and Agile methodologies.
- Strong problem-solving skills and ability to work in a dynamic environment.
Preferred Skills :
- Experience with cloud platforms (AWS, Azure, or GCP).
- Exposure to performance testing and security testing.
- Familiarity with DevOps practices and containerization (Docker, Kubernetes).
Job Description: Python-Azure AI Developer
Experience: 5+ years
Locations: Bangalore | Pune | Chennai | Jaipur | Hyderabad | Gurgaon | Bhopal
Mandatory Skills:
- Python: Expert-level proficiency with FastAPI/Flask
- Azure Services: Hands-on experience integrating Azure cloud services
- Databases: PostgreSQL, Redis
- AI Expertise: Exposure to Agentic AI technologies, frameworks, or SDKs with strong conceptual understanding
Good to Have:
- Workflow automation tools (n8n or similar)
- Experience with LangChain, AutoGen, or other AI agent frameworks
- Azure OpenAI Service knowledge
Key Responsibilities:
- Develop AI-powered applications using Python and Azure
- Build RESTful APIs with FastAPI/Flask
- Integrate Azure services for AI/ML workloads
- Implement agentic AI solutions
- Database optimization and management
- Workflow automation implementation
At F5, we strive to bring a better digital world to life. Our teams empower organizations across the globe to create, secure, and run applications that enhance how we experience our evolving digital world. We are passionate about cybersecurity, from protecting consumers from fraud to enabling companies to focus on innovation.
Everything we do centers around people. That means we obsess over how to make the lives of our customers, and their customers, better. And it means we prioritize a diverse F5 community where each individual can thrive.
-
Design, coding, enhancements, and bug fixing in DNS and related areas.
-
Bring up new ideas to improve the day-to-day challenges in the design/functionality.
-
Should be able to provide technical direction to the ongoing and future projects in the team.
-
Keep the product vulnerability free by uplifting/fixing the open issues.
-
Build tools and infrastructure to improve these F5’s components and features.
-
Set an example of software design and development innovation and excellence.
-
Research, investigate and define new areas of technology to enhance existing or new products directions
-
Evaluate performance of products to fine-tune, and refactor the design as per the requirements to scale up.
-
Must have worked in security and related areas.
-
Document software designs via functional specifications and other design documents
-
Conduct presentations internal and external, mentoring the team members
-
May participate in the hiring and onboarding process
-
Collaborate with team members and technical leads
-
Responsible for upholding F5’s Business Code of Ethics and for promptly reporting violations of the Code or other company policies.
Knowledge, Skills and Abilities:
Essential
-
Deep understanding of data structures & algorithm.
-
Expert in C, C++ with hands-on experience
-
Fair understanding of scripting languages Python and JavaScript
-
Expertise in Linux user-level programming and exposure to Linux networking stack.
-
Good understanding on TCP/IP concepts.
-
Proven experience with security standards.
-
Excellent analytical and problem-solving skills.
-
Good understanding of Network security and DNS modules
-
Excellent Understanding of networking technologies and OS internals.
-
Prior experience in leading and delivering project/programs involving multiple teams.
-
Prior experience of leading and mentoring senior engineers to deliver critical projects.
Nice-to-have
-
Prior experience developing DNS and related modules is a Plus.
-
Good understanding of network protocols like TCP, UDP, HTTP, SSL, DNS, FTP etc.
-
Experience with CI/CD (git, pipeline etc.).
Qualifications
-
Requires a minimum of 15+ years of related experience with a Bachelor of Engineering in ECE/Computers or similar years’ experience with ME/MTech in ECE/Computers.
-
Excellent organizational agility and interpersonal skills throughout the organization.
-
Ability to work flexible hours for better collaboration with international teams.
F5 Inc. is an equal opportunity employer and strongly supports diversity in the workplace. The Job Description is intended to be a general representation of the responsibilities and requirements of the job. However, the description may not be all-inclusive, and responsibilities and requirements are subject to change.
Role Description
- We are looking to add a Software Engineer to contribute to the development, upgradation and management of our back end services for our website / PWA / app / chatbot / internal tools.
- You will be part of a lean team with a very steep learning / growth opportunity while working on and exploring some of the cutting edge technologies
- This is a full-time role in Mumbai with flexible working hours (including WFH)
- You will be working closely with the founder and be involved in strategic decisions such as back end architecture, tech stack selection, hiring, etc.
- We have multiple products in the pipeline and we need a strong team player who can contribute shoulder-to-shoulder with the existing team in the software development process.
- CTC offered: upto Rs. 22 Lakhs
What are we looking for in the candidate?
- Must have qualities: logical & independent thinker; problem solver; result oriented; takes ownership; ability to work indepenently with end-to-end output delivery; ability to structure the code (to avoid rework in future)
- Experience in writing production quality code in NodeJS, Python, Java, or Ruby on Rails
- Hands on experience in design web application using ExpressJS, Koa, Django
- Experience in designing and developing REST API. Familiarity with GraphQL is a plus.
- Proficient in dealing with SQL and NoSQL databases like MySQL, PostgreSQL MongoDB, Elasticsearch.
- Experience with in-memory databases like Redis or MemCache; webserver like Apache, Nginx.
- Experience in stress testing and unit testing and familiarity with testing platforms is a plus
- Proven experience in implementing user authentication and authorization in distributed systems.
- Capability to integrate multiple data sources and databases into one system.
- Experience in designing and developing scalable system.
- Working experience with one of the cloud services like GCP, AWS , Digital Ocean, Azure, etc.
- Knowledge of low-code / no-code tools to expedite production is a plus
- Engineering degree; Computer Science preferably + minimum 2 years of work experience as a Back End Engineer (NOTE: Please do not apply if you do not meet this criteria)
- Clear communication, strong inter-personal skills
What can you expect to gain from the role?
- Experience of a lifetime by disrupting the antiquated tech of Real Estate
- Steep learning curve with opportunity to
- Opportunity to generate immense wealth for yourselves from the equity allocation
- A good cash salary
- Standard perks (health insurance, medical benefits etc.)
Hiring Process
- CV screening
- Coding Test
- Technical Interview

Job Brief
Primary Responsibilities:
- Obtaining in-depth understanding of design and implementation of existing software product
- Performing all phases of software engineering including requirements analysis, design, estimation, and development & testing
- Applying innovation and creativity in design and implementation of features
- Designing reusable components, frameworks and libraries
- Troubleshooting production support issues post-deployment and come up with solutions as required
- Follow the processes defined by the project manager and the organization
General Requirements
- 2+ years of experience in full-stack development in python based technologies.
- Experienced in relational database technologies
- Good in data structures and algorithms
- Good written and verbal communication skills
- Self motivated and willing to learn new technologies
- Experience in AWS cloud technologies is plus
Technologies
- Python, Django
- Angular
- JavaScript, HTML, CSS technologies
- Must understand AJAX and REST
Location: Bangalore
We are looking for the right Backend Developer.
What you will work on Build a scalable API platform that will enhance our customer experience & propel our logistics. You will be part of our Bangalore team of ambitious and talented engineers, who put their best together to build architecturally sound & scalable systems.
What can CasaOne promise you –
An opportunity to - increase your rate of learning exponentially by defining hard problems and solving them - partake in a high-growth journey and increase revenues 5x+ Y-o-Y - be an early innovator in the shifting trend: ‘ownership economy’ -> ‘access economy’ - build a category-defining platform for FF&E (Furniture, Fixture, and Equipment) leasing - build high-performance teams
The must-haves
• Bachelor’s or Master’s degree in engineering
• Good understanding of algorithms, data structures & design patterns
• A minimum of 4 years of work experience Experience required in
• Building distributed systems & service-oriented architecture
• Asynchronous programming, Test Driven Development (TDD)
• Writing (delightful) APIs & integration patterns
• RDBMS & NoSql databases
• Continuous integration & deployment (CI/CD) tools like git, Jenkins
• Cloud computing platforms - AWS/ Azure/ Google Cloud
Good to know CasaOne backend services are written in NodeJS. Experience in NodeJS will be handy, but it isn’t mandatory.








