
We are looking for a skilled and motivated Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data pipelines. The role involves working with various GCP services, implementing data ingestion and transformation logic, and ensuring data quality and consistency across systems.
Key Responsibilities:
- Design, develop, test, and maintain scalable ETL data pipelines using Python.
- Work extensively on Google Cloud Platform (GCP) services such as:
- Dataflow for real-time and batch data processing
- Cloud Functions for lightweight serverless compute
- BigQuery for data warehousing and analytics
- Cloud Composer for orchestration of data workflows (based on Apache Airflow)
- Google Cloud Storage (GCS) for managing data at scale
- IAM for access control and security
- Cloud Run for containerized applications
- Perform data ingestion from various sources and apply transformation and cleansing logic to ensure high-quality data delivery.
- Implement and enforce data quality checks, validation rules, and monitoring.
- Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver efficient data solutions.
- Manage version control using GitHub and participate in CI/CD pipeline deployments for data projects.
- Write complex SQL queries for data extraction and validation from relational databases such as SQL Server, Oracle, or PostgreSQL.
- Document pipeline designs, data flow diagrams, and operational support procedures.
Required Skills:
- 4–8 years of hands-on experience in Python for backend or data engineering projects.
- Strong understanding and working experience with GCP cloud services (especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.).
- Solid understanding of data pipeline architecture, data integration, and transformation techniques.
- Experience in working with version control systems like GitHub and knowledge of CI/CD practices.
- Strong experience in SQL with at least one enterprise database (SQL Server, Oracle, PostgreSQL, etc.).

About Egen Solutions
About
Similar jobs
Job Title : Senior Python Developer
Experience : 7+ Years
Location : Remote or Hybrid (Gurgaon / Coimbatore / Hyderabad)
Job Summary :
We are looking for a highly skilled and motivated Senior Python Developer to join our dynamic engineering team.
The ideal candidate will have a strong foundation in web application development using Python and related frameworks. A passion for writing clean, scalable code and solving complex technical challenges is essential for success in this role.
Mandatory Skills : Python (3.x), FastAPI or Flask, PostgreSQL or Oracle, ORM, API Microservices, Agile Methodologies, Clean Code Practices.
Required Skills and Qualifications :
- 7+ Years of hands-on experience in Python (3.x) development.
- Strong proficiency in FastAPI or Flask frameworks.
- Experience with relational databases like PostgreSQL, Oracle, or similar, along with ORM tools.
- Demonstrated experience in building and maintaining API-based microservices.
- Solid grasp of Agile development methodologies and version control practices.
- Strong analytical and problem-solving skills.
- Ability to write clean, maintainable, and well-documented code.
Nice to Have :
- Experience with Google Cloud Platform (GCP) or other cloud providers.
- Exposure to Kubernetes and container orchestration tools.
Job Description:
Required skills and qualifications
- 3+ years of experience as a Python Developer with a strong portfolio of projects.
- hands on exp in react.js
- Bachelor's degree in Computer Science, Software Engineering or a related field.
- In-depth understanding of the Python software development stacks, ecosystems, frameworks and tools such as Numpy, Scipy, Pandas, Dask, spaCy, NLTK, sci-kit-learn and PyTorch.
- Experience with front-end development using Angular.js HTML, CSS, and JavaScript.
- Familiarity with database technologies such as SQL and NoSQL.
- Excellent problem-solving ability with solid communication and collaboration skills.
Preferred skills and qualifications
- Experience with popular Python frameworks such as Django, Flask or Pyramid.
- Knowledge of data science and machine learning concepts and tools.
- A working understanding of cloud platforms such as AWS, Google Cloud or Azure.
- Contributions to open-source Python projects or active involvement in the Python community.
Position: Backend Developer
Organization: A Funded global healthcare platform connecting doctors, thereby enabling exchange of information on a quick and real time basis, founded in the year 2013.Currently there are 3 lakh doctors using this platform and everyday there are 400 new doctors joining it.
The platform promotes exchange of viewpoints, ideas, and information on various medical practices amongst healthcare professionals. This saves both time and money as solutions to several health issues can be accessed on a real time basis. There are 1.3 million registered doctors and 400+ daily publications on its platform and they operate across 16+countries.
Roles & Responsibilities
You’re Awesome At -
- Have strong experience in Python (FLASK framework).
- Have a Deep understanding of how RESTful APIs work.
- Familiar with various design and architectural patterns that can work at scale.
- Sound knowledge of NoSQL/SQL Databases (Mongo DB preferred).
- Strong experience with at-Cloud technology, preferably AWS or GCP, or Azure.
- Core experience in developing complex backend systems.
- Ability to communicate complex technical concepts to both technical and non-technical audiences.
- Passionate about application scalability, availability, reliability, and security.
Your Academic Qualifications -
BE/BTech in Computer Science preferred.
You’ll Be Improving & Responsible For –
- A team that is building products used by 300k + doctors every single day.
- Work on PetaByte Scale Streaming Systems - more than 500 million hours of video have been streamed.
- Lead high volume VOD streaming (think of systems as sophisticated as Netflix and Amazon prime).
- Challenge oneself on Security, Scalability, and Stability
- Maintain code and write automated tests to ensure the product is of the highest quality.
- Reach out to the open-source community to encourage and help implement mission-critical software fixes
Your Experience Across the Years in the Roles You’ve Played -
2-4 Years of experience in Backend Development.
- 3+ years of SDE work experience from Product based companies
- Experience in Java, Spring Boot, MySQL, Kafka, Hbase, AWS
- Experience in Multi threading, distributed systems, Best practices of coding, scaling
- At TailNode, we are at the bleeding edge of this change.
- We conceptualize and develop products that are aimed to enable this transformation of the political architecture of the country.
- We leverage the best practices and insights of the technology world and apply them in our unique way to deliver impact on a massive scale.
- We want to offer you a once-in-a-lifetime opportunity to be a part of this massive change and build new and exciting products with us.
Responsibilities :
- Designing, building, and maintaining high performance, reusable, scalable and robust services and applications
- Developing and managing databases and reporting tools
- Building intelligent messaging bots using web APIs
- Designing and developing robust RESTful APIs and other interfaces
- Integrating data storage solutions.
Required Skills :
- Ability to write clean, structured code in Ruby/Python with documentation.
- Proficiency in at least one Ruby frameworks (Ruby on Rails or Sinatra) or Python framework (Django or Flask)
- Clear understanding of Data Structures and Algorithms.
- Ability to write well defined test cases using Minitest, RSpec or Unit testing framework.
- Experience in one of the following database technologies - MySQL, PostgreSQL, MongoDB, Cassandra.
- Proficiency in working with complex SQL queries.
- Knowledge of design patterns, architectural best practices.
- Familiarity with RESTful web services.
- Knowledge of version control tools like Git, SVN etc.
- Working experience with Cloud Services like Amazon Web Services or Google Cloud is a plus.
Required Qualifications :
- A Bachelors or a Masters degree in Computer Science or relevant field.
- Experience of 3-5 years in software development.
Note : Other language candidates may apply only if they're expecting to work primarily on Ruby/Python.
Worked in Python Flask framework / or similarhttps://anuntatech.turbohire.co/jobdescription/3a6dd0d3-75f4-49b7-9378-0b2b336cec36?utm_source=CareerPage">Django building REST APIs.
Worked in Linux Environment.
Would be an advantage if they have Domain knowledge in Virtualization Or Cloud platformshttps://anuntatech.turbohire.co/jobdescription/3a6dd0d3-75f4-49b7-9378-0b2b336cec36?utm_source=CareerPage">Azure, AWS, or Computer networking.
It is added advantage to have C++ Application programming.
- 0-3 application development experience in solution building on Blockchain technology.
- Solid understanding of and experience in blockchain / distributed ledger technologies familiarity with platforms, such as Ethereum and Hyperledger.
- Any additional expertise with Python, containerization (Docker) and additional Cloud exposure also a huge plus
- Security Architecture / Cryptography is a plus.
- Any additional expertise with Python, containerization (Docker) and additional Cloud exposure also a huge plus.
- Experience on development tools such as Hyperledger Fabric/Sawtooth,Geth , Composer, Solidity Remix Functional
- Basic understanding of Web applications architecture and protocols.











