
We are looking for a skilled and motivated Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data pipelines. The role involves working with various GCP services, implementing data ingestion and transformation logic, and ensuring data quality and consistency across systems.
Key Responsibilities:
- Design, develop, test, and maintain scalable ETL data pipelines using Python.
- Work extensively on Google Cloud Platform (GCP) services such as:
- Dataflow for real-time and batch data processing
- Cloud Functions for lightweight serverless compute
- BigQuery for data warehousing and analytics
- Cloud Composer for orchestration of data workflows (based on Apache Airflow)
- Google Cloud Storage (GCS) for managing data at scale
- IAM for access control and security
- Cloud Run for containerized applications
- Perform data ingestion from various sources and apply transformation and cleansing logic to ensure high-quality data delivery.
- Implement and enforce data quality checks, validation rules, and monitoring.
- Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver efficient data solutions.
- Manage version control using GitHub and participate in CI/CD pipeline deployments for data projects.
- Write complex SQL queries for data extraction and validation from relational databases such as SQL Server, Oracle, or PostgreSQL.
- Document pipeline designs, data flow diagrams, and operational support procedures.
Required Skills:
- 4–8 years of hands-on experience in Python for backend or data engineering projects.
- Strong understanding and working experience with GCP cloud services (especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.).
- Solid understanding of data pipeline architecture, data integration, and transformation techniques.
- Experience in working with version control systems like GitHub and knowledge of CI/CD practices.
- Strong experience in SQL with at least one enterprise database (SQL Server, Oracle, PostgreSQL, etc.).

About Egen Solutions
About
Similar jobs
About the Role
At Ceryneian, we’re building a next-generation, research-driven algorithmic trading platform aimed at democratizing access to hedge fund-grade financial analytics. Headquartered in California, Ceryneian is a fintech innovation company dedicated to empowering traders with sophisticated yet accessible tools for quantitative research, strategy development, and execution.
Our flagship platform is currently under development. As a Backend Engineer, you will play a foundational role in designing and building the core trading engine and research infrastructure from the ground up. Your work will focus on developing performance-critical components that power backtesting, real-time strategy execution, and seamless integration with brokers and data providers. You’ll be responsible for bridging core engine logic with Python-based strategy interfaces, supporting a modular system architecture for isolated and scalable strategy execution, and building robust abstractions for data handling and API interactions. This role is central to delivering the reliability, flexibility, and performance that our users will rely on in fast-moving financial markets.
We are a remote-first team and are open to hiring exceptional candidates globally.
Core Tasks
· Build and maintain the trading engine core for execution, backtesting, and event logging.
· Develop isolated strategy execution runners to support multi-user, multi-strategy environments.
· Implement abstraction layers for brokers and market data feeds to offer a unified API experience.
· Bridge the core engine language with Python strategies using gRPC, ZeroMQ, or similar interop technologies.
· Implement logic to parse and execute JSON-based strategy DSL from the strategy builder.
· Design compute-optimized components for multi-asset workflows and scalable backtesting.
· Capture real-time state, performance metrics, and slippage for both live and simulated runs.
· Collaborate with infrastructure engineers to support high-availability deployments.
Top Technical Competencies
· Proficiency in distributed systems, concurrency, and system design.
· Strong backend/server-side development skills using C++, Rust, C#, Erlang, or Python.
· Deep understanding of data structures and algorithms with a focus on low-latency performance.
· Experience with event-driven and messaging-based architectures (e.g., ZeroMQ, Redis Streams).
· Familiarity with Linux-based environments and system-level performance tuning.
Bonus Competencies
· Understanding of financial markets, asset classes, and algorithmic trading strategies.
· 3–5 years of prior Backend experience.
· Hands-on experience with backtesting frameworks or financial market simulators.
· Experience with sandboxed execution environments or paper trading platforms.
· Advanced knowledge of multithreading, memory optimization, or compiler construction.
· Educational background from Tier-I or Tier-II institutions with strong computer science fundamentals, a passion for scalable system design, and a drive to build cutting-edge fintech infrastructure.
What We Offer
· Opportunity to shape the backend architecture of a next-gen fintech startup.
· A collaborative, technically driven culture.
· Competitive compensation with performance-based bonuses.
· Flexible working hours and a remote-friendly environment for candidates across the globe.
· Exposure to financial modeling, trading infrastructure, and real-time applications.
· Collaboration with a world-class team from Pomona, UCLA, Harvey Mudd, and Claremont McKenna.
Ideal Candidate
You’re a backend-first thinker who’s obsessed with reliability, latency, and architectural flexibility. You enjoy building scalable systems that transform complex strategy logic into high-performance, real-time trading actions. You think in microseconds, architect for fault tolerance, and build APIs designed for developer extensibility.
About Our Client
It is a last-mile tech-logistics solution provider for intra-state deliveries based in Bangalore. It offers reliable, affordable, and professional services, structured to serve enterprises.
Our Client aggregates light commercial vehicles for urban logistics and has onboarded 55,000+ truckers on its platform across 14 cities. Our Client works across industry sectors like organized retail, FMCG and e-commerce, distribution and 3PL companies. Some of its clients include Amazon, Flipkart, Bisleri, Vishal Mega Mart, Future Supply Chain, Coca-Cola, Delhivery, and Udaan.
The company offers customized logistics solutions for clients, along with other value-added services such as screened drivers, audited and GPS-enabled vehicles, point-to-point billing, status updates, 24x7 service, and greater efficiency, all at transparent and economical pricing.
Our Client, as a brand, is known as one of the market leaders in the enterprise segment, and first movers to identify and empathize with the underserved urban trucker community, playing a huge role in making them a part of the mainstream economy. This series-B funded tech-logistics company aims to disrupt the primitive $35bn+ urban-logistics industry by leveraging technology and help enterprises to reach consumers faster.
Our Client is India's largest enterprise urban-logistics provider in India, with 55,000+ Light Commercial Vehicles on its platform.
Why Our Client?
1) Young Startup growing and well funded.
What will I do?
- Designing user flows and converting them into logical entities in the code.
- Integration of user-facing elements developed by front-end developers with server-side logic.
- Designing Database schemas.
- Building reusable code and libraries for future use
- Optimization of the application for maximum speed and scalability
- Implementation of security and data protection
- Design and implementation of data storage solutions
What skills should I have?
- 3+ years of experience in Backend Development.
- Language: NodeJs
- Additional knowledge of Python will be a plus
- Understanding of microservices architecture.
- User authentication and authorization between multiple systems, servers, and environments
- Integration of multiple data sources and databases into one system
- Management of hosting environment, including database administration and scaling an application to support load changes
- Data migration, transformation, and scripting
- Understanding differences between multiple delivery platforms such as mobile vs desktop, and optimizing output to match the specific platform
- Creating database schemas that represent and support business processes
- Implementing automated testing platforms and unit tests
- Proficient understanding of code versioning tools, such as Git
We are looking for a qualified team leader to manage our team and provide effective guidance. The lead should be an excellent coder with proficiency and a clear understanding of different aspects of a project. You will be responsible for
supervising, managing, and motivating team members regularly. As a team leader, you will be the contact point for all Interactions with the architect and the team, so You must possess excellent communication skills. You should also be able to act proactively to ensure smooth team operations and effective collaboration.
Who are we looking for?
• Bachelors / Masters in Computer Science or equivalent with at least 7-10 years of professional experience.
●Strong software design and architectural skills in object-oriented and functional programming styles.
• Java 8, Microservices using Spring boot, Spring Cloud, Docker, Kubernetes orchestrator.
• Experience in working with Spring Framework - Spring Boot, Spring REST, Spring Security, Spring Data JPA, OAuth2, hibernate.
• Experience in Reactjs or Angular.
• Experience in RabbitMQ
• Experience in Unit Testing Tools like Junit/TestNG
• Experience in working with SQL & NoSQL databases such as MySQL, Mongo DB.
• Knowledge of CI/CD architecture.
• Knowledge of tools like Jenkins, SonarQube, Maven, Gitlab
• Experience in cloud technologies.
• Team management using Scrum methodologies.
You demonstrate the ability to work in a fast-paced and hyper-growth environment where the requirements are
constantly changing.
• Solid understanding of design patterns, data structures, and advanced programming techniques.
● Must have experience leading a team of at least 8- 10 people.
• Nice to have Python 3.6+, Image and textual data processing technologies.
At F5, we strive to bring a better digital world to life. Our teams empower organizations across the globe to create, secure, and run applications that enhance how we experience our evolving digital world. We are passionate about cybersecurity, from protecting consumers from fraud to enabling companies to focus on innovation.
Everything we do centers around people. That means we obsess over how to make the lives of our customers, and their customers, better. And it means we prioritize a diverse F5 community where each individual can thrive.
F5, Inc. is seeking a Software Engineer III with experience in building highly available and highly scalable services on public cloud like AWS, Azure and GCP. In this role you will help develop networking and security technologies as a service (SaaS) to solve customers’ multi-cloud problem. You will be part of Cloud Orchestration team working on F5 Distributed Cloud platform.
Primary Responsibilities
-
Design and development of highly available and highly scalable services using public cloud and F5 Distributed Cloud services.
-
Understand product requirements related to multi-cloud and propose solutions.
-
Follow software development lifecycle for feature development i.e., design, develop, test and support the features
-
Creating prototypes to validate use cases and get feedback from product team and architects.
-
Work cohesively with geographically distributed team
Knowledge, Skills and Abilities
-
Experience in designing and implementing solutions for services in public cloud
-
Experience in developing software in a SaaS environment
-
Extensive hands-on experience in using Infrastructure as code (IsC) tools like terraform (preferred), cloud formation etc
-
Extensive hands-on experience in programming languages such as Golang(preferred), python, Java, Rust
-
Solid understanding of AWS VPC Networking Services like Transit Gateway, Virtual Private Gateway, Direct Connect, Gateway Load balancer, Private link etc.
-
Solid understanding of Azure Networking Services like Virtual Network (Vnet), Express route, Azure load balancers etc
-
Solid understanding of GCP networking services
-
Good understanding and experience in L2 to L7 networking protocols including but not limited to Ethernet, TCP/IP, VLAN, BGP, HTTP
-
Good understanding of container technologies such as Docker, Kubernetes etc.,
-
Working knowledge of CI/CD tools like GitLab, Argo
-
Ability to implement all phases of a development cycle for a software product from understanding requirements, going through design, development and deploy phases
-
Self-motivated and willing to delve into new areas and take on new challenges in a proactive manner
-
Excellent written and verbal communication skills.
Qualifications
-
Minimum of 5 years of related experience with a Bachelor's degree in Computer Science/related field

Requirements
-
Previous working experience as a Python Web Developer for min 2 years.
-
Hands-on experience with Django, Flask, or other Python frameworks.
-
Experience with Design implementation of objects and data models.
-
Working knowledge in JavaScript, HTML5, CSS3.
-
Understanding of CI/CD practices.
-
Familiarity with some ORM (Object Relational Mapper) libraries.
-
Proficient understanding of code versioning tools such as Git, Mercurial, or SVN.
-
Hands-on experience with complex scripts in Python to capture business logic and automate system management tasks.
Skills/Requirements:
- Python
- Django
GEITPL is looking for Python Developer Please find below the JD- 1-6 years Ambitious, hardworking and self-motivated optimistic individual Eager to learn diverse open source technologies and work in dynamic work environment requiring constant learning Good understanding of OOPs concepts Should have clear understanding of classes, functions and data types in Python Knowledge of advanced Python concepts like decorators and memory management Should have knowledge of Django framework and Flask framework Should have working knowledge of ReactJS Good analytical and problem-solving skills with ability to work in groups Good communication skills Fast paced self-learning individual with clear thinking and analytical-logical approach to intellectual work Open source contributions would be considered as a plus point So, if you have 1+ years of experience developing applications with Python Developer, apply today! We will love to talk! Please submit Your complete application with salary expectations
Responsibilities:
- Writing reusable, testable, and efficient code
- Design and implementation of low-latency, high-availability, and performant applications
- Integration of user-facing elements developed by front-end developers with server side logic
- Implementation of security and data protection
- Integration of data storage solutions (may include databases, key-value stores, blob stores, etc.)
- Expert in Python, with knowledge of at least one Python web framework (such as Django, Flask, etc depending on your technology stack)
- Familiarity with some ORM (Object Relational Mapper) libraries
- Able to integrate multiple data sources and databases into one system
- Understanding of the threading limitations of Python, and multi-process architecture
- Good understanding of server-side templating languages (such as Jinja 2, Mako, etc depending on your technology stack)
- Basic understanding of front-end technologies, such as JavaScript, HTML5, and CSS3
- Understanding of accessibility and security compliance (depending on the specific project)
- Knowledge of user authentication and authorization between multiple systems, servers, and environments
- Understanding of fundamental design principles behind a scalable application
- Familiarity with event-driven programming in Python
- Understanding of the differences between multiple delivery platforms, such as mobile vs desktop, and optimizing output to match the specific platform
- Able to create database schemas that represent and support business processes
- Strong unit test and debugging skills
- Basic knowledge of machine learning algorithm and libraries like keras, tensorflow, sklearn.






