

Egen Solutions
https://egen.solutionsAbout
Jobs at Egen Solutions
The recruiter has not been active on this job recently. You may apply but please expect a delayed response.
We are looking for a skilled and motivated Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data pipelines. The role involves working with various GCP services, implementing data ingestion and transformation logic, and ensuring data quality and consistency across systems.
Key Responsibilities:
- Design, develop, test, and maintain scalable ETL data pipelines using Python.
- Work extensively on Google Cloud Platform (GCP) services such as:
- Dataflow for real-time and batch data processing
- Cloud Functions for lightweight serverless compute
- BigQuery for data warehousing and analytics
- Cloud Composer for orchestration of data workflows (based on Apache Airflow)
- Google Cloud Storage (GCS) for managing data at scale
- IAM for access control and security
- Cloud Run for containerized applications
- Perform data ingestion from various sources and apply transformation and cleansing logic to ensure high-quality data delivery.
- Implement and enforce data quality checks, validation rules, and monitoring.
- Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver efficient data solutions.
- Manage version control using GitHub and participate in CI/CD pipeline deployments for data projects.
- Write complex SQL queries for data extraction and validation from relational databases such as SQL Server, Oracle, or PostgreSQL.
- Document pipeline designs, data flow diagrams, and operational support procedures.
Required Skills:
- 4–8 years of hands-on experience in Python for backend or data engineering projects.
- Strong understanding and working experience with GCP cloud services (especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.).
- Solid understanding of data pipeline architecture, data integration, and transformation techniques.
- Experience in working with version control systems like GitHub and knowledge of CI/CD practices.
- Strong experience in SQL with at least one enterprise database (SQL Server, Oracle, PostgreSQL, etc.).
The recruiter has not been active on this job recently. You may apply but please expect a delayed response.
Egen is a data engineering and cloud modernization firm helping industry-leading companies achieve digital breakthroughs and deliver for the future, today. We are catalysts for change who create digital breakthroughs at warp speed. Our team of cloud and data engineering experts are trusted by top clients in pursuit of the extraordinary. An Inc. 5000 Fastest Growing Company 7 times, and recently recognized on the Crain’s Chicago Business Fast 50 list, Egen has also been recognized as a great place to work 3 times.
You will join a team of insatiably curious data engineers, software architects, and product experts who never settle for "good enough". Our Java Platform team's tech stack is based on Java8 (Spring Boot) and RESTful web services. We typically build and deploy applications as cloud-native Kubernetes microservices and integrate with scalable technologies such as Kafka in Docker container environments. Our developers work in an agile process to efficiently deliver high value data driven applications and product packages.
Required Experience:
- Minimum of Bachelor’s Degree or its equivalent in Computer Science, Computer Information Systems, Information Technology and Management, Electrical Engineering or a related field.
- Have experience working and strong understanding of object-oriented programing and cloud technologies
- End to end experience delivering production ready code with Java8, Spring Boot, Spring Data, and API libraries
- Strong experience with unit and integration testing of the Spring Boot APIs.
- Strong understanding and production experience of RESTful API's and microservice architecture.
- Strong understanding of SQL databases and NoSQL databases and experience with writing abstraction layers to communicate with the databases.
Nice to have's (but not required):
- Exposure to Kotlin or other JVM programming languages
- Strong understanding and production experience working with Docker container environments
- Strong understanding and production experience working with Kafka
- Cloud Environments: AWS, GCP or Azure
The recruiter has not been active on this job recently. You may apply but please expect a delayed response.
Egen is a data engineering and cloud modernization firm helping industry-leading companies achieve digital breakthroughs and deliver for the future, today. We are catalysts for change who create digital breakthroughs at warp speed. Our team of cloud and data engineering experts are trusted by top clients in pursuit of the extraordinary. An Inc. 5000 Fastest Growing Company 7 times, and recently recognized on the Crain’s Chicago Business Fast 50 list, Egen has also been recognized as a great place to work 3 times.
You will join a team of insatiably curious data engineers, software architects, and product experts who never settle for "good enough". Our Java Platform team's tech stack is based on Java8 (Spring Boot) and RESTful web services. We typically build and deploy applications as cloud-native Kubernetes microservices and integrate with scalable technologies such as Kafka in Docker container environments. Our developers work in an agile process to efficiently deliver high value data driven applications and product packages.
Required Experience:
- Minimum of Bachelor’s Degree or its equivalent in Computer Science, Computer Information Systems, Information Technology and Management, Electrical Engineering or a related field.
- Have experience working and strong understanding of object-oriented programing and cloud technologies
- End to end experience delivering production ready code with Java8, Spring Boot, Spring Data, and API libraries
- Strong experience with unit and integration testing of the Spring Boot APIs.
- Strong understanding and production experience of RESTful API's and microservice architecture.
- Strong understanding of SQL databases and NoSQL databases and experience with writing abstraction layers to communicate with the databases.
Nice to have's (but not required):
- Exposure to Kotlin or other JVM programming languages
- Strong understanding and production experience working with Docker container environments
- Strong understanding and production experience working with Kafka
- Cloud Environments: AWS, GCP or Azure
Similar companies
About the company
Bidgely is an energy-intelligence company founded in 2011. They specialise in turning smart-meter and utility data into actionable insights via their platform UtilityAI™. Their goal: help utilities (electric, gas, water) personalise customer engagement, modernise grids, enable EV charging, distributed energy resources—all while lowering operating cost and improving efficiency. They work globally (North America, Europe, Asia Pacific) and are in a growth/scale-up phase.
Bidgely holds 17+ patents and has raised over $50M in funding. Our team of 30+ data scientists and 150+ engineers brings a shared passion for using AI to revolutionize how the world consumes energy.
As energy usage evolves, our platform is scaling fast — growing from 700 billion to trillions of data points processed. Headquartered in Silicon Valley with hubs in India and Europe, Bidgely blends the agility of a scale-up with the impact of a global clean-energy leader.
Our India Development Center is the heart of innovation, driving data science, technology, and product delivery for customers worldwide.
Jobs
2
About the company
Virtana’s AI-powered platform delivers the deepest hybrid infrastructure observability, empowering you to optimize performance, reduce costs, and mitigate risks.
Founded in 2008, more than 150 Global 2000 enterprise customers such as AstraZeneca, Dell, Apple, Geico, Costco, Nasdaq, and Boeing, have long valued Virtana's software solutions. With advanced AI-powered capabilities, Virtana helps IT teams proactively address issues, streamline operations, and transform infrastructure into strategic assets in today's rapidly evolving digital landscape.
In 2023 Virtana Corp. was named:
- Top 20 Coolest Cloud Monitoring Companies (Cloud 100) by CRN.
- Best Place to Work in the Bay Area by Comparably.
- In eight Gartner® reports for innovation in Infrastructure Monitoring and Artificial Intelligence for IT Operations (AIOps).
💰 Funding details
In the most recent funding round, Virtana raised $73 million in Series C funding in January 2022, led by Atalaya Capital Management and Elm Park Capital Management, among others. Virtana has raised a total of $192.42 million so far!
Jobs
8
About the company
Jobs
4
About the company
Quantiphi is an award-winning AI-first digital engineering company driven by the desire to reimagine and realize transformational opportunities at the heart of the business. Since its inception in 2013, Quantiphi has solved the toughest and most complex business problems by combining deep industry experience, disciplined cloud, and data-engineering practices, and cutting-edge artificial intelligence research to achieve accelerated and quantifiable business results.
Jobs
3
About the company
Sim Gems Group is a leading diamond manufacturer, miner, wholesaler, and distributor of natural diamonds. Established in 1993, the company is dedicated to providing customers with cut and polished stones of the highest quality and unmatched brilliance. They focus on ethical sourcing, following the Kimberley Process Certification Scheme, and prioritize sustainable practices in their operations.
Jobs
3
About the company
We help companies of all sizes from Startups to Unicorns in building and deploying scalable, future-ready solutions.
Jobs
2
About the company
Jobs
514
About the company
Jobs
1
About the company
SimplyFI is a secure digital marketplace developed to provide both liquidity and efficiency in the import-export supply chain. SimplyFI is a B2B marketplace and one single source for both supply chain finance and trade services, powered by cutting-edge cryptography, which ensures both data privacy and auditability in real time.
SimplyFI is built on enterprise-grade Blockchain Technology to support global trade deals with the infrastructure needed to participate with a highly available and highly scalable network where trade services, which include financial, shipping, and insurance services, quality services, etc., can interoperate and collaborate in a secure way.
We also specialize in delivering end-to-end solutions for the smart connected world through IOT and AI technologies. We uncover new ways of harnessing data and generate insights to create a more holistic and better user experience with our products.
Jobs
5
About the company
Jobs
3







