
We are looking for a skilled and motivated Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data pipelines. The role involves working with various GCP services, implementing data ingestion and transformation logic, and ensuring data quality and consistency across systems.
Key Responsibilities:
- Design, develop, test, and maintain scalable ETL data pipelines using Python.
- Work extensively on Google Cloud Platform (GCP) services such as:
- Dataflow for real-time and batch data processing
- Cloud Functions for lightweight serverless compute
- BigQuery for data warehousing and analytics
- Cloud Composer for orchestration of data workflows (based on Apache Airflow)
- Google Cloud Storage (GCS) for managing data at scale
- IAM for access control and security
- Cloud Run for containerized applications
- Perform data ingestion from various sources and apply transformation and cleansing logic to ensure high-quality data delivery.
- Implement and enforce data quality checks, validation rules, and monitoring.
- Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver efficient data solutions.
- Manage version control using GitHub and participate in CI/CD pipeline deployments for data projects.
- Write complex SQL queries for data extraction and validation from relational databases such as SQL Server, Oracle, or PostgreSQL.
- Document pipeline designs, data flow diagrams, and operational support procedures.
Required Skills:
- 4–8 years of hands-on experience in Python for backend or data engineering projects.
- Strong understanding and working experience with GCP cloud services (especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.).
- Solid understanding of data pipeline architecture, data integration, and transformation techniques.
- Experience in working with version control systems like GitHub and knowledge of CI/CD practices.
- Strong experience in SQL with at least one enterprise database (SQL Server, Oracle, PostgreSQL, etc.).

About Egen Solutions
About
Similar jobs
Strong Software Engineer, Engineering Manager Profiles
Mandatory (Experience) – Must have minimum 4+ years of hands on experience in software development
Mandatory (Tech Skillset) – Must have 3+ years of hands-on experience in backend development using Java / Node.js / Go / Python (any 1) OR 3+ YOE in frontend Development using React / Angular / Vue (any 1)
Mandatory (Mentoring Skillset) – Must have at least 1+ year of experience leading or mentoring a team of software engineers.
Mandatory (Tech Skills) – Must have a solid understanding of microservices architecture, APIs, and cloud platforms (AWS / GCP / Azure).
Mandatory (DevOps Skillset) – Must have hands-on experience working with Docker, Kubernetes, and CI/CD pipelines.
Mandatory (Company) – Top-tier/renowned product-based company (preferred Entreprise B2B SaaS)
Mandatory (Education) – Undergraduation from Tier-1 Engineering College (IIT, BITS, IIIT, NSUT, DTU, etc.)
Mandatory (Note): No hire policy from Sprinklr
Procedure is hiring for Drover.
This is not a DevOps/SRE/cloud-migration role — this is a hands-on backend engineering and architecture role where you build the platform powering our hardware at scale.
About Drover
Ranching is getting harder. Increased labor costs and a volatile climate are placing mounting pressure to provide for a growing population. Drover is empowering ranchers to efficiently and sustainably feed the world by making it cheaper and easier to manage livestock, unlock productivity gains, and reduce carbon footprint with rotational grazing. Not only is this a $46B opportunity, you'll be working on a climate solution with the potential for real, meaningful impact.
We use patent-pending low-voltage electrical muscle stimulation (EMS) to steer and contain cows, replacing the need for physical fences or electric shock. We are building something that has never been done before, and we have hundreds of ranches on our waitlist.
Drover is founded by Callum Taylor (ex-Harvard), who comes from 5 generations of ranching, and Samuel Aubin, both of whom grew up in Australian ranching towns and have an intricate understanding of the problem space. We are well-funded and supported by Workshop Ventures, a VC firm with experience in building unicorn IoT companies.
We're looking to assemble a team of exceptional talent with a high eagerness to dive headfirst into understanding the challenges and opportunities within ranching.
About The Role
As our founding cloud engineer, you will be responsible for building and scaling the infrastructure that powers our IoT platform, connecting thousands of devices across ranches nationwide.
Because we are an early-stage startup, you will have high levels of ownership in what you build. You will play a pivotal part in architecting our cloud infrastructure, building robust APIs, and ensuring our systems can scale reliably. We are looking for someone who is excited about solving complex technical challenges at the intersection of IoT, agriculture, and cloud computing.
What You'll Do
- Develop Drover IoT cloud architecture from the ground up (it’s a green field project)
- Design and implement services to support wearable devices, mobile app, and backend API
- Implement data processing and storage pipelines
- Create and maintain Infrastructure-as-Code
- Support the engineering team across all aspects of early-stage development -- after all, this is a startup
Requirements
- 5+ years of experience developing cloud architecture on AWS
- In-depth understanding of various AWS services, especially those related to IoT
- Expertise in cloud-hosted, event-driven, serverless architectures
- Expertise in programming languages suitable for AWS micro-services (eg: TypeScript, Python)
- Experience with networking and socket programming
- Experience with Kubernetes or similar orchestration platforms
- Experience with Infrastructure-as-Code tools (e.g., Terraform, AWS CDK)
- Familiarity with relational databases (PostgreSQL)
- Familiarity with Continuous Integration and Continuous Deployment (CI/CD)
Nice To Have
- Bachelor’s or Master’s degree in Computer Science, Software Engineering, Electrical Engineering, or a related field
About Simpl
The thrill of working at a start-up that is starting to scale massively is something else. Simpl (FinTech startup of the year - 2020) was formed in 2015 by Nitya Sharma, an investment banker from Wall Street and Chaitra Chidanand, a tech executive from the Valley, when they teamed up with a very clear mission - to make money simple, so that people can live well and do amazing things. Simpl is the payment platform for the mobile-first world, and we’re backed by some of the best names in fintech globally (folks who have invested in Visa, Square and Transferwise), and has Joe Saunders, Ex Chairman and CEO of Visa as a board member.
Everyone at Simpl is an internal entrepreneur who is given a lot of bandwidth and resources to create the next breakthrough towards the long term vision of “making money Simpl”. Our first product is a payment platform that lets people buy instantly, anywhere online, and pay later. In the background, Simpl uses big data for credit underwriting, risk and fraud modelling, all without any paperwork, and enables Banks and Non-Bank Financial Companies to access a whole new consumer market.
In place of traditional forms of identification and authentication, Simpl integrates deeply into merchant apps via SDKs and APIs. This allows for more sophisticated forms of authentication that take full advantage of smartphone data and processing power.
--------
We’re looking for polyglot developers who love to code. You should have >3 years of experience building high-quality products. You should have the ability to write clean code and must’ve worked on one of Ruby, NodeJS, Golang or Python
Responsibilities
- Develop new features - build POCs, get feedback, and scale is our default mode
- Building reusable and platform specific components
- Translating designs and wireframes into high-quality code
- Optimizing services for maximum performance
- Ensure faster release cycles by managing distribution over the cloud
Requirements
- Hands-on experience in all aspects of software development - analysis, coding, writing tests, deployment, the works.
- Knowledge of relational databases, SQL, ACID and distributed locking
- Solid OOPS understanding.
- Good exposure to building distributed systems, micro-services architecture.
- Continuous delivery experience
- Exposure to building platforms (not just products) would be a plus
Years of Experience:- 1.5+
Qualification:- BE Computer Engineering/MCA
Industry:- Software
Location:- Andheri
About RecoSense
We are a growing SaaS based data analytics startup at revenue stage with multiple customers. We are looking for Python programmer who can be part of core product team in taking the product forward.
Flexible work timings, Stock options, Architect role to lead the product. Visit http://recosenselabs.com">http://recosenselabs.com.
Requirement: We are looking for a good programmer with following skills:
Sr. python developer
Experience: 2- 5 years
Requirements:
- Mandatory good experience in Python and Mongodb
- Expertise in cloud management
- Proficient in shell scripting
- Expert in modular code writing skills
- Explorative(geek on what's going around technology)
- Worked on Spark, AWS, is plus
- Hands on Postgres
- Experienced on developing a product from scratch to production
- Experience on developing modular backend architecture
Location of Work
We are located in Banashankari 2nd stage, Bangalore. Looking for a full time candidate.
Work hours and location of Work is flexible.
Benefit for Candidate
- Part of the Core Team in the Company
- Growth along with the Company
- Startup culture - Ability to work on best technologies, fast paced and dynamic
- Freedom to work independently.
- Equity incentives for long term interest









