
We are looking for a skilled and motivated Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data pipelines. The role involves working with various GCP services, implementing data ingestion and transformation logic, and ensuring data quality and consistency across systems.
Key Responsibilities:
- Design, develop, test, and maintain scalable ETL data pipelines using Python.
- Work extensively on Google Cloud Platform (GCP) services such as:
- Dataflow for real-time and batch data processing
- Cloud Functions for lightweight serverless compute
- BigQuery for data warehousing and analytics
- Cloud Composer for orchestration of data workflows (based on Apache Airflow)
- Google Cloud Storage (GCS) for managing data at scale
- IAM for access control and security
- Cloud Run for containerized applications
- Perform data ingestion from various sources and apply transformation and cleansing logic to ensure high-quality data delivery.
- Implement and enforce data quality checks, validation rules, and monitoring.
- Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver efficient data solutions.
- Manage version control using GitHub and participate in CI/CD pipeline deployments for data projects.
- Write complex SQL queries for data extraction and validation from relational databases such as SQL Server, Oracle, or PostgreSQL.
- Document pipeline designs, data flow diagrams, and operational support procedures.
Required Skills:
- 4–8 years of hands-on experience in Python for backend or data engineering projects.
- Strong understanding and working experience with GCP cloud services (especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.).
- Solid understanding of data pipeline architecture, data integration, and transformation techniques.
- Experience in working with version control systems like GitHub and knowledge of CI/CD practices.
- Strong experience in SQL with at least one enterprise database (SQL Server, Oracle, PostgreSQL, etc.).

About Egen Solutions
About
Similar jobs
Job Title : Python Django Developer
Experience : 3+ Years
Location : Gurgaon Sector - 48
Working Days : 6 Days WFO (Monday to Saturday)
Job Summary :
We are looking for a skilled Python Django Developer with strong foundational knowledge in backend development, data structures, and operating system concepts.
The ideal candidate should have experience in Django and PostgreSQL, along with excellent logical thinking and multithreading knowledge.
Main Technical Skills : Python, Django (or Flask), PostgreSQL/MySQL, SQL & NoSQL ORM, Microservice Architecture, Third-party API integrations (e.g., payment gateways, SMS/email APIs), REST API development, JSON/XML, strong knowledge of data structures, multithreading, and OS concepts.
Key Responsibilities :
- Write efficient, reusable, testable, and scalable code using the Django framework
- Develop backend components, server-side logic, and statistical models
- Design and implement high-availability, low-latency applications with robust data protection and security
- Contribute to the development of highly responsive web applications
- Collaborate with cross-functional teams on system design and integration
Mandatory Skills :
- Strong programming skills in Python and Django (or similar frameworks like Flask).
- Proficiency with PostgreSQL / MySQL and experience in writing complex queries.
- Strong understanding of SQL and NoSQL ORM.
- Solid grasp of data structures, multithreading, and operating system concepts.
- Experience with RESTful API development and implementation of API security.
- Knowledge of JSON/XML and their use in data exchange.
Good-to-Have Skills :
- Experience with Redis, MQTT, and message queues like RabbitMQ or Kafka.
- Understanding of microservice architecture and third-party API integrations (e.g., payment gateways, SMS/email APIs).
- Familiarity with MongoDB and other NoSQL databases.
- Exposure to data science libraries such as Pandas, NumPy, Scikit-learn.
- Knowledge in building and integrating statistical learning models.
Job Summary:
We are looking for a skilled and motivated Python AWS Engineer to join our team. The ideal candidate will have strong experience in backend development using Python, cloud infrastructure on AWS, and building serverless or microservices-based architectures. You will work closely with cross-functional teams to design, develop, deploy, and maintain scalable and secure applications in the cloud.
Key Responsibilities:
- Develop and maintain backend applications using Python and frameworks like Django or Flask
- Design and implement serverless solutions using AWS Lambda, API Gateway, and other AWS services
- Develop data processing pipelines using services such as AWS Glue, Step Functions, S3, DynamoDB, and RDS
- Write clean, efficient, and testable code following best practices
- Implement CI/CD pipelines using tools like CodePipeline, GitHub Actions, or Jenkins
- Monitor and optimize system performance and troubleshoot production issues
- Collaborate with DevOps and front-end teams to integrate APIs and cloud-native services
- Maintain and improve application security and compliance with industry standards
Required Skills:
- Strong programming skills in Python
- Solid understanding of AWS cloud services (Lambda, S3, EC2, DynamoDB, RDS, IAM, API Gateway, CloudWatch, etc.)
- Experience with infrastructure as code (e.g., CloudFormation, Terraform, or AWS CDK)
- Good understanding of RESTful API design and microservices architecture
- Hands-on experience with CI/CD, Git, and version control systems
- Familiarity with containerization (Docker, ECS, or EKS) is a plus
- Strong problem-solving and communication skills
Preferred Qualifications:
- Experience with PySpark, Pandas, or data engineering tools
- Working knowledge of Django, Flask, or other Python frameworks
- AWS Certification (e.g., AWS Certified Developer – Associate) is a plus
Educational Qualification:
- Bachelor's or Master’s degree in Computer Science, Engineering, or related field
- 4+ years exp with solid backend/engineering experience.
- Knowledge of data structures and an eye for architecture.
- Solid CS fundamentals, fluent in multi-threaded and asynchronous programming, a strong inclination for architecting at scale.
- Excellent technical design, problem-solving, debugging, and communication skills.
- Rapid prototyping worked on distributed systems at scale.
- Basic knowledge of SQL as well as NoSQL databases.
- Proficient in Golang, it's design, and concurrency patterns.
Company and Founders
Egregore Labs (http://www.egregorelabs.com/" target="_blank">www.egregorelabs.com) is a financial software company founded in 2017 by Prashant Vijay (ISB, Tulane) & Hari Balaji (IIM Ahmedabad, IIT Madras) both of whom have spent over a decade each in Financial Services, with a majority of their experience at Goldman Sachs across New York, Hong Kong & Singapore in roles across Trading, Quant & Technology. More about the founders is available here and here
We operate at the intersection of Unstructured Data and Finance. We run multiple products, including Romulus (http://www.romulus.co/" target="_blank">www.romulus.co) and Robana (http://www.robana.ai/" target="_blank">www.robana.ai) - all our products work on the same underlying principles and set of technologies.
Ideal Background
- At least 2 years experience in back-end development in a fast-paced environment, working in Python
- Deep understanding of technologies used in web-deployed SaaS products, including Rest APIs
- Exposure to AWS, Azure, or other cloud providers
- Sound understanding of computer science principles
- Exposure to any of the following
- Financial services
- Natural Language Processing
- Robotic Process Automation
- Intelligent Document Processing
- Document Management and Repositories
Opportunity
We will share our workload as a team and we expect you to work on a broad range of tasks. Here’s are some of the things you might have to do on any given day:
- Developing APIs and endpoints for deployments of our product
- Infrastructure Development such as building databases, creating and maintaining automated jobs
- Build out the back-end to deploy and scale our product
- Build POCs for client deployments
- Integrate our products with 3rd party products/tools/services
- Document your code, write test cases, etc.
Skills
- Hands-on experience with Python (2+ years)
- Sound understanding of Postgres and NoSQL databases such as MongoDB
- Deep familiarity with UNIX, major cloud platforms (AWS, Azure), DevOps
- Understanding of databases, and related tools, paradigms
- A computer science education would be great, but other engineering disciplines are ok as well
Desirables
We are looking for a person who has :
- Resourcefulness- - we're looking for versatile developers who are good at figuring out what they need to use, learn, build, re-purpose to get the job done quickly and efficiently.
- Ownership- - We like to be directive and not prescriptive in our management. We- d love for you to take ownership of what you work on, and tell us what to do, rather than the other way round.
- Work Ethic- - We've grown up on Wall Street. We work hard and have aggressive goals. We want our teammates to be focused, goal-oriented, and consistent high achievers.
- Execution Focus- - Our business is about getting things done and getting things done right. We want outcome-focused colleagues who can multi-task, and execute quickly and elegantly.
Interested?
We are an early-stage company. Working here is not for the faint-hearted. An intense and unstructured work environment, lots of excitement, and a group of motivated colleagues are what we bring to the table. We ask you to bring your undivided attention, strong worth ethic & resourcefulness. We are Delhi-based and work 6 days a week. Currently, due to the pandemic, we are operating remotely since Feb 2020.
About KAFQA
At Kafqa, we are building the next generation performing arts platform. Our mission is to transform how India learns, performs & watchers performing arts. We are currently in stealth mode with a target public launch date in April. Our launch services consist of technology enabled dance classes in our proprietary studios, production facilities and social media broadcasting & competitions.
Founder & Team
The founder is Shariq Plasticwala. He is a graduate of IIT Bombay & Stanford GSB. He was part of the founding team of Amazon India where he played a key role for over 8 years. Among his roles at Amazon, he was the CEO of Amazon’s first joint venture in India and a Board Member of Amazon’s payments business. The other members of the founding team consist of senior executives from Shiamak Davar & Byju’s.
Background
- At least 1+ years’ experience in back-end development in a fast-paced environment, working in Python & Django Framework
- Deep understanding of technologies used in web-deployed SaaS products, including Rest APIs
- Exposure to AWS, Azure or other cloud providers
Opportunity
We will share our workload as a team and we expect you to work on a broad range of tasks. Here’s are some of the things you might have to do on any given day:
- Developing APIs and endpoints for deployments of our product
- Infrastructure Development such as building databases, creating and maintaining automated jobs
- Build out the back-end to deploy and scale our product
- Build POCs for client deployments
- Document your code, write test cases, etc.
Skills
- Hands-on experience with Python (1+ years)
- Sound understanding of Postgres and NoSQL databases such as MongoDB
- Deep familiarity with UNIX, major cloud platforms (AWS, Azure), DevOps
- Understanding of databases, and related tools, paradigms
We are having an immediate requirement for a Python web developer.
You have:
- At least 2 years of experience developing web applications with Django/Flask/FastAPI
- Familiarity with Linux
- Experience in both SQL and NoSQL databases.
- Uses Docker and CI/CD
- Writes tests
- Experienced in application deployments and scaling them on AWS or GCP
You are:
- Eager to work independently without being watched
- Easy going.
- Able to handle clients on your own
Location: Remote (in India)
You will be building product features solving complex business problems using state of the art technologies (Docker, Kubernetes, GCP, Python, Angular, ML/AI) in an ownership and integrity driven culture.
What will you do:
- Architect full-stack solutions for complex business requirements in a fast-paced environment while optimising for scalability, performance, concurrency, availability, security and code quality.
- Own and execute engineering projects end to end including API design, DB design, project planning, coding, and fluent communication with the rest of the team.
What we’re looking for:
- Bachelors/Masters in Computer Science or a related field
- Experience 3-6 years
- Strong ownership, integrity and drive to succeed individually and as a startup
- Good grasp on algorithms and data structures
GeoSpoc is looking for passionate backend developers who would like to solve complex business problems using location-aware data and cutting-edge tools and technologies such as microservices and cloud platforms such as AWS.
General skill
- A passionate developer with solid understanding of software basics
- Always willing to learn and explore upcoming technologies
- Pro-active, reliable and result oriented
- Someone who can continuously perform in a fast-paced environment
Key Skills Required
- Write effective, scalable code
- Develop back-end components to improve responsiveness and overall performance
- Integrate user-facing elements into applications
- Test and debug programs
- Improve functionality of existing systems
- Implement security and data protection solutions
- Assess and prioritize feature requests
- Coordinate with internal teams to understand user requirements and provide technical solutions
Skills and Experience
- Expertise in at least one popular Python framework (like Django, Flask or Pyramid)
- Knowledge of object-relational mapping (ORM)
- Familiarity with front-end technologies (like JavaScript and HTML5)
Responsibilities
- Writing and testing code, debugging programs and integrating applications with third-party web services
- Work closely with small teams of designers, frontend developers, GIS experts as well as business stakeholders
- Own the development lifecycle of backend systems from design to deployment
- Go above and beyond to deliver great quality software solutions on time








