
We are looking for a skilled and motivated Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data pipelines. The role involves working with various GCP services, implementing data ingestion and transformation logic, and ensuring data quality and consistency across systems.
Key Responsibilities:
- Design, develop, test, and maintain scalable ETL data pipelines using Python.
- Work extensively on Google Cloud Platform (GCP) services such as:
- Dataflow for real-time and batch data processing
- Cloud Functions for lightweight serverless compute
- BigQuery for data warehousing and analytics
- Cloud Composer for orchestration of data workflows (based on Apache Airflow)
- Google Cloud Storage (GCS) for managing data at scale
- IAM for access control and security
- Cloud Run for containerized applications
- Perform data ingestion from various sources and apply transformation and cleansing logic to ensure high-quality data delivery.
- Implement and enforce data quality checks, validation rules, and monitoring.
- Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver efficient data solutions.
- Manage version control using GitHub and participate in CI/CD pipeline deployments for data projects.
- Write complex SQL queries for data extraction and validation from relational databases such as SQL Server, Oracle, or PostgreSQL.
- Document pipeline designs, data flow diagrams, and operational support procedures.
Required Skills:
- 4–8 years of hands-on experience in Python for backend or data engineering projects.
- Strong understanding and working experience with GCP cloud services (especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.).
- Solid understanding of data pipeline architecture, data integration, and transformation techniques.
- Experience in working with version control systems like GitHub and knowledge of CI/CD practices.
- Strong experience in SQL with at least one enterprise database (SQL Server, Oracle, PostgreSQL, etc.).

About Egen Solutions
About
Similar jobs
Job Title : Senior Python Scripting Engineer (Testing)
Experience : 7 to 8 Years
Location : Bangalore
Employment Type : Full-Time
Job Overview :
- We are looking for a Senior Python Scripting Engineer with 4 to 5 Years of advanced Python scripting experience and 2 years of testing experience.
- The ideal candidate will be responsible for developing robust automation scripts, ensuring software quality, and collaborating with cross-functional teams to enhance product reliability.
Key Responsibilities :
- Develop and maintain advanced Python scripts for automation and software development.
- Design, implement, and execute test cases, automation scripts, and testing frameworks to ensure software quality.
- Collaborate with developers and QA teams to identify and resolve software defects.
- Optimize existing scripts and test cases to improve efficiency and accuracy.
- Work on test automation, debugging, and continuous integration pipelines.
- Maintain clear documentation for scripts, test cases, and processes.
Required Skills & Qualifications :
- 7 to 8 Years of overall experience in software development/testing.
- 4 to 5 Years of strong hands-on experience in Python scripting (Advanced Level).
- 2 Years of experience in Software Testing (manual and automation).
- Experience with test automation frameworks like PyTest, Selenium, or Robot Framework.
- Proficiency in debugging, troubleshooting, and optimizing scripts.
- Knowledge of CI/CD pipelines, version control systems (Git), and Agile methodologies.
- Strong problem-solving skills and ability to work in a dynamic environment.
Preferred Skills :
- Experience with cloud platforms (AWS, Azure, or GCP).
- Exposure to performance testing and security testing.
- Familiarity with DevOps practices and containerization (Docker, Kubernetes).
Job Title : Senior Python Developer – Product Engineering
Experience : 5 to 8 Years
Location : Pune, India (Hybrid – 3-4 days WFO, 1-2 days WFH)
Employment Type : Full-time
Commitment : Minimum 3 years (with end-of-term bonus)
Openings : 2 positions
- Junior : 3 to 5 Years
- Senior : 5 to 8 Years
Mandatory Skills : Python 3.x, REST APIs, multithreading, Celery, encryption (OpenSSL/cryptography.io), PostgreSQL/Redis, Docker/K8s, secure coding
Nice to Have : Experience with EFSS/DRM/DLP platforms, delta sync, file systems, LDAP/AD/SIEM integrations
🎯 Roles & Responsibilities :
- Design and develop backend services for DRM enforcement, file synchronization, and endpoint telemetry.
- Build scalable Python-based APIs interacting with file systems, agents, and enterprise infra.
- Implement encryption workflows, secure file handling, delta sync, and file versioning.
- Integrate with 3rd-party platforms: LDAP, AD, DLP, CASB, SIEM.
- Collaborate with DevOps to ensure high availability and performance of hybrid deployments.
- Participate in code reviews, architectural discussions, and mentor junior developers.
- Troubleshoot production issues and continuously optimize performance.
✅ Required Skills :
- 5 to 8 years of hands-on experience in Python 3.x development.
- Expertise in REST APIs, Celery, multithreading, and file I/O.
- Proficient in encryption libraries (OpenSSL, cryptography.io) and secure coding.
- Experience with PostgreSQL, Redis, SQLite, and Linux internals.
- Strong command over Docker, Kubernetes, CI/CD, and Git workflows.
- Ability to write clean, testable, and scalable code in production environments.
➕ Preferred Skills :
- Background in DRM, EFSS, DLP, or enterprise security platforms.
- Familiarity with file diffing, watermarking, or agent-based tools.
- Knowledge of compliance frameworks (GDPR, DPDP, RBI-CSF) is a plus.
About Us :
CLOUDSUFI, a Google Cloud Premier Partner, a Data Science and Product Engineering organization building Products and Solutions for Technology and Enterprise industries. We firmly believe in the power of data to transform businesses and make better decisions. We combine unmatched experience in business processes with cutting edge infrastructure and cloud services. We partner with our customers to monetize their data and make enterprise data dance.
Our Values :
We are a passionate and empathetic team that prioritizes human values. Our purpose is to elevate the quality of lives for our family, customers, partners and the community.
Equal Opportunity Statement :
CLOUDSUFI is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified candidates receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, and national origin status. We provide equal opportunities in employment, advancement, and all other areas of our workplace.
About the Role
Job Title: Lead Java Developer
Location: Noida(Hybrid)
Experience: 7-12 years
Education: BTech / BE / ME /MTech/ MCA / MSc Computer Science
Primary Skills - Java 8-17+, Core Java, Design patterns (more than Singleton & Factory), Webservices development,REST/SOAP, XML & JSON manipulation, OAuth 2.0, CI/CD, SQL / NoSQL
Secondary Skills -Kafka, Jenkins, Kubernetes, Google Cloud Platform (GCP), SAP JCo library, Terraform
Certifications (Optional): OCPJP (the Oracle Certified Professional Java Programmer) / Google Professional Cloud
Required Experience:
● Must have integration component development experience using Java 8/9 technologies andservice-oriented architecture (SOA)
● Must have in-depth knowledge of design patterns and integration architecture
● Must have experience in system scalability and maintenance for complex enterprise applications and integration solutions
● Experience with developing solutions on Google Cloud Platform will be an added advantage.
● Should have good hands-on experience with Software Engineering tools viz. Eclipse, NetBeans, JIRA,Confluence, BitBucket, SVN etc.
● Should be very well verse with current technology trends in IT Solutions e.g. Cloud Platform Development,DevOps, Low Code solutions, Intelligent Automation
Good to Have:
● Experience of developing 3-4 integration adapters/connectors for enterprise applications (ERP, CRM, HCM,SCM, Billing etc.) using industry standard frameworks and methodologies following Agile/Scrum
Behavioral competencies required:
● Must have worked with US/Europe based clients in onsite/offshore delivery model
● Should have very good verbal and written communication, technical articulation, listening and presentation skills
● Should have proven analytical and problem solving skills
● Should have demonstrated effective task prioritization, time management and internal/external stakeholder management skills
● Should be a quick learner and team player
● Should have experience of working under stringent deadlines in a Matrix organization structure
● Should have demonstrated appreciable Organizational Citizenship Behavior (OCB) in past organizations
Job Responsibilities:
● Writing the design specifications and user stories for the functionalities assigned.
● Develop assigned components / classes and assist QA team in writing the test cases
● Create and maintain coding best practices and do peer code / solution reviews
● Participate in Daily Scrum calls, Scrum Planning, Retro and Demos meetings
● Bring out technical/design/architectural challenges/risks during execution, develop action plan for mitigation and aversion of identified risks
● Comply with development processes, documentation templates and tools prescribed by CloudSufi or and its clients
● Work with other teams and Architects in the organization and assist them on technical Issues/Demos/POCs and proposal writing for prospective clients
● Contribute towards the creation of knowledge repository, reusable assets/solution accelerators and IPs
● Provide feedback to junior developers and be a coach and mentor for them
● Provide training sessions on the latest technologies and topics to others employees in the organization
● Participate in organization development activities time to time - Interviews, CSR/Employee engagement activities, participation in business events/conferences, implementation of new policies, systems and procedures as decided by Management team
We are looking for back end engineering experts with the passion to take on new challenges in a high growth startup environment. If you love finding creative solutions to coding challenges using the latest tech stack such as Java 18+, Spring Boot 3+, then we would like to speak with you.
Roles & Responsibilities
- You will be part of a team that focuses on building a world-class data science platform
- Work closely with both product owners and architects to fully understand business requirements and the design philosophy
- Optimize web and data applications for performance and scalability
- Collaborate with automation engineering team to deliver high-quality deliverables within a challenging time frame
- Produce quality code, raising the bar for team performance and speed
- Recommend systems solutions by comparing advantages and disadvantages of custom development and purchased alternatives
- Follow emerging technologies
Key Skills Required
- Bachelor’s degree (or equivalent) in computer science
- At least 6 years of experience in software development using Java / Python, SpringBoot, REST API and scalable microservice frameworks.
- Strong foundation in computer science, algorithms, and web design
- Experience in writing highly secure web applications
- Knowledge of container/orchestration tools (Kubernetes, Docker, etc.) and UI frameworks (NodeJS, React)
- Good development habits, including unit testing, CI, and automated testing
- High growth mindset that challenges the status quo and focuses on unique ideas and solutions
- Experience on working with dynamic startups / high intensity environment would be a Plus
- Experience working with shell scripting, Github Actions, Unix and prominent cloud providers like GCP, Azure, S3 is a plus
Why Join Us
- Drive measurable impact for Fortune 500 customers across the globe, helping them turn AI vision into operational value.
- Be part of a category-defining AI company, pioneering a hybrid model that bridges agents and experts.
- Own strategic accounts end-to-end and shape what modern AI success looks like.
- Work with a cross-functional, high-performance team that values execution, clarity, and outcomes.
- Globally competitive compensation and benefits tailored to your local market.
- Recognized as a Top 5 Data Science and Machine Learning platform on G2 for customer satisfaction.
Skills:
- Expertise in Python 3 on AWS serverless
- Experience in AWS serverless stack Appsync, Lambda, Cognito, API Gateway, DynamoDB, Elasticsearch, SQS, S3, Code commit & Code Deploy.
- Proficient in modern microservice-based architectures and methodologies.
- Experience in a database technology, preferably No-SQL such as AWS DynamoDB.
- Build human-centric UX with us using technologies like React, TypeScript, GraphQL, and CSS-in-JS.
- Experience building data processing pipelines (SQS, Kinesis, DynamoDB, AWS Lambda, or similar)
- Deep technical hands-on experience developing in REST/JSON or SOAP/XML, combined with strong knowledge of concepts such as CORs (Cross Origins Resources), headers, security, JSON and http concept.
- Experience with Github and advanced Github features (good to have).
- Must have worked as a part of Agile Teams and DevOps practices such as continuous Integration tools (e.g. Jenkins), code repository, creating CI/CD pipelines is required.
Job Description
Who are we looking for?
A senior level Java-J2EEE lead to manage a critical project for one of the biggest clients in banking domain. The Individual should be passionate about technology, experienced in developing and managing cutting edge technology applications.
We are looking for people from the trading background
Technical Skills:
- An excellent tech Lead or application architect with strong experience in monolithic Java legacy applications, modern cloud-native
- Strong hands-on experience in Spring, Core Java specifically on multi-threading, concurrency, memory management process, and fair understanding on network communication & protocols.
- experience working in software development on low-latency and high performing systems
- Experienced to guide & mentor the offshore team members, validating application deliverables on regular basis
- Ability to work in a collaborative manner with peers across different time zones.
- Passionate about good design and code quality and have strong engineering practices
- Experience working on GCP will be preferred.
Process Skills:
- Experience in analyzing requirements and develop software as per project defined software process
- Develop and review design, code
- Develop and document architecture framework, technical standards, and application roadmap
- Guide development teams to comply with the architecture and development standards and ensure quality application is designed, developed, and delivered
- Must have excellent communication skills.
Behavioral Skills:
- Resolve technical issues of projects and Explore alternate designs
- Effectively collaborates and communicates with the stakeholders and ensure client satisfaction
- Mentor, Train and coach members of project groups to ensure effective knowledge management activity.
Certification:
- Ultimate sun Java and GCP Certified
- Deep understanding of Django and DRF
- Write effective, scalable code
- Develop back-end components to improve responsiveness and overall performance
- Integrate user-facing elements into applications
- Test and debug programs
- Improve functionality of existing systems
- Implement security and data protection solutions
- Assess and prioritize feature requests
- Coordinate with internal teams to understand user requirements and provide technical solutions
What we are looking for
- At-least 3 years of experience of development on backend applications. Full stack experience is a cherry on the top!
- Experience / knowledge of designing robust systems, maintaining & scaling them
- Experience with usage of NoSQL databases like MongoDB & with SQL and RDBMS Systems
- Experience of creating applications with any of the popular frameworks in Python, Java, GoLang, Node
- Experience with JS frontend frameworks like React, Angular, Vue etc is a big plus
- Well versed with versioning systems like git
- Understanding of rest API implementation
Some of the responsibilties you will be taking up are following
- Working on creating performant and fault tolerant systems which are scalable
- Design, build, and maintain high performance, reusable, and reliable codebase
- Effectively work with product to gather requirements, gain deep understanding of use cases and business needs, and translate into design and implementation.
- Maintain code integrity and organization.
- Manage basic devops related to CI/CD
- Creating secure systems
- Lead other junior developers
- Define optimal and minimal architecture to achieve product requirements
Managing & mentoring a team of 5+ people
Ability to deliver projects/sprints on time
Obsessed with quality: Design reviews, code reviews, testing (system/performance)
Spending at least 50% time with hands-on coding while doing the above
Programming
Hands on experience with design and implementation of of WebApps and APIs using a PHP based framework (such as Laravel, Code Igniter, Cake or similar)
In addition to PHP, hands-on with a Python or node.js based framework
Good understanding of SQL (mySQL, postgres or similar. including clustering)
Good understanding of one no-SQL
Comfortable producing and refactoring code without assistance
Understands different major language paradigms (object oriented / functional /reactive)
Can reason about complexity of algorithms (time and space)
Basic CI/CD and DevOps









