Cutshort logo
Egen Solutions logo
GCP Data Engineer
GCP Data Engineer
Egen Solutions's logo

GCP Data Engineer

Hemavathi Panduri's profile picture
Posted by Hemavathi Panduri
4 - 8 yrs
₹12L - ₹25L / yr
Hyderabad
Skills
skill iconPython
Google Cloud Platform (GCP)
ETL
Apache Airflow

We are looking for a skilled and motivated Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data pipelines. The role involves working with various GCP services, implementing data ingestion and transformation logic, and ensuring data quality and consistency across systems.


Key Responsibilities:

  • Design, develop, test, and maintain scalable ETL data pipelines using Python.
  • Work extensively on Google Cloud Platform (GCP) services such as:
  • Dataflow for real-time and batch data processing
  • Cloud Functions for lightweight serverless compute
  • BigQuery for data warehousing and analytics
  • Cloud Composer for orchestration of data workflows (based on Apache Airflow)
  • Google Cloud Storage (GCS) for managing data at scale
  • IAM for access control and security
  • Cloud Run for containerized applications
  • Perform data ingestion from various sources and apply transformation and cleansing logic to ensure high-quality data delivery.
  • Implement and enforce data quality checks, validation rules, and monitoring.
  • Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver efficient data solutions.
  • Manage version control using GitHub and participate in CI/CD pipeline deployments for data projects.
  • Write complex SQL queries for data extraction and validation from relational databases such as SQL Server, Oracle, or PostgreSQL.
  • Document pipeline designs, data flow diagrams, and operational support procedures.

Required Skills:

  • 4–8 years of hands-on experience in Python for backend or data engineering projects.
  • Strong understanding and working experience with GCP cloud services (especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.).
  • Solid understanding of data pipeline architecture, data integration, and transformation techniques.
  • Experience in working with version control systems like GitHub and knowledge of CI/CD practices.
  • Strong experience in SQL with at least one enterprise database (SQL Server, Oracle, PostgreSQL, etc.).



Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Egen Solutions

Founded :
2009
Type :
Services
Size :
100-1000
Stage :
Profitable

About

We build next-generation cloud-native data platforms and applications. Our clients rely on us to architect and execute next generation technology strategies. From building and migrating to cloud-native data platforms to designing new modern business models.
Read more

Company social profiles

bloglinkedintwitterfacebook

Similar jobs

NeoGenCode Technologies Pvt Ltd
Bengaluru (Bangalore)
7 - 12 yrs
₹5L - ₹20L / yr
skill iconPython
Test Automation (QA)
Scripting language
skill iconGit
CI/CD
+6 more

Job Title : Senior Python Scripting Engineer (Testing)

Experience : 7 to 8 Years

Location : Bangalore

Employment Type : Full-Time

Job Overview :

  • We are looking for a Senior Python Scripting Engineer with 4 to 5 Years of advanced Python scripting experience and 2 years of testing experience.
  • The ideal candidate will be responsible for developing robust automation scripts, ensuring software quality, and collaborating with cross-functional teams to enhance product reliability.

Key Responsibilities :

  • Develop and maintain advanced Python scripts for automation and software development.
  • Design, implement, and execute test cases, automation scripts, and testing frameworks to ensure software quality.
  • Collaborate with developers and QA teams to identify and resolve software defects.
  • Optimize existing scripts and test cases to improve efficiency and accuracy.
  • Work on test automation, debugging, and continuous integration pipelines.
  • Maintain clear documentation for scripts, test cases, and processes.

Required Skills & Qualifications :

  • 7 to 8 Years of overall experience in software development/testing.
  • 4 to 5 Years of strong hands-on experience in Python scripting (Advanced Level).
  • 2 Years of experience in Software Testing (manual and automation).
  • Experience with test automation frameworks like PyTest, Selenium, or Robot Framework.
  • Proficiency in debugging, troubleshooting, and optimizing scripts.
  • Knowledge of CI/CD pipelines, version control systems (Git), and Agile methodologies.
  • Strong problem-solving skills and ability to work in a dynamic environment.

Preferred Skills :

  • Experience with cloud platforms (AWS, Azure, or GCP).
  • Exposure to performance testing and security testing.
  • Familiarity with DevOps practices and containerization (Docker, Kubernetes).
Read more
NeoGenCode Technologies Pvt Ltd
Pune
5 - 8 yrs
₹7L - ₹11L / yr
skill iconPython
Celery
RESTful APIs
Multithreading
Encryption
+6 more

Job Title : Senior Python Developer – Product Engineering

Experience : 5 to 8 Years

Location : Pune, India (Hybrid – 3-4 days WFO, 1-2 days WFH)

Employment Type : Full-time

Commitment : Minimum 3 years (with end-of-term bonus)

Openings : 2 positions

  • Junior : 3 to 5 Years
  • Senior : 5 to 8 Years

Mandatory Skills : Python 3.x, REST APIs, multithreading, Celery, encryption (OpenSSL/cryptography.io), PostgreSQL/Redis, Docker/K8s, secure coding


Nice to Have : Experience with EFSS/DRM/DLP platforms, delta sync, file systems, LDAP/AD/SIEM integrations


🎯 Roles & Responsibilities :

  • Design and develop backend services for DRM enforcement, file synchronization, and endpoint telemetry.
  • Build scalable Python-based APIs interacting with file systems, agents, and enterprise infra.
  • Implement encryption workflows, secure file handling, delta sync, and file versioning.
  • Integrate with 3rd-party platforms: LDAP, AD, DLP, CASB, SIEM.
  • Collaborate with DevOps to ensure high availability and performance of hybrid deployments.
  • Participate in code reviews, architectural discussions, and mentor junior developers.
  • Troubleshoot production issues and continuously optimize performance.

✅ Required Skills :

  • 5 to 8 years of hands-on experience in Python 3.x development.
  • Expertise in REST APIs, Celery, multithreading, and file I/O.
  • Proficient in encryption libraries (OpenSSL, cryptography.io) and secure coding.
  • Experience with PostgreSQL, Redis, SQLite, and Linux internals.
  • Strong command over Docker, Kubernetes, CI/CD, and Git workflows.
  • Ability to write clean, testable, and scalable code in production environments.

➕ Preferred Skills :

  • Background in DRM, EFSS, DLP, or enterprise security platforms.
  • Familiarity with file diffing, watermarking, or agent-based tools.
  • Knowledge of compliance frameworks (GDPR, DPDP, RBI-CSF) is a plus.
Read more
Noida
8 - 14 yrs
₹25L - ₹40L / yr
skill iconJava
Google Cloud Platform (GCP)
Spring
RESTful APIs
Microservices
+1 more

About Us :


CLOUDSUFI, a Google Cloud Premier Partner, a Data Science and Product Engineering organization building Products and Solutions for Technology and Enterprise industries. We firmly believe in the power of data to transform businesses and make better decisions. We combine unmatched experience in business processes with cutting edge infrastructure and cloud services. We partner with our customers to monetize their data and make enterprise data dance.


Our Values :


We are a passionate and empathetic team that prioritizes human values. Our purpose is to elevate the quality of lives for our family, customers, partners and the community.


Equal Opportunity Statement :


CLOUDSUFI is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified candidates receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, and national origin status. We provide equal opportunities in employment, advancement, and all other areas of our workplace.


About the Role


Job Title: Lead Java Developer


Location: Noida(Hybrid)


Experience: 7-12 years


Education: BTech / BE / ME /MTech/ MCA / MSc Computer Science



Primary Skills - Java 8-17+, Core Java, Design patterns (more than Singleton & Factory), Webservices development,REST/SOAP, XML & JSON manipulation, OAuth 2.0, CI/CD, SQL / NoSQL


Secondary Skills -Kafka, Jenkins, Kubernetes, Google Cloud Platform (GCP), SAP JCo library, Terraform


Certifications (Optional): OCPJP (the Oracle Certified Professional Java Programmer) / Google Professional Cloud



Required Experience:


● Must have integration component development experience using Java 8/9 technologies andservice-oriented architecture (SOA)


● Must have in-depth knowledge of design patterns and integration architecture


● Must have experience in system scalability and maintenance for complex enterprise applications and integration solutions


● Experience with developing solutions on Google Cloud Platform will be an added advantage.


● Should have good hands-on experience with Software Engineering tools viz. Eclipse, NetBeans, JIRA,Confluence, BitBucket, SVN etc.


● Should be very well verse with current technology trends in IT Solutions e.g. Cloud Platform Development,DevOps, Low Code solutions, Intelligent Automation


Good to Have:


● Experience of developing 3-4 integration adapters/connectors for enterprise applications (ERP, CRM, HCM,SCM, Billing etc.) using industry standard frameworks and methodologies following Agile/Scrum


Behavioral competencies required:


● Must have worked with US/Europe based clients in onsite/offshore delivery model


● Should have very good verbal and written communication, technical articulation, listening and presentation skills


● Should have proven analytical and problem solving skills


● Should have demonstrated effective task prioritization, time management and internal/external stakeholder management skills


● Should be a quick learner and team player


● Should have experience of working under stringent deadlines in a Matrix organization structure


● Should have demonstrated appreciable Organizational Citizenship Behavior (OCB) in past organizations


Job Responsibilities:


● Writing the design specifications and user stories for the functionalities assigned.


● Develop assigned components / classes and assist QA team in writing the test cases


● Create and maintain coding best practices and do peer code / solution reviews


● Participate in Daily Scrum calls, Scrum Planning, Retro and Demos meetings


● Bring out technical/design/architectural challenges/risks during execution, develop action plan for mitigation and aversion of identified risks


● Comply with development processes, documentation templates and tools prescribed by CloudSufi or and its clients


● Work with other teams and Architects in the organization and assist them on technical Issues/Demos/POCs and proposal writing for prospective clients


● Contribute towards the creation of knowledge repository, reusable assets/solution accelerators and IPs


● Provide feedback to junior developers and be a coach and mentor for them


● Provide training sessions on the latest technologies and topics to others employees in the organization


● Participate in organization development activities time to time - Interviews, CSR/Employee engagement activities, participation in business events/conferences, implementation of new policies, systems and procedures as decided by Management team

Read more
Rapid Canvas
at Rapid Canvas
1 candid answer
Nikita Sinha
Posted by Nikita Sinha
Remote only
6 - 10 yrs
Upto ₹60L / yr (Varies
)
skill iconJava
skill iconPython
skill iconGo Programming (Golang)
skill iconNodeJS (Node.js)
skill iconPHP

We are looking for back end engineering experts with the passion to take on new challenges in a high growth startup environment. If you love finding creative solutions to coding challenges using the latest tech stack such as Java 18+, Spring Boot 3+, then we would like to speak with you.

Roles & Responsibilities

  • You will be part of a team that focuses on building a world-class data science platform
  • Work closely with both product owners and architects to fully understand business requirements and the design philosophy
  • Optimize web and data applications for performance and scalability
  • Collaborate with automation engineering team to deliver high-quality deliverables within a challenging time frame
  • Produce quality code, raising the bar for team performance and speed
  • Recommend systems solutions by comparing advantages and disadvantages of custom development and purchased alternatives
  • Follow emerging technologies

Key Skills Required

  • Bachelor’s degree (or equivalent) in computer science
  • At least 6 years of experience in software development using Java / Python, SpringBoot, REST API and scalable microservice frameworks.
  • Strong foundation in computer science, algorithms, and web design
  • Experience in writing highly secure web applications
  • Knowledge of container/orchestration tools (Kubernetes, Docker, etc.) and UI frameworks (NodeJS, React)
  • Good development habits, including unit testing, CI, and automated testing
  • High growth mindset that challenges the status quo and focuses on unique ideas and solutions
  • Experience on working with dynamic startups / high intensity environment would be a Plus
  • Experience working with shell scripting, Github Actions, Unix and prominent cloud providers like GCP, Azure, S3 is a plus

Why Join Us

  • Drive measurable impact for Fortune 500 customers across the globe, helping them turn AI vision into operational value.
  • Be part of a category-defining AI company, pioneering a hybrid model that bridges agents and experts.
  • Own strategic accounts end-to-end and shape what modern AI success looks like.
  • Work with a cross-functional, high-performance team that values execution, clarity, and outcomes.
  • Globally competitive compensation and benefits tailored to your local market.
  • Recognized as a Top 5 Data Science and Machine Learning platform on G2 for customer satisfaction.

Read more
Virtusa
Virtusa
Agency job
via Response Informatics by Ramki Prasad
Remote, Hyderabad, Bengaluru (Bangalore), Chennai, Pune
5 - 7 yrs
₹5L - ₹15L / yr
skill iconPython
skill iconAmazon Web Services (AWS)
Amazon EC2
Microservices

Skills:

  • Expertise in Python 3 on AWS serverless
  • Experience in AWS serverless stack Appsync, Lambda, Cognito, API Gateway, DynamoDB, Elasticsearch, SQS, S3, Code commit & Code Deploy.
  • Proficient in modern microservice-based architectures and methodologies.
  • Experience in a database technology, preferably No-SQL such as AWS DynamoDB.
  • Build human-centric UX with us using technologies like React, TypeScript, GraphQL, and CSS-in-JS.
  • Experience building data processing pipelines (SQS, Kinesis, DynamoDB, AWS Lambda, or similar)
  • Deep technical hands-on experience developing in REST/JSON or SOAP/XML, combined with strong knowledge of concepts such as CORs (Cross Origins Resources), headers, security, JSON and http concept.
  • Experience with Github and advanced Github features (good to have).
  • Must have worked as a part of Agile Teams and DevOps practices such as continuous Integration tools (e.g. Jenkins), code repository, creating CI/CD pipelines is required.
Read more
Looking for candidates -Java - J2EEE lead
Looking for candidates -Java - J2EEE lead
Agency job
via HiyaMee by shardha madhu
Hyderabad
10 - 12 yrs
₹25L - ₹30L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Spring
+1 more

Job Description

Who are we looking for?

A senior level Java-J2EEE lead to manage a critical project for one of the biggest clients in banking domain. The Individual should be passionate about technology, experienced in developing and managing cutting edge technology applications.
We are looking for people from the trading background

Technical Skills: 

  • An excellent tech Lead or application architect with strong experience in monolithic Java legacy applications, modern cloud-native
  • Strong hands-on experience in Spring, Core Java specifically on multi-threading, concurrency, memory management process, and fair understanding on network communication & protocols. 
  • experience working in software development on low-latency and high performing systems
  • Experienced to guide & mentor the offshore team members, validating application deliverables on regular basis
  • Ability to work in a collaborative manner with peers across different time zones. 
  • Passionate about good design and code quality and have strong engineering practices
  • Experience working on GCP will be preferred. 

Process Skills: 

  • Experience in analyzing requirements and develop software as per project defined software process
  • Develop and review design, code
  • Develop and document architecture framework, technical standards, and application roadmap
  • Guide development teams to comply with the architecture and development standards and ensure quality application is designed, developed, and delivered
  • Must   have excellent communication skills.

Behavioral Skills:

  • Resolve technical issues of projects and Explore alternate designs
  • Effectively collaborates and communicates with the stakeholders and ensure client satisfaction
  • Mentor, Train and coach members of project groups to ensure effective knowledge management activity.

Certification:

  • Ultimate sun Java and GCP Certified 
Read more
Glamplus
at Glamplus
4 recruiters
Vatsalya Agarwal
Posted by Vatsalya Agarwal
Bengaluru (Bangalore)
4 - 6 yrs
₹10L - ₹20L / yr
skill iconDjango
skill iconPython
Data Structures
Problem solving
Relational Database (RDBMS)
  • Deep understanding of Django and DRF
  • Write effective, scalable code
  • Develop back-end components to improve responsiveness and overall performance
  • Integrate user-facing elements into applications
  • Test and debug programs
  • Improve functionality of existing systems
  • Implement security and data protection solutions
  • Assess and prioritize feature requests
  • Coordinate with internal teams to understand user requirements and provide technical solutions
Read more
InfyBytes AI Labs Private Limited Octo
Harshvardhan Mandad
Posted by Harshvardhan Mandad
Bengaluru (Bangalore)
3 - 5 yrs
₹15L - ₹30L / yr
skill iconNodeJS (Node.js)
skill iconJava
skill iconGo Programming (Golang)
skill iconPython
NOSQL Databases
+1 more

What we are looking for

  • At-least 3 years of experience of development on backend applications. Full stack experience is a cherry on the top!
  • Experience / knowledge of designing robust systems, maintaining & scaling them
  • Experience with usage of NoSQL databases like MongoDB & with SQL and RDBMS Systems
  • Experience of creating applications with any of the popular frameworks in Python, Java, GoLang, Node
  • Experience with JS frontend frameworks like React, Angular, Vue etc is a big plus
  • Well versed with versioning systems like git
  • Understanding of rest API implementation

Some of the responsibilties you will be taking up are following

  • Working on creating performant and fault tolerant systems which are scalable
  • Design, build, and maintain high performance, reusable, and reliable codebase
  • Effectively work with product to gather requirements, gain deep understanding of use cases and business needs, and translate into design and implementation.
  • Maintain code integrity and organization.
  • Manage basic devops related to CI/CD
  • Creating secure systems
  • Lead other junior developers
  • Define optimal and minimal architecture to achieve product requirements
Read more
mPokket is an mobile app based lending platform.
mPokket is an mobile app based lending platform.
Agency job
via Success Pact by Himanshu Sati
Bengaluru (Bangalore)
6 - 15 yrs
₹10L - ₹80L / yr
skill iconPHP
skill iconPython
skill iconLaravel
skill iconCodeIgniter
skill iconCakePHP
Tech Lead / Sr. Tech Lead / SDE-I / II We need you to have a minimum of 6 years of experience with the following: Leadership
 Managing & mentoring a team of 5+ people
 Ability to deliver projects/sprints on time
 Obsessed with quality: Design reviews, code reviews, testing (system/performance)
 Spending at least 50% time with hands-on coding while doing the above
Programming
 Hands on experience with design and implementation of of WebApps and APIs using a PHP based framework (such as Laravel, Code Igniter, Cake or similar)
 In addition to PHP, hands-on with a Python or node.js based framework
 Good understanding of SQL (mySQL, postgres or similar. including clustering)
 Good understanding of one no-SQL
 Comfortable producing and refactoring code without assistance
 Understands different major language paradigms (object oriented / functional /reactive)
 Can reason about complexity of algorithms (time and space)
 Basic CI/CD and DevOps
Read more
Brainizen Technologies
at Brainizen Technologies
1 recruiter
Brainizen Tech
Posted by Brainizen Tech
Pune
1 - 3 yrs
₹5L - ₹12L / yr
skill iconJavascript
skill iconPython
skill iconDjango
Heroku
skill iconAmazon Web Services (AWS)
+3 more
Are you an awesome python programmer and looking for an opportunity to join founding team to build a great product from scratch? Brainizen is founded with passion for excellence combined with rich experience of working with innovative startups as well as big corporates known for leading disruptive innovations. At Brainizen, we are working on revolutionizing social networking by addressing some of the key challenges. We are looking for bright Engineers to help us in our mission. *What You'll be doing:* • As an early stage startup engineer, you will provide thought leadership to find new solutions, design next-gen systems to help us in our mission. • Write and test high-quality, maintainable code • We are building the foundation for massive scale product, so this is right time to put your stamp on the product. • You will be working in fast changing environment typical to early stage startup and will not be limited to a specific role. • Work with an awesome team that dream big and enjoys getting things done. • Contribute and help build the company culture *What You Need for this Position:* • BTech / BS / BE / MTech / MS / ME in CS or equivalent from IITs or Top Tier Engineering Colleges • Demonstrated experience working on mobile application backend, distributed systems • Python and Django framework experience • Practical knowledge of MySQL and NoSQL databases (Redis, MongoDB etc), Elastic search • Comfortable with Git and continuous integration *Extra Points For:* • Experience with scaling and orchestrating any of cloud (AWS/Heroku/GCP) deployments. • Knowledge of distributed messaging platforms (Kafka, kinesis) and distributed computing platform (Spark, storm) • Knowledge of HTML, CSS and Javascript
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos