Cutshort logo
Egen Solutions logo
GCP Data Engineer
GCP Data Engineer
Egen Solutions's logo

GCP Data Engineer

Hemavathi Panduri's profile picture
Posted by Hemavathi Panduri
4 - 8 yrs
₹12L - ₹25L / yr
Hyderabad
Skills
skill iconPython
Google Cloud Platform (GCP)
ETL
Apache Airflow

We are looking for a skilled and motivated Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data pipelines. The role involves working with various GCP services, implementing data ingestion and transformation logic, and ensuring data quality and consistency across systems.


Key Responsibilities:

  • Design, develop, test, and maintain scalable ETL data pipelines using Python.
  • Work extensively on Google Cloud Platform (GCP) services such as:
  • Dataflow for real-time and batch data processing
  • Cloud Functions for lightweight serverless compute
  • BigQuery for data warehousing and analytics
  • Cloud Composer for orchestration of data workflows (based on Apache Airflow)
  • Google Cloud Storage (GCS) for managing data at scale
  • IAM for access control and security
  • Cloud Run for containerized applications
  • Perform data ingestion from various sources and apply transformation and cleansing logic to ensure high-quality data delivery.
  • Implement and enforce data quality checks, validation rules, and monitoring.
  • Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver efficient data solutions.
  • Manage version control using GitHub and participate in CI/CD pipeline deployments for data projects.
  • Write complex SQL queries for data extraction and validation from relational databases such as SQL Server, Oracle, or PostgreSQL.
  • Document pipeline designs, data flow diagrams, and operational support procedures.

Required Skills:

  • 4–8 years of hands-on experience in Python for backend or data engineering projects.
  • Strong understanding and working experience with GCP cloud services (especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.).
  • Solid understanding of data pipeline architecture, data integration, and transformation techniques.
  • Experience in working with version control systems like GitHub and knowledge of CI/CD practices.
  • Strong experience in SQL with at least one enterprise database (SQL Server, Oracle, PostgreSQL, etc.).



Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Egen Solutions

Founded :
2009
Type :
Services
Size :
100-1000
Stage :
Profitable

About

We build next-generation cloud-native data platforms and applications. Our clients rely on us to architect and execute next generation technology strategies. From building and migrating to cloud-native data platforms to designing new modern business models.
Read more

Company social profiles

bloglinkedintwitterfacebook

Similar jobs

Talent Pro
Mayank choudhary
Posted by Mayank choudhary
Remote only
4 - 8 yrs
₹20L - ₹35L / yr
skill iconPython
AWS
Amazon EC2
skill iconPostgreSQL
Service company preferred

Mandatory (Experience 1) - Must have a minimum 4+ years of experience in backend software development.

Mandatory (Experience 2) -Must have 4+ years of experience in backend development using Python (Highly preferred), Java, or Node.js.

Mandatory (Experience 3) - Must have experience with Cloud platforms like AWS (highly preferred), gcp or azure

Mandatory (Experience 4) - Must have Experience in any databases - MySQL / PostgreSQL / Postgres / Oracle / SQL Server / DB2 / SQL / MongoDB / Ne

Read more
BigRio
Disha Bhardwaj
Posted by Disha Bhardwaj
Chennai
8 - 12 yrs
₹25L - ₹30L / yr
Natural Language Processing (NLP)
Large Language Models (LLM) tuning
Artificial Intelligence (AI)
skill iconPython

Job Title: AI Engineer - NLP/LLM Data Product Engineer Location: Chennai, TN- Hybrid

Duration: Full time


Job Summary:

About the Role:

We are growing our Data Science and Data Engineering team and are looking for an

experienced AI Engineer specializing in creating GenAI LLM solutions. This position involves collaborating with clients and their teams, discovering gaps for automation using AI, designing customized AI solutions, and implementing technologies to streamline data entry processes within the healthcare sector.


Responsibilities:

·        Conduct detailed consultations with clients functional teams to understand client requirements, one use case is related to handwritten medical records.

·        Analyze existing data entry workflows and propose automation opportunities.

Design:

·        Design tailored AI-driven solutions for the extraction and digitization of information from handwritten medical records.

·        Collaborate with clients to define project scopes and objectives.

Technology Selection:

·        Evaluate and recommend AI technologies, focusing on NLP, LLM and machine learning.

·        Ensure seamless integration with existing systems and workflows.

Prototyping and Testing:

·        Develop prototypes and proof-of-concept models to demonstrate the feasibility of proposed solutions.

·        Conduct rigorous testing to ensure accuracy and reliability.

Implementation and Integration:

·        Work closely with clients and IT teams to integrate AI solutions effectively.

·        Provide technical support during the implementation phase.

Training and Documentation:

·        Develop training materials for end-users and support staff.

·        Create comprehensive documentation for implemented solutions.

Continuous Improvement:


·        Monitor and optimize the performance of deployed solutions.

·        Identify opportunities for further automation and improvement.

Qualifications:

·        Advanced degree in Computer Science, Artificial Intelligence, or related field (Masters or PhD required).

·        Proven experience in developing and implementing AI solutions for data entry automation.

·        Expertise in NLP, LLM and other machine-learning techniques.

·        Strong programming skills, especially in Python.

·        Familiarity with healthcare data privacy and regulatory requirements.


Additional Qualifications( great to have):

An ideal candidate will have expertise in the most current LLM/NLP models, particularly in the extraction of data from clinical reports, lab reports, and radiology reports. The ideal candidate should have a deep understanding of EMR/EHR applications and patient-related data.

Read more
Leading Global Provider For Secure Data Erasure Solutions
Leading Global Provider For Secure Data Erasure Solutions
Agency job
via Jobdost by Sathish Kumar
Pune
2 - 5 yrs
₹5L - ₹14L / yr
skill iconPython
skill iconAmazon Web Services (AWS)
Webservices
RESTful APIs
SOAP
+3 more

Job Details:

 

As a Software engineer you will be able to challenge the idea of “impossible”, producing results that are elegant, simple and don’t require a team of experts to decode. You are driven by innovation, fresh ideas and new ways to produce high quality solutions. 

 

Job Description:

 

Position Summary:

We are looking for a Cloud developer responsible for the development and maintenance of cloud applications deployed in AWS environment. Your primary focus will be the development of such applications and their integration with other services. A commitment to open mind, problem solving, ability to learn, and creating quality products is essential.

 

Responsibilities:

  • Ensure the performance, quality, and responsiveness of services
  • Collaborate with a team to define, design, and ship new features
  • Innovative thinking of finding solutions to needs
  • Identify and correct bottlenecks and fix bugs
  • Help maintain code quality, automatization and documentation
  • Use Agile Scrum Methodology for software development
  • Develop unit tests for all new code
  • Provide code reviews for all new code and participate to code reviews of other people
  • Diagnose and resolve complex level issues of application
  • Participate in interactions with all levels of personnel with different teams
  • Design and build services on top of AWS

 

Skills:

  • Strong knowledge of Python
  • Strong knowledge of Web Services (Rest or SOAP APIs)
  • Strong knowledge of React JS or any other JavaScript
  • Solid understanding of object-oriented programming
  • Knowledge of Java and Spring Boot is good to have
  • Knowledge of AWS is good to have
  • Knowledge of TypeScript is good to have
  • Knowledge of Linux is good to have
  • Knowledge of HTML and CSS is good to have
  • Knowledge of AWS CloudFormation is good to have
  • Knowledge of Elasticsearch is good to have
  • Familiarity with continuous integration
  • Any authorized Java, AWS, Linux, or Python certifications will be value added
  • Min 2 years of work experience in relevant technologies
  • Excellent interpersonal and written communication skills

 

Read more
Sureify Labs Technology
at Sureify Labs Technology
3 recruiters
Ajay Cherukuri
Posted by Ajay Cherukuri
Hyderabad
1 - 7 yrs
₹9L - ₹24L / yr
skill iconPHP
skill iconPython
skill iconGo Programming (Golang)

Sureify drives customer engagement between the customer and their insurance company by incorporating web & mobile apps, into the insurance product experience. Our product is controlled by our backend dashboard so insurers can get the latest IoT data streaming in. The SaaS platform is designed to ensure that insurers never miss opportunities to increase engagement with their existing customer base.


We are looking for a Full Stack Web Developer who is motivated to combine the art of design with the art of programming. Responsibilities will include translation of the UI/UX design wireframes to actual code that will produce visual elements of the application. You will work with the UI/UX designer and bridge the gap between graphical design and technical implementation, taking an active role on both sides and defining how the application looks as well as how it works. On the backend, you will have the opportunity to help our product scale and be involved in the further architecture of the Sureify platform.

Responsibilities

  • Develop new user-facing features
  • Build reusable code and libraries for future use
  • Build scalable architecture to support millions of users
  • Ensure the technical feasibility of UI/UX designs
  • Work closely with the UI/UX designers and product managers
  • Optimize application for maximum speed and scalability
  • Assure that all user input is validated before submitting to the back-end
  • Collaborate with other team members and stakeholders

Skills And Qualifications

  • Proficient understanding of web markup, including HTML5, CSS3
  • 2+ years of experience with Full-Stack web development
  • Proficient in PHP or Python or Golang.
  • Experience in Golang is an added advantage.
  • Proficient understanding of client-side scripting and JavaScript frameworks, including jQuery
  • Good understanding of asynchronous request handling, partial page updates, and AJAX.
  • Use test-driven development and acceptance tests to ensure feature quality
  • Excellent relational database skills with MySQL
  • Experience with building restful JSON web services
  • Knowledge of APIs, such as Twitter, Facebook, Google maps, Instagram, etc.
Read more
PL
PL
Agency job
Navi Mumbai, Bengaluru (Bangalore), Pune
4 - 10 yrs
₹1L - ₹15L / yr
Apache Kafka
Kafka
skill iconJava
skill iconPython
  • 3-8+ years of experience programming in a backend language (Java / Python), with a good understanding of troubleshooting errors. 
  • 5+ years of experience in Confluent Kafka / 3+ years of experience in Confluent Kafka 
  • Cloud Kafka, Control Central, Rest Proxy, HA Proxy, Confluent Kafka Connect, Confluent Kafka Security features 
Read more
makeO
at makeO
1 recruiter
Kavya Bethi
Posted by Kavya Bethi
Remote only
3 - 10 yrs
₹15L - ₹35L / yr
skill iconNodeJS (Node.js)
skill iconPython
skill iconJava
skill iconExpress
SQL server
+1 more

Relevant Experience

3 to 10 years

 

Job Description and Key Skills Required:

  • Hands-on with any of the programming languages like NodeJS/ExpressJS, Python, Java, Php or any.
  • Design and create efficient RESTful API endpoints for both internal and public consumption
  • Strong understanding of database technologies such as MySQL, Postgress, Oracle , relational Database.
  • Work closely with front end developers to understand required data model
  • Comfortable deploying applications on AWS, and have a strong working knowledge of EC2, RDS and S3.
  • Must understand overall system design, architecture , improve design and implement new processes.
  • Strong understanding of sessions, cookies & local storage is must.
  • Experience with in memory databases like redis basic, Memcache
  • Independently think of solutions to complex requirements; possess exceptional logical skills.
  • Analyse current products in development, including performance, scalability, diagnosis and troubleshooting.
  • Work with the existing framework and evolve it by building reusable code & libraries
  • Search and introduce new software related technologies, processes and tools.
  • Bonus: You're fluent with React.
  • Bonus: Interested in full-stack development.
  • Bonus: Any experience of iOS/Android mobile development.
  • Bonus: Experience with CI servers such as Jenkins, Travis or similar types
  • Bonus: Experience with web server like Nginx

 

Read more
Tailnode Technology
at Tailnode Technology
1 recruiter
Talent Acquisition
Posted by Talent Acquisition
Gurugram
3 - 5 yrs
₹6L - ₹15L / yr
skill iconJava
skill iconPython
skill iconRuby
skill iconRuby on Rails (ROR)
skill iconGo Programming (Golang)
+8 more
About Us :

- At TailNode, we are at the bleeding edge of this change.

- We conceptualize and develop products that are aimed to enable this transformation of the political architecture of the country.

- We leverage the best practices and insights of the technology world and apply them in our unique way to deliver impact on a massive scale.

- We want to offer you a once-in-a-lifetime opportunity to be a part of this massive change and build new and exciting products with us.

Responsibilities :

- Designing, building, and maintaining high performance, reusable, scalable and robust services and applications

- Developing and managing databases and reporting tools

- Building intelligent messaging bots using web APIs

- Designing and developing robust RESTful APIs and other interfaces

- Integrating data storage solutions.

Required Skills :

- Ability to write clean, structured code in Ruby/Python with documentation.

- Proficiency in at least one Ruby frameworks (Ruby on Rails or Sinatra) or Python framework (Django or Flask)

- Clear understanding of Data Structures and Algorithms.

- Ability to write well defined test cases using Minitest, RSpec or Unit testing framework.

- Experience in one of the following database technologies - MySQL, PostgreSQL, MongoDB, Cassandra.

- Proficiency in working with complex SQL queries.

- Knowledge of design patterns, architectural best practices.

- Familiarity with RESTful web services.

- Knowledge of version control tools like Git, SVN etc.

- Working experience with Cloud Services like Amazon Web Services or Google Cloud is a plus.

Required Qualifications :

- A Bachelors or a Masters degree in Computer Science or relevant field.

- Experience of 3-5 years in software development.

Note : Other language candidates may apply only if they're expecting to work primarily on Ruby/Python.
Read more
Eximius Ventures
at Eximius Ventures
1 recruiter
Amrita Saini
Posted by Amrita Saini
Bengaluru (Bangalore)
2 - 6 yrs
₹10L - ₹25L / yr
skill iconPython
skill iconJava
RESTful APIs
Microservices
Data Structures
+5 more

Eximius is a micro-VC fund which invests into early-stage startups. One of our portfolio startup iTribe is looking for "Hustlers", "First Principle Thinkers", "Crazy and trips on creating products out of the box from scratch", "Outspoken", "unafraid of users ripping your product".

About iTribe: 
iTribe is on a mission to make discussing finance from being a taboo topic to a dinner table topic, which means making "Bharat" financially literate and independent. iTribe is a social network which allows anyone to discover, discuss, vet ideas and seek advice from like-minded iTribe aims at making Finance simple, witty and fun for everyone

Founded in 2021 by IIT Kharagpur alumni to convert their own journey of becoming investors into a product to help billion users. An emerging startup backed by some of the most respected investors around the world.


Responsibilities

Code Quality and Go live
  • Craft clean, manageable code, maintain proper documentation and code integrity
  • Maintain quality and ensure 100% uptime
  • Create, test and deploy the applications on production servers
  • Continuously discover, evaluate, and implement new technologies and frameworks to maximize development efficiency
  • Responsible for security and data protection.
Communication & Collaboration
  • Working alongside Product managers to architect and design new features.
  • Collaborate with the rest of the engineering team to launch new features.
  • Unblock peers and keep all the internal and external teams informed about the progress of development

Requirements

  • 2 - 5 years of experience in designing and developing Server side component (REST APIs, Micro service Architecture)
  • Good understanding and strong in data structures and algorithms (Degree in computer science is an added advantage)
  • OOP implementation experience with back-end programming languages (Ex: JavaScript, Python, Java, etc).
  • Good to have experience with event driven architecture.
  • Good understanding of databases such as MongoDB, PostgreSQL, MySQL.
  • Well-versed with Software Development Life Cycle
  • Demonstrate the ability to be a self-starter, learn and implement new technologies/ frameworks
  • Excellent analytical and problem-solving skills

 

Why you should join iTribe? 

  • Building a product which is not done in decades.
  • Be a part of the founding team and work directly with the founders.
  • Competitive Salary
  • ESOPs - ownership in the company
  • Medical Insurances
  • Subscriptions to premium platforms for learning
  • Books that you ask for
  • Friendly leave policy
Come join them on this exciting journey of Innovation.
Read more
Indian language self publishing platform. (PT1)
Indian language self publishing platform. (PT1)
Agency job
via Multi Recruit by Kavitha S
Bengaluru (Bangalore)
3 - 5 yrs
₹10L - ₹40L / yr
skill iconPython
skill iconNodeJS (Node.js)
skill iconGo Programming (Golang)
Backend Developer
Go
  • Participate in brainstorming and technical ideation for projects with product, growth, and engineering
  • You will design Scalable and Fault-Tolerant systems
  • You will help Maintain critical and auxiliary systems (databases, cache ...)
  • You will build Experiments that help validate hypotheses for the product

 

Experience:

2+yrs In your first 3 months, you will…

  • Successfully onboard and create strong bonds with the current team
  • Participate in brainstorming and technical ideation for projects with product, growth, and engineering
  • Contribute to existing product features and experimentation

In your first 6 months, you will…

  • Develop prototypes of new features or products using rapid iteration and experimentation as we explore new ideas
  • Partner across the engineering team to ship features

In your first year, you will...

  • Champion best-in-class engineering practices and systems for an emerging engineer team
  • Help build a suite of features for the product

Our Ideal Hire:

  • Learned best practices and has experienced the challenges and joys working at a startup
  • Managed and maintained production code at increasing scales
  • Feels strongly motivated by our mission
  • Communicates complex problems and proposes solutions, in writing and in conversation

Expertise:

  • Proficiency in any one language (ex: NodeJS / Go / Python)
  • MySQL (design / indices / optimizing queries)
  • Redis (types/ functionality/ use cases)

Hands-on experience:

  • Handled scaling issue
  • Good at debugging

Good to have:

  • Kafka (or other stream-processing software)
  • AWS

Do not apply if you are not:

  • Ownership driven
  • Curious in general
  • Able to explain things in simple terms
  • Self-motivated
  • Use to work in the chaotic environment
  • Highly proactive
  • Willing to Mentor and humble to ask for collaboration
  • Most important, Learn & Grow yourself!
  • Hungry to grow anymore
Read more
goplaybook app
at goplaybook app
3 recruiters
Avijeet Gumber
Posted by Avijeet Gumber
NCR (Delhi | Gurgaon | Noida)
0 - 2 yrs
₹3L - ₹6L / yr
skill iconPython
MEAN stack
skill iconDjango
RESTful APIs
Job Duties : 1. Optimising existing Stack & Architecture 2. Has Expertise in handling Backend Microservices Architecture, High-Concurrency, Multi-Thread, Server-side system. 3. Develop efficient, reusable, reliable & Scalable Code. 4. Has the Hustle and Ownership approach. Also, Has the ability to lead technical team. 5. Implementation of security and Data storage solution. Requirements : 1. Has Expertise of 0-2 years on Python and related frameworks. 2. Has Experience with micro-services architecture 3. Has Experience with relational DBs and Linux environments 4. Has Expertise in development and use of REST/3P APIs. 5. Has a great understanding of SQL and NoSQL worlds. We use both Firebase as well as PostgreSQL. 6. Has Experience in handling AWS 7. Has Experience in payment gateway implementation. 8. Has Experience building high-traffic systems 9. Knowledge in Node.js is a plus. 10. Has Experience of leading a team/project/startup in tech role.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos