Cutshort logo
Egen Solutions logo
GCP Data Engineer
GCP Data Engineer
Egen Solutions's logo

GCP Data Engineer

Hemavathi Panduri's profile picture
Posted by Hemavathi Panduri
4 - 8 yrs
₹12L - ₹25L / yr
Hyderabad
Skills
skill iconPython
Google Cloud Platform (GCP)
ETL
Apache Airflow

We are looking for a skilled and motivated Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data pipelines. The role involves working with various GCP services, implementing data ingestion and transformation logic, and ensuring data quality and consistency across systems.


Key Responsibilities:

  • Design, develop, test, and maintain scalable ETL data pipelines using Python.
  • Work extensively on Google Cloud Platform (GCP) services such as:
  • Dataflow for real-time and batch data processing
  • Cloud Functions for lightweight serverless compute
  • BigQuery for data warehousing and analytics
  • Cloud Composer for orchestration of data workflows (based on Apache Airflow)
  • Google Cloud Storage (GCS) for managing data at scale
  • IAM for access control and security
  • Cloud Run for containerized applications
  • Perform data ingestion from various sources and apply transformation and cleansing logic to ensure high-quality data delivery.
  • Implement and enforce data quality checks, validation rules, and monitoring.
  • Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver efficient data solutions.
  • Manage version control using GitHub and participate in CI/CD pipeline deployments for data projects.
  • Write complex SQL queries for data extraction and validation from relational databases such as SQL Server, Oracle, or PostgreSQL.
  • Document pipeline designs, data flow diagrams, and operational support procedures.

Required Skills:

  • 4–8 years of hands-on experience in Python for backend or data engineering projects.
  • Strong understanding and working experience with GCP cloud services (especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.).
  • Solid understanding of data pipeline architecture, data integration, and transformation techniques.
  • Experience in working with version control systems like GitHub and knowledge of CI/CD practices.
  • Strong experience in SQL with at least one enterprise database (SQL Server, Oracle, PostgreSQL, etc.).



Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Egen Solutions

Founded :
2009
Type :
Services
Size :
100-1000
Stage :
Profitable

About

We build next-generation cloud-native data platforms and applications. Our clients rely on us to architect and execute next generation technology strategies. From building and migrating to cloud-native data platforms to designing new modern business models.
Read more

Company social profiles

bloglinkedintwitterfacebook

Similar jobs

Timble Technologies
at Timble Technologies
1 recruiter
Preeti Bisht
Posted by Preeti Bisht
Delhi, Gurugram
1 - 4 yrs
₹4L - ₹8.4L / yr
skill iconPython
skill iconDjango
RESTful APIs
skill iconRedis
Celery
+1 more

Job Title: L3 SDE (Python- Django)

Location: Arjan Garh, MG Road (Delhi)

Job Type: Full-time, On site

Pay Range: RS. 30,000- 70,000

**IMMEDIATE JOINERS REQUIRED**


About Us:

Our Aim is to develop ‘More Data, More Opportunities’. We take pride in building a cutting-edge AI solutions to help financial institutions mitigate risk and generate comprehensive data. Elevate Your Business's Credibility with Timble Glance's Verification and Authentication Solutions.


Responsibilities

• Writing and testing code, debugging programs, and integrating applications with third-party web services. To be successful in this role, you should have experience using server-side logic and work well in a team. Ultimately, you’ll build highly responsive web applications that align with our client’s business needs

• Write effective, scalable code

• Develop back-end components to improve responsiveness and overall performance

• Integrate user-facing elements into applications

• Improve functionality of existing systems

• Implement security and data protection solutions

• Assess and prioritize feature requests

• Coordinate with internal teams to understand user requirements and provide technical solutions

• Creates customized applications for smaller tasks to enhance website capability based on business needs

• Builds table frames and forms and writes script within the browser to enhance site functionality

• Ensures web pages are functional across different browser types; conducts tests to verify user functionality

• Verifies compliance with accessibility standards

• Assists in resolving moderately complex production support problems


Profile Requirements


* IMMEDIATE JOINERS REQUIRED

* 2 years or more experience as a Python Developer

* Expertise in at least one Python framework required Django

* Knowledge of object-relational mapping (ORM)

* Familiarity with front-end technologies like JavaScript, HTML5, and CSS3

* Familiarity with event-driven programming in Python

* Good understanding of the operating system and networking concepts.

* Good analytical and troubleshooting skills

* Graduation/Post Graduation in Computer Science / IT / Software Engineering

* Decent verbal and written communication skills to communicate with customers, support personnel, and management


How to apply: Drop your CV at linkedin.com/in/preeti-bisht-1633b1263/ with Current CTC, Current Notice and Expected CTC



Read more
NonStop io Technologies Pvt Ltd
Kalyani Wadnere
Posted by Kalyani Wadnere
Pune
2 - 5 yrs
Best in industry
skill iconPython
skill iconDjango
skill iconFlask
Data Structures
Algorithms
+4 more

We're seeking an AI/ML Engineer to join our team-

As an AI/ML Engineer, you will be responsible for designing, developing, and implementing artificial intelligence (AI) and machine learning (ML) solutions to solve real world business problems. You will work closely with cross-functional teams, including data scientists, software engineers, and product managers, to deploy and integrate Applied AI/ML solutions into the products that are being built at NonStop io. Your role will involve researching cutting-edge algorithms, data processing techniques, and implementing scalable solutions to drive innovation and improve the overall user experience.


Responsibilities

  • Applied AI/ML engineering; Building engineering solutions on top of the AI/ML tooling available in the industry today. Eg: Engineering APIs around OpenAI
  • AI/ML Model Development: Design, develop, and implement machine learning models and algorithms that address specific business challenges, such as natural language processing, computer vision, recommendation systems, anomaly detection, etc.
  • Data Preprocessing and Feature Engineering: Cleanse, preprocess, and transform raw data into suitable formats for training and testing AI/ML models. Perform feature engineering to extract relevant features from the data
  • Model Training and Evaluation: Train and validate AI/ML models using diverse datasets to achieve optimal performance. Employ appropriate evaluation metrics to assess model accuracy, precision, recall, and other relevant metrics
  • Data Visualization: Create clear and insightful data visualizations to aid in understanding data patterns, model behavior, and performance metrics
  • Deployment and Integration: Collaborate with software engineers and DevOps teams to deploy AI/ML models into production environments and integrate them into various applications and systems
  • Data Security and Privacy: Ensure compliance with data privacy regulations and implement security measures to protect sensitive information used in AI/ML processes
  • Continuous Learning: Stay updated with the latest advancements in AI/ML research, tools, and technologies, and apply them to improve existing models and develop novel solutions
  • Documentation: Maintain detailed documentation of the AI/ML development process, including code, models, algorithms, and methodologies for easy understanding and future reference

Requirements

  • Bachelor's, Master's or PhD in Computer Science, Data Science, Machine Learning, or a related field. Advanced degrees or certifications in AI/ML are a plus
  • Proven experience as an AI/ML Engineer, Data Scientist, or related role, ideally with a strong portfolio of AI/ML projects
  • Proficiency in programming languages commonly used for AI/ML. Preferably Python
  • Familiarity with popular AI/ML libraries and frameworks, such as TensorFlow, PyTorch, scikit-learn, etc.
  • Familiarity with popular AI/ML Models such as GPT3, GPT4, Llama2, BERT etc.
  • Strong understanding of machine learning algorithms, statistics, and data structures
  • Experience with data preprocessing, data wrangling, and feature engineering
  • Knowledge of deep learning architectures, neural networks, and transfer learning
  • Familiarity with cloud platforms and services (e.g., AWS, Azure, Google Cloud) for scalable AI/ML deployment
  • Solid understanding of software engineering principles and best practices for writing maintainable and scalable code
  • Excellent analytical and problem-solving skills, with the ability to think critically and propose innovative solutions
  • Effective communication skills to collaborate with cross-functional teams and present complex technical concepts to non-technical stakeholders
Read more
ProductWARfare
Noella Sadankar
Posted by Noella Sadankar
Hyderabad
4 - 8 yrs
₹15L - ₹18L / yr
Test Automation (QA)
skill iconPython
Microsoft TFS
skill iconGitHub
Software Development

Assignment Details

Our client, a global leader in energy management and automation, is seeking a skilled and experienced Test Automation Engineer with strong expertise in developing automation frameworks for Windows and Web applications. The ideal candidate will have hands-on experience with Python and Robot Framework, and a solid background in software development, debugging, and unit testing. This role requires the ability to work independently, contribute to the entire testing lifecycle, and collaborate with cross-functional teams in an Agile environment.

Key Responsibilities:

  • Design and develop robust Test Automation Frameworks for both Windows and Web applications.
  • Implement automated test cases using Python and Robot Framework.
  • Collaborate with development teams to understand feature requirements and break them down into actionable tasks.
  • Use version control and issue tracking tools like TFS/ADO, GitHub, Jira, SVN, etc.
  • Perform code reviews, unit testing, and debugging of automation scripts.
  • Clearly document and report test results, defects, and automation progress.
  • Maintain and enhance existing test automation suites to support continuous delivery pipelines.

Skills Required

  • 5–10 years of professional experience in Test Automation and Software Development.
  • Strong proficiency in Python and Robot Framework.
  • Solid experience with Windows and Web application testing.
  • Familiarity with version control systems such as TFS, GitHub, SVN and project tracking tools like Jira.
  • Strong analytical and problem-solving skills.
  • Ability to work independently with minimal supervision.
  • Excellent written and verbal communication skills for documentation and reporting.


Read more
Plumhq
at Plumhq
3 recruiters
Megha Singh
Posted by Megha Singh
Bengaluru (Bangalore)
5 - 8 yrs
₹15L - ₹30L / yr
skill iconDjango
skill iconFlask
skill iconPython
ORM
About Plum
 
We are making health insurance - simple, accessible and affordable. Hundreds of businesses of all sizes from startups to large corporates trust Plum for their employee's health protection.
 
Healthcare in India is seeing a phenomenal shift. Healthcare cost is seeing an inflation that is three times the general inflation. Treatments of diseases including Covid-19 can wipe out entire household savings. Majority of Indians won't be able to afford a health insurance on their own. As many as 600mn Indians would depend on employer-sponsored insurance.
 
Enter Plum. Plum is re-imagining the health insurance stack, and accelerating the penetration of health insurance in India to 100%. Plum has forged new underwriting and fraud detection algorithms to enable companies as small as 2 to benefit from a group insurance. The platform enables realtime insurance design & pricing to enable companies to buy insurance in 3-clicks. And offers employees a hassle-free claims experience through an integrated digital process.
 
Plum is backed by leading global investors including Tiger Global, Sequoia Capital, Tanglin Ventures and Incubate Fund (read more https://www.plumhq.com/blog/plum-series-a-funding">here)

Roles and Responsibilities:-
-Design and implementation of low-latency, high-availability, and performant APIs.
-Writing reusable, testable, and efficient code to build features and improvements to the - Plum product in a secure, well-tested, and performant way.
-Collaborate with Product Management and other stakeholders within Engineering (Frontend, UX, etc.) to maintain a high bar for quality in a fast-paced, iterative environment.
-Advocate for improvements to product quality, security, and performance.

Experience and Qualifications:-
-5+ years of experience of shipping backend applications in Python, with knowledge of at least one Python framework Django / Flask.
-Familiarity with some ORM (Object Relational Mapper) libraries.
-Able to integrate multiple data sources and databases into one system.
-Understanding of fundamental design principles behind a scalable API infrastructure. 
-Shows the drive for owning a project from concept to production, including proposal, discussion, and execution. Self-motivated and self-managing, with strong organizational skills.
-Having experience maintaining a production grade open source project is a plus.
Read more
Think learn Pvt-ltd Byjus
at Think learn Pvt-ltd Byjus
24 recruiters
Agency job
via zyoin by RAKESH RANJAN
Bengaluru (Bangalore)
6.1 - 9 yrs
₹20L - ₹38L / yr
skill iconGo Programming (Golang)
skill iconPython
skill iconRuby on Rails (ROR)
skill iconNodeJS (Node.js)

Responsibilities:

  • Hand on experience in Golang/Python/Ruby on Rails /Node.Js
  • Must have at least 1+ years of experience in Team Handling
Read more
Artificial Learning Systems
at Artificial Learning Systems
1 video
3 recruiters
Bindu Varma
Posted by Bindu Varma
Bengaluru (Bangalore)
5 - 8 yrs
₹5L - ₹20L / yr
Game Design
skill iconNodeJS (Node.js)
skill iconPython
skill iconJavascript
skill iconHTML/CSS
+4 more
Artificial Learning Systems India Pvt Ltd is looking for an exceptional Technical Lead who will work with the engineering team and will have a good background in, and understanding of, software systems, and one who has the ability to work closely with the rest of the Engineering team from the early stages of design all the way through identifying and resolving production issues. Candidate Profile: The ideal candidate will be passionate about this role which involves deep knowledge of both the application and the product, and he/she will also believe that automation is key to operating large-scale systems Education: BTech from IIT or equivalent Job Type: Full time, permanent Job Location: Bangalore Technical skills required: 5+ years’ experience as a backend web developer in python Do software design for the product development Strong understanding of the 3 key areas of web application architecture server backend, frontend presentation (HTML, CSS) and interactive web (Javascript and jQuery) Proficiency in python Proficiency in a modern open-source NoSQL database such as Cassandra, MongoDB Proficient in HTTP protocol, REST APIs, JSON Ability to do database design and modeling Experience with Flask/Django Experience with Javascript, jQuery Experience with Gunicorn, Celery Artificial Learning systems (Artelus) is a 16 month young company, bootstrapped and working in the Deep Learning space to solve healthcare problems. The company seeks to make products, which would complement the knowledge and assist clinicians in making faster and more accurate diagnoses. Our team comprises a group of dedicated scientists trying to make the world a healthier place using the latest advances in computer science and machine learning and applying it to the field of medicine and healthcare. Why Artelus? You will be joining a world-class, multidisciplinary team and will be participating in cutting-edge research in machine intelligence and artificial intelligence. You will be providing quality answers to large-scale problems with broad impact.
Read more
PandoCorp
at PandoCorp
5 recruiters
Pando Support
Posted by Pando Support
Chennai
3 - 9 yrs
₹12L - ₹24L / yr
skill iconJavascript
skill iconMongoDB
skill iconNodeJS (Node.js)
skill iconPHP
skill iconPython
+2 more
You will be one of our early team members. You will join a high calibre, result oriented team that builds for scale yet makes an impact everyday. Every developer is an owner and has the flexibility to dictate the choice of components, architecture etc..
Read more
Amazon India
at Amazon India
1 video
58 recruiters
Navin Kumar
Posted by Navin Kumar
Bengaluru (Bangalore)
2 - 4 yrs
₹15L - ₹25L / yr
skill iconJava
skill iconPython
Data Structures
Shell Scripting
Distributed Systems
+2 more
Amazon CloudSearch from Amazon Web Services (AWS) is looking for Software Development Engineers for its Bangalore team who can help build cutting edge search technologies for customers of all sizes. If you have a solid understanding of fundamental algorithms and system design and are able to produce bulletproof code, we are looking for you. CloudSearch team develops and maintains 2 of the AWS services "Amazon Elasticsearch Service" and "Amazon CloudSearch". We are part of AWS, Amazon web services. As a small company, we have a culture of creative problem solving, intellectual design, fast-paced development, and passionate product delivery. As a subsidiary of Amazon, we also have the longevity and resources of a larger company and the ability to quickly introduce our technology to millions of users. As a Elasticsearch Engineer, you will: · Design, develop, and support a world-class CloudSearch and Elasticsearch platform that manages thousands of search domains across 2 AWS services. · Focus on scalability, performance, service robustness, and cost trade-offs. (Especially as they pertain to a highly-virtualized, elastic, cloud-based environment) · Apply scientific analysis and mathematical modeling techniques to predict, measure, and evaluate the consequences of designs and the ongoing success of our platform · Continuously drive to explore, improve, enhance, automate, and optimize distributed systems and tools to best meet evolving business and market needs · Work alongside a dedicated operations team to develop and support the smooth 24x7 operation of our worldwide service · Participate in setting a vision and objectives for Amazon CloudSearch in alignment with business and market needs · Invent the future of search instead of just being a bystander · Mentor other SDEs and advise the leadership team on the technical vision.
Read more
Ideas2IT Technologies
at Ideas2IT Technologies
13 recruiters
Reshma P Ramesh
Posted by Reshma P Ramesh
Chennai
4 - 9 yrs
₹6L - ₹15L / yr
Virtualization
skill iconC++
skill iconPython
skill iconC#
skill iconGo Programming (Golang)
+2 more
Ideas2IT is a high-end product engineering firm. Started by an ex-Googler, Murali Vivekanandan, we count Siemens, Motorola, eBay, Microsoft and many Silicon Valley startups among our clients. We build enterprise products leveraging bleeding edge technologies for startups. We also roll out innovative products of our own. To give a taste, we recently rolled out Pipecandy, an AI Sales Intelligence platform and got it funded by top-tier investors. We have more products in the making! We are betting big on Data Science, Machine Learning, and Deep Learning. All our current/nextgen products are on this platform. To enable this, we are ramping up our DS/ML practice under Ideas2IT Predictive Labs. Desired Skills: * 4+ years of programming experience which should include hands-on programming in C++. * Strong understanding of Data Structures & Algorithms * Knowledge of one of statistical/general purpose scripting languages software such as R, Python * Strong mathematical background, with good knowledge in any two of the following disciplines - probability, quantitative finance, numerical methods, multivariate statistics, econometrics, optimization, time series analysis, Machine learning. * Excellent problem solving and analysis skills. * Willing to learn on work on Big data technologies
Read more
Browntape Technologies Pvt. Ltd.
at Browntape Technologies Pvt. Ltd.
1 video
4 recruiters
Shivani Barve
Posted by Shivani Barve
Mumbai/Goa
2 - 4 yrs
₹5L - ₹8L / yr
MySQL
skill iconPython
skill iconPHP
skill iconjQuery
AJAX
+3 more
We are looking for a smart technologist to be one of the pillars of our tech team in our Goa office. We want to hire someone who can self-learn fast, innovate and accelerate our product development. You must have • Some web development experience with a great deal of passion for it (not necessarily a degree in computer science) • A knack to write code for humans. "Always code as if the person who will maintain your code is a maniac serial killer that knows where you live" • Vision to setup coding practices which help us accelerate • Great understanding of server-side engineering (databases, MVC, JS MVC and more) • Ability to think creatively. Finding the simple "right" answer, in an extensible way • A penchant for making things simple for the user • A smile on your face, and a tinkle in your eyes • Good to haves: Expertise in CakePHP and open source contributions Responsibilities: • Study the architecture of our app • Build features and modules designed by the design team • Write clean code with scalability and performance in mind • Daily/Weekly code check-ins • Write unit tests for your code • Integrate with external APIs to fetch, process, organize and present data dynamically Skills Required: • LAMP • PHP & CakePHP • MySQL • HTML5 and CSS3 jQuery / AngularJS Additional good-to-have skills: Open-source contributions We are currently working with the following stack... • Apache as the webserver • CakePHP for the backend • MySQL as the database • Sphinx for the search • HTML5 and CSS3 for the front end • jQuery and Backbone.js for the interaction • Redis for queues
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos