Cutshort logo
Egen Solutions logo
GCP Data Engineer
GCP Data Engineer
Egen Solutions's logo

GCP Data Engineer

Hemavathi Panduri's profile picture
Posted by Hemavathi Panduri
4 - 8 yrs
₹12L - ₹25L / yr
Hyderabad
Skills
skill iconPython
Google Cloud Platform (GCP)
ETL
Apache Airflow

We are looking for a skilled and motivated Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data pipelines. The role involves working with various GCP services, implementing data ingestion and transformation logic, and ensuring data quality and consistency across systems.


Key Responsibilities:

  • Design, develop, test, and maintain scalable ETL data pipelines using Python.
  • Work extensively on Google Cloud Platform (GCP) services such as:
  • Dataflow for real-time and batch data processing
  • Cloud Functions for lightweight serverless compute
  • BigQuery for data warehousing and analytics
  • Cloud Composer for orchestration of data workflows (based on Apache Airflow)
  • Google Cloud Storage (GCS) for managing data at scale
  • IAM for access control and security
  • Cloud Run for containerized applications
  • Perform data ingestion from various sources and apply transformation and cleansing logic to ensure high-quality data delivery.
  • Implement and enforce data quality checks, validation rules, and monitoring.
  • Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver efficient data solutions.
  • Manage version control using GitHub and participate in CI/CD pipeline deployments for data projects.
  • Write complex SQL queries for data extraction and validation from relational databases such as SQL Server, Oracle, or PostgreSQL.
  • Document pipeline designs, data flow diagrams, and operational support procedures.

Required Skills:

  • 4–8 years of hands-on experience in Python for backend or data engineering projects.
  • Strong understanding and working experience with GCP cloud services (especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.).
  • Solid understanding of data pipeline architecture, data integration, and transformation techniques.
  • Experience in working with version control systems like GitHub and knowledge of CI/CD practices.
  • Strong experience in SQL with at least one enterprise database (SQL Server, Oracle, PostgreSQL, etc.).



Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Egen Solutions

Founded :
2009
Type :
Services
Size :
100-1000
Stage :
Profitable

About

We build next-generation cloud-native data platforms and applications. Our clients rely on us to architect and execute next generation technology strategies. From building and migrating to cloud-native data platforms to designing new modern business models.
Read more

Company social profiles

bloglinkedintwitterfacebook

Similar jobs

Gurugram
4 - 7 yrs
₹40L - ₹55L / yr
Software Development
skill iconJava
skill iconPython
Team Management
skill iconAmazon Web Services (AWS)
+2 more

Strong Software Engineer, Engineering Manager Profiles

Mandatory (Experience) – Must have minimum 4+ years of hands on experience in software development

Mandatory (Tech Skillset) – Must have 3+ years of hands-on experience in backend development using Java / Node.js / Go / Python (any 1) OR 3+ YOE in frontend Development using React / Angular / Vue (any 1)

Mandatory (Mentoring Skillset) – Must have at least 1+ year of experience leading or mentoring a team of software engineers.

Mandatory (Tech Skills) – Must have a solid understanding of microservices architecture, APIs, and cloud platforms (AWS / GCP / Azure).

Mandatory (DevOps Skillset) – Must have hands-on experience working with Docker, Kubernetes, and CI/CD pipelines.

Mandatory (Company) – Top-tier/renowned product-based company (preferred Entreprise B2B SaaS)

Mandatory (Education) – Undergraduation from Tier-1 Engineering College (IIT, BITS, IIIT, NSUT, DTU, etc.)

Mandatory (Note): No hire policy from Sprinklr

Read more
Procedure
at Procedure
4 candid answers
3 recruiters
Adithya K
Posted by Adithya K
Remote only
5 - 10 yrs
₹40L - ₹60L / yr
Software Development
skill iconAmazon Web Services (AWS)
skill iconPython
TypeScript
skill iconPostgreSQL
+3 more

Procedure is hiring for Drover.


This is not a DevOps/SRE/cloud-migration role — this is a hands-on backend engineering and architecture role where you build the platform powering our hardware at scale.


About Drover

Ranching is getting harder. Increased labor costs and a volatile climate are placing mounting pressure to provide for a growing population. Drover is empowering ranchers to efficiently and sustainably feed the world by making it cheaper and easier to manage livestock, unlock productivity gains, and reduce carbon footprint with rotational grazing. Not only is this a $46B opportunity, you'll be working on a climate solution with the potential for real, meaningful impact.


We use patent-pending low-voltage electrical muscle stimulation (EMS) to steer and contain cows, replacing the need for physical fences or electric shock. We are building something that has never been done before, and we have hundreds of ranches on our waitlist.


Drover is founded by Callum Taylor (ex-Harvard), who comes from 5 generations of ranching, and Samuel Aubin, both of whom grew up in Australian ranching towns and have an intricate understanding of the problem space. We are well-funded and supported by Workshop Ventures, a VC firm with experience in building unicorn IoT companies.


We're looking to assemble a team of exceptional talent with a high eagerness to dive headfirst into understanding the challenges and opportunities within ranching.


About The Role

As our founding cloud engineer, you will be responsible for building and scaling the infrastructure that powers our IoT platform, connecting thousands of devices across ranches nationwide.


Because we are an early-stage startup, you will have high levels of ownership in what you build. You will play a pivotal part in architecting our cloud infrastructure, building robust APIs, and ensuring our systems can scale reliably. We are looking for someone who is excited about solving complex technical challenges at the intersection of IoT, agriculture, and cloud computing.


What You'll Do

  • Develop Drover IoT cloud architecture from the ground up (it’s a green field project)
  • Design and implement services to support wearable devices, mobile app, and backend API
  • Implement data processing and storage pipelines
  • Create and maintain Infrastructure-as-Code
  • Support the engineering team across all aspects of early-stage development -- after all, this is a startup


Requirements

  • 5+ years of experience developing cloud architecture on AWS
  • In-depth understanding of various AWS services, especially those related to IoT
  • Expertise in cloud-hosted, event-driven, serverless architectures
  • Expertise in programming languages suitable for AWS micro-services (eg: TypeScript, Python)
  • Experience with networking and socket programming
  • Experience with Kubernetes or similar orchestration platforms
  • Experience with Infrastructure-as-Code tools (e.g., Terraform, AWS CDK)
  • Familiarity with relational databases (PostgreSQL)
  • Familiarity with Continuous Integration and Continuous Deployment (CI/CD)


Nice To Have

  • Bachelor’s or Master’s degree in Computer Science, Software Engineering, Electrical Engineering, or a related field


Read more
Simpl
at Simpl
3 recruiters
Arya Muralidharan
Posted by Arya Muralidharan
Remote only
2 - 10 yrs
Best in industry
skill iconGo Programming (Golang)
skill iconRuby
skill iconRuby on Rails (ROR)
skill iconPython
Relational Database (RDBMS)
+1 more

About Simpl 

The thrill of working at a start-up that is starting to scale massively is something else. Simpl (FinTech startup of the year - 2020) was formed in 2015 by Nitya Sharma, an investment banker from Wall Street and Chaitra Chidanand, a tech executive from the Valley, when they teamed up with a very clear mission - to make money simple, so that people can live well and do amazing things. Simpl is the payment platform for the mobile-first world, and we’re backed by some of the best names in fintech globally (folks who have invested in Visa, Square and Transferwise), and has Joe Saunders, Ex Chairman and CEO of Visa as a board member.

Everyone at Simpl is an internal entrepreneur who is given a lot of bandwidth and resources to create the next breakthrough towards the long term vision of “making money Simpl”. Our first product is a payment platform that lets people buy instantly, anywhere online, and pay later. In the background, Simpl uses big data for credit underwriting, risk and fraud modelling, all without any paperwork, and enables Banks and Non-Bank Financial Companies to access a whole new consumer market.

In place of traditional forms of identification and authentication, Simpl integrates deeply into merchant apps via SDKs and APIs. This allows for more sophisticated forms of authentication that take full advantage of smartphone data and processing power.

--------

We’re looking for polyglot developers who love to code. You should have >3 years of experience building high-quality products. You should have the ability to write clean code and must’ve worked on one of Ruby, NodeJS, Golang or Python

 

Responsibilities

  1. Develop new features - build POCs, get feedback, and scale is our default mode
  2. Building reusable and platform specific components
  3. Translating designs and wireframes into high-quality code
  4. Optimizing services for maximum performance
  5. Ensure faster release cycles by managing distribution over the cloud 

Requirements

  1. Hands-on experience in all aspects of software development - analysis, coding, writing tests, deployment, the works.
  2. Knowledge of relational databases, SQL, ACID and distributed locking
  3. Solid OOPS understanding.
  4. Good exposure to building distributed systems, micro-services architecture.
  5. Continuous delivery experience
  6. Exposure to building platforms (not just products) would be a plus
Read more
eBikeGO
at eBikeGO
1 recruiter
Dakshata Kadam
Posted by Dakshata Kadam
Mumbai
1.5 - 9 yrs
₹4L - ₹7L / yr
skill iconPython
skill iconDjango
skill iconPostgreSQL
NOSQL Databases
CI/CD
+1 more

Years of Experience:- 1.5+

Qualification:- BE Computer Engineering/MCA

Industry:- Software
Location:- Andheri

Job Description - 
 
1. Building REST API’s & Services In Django Framework 
2. Building reusable code and libraries for future use 
3. Optimization of the application for maximum speed and scalability 
4. Implementation of security and data protection 
5. Design and implementation of the database schema 
6. Design and implementation of data storage solutions
7. Implementing CI/CD pipeline
 
 Skills And Qualifications
 
1. Proficient knowledge of a back-end programming language Python
2. Hands-on experience with Python Frameworks like Django 
3. Proficient knowledge of MySQL, PostgreSQL 
4. Creating database schemas that represent and support business processes (Relational & NoSQL)
5. Understanding of token-based authentication systems.
6. Understanding and Hands-on knowledge of the asynchronous task/job processing 
7. Understanding of queueing systems like Redis/AWS SQS
8. Understanding accessibility and security compliance
9. User authentication and authorization between multiple systems, servers, and environments
10. Integration of multiple data sources and databases into one system 
11. Data migration, transformation, and scripting 
12. Setup and administration of backups 
13. Understanding differences between multiple delivery platforms such as mobile vs desktop, and optimizing output to match the specific platform 
14. Implementing automated testing platforms and unit tests 
15. Proficient understanding of code versioning tools, such as Git 
16. Proficient understanding of OWASP security principles 
17. Understanding of “session management” in a distributed server environment 
 
Brownie Points
 
1. Experience in Docker
2. HandsOn Knowledge with implementing CI/CD pipelines 
3. Experience in managing applications on AWS
4. Management of the hosting environment, including database administration and scaling an application to support load changes 5. Product wide application-level thinking on API and data modeling  
 



Read more
AIndra Systems
at AIndra Systems
2 recruiters
Evelyn Immanuel
Posted by Evelyn Immanuel
Bengaluru (Bangalore)
9 - 12 yrs
₹12L - ₹18L / yr
skill iconPython
skill iconJavascript
skill iconAmazon Web Services (AWS)
skill iconJava
skill iconGo Programming (Golang)
+1 more
Envision and develop the long-term architectural direction, with emphasis on platforms/ reusable components while adopting a nimble delivery process. Establish structures and processes that ensure a high level of quality and reliability and extensibility of deliverables Develop design and coding principles and standards and drive code and design reviews of products and drive the architectural governance for them · Set directional paths for the teams/department for adoption of new technology stacks for solving business problems · Be a very visible representative of multiple technology domains and represent AIndra in external technical forums · Work with product management, business stakeholders and other engineering leaders to help define mid-term, long-term roadmaps and shape business directions · Initiate and deliver leadership training within the engineering organisation, including training new managers, and drive the growth of leaders to create a strong leadership bench. Desired Skills and Experience 13+ years of experience in software product development A solid engineer at heart with excellent abstraction, coding and system design skills. Must have the ability to be hands-on and pick up and execute on key projects with a small team. Strong understanding of business fundamentals and the ability to work across stakeholders outside engineering will be required. A proven track record of leading the architecture and delivery in a startup ecosystem within a high growth environment Successfully architected and led technology for consumer facing products in the global market Must have exposure to leading product development end-end ( portfolio to delivery, re-architectures) Strong hands-on technology experience building and running large scale systems Solid experience in large scale Database systems. Experience with NoSQL stores will be a huge plus Strong design/development experience in building massively large scale distributed internet systems and products Excellent Java (or other high level languages) programming skills and expertise in multi-threading and performance oriented programming. Being a polyglot with exposure and hands on work across multiple technology stacks will be highly desired. Excellent computer fundamentals and problem solving skills Excellent data structures & algorithms skills Experience and knowledge of open source software, frameworks and broader cutting edge technologies Must have a degree in Computer Science or related field. Strong understanding of object-oriented programming, concurrency and fundamentals of computer-science
Read more
PayPal
Bengaluru (Bangalore)
10 - 15 yrs
₹30L - ₹80L / yr
skill iconPython
skill iconJava
skill iconGo Programming (Golang)
At PayPal, we believe that now is the time to democratize financial services so that moving and managing money is a right for all citizens, not just the affluent. We are driven by this purpose, and we uphold our cultural values of collaboration, innovation, wellness and inclusion as our guide for making decisions and conducting business every day. It is our duty and privilege to be customer champions and put those we serve at the center of everything we do. We are one team that respects and values diversity of thought for everyone, everywhere, and we actively seek to create an energizing workplace that brings out the best in all of us. If you are ready to shape the future of money, join the team at PayPal. We are proud to work here. You will be too. Core Platform and Infrastructure (CPI) team is the technology engine that powers PayPal’s business. We deliver a seamlessly scalable, exceptionally efficient, highly reliable infrastructure and services platform in a hybrid cloud environment. Thousands of PayPal developers build and run hundreds of applications processing billions of calls daily with high availability and reliability on our Java middleware framework products. As a team, we are active in the open source community, are proud of our systems knowledge, technology breadth, and intellectual curiosity. We are driven to empower PayPal developers in the best way possible. o As part of Developer Experience organization, our mission is to reduce the cycle time of software delivery and enabling development teams to quickly take their code changes to production with highest quality which can only be done with a world class testing platform. o You will be working with a team of strong engineers who enable the rest of development community to quickly and reliably test their code changes. o You will be building the next generation test platform that enables rich data insights into identifying the gaps in testing and introduce, influence the culture of great test practices and engineering disciplines within the organization. o You will be focused on solving the hardest, most interesting challenges of reducing the testing cycle time and building tools that can intelligently triage failures. o You will build framework that enables the rest of the development community effectively contribute with utilities that can enhance the quality at PayPal. o You will use your knowledge of testing and testability to influence better software design, promote proper engineering practice, bug prevention strategies, testability, accessibility, and other advanced quality concepts across products. o You will be building frameworks, tools and solutions for the rest of PayPal developer community. o Work directly with Architecture, Product Managers, Program Managers and stakeholders from clients that integrates with the frameworks and tools o Skills needed: o 10+ years of hands-on experience in designing and developing scalable web services and platforms. o Experience in providing technical leadership and guidance to engineering teams. o Strong experience in Java, Python and scripting. o Knowledge in DevOps lifecycle is a must. o Working experience in building platform solutions is a plus. o Knowledge in GoLang a huge plus o Knowledge and experience in cloud technologies a huge plus o Excellent written and verbal communication skills with the ability to present complex technical information in a clear and concise manner to a variety of audiences. o BS in computer science or equivalent
Read more
Niki.ai
at Niki.ai
6 recruiters
Suchandni Verma
Posted by Suchandni Verma
Bengaluru (Bangalore)
4 - 6 yrs
₹10L - ₹25L / yr
skill iconJava
skill iconPython
Distributed Systems
skill iconMachine Learning (ML)
Object Oriented Programming (OOPs)
+2 more
- Niki is an artificially intelligent personal shopping assistant (http://niki.ai/app). Our founding team is from IIT Kharagpur, and we are looking for a Backend Developer to join us in the core software development and maintenance. - We work mostly in Java and Python and object oriented concepts are a must to fit in the team. If you have experience in :1. Working at a high-traffic consumer facing company for minimum 5 years. 2. Architecting scalable systems in terms of making key decisions about database options, server frameworks, sync vs async, distributed vs monolithic, redundancy etc. 3. Ensuring fault tolerance and optimal latency of distributed and concurrent systems. 4. Mitigating and recovering from large scale system crashes and disasters. 5. Automation and consumer centric machine learning implementations - setting up ground truth, feedback loops and A/B testing. 6. Large scale monitoring and alarm systems. 7. Thinking backwards from a customer POV and relentlessly pursuing customer's cause in tech and product decisions. And you are always ready to get your hands dirty with coding and shipping products and services covering all the aspects yourselves - requirements gathering, resource allocation, testing, deploying, monitoring and iterating. Basic eligibility criteria are : 1. Graduate/Post-Graduate in Computer Science/Mathematics/Physics or allied fields. 2. Industry experience of 5-9 years in developing scalable software. 3. Have some experience in leading a team big or small.
Read more
Ekino
Dhruv Dutta
Posted by Dhruv Dutta
Bengaluru (Bangalore)
3 - 7 yrs
₹5L - ₹7L / yr
skill iconJavascript
skill iconPHP
skill iconPython
skill iconRuby on Rails (ROR)
skill iconNodeJS (Node.js)
+2 more
Role and Responsibilities: • Design, develop, test and deploy code using the best technologies and patterns • Follow, refine and adapt ekino coding & deployment standards & practices • Adopt and manage ekino development & deployment process as defined by the technical leaders of the team • Analyze requirements against existing framework and available alternatives to develop effective solutions • Maintain documentation for all the projects that you are working on. • Work closely with the product management and QA teams to build, test and release all products • Ensure project timelines are achieved • Development is done using an agile/waterfall methodology in an energized, collaborative environment Required Skills & Experience: ● Technical skills • Understanding of software modeling, design patterns and OOP • Previous experience with Drupal 7+, Symfony, Yii 2.0 or any other MVC Framework • Minimum 1-2 years of experience in Web development using LAMP/LEMP stack • Strong command of PHP 5+, MySQL, HTML5, CSS3 and Javascript • Working experience on GIT • Basic understanding of server and network architecture Management and soft skills • Ability to work alone with minimal supervision • Strong interpersonal skills • Eager to test and learn new technologies and frameworks • Analytical abilities and problem solving skills • Self- motivated, with ability to work independently • Attention to details and deadlines • Attention to work with processes and standards • Ability to multi-task daily and manage time efficiently • Able to work efficiently in fast-paced environment with team members
Read more
RecoSense Infosolutions Pvt Ltd
Sandhya BY
Posted by Sandhya BY
Bengaluru (Bangalore)
2 - 8 yrs
₹5L - ₹11L / yr
skill iconPython
skill iconMongoDB
skill iconAmazon Web Services (AWS)

About RecoSense

We are a growing SaaS based data analytics startup at revenue stage with multiple customers. We are looking for Python programmer who can be part of core product team in taking the product forward.

Flexible work timings, Stock options, Architect role to lead the product. Visit http://recosenselabs.com">http://recosenselabs.com.

Requirement: We are looking for a good programmer with following skills:

Sr. python developer

Experience:  2- 5 years

Requirements:

  1. Mandatory good experience in Python and Mongodb
  2. Expertise in cloud management
  3. Proficient in shell scripting
  4. Expert in modular code writing skills
  5. Explorative(geek on what's going around technology)
  6. Worked on Spark, AWS, is plus
  7. Hands on Postgres
  8. Experienced on developing a product from scratch to production
  9. Experience on developing modular backend architecture

Location of Work

We are located in Banashankari 2nd stage, Bangalore. Looking for a full time candidate.

Work hours and location of Work is flexible.

Benefit for Candidate

  1. Part of the Core Team in the Company
  2. Growth along with the Company
  3. Startup culture - Ability to work on best technologies, fast paced and dynamic
  4. Freedom to work independently.
  5. Equity incentives for long term interest
Read more
Hyderabad
3 - 5 yrs
₹4L - ₹7L / yr
skill iconJavascript
skill iconPHP
skill iconPython
skill iconRuby on Rails (ROR)
skill iconNodeJS (Node.js)
+2 more
Proxim Quest IT Solutions is looking for a Full Stack Developer- Job Description: 3+ years working with Javascript on either the front-end or the back-end of a web application Significant exposure to Angular development. Experienced and interested in Node.JS or other back-end programming language or framework Proficiency in front-end languages like HTML, CSS, JavaScript, and jQuery Solid understanding of OO and application design particularly as it relates to web development Must be familiar with all stages of the development life cycle including analysis, design, development and support. Exposure to agile approaches is advantageous especially test driven development. Solid understanding of web heuristics and design. If interested, please share the details below: 1. Current CTC 2. Expected CTC 3. Notice Period Job Type: Full-time
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos