Cutshort logo
CLOUDSUFI logo
Sr/Lead Data Engineer
Sr/Lead Data Engineer
CLOUDSUFI's logo

Sr/Lead Data Engineer

Ayushi Dwivedi's profile picture
Posted by Ayushi Dwivedi
6 - 11 yrs
₹30L - ₹45L / yr
Remote only
Skills
Google Cloud Platform (GCP)
SQL
skill iconPython

Highlights - Current location of candidate should be Bangalore

Total Exp - 6-12yrs

Joining Time period - Within 30 days

GCP Bigquery expert, GCP Certified


About Us

CLOUDSUFI, a Google Cloud Premier Partner, is a global leading provider of data-driven digital transformation across cloud-based enterprises. With a global presence and focus on Software & Platforms, Life sciences and Healthcare, Retail, CPG, financial services and supply chain, CLOUDSUFI is positioned to meet customers where they are in their data monetization journey.

 

Our Values 

We are a passionate and empathetic team that prioritizes human values. Our purpose is to elevate the quality of lives for our family, customers, partners and the community.

 

Equal Opportunity Statement 

CLOUDSUFI is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified candidates receive consideration for employment without regard to race, colour, religion, gender, gender identity or expression, sexual orientation and national origin status. We provide equal opportunities in employment, advancement, and all other areas of our workplace. Please explore more at https://www.cloudsufi.com/


Job Summary

We are seeking a highly skilled and motivated Data Engineer to join our Development POD for the Integration Project. The ideal candidate will be responsible for designing, building, and maintaining robust data pipelines to ingest, clean, transform, and integrate diverse public datasets into our knowledge graph. This role requires a strong understanding of Cloud Platform (GCP) services, data engineering best practices, and a commitment to data quality and scalability.


Key Responsibilities

ETL Development: Design, develop, and optimize data ingestion, cleaning, and transformation pipelines for various data sources (e.g., CSV, API, XLS, JSON, SDMX) using Cloud Platform services (Cloud Run, Dataflow) and Python.

Schema Mapping & Modeling: Work with LLM-based auto-schematization tools to map source data to our schema.org vocabulary, defining appropriate Statistical Variables (SVs) and generating MCF/TMCF files.

Entity Resolution & ID Generation: Implement processes for accurately matching new entities with existing IDs or generating unique, standardized IDs for new entities.

Knowledge Graph Integration: Integrate transformed data into the Knowledge Graph, ensuring proper versioning and adherence to existing standards. 

API Development: Develop and enhance REST and SPARQL APIs via Apigee to enable efficient access to integrated data for internal and external stakeholders.

Data Validation & Quality Assurance: Implement comprehensive data validation and quality checks (statistical, schema, anomaly detection) to ensure data integrity, accuracy, and freshness. Troubleshoot and resolve data import errors.

Automation & Optimization: Collaborate with the Automation POD to leverage and integrate intelligent assets for data identification, profiling, cleaning, schema mapping, and validation, aiming for significant reduction in manual effort.

Collaboration: Work closely with cross-functional teams, including Managed Service POD, Automation POD, and relevant stakeholders.


Qualifications and Skills

Education: Bachelor's or Master's degree in Computer Science, Data Engineering, Information Technology, or a related quantitative field.

Experience: 6+ years of proven experience as a Data Engineer, with a strong portfolio of successfully implemented data pipelines.

Programming Languages: Proficiency in Python for data manipulation, scripting, and pipeline development.

Cloud Platforms and Tools: Expertise in Google Cloud Platform (GCP) services, including Cloud Storage, Cloud SQL, Cloud Run, Dataflow, Pub/Sub, BigQuery, and Apigee. Proficiency with Git-based version control.


Core Competencies:

Must Have - SQL, Python, BigQuery, (GCP DataFlow / Apache Beam), Google Cloud Storage (GCS)

Must Have - GCP Certification

Must Have - Proven ability in comprehensive data wrangling, cleaning, and transforming complex datasets from various formats (e.g., API, CSV, XLS, JSON)

Secondary Skills - SPARQL, Schema.org, Apigee, CI/CD (Cloud Build), GCP, Cloud Data Fusion, Data Modelling

Solid understanding of data modeling, schema design, and knowledge graph concepts (e.g., Schema.org, RDF, SPARQL, JSON-LD).

Experience with data validation techniques and tools.

Familiarity with CI/CD practices and the ability to work in an Agile framework.

Strong problem-solving skills and keen attention to detail.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About CLOUDSUFI

Founded :
2019
Type :
Products & Services
Size :
100-1000
Stage :
Profitable

About

We exist to eliminate the gap between “Human Intuition” and “Data-Backed Decisions”


Data is the new oxygen, and we believe no organization can live without it. We partner with our customers to get to the core of their problems, enable the data supply chain and help them monetize their data. We make enterprise data dance!


Our work elevates the quality of lives for our family, customers, partners and the community.


The human values that we display in all our interactions are of:


Passion – we are committed in heart and head

Integrity – we are real, honest and, fair

Empathy – we understand business isn’t just B2B, or B2C, it is H2H i.e. Human to Human

Boldness – we have the courage to think and do differently


The CLOUDSUFI Foundation embraces the power of legacy and wisdom of those who have helped laid the foundation for all of us, our seniors. We believe in their abilities and we pledge to equip them, to provide them jobs, and to bring them sufi joy.

Read more

Tech stack

skill iconGo Programming (Golang)
skill iconJava
skill iconMachine Learning (ML)
skill iconData Analytics
skill iconReact.js
skill iconReact Native
Information security
Cyber Security
Data engineering
SAP

Connect with the team

Profile picture
Harmeet Singh
Profile picture
Ayushi Dwivedi
Profile picture
Lishta Jain

Company social profiles

instagramlinkedintwitterfacebook

Similar jobs

Bengaluru (Bangalore)
1 - 3 yrs
₹7L - ₹12L / yr
Implementation engineer
SaaS

Strong Implementation Specialist / Implementation Engineer / Technical Implementation Associate (Post-Sales SaaS) Profiles

Mandatory (Experience 1): Must have 1+ years of hands-on experience in software/tech Implementation roles within technical B2B SaaS companies, preferably working with global or US-based clients

Mandatory (Experience 2): Must have experience in executing and supporting end-to-end SaaS product implementations, including customer onboarding, workflow & configuration setup, data modeling/data setup, API-based integrations, and go-live support.

Mandatory (Experience 3): Must have strong technical fundamentals — ability to understand data models, debug API workflows, read JSON payloads, write basic SQL queries, and support configuration troubleshooting.

Mandatory (Experience 4): Must have basic hands-on experience writing scripts (preferably JavaScript) for data migration, configuration automation, or workflow customization in SaaS products.

Mandatory (Experience 5): Must have worked in post-sales environments, supporting customer success and delivery after deal closure, ensuring product adoption, accurate setup, and smooth go-live.

Mandatory (Experience 6): Must have experience collaborating cross-functionally with product, engineering, and sales teams to ensure timely resolution of implementation blockers and seamless client onboarding.

Mandatory (Company Type): B2B SaaS startup or growth-stage company

Read more
Cinetoons Animation
Cinetoons Animation
Posted by Cinetoons Animation
Remote only
0 - 5 yrs
₹1L - ₹3L / yr
Training and Development

Hi,

We are looking for MERN Fullstack Developer. Can work remotely. Need to handle both frontend and backend. Please reply if interested.

Thanks!

Cinetoons


Read more
Orbital
Rohini P
Posted by Rohini P
Hyderabad
4 - 7 yrs
₹8L - ₹25L / yr
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJavascript
+6 more
  • 4 to 7 years of experience (or equivalent understanding of software engineering)
  • Strong in Javascript & Typescript + frameworks like React, Next.js, Angular, etc.
  • Strong experience in architecting complex, distributed systems in public or private cloud
  • Willingness and interest in learning new tech/processes (Python, Airflow, Postgres, etc.)
  • Willingness to travel to offices in New York City, San Francisco, and Hyderabad
Read more
Goodrich Maritime Pvt Ltd
Mumbai, Navi Mumbai
1 - 2 yrs
₹2.4L - ₹3L / yr
Human Resources (HR)
Onboarding
Data management
Payroll Management
Human Resource Management System (HRMS)
+3 more
  1. A competent user of all internal systems, to include our employee records system (HRMS- SPINE)
  2. Updating and maintaining HR systems, records, and reports with accurate employee data.
  3. Undertake all required pre-employment checks, updating, and discussing with line manager and recruitment team as appropriate.
  4. Providing MIS & monthly employee payroll data in support of the payroll subject matter expert.
  5. Processing changes to employee's circumstances, including preparing accurate and effective documentation/communication and updating relevant databases.
  6. Processing leavers, including preparing accurate, relevant documentation and updating systems accordingly.
  7. Producing Information reports and complete any HR audit requirements and/or reporting as required.
  8. Ensuring that the end-to-end HR process always supports a positive employee experience.
  9. Following existing HR processes accurately and challenging these for ongoing efficiencies.
  10. Supporting HR priority projects with any administrative activity
  11. Responding to emails on behalf of the department
  12. Providing ad-hoc administrative support to any of the other HR functions, as necessary and in line with business requirements.
Read more
Wallero technologies
at Wallero technologies
5 recruiters
Keerthana M
Posted by Keerthana M
Hyderabad
4 - 15 yrs
₹10L - ₹25L / yr
Windows Azure
Azure
DevOps
SQL Azure
CI/CD
+2 more

Job Description:

Responsibilities

·       Having E2E responsibility for Azure landscape of our customers

·       Managing to code release and operational tasks within a global team with a focus on automation, maintainability, security and customer satisfaction

·       Make usage of CI/CD framework to rapidly support lifecycle management of the platform

·       Acting as L2-L3 support for incidents, problems and service request

·       Work with various Atos and 3rd party teams to resolve incidents and implement changes

·       Implement and drive automation and self-healing solutions to reduce toil

·       Enhance error budgets and hands on design and development of solutions to address reliability issues and/or risks

·       Support ITSM processes and collaborate with service management representatives

 

Job Requirements

·       Azure Associate certification or equivalent knowledge level

·       5+ years of professional experience

·       Experience with Terraform and/or native Azure automation

·       Knowledge of CI/CD concepts and toolset (i.e. Jenkins, Azure DevOps, Git)

·       Must be adaptable to work in a varied, fast paced exciting, ever changing environment

·       Good analytical and problem-solving skills to resolve technical issues

·       Understanding of Agile development and SCRUM concepts a plus

·       Experience with Kubernetes architecture and tools a plus

Read more
Srijan Technologies
at Srijan Technologies
6 recruiters
Rinku Sharma
Posted by Rinku Sharma
Remote only
3 - 8 yrs
₹7L - ₹14L / yr
skill iconNodeJS (Node.js)
skill iconReact.js
skill iconJavascript
Fullstack Developer
skill iconHTML/CSS
+4 more

About the job

Srijan is hiring for the position of Senior JavaScript Developer (React & Node)

with a remote working option.

 

 

Skills Required:

  • Minimum 3-5 years of experience as a Front-end Developer

  • Possess Responsive/Mobile Design Skills

  • Knowledge of Cross-Browser Development

  • Knowledge of JavaScript frameworks like NodeJS, ReactJS etc.

  • Worked on Front End Frameworks like Bootstrap

  • Worked on markup languages like HTML, HTML5

  • Worked on JavaScript, CSS, and jQuery

  • Excellent knowledge of browser troubleshooting and debugging practices and techniques

  • Knowledge of some SEO principles

  • Knowledge of graphics software such as Adobe Suite, Photoshop, etc.

  • Sense of ownership and pride in your performance and its impact on the company’s success

  • Critical thinker and problem-solving skills

  • Team player

  • Good time-management skills

  • Good interpersonal and communication skills

 

Read more
Nova Semita
at Nova Semita
2 recruiters
Raj Kunkolienkar
Posted by Raj Kunkolienkar
Goa
2 - 5 yrs
₹6L - ₹7L / yr
skill iconNodeJS (Node.js)
skill iconPostgreSQL
skill iconJavascript
skill iconAmazon Web Services (AWS)
NOSQL Databases
+3 more
🔎 Nova Semita runs a fellowship for ambitious and talented college students that seeks to solve for India’s graduate employability crisis. The fellowship runs online and is pursued by our fellows at their own time. We believe in learning through the best of online content and working collaboratively to build projects to cement our understanding. We are extremely student friendly and host a community of enthusiastic, hungry learners waiting for you to kick-start their journey in tech. We’ve run a successful pilot and are now looking to scale. This is a student-facing role on the technical facilitation team, reporting directly to the founders. As a facilitator for the front end track, you’ll be responsible for producing individuals who are ready to join product-oriented companies upon graduation. We expect you to ensure this via testing the understanding of students, solving doubts and helping students with their projects. You will be assisted by fellowship success executives who will help you track learnings and engage with students. 🙋🏽‍♀️ What are you going to do? ✅ Build, implement and iterate upon the Back-End Track curriculum that produces industry-ready graduates. ✅ Collaborate with other instructors and fellowship success executives as needed. ✅ Accountable for competency building and doubt resolution rates. ✅ Oversee groups of fellows who undertake internal/external projects The responsibilities do NOT include delivery of live lectures. 💫 Requirements ✅ 2+ years of industry experience in developing backend tech using Node.js ✅ SQL & NoSQL DB modeling and querying skills. ✅ API development experience using Express / Hapi.js frameworks. ✅ Experience working with cloud infrastructure such as AWS EB, S3, EC2, Lambda, DynamoDB ✅ Familiarity with popular JavaScript tools, frameworks, and design principles, and enthusiasm for keeping pace with the ever-changing JavaScript ecosystem. ✅ Strong communication skills, with an inclination towards teaching and helping others out. ✅ Ability to work with a diverse group of individuals. 🚫 Your college pedigree doesn’t matter to us. 👍🏽 Good to have ❇️ Understanding of pedagogy and curriculum development. ❇️ Ability to work with Python is a bonus. ❇️ Experience with CI/CD, build and testing tools. ❇️ Experience with GraphQL servers. ❇️ Basic understanding of front-end frameworks such as React.js / Vue.js ❇️ Prior experience working in a startup environment. 🏖 Perks 😏 We are based out of Goa and know the place inside out. Soon, you would too. 😃 High level of freedom and flexible timings. 🥊 Undoubtedly, the ability to act on problems with our education system. 👨🏽‍💻 We're a young team and we embrace the latest tech in town.
Read more
www.talentdekho.in
at www.talentdekho.in
1 recruiter
saloni mehta
Posted by saloni mehta
Vadodara
3 - 7 yrs
₹3L - ₹8L / yr
0066
Sales Operations
Event Management
Marketing & Communication
Roles & Responsibilities: - Tie-up with schools/colleges/academies/workplaces, etc. to create a pool of talent for the app - Maintain relations with the talent of the app – ensure that they are engaged & active - Plan, organize & execute creator meets & other events in the city - Identify local events & associations for sponsorships & tie-ups - Conduct college activities & events to create a buzz in the city - Plan marketing campaigns (hoardings/radio/print, etc.) in association with the national marketing team - Enrol team of interns, whenever required, and manage their tasks - Responsible for everything required to for creating a buzz for the app in the city - Rope in brands/companies for sponsorships/advertising on our app or for events organized by Talent Dekho (sales function) Desired skills & qualifications: - 3+ years of experience in sales/marketing role - Graduation is a must - Event management background is a big plus - Energetic & results driven - Self-starter & should be able to work on their own - Ability to remain flexible as the start-up ecosystem demands it
Read more
Syncwell Software & Technology Pvt Ltd
kalpesh sojitra
Posted by kalpesh sojitra
Surat
1 - 3 yrs
₹2L - ₹3L / yr
MVC Framework
skill icon.NET
Webservices
Web Service Definition Language (WSDL)
we need .net developer who handle web as well as desktop
Read more
InstantPost Printers and Scanners Private Limited
anywhere
1 - 5 yrs
₹2L - ₹3L / yr
skill iconJavascript
skill iconPHP
LAMP Stack
Progressive Web Apps (PWA)
skill iconCakePHP
+2 more
We are targeting educational institutions to offer our printing services within the campus premises as well as through various delivery channels. For the campus-wide print management, we offer software solutions to centrally manage printing operations to control cost, increase up-time of printers and timely management of consumables and related inventory for printers across the campuses and branches as may be the requirement. Currently, our off-campus printing services are live for select customers in Bangalore and will be launching our on-campus printing services soon. We are looking forward engage with interested folks to build web applications for the InstantPost platform. Skills and expertise (technologies you should either know or should be ready to explore and learn with minimal guidance) - Ubuntu 18.04, MySQL, ZMQ, CakePHP, JWT, JS, HTML5, CSS3, PWA, CUPS, IPP, Git.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos