
Hiring | CloudSufi |Python Architect (PySpark, Fivetran/Airbyte)|Noida
at CLOUDSUFI
About Us :
CLOUDSUFI, a Google Cloud Premier Partner, a Data Science and Product Engineering organization building Products and Solutions for Technology and Enterprise industries. We firmly believe in the power of data to transform businesses and make better decisions. We combine unmatched experience in business processes with cutting edge infrastructure and cloud services. We partner with our customers to monetize their data and make enterprise data dance.
Our Values :
We are a passionate and empathetic team that prioritizes human values. Our purpose is to elevate the quality of lives for our family, customers, partners and the community.
Equal Opportunity Statement :
CLOUDSUFI is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified candidates receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, and national origin status. We provide equal opportunities in employment, advancement, and all other areas of our workplace.
Role : Architect/Lead-Python(Hands-on experience with at least one SaaS ingestion platform such as Fivetran ,Airbyte,etc. is mandatory.)
Location : Noida, Delhi/NCR(Hybrid)
Experience : 8- 14 years
Education : BTech / BE / MCA / MSc Computer Science
Must have :
- 6+ years of data engineering; at least 3 years working on connector or integration framework development
- Deep Python expertise including PySpark, pyarrow, and an understanding of Spark's execution model (driver vs executor, serialization constraints, partition fan-out)
- Hands-on experience with at least one SaaS ingestion platform Fivetran, Airbyte, Google DTS, AWS Glue connectors, or equivalent at the connector-build level, not just configuration
- Strong understanding of OAuth 2.0 flows (auth code, PKCE, client credentials, JWT), rate limiting strategies (token bucket, leaky bucket, per-endpoint quotas), and incremental sync patterns (cursor, watermark, CDC)
- Experience designing shared connector frameworks reusable auth managers, rate governors, state stores not just per-connector scripts
- Ability to author and own TDDs and PRDs that can be handed to a junior engineer with minimal back-and-forth
Nice to have :
- Prior exposure to Databricks Asset Bundles / Declarative Automation Bundles or Lakeflow pipelines
- Experience with the Databricks Python Data Source API (DBR 15.4 LTS+) extremely rare, so treat practical Spark DSv2 Java/Scala background as equivalent
- GCP DTS or Cloud Data Fusion connector experience
- Knowledge of the specific source systems, particularly Social Ads APIs (Meta, LinkedIn, X) or enterprise SaaS (Salesforce, Oracle)

About CLOUDSUFI
About
We exist to eliminate the gap between “Human Intuition” and “Data-Backed Decisions”
Data is the new oxygen, and we believe no organization can live without it. We partner with our customers to get to the core of their problems, enable the data supply chain and help them monetize their data. We make enterprise data dance!
Our work elevates the quality of lives for our family, customers, partners and the community.
The human values that we display in all our interactions are of:
Passion – we are committed in heart and head
Integrity – we are real, honest and, fair
Empathy – we understand business isn’t just B2B, or B2C, it is H2H i.e. Human to Human
Boldness – we have the courage to think and do differently
The CLOUDSUFI Foundation embraces the power of legacy and wisdom of those who have helped laid the foundation for all of us, our seniors. We believe in their abilities and we pledge to equip them, to provide them jobs, and to bring them sufi joy.
Tech stack
Connect with the team
Similar jobs
Responsibilities
- Technical Leadership & Architecture: Serve as a technical authority, define cloud-native standards, and own end-to-end system design for complex, distributed, and high-scale solutions.
- Engineering Excellence: Lead modernization initiatives, transition legacy systems to microservices, and ensure performance, scalability, and security.
- Platform & Cloud Enablement: Champion GCP-native services (GKE, Cloud Run, Pub/Sub, BigQuery, Cloud SQL, Spanner), influence CI/CD, and drive FinOps strategies.
- Mentorship & Organizational Impact: Mentor Lead and Senior Engineers, foster engineering rigor, and collaborate with Product Management to translate business strategy into technical solutions.
Required Skills, Experience & Background
- 12+ years of professional experience building enterprise-grade software systems.
- Proven experience operating at a Lead or Principal Engineer level.
- Strong hands-on experience with Java or another major programming language (e.g., Go, Python, C#).
- Deep expertise in microservices architecture, RESTful APIs, and distributed systems.
- Strong experience with SQL and NoSQL databases and data modeling.
- Expertise in cloud-native design principles (stateless services, scalability, resiliency).
- Strong experience building and operating systems on Google Cloud Platform (GCP).
- Proficiency with containers and orchestration (Docker, Kubernetes, GKE).
- Experience with CI/CD pipelines, Git-based workflows, and observability.
- Experience with Big Data and data engineering technologies (e.g., BigQuery, Spark).
Qualifications
- Bachelor’s degree in computer science or related field (required).
- Master’s degree in computer science or related field (preferred).
🚨 We’re Building a “Top 1% Engineering Org”
We’re building a high-talent-density, AI-first R&D organization from scratch — inside a publicly listed company undergoing a full-scale transformation.
Think:
→ Rewriting legacy systems into AI-native architectures
→ Embedding LLMs + Agentic AI into core workflows
→ Reimagining platforms, infra, and data systems for the next decade
This is the kind of shift you’d expect from Google, Microsoft, or Meta —
Except you get to build it from day 0 → scale it globally.
About the Role / Team
We are building a next-generation AI-first R&D organization in Bengaluru, focused on solving complex problems across LLMs, Agentic AI systems, distributed computing, and enterprise-scale architectures.
This initiative is part of a publicly listed global company investing heavily in AI-driven transformation, re-architecting its platforms into intelligent, autonomous systems powered by large language models, workflows, and decision engines.
You will be working on:
- Agentic AI systems & LLM-powered workflows
- Distributed, scalable backend systems
- Enterprise-grade AI platforms
- Automation-first engineering environments
🚀 The Mandate
Own and evolve the technical backbone of an AI-first enterprise platform.
You will define architecture across LLM-powered systems, distributed services, and data platforms — and lead critical transformations from legacy → AI-native systems.
🧩 What You’ll Do
- Architect large-scale distributed systems powering AI-driven workflows
- Lead 0→1 and 1→N platform builds (LLM integrations, agentic systems, orchestration layers)
- Redesign legacy systems into scalable, modular, AI-native architectures
- Drive system design excellence across teams (APIs, infra, observability, reliability)
- Make high-stakes decisions on trade-offs (latency, cost, scalability, model performance)
- Mentor senior engineers and influence engineering culture/org standards
- Partner with product, data, and leadership on long-term technical strategy
🧠 What We’re Looking For
- Proven track record building high-scale backend or platform systems
- Deep expertise in distributed systems, microservices, cloud (AWS/GCP/Azure)
- Strong exposure to data systems/infra / Data / real-time architectures
- Experience or strong interest in LLMs, GenAI, or AI system design
- Exceptional system design, abstraction, and problem-solving ability
- High ownership mindset — you think in terms of systems, not tickets
- Strong coding skills in Python / Java / Go / Node.js
- Solid understanding of data structures, system design basics, and backend architecture
- Experience building scalable APIs and services
- Familiarity or curiosity around AI/LLMs, async systems, or event-driven design
- Strong debugging, problem-solving, and ownership mindset
- Solve hard system problems (latency, scale, reliability)
- Drive cross-team technical decisions and standards
- Mentor senior engineers and influence org-wide architecture
- Design large-scale distributed systems and backend platforms
- Mentorship & Technical Leadership
- Expertise in system design, scalability, and performance optimization
Nice to Have
- Experience integrating LLMs, vector databases, or AI pipelines
- Contributions to architecture at scale
- Experience with Agentic AI / LLM orchestration frameworks
- Background in product engineering or platform companies
- Exposure to global-scale systems (millions of users / high throughput)
🔥 What Sets You Apart
- Built platforms used by millions of users / high-throughput systems
- Experience with event-driven systems, stream processing, or infra platforms
- Prior work on AI/ML platforms, model serving, or intelligent systems
Strong AI & Full-Stack Tech Lead
Mandatory (Experience 1): Must have 5+ years of experience in full-stack development, including Python for backend development and React/JavaScript for frontend, along with API/microservice integration.
Mandatory (Experience 2): Must have 2+ years of experience in leading technical teams, coordinating engineers, and acting as a system integrator across distributed teams.
Mandatory (Experience 3): Must have 1+ year of hands-on experience in AI projects, including LLMs, Transformers, LangChain, or OpenAI/Azure AI frameworks.
Mandatory (Tech Skills 1): Must have experience in designing and implementing AI workflows, including RAG pipelines, vector databases, and prompt orchestration.
Mandatory (Tech Skills 2): Must ensure backend and AI system scalability, reliability, observability, and security best practices.
Mandatory (Company): Must have experience working in B2B SaaS companies delivering AI, automation, or enterprise productivity solutions
Tech Skills (Familiarity): Should be familiar with integrating AI systems with enterprise platforms (SharePoint, Teams, Databricks, Azure) and enterprise SaaS environmentsx
Mandatory (Note): Both founders are based out of Australia, design (2) and developer (4) team in India. Indian shift timings.
Job Location: Sewri, Mumbai, Maharashtra
Required experience:
- Minimum 2 year of experience in Web & Backend Development using Python
Overview
We are looking for Python developers with a strong understanding of object orientation and experience in web and backend development. Experience with Analytical algorithms and mathematical calculations using libraries such as Numpy and Pandas are a must. Experience in some form of Machine Learning. We require candidates who have working experience using Django Framework
Key Skills required (Items in Bold are mandatory keywords) :
- Proficiency in Python 3.x based web and backend development
- Solid understanding of Python concepts
- Experience with some form of Machine Learning (ML)
- Experience in using libraries such as Numpy and Pandas
- Some form of experience with NLP and Deep Learning using any of Pytorch, Tensorflow, Keras, Scikit-learn or similar
- Hands on experience with RDBMS such as Postgres or MySQL
- Experience building REST APIs using DRF or Flask
- Comfort with Git repositories, branching and deployment using Git
- Working experience with Docker
- Basic working knowledge of ReactJs
- Experience in deploying Django applications to AWS,Digital Ocean or Heroku
KRAs includes:
- Understanding the scope of work
- Understanding and adopting the current internal development workflow and processes
- Understanding client requirements as communicated by the project manager
- Arriving on timelines for projects, either independently or as a part of a team
- Executing projects either independently or as a part of a team
- Developing products and projects using Python
- Writing code to collect and mathematically analyse large volumes of data.
- Creating backend modules in Python by building or reutilizing existing modules in a manner so as to
provide optimal deliveries on time
- Writing Scalable, maintainable code
- Building secured REST APIs
- Setting up batch task processing environments using Celery
- Unit testing prepared modules
- Bug fixing issues as reported by the QA team
- Optimization and performance tuning of code
Assignment Details
Our client, a global leader in energy management and automation, is seeking a skilled and experienced Test Automation Engineer with strong expertise in developing automation frameworks for Windows and Web applications. The ideal candidate will have hands-on experience with Python and Robot Framework, and a solid background in software development, debugging, and unit testing. This role requires the ability to work independently, contribute to the entire testing lifecycle, and collaborate with cross-functional teams in an Agile environment.
Key Responsibilities:
- Design and develop robust Test Automation Frameworks for both Windows and Web applications.
- Implement automated test cases using Python and Robot Framework.
- Collaborate with development teams to understand feature requirements and break them down into actionable tasks.
- Use version control and issue tracking tools like TFS/ADO, GitHub, Jira, SVN, etc.
- Perform code reviews, unit testing, and debugging of automation scripts.
- Clearly document and report test results, defects, and automation progress.
- Maintain and enhance existing test automation suites to support continuous delivery pipelines.
Skills Required
- 5–10 years of professional experience in Test Automation and Software Development.
- Strong proficiency in Python and Robot Framework.
- Solid experience with Windows and Web application testing.
- Familiarity with version control systems such as TFS, GitHub, SVN and project tracking tools like Jira.
- Strong analytical and problem-solving skills.
- Ability to work independently with minimal supervision.
- Excellent written and verbal communication skills for documentation and reporting.
Job Title - Senior Backend Engineer
About Tazapay
Tazapay is a cross border payment service provider. They offer local collections via local payment methods, virtual accounts and cards in over 70 markets. The merchant does not need to create local entities anywhere and Tazapay offers the additional compliance framework to take care of local regulations and requirements. This results in decreased transaction costs, fx transparency and higher auth rates.
They are licensed and backed by leading investors. www.tazapay.com
What’s exciting waiting for You?
This is an amazing opportunity for you to join a fantastic crew before the rocket ship launch. It will be a story you will carry with you through your life and have the unique experience of building something ground up and have the satisfaction of seeing your product being used and paid for by thousands of customers. You will be a part of a growth story be it anywhere - Sales, Software Development, Marketing, HR, Accounting etc.
We believe in a culture of openness, innovation & great memories together.
Are you ready for the ride?
Find what interesting things you could do with us.
About the Backend Engineer role
Responsibilities (not exhaustive)
- Design, write and deliver highly scalable, reliable and fault tolerant systems with minimal guidance
- Participate in code and design reviews to maintain our high development standards
- Partner with the product management team to define and execute the feature roadmap
- Translate business requirements into scalable and extensible design
- Proactively manage stakeholder communication related to deliverables, risks, changes and dependencies
- Coordinate with cross functional teams (Mobile, DevOps, Data, UX, QA etc.) on planning and execution
- Continuously improve code quality, product execution, and customer delight
- Willingness to learn new languages and methodologies
- An enormous sense of ownership
- Engage in service capacity and demand planning, software performance analysis, tuning and optimization
The Ideal Candidate
Education
- Degree in Computer Science or equivalent with 5+ years of experience in commercial software development in large distributed systems
Experience
- Hands-on experience in designing, developing, testing and deploying applications on Golang, Ruby,Python, .Net Core or Java for large scale applications
- Deep knowledge of Linux as a production environment
- Strong knowledge of data structures, algorithms, distributed systems, and asynchronous architectures
- Expert in at least 1 of the following languages: Golang, Python, Ruby, Java, C, C++
- Proficient in OOP, including design patterns.
- Ability to design and implement low latency RESTful services
- Hands-on coder who has built backend services that handle high volume traffic.
- Strong understanding of system performance and scaling
- Possess excellent communication, sharp analytical abilities with proven design skills, able to think critically of the current system in terms of growth and stability
- Data modeling experience in both Relational and NoSQL databases
- Continuously refactor applications to ensure high-quality design
- Ability to plan, prioritize, estimate and execute releases with good degree of predictability
- Ability to scope, review and refine user stories for technical completeness and to alleviate dependency risks
- Passion for learning new things, solving challenging problems
- Ability to get stuff done!
Nice to have
- Familiarity with Golang ecosystem
- Familiarity with running web services at scale; understanding of systems internals and networking are a plus
- Be familiar with HTTP/HTTPS communication protocols.
Abilities and Traits
- Ability to work under pressure and meet deadlines
- Ability to provide exceptional attention to details of the product.
- Ability to focus for extended periods of repetitious activity.
- Ability to think ahead and anticipate problems, issues and solutions
- Work well as a team player and help the team members to resolve issues
- Be committed to quality and be structured in approach
- Excellent and demonstrable concept formulation, logical and analytical skills
- Excellent planning, organizational, and prioritization skills
Location - Chennai - India
Join our team and let's groove together to the rhythm of innovation and opportunity!
Your Buddy
Tazapay
Rejolut is one of the award-winning fastest-growing emerging tech company which is working on leading technology like Blockchain, ML & AI, Complex mobile & web apps, IoT, etc.
The ideal candidate will be responsible for developing a highly scalable and secure code.
Responsibilities:-
- Able to take the Extreme Ownership of modules/product/projects
- Able to learn & implement new technology/framework/library at God Speed
- Able to come with an optimal solution for the business problem
- Can handle calls with the client & customer to know their feedback
- Writing clean code & able to dig into other's code or open-source code.
Desired Candidate Profile:-
- Good problem-solving skills are a must
- Expertise in Node.js development, Javascript (hands-on Experience )
- Exposure to developing APIs with Node JS
- Knowledge of Node.js and frameworks available for it such as Express, sails.js, StrongLoop, etc
- Knowledge of SQL and NoSQL database
- Knowledge of tools like Docker, Git, Postman, JSdocs, etc.
- Basic understanding of front-end technologies, such as HTML5, and CSS3
- Added advantage (Python or Ruby or Golang)
- Self-motivated and able to drive the team
- Good communication and interpersonal skills
- Experience in working in fintech is a plus
How we are different
-We are a young and dynamic team who are obsessed with solving the business problem at scale.
-We are a technology agnostic company that focuses more on finding the optimal solution to the business problem rather than technology.
Why join us
- We provide a huge learning curve. Spending 1.5-2 years with us will put you 3 years ahead in the career.
- We work only on cutting edge technology like React, React Native, Flutter, NodeJS, Python, Go, Svelte, ELM
- There are two technology Co-founder in the company who are pretty much hands-on and have earlier bult the Consumer application which is downloaded millions of times and are in leadership position in copanies like Samsung, Purplle, Loylty Rewardz.
- Get mentored by the best in the industry
- Flexible working hours
- Perks best in the industry
- Implement security and data protection solutions
- Hands-on experience in backend programming languages.
- Experience in Python 3.X & Django is a must. Knowledge of .NET, Java, PHP is an added advantage.
- Hands-on experience in front-end technologies like Angular, jQuery, JavaScript, HTML, CSS, SCSS, etc.
- Experience with leading technical teams and acting as a technical mentor.
- Experience in client communication & reporting to the client-side management team.
- Experience in AWS is an added advantage.













