Data Engineer

About Us

CLOUDSUFI, a Google Cloud Premier Partner, a Data Science and Product Engineering organization building Products and Solutions for Technology and Enterprise industries. We firmly believe in the power of data to transform businesses and make better decisions. We combine unmatched experience in business processes with cutting edge infrastructure and cloud services. We partner with our customers to monetize their data and make enterprise data dance.

Our Values

We are a passionate and empathetic team that prioritizes human values. Our purpose is to elevate the quality of lives for our family, customers, partners and the community.

Equal Opportunity Statement

CLOUDSUFI is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified candidates receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, and national origin status. We provide equal opportunities in employment, advancement, and all other areas of our workplace. Please explore more at https://www.cloudsufi.com/.

About Role:

The Senior Python Developer will lead the design and implementation of ACL crawler connectors for Workato’s search platform. This role requires deep expertise in building scalable Python services, integrating with various SaaS APIs and designing robust data models. The developer will mentor junior team members and ensure that the solutions meet the technical and performance requirements outlined in the Statement of Work.

Key Responsibilities:

• Architecture and design: Translate business requirements into technical designs for ACL crawler connectors. Define data models, API interactions and modular components using the Workato SDK.
• Implementation: Build Python services to authenticate, enumerate domain entities and extract ACL information from OneDrive, ServiceNow, HubSpot and GitHub. Implement incremental sync, pagination, concurrency and caching.
• Performance optimisation: Profile code, parallelise API calls and utilise asynchronous programming to meet crawl time SLAs. Implement retry logic and error handling for network‑bound operations.
• Testing and code quality: Develop unit and integration tests, perform code reviews and enforce best practices (type hints, linting). Produce performance reports and documentation.
• Mentoring and collaboration: Guide junior developers, collaborate with QA, DevOps and product teams, and participate in design reviews and sprint planning.
• Hypercare support: Provide Level 2/3 support during the initial rollout, troubleshoot issues, implement minor enhancements and deliver knowledge transfer sessions.

Must Have Skills and Experiences:

• Bachelor’s degree in Computer Science or related field.
• 3-8 years of Python development experience, including asynchronous programming and API integration.
• Knowledge of python libraries-pandas,pytest,requests,asyncio
• Strong understanding of authentication protocols (OAuth 2.0, API keys) and access‑control models.
• Experience with integration with cloud or SaaS platforms such as Microsoft Graph, ServiceNow REST API, HubSpot API, GitHub API.
• Proven ability to lead projects and mentor other engineers.
• Excellent communication skills and ability to produce clear documentation.

Optional/Good to Have Skills and Experiences:

• Experience with integration with Microsoft Graph API, ServiceNow REST API, HubSpot API, GitHub API.
• Familiarity with the following libraries, tools and technologies will be advantageous-aiohttp,PyJWT,aiofiles / aiocache
• Experience with containerisation (Docker), CI/CD pipelines and Workato’s connector SDK is also considered a plus.

Who we are: My AI Client is building the foundational platform for the "agentic economy," moving beyond simple chatbots to create an ecosystem for autonomous AI agents and they aim to provide tools for developers to launch, manage, and monetize AI agents as "digital coworkers."

The Challenge

The current AI stack is fragmented, leading to issues with multimodal data, silent webhook failures, unpredictable token usage, and nascent agent-to-agent collaboration. My AI Client is building a unified, robust backend to resolve these issues for the developer community.

Your Mission

As a foundational member of the backend team, you will architect core systems, focusing on:

• Agent Nervous System: Designing agent-to-agent messaging, lifecycle management, and high-concurrency, low-latency communication.
• Multimodal Chaos Taming: Engineering systems to process and understand real-time images, audio, video, and text.
• Bulletproof Systems: Developing secure, observable webhook systems with robust billing, metering, and real-time payment pipelines.

What You'll Bring

• My AI Client seeks an experienced engineer comfortable with complex systems and ambiguity.

Core Experience:

● Typically 3 to 5 years of experience in backend engineering roles.

● Expertise in Python, especially with async frameworks like FastAPI.

● Strong command of Docker and cloud deployment (AWS, Cloud Run, or similar).

● Proven experience designing and building microservice or agent-based architectures.

Specialized Experience (Ideal):

• Real-Time Systems: Experience with real-time media transmission like WebRTC, WebSockets and ways to process them.
• Scalable Systems: Experience in building scalable, fault-tolerant systems with a strong understanding of observability, monitoring, and alerting best practices.
• Reliable Webhooks: Knowledge of scalable webhook infrastructure with retry logic, backoffs, and security.
• Data Processing: Experience with multimodal data (e.g., OCR, audio transcription, video chunking with FFmpeg/OpenCV).
• Payments & Metering: Familiarity with usage-based billing systems or token-based ledgers.

Your Impact

• The systems designed by this role will form the foundation for:
• Thousands of AI agents for major partners across chat, video, and APIs.
• A new creator economy enabling developers to earn revenue through agents.
• The overall speed, security, and scalability of my client’s AI platform.

Why Join Us?

• Opportunity to solve hard problems with clean, scalable code.
• Small, fast-paced team with high ownership and zero micromanagement.
• Belief in platform engineering as a craft and care for developer experience.
• Conviction that AI agents are the future, and a desire to build their powering platform.
• Dynamic, collaborative in-office work environment in Bengaluru in a Hybrid setup (weekly 2 days from office)
• Meaningful equity in a growing, well-backed company.
• Direct work with founders and engineers from top AI companies.
• A real voice in architectural and product decisions.
• Opportunity to solve cutting-edge problems with no legacy code.

Ready to Build the Future?

My AI Client is building the core platform for the next software paradigm. Interested candidates are encouraged to apply with their GitHub, resume, or anything that showcases their thinking.

At Palcode.ai, We're on a mission to fix the massive inefficiencies in pre-construction. Think about it - in a $10 trillion industry, estimators still spend weeks analyzing bids, project managers struggle with scattered data, and costly mistakes slip through complex contracts. We're fixing this with purpose-built AI agents that work. Our platform can do “magic” to Preconstruction workflows from Weeks to Hours. It's not just about AI – it's about bringing real, measurable impact to an industry ready for change. We are backed by names like AWS for Startups, Upekkha Accelerator, and Microsoft for Startups.

Why Palcode.ai

Tackle Complex Problems: Build AI that reads between the lines of construction bids, spots hidden risks in contracts, and makes sense of fragmented project data

High-Impact Code: Your code won't sit in a backlog – it goes straight to estimators and project managers who need it yesterday

Tech Challenges That Matter: Design systems that process thousands of construction documents, handle real-time pricing data, and make intelligent decisions

Build & Own: Shape our entire tech stack, from data processing pipelines to AI model deployment

Quick Impact: Small team, huge responsibility. Your solutions directly impact project decisions worth millions

Learn & Grow: Master the intersection of AI, cloud architecture, and construction tech while working with founders who've built and scaled construction software

Your Role:

• Design and build our core AI services and APIs using Python
• Create reliable, scalable backend systems that handle complex data
• Help set up cloud infrastructure and deployment pipelines
• Collaborate with our AI team to integrate machine learning models
• Write clean, tested, production-ready code

You'll fit right in if:

• You have 1 year of hands-on Python development experience
• You're comfortable with full-stack development and cloud services
• You write clean, maintainable code and follow good engineering practices
• You're curious about AI/ML and eager to learn new technologies
• You enjoy fast-paced startup environments and take ownership of your work

How we will set you up for success

• You will work closely with the Founding team to understand what we are building.
• You will be given comprehensive training about the tech stack, with an opportunity to avail virtual training as well.
• You will be involved in a monthly one-on-one with the founders to discuss feedback
• A unique opportunity to learn from the best - we are Gold partners of AWS, Razorpay, and Microsoft Startup programs, having access to rich talent to discuss and brainstorm ideas.
• You’ll have a lot of creative freedom to execute new ideas. As long as you can convince us, and you’re confident in your skills, we’re here to back you in your execution.
• 
  

Location: Bangalore, Remote

Compensation: Competitive salary + Meaningful equity

If you get excited about solving hard problems that have real-world impact, we should talk.

All the best!!

Experience:

The candidate should have about 1+ years of experience with design and development in Java/Scala. Experience in algorithm, data-structure, database is mandatory.

Required Skills:

1. Java or Scala
2. Extensive experience in developing web applications. Should possess good Oops knowledge and be aware of enterprise application design patterns.
3. Should have the ability to analyze, design, develop and test complexity of spark job.
4. Basic working knowledge of Unix/Linux.

Good To have: -

1. Python
2. Distributed Computing