Python Django Scrapper

Who we are: My AI Client is building the foundational platform for the "agentic economy," moving beyond simple chatbots to create an ecosystem for autonomous AI agents and they aim to provide tools for developers to launch, manage, and monetize AI agents as "digital coworkers."

The Challenge

The current AI stack is fragmented, leading to issues with multimodal data, silent webhook failures, unpredictable token usage, and nascent agent-to-agent collaboration. My AI Client is building a unified, robust backend to resolve these issues for the developer community.

Your Mission

As a foundational member of the backend team, you will architect core systems, focusing on:

• Agent Nervous System: Designing agent-to-agent messaging, lifecycle management, and high-concurrency, low-latency communication.
• Multimodal Chaos Taming: Engineering systems to process and understand real-time images, audio, video, and text.
• Bulletproof Systems: Developing secure, observable webhook systems with robust billing, metering, and real-time payment pipelines.

What You'll Bring

• My AI Client seeks an experienced engineer comfortable with complex systems and ambiguity.

Core Experience:

● Typically 3 to 5 years of experience in backend engineering roles.

● Expertise in Python, especially with async frameworks like FastAPI.

● Strong command of Docker and cloud deployment (AWS, Cloud Run, or similar).

● Proven experience designing and building microservice or agent-based architectures.

Specialized Experience (Ideal):

• Real-Time Systems: Experience with real-time media transmission like WebRTC, WebSockets and ways to process them.
• Scalable Systems: Experience in building scalable, fault-tolerant systems with a strong understanding of observability, monitoring, and alerting best practices.
• Reliable Webhooks: Knowledge of scalable webhook infrastructure with retry logic, backoffs, and security.
• Data Processing: Experience with multimodal data (e.g., OCR, audio transcription, video chunking with FFmpeg/OpenCV).
• Payments & Metering: Familiarity with usage-based billing systems or token-based ledgers.

Your Impact

• The systems designed by this role will form the foundation for:
• Thousands of AI agents for major partners across chat, video, and APIs.
• A new creator economy enabling developers to earn revenue through agents.
• The overall speed, security, and scalability of my client’s AI platform.

Why Join Us?

• Opportunity to solve hard problems with clean, scalable code.
• Small, fast-paced team with high ownership and zero micromanagement.
• Belief in platform engineering as a craft and care for developer experience.
• Conviction that AI agents are the future, and a desire to build their powering platform.
• Dynamic, collaborative in-office work environment in Bengaluru in a Hybrid setup (weekly 2 days from office)
• Meaningful equity in a growing, well-backed company.
• Direct work with founders and engineers from top AI companies.
• A real voice in architectural and product decisions.
• Opportunity to solve cutting-edge problems with no legacy code.

Ready to Build the Future?

My AI Client is building the core platform for the next software paradigm. Interested candidates are encouraged to apply with their GitHub, resume, or anything that showcases their thinking.

About the Role:

• We are looking for a highly skilled and experienced Senior Python Developer to join our dynamic team based in Manyata Tech Park, Bangalore. The ideal candidate will have a strong background in Python development, object-oriented programming, and cloud-based application development. You will be responsible for designing, developing, and maintaining scalable backend systems using modern frameworks and tools.
• This role is hybrid, with a strong emphasis on working from the office to collaborate effectively with cross-functional teams.

Key Responsibilities:

• Design, develop, test, and maintain backend services using Python.
• Develop RESTful APIs and ensure their performance, responsiveness, and scalability.
• Work with popular Python frameworks such as Django or Flask for rapid development.
• Integrate and work with cloud platforms (AWS, Azure, GCP or similar).
• Collaborate with front-end developers and other team members to establish objectives and design cohesive code.
• Apply object-oriented programming principles to solve real-world problems efficiently.
• Implement and support event-driven architectures where applicable.
• Identify bottlenecks and bugs, and devise solutions to mitigate and address these issues.
• Write clean, maintainable, and reusable code with proper documentation.
• Contribute to system architecture and code review processes.

Required Skills and Qualifications:

• Minimum of 5 years of hands-on experience in Python development.
• Strong understanding of Object-Oriented Programming (OOP) and Data Structures.
• Proficiency in building and consuming REST APIs.
• Experience working with at least one cloud platform such as AWS, Azure, or Google Cloud Platform.
• Hands-on experience with Python frameworks like Django, Flask, or similar.
• Familiarity with event-driven programming and asynchronous processing.
• Excellent problem-solving, debugging, and troubleshooting skills.
• Strong communication and collaboration abilities to work effectively in a team environment.

Mandate Skills:

• 3 - 7 years of experience in cloud-native applications (Azure strongly preferred) using Python.
• Thorough understanding of Object-Oriented Programming (OOP) design and practices.
• Strong RDBMS experience (PostgreSQL, MS SQL etc.) designing tables & writing queries.
• Great command of design patterns (especially integration design patterns)

• Programming Language: Python (Strong knowledge)
• Concurrency & Parallelism: Multithreading, Multiprocessing, AsyncIO, ThreadPoolExecutor, Future, concurrent.futures
• Memory Management: Reference Counting, Global Interpreter Lock (GIL)
• Distributed Computing: Dask, Apache Spark (Preferred)
• Data Processing: NumPy
• Inter-Service Communication: GRPC, REST API
• Containerization & Orchestration: Docker, Kubernetes
• Software Development Practices: Code Optimization, Debugging, Performance Tuning
• Communication & Problem-Solving: Technical Documentation, Team Collaboration, Asking for Clarity When Needed

Skills And Expertise

• Python, 
• Multithreading, 
• Multiprocessing, 
• Dask, Apache Spark, 
• NumPy, 
• REST API, 
• Docker, 
• Kubernetes, 
• Code Optimization

Good knowledge and experience of working with backend systems; 

designing server-side architecture, including production maintenance experience are must-haves.

At least 1-2 years of experience in any programming languages like Java, Ruby, PHP, Python and Node.js(Node.js preferred).

Understanding of micro-services oriented architecture.

Experience with Databases design (SQL, NoSQL) and analytics

Experience in driving and delivering complex features/software modules from technical design to launch.

Expertise with unit testing & Test Driven Development (TDD)

Position: Backend Developer 1 / Backend Engineer:

Location: Bangalore

Experience:  .5 to 4 years, preferably in an agile environment

Strong Knowledge Node.js and MongoDB
Good Knowledge on Flask, SQL and other databases
Good Knowledge on Deployment Process (Nginix, Docker, AWS, Digital Ocean)
Basic Knowledge on Python