Cutshort logo
shoppin' logo
Senior Backend Engineer — Data Pipeline
Senior Backend Engineer — Data Pipeline
shoppin''s logo

Senior Backend Engineer — Data Pipeline

Nikita Sinha's profile picture
Posted by Nikita Sinha
3.5 - 6 yrs
Upto ₹45L / yr (Varies
)
Gurugram
Skills
skill iconPython
API
Microservices
skill iconGo Programming (Golang)

Why this role exists:

You’ll own our data pipelines—ingesting, cleaning, and serving fashion/e-commerce data at scale—so the team (and founder) can focus on building new capabilities. If you love end-to-end ownership and turning messy web data into reliable, queryable systems, this role is your playground.


What you’ll do:

  • Ingestion at scale: Design, build, and operate resilient crawlers/scrapers with rotation, rate-limits, backoff, and change-tolerance.
  • Robust pipelines: Normalization, deduping, schema evolution, enrichment, and SLAs for freshness & completeness.
  • Data stores & caching: Model products/variants/attributes in PostgreSQL, manage Redis for caching/queues, and keep costs predictable.
  • Observability & quality: Instrument with metrics/tracing, add data QA checks, alerts, and auto-healing where sensible.
  • Performance & reliability: Optimize throughput, memory, I/O, and infra spend; design for retries, idempotency, and correct delivery semantics.
  • Collaboration: Partner with search/ML/product teams; write crisp docs; raise the bar in reviews; mentor where helpful.

Must-haves:

  • Super high ownership: End-to-end closure on tasks you lead.
  • 3.5+ years building backend systems, preferably in Python with production ownership.
  • Strong data pipeline experience (batch/stream): schema design, deduplication, and backfills.
  • Hands-on with PostgreSQL/MySQL and Redis (caching, rate-limits, queues).
  • Real-world web scraping: requests/httpx/aiohttp, BeautifulSoup/lxml/Scrapy/Playwright, anti-bot tactics, respectful crawling.
  • Concurrency & async (asyncio, multiprocessing), robust error handling, idempotent jobs.
  • Solid testing habits and bias for simple, maintainable code.

Nice-to-haves:

  • Message queues/streams: Kafka, RabbitMQ, SQS.
  • Workflow schedulers: Airflow, Prefect.
  • GraphQL; search tech (Elasticsearch/OpenSearch).
  • Cost/perf tuning, on-call pragmatism, or prior startup/founding team experience.

How we work:

  • High ownership, fast shipping, clear interfaces, strong documentation.
  • We optimize for time to go live—startups that succeed outpace those that don’t.
  • Competitive salary + meaningful ESOPs.
  • (Optional) Work from our hacker-house on MG Road, Gurgaon.


Hiring process (fast closures)

  1. 30-min technical deep-dive
  2. Take-home (optional)
  3. Founder conversation & references
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About shoppin'

Founded :
2024
Type :
Product
Size :
0-20
Stage :
Raised funding

About

Shoppin' - if Pinterest and Google had an AI-powered baby 🍓


Here’s why:

shoppin' isn't just another AI powered tech platform.

we’re crafting a groundbreaking fashion search and shopping platform, one that outshines Google’s search capabilities, offers more intuitive recommendations than Pinterest, and engages users more deeply than Instagram’s feeds.


Our vision is bold — we’re not just building a foundational ai for fashion; we're aiming for the stars with a full-fledged fashion AGI.


Achieving such heights demands a remarkable team. Over the past month, our office has buzzed with energy and ideas, pushing us closer to crafting a user experience that feels as natural as it is innovative.


🚀 We have raised a funding of $1M pre-seed and will be raising another round very soon. Our aim is built the best founding team out there and we are scaling up our hiring efforts rapidly.


🍓Apply now to become a part of our creative force dedicated to shaping the future of fashion.

Read more

Connect with the team

Profile picture
Utsav Soi
Profile picture
Shlok Bhartiya

Company social profiles

instagramlinkedin

Similar jobs

service co
service co
Agency job
via Vikash Technologies by Rishika Teja
Bengaluru (Bangalore)
6 - 9 yrs
₹15L - ₹22L / yr
skill iconJava
Microservices
skill iconSpring Boot
skill iconAmazon Web Services (AWS)
skill iconKubernetes
+3 more
  • Experience in Java, J2ee, Spring boot.
  • Experience in Design, Kubernetes, AWS (Lambda, EKS, EC2) is needed.
  • Experience in AWS cloud monitoring tools like Datadog, CloudWatch, Land ambda is needed.
  • Experience with XACML Authorization policies.
  • Experience in NoSQL , SQL database such as Cassandra, Aurora, Oracle.
  • Experience with Web Services SOA experience (SOAP as well as Restful with JSON formats), with Messaging (Kafka).
  • Hands on with development and test automation tools/frameworks (e.g. BDD and Cucumber)


Read more
Wissen Technology
at Wissen Technology
4 recruiters
Monika Sekaran
Posted by Monika Sekaran
Mumbai
2 - 8 yrs
Best in industry
skill iconPython
Data Structures
Algorithms
skill iconDjango
Object Oriented Programming (OOPs)
+1 more

Job Description:


• Experience in Python (Only Backend), Data structures, Oops, Algorithms, Django, NumPy etc.

• Notice/Joining of not more than 30 days.

• Only Premium Institute- Tier 1 and Tier 2.

• Hybrid Mode of working.

• Good understanding of writing Unit Tests using PYTest.

• Good understanding of parsing XML’s and handling files using Python.

• Good understanding with Databases/SQL, procedures and query tuning.

• Service Design Concepts, OO and Functional Development concepts.

• Agile Development Methodologies.

• Strong oral and written communication skills.

• Excellent interpersonal skills and professional approach Skills desired.

Read more
Gyaan AI Private Limited
at Gyaan AI Private Limited
2 candid answers
Arwa Virpurwala
Posted by Arwa Virpurwala
Pune
2 - 8 yrs
₹10L - ₹25L / yr
skill iconPython
Databases
skill iconDjango
Relational Database (RDBMS)
skill iconRedis
+1 more

About Gyaan:

Gyaan empowers Go-To-Market teams to ascend to new heights in their sales performance, unlocking boundless opportunities for growth. We're passionate about helping sales teams excel beyond expectations. Our pride lies in assembling an unparalleled team and crafting a crucial solution that becomes an indispensable tool for our users. With Gyaan, sales excellence becomes an attainable reality.


About the Job:

Gyaan is seeking an experienced backend developer with expertise in Python, Django, AWS, and Redis to join our dynamic team! As a backend developer, you will be responsible for building responsive and scalable applications using Python, Django, and associated technologies.


Required Qualifications:

  • 2+ years of hands-on experience programming in Python, Django
  • Good understanding of CI/CD tools (Github Action, Gitlab CI) in a SaaS environment.
  • Experience in building and running modern full-stack cloud applications using public cloud technologies such as AWS/
  • Proficiency with at least one relational database system like MySQL, Oracle, or PostgreSQL.
  • Experience with unit and integration testing.
  • Effective communication skills, both written and verbal, to convey complex problems across different levels of the organization and to customers.
  • Familiarity with Agile methodologies, software design lifecycle, and design patterns.
  • Detail-oriented mindset to identify and rectify errors in code or product development workflow.
  • Willingness to learn new technologies and concepts quickly, as the "cloud-native" field evolves rapidly.


Must Have Skills:

  • Python
  • Django Framework
  • AWS
  • Redis
  • Database Management


Qualifications:

  • Bachelor’s degree in Computer Science or equivalent experience.


If you are passionate about solving problems and have the required qualifications, we want to hear from you! You must be an excellent verbal and written communicator, enjoy collaborating with others, and welcome discussing a plan upfront. We offer a competitive salary, flexible work hours, and a dynamic work environment.


Read more
Kaleidofin
at Kaleidofin
3 recruiters
Poornima B
Posted by Poornima B
Chennai, Bengaluru (Bangalore)
3 - 5 yrs
Best in industry
skill iconPython
Risk Management
Risk assessment
NOSQL Databases
Risk Policies

The Risk team is responsible for overall risk framework and strategy for the organization. The team develops various risk models, arrives at various sector reports from a risk perspective and provides in depth analysis and recommendation around risk profiles of various clients.

 

In this role, the person is responsible for playing a leadership role in the Risk function to identify, assess, monitor and make timely and measured judgments on all current and potential future risks faced, in order to protect the organization’s interest, assets and reputation of the group along with growing shareholder value and profitability.

Responsibilities

  • Manage risk for the retail and wholesale portfolio. Should have managed organization level Risk Policies, Credit Underwriting and Collection functions.
  • Manage risk framework for the organization - including updating, establishing new risk management mechanisms, to identify, assess, monitor, measure and control a broad spectrum of risks. Ensure all policies and frameworks are kept updated and deployed to the optimum level.
  • Develop continuous monitoring and improvement of the quality of the organization's credit and lending portfolio through credit policy direction and implementation.
  • Possess a complete understanding the business. Evaluate, improve, and monitor the business, including assisting in reporting to the Board and Board Committees and providing leadership in the effectiveness of credit risk management controls, systems, and processes across the organization.
  • Lead and mentor a team of analysts.
Requirements
  • Possess 7+ years of relevant experience in financial services industry in a risk role.
  • Exposure to both wholesale and retail risk in a banking environment will be preferred. Some experience in a business / sales role within the banking / NBFC space will be an added advantage.
  • Should have held a position of authority in terms of allocation and appropriating limits.
  • Sector understanding in financial institution space and good knowledge of interpreting financial trends.
  • High proficiency in Python and SQL/NoSQL.
  • Experience with big data and cloud computing e.g., PySpark, data lake is a plus.
  • Outstanding written, verbal and interpersonal communication skills.
  • Ability to speak at various levels of an organization (CXOs to analysts).
  • Have demonstrated resilience – stayed with companies and taking businesses to scale, have preferably not ‘hopped jobs. Strong organizational skills and excellent follow-through.
  • Present / articulate / position an idea compellingly and ability to work in a fast-paced dynamic environment.
  • Excellent communication and presentation skills.
  • Takes personal ownership; Self-starter; Ability to drive projects with minimal guidance and focus on high impact work.
  • Learns continuously; Seeks out knowledge, ideas and feedback.

 

Read more
InfoBeans
at InfoBeans
2 recruiters
Pooja Gupta
Posted by Pooja Gupta
Pune, Indore, Vadodara
4 - 7 yrs
₹5L - ₹15L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Microservices
+3 more
JAVA Microservices Developer
- Exp 4+ Years
- Should have strong technical knowledge in JAVA, Spring, and Spring boot. REST APIs
- MicroServices knowledge will be plus 
- Good communication skills. Should be able to communicate independently.
Read more
Ally Software LLP
at Ally Software LLP
1 video
1 recruiter
Pratibha Narkhede
Posted by Pratibha Narkhede
Bengaluru (Bangalore)
2 - 5 yrs
Best in industry
skill iconPython
skill iconDjango
skill iconAmazon Web Services (AWS)

About the Company :

- ALLY - GLOBAL DISTRIBUTION PLATFORM - BLOCKCHAIN POWERED

- The-Ally (Ally), derived from - Theatrically', is India's 1st Indigenous open platform for Creators/Producers/Filmmakers with an audacious goal to enable every filmmaker to launch their film globally and monetize thru Pay-Per-View. Ally is India's first Transparent & Trusted film distribution & real-time verification. We are located in Bangalore

Ally SoftwareLLP is recruiting Python Developers.

Experience : Required immediate joiners with 2-5 years of experience in python development.

- This candidate will help us build a leading system for the entertainment economy. If you are passionate about experiments and research and have super interest in coding and doing new stuff, we are looking for you to be part of the growing team and a unique concept.

- We are primarily looking for good Python/Django mid-level developers. You should necessarily have 2 +yrs of experience in python development, preferably in a startup.

Just to define, you should have some of the following skills :

- Web apps development experience in Python/Django

- Knowledge of HTTP and RESTful APIs

- Experience in Django Rest Framework

- Understand models, views, and templates

- Should be able to create APIs

- Work with front-end developers to integrate their CSS and JavaScript

- Virtualization : AWS, VirtualBox, Docker.

 

 

 
 
 
 
 
 
 

 

Read more
Advensure
at Advensure
1 recruiter
Manan Vora
Posted by Manan Vora
Mumbai
1 - 4 yrs
₹3L - ₹0.0L / yr
skill iconJavascript
skill iconPython
skill iconPHP
skill iconAngularJS (1.x)
LAMP Stack
+3 more
Main role would be to work on our core systems.
Read more
Blockchain based Software Company
Blockchain based Software Company
Agency job
via Adept Global by Aldrin Castelino
Mumbai
6 - 12 yrs
₹8L - ₹18L / yr
skill iconDjango
skill iconPython
skill iconJava
J2EE
As a Python Django Lead Engineer on our team you will:  Use existing design patterns and framework to iteratively write and review maintainable code.  Help flesh out scalable application architectures.  Proactively improve product quality through peer code review.  Identify and challenge established organizational limitations, and offer solutions.  Explore efficiency and effectiveness, and suggest improvements to process revisions.  Assist in growing a catalog of unit and functional tests for both new and existing solutions.  Mentoring junior developers as and when required.  Enjoying your work, your team, and your quality of life You should bring:  At least 8+ years of experience in various Python frameworks  At least 6+ years of experience in writing Python using the Django and Django Rest framework  At least 2+ years of experience in J2EE, Spring boot, etc  Proficiency in the tenants of Rest Web services using the JSON API standard  Proficiency in deploying applications to cloud based platform as a service using heroku, aws, google cloud and integration with 3rd party webservices  Several years of client-side focused, web application development experience.  Deep knowledge of the web application development ecosystem.  Understanding of application stacks, and DevOps workflows.  Excellent communication skills at all levels, from team members to senior management.  Having experience in Machine learning, Data science and micro services area would be preferred  Working knowledge of command-line utilities, build tools, version control and branching strategies.  A commitment to quality, and a desire to improve.  An excellent understanding of browser-based technology and specifications.  A strong drive to solve problems of all types.  An intense dislike of waste and activities that add no value to team growth or productivity.  An entrepreneurial spirit, and comfort with uncertainty and ambiguity.  A firm belief in exchanging constructive and respectful feedback.  Enthusiasm and a desire to be part of an excellent team.
Read more
Tika Data Services
at Tika Data Services
1 recruiter
Muzammil Hussain
Posted by Muzammil Hussain
Bengaluru (Bangalore)
2 - 4 yrs
₹4L - ₹12L / yr
skill iconJavascript
skill iconPython
skill iconMongoDB
LAMP Stack
skill iconReact.js
+1 more
We are looking for: • 3+ years of work experience with a strong CS background • Expertise in Python and Django • Knowledge of frontend JS frameworks like React.js plus expertise in plain JS • Experience with efficient UX design techniques. • Good knowledge of databases (PostgreSQL) • Understanding of Software Engineering best practices
Read more
Mutual Mobile
at Mutual Mobile
7 recruiters
Smitha Kamath
Posted by Smitha Kamath
Hyderabad
1 - 5 yrs
₹4L - ₹20L / yr
skill iconJavascript
skill iconPython
skill iconDjango
skill iconFlask
skill iconAmazon Web Services (AWS)
+3 more
Mutual Mobile is a world leading agency in mobile and emerging technology innovation and we are looking for an accomplished and capable full stack engineer to join our team! We have built our success through timely bets on emerging technology and rapid execution of targeted marketing campaigns and skills development. This approach has resulted in a list of premier clients that come to us to build innovative experiences using emerging technology (Nike, Google, GM, Nestle, UnderArmour). We’ve seen this happen with iOS, Android, Wearables and IoT. We continue to evolve - it’s in our DNA - we stay on the forefront of innovation. Now, in 2018, we stand at the foot of a massive transition in emerging technology with the growth of Virtual Reality, Augmented Reality, Voice, Bots, and more. We are ready to embrace these changes and to help our clients make the most of the opportunities they bring. At Mutual Mobile, Engineers are highly-capable, experienced producers of high-quality, extensible code. They know the ins-and-outs of their field, apply that knowledge to solve the most difficult problems, and pass along that knowledge to the next generation through mentorship. They: Improve the structure, quality, and extensibility of code bases Implement tools and best practices Create reusable libraries and frameworks Act as subject matter expert and contribute to the server center of excellence Accurately estimate level of effort Discover and evaluate new tools and technology partners We expect Engineers to: Be highly-capable experts in at least one technology Build breadth across multiple tech stacks Write high-quality, extensible, testable code Participate in planning activities and provide accurate story estimates Conduct code reviews and act as a role model on the team Proactively breakdown work, identify risks, and explore solutions Engineers have experience: Building server applications in Python Strong knowledge on Flask or Django Employing strong TDD and performance optimization strategies Architecting and deploying applications for AWS and other cloud providers Provisioning Devops tooling and continuous integration Designing APIs consumed by many mobile or web applications Using relational and document-store databases Building high-performance, scalable cloud applications Shipping fault-tolerant, highly-available systems in production Good knowledge on basic authentication, authorization and security technologies. Preferred experience includes: Building server applications using several different open-source stacks Using BaaS providers like Firebase or Heroku Familiarity with modern front-end development such as React or Angular Using containerization systems like Docker or Kubernetes Integrating third-party systems: CRM, CMS, shopping carts, and payments Broad architectural knowledge and experience: serverless, microservices, traditional server-based (monolithic) services System monitoring and security design and implementation Why work for Mutual Mobile? We make great products. We craft beautiful mobile interfaces and solve complex software challenges. Clients such as HEB, Google, lynda.com, Citi, Nike, and Under Armour come to us for our deep experience in mobile and emerging technology — from establishing a mobile strategy that provides impactful business value, to building those solutions from the ground up. We bring together the brightest minds in interactive & visual design, engineering, and business management to deliver solutions that actually matter. You’ll love working here, because this isn’t a company of silos. Team members are empowered and encouraged to pursue cool ideas, think for themselves, and make mistakes. If your passion extends beyond the role, we’ll invite your views and assistance with improving our culture, systems and processes. We know you’re smart, and that you love learning new technologies--so you’ll be able to work on a variety of projects with many different types of people.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos