Cutshort logo
For Employers
Our client provides data solutions for fraud prevention logo
Tech Lead - Web Scraping and Crawling
Our client provides data solutions for fraud prevention
Tech Lead - Web Scraping and Crawling
Purple Squirrel Consulting Services's logo

Tech Lead - Web Scraping and Crawling

at Our client provides data solutions for fraud prevention

4 - 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
Web Scraping
Web crawling
Selenium
Selenium Web driver
Beautiful Soup
skill iconData Science
web crawler
skill iconJavascript
skill iconJava
skill iconPython
skill iconHTML/CSS
  • Manage individual projects priorities, deadlines, and deliverables

  • Gather and process raw data at scale (including writing scripts, web scraping, calling/create

    APIs, etc.) from the web / internet

  • Develop frameworks for automating and maintaining constant flow of data from multiple

    sources

  • Identify, analysis, design, and implement internal process improvements

  • Design and implement tooling upgrades to increase stability and data quality

  • Help team to fix issues that occur in test and production environments

  • Automate software development processes, including build, deploy, and test

  • Manage and guide the team members

REQUIRED QUALIFICATIONS:

  •   4+ years of web crawling/ scraping experience is a must

  •   Strong knowledge of scraping frameworks such as Scrapy, Beautiful Soup, HTQL, Jsoup, Web-

    Harvest and others

  • Excellent verbal, written, and interpersonal communication skills in English

  •   Good to have Experience of complex crawling (like captcha, Mobile OTP based crawling,

    bypassing proxy)

  •   Sound Knowledge in Bot Management Techniques

  •   Experience in various data extraction methods (like data extraction from PDF Files, web

    pages, etc)

  •   Good understanding of HTML DOM, CSS, Javascript, and RESTful web services

  •   Good to have understanding of AWS

  •   Experience with Linux

  •   Experience with Java / Python

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

NFlow Technologies Pvt Ltd
Dhruti Bhatt HR
Posted by Dhruti Bhatt HR
Ahmedabad
2 - 3 yrs
₹2L - ₹6L / yr
Facebook Marketing
Facebook API
Social Media Marketing (SMM)

We are looking for Senior-level of Paid Media Expert. You have to work for a single/Multiple ecommerce brand or at a digital marketing agency where they handle international clients and manage the team. You will need to analyzing campaign performance and making optimizations. You need to install tracking pixels. 

Read more
Fx31labs
Darshana Jadhav
Posted by Darshana Jadhav
Remote only
8 - 16 yrs
₹35L - ₹45L / yr
skill iconPython
databricks
LangChain
LangGraph
AI Ops
+4 more

Job Title:  Sr. AI Ops Engineer

Experience: 8+ Years

Location: Remote


We’re looking for a hands-on Lead AI Ops Engineer to drive AI-powered automation across enterprise infrastructure. This role involves working closely with senior stakeholders to identify opportunities and implement Agentic / AIOps solutions at scale.


 What You’ll Do

  • Identify automation opportunities across Cloud & Enterprise Infrastructure
  • Design & build AI/Agentic solutions aligned with AIOps frameworks
  • Collaborate with Principal Engineers / Directors on high-impact initiatives
  • Own end-to-end delivery: Problem → Solution → Deployment


 Tech Stack

  • Must: Python
  • Good to have: JavaScript, Java, Scala, R
  • AI/ML: Databricks, MLflow
  • Frameworks: LangChain, LangGraph, LLaMA, Cohere, DBRX
  • Cloud: AWS, Azure, GCP
  • Others (Plus): Google ADK, MCP, A2A, Argo


 Ideal Profile

  • Strong engineering maturity & ownership
  • Experience in AI-driven automation / AIOps
  • Ability to work directly with senior technical stakeholders


 Why Apply?

Work on cutting-edge AI Ops & Agentic automation in a large-scale enterprise environment with high visibility.

Read more
appscrip
at appscrip
2 recruiters
Nilam Surati
Posted by Nilam Surati
Bengaluru (Bangalore)
0 - 1 yrs
₹1.8L - ₹3.6L / yr
Digital Marketing
Search Engine Optimization (SEO)

About the role

We are looking for an Off-Page SEO Executive with 2-3 years of experience to handle backlink building and off-page SEO for our clients. The candidate should have tech awareness, good spoken English, and a solid understanding of current digital market trends.

Key Responsibilities

  • Build and manage quality backlinks for client websites across tech and SaaS niches
  • Execute off-page SEO activities including guest posting, niche edits, directory submissions, and profile creation
  • Identify backlink opportunities through competitor analysis and niche research
  • Maintain backlink trackers, live URLs, and weekly reports
  • Contribute to building and improving internal SEO systems and processes
  • Coordinate with the content and SEO teams for anchor text and landing page alignment

Required Skills

  • Knowledge in Off-Page SEO and backlink building
  • Tech awareness — comfortable working on software or SaaS websites
  • Good spoken and written English
  • Hands-on experience with tools like Ahrefs or SEMrush
  • Understanding of current SEO trends and digital market
  • Ability to evaluate link quality and avoid spammy practices



You can contact me on this WhatsApp number: Nine three one six one two zero one three two

Read more
A Health, Wellness & Fitness Startup
A Health, Wellness & Fitness Startup
Agency job
via Qrata by Prajakta Kulkarni
Bengaluru (Bangalore)
5 - 9 yrs
₹35L - ₹55L / yr
Product Management
Product Manager
Product Strategy
Product Management

Are you passionate about solving problems through technology, customer obsessed, flexible, smart and analytical, strategic yet execution focused, passionate about mobile and e-commerce ? If yes, a Product Manager role gives you a chance to be a part of the Health-tech revolution in India & build products for scale.

As a Product Manager you will be expected to :

- Develop a vision & roadmap for your Product area for the next phase of hyper growth in the Health- tech segment.

- Drive execution on the roadmap, partnering with your development team, design, qa and cross-functional stakeholders.

- Always think customer backwards, collect insights & work on products / solutions that delight our customers.

- Analytical and data-driven, you love digging into the data to understand what's happening and define & measure success on every project

- Recruit & Mentor other product managers, providing them with guidance and mentorship to maximize their potential.

- Communicate confidently & clearly both written & verbal.

Responsibilities :

We are looking for a Product Leader to own the customer experience across platforms (Mobile Web, DWeb, Mobile Apps). The objective of this role is to define & drive experiences for consumers which give a delightful experience & build long term loyalties. You will also work to identify, prioritize and fix areas of improvement across the conversion funnel, and improve new customer acquisition and retention. The specific focus would also be on identifying the needs of customers that are new-to-online or new-to-ecommerce, and build solutions to address those needs.

What are we looking for ?

- 5 to 8 years of hands-on experience in product management in high scale consumer internet environments with 2+ years in managing consumer Apps / Web platforms.

- Bachelor's degree in Engineering. Management degree from a top Business school is a plus.

- Solid track record of building and shipping multiple products with a high business impact.

- Experience of working with multiple stakeholders and demonstrate a high degree of influence across several teams/functions.

- Excellent problem solving, critical thinking, and communication skills. Highly customer obsessed thinking with deep understanding of customer needs and aspirations.

- Deep understanding of technology.

- Hands on experience of working on contemporary tools on Analytics, A/B, CLM & Agile.

- Previous start-up experience is a strong plus
Read more
A leading IT & Digital Tech US (Chicago) based client
A leading IT & Digital Tech US (Chicago) based client
Agency job
via Tridat Technologies Pvt. Ltd. by Shraddha Kamble
Remote only
5 - 15 yrs
₹5L - ₹15L / yr
ASP.NET
skill iconC#
skill iconAngularJS (1.x)
skill iconReact.js
MVC Framework
+2 more

Hello,

 

Greetings for the day !!!

 

We are hiring "Backend Developer" for one of the IT & digital tech solutions based organization @ US (Chicago) !!!

 

JOB BRIEF:

  • We are looking for an experienced Back-end developer to join our IT team.
  • You will be responsible for the server side of our web applications.
  • If you have excellent programming skills and a passion for developing applications or improving existing ones, we would like to meet you.
  • As a Back-end developer, you’ll work closely with our engineers to ensure system consistency and improve user experience.
  • Ultimately, you should be able to develop and maintain functional and stable web applications to meet our company’s needs.

 

RESPONSIBILITIES:
Participate in the entire application lifecycle, focusing on coding and debugging

  • Write clean code to develop functional web applications
  • Troubleshoot and debug applications
  • Perform UI tests to optimize performance
  • Manage cutting-edge technologies to improve legacy applications
  • Collaborate with Front-end developers to integrate user-facing elements with server side logic
  • Gather and address technical and design requirements
  • Provide training and support to internal teams
  • Build reusable code and libraries for future use
  • Liaise with developers, designers, and system administrators to identify new features
  • Follow emerging technologies

 

REQUIREMENTS & SKILLS:

  • Minimum of 5 years of work experience as a Back-end developer
  • In-depth understanding of the entire web development process (design, development, and deployment)
  • Knowledge of multiple back-end languages (e.g., C#, Java, Python, PHP, RUBY) and JavaScript
  • frameworks (e.g., Angular, React, [website])
  • Experience with .NET, C#, [website] MVC framework, .NET web APIs
  • Familiarity with databases (e.g., MySQL, MongoDB, SQL server), web servers (e.g., Apache) and UI/UX design
  • Skills on Database design, table, views creation,
  • Writing SQL scripts, stored procedures, creating SQL Jobs etc. optimizing queries.
  • Should be able to work with different rest APIs and consuming the data, make GET, PUT, POST calls
  • Should be able to create APIs that others can consume
  • Working knowledge of CMS framework
  • Familiarity with front-end languages (e.g., HTML, JavaScript, and CSS)
  • Excellent analytical and time management skills
  • Teamwork skills with a problem-solving attitude
  • BSc degree in Computer Science or relevant field

 

 

Employment Mode: Full time - Remote opportunity

 

Joining Period: Immediate to Max 30 days

 

Location: Full Fledge Remote

 

Shifts: US Shift

 

Read more
Vadodara
2 - 10 yrs
₹2L - ₹12L / yr
skill iconLaravel
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
+3 more

Join our core team


  1. Are you excited to be one of the first five employees of a startup and witness the growth of a company from a small room to the next unicorn?
  2. Do you think the problems around people should be solved first?
  3. Does your heart hurt when you see a talented engineer who has no job and is struggling to get any kind of job just to live a better life?
  4. Are you keen to keep learning new technologies for the betterment of human lives?
  5. Are you passionate and energetic enough to build a platform to enable the ‘Future of Work’?


If the answer to all the above questions is a BIG YES, we are waiting curiously for you to join Dignifiedme.


Following technical skills is mandatory, but not at the cost of your confusion about the above questions.


Job Role – Full Stack Developer This is just a title! and there’s much more expected 😊, if you transcend with your performance, the title can be anything big you can dream of)

Technologies – Extensive experience in PHP Laravel, AJAX, Bootstrap, React/Angular JS, Javascript, HTML, HTML 5, CSS, MySQL 

  • Clear fundamentals, well versed with OOP.
  • Demonstrable experience developing clean, scalable code.
  • Understanding of CI/CD, Github.
  • Experience optimizing existing code and queries for performance and scalability.
  • Experience developing and consuming restful web services.
  • Agile methodologies

Nice to have - LiteSpeed Server Experience, Azure Cloud

Willing to learn – MEAN and MERN stacks, Cloud Technologies, AI-ML 

Industry Experience – 2+ years (if you think that with your lesser experience, you can beat others, you are open to applying)


Education: Degrees don’t count for us, but your skills do.


Soft skills: self-motivated, can define own goals, can work independently on day-to-day tasks, knows what being accountable means, and understands ownership well. 


MUST HAVE SKILL: The Art of Googling (and now ChatGPT!) the Solutions We don't need to reinvent what already exists!

Location – Vadodara, Gujarat (most of the time it will be Work from Home)


Perks:

  • 5 days a week (moving further yes, but you may be required to support for extra hours)
  • Flexible work hours (no 9 to 5 culture), but your output will count. We ensure that you will have the best work-life balance)
  • Competitive Compensation 
Read more
Capital Quotient
at Capital Quotient
1 recruiter
Archana Bharadwaj
Posted by Archana Bharadwaj
Bengaluru
2 - 5 yrs
₹3L - ₹8L / yr
skill iconNodeJS (Node.js)
skill iconAngularJS (1.x)
skill iconMongoDB
skill iconGo Programming (Golang)
skill iconReact.js
+4 more
Min 3 years of development experience of working on entire tech stack with the end to end responsibilities. Role 1. Own end to end responsibility - right from the requirement to release. 2. Understanding the nature of asynchronous programming and its quirks and workarounds. 3. Write & deploy auto-scaling applications. Skills Node.js, Express.js, JWT, Passport, and other useful node packages MySQL, Database Schema Design, MongoDB/RethinkDB with knowledge of data shading & clustering JavaScript ES6, JQuery, HTML/CSS3 with basic design sense of UI/UX, SASS, BootStrap, Cordova, ReactJS/AngularJS, Git & Best Git practices, Redis, Understanding of AWS EC2, S3 & Lamda, Understanding of modern JS toolchains such as Grunt/Bower and Yeoman. Strong in RESTful & Lamda services with GOlang is preferred.
Read more
GoodWorker
at GoodWorker
6 recruiters
Sunder E
Posted by Sunder E
Bengaluru (Bangalore)
7 - 10 yrs
₹12L - ₹15L / yr
DevOps
skill iconKubernetes
skill iconDocker
skill iconAmazon Web Services (AWS)
Terraform
+1 more

Why you should join us

 

- You will join the mission to create positive impact on millions of peoples lives

- You get to work on the latest technologies in a culture which encourages experimentation - You get to work with super humans (Psst: Look up these super human1, super human2, super human3, super human4)

- You get to work in an accelerated learning environment

 

 

What you will do

 

- You will provide deep technical expertise to your team in building future ready systems.

- You will help develop a robust roadmap for ensuring operational excellence

- You will setup infrastructure on AWS that will be represented as code

- You will work on several automation projects that provide great developer experience

- You will setup secure, fault tolerant, reliable and performant systems

- You will establish clean and optimised coding standards for your team that are well documented

- You will set up systems in a way that are easy to maintain and provide a great developer experience

- You will actively mentor and participate in knowledge sharing forums

- You will work in an exciting startup environment where you can be ambitious and try new things :)

 

 

You should apply if

 

- You have a strong foundation in Computer Science concepts and programming fundamentals

- You have been working on cloud infrastructure setup, especially on AWS since 8+ years

- You have set up and maintained reliable systems that operate at high scale

- You have experience in hardening and securing cloud infrastructures

- You have a solid understanding of computer networking, network security and CDNs

- Extensive experience in AWS, Kubernetes and optionally Terraform

- Experience in building automation tools for code build and deployment (preferably in JS)

- You understand the hustle of a startup and are good with handling ambiguity

- You are curious, a quick learner and someone who loves to experiment

- You insist on highest standards of quality, maintainability and performance

- You work well in a team to enhance your impact

Read more
UnoTag
at UnoTag
1 recruiter
Mohit Ambani
Posted by Mohit Ambani
Remote, Bengaluru (Bangalore)
2 - 5 yrs
₹6L - ₹9L / yr
skill iconNodeJS (Node.js)
skill iconReact.js
skill iconJavascript
skill iconExpress
MS SQLServer

Knowledge of Node.js and frameworks available for it (such as Express, StrongLoop, etc depending on your technology stack)

Understanding the nature of asynchronous programming and its quirks and workarounds

Good with REST Api and integration of many API's in our backend

Good understanding of server-side templating languages (such as Jade, EJS, etc depending on your technology stack)

Understanding accessibility and security compliance

User authentication and authorization between multiple systems, servers, and environments
Integration of multiple data sources and databases into one system

Understanding fundamental design principles behind a scalable application

Understanding differences between multiple delivery platforms, such as mobile vs. desktop, and optimizing output to match the specific platform

Creating database schemas that represent and support business processes
Implementing automated testing platforms and unit tests

Proficient understanding of code versioning tools, such as Git
Good Code writing skills 
Integration with Shopfy, Zoho, ERP, CRM is a plus.

Read more
Bengaluru (Bangalore)
5 - 8 yrs
₹10L - ₹14L / yr
skill iconJavascript
skill iconAngular (2+)
User Interface (UI) Development
ROLES AND RESPONSIBILITIES ● Developing and integrating the frontend of our new platform based using AngularJS ● Writing high-quality HTML and CSS code that works across platforms ● Establish processes and best practices around front-end development standards. ● Review product requirements in order to give development estimates and product feedback SKILLS / COMPETENCIES ● Strong knowledge in frontend development of complex web applications using AngularJS, HTML5 and CSS ● Responsive Design integration with media queries is a must ● Secondary skills: Bootstrap, CSS animations, versioning system (GIT, SVN) ● Proficiency in Adobe Photoshop is a great plus ● Ability to work and communicate clearly and efficiently with team members.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos