Tech Lead - Web Scraping and Crawling

Our client provides data solutions for fraud prevention

Tech Lead - Web Scraping and Crawling

Purple Squirrel Consulting Services

Company

Home

Tech Lead - Web Scraping and Crawling

at Our client provides data solutions for fraud prevention

Agency job

via Purple Squirrel Consulting Services

4 - 10 yrs

₹10L - ₹20L / yr

Remote only

Skills

Web Scraping

Web crawling

Selenium

Selenium Web driver

Beautiful Soup

Data Science

web crawler

Javascript

Java

Python

HTML/CSS

Manage individual projects priorities, deadlines, and deliverables
Gather and process raw data at scale (including writing scripts, web scraping, calling/create

APIs, etc.) from the web / internet
Develop frameworks for automating and maintaining constant flow of data from multiple

sources
Identify, analysis, design, and implement internal process improvements
Design and implement tooling upgrades to increase stability and data quality
Help team to fix issues that occur in test and production environments
Automate software development processes, including build, deploy, and test
Manage and guide the team members

REQUIRED QUALIFICATIONS:

 4+ years of web crawling/ scraping experience is a must
 Strong knowledge of scraping frameworks such as Scrapy, Beautiful Soup, HTQL, Jsoup, Web-

Harvest and others
Excellent verbal, written, and interpersonal communication skills in English
 Good to have Experience of complex crawling (like captcha, Mobile OTP based crawling,

bypassing proxy)
 Sound Knowledge in Bot Management Techniques
 Experience in various data extraction methods (like data extraction from PDF Files, web

pages, etc)
 Good understanding of HTML DOM, CSS, Javascript, and RESTful web services

 Good to have understanding of AWS
 Experience with Linux
 Experience with Java / Python

Manage individual projects priorities, deadlines, and deliverables
Gather and process raw data at scale (including writing scripts, web scraping, calling/create

APIs, etc.) from the web / internet
Develop frameworks for automating and maintaining constant flow of data from multiple

sources
Identify, analysis, design, and implement internal process improvements
Design and implement tooling upgrades to increase stability and data quality
Help team to fix issues that occur in test and production environments
Automate software development processes, including build, deploy, and test
Manage and guide the team members

REQUIRED QUALIFICATIONS:

 4+ years of web crawling/ scraping experience is a must
 Strong knowledge of scraping frameworks such as Scrapy, Beautiful Soup, HTQL, Jsoup, Web-

Harvest and others
Excellent verbal, written, and interpersonal communication skills in English
 Good to have Experience of complex crawling (like captcha, Mobile OTP based crawling,

bypassing proxy)
 Sound Knowledge in Bot Management Techniques
 Experience in various data extraction methods (like data extraction from PDF Files, web

pages, etc)
 Good understanding of HTML DOM, CSS, Javascript, and RESTful web services

 Good to have understanding of AWS
 Experience with Linux
 Experience with Java / Python

Users love Cutshort

Read about what our users have to say about finding their next opportunity on Cutshort.

Shubham Vishwakarma

Full Stack Developer - Averlon

I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.

Companies hiring on Cutshort

Similar jobs

React.js Developer

at Coredgeio

1 recruiter

Posted by Abhimanyu Bhatter

Noida, Bengaluru (Bangalore), NCR (Delhi | Gurgaon | Noida)

3 - 7 yrs

₹8L - ₹15L / yr

React.js

NodeJS (Node.js)

Position: Software Engineer (React JS Developer)

Responsibilities

Developing new user-facing features using React.js
Building reusable components and front-end libraries for future use
Translating designs and wireframes into high-quality code
Optimizing components for maximum performance across a vast array of web-
capable devices and browsers

Skills
Strong proficiency in JavaScript, including DOM manipulation and the JavaScript object model
Thorough understanding of React.js and its core principles
Experience with popular React.js workflows (such as Flux or Redux)
Familiarity with newer specifications of EcmaScript
Experience with data structure libraries (e.g., Immutable.js)
Knowledge of isomorphic React is a plus
Familiarity with RESTful APIs
Soft Skills :
Excellent interpersonal Skills, Written & Verbal communication skills
Ability to communicate clearly & effectively based on facts & data Ability to
manage multiple streams in parallel in high pressure situation
Good understanding of Domain Drive Design

What are we looking for:

We’re looking for a deeply skilled Senior Software Engineer to work closely with the product and the open source community to build the Coredge.io vision. You'll join a highly collaborative team working along with talented engineers focusing to be the best in Cloud native ecosystem.

About the Organisation:

The team at Coredge.io is a combination of experienced and young professionals alike having many years of experience in working with Edge computing, Telecom application development and Kubernetes. The company has continuously collaborated with the open source community, universities and major industry players in furthering its goal of providing the industry with an indispensable tool to offer improved services to its customers. Coredge.io has a global market presence with its offices in US and New Delhi, India.

Position: Software Engineer (React JS Developer)

Responsibilities

Developing new user-facing features using React.js
Building reusable components and front-end libraries for future use
Translating designs and wireframes into high-quality code
Optimizing components for maximum performance across a vast array of web-
capable devices and browsers

Skills
Strong proficiency in JavaScript, including DOM manipulation and the JavaScript object model
Thorough understanding of React.js and its core principles
Experience with popular React.js workflows (such as Flux or Redux)
Familiarity with newer specifications of EcmaScript
Experience with data structure libraries (e.g., Immutable.js)
Knowledge of isomorphic React is a plus
Familiarity with RESTful APIs
Soft Skills :
Excellent interpersonal Skills, Written & Verbal communication skills
Ability to communicate clearly & effectively based on facts & data Ability to
manage multiple streams in parallel in high pressure situation
Good understanding of Domain Drive Design

What are we looking for:

We’re looking for a deeply skilled Senior Software Engineer to work closely with the product and the open source community to build the Coredge.io vision. You'll join a highly collaborative team working along with talented engineers focusing to be the best in Cloud native ecosystem.

About the Organisation:

The team at Coredge.io is a combination of experienced and young professionals alike having many years of experience in working with Edge computing, Telecom application development and Kubernetes. The company has continuously collaborated with the open source community, universities and major industry players in furthering its goal of providing the industry with an indispensable tool to offer improved services to its customers. Coredge.io has a global market presence with its offices in US and New Delhi, India.

Project Manager

at Big internet ecommerce pvt ltd

Posted by Shradha vernekar

Remote only

1 - 2 yrs

₹1L - ₹2L / yr

Team Management

Asana

Effective communication

Hello,

I am seeking a project manager who can help me manage and coordinate various projects using Asana, a web-based project management tool. The ideal candidate should have: - At least two years of experience in project management, preferably in the same or similar industry as mine - Proficiency in using Asana for creating, assigning, tracking, and reporting tasks, subtasks, milestones, dependencies, and deadlines - Excellent communication skills, both written and verbal, to communicate effectively with team members, clients, and stakeholders - Ability to work independently and collaboratively, as well as prioritize and multitask in a fast-paced environment - A proactive and problem-solving attitude, with a keen eye for detail and quality.

Hello,

Saviynt

at Technogen India PvtLtd

4 recruiters

Posted by divya Allam

Hyderabad

5 - 8 yrs

Best in industry

Saviynt

Identity management

Analyze client requirements and design customized Saviynt IGA solutions to meet their identity management needs
Configure and implement Saviynt IGA platform features, including role-based access control, user provisioning, de-provisioning, certification campaigns, and entitlement management
Collaborate with clients and internal stakeholders to understand business processes and translate them into effective IGA policies
Assist in the integration of Saviynt IGA with existing identity and access management (IAM) systems, directories, and applications
Conduct testing and troubleshooting to ensure the accuracy and effectiveness of the implemented IGA solution

Analyze client requirements and design customized Saviynt IGA solutions to meet their identity management needs
Configure and implement Saviynt IGA platform features, including role-based access control, user provisioning, de-provisioning, certification campaigns, and entitlement management
Collaborate with clients and internal stakeholders to understand business processes and translate them into effective IGA policies
Assist in the integration of Saviynt IGA with existing identity and access management (IAM) systems, directories, and applications
Conduct testing and troubleshooting to ensure the accuracy and effectiveness of the implemented IGA solution

Java Architect

at Zycus

10 recruiters

Posted by Nafis Kurne

Pune, Mumbai, Bangalore

14 - 26 yrs

₹25L - ₹55L / yr

Vue.js

AngularJS (1.x)

Angular (2+)

React.js

Javascript

+18 more

EXPERTISE AND QUALIFICATIONS

14+ years of experience in Software Engineering with at least 6+ years as a Lead Enterprise Architect preferably in a software product company
High technical credibility - ability to lead technical brainstorming, take decisions and push for the best solution to a problem
Experience in architecting Microservices based E2E Enterprise Applications
Experience in UI technologies such as Angular, Node.js or Fullstack technology is desirable
Experience with NoSQL technologies (MongoDB, Neo4j etc.)
Elastic Search, Kibana, ELK, Logstash.
Good understanding of Kafka, Redis, ActiveMQ, RabbitMQ, Solr etc.
Exposure in SaaS cloud-based platform.
Experience on Docker, Kubernetes etc.
Experience in planning, designing, developing and delivering Enterprise Software using Agile Methodology
Key Programming Skills: Java, J2EE with cutting edge technologies
Hands-on technical leadership with proven ability to recruit and mentor high performance talents including Architects, Technical Leads, Developers
Excellent team building, mentoring and coaching skills are a must-have
A proven track record of consistently setting and achieving high standards

Five Reasons Why You Should Join Zycus

1. Cloud Product Company: We are a Cloud SaaS Company, and our products are created by using the latest technologies like ML and AI. Our UI is in Angular JS and we are developing our mobile apps using React.

2. A Market Leader: Zycus is recognized by Gartner (world’s leading market research analyst) as a Leader in Procurement Software Suites.

3. Move between Roles: We believe that change leads to growth and therefore we allow our employees to shift careers and move to different roles and functions within the organization

4. Get a Global Exposure: You get to work and deal with our global customers.

5. Create an Impact: Zycus gives you the environment to create an impact on the product and transform your ideas into reality. Even our junior engineers get the opportunity to work on different product features.

About Us

Zycus is a pioneer in Cognitive Procurement software and has been a trusted partner of choice for large global enterprises for two decades. Zycus has been consistently recognized by Gartner, Forrester, and other analysts for its Source to Pay integrated suite. Zycus powers its S2P software with the revolutionary Merlin AI Suite. Merlin AI takes over the tactical tasks and empowers procurement and AP officers to focus on strategic projects; offers data-driven actionable insights for quicker and smarter decisions, and its conversational AI offers a B2C type user-experience to the end-users.

Zycus helps enterprises drive real savings, reduce risks, and boost compliance, and its seamless, intuitive, and easy-

to-use user interface ensures high adoption and value across the organization.

Start your #CognitiveProcurement journey with us, as you are #MeantforMore

EXPERTISE AND QUALIFICATIONS

14+ years of experience in Software Engineering with at least 6+ years as a Lead Enterprise Architect preferably in a software product company
High technical credibility - ability to lead technical brainstorming, take decisions and push for the best solution to a problem
Experience in architecting Microservices based E2E Enterprise Applications
Experience in UI technologies such as Angular, Node.js or Fullstack technology is desirable
Experience with NoSQL technologies (MongoDB, Neo4j etc.)
Elastic Search, Kibana, ELK, Logstash.
Good understanding of Kafka, Redis, ActiveMQ, RabbitMQ, Solr etc.
Exposure in SaaS cloud-based platform.
Experience on Docker, Kubernetes etc.
Experience in planning, designing, developing and delivering Enterprise Software using Agile Methodology
Key Programming Skills: Java, J2EE with cutting edge technologies
Hands-on technical leadership with proven ability to recruit and mentor high performance talents including Architects, Technical Leads, Developers
Excellent team building, mentoring and coaching skills are a must-have
A proven track record of consistently setting and achieving high standards

Five Reasons Why You Should Join Zycus

2. A Market Leader: Zycus is recognized by Gartner (world’s leading market research analyst) as a Leader in Procurement Software Suites.

3. Move between Roles: We believe that change leads to growth and therefore we allow our employees to shift careers and move to different roles and functions within the organization

4. Get a Global Exposure: You get to work and deal with our global customers.

About Us

Zycus helps enterprises drive real savings, reduce risks, and boost compliance, and its seamless, intuitive, and easy-

to-use user interface ensures high adoption and value across the organization.

Start your #CognitiveProcurement journey with us, as you are #MeantforMore

Android Lead

A funded gaming startup based out of Gurgaon

Agency job

via Qrata by Revathi Satish

NCR (Delhi | Gurgaon | Noida)

4 - 9 yrs

₹20L - ₹40L / yr

Android Development

Java

Kotlin

Key Responsibilities

Prototype new app and feature ideas and explore new technologies that are at the forefront of mobile technology
Integrating back-end API's with front-end.
Maintain android apps, listen to community and fix issues that arise
Design and implement new features, create UI, debugging
Optimize applications for maximum speed and scalability.
Collaborate with other team members

Key Requirements

Strong expertise in Java
Experience with releasing, maintaining mobile code
Strong focus on high-quality mobile UI experiences
Deep understanding of Android SDK
Proficient understanding of code versioning

Key Responsibilities

Prototype new app and feature ideas and explore new technologies that are at the forefront of mobile technology
Integrating back-end API's with front-end.
Maintain android apps, listen to community and fix issues that arise
Design and implement new features, create UI, debugging
Optimize applications for maximum speed and scalability.
Collaborate with other team members

Key Requirements

Strong expertise in Java
Experience with releasing, maintaining mobile code
Strong focus on high-quality mobile UI experiences
Deep understanding of Android SDK
Proficient understanding of code versioning

MERN FULL STACK DEVELOPER

at QEOSOL TECH SOLUTIONS PVT LTD

Posted by SUNIL N

Noida

4 - 10 yrs

₹5L - ₹20L / yr

NodeJS (Node.js)

React.js

Angular (2+)

AngularJS (1.x)

MongoDB

+3 more

POSITION - MERN Full stack Developer" & MERN FULL STACK TECHNICAL LEAD

EXP: 4-10YRS

Location: Noida, WORK FROM OFFICE

NP: IMMEDIATE JOINED/15 DAYS

In-depth knowledge of NodeJS, ExpressJS
REST API Services Development with Node.js
Front-end Application design and Development with React,
HTML / CSS/JavaScript
Database Knowledge with MongoDB
Design and Development of Dynamic web apps

POSITION - MERN Full stack Developer" & MERN FULL STACK TECHNICAL LEAD

EXP: 4-10YRS

Location: Noida, WORK FROM OFFICE

NP: IMMEDIATE JOINED/15 DAYS

In-depth knowledge of NodeJS, ExpressJS
REST API Services Development with Node.js
Front-end Application design and Development with React,
HTML / CSS/JavaScript
Database Knowledge with MongoDB
Design and Development of Dynamic web apps

Frontend Developer

My client is the Trust Platform of India

Agency job

via Unnati by Seemi Ejaz

Remote, Gurugram

2 - 7 yrs

₹12L - ₹18L / yr

Javascript

User Interface (UI) Design

User Experience (UX) Design

HTML/CSS

Algorithms

+1 more

Looking for a motivated Frontend Developer with experience in building high-performing,
scalable, enterprise-grade applications, to join and drive this vision and take it to a larger scale. Looking for a visionary, always on the lookout for finding the right solutions and technology geek, constantly seeking to learn and improve skillset Ideal Candidate

• Develop new user-facing features.
• Work alongside product to understand our requirements, and design, develop and iterate, think through the complex architecture.
• Writing clean, reusable, high-quality, high-performance, maintainable code.
• Ensure the technical feasibility of UI/UX designs and optimize applications for maximum speed.
• Research and apply new technologies, techniques, and best practices.
• Experience in working on frameworks like React and VueJS
• Excellent teamwork skills, flexibility, and ability to handle multiple tasks.
• Strong understanding of Object-Oriented Programming, Data Structure s, and Algorithms .
• Strong knowledge of Javascript, HTML5, CSS3.
• Extensive experience working on Javascript

Java Springboot developer

Agency job

via Plexcel Info Systems Pvt Ltd by Rekha Venkatesh

Bengaluru (Bangalore)

1 - 8 yrs

₹4L - ₹16L / yr

Vue.js

AngularJS (1.x)

Angular (2+)

React.js

Javascript

+5 more

I am hiring Java SpringBoot & ReactJS developers for a Big4 Consulting Company...

Location: Bangalore

Years of experience: 2- 7 Yrs

Notice Period: Immediate is desirable. not more than 1 month.

Prerequisites & Evaluation: The candidates should go thru' Coder Pad or HackerRank with medium or complex questions. Candidates with at least 80% pass marks will be taken forward.

Shortlisted candidates will be taken thru the next round of interviews by the client stakeholders.

Marketing Head

at HelpNow

1 video

5 recruiters

Posted by Mohika Jain

Mumbai

4 - 40 yrs

₹6L - ₹10L / yr

Marketing

People Management

Communication Skills

About the Role

Brainstorm digital and grass root strategies to let a billion people know about HelpNow. Your chance to build the 911 of India.

Job Responsibilities:

Hack influencer & celeb tie-ups, social media trends and comment strategy.
Tap into Housing societies, Jogging parks, etc. to spread awareness.
Negotiate ads on billboards, bus stops, metro trains et cetera.
Work on off-beat marketing ideas worthy of featuring on mad over marketing.
Drive regular posts on WhatsApp, email and blog posts.
Execute strategic barter deals and partnerships.

The candidate should have minimum 4 years of experience in:

Connecting with people of all kinds
Marketing for a growth stage startup
Being street smart with a demonstrated history of “hustling"
Social media activity that unanimously declares you a savage
Hunger for growth

About the Role

Brainstorm digital and grass root strategies to let a billion people know about HelpNow. Your chance to build the 911 of India.

Job Responsibilities:

Hack influencer & celeb tie-ups, social media trends and comment strategy.
Tap into Housing societies, Jogging parks, etc. to spread awareness.
Negotiate ads on billboards, bus stops, metro trains et cetera.
Work on off-beat marketing ideas worthy of featuring on mad over marketing.
Drive regular posts on WhatsApp, email and blog posts.
Execute strategic barter deals and partnerships.

The candidate should have minimum 4 years of experience in:

Connecting with people of all kinds
Marketing for a growth stage startup
Being street smart with a demonstrated history of “hustling"
Social media activity that unanimously declares you a savage
Hunger for growth

Manager Medical Billing

at Osprosys Software

1 recruiter

Posted by Latha C

Bengaluru (Bangalore), Bengaluru (Bangalore)

8 - 11 yrs

₹7L - ₹12L / yr

RCM

Medical billing in US Health care

Team Handling

Rotational Shifts

OSPRO is a global management consulting, technology services and outsourcing company committed to deliver innovation. OSPRO collaborates with its clients to help them become high-performance businesses. OSPRO can mobilize the right people, skills and technologies to help clients improve their performance. OSPRO has over 15 years of experience and proven track record in providing IT solutions, BPO and Medical services to wide spectrum of clients in Manufacturing, Financial Services, Healthcare, Communications, Energy, Transportation and Retail around the world.

Why apply to jobs via Cutshort