Cutshort logo
Our client provides data solutions for fraud prevention logo
Tech Lead - Web Scraping and Crawling
Our client provides data solutions for fraud prevention
Tech Lead - Web Scraping and Crawling
Our client provides data solutions for fraud prevention's logo

Tech Lead - Web Scraping and Crawling

at Our client provides data solutions for fraud prevention

4 - 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
Web Scraping
Web crawling
Selenium
Selenium Web driver
Beautiful Soup
skill iconData Science
web crawler
skill iconJavascript
skill iconJava
skill iconPython
skill iconHTML/CSS
  • Manage individual projects priorities, deadlines, and deliverables

  • Gather and process raw data at scale (including writing scripts, web scraping, calling/create

    APIs, etc.) from the web / internet

  • Develop frameworks for automating and maintaining constant flow of data from multiple

    sources

  • Identify, analysis, design, and implement internal process improvements

  • Design and implement tooling upgrades to increase stability and data quality

  • Help team to fix issues that occur in test and production environments

  • Automate software development processes, including build, deploy, and test

  • Manage and guide the team members

REQUIRED QUALIFICATIONS:

  •   4+ years of web crawling/ scraping experience is a must

  •   Strong knowledge of scraping frameworks such as Scrapy, Beautiful Soup, HTQL, Jsoup, Web-

    Harvest and others

  • Excellent verbal, written, and interpersonal communication skills in English

  •   Good to have Experience of complex crawling (like captcha, Mobile OTP based crawling,

    bypassing proxy)

  •   Sound Knowledge in Bot Management Techniques

  •   Experience in various data extraction methods (like data extraction from PDF Files, web

    pages, etc)

  •   Good understanding of HTML DOM, CSS, Javascript, and RESTful web services

  •   Good to have understanding of AWS

  •   Experience with Linux

  •   Experience with Java / Python

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

NeoGenCode Technologies Pvt Ltd
Akshay Patil
Posted by Akshay Patil
Bengaluru (Bangalore)
10 - 25 yrs
₹5L - ₹25L / yr
Test Automation (QA)
Systems Development Life Cycle (SDLC)
skill iconJava
Selenium
Appium
+12 more

Position Name : Senior QA Lead

Location : Bengaluru Main Campus, Whitefield, Bengaluru

Work Mode : Hybrid – 3 days WFO

Experience : 10 to 20 Years

Notice Period : Immediate Joiner to 15 Days


Role Overview :

Tesco is seeking a Senior QA Lead with a strong background in automation testing, SDLC, Agile methodologies, and CI/CD tools. The ideal candidate should have expertise in Java-based test automation, performance testing tools, and problem-solving.


Must-Have Skills :

Programming : Proficiency in Java.

Test Automation : Hands-on experience with frameworks like -Selenium, Rest Assured, Appium, TestNG, JUnit.

SDLC & Agile : Strong knowledge of software development life cycle (SDLC) and Agile methodologies.

CI/CD Tools: Experience with Jenkins, GitLab CI.

Performance Testing : Familiarity with tools like JMeter, LoadRunner.

Problem Solving : Strong analytical and root cause analysis skills.

Communication : Ability to collaborate effectively with cross-functional teams.


Good-to-Have Skills :

🔹 Oracle Financials : Fusion (SaaS) & Oracle Financials R12.

🔹 Strong functional knowledge of allied applications/modules :

  • Fusion/R12 GL, AP, AR, Cash Management, FA, Interfaces & Integrations.
  • Treasury Risk Management.


Key Responsibilities :

🔹 Test Automation & Framework Development : Design, develop, and maintain automated test frameworks.

🔹 Collaboration : Work closely with development teams to define and execute test strategies.

🔹 Regression & Quality Assurance : Conduct thorough regression testing and ensure high-quality releases.

🔹 Bug Tracking & RCA : Identify, record, and track defects while performing root cause analysis.

🔹 Mentorship : Guide and mentor junior SDETs, improving QA processes.

🔹 Process Optimization : Participate in code reviews and enhance testing methodologies.

🔹 Industry Awareness : Stay updated with the latest trends in software testing.

Read more
Gurugram
7 - 15 yrs
₹12L - ₹25L / yr
ISO 27001 LI
ISO 27701 Lead implementer
Information security
IT security
information security consultant
+1 more

Job Title: Senior Consultant Information Security – IT

Job Purpose: Acting in a key technical management & execution capacity to

provide a conduit between M&S IT teams and key business stakeholders thereby

ensuring information technology needs are managed consistently, following

professional IT and global M&S standards, and delivered with a high quality and

customer satisfaction.

Reward level: Middle Management

Job Location Gurgaon

Experience 7 years

Relevant Experience 7 years

Reporting to: General Manager

Qualification: Bachelor’s degree in IT and relevant Information Security

Certifications

Key Deliverables:

 Provide support as Lead implementor towards ISMS and PIMS policies,

procedures, and guidelines and ensure to perform regular review and update.

 Gather evidence of continuous compliance with ISO 27001:2022 and ISO

27701:2019, DPDPA, IT Act and Cert In Regulation including audit logs,

records of reviews, timely closure of open audit and risks and sharing the

report with management.

 Conduct regular, documented information security and privacy risk

assessments on Security Tools and Technologies by identifying assets,

threats, vulnerabilities, likelihood, and impact.

 Prioritize identified vulnerabilities, detailed findings, remediation

recommendations, trending reports on vulnerability posture towards closure

with stakeholders.

 Implementation of a comprehensive, ongoing security project plan for

remediation of open audit gaps.

 Prepare regular report on overall information security posture, GRC maturity,

and risk landscape to relevant stakeholders

 Perform Root Cause Analysis and lessons learned from information security

incidents, actively participate in audits and support internal IT staff to perform

technical assessments and controls with evidence.

Key Relationships:

 Internal IT and business customers in MSR.

 Global/Local IT Vendor, market and global (HQ) colleagues,

 Internal staff - direct reports (where applicable)

 IT vendors, contractors (where applicable)

Knowledge Skills and Abilities:


 Must have ISO 27001 Lead Implementer and ISO 27701 Lead Implementer

certifications.

 In depth understanding of IT Act, DPDPA, Cert In regulations, CIS Controls as

well as UK DPA and ISO 31000

 Good to have certification on CISM (Certified Information Security Manager),

CISSP (Certified Information Systems Security Professional) and Cloud Security

certifications (e.g., CCSK, CCSP, vendor-specific like AWS Security Specialty)

 Familiarity with common vulnerability scanning tools like Qualys (features,

reporting, agent-based vs. network scans) and Cloud Security Posture

Management (CSPM) tools like Wiz (cloud service provider configurations,

misconfigurations, compliance checks in AWS, Azure, GCP).

 Conduct and lead IT DR drills and Tabletop exercises with internal IT teams.

 Hands on knowledge on common security technologies (e.g., firewalls, EDR,

Cloud Security, VAPT tools, SIEM, WAF, DLP, PAM, BAS, encryption etc.,).

 Ability to handle and manage Endpoint, Perimeter, Cloud and Data Security

technical consoles with configuration and fine tuning of policies.

 Understanding of various penetration testing types (e.g., network, web

application, API, mobile, cloud) and methodologies

 Knowledge of common attack vectors and exploitation techniques like MITRE

ATTACK and DEFEND, NIST Cyber Security Framework.

 Excellent technical writing skills for creating clear, concise, and comprehensive

security policies, standards, and procedures.

 Ability to analyse complex risk data and present actionable insights.

 Proficiency with GRC platforms or tools for managing policies, risks, and controls

 Exceptional verbal and written communication skills to articulate complex security

concepts to technical and non-technical stakeholders

 Strong technical skills to diagnose security issues, identify root causes, and

develop effective solutions.

 Ability to develop and deliver engaging security training sessions and awareness

campaigns to internal IT staff.

 Ability to stay updated with the latest security threats, vulnerabilities,

technologies, and regulatory changes.


mail updated resume- etalenthire[at]gmail[dot]com

satish- 88O 27 49 743

Read more
Manufacturing of Engineering product
Manufacturing of Engineering product
Agency job
via keiretsu advisory services by shivani juyal
Manesar
1 - 4 yrs
₹2L - ₹3L / yr
Personnel security
Personal Administration
Administrative support

Personal Assistant-Manesar, Haryana

Responsibilities:

1. Coordinate and manage the managing director’s schedule, including meetings, appointments,

and travel arrangements.

2. EXCELLENT FOLLOW UP SKILLS.

3. Manage and prioritize incoming communications, including emails, phone calls, and mail.

4. Organize and coordinate meetings and work, conferences, and events, both internally and

externally.

5. Prepare meeting agendas, materials, and follow-up on action items.

6. Track and manage expenses, ensuring accurate and timely submission of expense reports.

7. Collaborate with other administrative staff to ensure seamless office operations.

4. Ability to take notes, Strong communication skills, both written and verbal.

5. Flexibility to adapt to changing priorities and work in a fast-paced environment

Read more
Product based company in Hyderabad
Product based company in Hyderabad
Agency job
via Vmultiply solutions by Mounica Buddharaju
Hyderabad
5 - 8 yrs
₹5L - ₹15L / yr
skill iconBootstrap
skill iconHTML/CSS
Angular
TypeScript
skill iconJavascript
+1 more

Skills & Qualifications 

●Should have experience of Angular 13 

●Should have 1 year of experience in NodeJS and RESTFUL API Development. 

●Strong knowledge of Front-End web development in Advance JavaScript (ES6, ES7, 

ES8, ES9), OOPS Concept PLUS exceptional debug skills 

●Experience in Unit test development (Test Driven Development – TDD) 

●Experience building progressive responsive web applications. 

●Experience in the concepts of code repositories (Preference GIT) and be able to commit 

code 

●A team player with good communication skills 

●Analytical thinking and problem-solving capability 

●Good to have - Continuous Integration (CI) tools like Jenkins. 

●Any experience on AWS will be a plus 

 

 

What are we looking for 

●5+ years of experience  in HTML5, CSS,Bootstrap,JavaScript,Tailwind,Angular (12.0 or higher), TypeScript and related technologies  

 

 

Educational Qualifications 

Bachelor's degree or equivalent experience in Computer Science or related field. 

 

Read more
Atmosol
at Atmosol
3 recruiters
Ram Manohar
Posted by Ram Manohar
Bengaluru (Bangalore)
3 - 5 yrs
₹8L - ₹13L / yr
skill iconJava
skill iconC#
Selenium
Selenium Web driver
The main job is automation of a web application written in react.js and asp.net MVC core. During production time, this could also include manual testing as and when required
Read more
Dwarka
4 - 6 yrs
₹15L - ₹24L / yr
Blockchain
Wallet (Blockchain)
Web3js

Min Exp – 4 years

Location – Dwarka, Delhi

Immediate joiners are preferred


About the company – We are a web development and digital marketing company in Delhi, India. We have been serving our clients globally since 2012. We offer quality assured and revenue driven digital services at affordable rate.


Role summary - We seek an experienced Web3 Developer to join our team and help us build and maintain our Ecosystem based on blockchain. Our platform is built using React for the front end, Node.js, TypeScript, MongoDB for the backend, and Solidity for smart contracts. Someone passionate about blockchain technology and with a strong understanding of the Web3 ecosystem.


Responsibilities:

1. Blockchain Solution Design:

  • Collaborate with stakeholders to understand business requirements and identify areas where blockchain technology can add value.
  • Design and architect blockchain solutions, including selecting appropriate blockchain platforms, consensus mechanisms, data structures, and smart contract frameworks.
  • Develop technical specifications, system architectures, and integration strategies for blockchain-based applications.
  • Ensure blockchain solutions align with industry best practices, security standards, and compliance requirements.

2. Blockchain Development:

  • Lead the development and implementation of blockchain applications, smart contracts, and decentralized protocols.
  • Design and implement APIs and integration points for seamless interaction between blockchain and existing enterprise systems.
  • Conduct thorough testing and debugging to ensure blockchain solutions' performance, security, and reliability.
  • Collaborate with development teams to define blockchain development coding standards and best practices.

3. Security and Privacy:

  • Implement robust security measures, encryption techniques, and access controls to protect blockchain data and transactions.
  • Address privacy concerns and design solutions that ensure the confidentiality of sensitive information while maintaining transparency.
  • Stay up-to-date with the latest security vulnerabilities and recommend strategies to mitigate risks in blockchain implementations.

4. Scalability and Performance Optimization:

  • Optimize blockchain solutions to enhance scalability, transaction throughput, and system performance.
  • Evaluate and implement scaling solutions, such as sharding, sidechains, or layer 2 protocols, to address the limitations of blockchain platforms.
  • Conduct load testing and performance tuning to identify bottlenecks and optimize resource utilization.

5. Blockchain Governance and Consensus:

  • Define governance models and consensus mechanisms suitable for specific use cases and industry requirements.
  • Assess and recommend appropriate consensus algorithms, such as Proof of Work (PoW), Proof of Stake (PoS), or Practical Byzantine Fault Tolerance (PBFT), based on the project's needs.
  • Establish protocols for transaction validation, block verification, and network participation.

6. Research and Innovation:

  • Stay updated with the latest advancements and emerging trends in blockchain technology.
  • Conduct research and experimentation to explore the potential of new blockchain platforms, protocols, and tools.
  • Evaluate and recommend third-party blockchain solutions, frameworks, and libraries to accelerate development processes.

7. Collaboration and Leadership:

  • Collaborate with cross-functional teams, including developers, engineers, product managers, and business stakeholders, to align technical requirements with business goals.
  • Provide technical guidance and mentorship to development teams regarding blockchain technologies, best practices, and coding standards.
  • Act as a subject matter expert, delivering presentations and training sessions on blockchain concepts and solutions.


Qualifications and Skills:


  • Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
  • Extensive experience in blockchain development and architecture, with a deep understanding of blockchain concepts, protocols, and platforms (such as Ethereum, Hyperledger Fabric, Corda, etc.).
  • Proficiency in programming languages commonly used in blockchain development, such as Solidity, Go, or Java.
  • Strong knowledge of smart contracts, decentralized applications (DApps), and blockchain development frameworks.
  • Familiarity with cryptographic principles, encryption algorithms, and security best practices in the context of blockchain.
  • Experience with cloud platforms and infrastructure (such as AWS, Azure, or Google Cloud) for deploying and managing blockchain networks.
  • Understanding of decentralized storage, identity management, and tokenization concepts.
  • Excellent problem-solving and analytical skills, with the ability to architect complex and scalable blockchain solutions.
  • Strong communication and leadership skills to collaborate effectively with multidisciplinary teams and drive successful project outcomes.
Read more
ArmorCode
at ArmorCode
1 recruiter
Khyati Mistry
Posted by Khyati Mistry
Remote only
5 - 8 yrs
₹25L - ₹55L / yr
skill iconElastic Search
skill iconAmazon Web Services (AWS)
skill iconSpring Boot
skill iconJava
● Engineering degree B.E/B.Tech/MCA/M.Tech/M.Sc or any Equivalent Degree.
● Proven work experience as a Back-end developer.
● In-depth understanding of the entire web development process (design, development and deployment).
● Proficient in Java, with a good knowledge of its ecosystems
● Basic understanding of JVM, its limitations, weaknesses, and workarounds
● Ability to decide when to use relational vs NoSQL databases and must be experienced with at least one of
the relational databases (MySQL) as well as experience with ElasticSearch will be good to have
● Familiarity with concepts of MVC, JDBC, and RESTful
● Experience with Spring, Spring Boot, Spring MVC
● Experience in CI/CD and Cloud technologies
● Expertise in developing enterprise-level web applications and RESTful APIs using MicroServices, with
demonstrable production-scale experience
● Familiarity with front-end languages (e.g. HTML, JavaScript and CSS) - Not mandatory
● Participation in coding competitions such as hackathon, hackerrank will be added advantage.
Read more
Unifytech
at Unifytech
20 recruiters
Prakash G
Posted by Prakash G
Hyderabad
2 - 12 yrs
₹10L - ₹20L / yr
skill iconReact.js
skill iconRedux/Flux
skill iconJavascript

Few words about Unify Technologies: Unify a Digital Engineering company. We help our clients by providing Digital Engineering Services to develop high-quality products. We have extensive experience in software product engineering and a successful track record of delivering on aggressive delivery plans without compromising on the quality in Cloud, Mobile, and Data practices.

 

Employment Type: Full-Time

Position: Sr. SDE and Lead SDE (Software Development Engineer)

Job Location: Hyderabad


Experience:

  • ReactJS Jr Developer: 2-4 Yrs

  • ReactJS Sr Developer: 4-8 Yrs

  • ReactJS Lead Developer: 7-12 Yrs


Key Skills:

  • ReactJS Jr Developer: (Must: ReactJS+JavaScript Programming Experience+UI)

  • ReactJS Sr Developer: (Must: ReactJS+JavaScript Programming Experience+UI)

  • ReactJS Lead Developer: (Must: Team Lead Experience + ReactJS+JavaScript Programming Experience+UI)

  • NOTE: For the Lead Developer Team leading exp is Must

Project: Product-Online Marketing, E-commerce Platforms and AI, Predictive Analytics

Joining time: Immediate to 30 days

Education: Master’s/Bachelor’s degree in Computer Science, Statistics, Engineering or a related technical discipline will be preferred


Skills Required for Front End UI (ReactJS) Sr Developer/Lead Developer:

  • Strong Experience in ReactJS/VueJS and JavaScript Programming

  • Strong knowledge of HTML/CSS Page Designs, DOM, HTTP protocol and how the web works in general.

  • Integrating with Backend Rest APIs

  • Experience using libraries and frameworks like React, Redux, GraphQL and TypeScript. 

  • Experience building server-side APIs and proxies using Node.js.

  • Strong Knowledge of managed and performance-oriented code with React and Redux, Mobx, Mobx-state-tree 

  • Good to have knowledge (Not must) with the SEO process

  • Build pixel-perfect, buttery smooth UIs across both mobile platforms.

  • Experience designing and building complex UI applications and implementing individual services that participate healthily in a microservice architecture.

  • Ability to write well-documented, clean JavaScript code

  • Familiarities with native Build tools, like XCode, Gradle and other required Build tools

  • Understanding of REST APIs, the document request model, and offline storage

  • Leverage native APIs for deep integrations with both platforms.

  • Diagnose and fix bugs and performance bottlenecks for performance that feels native.

  • Maintain code and write automated tests to ensure the product is of the highest quality.


Responsibilities:

  • Design, build, review and evolve durable, highly scalable event-driven infrastructure

  • Architect and lead the development of backend services.

  • Work with REST APIs and integrating them with our software platform

  • Develop front end capabilities such as dashboards, visualizations, features

  • Work on building best performance UI features and linking with backend

  • Integrate all the front end features with a backend pipeline 

  • Integrate our AI models with the platform pipeline 

  • Work on bug fixing and improving application performance 

  • Unit-test code for robustness, including edge cases, usability, and general reliability

  • Own new initiatives, Debug production issues

  • Help define the way we work in the future including coding and design standards

  • Work effectively in an agile development process

  • Research cutting edge technology that can be applied to accelerate business growth

  • Be the communication bridge be product owners and development teams

Read more
Headstartr
at Headstartr
1 recruiter
Vaibhav Nanda
Posted by Vaibhav Nanda
anywhere
0 - 7 yrs
₹3L - ₹7L / yr
User Experience (UX) Design
skill iconReact.js
skill iconHTML/CSS
Adobe Photoshop
UI designers who can make great designs and code in react framework as well
Read more
Expertily
at Expertily
1 recruiter
Pratyush Singh
Posted by Pratyush Singh
NCR (Delhi | Gurgaon | Noida)
0 - 2 yrs
₹3L - ₹4L / yr
skill iconPHP
LAMP Stack
skill iconLaravel
RESTful APIs
We're looking for someone to join our small family and help us build the biggest legal tech company in the world. We are looking for someone who wants to work as an equal and not as an employee. We are building a platform for individuals, companies, business houses etc. to find verified and qualified lawyers. We are Everything Legal. We are streamlining the super scattered legal ecosystem in India and are giving a place for clients and lawyers to meet and coordinate. Lawyers and other lawyers to collaborate. Students to find lawyers. Lawyers to find interns. Lawyers to publish journals. Lawyers to find judgments. Clients to review lawyers and more. Your Role in the company: 1. We would want someone motivated individual who will jump in and have an impact on the business and develop critical features for both our upcoming and existing product. 2. Embrace emerging standards while promoting best practices in order to push the limits of what a browser can do. 3. Should be comfortable working in Test Driven Development. 4. Should be a problem solver. 6. Work with CTO on timely code reviews and refactoring to optimize the code 7. Manage your own time, and work well both independently and as part of a team.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos