Cutshort logo
Our client provides data solutions for fraud prevention logo
Tech Lead - Web Scraping and Crawling
Our client provides data solutions for fraud prevention
Tech Lead - Web Scraping and Crawling
Our client provides data solutions for fraud prevention's logo

Tech Lead - Web Scraping and Crawling

at Our client provides data solutions for fraud prevention

4 - 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
Web Scraping
Web crawling
Selenium
Selenium Web driver
Beautiful Soup
skill iconData Science
web crawler
skill iconJavascript
skill iconJava
skill iconPython
skill iconHTML/CSS
  • Manage individual projects priorities, deadlines, and deliverables

  • Gather and process raw data at scale (including writing scripts, web scraping, calling/create

    APIs, etc.) from the web / internet

  • Develop frameworks for automating and maintaining constant flow of data from multiple

    sources

  • Identify, analysis, design, and implement internal process improvements

  • Design and implement tooling upgrades to increase stability and data quality

  • Help team to fix issues that occur in test and production environments

  • Automate software development processes, including build, deploy, and test

  • Manage and guide the team members

REQUIRED QUALIFICATIONS:

  •   4+ years of web crawling/ scraping experience is a must

  •   Strong knowledge of scraping frameworks such as Scrapy, Beautiful Soup, HTQL, Jsoup, Web-

    Harvest and others

  • Excellent verbal, written, and interpersonal communication skills in English

  •   Good to have Experience of complex crawling (like captcha, Mobile OTP based crawling,

    bypassing proxy)

  •   Sound Knowledge in Bot Management Techniques

  •   Experience in various data extraction methods (like data extraction from PDF Files, web

    pages, etc)

  •   Good understanding of HTML DOM, CSS, Javascript, and RESTful web services

  •   Good to have understanding of AWS

  •   Experience with Linux

  •   Experience with Java / Python

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

xoxoday
at xoxoday
2 recruiters
Agency job
via Jobdost by Sathish Kumar
Bengaluru (Bangalore)
4 - 7 yrs
₹20L - ₹35L / yr
skill icon.NET
ASP.NET
skill iconC#
skill iconAmazon Web Services (AWS)
MVC Framework
+4 more

 

Senior Backend Developer (C# and .NET)

Hybrid / On-site (Bangalore)

What is the role?

Xoxoday is looking for a candidate who has a strong background in the design and implementation of scalable architecture and a good understanding of Algorithms, Data structures, and design patterns. Candidates must be ready to learn new tools, languages, and technologies. We are offering hybrid / remote options as well.

Basic Qualifications:

  • At least 4 -7 years of experience as a software developer.
  • At Least 3 years of experience in .net core C#, AWS stack, MS SQL Server, MVC, NodeJS experience is a plus
  • Strong working knowledge in distributed event-driven messaging architecture/platform
  • Strong knowledge in data access layer especially ability to work with stored procedure
  • Established and stimulated software development standards and processes along with best practices for delivery of scalable and high-quality software.
  • Production experience with AWS stack
  • Fluent English speaker

Preferred Qualifications:l

  • Experience working with OOP languages.
  • Experience designing and developing Microservices and SOA.
  • Experience working with AWS Kinesis, Lambda, SQS, S3, ElastiCache, ElasticSearch, Kubernetes, EventBridge, RDS, CloudWatch, APIGateway
  • Experience designing and building high-performance scalable web services.
  • Experience in REST API design and implementation.
  • Experience in unit testing, test automation, and continuous delivery.
  • Experience with stream-processing and message-broker software.

Nice to have:

  • Experience working with distributed teams.
  • Ability to work independently and as part of a team.
  • Ability to work quickly toward tight deadlines, and make smart tradeoffs between speed, accuracy, and maintainability.
  • Bachelor's or Master's degree in computer science (or equivalent professional experience).

What can you look for?

A wholesome opportunity in a fast-paced environment that will enable you to juggle between concepts, yet maintain the quality of content, interact, and share your ideas and have loads of learning while at work. Work with a team of highly talented young professionals and enjoy the benefits of being at Xoxoday.

We are

Xoxoday is a rapidly growing fintech SaaS firm that propels business growth while focusing on human motivation. Backed by Giift and Apis Partners Growth Fund II, Xoxoday offers a suite of three products - Plum, Empuls, and Compass. Xoxoday works with more than 2000 clients across 10+ countries and over 2.5 million users. Headquartered in Bengaluru, Xoxoday is a 300+ strong team with four global offices in San Francisco, Dublin, Singapore, New Delhi.

Way forward

We look forward to connecting with you. As you may take time to review this opportunity, we will wait for a reasonable time of around 3-5 days before we screen the collected applications and start lining up job discussions with the hiring manager. We however assure you that we will attempt to maintain a reasonable time window for successfully closing this requirement. The candidates will be kept informed and updated on the feedback and application status.

Read more
Simform
at Simform
1 video
2 recruiters
Ravi Dhingani
Posted by Ravi Dhingani
Remote, Ahmedabad
3 - 7 yrs
₹7L - ₹12L / yr
skill iconVue.js
TypeScript
Vue 3
Unit testing
Vuex

Company Description:


Simform is a product engineering company on a mission to solve complex software engineering problems. They have helped organizations ranging from startups that went public to Fortune 500 companies and enterprises. Simform's Product Innovation Center transforms engineering from bottlenecks to growth drivers by using proven technology practices such as DevOps, cloud-native development, and quality engineering services. The company has agile teams that are remote and immerse themselves in clients' projects while maintaining their company culture and working in line with strategic goals.



Role Description:


This is a full-time remote role for a Senior Vue JS Developer at Simform. As a Vue JS Developer, you will be responsible for developing user-friendly web interfaces and applications. You will work closely with cross-functional teams, including backend developers and UI/UX designers. You will use your expertise in Vue JS and related frameworks to maintain, enhance, and develop user-facing products and ensure the technical feasibility of UI/UX designs.



Qualifications and Skills:


  • 3+ years of experience in front-end development
  • Must have hands-on with Vue 3 and Typescript.
  • 2+ experience with Vue JS and related frameworks like Nuxt.js.
  • Strong understanding of cross-browser compatibility, experience in building responsive web applications and progressive web applications
  • Experience with Vuex, Vuetify, Vuex-persist and Vuelidate would be a plus
  • Understanding of state management using Vuex, Axios or any other JS library
  • Understanding of TDD using frameworks like Jest or Jasmine
  • Good understanding of templating languages like Pug or Handlebars
  • Good understanding of Git, DevOps workflows, & CI and CD processes
  • Ability to write clean, modular, reusable code & excellent analytical skills
  • Strong debugging and troubleshooting skills to identify the root issues quickly, anticipate & mitigate scaling issues.
  • Bachelor's or Master's in Computer Science, or a related field
  • Prior experience working in a remote team environment would be a plus



Why Simform?:


  • Flat-hierarchical, friendly, engineering-oriented, and growth-focused culture. 
  • Flexible work timing, 18+12 leaves, Leaves for life events, flexible environment.
  • Free health insurance
  • Office facility with large fully-equipped game-zone, in-office kitchen with affordable lunch service, and free snacks. 
  • Sponsorship for certifications/events, library service.
Read more
Deqode
at Deqode
1 recruiter
Samiksha Agrawal
Posted by Samiksha Agrawal
Pune, Indore
1 - 2.5 yrs
₹3L - ₹11L / yr
skill iconRuby
skill iconRuby on Rails (ROR)
skill iconJavascript
skill iconReact.js
skill iconAngular (2+)
+5 more

Job Description :


- Strong understanding of the Ruby programming language and Rails framework


- Proficiency in Javascript including experience with React, Angular or Vue


- Database understanding (Postgres/MySQL)


- Previous experience maintaining production applications


- Focus on writing clear, maintainable, tested code.


Skills Required :


- Navigating and understanding a large codebase


- Experience with Git continuous integration and regular deployments


- Understanding and appreciation for UX and usability


- Excellent communication skills and diligent ability to contribute to the team by performing code reviews,


- Writing tests using Rspec and Capybara.

Read more
The Hub
at The Hub
1 recruiter
Sridevi Viswanathan
Posted by Sridevi Viswanathan
Chennai
3 - 8 yrs
₹10L - ₹15L / yr
skill iconNodeJS (Node.js)
skill iconMongoDB
SaaS
My client is a VC-funded startup and is backed by some of the leading venture funds & angels in India & US.

We are looking for a Backend Developer to join our team to build the first-of-its-kind product in the space - and we are looking for out-of-the-box thinkers with the original thought process and lateral thinking. The code you ship will be used by thousands of users every day helping them get their work done. You will join a young, dynamic and fast-paced environment, and work with cross-functional teams to design, build, and roll out products that deliver the company's vision and strategy.

Responsibilities :

- Backend development with Node.js, MongoDB and Typescript.

- Developing and testing flexible, scalable applications.

- Collaborate with Front end developers to produce optimum output.

- Think out of the box, discuss and implement your ideas over the phase.

Required skills :

- Strong knowledge in creating RESTFUL APIs(web service)

- Proficient understanding of code versioning tools: Git.

- Good knowledge of Docker & Shell scripting

- Basic knowledge of web fundamentals: HTML, CSS

- Experience in DevOps is an added advantage
Read more
ThinkSys Inc
at ThinkSys Inc
1 recruiter
Kalpna  Panwar
Posted by Kalpna Panwar
Noida
3 - 6 yrs
₹5L - ₹9L / yr
Storage & Networking
TCP/IP
VPN
Wireshark
tcpdump
+4 more

Hi



Profile : Network Support Engineer

Experience - 3+ years

Timing - Thurs-Mon: 10:30PM to 7:30 AM

https://www.thinksys.com/

 Location: NOIDA, Sec-62 ( Work from Office)



Expertise & Hands on experience with the following:

  • Creating new infrastructure from scratch
  • Excellent working experience of LAN, WAN management and network devices
  • Linux Server installation and drivers installations configuration
  • Network troubleshooting in both windows, linux environments.
  • Troubleshooting of WiFi Networks
  • Solid understanding of networking concepts and protocols, including TCP/IP, DNS, DHCP, BGP, OSPF, VLANs, and VPNs.
  • Perform network diagnostics using tools such as Wireshark, tcpdump, and SNMP.
  • Investigate security incidents and implement measures to mitigate risks. ○ Participate in on-call rotation to provide support for network emergencies.
  • Working experience to manage the complex network infrastructure.
  • Experience to do automation to manage network devices using scripting.
  • Strong analytical and problem-solving skills with the ability to quickly diagnose and resolve network issues.
  • Cisco CCNA or equivalent certification is a plus.

Scripting for automation ○ Python ○ Bash


Non-Functional Requirements: 

  • Performs regular audits of server security and websites exposed outside to the world.
  • Documenting any processes which employees need to follow in order to successfully work within our computing system.
  • Experience supporting technical teams (e.g., developers and/or IT teams)
  • Strong attention to details of problems and ability to navigate complex issues in high pressure situations
  • The ability to effectively collaborate with various internal teams
  • Excellent critical thinking and problem solving skills.
  • Ensures all the problems are resolving in a timely manner and following SLAs.
  • Ability to prioritize a wide range of workloads with critical deadlines.
  • Experience in a 24x7 environment.
  • Good communication skills





Read more
codersbrain
at codersbrain
1 recruiter
Aishwarya Hire
Posted by Aishwarya Hire
Noida, Detroit, USA
4 - 10 yrs
₹7L - ₹10L / yr
skill iconJava
skill iconPython
skill iconRuby
skill iconRuby on Rails (ROR)
skill iconGo Programming (Golang)
+8 more

UKG's engineering teams wants to add 4 staff aug consultants (2 in US and 2 in Noida) to support their identity platform infrastructure, deployments to prod, escalations/KTLO, and debugging needs. They'll need to partner with internal dev teams who consume our Identity platform around any issues or new integrations needed. RCA/enhancing our observability.


They need to have the below qualifications:


• Linux (Ubuntu) - Understanding of Linux OS and has experience with troubleshooting complex issues that can be due to infrastructure related around disk/iops, network latency, jvm/gc related, as well as application related defects.


Python/similar scripting language to help automate manual tasks/remediation efforts.


• Ansible

• Identity platforms/technology -

SAML2/Oauth2/Directory server LDAP#python queryquerylanguage/OpenDJ/OpenAM/Auth0/Okta/SSO

• Java - understanding of Java tuning/best practices for high volume applications at scale

• Nginx

• Grafana • PagerDuty

• Postman/API • Kibana/Splunk

Dynatrace


GCP preferred. Azure is good as well.



Read more
savvysoft technologies
at savvysoft technologies
1 recruiter
Bharath savvy
Posted by Bharath savvy
Chennai
2 - 5 yrs
₹2L - ₹6L / yr
Human Resources (HR)
Recruitment
Recruitment/Talent Acquisition
Staff augmentation
staffing

Responsibilities

  • Identify and Source candidates with matching skills and experience as specified in the requirements
  • Interview and qualify shortlisted candidates to confirm suitability (technical, administrative and personal), attitude, honesty and reliability
  • Confirm that the chosen candidates are willing to be deputed to work at our clients’ premises
  • Build confidence and trust in the candidates that they are our team and full-time employees
  • Follow-up with candidates by sharing with and obtaining from the candidates all information promptly and periodically throughout the recruitment process  

 

 

Location: Chennai

Experience: 3+ years

Domain: Domestic Staffing Industry

Skills: Recruitment of IT and other engineers for Telecom Industry

Geographical Coverage: Pan India

Work Hours: 6 Days Week except Second Saturday

 

 

Read more
sss placement
Chennai
3 - 6 yrs
₹7L - ₹18L / yr
Selenium
Appium
Test Automation (QA)
Software Testing (QA)
skill iconPython
+2 more
Golden Job opportunity for Experience Candidate

Job Profile :- Python Developer | Automation Engineer

Experience : - 3.0 to 6.0 Yrs

Salary : - CTC Range: 700000.0 - 1800000.0

Job Location : - Chennai

Job Description :-

1. Hands-on experience in Python
2. Proficient experience in the automation tool
3. Strong understanding of Automation Development
4. QA processes Experience with working in an Agile environment and CI/CD driven testing culture
5. Good communication skills with Organizational behavior
6. Source control and build tools experience with GIT
7. Jenkins Familiarity with Continuous Integration and software build processes

Skills Required

1. Python
2. Automation tool
3. Automation Development
4. QA
5. GIT tool experience
6. Jenkins.
7. Selenium

Male and female both candidate can apply

Regards

SSS Placement
Read more
Casey Foods
at Casey Foods
7 recruiters
Hrnisi Mishra
Posted by Hrnisi Mishra
Jharsuguda
3 - 7 yrs
₹2L - ₹3L / yr
Sales
Marketing
Team building
Lead Generation

To recruit and train the Block Sales Manager for their current district.

To manage sales operation.

To identify skill gaps.

To contact potential customers to identify business opportunity.

To develop promotional programs to increase sales and revenue.

To supervise the team.

To maintain clear and complete sales reports for management review.  

To plan and coordinate sales activities for assigned projects.

To provide outstanding services and ensure customer satisfaction.

Read more
Brandmuscle
at Brandmuscle
2 recruiters
Manjusha Shenoy
Posted by Manjusha Shenoy
Bengaluru (Bangalore)
5 - 9 yrs
₹4.5L - ₹9L / yr
skill iconJavascript
skill iconAngularJS (1.x)
User Interface (UI) Design
skill iconHTML/CSS
skill iconjQuery
+1 more
Responsibilities :- Develop new user - facing features- Ability to translate the UI designs in to fully-functional interactive prototypes- Build reusable code and libraries for future use- Ensure the technical feasibility of UI / UX designs. - Optimize application for maximum speed and scalability. - Assure that all user input is validated before submitting to back - end. - Collaborate with other team members and stakeholders. Technical Skills :- Complete familiarity with web technologies HTML5/CSS3/JavaScript, JQuery and AJAX.- Thorough knowledge on JS frameworks and knowledge of OOPs & MVC. - Some experience with CSS pre-processors (SASS) and JS frameworks (Angular)- Strong skills one or more frameworks like Angular 1.x/2+, React JS, Can JS- Basic working knowledge of MVC RazorSoft Skills :- Good to great presentation skills- Good to great written and communication skillsEducation Qualification : B.E./B.Tech
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos