Cutshort logo
Our client provides data solutions for fraud prevention logo
Tech Lead - Web Scraping and Crawling
Our client provides data solutions for fraud prevention
Tech Lead - Web Scraping and Crawling
Our client provides data solutions for fraud prevention's logo

Tech Lead - Web Scraping and Crawling

at Our client provides data solutions for fraud prevention

4 - 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
Web Scraping
Web crawling
Selenium
Selenium Web driver
Beautiful Soup
skill iconData Science
web crawler
skill iconJavascript
skill iconJava
skill iconPython
skill iconHTML/CSS
  • Manage individual projects priorities, deadlines, and deliverables

  • Gather and process raw data at scale (including writing scripts, web scraping, calling/create

    APIs, etc.) from the web / internet

  • Develop frameworks for automating and maintaining constant flow of data from multiple

    sources

  • Identify, analysis, design, and implement internal process improvements

  • Design and implement tooling upgrades to increase stability and data quality

  • Help team to fix issues that occur in test and production environments

  • Automate software development processes, including build, deploy, and test

  • Manage and guide the team members

REQUIRED QUALIFICATIONS:

  •   4+ years of web crawling/ scraping experience is a must

  •   Strong knowledge of scraping frameworks such as Scrapy, Beautiful Soup, HTQL, Jsoup, Web-

    Harvest and others

  • Excellent verbal, written, and interpersonal communication skills in English

  •   Good to have Experience of complex crawling (like captcha, Mobile OTP based crawling,

    bypassing proxy)

  •   Sound Knowledge in Bot Management Techniques

  •   Experience in various data extraction methods (like data extraction from PDF Files, web

    pages, etc)

  •   Good understanding of HTML DOM, CSS, Javascript, and RESTful web services

  •   Good to have understanding of AWS

  •   Experience with Linux

  •   Experience with Java / Python

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Simplilearn Solutions
at Simplilearn Solutions
1 video
36 recruiters
Binoy Raphel
Posted by Binoy Raphel
Bengaluru (Bangalore)
1 - 6 yrs
₹3.6L - ₹5.5L / yr
Sales
Business Development
Telesales
Business relationship management

About Simplilearn:

Simplilearn.com is the world’s largest professional certifications company and an Onalytica Top 20 influential brand. With a library of 400+ courses, we've helped 1 million+ professionals advance their careers, delivering $5 billion in pay raises. Simplilearn has over 750 employees worldwide, and our customers include Fortune 1000 companies, top universities, leading agencies, and hundreds of thousands of working professionals. We are growing over 200% year on year and having fun doing it.


Who are we looking for?

This role would be part of the B2C sales function for our India/International Business Groups. He/she would drive the new customer acquisition, customer relationship management, operations, & reporting.


What should you do?

New Customer Acquisition


• Conversion of leads received through various marketing channels

• Preparing short-­­term and long-­­term sales plan towards reaching the assigned goals

• Consistently achieve revenue targets in line withteam/organizational objectives

• Proactively identifying cross-­­selling/up-­­selling opportunities with the existing customers

• Identifying references through the existing customer base to increase the sales pipeline


Customer Relationship Management

• Understand the customer requirement and pass on the insights towards the product portfolio improvement based on the customer interaction / feedback • Key Account Management • New account development


Operations and Reporting

• Managing pre-­­sales to post-­­sales support activities for the assigned products/geographies and ensuring the highest customer satisfactio

Read more
Cibirix
at Cibirix
2 recruiters
Anshika Garg
Posted by Anshika Garg
Indore
5 - 7 yrs
₹7L - ₹15L / yr
Wordpress
skill iconHTML/CSS
Plugin
Theme plugin
Content Management System (CMS)


WordPress developers should have the following skills:


  • Strong understanding of PHP back-end development.
  • In and out understanding of WordPress and theme - plugin implementations.
  • Much has experience and knowledge in improving WordPress performance.
  • Meeting with website functional requirements.
  • Experienced in content structuring and code optimization.
  • Good understanding of front-end technologies, including HTML5, CSS3, JavaScript, jQuery.
  • Knowledge of code versioning tools.


Read more
A growing online gaming company
A growing online gaming company
Agency job
via Jobdost by Sathish Kumar
Delhi, Gurugram, Noida, Ghaziabad, Faridabad
2 - 6 yrs
₹5L - ₹13L / yr
skill iconReact.js
skill iconAngularJS (1.x)
skill iconVue.js
skill iconJavascript
skill iconHTML/CSS
+1 more

Role Summary:

Front-end Developer who would contribute towards building a highly flexible and scalable front-end by bringing deep core technology expertise.

Job Description:

- Ensure proper offline access using service workers and PWA

- Develop components which are SEO friendly

- Have experience in server-side rendering

- Drive evolution of application performance

- Ensure project scalability by having good project architecture

 

Skill Requirements:

- Good experience in HTML5, CSS3, JS - React

- React native

- Angular - Redux exposure - Have handled service workers and PWA caching and updates - CSS pre-processors knowledge like sass - Knowledge of webpack, parcel, grunt etc.

-Knowledge of pre-processors like SASS/LESS, CSS-Modules.

- Architecting and automating the build process for production, using task runners or scripts (Gulp / Grunt)

-Have an eye for good UI/UX, Progressive Web Apps, Responsive Design

-Interested in writing code, actively experimenting along with learning new things.

 

Individual applying to the role should ideally have the following attributes

-Passionate about Frontend Development and continually follow the platform & innovations

-Strong and innovative approach to problem solving and finding solutions

-Interested in working on fast-paced

- Excellent communicator (written and verbal, formal and informal)

- Flexible and proactive/self-motivated working style with strong personal ownership of problem resolution

- Ability to multi-task under pressure and work independently with minimal supervision.

- Ability to prioritize when under pressure.

Read more
AJACKUS
at AJACKUS
1 video
6 recruiters
Kaushik Vedpathak
Posted by Kaushik Vedpathak
Remote only
1 - 3 yrs
₹6000 - ₹7000 / mo
Content Writing
Search Engine Optimization (SEO)
Marketing
Technical editing
Social Media Marketing (SMM)
+1 more
Job Description

Area
We are on a mission to enable businesses to build agile and accountable technology teams that can deliver results in a secure and scalable way. You will be working with the leadership team of the company to decide content strategy and assist marketing efforts.

Role

We are looking for a Content Writer to join our editorial team and enrich our websites with new blog posts, guides, and marketing copy.

Content Writer Intern responsibilities include conducting thorough research on industry-related topics, generating ideas for new content types and proofreading articles before publication. If you’re familiar with producing online content and have an eye for detail, we’d like to meet you. Feel free to share samples of your work or portfolio of your published articles, along with your application.

Ultimately, you’ll deliver quality writing pieces that appeal to our audiences, attract customers and boost brand awareness.

Responsibilities
  • Research industry-related topics (combining online sources, interviews and studies)
  • Write clear marketing copy to promote our products/services
  • Prepare well-structured drafts using Content Management Systems
  • Proofread and edit blog posts before publication
  • Submit work to editors for input and approval
  • Coordinate with marketing and design teams to illustrate articles
  • Conduct simple keyword research and use SEO guidelines to increase web traffic
  • Promote content on social media
  • Identify customers’ needs and gaps in our content and recommend new topics
  • Ensure all-around consistency (style, fonts, images and tone)
  • Update website content as needed

Qualifications
  • Bachelor's Degree BBA/BSc in Marketing, English, Journalism or related field
  • Proven work experience as a Content Writer, Copywriter or similar role if available
  • Familiarity with web publications
  • Excellent writing and editing skills in English
  • Ability to meet deadlines
Read more
Flowace
Nandini Jain
Posted by Nandini Jain
Remote only
1 - 2 yrs
₹3L - ₹6.5L / yr
skill icon.NET
ASP.NET
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconJavascript
+5 more

The ideal candidate will be familiar with the full software design life cycle. They should have experience in designing, coding, testing and consistently managing applications They should be comfortable coding in a number of languages and have the ability to test code in order to maintain high-quality code.

 

NET Developer Responsibilities:

  • Utilizing Microsoft's .NET infrastructure to create software solutions that meet clients' requirements.
  • Collaborating with coworkers to facilitate the creation of large, complex developments, as required.
  • Reformulating existing code to ensure adherence to stipulated guidelines.
  • Check your code to detect and remedy errors and omissions.
  • Testing your outputs to ensure that they are in excellent working order.
  • Ensuring that outputs are visually appealing, user-friendly, and engaging.
  • Deploying developments and monitoring uptake by the target audience.
  • Using clients' feedback to inform the creation of subsequent versions of each development.

 

Skills: Microsoft. Net, Win forms, LINQ, Entity Framework, Integrating REST Ful APIs, SQL

Good to have: ElectronJs, Electron. Net

Read more
Scalex Technology Solutions
Remote only
4 - 9 yrs
₹10L - ₹20L / yr
skill iconReact Native
skill iconFlutter
skill iconRedux/Flux
skill iconAndroid Development
skill iconiOS App Development
JOB DESCRIPTION:
 Work as part of a small team to build React Native iOS / Android applications for clients.
 Architect, build and maintain excellent React Native applications with clean code.
 Implement pixel perfect UI's that match designs.
 Implement clean, modern, smooth animations and transitions that provide an excellent user
experience.
 Integrate third-party API's.
 Write unit and integration tests.
 Release applications to IOS and Google Play stores.
 Work with native modules when required.
 Work as part of a small team, which will include other React Native developers, a project
manager, QA professional, and a designer.
 Complete sprints and participate in sprint retrospectives and daily standups.
 Assist with building estimates.
 Interface with clients via Slack, Zoom, and email.
 Track your time throughout the day using Toggle.
 Work with modern tools including Jira, Slack, GitHub, Google Docs, etc.
 Be part of a community of React Native developers who share knowledge and help each
other as problems arise.
 Follow Full Stack's detailed development process



Perks and Benefits

  • Get to work with a highly passionate team of engineers.
  • Open and embracing the culture for the latest hot technologies.
  • A high level of freedom, experimentation and responsibility.
  • Insurance and Snacks
  • Performance Benefits
Read more
Hotstar
at Hotstar
3 recruiters
Agency job
via Success Pact by Harish Joshi
Remote, Bengaluru (Bangalore), Delhi, Gurugram, Noida, Ghaziabad, Faridabad, Mumbai, Hyderabad
15 - 25 yrs
₹150L - ₹400L / yr
Engineering Management
Engineering Manager
Engineering Head
Director of Engineering
VP of Engineering
+6 more

VP Engineering

BANGALORE, KARNATAKA / 1. ENGINEERING – LEADERSHIP / FULL TIME

Disney Media & Entertainment Distribuon (DMED) brings together the Company’s best-in-class product, technology, and commercializaon teams together into one global organizaon. DMED is responsible for the P&L management and all distribuon, network and engineering operaons, sales, adversing, data, and certain key technology funcons worldwide for the Company’s content engines. DMED also manages operaons of the Company’s streaming services including Disney+, Hulu, ESPN+ and Disney+ Hotstar; and domesc broadcast and cable television networks.

Disney+ Hotstar is leading the way as the largest and smartest video plaorm in the country, reaching over 300 million users today. We have set a number of world records along the way - including for the highest concurrent viewership at 25.3 million during the ICC Cricket World Cup 2019. Disney+ Hotstar today is the one-stop desnaon for all your entertainment needs - from Live Sports, Indian and Internaonal Shows and Movies to all Disney content, including Pixar, Marvel, Star Wars, Naonal Geographic and Disney+ Originals. We’re looking for the brightest minds to build the future of TV with us.

About the Team

In this role, you will build large distributed systems to process and stream video at scale and drive all user aspects. As a VP for the team, you will develop plaorms and tools that deliver personalized recommendaons to 500+ million users. You will work on building storage soluons and microservices that serve recommendaons at a rate of few 100K requests per second. You

21/05/2021 Disney+ Hotstar - VP Engineering

will develop tools that serve recommendaons to our users in real-me. You will work closely with our product team to build new and compelling experiences for our customers!

The pace of our growth is incredible – if you want to tackle hard and interesng problems at scale, and create an impact within an entrepreneurial environment, join us!

Your Key Responsibilies

Responsible for the overall soware development life cycle.

Management and execuon against project plans and delivery commitments

Manage the day-to-day acvies of the engineering team within an Agile/Scrum environment.

Management of departmental resources, staffing, mentoring, enhancing, and maintaining a best-of-class engineering team.

Work closely with the engineers to architect and develop the best technical design and approach.

Contribute substanally to innovaon and overcome technology limitaons to deliver on customer experience.

Report on the status of development, quality, operaons, and system performance to management.

What to Bring

Bachelor's Degree in Computer Science or related field

14+ years of experience designing and developing complex, interacve consumer applicaons

Proficient with either Java or GoLang

7+ years of experience in soware development with strong experse in Java with micro web frameworks – like Play, Spring MVC, reacve programming

At least 5 years managing soware development teams including hands-on architectural or distributed systems experience

21/05/2021 Disney+ Hotstar - VP Engineering

Exposure in building RESTful APIs with monitoring(New Relic, statsd, graphite), fault tolerance and metrics

Experience with MySQL, NoSQL (Cassandra, Redis, DynamoDB) Experience/Knowledge of Nelix OSS.
Experience in server-side services using ElascSearch, Kaa Experience with AWS stack.

Experience with CI/CD processes.

A strong track record of project delivery for large, cross-funconal, projects and bringing in and growing engineering talent

Excellent wrien and verbal communicaon skills with the ability to present complex technical informaon clearly and concisely to a variety of audiences.

An entrepreneurial spirit combined with strong programming and product management skills

Our Values

- Audacity
- Self-Awareness - Ownership
- Bias for Acon
- Collaboraon
- Radical Candour - Inclusivity
- Mentorship

The Perks

- The glory. Almost too much responsibility. - No dress code. Unlimited leave.
- A fun-life balance.
- A cket on our rocket ship to the moon.

Who we are as an employer

We are an equal opportunity employer and all qualified applicants will receive consideraon for employment without regard to race, colour, religion, sex, naonal origin, gender identy,

🚀

21/05/2021 Disney+ Hotstar - VP Engineering

disability, protected veteran status, or any other characterisc protected by law. We will consider for employment qualified applicants with criminal histories consistent with applicable law.

Who we are as a company

We’re Disney+ Hotstar. The go-to desnaon for over 300 million users for everything from Live Sports, Indian and Internaonal Shows and Movies to all Disney content, including Pixar, Marvel, Star Wars, Naonal Geographic and Disney+ originals. Our mission is to revoluonize internet entertainment through smart personalizaon, and by building a global video plaorm that takes over the world wide web and the whole wide world.

Read more
WEQ Technologies
at WEQ Technologies
2 recruiters
Arshad Shaikh
Posted by Arshad Shaikh
Mumbai
1 - 2 yrs
₹2.5L - ₹4L / yr
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJavascript
+5 more

PRIMARY RESPONSIBILITIES :-

  • Should have develop professional applications in PHP using CodeIgniter.
  • Additional advantage if worked on frameworks like Laravel and Zend
  • Extensive knowledge with JavaScript, jQuery or Angular
  • Advance Level SQL knowledge
  • Additional advantage if familiar with Server Configuration and Monitoring
  • Should have working on Git Repository
  • Candidate should have exceptionally good debugging skills.
  • Clear about Object Oriented Programming Concepts.

SECONDARY RESPONSIBILITIES :-

  • Ability to work independently and take ownership of the project.
  • Should be capable to work in a team.
  • Must have strong communication skills.
  • Should be enthusiasts and able to take challenge.
Read more
Isparrow Services private limited
Priya Vora
Posted by Priya Vora
Ahmedabad
4 - 10 yrs
₹3L - ₹15L / yr
skill iconJava
J2EE
Struts
Spring
Hibernate (Java)
+1 more
  • 4+ years of professional development experience in an agile software engineering role
  • Strong development skills in Java or Groovy
  • Experience with Jenkins, bamboo and CI/CD environments
  • Familiarity with Guice or similar dependency injection frameworks
  • Familiarity with relational database technology
  • Familiarity with document store database technology such as ElasticSearch or Cassandra
  • Experience with design and testing of RESTful APIs
  • Familiarity with cross platform development on Linux, OSX and Windows
  • Strong understanding of Git version control system
  • Knowledge of JavaScript (Node.js)
  • Familiarity with Amazon Web Services (AWS)
  • Familiarity with Docker / Kubernetes
  • Experience with continuous integration and build systems such as Jenkins or Bamboo
  • Experience with Jira or other project management, issue-tracking or bug-tracking tools
  • Should have knowledge of RDBMS
  • Familiarity with Node.js, Kotlin, Kafka, DynamoDB
  • Previous experience with SaaS or cloud development, Micro-services

 

Read more
Rely
at Rely
1 video
3 recruiters
Hizam Ismail
Posted by Hizam Ismail
Bengaluru (Bangalore)
2 - 10 yrs
₹8L - ₹35L / yr
skill iconPython
Hadoop
Spark
skill iconAmazon Web Services (AWS)
Big Data
+2 more

Intro

Our data and risk team is the core pillar of our business that harnesses alternative data sources to guide the decisions we make at Rely. The team designs, architects, as well as develop and maintain a scalable data platform the powers our machine learning models. Be part of a team that will help millions of consumers across Asia, to be effortlessly in control of their spending and make better decisions.


What will you do
The data engineer is focused on making data correct and accessible, and building scalable systems to access/process it. Another major responsibility is helping AI/ML Engineers write better code.

• Optimize and automate ingestion processes for a variety of data sources such as: click stream, transactional and many other sources.

  • Create and maintain optimal data pipeline architecture and ETL processes
  • Assemble large, complex data sets that meet functional / non-functional business requirements.
  • Develop data pipeline and infrastructure to support real-time decisions
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS big data' technologies.
  • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
  • Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs.


What will you need
• 2+ hands-on experience building and implementation of large scale production pipeline and Data Warehouse
• Experience dealing with large scale

  • Proficiency in writing and debugging complex SQLs
  • Experience working with AWS big data tools
    • Ability to lead the project and implement best data practises and technology

Data Pipelining

  • Strong command in building & optimizing data pipelines, architectures and data sets
  • Strong command on relational SQL & noSQL databases including Postgres
  • Data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.

Big Data: Strong experience in big data tools & applications

  • Tools: Hadoop, Spark, HDFS etc
  • AWS cloud services: EC2, EMR, RDS, Redshift
  • Stream-processing systems: Storm, Spark-Streaming, Flink etc.
  • Message queuing: RabbitMQ, Spark etc

Software Development & Debugging

  • Strong experience in object-oriented programming/object function scripting languages: Python, Java, C++, Scala, etc
  • Strong hold on data structures & algorithms

What would be a bonus

  • Prior experience working in a fast-growth Startup
  • Prior experience in the payments, fraud, lending, advertising companies dealing with large scale data
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos