Cutshort logo
For Employers
Qube Research Technologies logo
Data Scraping - Python
Qube Research Technologies
Data Scraping - Python

Data Scraping - Python at Qube Research Technologies · Mumbai · 4 - 12 years · ₹30L - ₹70L / yr · Posted 21 Jan 2025

Xcelyst tech Solutions's logo

Data Scraping - Python

at Qube Research Technologies

4 - 12 yrs
₹30L - ₹70L / yr
Mumbai
Skills
skill iconPython
Data Structures

Data Scraping Specialist

Qube Research & Technologies (QRT) is a global quantitative and systematic investment manager, operating in all liquid asset classes across the world. We are a technology and data driven group implementing a scientific approach to investing. Combining data, research, technology and trading expertise has shaped QRT’s collaborative mindset which enables us to solve the most complex challenges. QRT’s culture of innovation continuously drives our ambition to deliver high quality returns for our investors.

 

Your future role within QRT

  • Your core objective is to develop and maintain web scraping tools to build datasets for research and trading
  • Contributing to integrate datasets from internal or external providers
  • Manage the multiple and extensive dataset used in the QRT research and trading platform
  • Monitoring fetching processes and data health
  • Supporting users (Quants & Traders)

 

Your present skillset

  • 4+ years’ experience in web scraping
  • Advanced English, both written and verbal communication skills
  • Polyglot developer, Python coding is important
  • Software engineering best practices
  • Ability to communicate and understand user needs
  • Structured and unstructured data management expertise is a plus
  • Knowledge of the financial data of equity/derivatives is a plus
  • Intellectual curiosity to learn new technologies
  • Capacity to work with autonomy within a global team


Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs (10)

Resources Valley
at Resources Valley
1 recruiter
Manind Gupta
Posted by Manind Gupta
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Jaipur
5 - 15 yrs
₹10L - ₹40L / yr
skill iconPython
skill iconDjango

Responsibilities

  • Assist with the design and implementation of advanced scraping solutions using Python, Playwright, and AWS services.
  • Automate interactions with JavaScript-heavy and authentication-secured websites, including handling MFA, CAPTCHAs, and session or token-based login flows.
  • Architect scraping pipelines using serverless AWS components such as Lambda, Step Functions, S3, CloudWatch, and Secrets Manager.
  • Build systems that scale to support high volumes of data extraction with fault tolerance, retries, and intelligent logging.
  • Integrate and manage complex workflows across multiple portals, APIs, and data sources.
  • Contribute to architectural decisions, tooling, and best practices.
  • Responsible for Code reviews and deployments.

 

Qualifications

  • Bachelor’s or master’s degree in computer science, software engineering, or related field, or equivalent professional experience
  • 10+ years of experience in Python development, with a strong focus on automation and data extraction
  • Proven expertise in web scraping using tools like Playwright, Selenium, Scrapy, BeautifulSoup, and requests
  • In-depth experience handling multi-step authentication flows, including multi-factor authentication (MFA), CAPTCHA solving, and session or cookie management
  • Proficient in deploying and managing scraping workloads in AWS, particularly Lambda, S3, IAM, CloudWatch, and Secrets Manager
  • Experience with asynchronous programming, headless browsers, and JavaScript-rendered content
  • Solid understanding of web protocols (i.e. HTTP, HTTPS, cookies, headers), and the ability to reverse-engineer network calls and authentication mechanisms
  • Comfortable working with APIs, JSON/XML, and data transformation
  • Experience with CI or CD pipelines, Docker, and infrastructure as code (i.e. CloudFormation, Terraform)
  • Familiar with data pipeline orchestration tools such as Apache Airflow or AWS Step Functions
  • Prior experience scraping from secure or enterprise-level portals (i.e. financial, healthcare, legal)
  • Background in data engineering or ETL workflows is a plus
  • Exposure to Python testing frameworks and writing unit or integration tests


Read more
Commercify360
Viny Deshmukh
Posted by Viny Deshmukh
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Gurugram
2 - 5 yrs
₹4.8L - ₹10L / yr
skill iconPython

About Us:

Datum builds market intelligence solutions for the retail industry. We transform public and proprietary data into actionable insights that help retail brands decide where to expand, compete, and grow. We are a small, fast-moving team that works closely with customers and

believes in shipping impactful products quickly.

About the Role

We're looking for a Full Stack Platform Engineer to build and own our end-to-end product ecosystem, including:

● Data acquisition through scalable web scraping and ETL pipelines

● Customer-facing analytics platform

● Geospatial analysis engine powering retail insights

You'll work across frontend, backend, data engineering, cloud infrastructure, and geospatial systems while collaborating directly with the founder and customers.

Key Responsibilities

● Build scalable web scrapers and ETL pipelines

● Develop customer-facing features using React/Next.js

● Design REST & WebSocket APIs

● Work with PostgreSQL/PostGIS and geospatial data

● Own deployment, CI/CD, monitoring, and cloud infrastructure

● Translate customer feedback into product features

Must-Have Skills

● 3–6 years of Full Stack development experience

● Python (FastAPI/Django)

● React or Next.js with JavaScript/TypeScript

● Web scraping using Scrapy, Playwright, Selenium, or BeautifulSoup

● PostgreSQL (PostGIS preferred)

● REST APIs, JWT/OAuth

● Docker, Git, AWS/GCP/Azure

● Understanding of proxy rotation and anti-bot techniques

Good to Have

● Mapbox, Leaflet, or Google Maps Platform

● Airflow, Redis, Kafka, or SQS

● Experience with large-scale scraping (Google Maps, Zomato, Justdial, etc.)

● Geospatial analytics or retail domain experience

● Startup experience with end-to-end ownership

Read more
VY SYSTEMS PRIVATE LIMITED
Santhanalakshmi A
Posted by Santhanalakshmi A
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Bengaluru (Bangalore), Hyderabad
5 - 12 yrs
₹8L - ₹16L / yr
skill iconPython
PySpark
SQL

1st virtual , 2nd round F2F

Python pyspark, SQL, data engineer

5+yrs

Bang/hyderabad

immediate to 15days.

Read more
VY SYSTEMS PRIVATE LIMITED
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Bengaluru (Bangalore), Hyderabad
5 - 9 yrs
₹9L - ₹15L / yr
skill iconPython
PySpark
SQL

1st virtual , 2nd round F2F -

Python pyspark, SQL, data engineer

5+yrs

Bang/hyderabad

immediate to 15days.

Read more
VY SYSTEMS PRIVATE LIMITED
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Hyderabad, Bengaluru (Bangalore)
5 - 9 yrs
₹9L - ₹20L / yr
PySpark
SQL
skill iconPython
ETL

Data Engineer Hiring Post


🚨 Hiring: Data Engineer | PySpark + Python + SQL

We are looking for experienced Data Engineers to join our team!

🔹 Experience: 5 to 9 Years

🔹 Locations: Bangalore / Hyderabad

🔹 Interview Process:

• 1st Round – Virtual

• 2nd Round – Face-to-Face (Karat Test)

🔑 Key Skills:

✅ PySpark

✅ SQL

✅ Python

✅ ETL

📩 Interested candidates can share their updated resume.

#Hiring #DataEngineer #PySpark #Python #SQL #ETL #BangaloreJobs #HyderabadJobs #TechHiring #ImmediateHiring

Read more
Wissen Technology
at Wissen Technology
4 recruiters
Meghana Shinde
Posted by Meghana Shinde
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Pune, Bengaluru (Bangalore)
4 - 10 yrs
Best in industry
skill iconPython
Artificial Intelligence (AI)
skill iconMachine Learning (ML)
Natural Language Processing (NLP)

Location - Bangalore / Pune 

 

Exp - 4 to 10 years 

 

Required

·      3–8 years of relevant experience in data science, AI engineering, or applied machine learning roles.

·      Bachelor’s or master’s degree in computer science, Mathematics, Engineering, or a related quantitative field.

·      System design: ability to design scalable, reliable, and maintainable systems, including service decomposition, APIs, caching, queues and event-driven architectures, and the trade-offs between latency, throughput, cost, and consistency.

·      Strong foundation in data structures and algorithms, with the ability to analyse time and space complexity and choose efficient approaches for large-scale data processing.

·      Experience building and operating data-intensive or data-driven applications, such as large-scale data pipelines, batch and streaming processing, or applications whose core features depend on high-volume data.

·      Strong hands-on experience in Python.

·      Solid foundation in machine learning, NLP, and statistical modeling, including data exploration and visualization.

·      Hands-on experience or projects involving LLMs, LangChain, LangGraph, RAG, or agentic AI systems.

·      Experience delivering AI/ML solutions into production environments.

·      Understanding of text processing and unstructured data.

·      Knowledge of software engineering best practices (TDD, refactoring, modular design, version control).

·      System design: ability to design scalable, reliable, and maintainable systems, including service decomposition, APIs, caching, queues and event-driven architectures, and the trade-offs between latency, throughput, cost, and consistency.

·      Strong foundation in data structures and algorithms, with the ability to analyze time and space complexity and choose efficient approaches for large-scale data processing.

·      Experience building and operating data-intensive or data-driven applications, such as large-scale data pipelines, batch and streaming processing, or applications whose core features depend on high-volume data.

·      Strong analytical, problem-solving, and communication skills.

·      Self-motivated, proactive, and delivery-oriented mindset.

 



Read more
VY SYSTEMS PRIVATE LIMITED
Dharani S
Posted by Dharani S
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Bengaluru (Bangalore)
5 - 9 yrs
₹3L - ₹20L / yr
skill iconPython
DevOps
PySpark

Job Description


We are looking for an experienced Data Engineer with strong expertise in Python, ETL, SQL, CI/CD, and DevOps to design, develop, and maintain scalable data pipelines and data processing solutions.


Key Responsibilities

  • Design, develop, and maintain scalable ETL/ELT data pipelines.
  • Develop data processing solutions using Python.
  • Write complex and optimized SQL queries, stored procedures, and data transformations.
  • Build and maintain data ingestion and integration workflows.
  • Implement data quality, validation, monitoring, and error-handling processes.
  • Develop and maintain CI/CD pipelines for data engineering applications.
  • Work with DevOps tools and practices for automated build, deployment, and infrastructure management.
  • Collaborate with data analysts, data scientists, software engineers, and business teams.
  • Optimize data pipelines for performance, reliability, and scalability.
  • Troubleshoot production data issues and ensure timely resolution.
  • Follow best practices for version control, code quality, testing, and deployment.


Mandatory Skills

  • Python
  • ETL
  • SQL
  • CI/CD
  • DevOps
  • Git / Version Control
  • Strong problem-solving and debugging skills


Read more
Tibil Solutions
Ram Kumar
Posted by Ram Kumar
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Bengaluru (Bangalore)
3 - 4 yrs
₹12L - ₹17L / yr
skill iconMachine Learning (ML)
Time series
Forecasting
 Hands-on experience with Deep Learning framework

Key Responsibilities

 Strong understanding of Machine Learning algorithms (supervised and unsupervised)

 Hands-on experience with Deep Learning frameworks (TensorFlow, PyTorch, or similar)

 Experience in NLP techniques and libraries (NLTK, spaCy, Hugging Face, etc.)

 Solid knowledge of Statistics, probability, and data analysis methods

 Proficiency in SQL for querying relational databases

 Strong programming skills in Python (or similar languages)

 Excellent communication skills with the ability to explain complex concepts simply


Required Qualifications

 3+ years of hands-on experience as a Data Scientist or in a similar role.

 Strong expertise in classical machine learning and regression modeling.

 Solid understanding of statistics, including probability, distributions, hypothesis testing,

and correlation analysis.

 Proficiency in Python with libraries such as: scikit-learn pandas NumPy

 Experience working with structured/tabular data.

 Strong problem-solving and analytical thinking skills.

 Ability to clearly explain models and results to non-technical stakeholders.

Read more
VY SYSTEMS PRIVATE LIMITED
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Bengaluru (Bangalore)
6 - 12 yrs
₹5L - ₹20L / yr
Amazon EMR
skill iconPython
skill iconScala

We are hiring experienced Data Engineers for a permanent opportunity in Bangalore.

Job Description

Role: Data Engineer

Location: Bangalore

Experience: 6+ Years

Key Responsibilities:

  • Design, develop, and maintain scalable data processing pipelines using Amazon EMR.
  • Develop data engineering solutions using Python and Scala.
  • Process and transform large volumes of structured and unstructured data.
  • Build and optimize distributed data processing workflows for performance and scalability.
  • Work with big data technologies and cloud-based data processing environments.
  • Perform data integration, validation, transformation, and quality checks.
  • Troubleshoot data pipeline issues and optimize processing performance.
  • Collaborate with data architects, analysts, and development teams to deliver reliable data solutions.

Required Skills:

  • Strong hands-on experience with Amazon EMR.
  • Proficiency in Python and Scala.
  • Experience in big data processing and data pipeline development.
  • Good understanding of distributed computing and data transformation techniques.
  • Experience in performance tuning and troubleshooting data processing jobs.
  • Strong analytical, problem-solving, and communication skills.


Read more
WebMD
FauziyaAnjum Khadas
Posted by FauziyaAnjum Khadas
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Remote only
2 - 3 yrs
₹7L - ₹15L / yr
skill iconPython
skill iconMachine Learning (ML)

About the Company: 

WebMD Health Corp., an Internet Brands Company, is the leading provider of health information services, serving patients, physicians, health care professionals, employers, and health plans through our public and private online portals, mobile platforms, and health-focused publications. The WebMD Health Network includes WebMD Health, Medscape, Jobson Healthcare Information, prIME Oncology, MediQuality, Frontline, QxMD, Vitals Consumer Services, MedicineNet, eMedicineHealth, RxList, OnHealth, Medscape Education, and other owned WebMD sites. WebMD®, Medscape®, CME Circle®, Medpulse®, eMedicine®, MedicineNet®, theheart.org®, and RxList® are among the trademarks of WebMD Health Corp. or its subsidiaries. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status.

For Company details, visit our website: www.webmd.com

Experience: 3+ years

Qualification: Master's degree in Computer Science, Statistics, Mathematics, or a related field.

Work Timings: 2 PM to 11 PM IST

Position Requirement:

  • Write clean and efficient code in Python and/or R for data analysis, statistical modeling, and machine learning tasks.
  • Apply statistical and machine learning techniques to analyze large datasets and extract meaningful patterns, trends, and insights. Develop and implement predictive models for various business applications.
  • Formulate hypothesis tests and design experiments to validate assumptions, measure the impact of changes, and optimize decision-making processes.
  • Demonstrate strong SQL skills for efficient data querying and manipulation using window functions.
  • Work with large datasets and ensure data quality and accuracy.
  • Experience with dashboarding tools like Tableau is a plus to visualize and present data-driven insights to both technical and non-technical stakeholders.
  • Ability to communicate complex technical concepts and insights in a clear and concise manner to both technical and non-technical audiences. Engage with the leadership team and clients to understand business requirements and provide data-driven solutions.
  • Work with real world case studies in Data Science and a chance to implement various modelling techniques. Opportunity to independently execute and lead analytical projects and assignments.
  • Help solve some challenging Healthcare related digital marketing problems globally. Transform business question into data requirements; collect and merge the data; analyse the data, link it to the business reality and present the results
  • Develop predictive models and machine learning algorithms to study change in physician prescribing behaviour as well as WebMD integrated campaign response behaviour. Build analysis to understand user engagement and behaviours across various WebMD products.

 

 

 

 

 

Technical Skills needed:

1.Experience with data manipulation in SQL environment is a must. Experience with BigQuery/Vertica data warehousing is good to have

  • Experience with statistical and data manipulation tools such as Python or R is a must 
  • Need very good expertise in using Microsoft Excel, and Microsoft PowerPoint. Excellent presentation skills required
  • Experience developing statistical models like hypothesis testing, regression models, classifications models, forecasting etc is a must 
  • Algorithm designing and implementation skills in R or Python is required 

Requirements

  • B.Tech/B.E. / MSc Statistics from premier institutes with
  • Minimum 80% marks in 10th and 12th
  • Minimum 75% marks in graduation
  • 2-5 years of relevant work experience in analytics field
  • Proven experience in data science, statistical modeling, and machine learning applications.
  • Strong proficiency in Python and/or R programming languages.
  • Solid understanding of statistical concepts, hypothesis testing, and experimental design
  • Expertise in SQL for data querying and manipulation.
  • Familiarity with dashboarding tools is a plus.
  • Excellent presentation, communication and interpersonal skills.

 

Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos