Data Scraping - Python

About Us:

Datum builds market intelligence solutions for the retail industry. We transform public and proprietary data into actionable insights that help retail brands decide where to expand, compete, and grow. We are a small, fast-moving team that works closely with customers and

believes in shipping impactful products quickly.

About the Role

We're looking for a Full Stack Platform Engineer to build and own our end-to-end product ecosystem, including:

● Data acquisition through scalable web scraping and ETL pipelines

● Customer-facing analytics platform

● Geospatial analysis engine powering retail insights

You'll work across frontend, backend, data engineering, cloud infrastructure, and geospatial systems while collaborating directly with the founder and customers.

Key Responsibilities

● Build scalable web scrapers and ETL pipelines

● Develop customer-facing features using React/Next.js

● Design REST & WebSocket APIs

● Work with PostgreSQL/PostGIS and geospatial data

● Own deployment, CI/CD, monitoring, and cloud infrastructure

● Translate customer feedback into product features

Must-Have Skills

● 3–6 years of Full Stack development experience

● Python (FastAPI/Django)

● React or Next.js with JavaScript/TypeScript

● Web scraping using Scrapy, Playwright, Selenium, or BeautifulSoup

● PostgreSQL (PostGIS preferred)

● REST APIs, JWT/OAuth

● Docker, Git, AWS/GCP/Azure

● Understanding of proxy rotation and anti-bot techniques

Good to Have

● Mapbox, Leaflet, or Google Maps Platform

● Airflow, Redis, Kafka, or SQS

● Experience with large-scale scraping (Google Maps, Zomato, Justdial, etc.)

● Geospatial analytics or retail domain experience

● Startup experience with end-to-end ownership

1st virtual , 2nd round F2F

Python pyspark, SQL, data engineer

5+yrs

Bang/hyderabad

immediate to 15days.

Data Engineer Short Hiring Post

🚨 Hiring: Data Engineer

🔹 Experience: 5–9 Years

🔹 Location: Bangalore / Hyderabad

🔹 Skills: PySpark, Python, SQL, ETL, CI/CD, Data Modeling

🔹 Process: L1 Virtual → L2 F2F Karat Test

🔹 F2F: Bangalore / Hyderabad Location

🔹 Positions: Immediate requirement

⚠️ Note: Candidates must be available for F2F Karat immediately after L1.

#Hiring #DataEngineer #PySpark #Python #SQL #BangaloreJobs #HyderabadJobs #Mphasis #ImmediateJoiners

Hiring for Data Scientist / Senior Data Scientist

Exp : 4 - 12 yrs

Edu : BE/B.tech/MCA

Work Location : Pune

Notice Period : Immediate - 15 days

Skills :

4+ years of experience in data engineering, data science, or related domains.

Hands-on experience with SQL, Python, and distributed data systems.

Knowledge of machine learning techniques and statistical analysis.

Experience with cloud data platforms (Azure Data Factory, AWS Glue, GCP BigQuery).

Familiarity with DevOps practices and CI/CD for data pipelines.

Platforms & Operations Experience (Preferred)

- Experience working with Azure, AWS, or Google Cloud data tools.

Operational experience with data orchestration tools (Airflow, ADF, Glue).

Understanding of Kubernetes, Docker, or containerized environments.

Hands-on experience with data warehousing platforms (Snowflake, Redshift, BigQuery).

Experience in monitoring, logging, and alerting operations for data workflows.

Data Engineer Hiring Post

🚨 Hiring: Data Engineer | PySpark + Python + SQL

We are looking for experienced Data Engineers to join our team!

🔹 Experience: 5 to 9 Years

🔹 Locations: Bangalore / Hyderabad

🔹 Interview Process:

• 1st Round – Virtual

• 2nd Round – Face-to-Face (Karat Test)

🔑 Key Skills:

✅ PySpark

✅ SQL

✅ Python

✅ ETL

📩 Interested candidates can share their updated resume.

#Hiring #DataEngineer #PySpark #Python #SQL #ETL #BangaloreJobs #HyderabadJobs #TechHiring #ImmediateHiring

Job Summary

We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate should have strong expertise in SQL, Python, Linux, and modern data engineering practices to support data integration, transformation, and analytics.

Key Responsibilities

• Design, develop, and maintain ETL/ELT data pipelines.
• Write efficient and optimized SQL queries for data extraction, transformation, and reporting.
• Develop automation scripts using Python for data processing and workflow optimization.
• Work with Linux environments for deployment, monitoring, and troubleshooting.
• Ensure data quality, integrity, and reliability across data platforms.
• Collaborate with data analysts, software engineers, and business stakeholders to deliver data solutions.
• Monitor, troubleshoot, and optimize data pipelines for performance and scalability.
• Implement best practices for data security, governance, and documentation.

Required Skills

• Strong experience in Data Engineering concepts and ETL/ELT processes.
• Proficiency in SQL, including query optimization and database design.
• Strong programming skills in Python.
• Hands-on experience with Linux commands, shell scripting, and system administration basics.
• Experience with relational databases such as PostgreSQL, MySQL, SQL Server, or Oracle.
• Familiarity with Git/version control.
• Strong analytical and problem-solving skills.

Preferred Skills

• Experience with cloud platforms (AWS, Azure, or GCP).
• Knowledge of Apache Spark, Airflow, Kafka, or similar data engineering tools.
• Experience with data warehousing solutions and big data technologies.
• Understanding of CI/CD pipelines and containerization (Docker/Kubernetes).

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
• Relevant certifications in cloud or data engineering are an added advantage.

Job Description

We are looking for an experienced Data Engineer with strong expertise in Python, ETL, SQL, CI/CD, and DevOps to design, develop, and maintain scalable data pipelines and data processing solutions.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines.
• Develop data processing solutions using Python.
• Write complex and optimized SQL queries, stored procedures, and data transformations.
• Build and maintain data ingestion and integration workflows.
• Implement data quality, validation, monitoring, and error-handling processes.
• Develop and maintain CI/CD pipelines for data engineering applications.
• Work with DevOps tools and practices for automated build, deployment, and infrastructure management.
• Collaborate with data analysts, data scientists, software engineers, and business teams.
• Optimize data pipelines for performance, reliability, and scalability.
• Troubleshoot production data issues and ensure timely resolution.
• Follow best practices for version control, code quality, testing, and deployment.

Mandatory Skills

• Python
• ETL
• SQL
• CI/CD
• DevOps
• Git / Version Control
• Strong problem-solving and debugging skills

Key Responsibilities

 Strong understanding of Machine Learning algorithms (supervised and unsupervised)

 Hands-on experience with Deep Learning frameworks (TensorFlow, PyTorch, or similar)

 Experience in NLP techniques and libraries (NLTK, spaCy, Hugging Face, etc.)

 Solid knowledge of Statistics, probability, and data analysis methods

 Proficiency in SQL for querying relational databases

 Strong programming skills in Python (or similar languages)

 Excellent communication skills with the ability to explain complex concepts simply

Required Qualifications

 3+ years of hands-on experience as a Data Scientist or in a similar role.

 Strong expertise in classical machine learning and regression modeling.

 Solid understanding of statistics, including probability, distributions, hypothesis testing,

and correlation analysis.

 Proficiency in Python with libraries such as: scikit-learn pandas NumPy

 Experience working with structured/tabular data.

 Strong problem-solving and analytical thinking skills.

 Ability to clearly explain models and results to non-technical stakeholders.

Sr.Data Scientist,Python, AI ML

We are looking for a skilled Data Scientist to analyze complex datasets, develop predictive models, and generate actionable insights that support business decisions. The ideal candidate should have strong statistical, analytical, and programming skills, along with hands-on experience in machine learning.

We are hiring for Data Miner/Data Entry role.

Job location : Sindhubhavan road, Ahmedabad

Job Timings : 2:00 PM to 11:00 PM IST

5 Days working

Company Name: TechWize (A Business unit of Mangalam Information Technologies Pvt Ltd.)

Our Accreditations -

• 25 years of industry presence
• Salesforce Partner
• ISO 27001:2019 certified
• Great Place to Work certified
• HIPAA Compliant
• SOC2 Compliant
• NASSCOM Member

Our EVP (Employee Value proposition)

• We are a Great place to work certified company.
• 30 Earned Leaves during calendar Year
• Career progression and continuous Learning & Development (Technical, Soft skills, Communication, Leadership)
• Performance bonus & Loyalty Bonus Benefits
• 5 Days working
• Rewards and Recognition programs
• Standard Salary as per market norms
• Equal career opportunities, No discrimination
• Magnificent & Dynamic Culture
• Festival celebrations & fun events

Explore more : https://techwize.com/, https://mangalaminfotech.com/