ETL+ SQL Developer at ScatterPie Analytics · Bengaluru (Bangalore) · 4 - 6 years · ₹10L - ₹16L / yr · Profitable · Posted 17 Dec 2024

Skills: ETL+ SQL
· Experience with SQL and data querying languages.
· Knowledge of data governance frameworks and best practices.
· Familiarity with programming/scripting languages (e.g., SparkSQL)
· Strong understanding of data integration techniques and ETL processes.
· Experience with data quality tools and methodologies.
· Strong communication and problem-solving skills
Detailed JD: Data Integration: Manage the seamless integration various data lake, ensuring that jobs are running as expected, validate the data ingested , track the DQ checks , rerun/reprocess the jobs in case of failures post figuring out the RCAs
Data Quality Assurance: Monitor and validate data quality during and after the migration process, implementing checks and corrective actions as needed.
Documentation: Maintain comprehensive documentation related to data issues encountered during the weekly/monthly processing and operational procedures.
Continuous Improvement: Recommend and implement improvements to data processing, tools, and technologies to enhance efficiency and effectiveness.

About ScatterPie Analytics
About
Similar jobs (10)
Data Engineer Short Hiring Post
🚨 Hiring: Data Engineer
🔹 Experience: 5–9 Years
🔹 Location: Bangalore / Hyderabad
🔹 Skills: PySpark, Python, SQL, ETL, CI/CD, Data Modeling
🔹 Process: L1 Virtual → L2 F2F Karat Test
🔹 F2F: Bangalore / Hyderabad Location
🔹 Positions: Immediate requirement
⚠️ Note: Candidates must be available for F2F Karat immediately after L1.
#Hiring #DataEngineer #PySpark #Python #SQL #BangaloreJobs #HyderabadJobs #Mphasis #ImmediateJoiners
We are looking for Data engineer with strong expertise in Data warehousing to join our team.
Key skills : ab initio, ssis , Informatica, Hadoop and Teradata
Data Engineer Hiring Post
🚨 Hiring: Data Engineer | PySpark + Python + SQL
We are looking for experienced Data Engineers to join our team!
🔹 Experience: 5 to 9 Years
🔹 Locations: Bangalore / Hyderabad
🔹 Interview Process:
• 1st Round – Virtual
• 2nd Round – Face-to-Face (Karat Test)
🔑 Key Skills:
✅ PySpark
✅ SQL
✅ Python
✅ ETL
📩 Interested candidates can share their updated resume.
#Hiring #DataEngineer #PySpark #Python #SQL #ETL #BangaloreJobs #HyderabadJobs #TechHiring #ImmediateHiring
Location: Hyderabad / Chennai
Experience: 5+ years
Employment type: Full-time, permanent
Work Hours: General Shift
website: www.amazech.com
Qualifications:
- B.E./B.Tech/M.E./M.Tech in Computer Science, Information Technology, Data Science, or related disciplines.
- Strong academic background with relevant industry experience in Data Engineering and Data Warehousing.
Key Responsibilities:
· Design, develop, and maintain scalable data warehouse solutions using Snowflake.
· Write, optimize, troubleshoot, and enhance Snowflake SQL queries with a focus on performance and scalability.
· Develop and support ETL processes using Talend to ensure reliable and efficient data movement.
· Collaborate with business, analytics, and application teams to enable reporting, dashboards, metrics, and data exploration capabilities.
· Perform data analysis and resolve issues across data ingestion, transformation, and reporting pipelines.
· Debug and troubleshoot Python-based data processing scripts and automation workflows.
· Implement best practices for data quality, testing, deployment, and code reviews.
· Work across UI, API, and Data Warehouse layers to support end-to-end data integration and business requirements.
· Monitor, optimize, and maintain data warehouse performance and operational stability.
· Create and maintain technical documentation, data models, and process workflows.
Required Skills and Experience:
· Strong hands-on expertise in Snowflake Data Warehouse.
· Advanced SQL skills with experience handling large-scale datasets.
· Strong understanding of Data Warehousing concepts, dimensional modelling, and data architecture.
· Hands-on experience with Analytical SQL functions, query tuning, and performance optimization.
· Experience developing and maintaining ETL solutions using Talend.
· Proficiency in Python for scripting, debugging, automation, and data processing.
· Experience integrating UI, API, and Data Warehouse workflows.
· Strong problem-solving and analytical skills.
· Experience with testing, code reviews, and deployment best practices.
· Excellent communication and stakeholder management skills.
Position: Backup Data ETL Developer
Experience: 6–9 Years
Location:Mumbai
Employment Type: Full-time
Job Description:
We are looking for a Backup Data ETL Developer with 6–9 years of experience in designing, developing, and supporting data extraction, transformation, and loading (ETL) processes.
The candidate should have strong hands-on experience with Hadoop, Spark, Informatica, and Snowflake, along with expertise in large-scale data processing and data integration technologies.
Key Skills:
Hadoop
Spark
Informatica
Snowflake
ETL Development
Data Integration
Data Transformation
Large-Scale Data Processing
ETL Workflows and Data Pipelines
Troubleshooting and Problem-Solving
Strong analytical and collaboration skills
Immediate Joining
We are looking for a Dedicated Resource on Contract for –
Role: Data Engineer
Experience: 5+ Years
Location: Remote
Duration: 3+ Months
Strong hands-on experience with Snowflake, including writing SQL queries, creating views, stored procedures, and functions.
Good knowledge of AI tools such as Claude.
Experience with ETL tools like Alteryx is good to have.
Power BI experience is good to have.
Strong communication skills.
Job Description
We are looking for an experienced Data Engineer with strong expertise in Python, ETL, SQL, CI/CD, and DevOps to design, develop, and maintain scalable data pipelines and data processing solutions.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines.
- Develop data processing solutions using Python.
- Write complex and optimized SQL queries, stored procedures, and data transformations.
- Build and maintain data ingestion and integration workflows.
- Implement data quality, validation, monitoring, and error-handling processes.
- Develop and maintain CI/CD pipelines for data engineering applications.
- Work with DevOps tools and practices for automated build, deployment, and infrastructure management.
- Collaborate with data analysts, data scientists, software engineers, and business teams.
- Optimize data pipelines for performance, reliability, and scalability.
- Troubleshoot production data issues and ensure timely resolution.
- Follow best practices for version control, code quality, testing, and deployment.
Mandatory Skills
- Python
- ETL
- SQL
- CI/CD
- DevOps
- Git / Version Control
- Strong problem-solving and debugging skills
Description
We are looking for Senior Data Engineers to join our Data Platform team and build scalable, high-performance data platforms that power data processing, analytics, and downstream applications.
The ideal candidate will have strong experience in distributed data processing, ETL pipelines, and Big Data technologies, with hands-on expertise in Apache Spark and Python Scala.
You will be responsible for designing, developing, and optimizing large-scale data pipelines while collaborating closely with cross-functional engineering teams to build reliable, production-grade data solutions.
Key Responsibilities
- Design, develop, and maintain scalable ETL and data processing pipelines for large-scale datasets.
- Build and optimize distributed data applications using Apache Spark and Python Scala.
- Develop reliable, high-performance data pipelines for batch and streaming workloads.
- Design and manage data workflows using Apache Airflow.
- Build and operate data workloads on AWS, with strong usage of Amazon S3 for large-scale data storage.
- Work with large datasets to ensure data quality, consistency, reliability, and performance.
- Collaborate with engineering, product, analytics, and other platform teams to deliver robust data solutions.
- Optimize data workflows for scalability, reliability, performance, and cost efficiency.
- Troubleshoot production issues, identify bottlenecks, and continuously improve platform performance.
Requirements
Candidates who demonstrate:
- 5+ years of experience in Data Engineering, Big Data Engineering, or a similar role.
- Strong hands-on experience with Apache Spark and Scala.
- Experience designing, building, and maintaining large-scale ETL pipelines.
- Strong hands-on experience with AWS, particularly Amazon S3.
- Hands-on experience with Apache Airflow for workflow orchestration and scheduling.
- Strong SQL skills and a solid understanding of distributed data processing concepts.
- Experience working with batch and/or streaming data pipelines.
- Excellent debugging, problem-solving, and performance optimization skills.
- Strong communication and collaboration skills.
Good to Have
- Experience with Databricks and the broader Databricks data platform.
- Familiarity with streaming technologies such as Apache Kafka.
- Experience working on large-scale data platforms handling high-volume data workloads.
- Exposure to additional AWS data services and cloud-native data architectures.
Description
We are looking for Senior Data Engineers to join our AdTech team and build scalable, high-performance data platforms that power advertising insights and analytics. The ideal candidate will have strong experience in distributed data processing, ETL pipelines, and Big Data technologies, with hands-on expertise in Spark and Scala.
You will work on designing, developing, and optimizing large-scale data pipelines while collaborating closely with cross-functional engineering teams to build reliable, production-grade data solutions.
Key Responsibilities
- Design, develop, and maintain scalable ETL pipelines for large-scale data processing.
- Build and optimize distributed data applications using Spark and Scala.
- Develop reliable, high-performance data pipelines for batch and streaming workloads.
- Work with large datasets to ensure data quality, consistency, and performance.
- Collaborate with engineering, product, and analytics teams to deliver robust data solutions.
- Optimize data workflows for scalability, reliability, and cost efficiency.
- Deploy and manage data workloads in cloud and containerized environments.
- Troubleshoot production issues and continuously improve platform performance.
Requirements
Candidates who demonstrate:
- 5+ years of experience in Data Engineering or Big Data Engineering.
- Strong hands-on experience with Apache Spark and Scala.
- Experience building and maintaining ETL pipelines.
- Familiarity with Google Cloud Storage (GCS).
- Experience with Kubernetes (K8s).
- Strong SQL skills and understanding of distributed data processing.
- Excellent debugging, problem-solving, and performance optimization skills.
- Strong communication and collaboration skills.
Good to Have
- Experience with AWS and cloud-native data services.
- Familiarity with streaming technologies such as Kafka.
- Experience working on large-scale data platforms or AdTech systems.
- Exposure to orchestration tools such as Airflow.
Benefits
- Best-in-class salary: We hire strong talent and compensate accordingly.
- Proximity Talks: Meet and learn from designers, engineers, product leaders, and AI practitioners.
- Continuous learning: Work with a world-class team and stay close to the latest in AI, engineering, and product development.
- High-impact work: Build AI-first systems and products used at scale by global clients.
About Us
Proximity is the trusted technology, design, and consulting partner for some of the biggest Sports, Media, and Entertainment companies in the world. We’re headquartered in San Francisco and have offices in Palo Alto, Dubai, Mumbai, and Bangalore.
Since 2019, Proximity has built high-impact, scalable products used by millions of users every day. Today, we are a global team of engineers, designers, product managers, and experts solving complex problems and building cutting-edge technology at scale.
Dear Candidate,
Thanks for showing interest in the opportunity!!!
As discussed, we have an opening for ETL Developer – Hadoop & PySpark with Mphasis for the Bangalore location – Permanent.
Job Description:
We are looking for an experienced ETL Developer with strong expertise in ETL development, Hadoop, and PySpark. The candidate should have hands-on experience in data processing, building and maintaining ETL pipelines, data transformation, and handling large datasets using Big Data technologies.
Primary & Mandatory Skills:
- ETL Development
- Hadoop / HDFS
- PySpark / Apache Spark
- Data Extraction, Transformation & Loading
- SQL and Data Processing
Good to Have:
- Hive / Spark SQL
- Data Pipeline Development
- Big Data Processing
- Python Programming
Company: Mphasis
Role: ETL Developer – Hadoop & PySpark
Experience: As per requirement
Location: Bangalore
Employment Type: Permanent












