Data Engineer(Pyspark +Sql ) at Fragma Data Systems · Remote only · 1 - 5 years · ₹10L - ₹15L / yr · Profitable · Remote only · Posted 11 Jul 2022

Must Have Skills:

Similar jobs (10)
Company: Wissen Technology
Position: Databricks Engineer
Experience: 6-10 Years
Location: Bengaluru/Mumbai
Employment Type: Full-time
About Wissen Technology
Wissen Technology is a global technology services company focused on delivering innovative software engineering, data, and technology solutions to leading enterprises. The company works with clients across industries to build scalable, high-performance technology platforms and solve complex business and technology challenges.
With a strong focus on engineering excellence, innovation, and collaboration, Wissen Technology brings together skilled technology professionals across areas such as software engineering, data engineering, cloud, analytics, and digital transformation.
At Wissen Technology, employees have the opportunity to work on challenging technology projects, collaborate with experienced engineering teams, and contribute to solutions that create measurable business impact.
Key Responsibilities
- Design, develop, and maintain scalable data processing applications using Python, PySpark, and Spark.
- Develop and optimize data pipelines and workflows on Databricks.
- Collaborate with data engineers, data scientists, business stakeholders, and other technical teams to understand requirements and deliver high-quality solutions.
- Ensure data integrity, quality, performance, and reliability across data processing pipelines.
- Write clean, maintainable, scalable, and efficient code following established coding standards and best practices.
- Perform data analysis and implement appropriate data validation and quality checks.
- Monitor, troubleshoot, and optimize performance issues across data workflows and pipelines.
- Work with relational databases and develop efficient SQL queries for data extraction and transformation.
- Participate in code reviews, testing, deployment, and continuous improvement of data engineering solutions.
- Use Git/version control and follow established software development and deployment practices.
Required Skills & Qualifications
- Bachelor’s or Master’s degree in Computer Science, Engineering, Information Technology, or a related field.
- Proven experience as a Databricks Developer, Data Engineer, or similar role.
- Strong hands-on expertise in Apache Spark and PySpark.
- Strong programming skills in Python; experience with Scala is an advantage.
- Strong proficiency in SQL and hands-on experience with relational databases.
- Practical experience developing and optimizing data pipelines and data processing applications.
- Familiarity with Git and version control systems.
- Strong understanding of data engineering concepts, data transformation, and data validation.
- Excellent analytical and problem-solving skills.
- Strong communication and collaboration skills, with the ability to work effectively with cross-functional teams.
We are looking for a skilled Python & PySpark Developer with strong expertise in Big Data technologies, Spark, SQL/PL-SQL, and REST API development using Flask or Django. The ideal candidate should have experience building scalable data pipelines, processing large datasets, developing APIs, and working with distributed computing frameworks.
Key Responsibilities
- Develop, optimize, and maintain scalable data pipelines using PySpark and Apache Spark.
- Design, develop, and optimize complex SQL and PL/SQL queries, stored procedures, functions, and database objects.
- Build and maintain RESTful APIs using Flask or Django.
- Develop robust Python applications for data engineering and backend services.
- Process and analyze large-scale datasets using Big Data technologies.
- Optimize Spark jobs for performance, scalability, and reliability.
- Integrate APIs with internal and external systems.
- Collaborate with cross-functional teams including Data Engineers, Data Scientists, and Application Developers.
- Troubleshoot production issues and implement performance improvements.
- Follow coding standards, version control, and CI/CD best practices.
Mandatory Skills
- Strong proficiency in Python programming.
- Hands-on experience with PySpark and Apache Spark.
- Strong SQL coding skills.
- Experience with PL/SQL development.
- Experience in Big Data ecosystem.
- REST API development using Flask or Django.
- Experience in developing and consuming Python APIs.
- Knowledge of data processing, ETL, and distributed computing.
- Experience with Git/version control.
Preferred Skills
- Experience with Hadoop ecosystem (Hive, HDFS, YARN).
- Exposure to cloud platforms such as AWS, Azure, or GCP.
- Knowledge of Airflow or other workflow orchestration tools.
- Experience with Docker and Kubernetes.
- Familiarity with Kafka or other streaming technologies.
- Understanding of CI/CD pipelines.
Qualifications
- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
- 4–8+ years of experience in Python and Big Data development (can be adjusted based on the role).
Required Experience
- Strong hands-on experience in Python, PySpark, and Apache Spark.
- Extensive experience writing optimized SQL and PL/SQL code.
- Experience developing REST APIs using Flask or Django.
- Experience working with large-scale data processing and ETL pipelines.
- Strong analytical, debugging, and problem-solving skills.
Mandatory Skills: Python, PySpark, SQL Coding, Apache Spark, Big Data, Flask/Django (REST API), PL/SQL, Python APIs.
🚨 WE ARE HIRING – SENIOR DATA ENGINEER | BANGALORE 🚨
Looking for experienced Senior Data Engineers with strong expertise in PySpark, Oracle SQL/PLSQL, and Data Modeling!
🔹 Role: Senior Data Engineer
🔹 Experience: 7+ Years
🔹 Location: Bangalore
🔹 CTC: Up to 26 LPA
🔹 Notice Period: Immediate to 10 Days Preferred
💻 Mandatory Skills
✅ PySpark
✅ Oracle SQL / PL/SQL
✅ Data Modeling & Design / Modernization
✅ Python
✅ ETL
✅ Data Pipelines
⚙️ Good to Have / Ecosystem Skills
✅ Kafka
✅ Hadoop
✅ AWS / Azure / GCP
✅ Git
✅ JIRA
📌 Key Responsibilities
• Develop and maintain scalable data pipelines using PySpark
• Work extensively with Oracle SQL/PLSQL for data processing and transformation
• Design and implement data models and data architecture
• Work on data design and modernization initiatives
• Develop and optimize ETL processes and data pipelines
• Handle large volumes of data using PySpark and Python
• Work with technologies such as Kafka, Hadoop, and Cloud platforms
• Collaborate with cross-functional teams to deliver scalable data solutions
• Use Git and JIRA for version control and project tracking
📩 Interested candidates can share their updated CV along with:
Total Experience:
Relevant PySpark Experience:
Relevant Oracle SQL/PLSQL Experience:
Data Modeling Experience:
Current Location:
Notice Period:
Current CTC:
Expected CTC:
#Hiring #DataEngineer #SeniorDataEngineer #PySpark #Oracle #PLSQL #DataModeling #Python #ETL #DataPipelines #Kafka #Hadoop #AWS #Azure #GCP #BangaloreJobs #ITJobs #TechJobs #ImmediateJoiners
Job Summary
We are looking for a skilled and experienced Data Engineer to join our growing data team. The ideal candidate will have strong expertise in Python, PySpark, Data Modeling, and Power BI, with hands-on experience in designing, developing, and optimizing scalable data solutions. The role requires working closely with business stakeholders, data architects, and analytics teams to build robust data pipelines and semantic models that enable data-driven decision-making.
Technical Skills
- Strong hands-on experience in Python and PySpark development.
- Expertise in building and optimizing Data Engineering solutions and ETL pipelines.
- Strong understanding of Data Modeling concepts (Star Schema, Snowflake Schema, Dimensional Modeling).
- Experience with Power BI Data Modeling and Semantic Layer development.
- Proficiency in DAX (Data Analysis Expressions).
- Experience designing and managing Semantic Models in Power BI.
- Strong SQL skills and experience working with large datasets.
- Knowledge of data warehousing concepts and best practices.
Preferred Skills
- Experience with cloud platforms such as Azure, AWS, or GCP.
- Exposure to modern data platforms like Databricks.
- Understanding of data governance and data quality frameworks.
Senior Data Engineer – PySpark & Oracle
Experience: 7+ Years
Location: Bangalore
Notice Period: Immediate to 10 Days
Key Skills:
- Strong expertise in Data Modeling, Data Design & Modernization
- Primary skills: PySpark, Oracle SQL/PLSQL
- Secondary skills: Python, ETL & Data Pipelines
- Experience with Kafka and Hadoop
- Exposure to AWS / Azure / GCP
- Good knowledge of Git and JIRA
Roles & Responsibilities:
- Design, develop, and modernize scalable data models and data architecture.
- Develop and optimize data processing solutions using PySpark and Oracle SQL/PLSQL.
- Build and maintain robust ETL workflows and data pipelines.
- Work with Kafka, Hadoop, and cloud platforms for data processing and integration.
- Perform data transformation, optimization, and performance tuning.
- Collaborate with technical teams on data design, development, testing, and deployment.
Data Engineer Hiring Post
🚨 Hiring: Data Engineer | PySpark + Python + SQL
We are looking for experienced Data Engineers to join our team!
🔹 Experience: 5 to 9 Years
🔹 Locations: Bangalore / Hyderabad
🔹 Interview Process:
• 1st Round – Virtual
• 2nd Round – Face-to-Face (Karat Test)
🔑 Key Skills:
✅ PySpark
✅ SQL
✅ Python
✅ ETL
📩 Interested candidates can share their updated resume.
#Hiring #DataEngineer #PySpark #Python #SQL #ETL #BangaloreJobs #HyderabadJobs #TechHiring #ImmediateHiring
1st virtual , 2nd round F2F
Python pyspark, SQL, data engineer
5+yrs
9+yrs
Bangalore/Hyderabad
immediate to 15days.
Responsibilities and JD
Job Description: We are looking for a Senior Developer with strong expertise in PySpark, Databricks, and Snowflake to build scalable data engineering solutions and enterprise data platforms.
Key Responsibilities:
- Design, develop, and maintain ETL/ELT pipelines using PySpark, Databricks, and Snowflake.
- Develop batch and real-time data processing solutions for structured and semi-structured data.
- Build and optimize Databricks notebooks, workflows, and Delta Lake solutions.
- Design and implement Snowflake databases, schemas, views, stored procedures, tasks, and streams.
- Develop scalable data models, data marts, and data warehouse solutions.
- Optimize PySpark jobs, Databricks workloads, and Snowflake queries for performance and cost efficiency.
- Implement data quality, validation, governance, and security controls.
- Collaborate with business stakeholders, architects, and cross-functional teams to deliver data solutions.
- Manage source control and CI/CD deployments using Git and Azure DevOps.
- Troubleshoot production issues, perform root cause analysis, and ensure pipeline reliability.
- Mentor junior team members and participate in code reviews and technical design discussions.
Required Skills: PySpark, Databricks, Snowflake, Python, SQL.
Experience: 5+ years of Data Engineering experience with strong hands-on expertise in PySpark, Databricks, and Snowflake.
Dear Candidate,
Thanks for showing interest in the opportunity!!!
As discussed, we have an opening for ETL Developer – Hadoop & PySpark with Mphasis for the Bangalore location – Permanent.
Job Description:
We are looking for an experienced ETL Developer with strong expertise in ETL development, Hadoop, and PySpark. The candidate should have hands-on experience in data processing, building and maintaining ETL pipelines, data transformation, and handling large datasets using Big Data technologies.
Primary & Mandatory Skills:
- ETL Development
- Hadoop / HDFS
- PySpark / Apache Spark
- Data Extraction, Transformation & Loading
- SQL and Data Processing
Good to Have:
- Hive / Spark SQL
- Data Pipeline Development
- Big Data Processing
- Python Programming
Company: Mphasis
Role: ETL Developer – Hadoop & PySpark
Experience: As per requirement
Location: Bangalore
Employment Type: Permanent
Job Description – Azure Data Engineer
Role: Azure Data Engineer
Experience: 9+ Years
Location: Bangalore / Hyderabad
Notice Period: Immediate to 15 Days
Interview Process: 1st Round – Virtual | 2nd Round – F2F
Mandatory Skills
- Python
- PySpark
- SQL
- Azure Data Engineering
Job Description
We are looking for an experienced Azure Data Engineer with 9+ years of experience and strong hands-on expertise in Python, PySpark, SQL, and Azure Data Engineering.
Key Responsibilities
- Develop and maintain scalable data engineering solutions using Azure.
- Build and optimize data processing pipelines using PySpark and Python.
- Write complex SQL queries for data extraction and transformation.
- Work with Azure data services and cloud-based data platforms.
- Perform data processing, transformation, and integration.
- Troubleshoot data pipeline and production issues.
- Collaborate with technical and business teams to deliver data solutions.
Preferred: Immediate to 15 Days joiners.








