DATA ENGINEER at Wissen Technology · Bengaluru (Bangalore), Pune, Mumbai · 7 - 12 years · Profitable · Posted 13 Oct 2025

Wissen Technology is hiring for Data Engineer
About Wissen Technology:At Wissen Technology, we deliver niche, custom-built products that solve complex business challenges across industries worldwide. Founded in 2015, our core philosophy is built around a strong product engineering mindset—ensuring every solution is architected and delivered right the first time. Today, Wissen Technology has a global footprint with 2000+ employees across offices in the US, UK, UAE, India, and Australia. Our commitment to excellence translates into delivering 2X impact compared to traditional service providers. How do we achieve this? Through a combination of deep domain knowledge, cutting-edge technology expertise, and a relentless focus on quality. We don’t just meet expectations—we exceed them by ensuring faster time-to-market, reduced rework, and greater alignment with client objectives. We have a proven track record of building mission-critical systems across industries, including financial services, healthcare, retail, manufacturing, and more. Wissen stands apart through its unique delivery models. Our outcome-based projects ensure predictable costs and timelines, while our agile pods provide clients the flexibility to adapt to their evolving business needs. Wissen leverages its thought leadership and technology prowess to drive superior business outcomes. Our success is powered by top-tier talent. Our mission is clear: to be the partner of choice for building world-class custom products that deliver exceptional impact—the first time, every time.
Job Summary:Wissen Technology is hiring a Data Engineer with a strong background in Python, data engineering, and workflow optimization. The ideal candidate will have experience with Delta Tables, Parquet, and be proficient in Pandas and PySpark.
Experience:7+ years
Location:Pune, Mumbai, Bangalore
Mode of Work:Hybrid
Key Responsibilities:
- Develop and maintain data pipelines using Python (Pandas, PySpark).
- Optimize data workflows and ensure efficient data processing.
- Work with Delta Tables and Parquet for data storage and management.
- Collaborate with cross-functional teams to understand data requirements and deliver solutions.
- Ensure data quality and integrity throughout the data lifecycle.
- Implement best practices for data engineering and workflow optimization.
Qualifications and Required Skills:
- Proficiency in Python, specifically with Pandas and PySpark.
- Strong experience in data engineering and workflow optimization.
- Knowledge of Delta Tables and Parquet.
- Excellent problem-solving skills and attention to detail.
- Ability to work collaboratively in a team environment.
- Strong communication skills.
Good to Have Skills:
- Experience with Databricks.
- Knowledge of Apache Spark, DBT, and Airflow.
- Advanced Pandas optimizations.
- Familiarity with PyTest/DBT testing frameworks.
Wissen Sites:
- Website: http://www.wissen.com
- LinkedIn: https://www.linkedin.com/company/wissen-technology
- Wissen Leadership: https://www.wissen.com/company/leadership-team/
- Wissen Live: https://www.linkedin.com/company/wissen-technology/posts/feedView=All
- Wissen Thought Leadership: https://www.wissen.com/articles/
Wissen | Driving Digital Transformation
A technology consultancy that drives digital innovation by connecting strategy and execution, helping global clients to strengthen their core technology.

About Wissen Technology
About
The Wissen Group was founded in the year 2000. Wissen Technology, a part of Wissen Group, was established in the year 2015. Wissen Technology is a specialized technology company that delivers high-end consulting for organizations in the Banking & Finance, Telecom, and Healthcare domains.
With offices in US, India, UK, Australia, Mexico, and Canada, we offer an array of services including Application Development, Artificial Intelligence & Machine Learning, Big Data & Analytics, Visualization & Business Intelligence, Robotic Process Automation, Cloud, Mobility, Agile & DevOps, Quality Assurance & Test Automation.
Leveraging our multi-site operations in the USA and India and availability of world-class infrastructure, we offer a combination of on-site, off-site and offshore service models. Our technical competencies, proactive management approach, proven methodologies, committed support and the ability to quickly react to urgent needs make us a valued partner for any kind of Digital Enablement Services, Managed Services, or Business Services.
We believe that the technology and thought leadership that we command in the industry is the direct result of the kind of people we have been able to attract, to form this organization (you are one of them!).
Our workforce consists of 1000+ highly skilled professionals, with leadership and senior management executives who have graduated from Ivy League Universities like MIT, Wharton, IITs, IIMs, and BITS and with rich work experience in some of the biggest companies in the world.
Wissen Technology has been certified as a Great Place to Work®. The technology and thought leadership that the company commands in the industry is the direct result of the kind of people Wissen has been able to attract. Wissen is committed to providing them the best possible opportunities and careers, which extends to providing the best possible experience and value to our clients.
Connect with the team
Similar jobs (10)
1st virtual , 2nd round F2F
Python pyspark, SQL, data engineer
5+yrs
9+yrs
Bangalore/Hyderabad
immediate to 15days.
1st virtual , 2nd round F2F -
Python pyspark, SQL, data engineer
5+yrs
Bang/hyderabad
immediate to 15days.
role: data engineer
Python pyspark, SQL, data engineer
5+yrs
Bangalore/Hyderabad
immediate to 15days.
1st virtual , 2nd round F2F
Python pyspark, SQL, data engineer
5+yrs
Bang/hyderabad
immediate to 15days.
About the Role
We are looking for a Senior Data Engineer with strong hands-on expertise in Databricks, Python, PySpark, and SQL to build scalable, high-performance data engineering solutions. You’ll architect and develop large scale, high-performance data pipelines capable of handling massive real-time and batch data volumes across multiple business systems. Databricks is the core enterprise data and processing platform for this role. You will also use Apache Airflow for workflow orchestration and dbt for ELT transformations, and will contribute to designing reliable, secure, and governed data platforms that enable analytics, reporting, and AI-driven use cases.
Key Responsibilities
- Design and implement large-scale data pipelines using Python/PySpark, Databricks, and Microsoft Fabric.
- Develop and optimize data processing workloads in Databricks using PySpark and Spark SQL, with a strong focus on scalability, reliability, performance, and maintainability.
- Develop and maintain dbt models including layered architecture, incremental models, snapshots, macros, testing, and documentation.
- Design, develop, and maintain Apache Airflow DAGs for orchestrating reliable, scalable, and observable data pipelines.
- Design and implement data quality, observability, and governance frameworks, including automated testing, monitoring, lineage, access control, and data privacy standards.
- Partner with analytics, product, and business stakeholders to turn requirements into trustworthy datasets, and raise the engineering bar through design discussions, code reviews, and mentoring junior engineers.
Required Skills
- Strong expertise in Python for developing scalable, modular, and production-ready data engineering applications.
- Strong expertise in PySpark, including DataFrame API, Spark SQL, Structured Streaming, partitioning strategies, joins, caching, handling data skew, and Spark performance optimization.
- Strong hands-on experience with Databricks for data ingestion, transformation, processing, and optimization, including Delta Lake, Unity Catalog, Databricks Workflows, notebooks, jobs, and Databricks-native data engineering capabilities.
- Strong experience in Databricks/Spark performance tuning, including query and job optimization, partitioning, file sizing, caching, join optimization, handling data skew, and efficient use of compute resources.
- Hands-on experience with Delta Lake, including transactional data processing, schema management, incremental data processing, and reliable batch and streaming data pipelines.
- Hands-on experience in developing dbt projects using layered architecture, incremental models, snapshots, macros/Jinja, testing, documentation, and deployment best practices.
- Expertise in advanced SQL and data modelling — dimensional modeling, slowly changing dimensions, schema evolution, and query optimization.
- Hands-on experience in developing and managing Apache Airflow DAGs, scheduling workflows, dependency management, retries, backfills, and operational monitoring.
- Hands-on experience with at least one major cloud platform (AWS, Azure or GCP).
- Strong problem-solving skills and the ability to work independently with business and analytics stakeholders.
Nice to Have
- Hands-on exposure to Microsoft Fabric for data integration and analytics.
- Experience using AI coding assistants (e.g. Claude Code, GitHub Copilot) as part of a development workflow.
- Familiarity with modern DevOps practices, including CI/CD pipelines, Infrastructure as Code (IaC), and containerization (Docker/Kubernetes).
- Domain expertise in financial services.
We are hiring experienced Data Engineers for a permanent opportunity in Bangalore.
Job Description
Role: Data Engineer
Location: Bangalore
Experience: 6+ Years
Key Responsibilities:
- Design, develop, and maintain scalable data processing pipelines using Amazon EMR.
- Develop data engineering solutions using Python and Scala.
- Process and transform large volumes of structured and unstructured data.
- Build and optimize distributed data processing workflows for performance and scalability.
- Work with big data technologies and cloud-based data processing environments.
- Perform data integration, validation, transformation, and quality checks.
- Troubleshoot data pipeline issues and optimize processing performance.
- Collaborate with data architects, analysts, and development teams to deliver reliable data solutions.
Required Skills:
- Strong hands-on experience with Amazon EMR.
- Proficiency in Python and Scala.
- Experience in big data processing and data pipeline development.
- Good understanding of distributed computing and data transformation techniques.
- Experience in performance tuning and troubleshooting data processing jobs.
- Strong analytical, problem-solving, and communication skills.
Job Description – Data Engineer
Role: Data Engineer
Experience: 9+ Years
Location: Bangalore / Hyderabad
Notice Period: Immediate to 15 Days
Interview Process: 1st Round – Virtual | 2nd Round – F2F
Mandatory Skills
- Python
- PySpark
- SQL
- Azure Data Engineering
Job Description
We are looking for an experienced Azure Data Engineer with 9+ years of experience and strong hands-on expertise in Python, PySpark, SQL, and Azure Data Engineering.
Key Responsibilities
- Develop and maintain scalable data engineering solutions using Azure.
- Build and optimize data processing pipelines using PySpark and Python.
- Write complex SQL queries for data extraction and transformation.
- Work with Azure data services and cloud-based data platforms.
- Perform data processing, transformation, and integration.
- Troubleshoot data pipeline and production issues.
- Collaborate with technical and business teams to deliver data solutions.
Preferred: Immediate to 15 Days joiners.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines using Python and PySpark.
- Work extensively with Databricks and Delta Lake, including Delta tables, MERGE operations, schema evolution, Time Travel, and data optimization.
- Develop, schedule, and monitor Apache Airflow DAGs for workflow orchestration and dependency management.
- Work with Kubernetes for containerized application deployment, orchestration, monitoring, and troubleshooting.
- Develop reusable and optimized Python code following software engineering best practices.
- Optimize Spark jobs for performance, scalability, and cost efficiency.
- Implement data quality checks, error handling, logging, and monitoring mechanisms.
- Use Git for version control, branching, pull requests, code reviews, and collaborative development.
- Troubleshoot pipeline failures, investigate data issues, and implement reliable solutions.
- Collaborate with cross-functional teams to understand business requirements and deliver efficient data solutions.
Required Technical Skills
- Python: Strong programming skills, including data manipulation, exception handling, modular programming, and debugging.
- PySpark: Hands-on experience with Spark DataFrames, Spark SQL, joins, transformations, partitioning, and performance tuning.
- Databricks: Strong understanding of Databricks architecture, notebooks, workflows, compute management, and job execution.
- Delta Lake: Experience with Delta tables, ACID transactions, MERGE/UPSERT, schema enforcement, schema evolution, VACUUM, and Time Travel.
- Apache Airflow: Experience developing DAGs, managing task dependencies, configuring retries, scheduling workflows, and troubleshooting failures.
- Kubernetes: Practical knowledge of pods, deployments, services, ConfigMaps, Secrets, resource management, and troubleshooting containerized workloads.
- Git: Proficiency in branching strategies, pull requests, merging, and resolving conflicts.
- SQL: Strong SQL skills, including complex joins, CTEs, window functions, and query optimization.
Good to Have
- Experience with Docker and containerization best practices.
- Experience with Databricks Unity Catalog and data governance.
- Knowledge of CI/CD pipelines and automated deployments.
- Experience deploying and managing Airflow workloads on Kubernetes.
- Familiarity with Kubernetes monitoring, autoscaling, and resource optimization.
- Experience with cloud platforms such as Azure, AWS, or GCP.
- Understanding of data lakehouse architecture and data modeling.
- Experience with batch and incremental data processing.
- Familiarity with data quality frameworks and automated testing.
Preferred Candidate Profile
- Strong analytical and problem-solving skills.
- Ability to independently design, develop, deploy, and troubleshoot data pipelines.
- Good understanding of distributed data processing and container orchestration.
- Experience working in an Agile development environment.
- Strong communication and collaboration skills.
Job Summary
We are looking for an experienced Data Engineer to build and optimize scalable data pipelines and AWS-based data platforms.
Key Responsibilities
- Develop and maintain data pipelines using Python and PySpark.
- Design and implement data lakehouse solutions on AWS.
- Build and manage data workflows using AWS Glue, EMR, ECS, and Step Functions.
- Work with DynamoDB and other data storage technologies.
- Monitor data pipelines and ensure data quality, performance, and reliability.
- Collaborate with stakeholders and engineering teams to deliver data solutions.
Mandatory Skills
- 5+ years of overall professional experience.
- 3+ years of experience in data platforms and big data technologies.
- Strong proficiency in Python and PySpark.
- Hands-on experience with AWS EMR, ECS, Glue, Step Functions, and DynamoDB.
- Experience designing and implementing AWS data lakehouse architectures.
Good to Have
- Apache Spark and Apache Iceberg.
- AWS Lambda, EventBridge, Kinesis, and Redshift.
- Experience with real-time data pipelines and event-driven architectures.

Sr. Data Engineer
Location: Pune
Responsibilities
· Lead the end-to-end design and development of scalable, high-performance data pipelines and ETL/ELT frameworks aligned with modern data engineering best practices.
· Architect complex data integration workflows that bring together structured, semi-structured, and unstructured data from both cloud and on-premise sources.
· Build robust real-time, batch, and on-demand pipelines with built-in observability—monitoring, alerting, and automated error handling.
· Partner with analysts, data scientists, and business leaders to define and deliver reliable data models, quality frameworks, and SLAs that power key business insights.
· Ensure optimal pipeline performance and throughput, with clearly defined SLAs and proactive alerting for data delivery or quality issues.
· Collaborate with platform, DevOps, and architecture teams to build secure, reusable, and CI/CD-enabled data workflows that align with enterprise architecture standards.
· Establish and enforce the best practices in source control, code reviews, testing automation, and continuous delivery for all data engineering components.
· Lead root cause analysis (RCA) and preventive maintenance for critical data failures, ensuring minimal business impact and continuous service improvement.
· Guide the team in establishing standards for data modeling, transformation logic, and governance, ensuring long-term maintainability and scalability.
· Design and execute comprehensive testing strategies—unit, integration, and system testing—ensuring high data reliability and pipeline resilience.
· Monitor and fine-tune data pipeline and query performance, optimizing for reliability, scalability, and cost-efficiency.
· Create and maintain detailed technical documentation, including data architecture diagrams, process flows, and integration specifications for internal and external stakeholders.
· Facilitate and lead discussions with business and operational teams to understand data requirements, prioritize initiatives, and drive data strategy forward.
Qualifications
· 7 to 10 years of hands-on experience in data engineering roles with a proven record of building scalable and secure data platforms.
· Over 5 years of experience in scripting languages such as Python for data processing, automation, and ETL development.
· 4+ years of experience with Snowflake, including performance tuning, security model design, and advanced SQL development.
· 5+ years of experience with data integration tools such as Azure Data Factory, Fivetran, or Matillion.
· 5+ years of experience in writing complex, highly optimized SQL queries on large datasets.
· Proven experience integrating and managing APIs, JSON, XML, and webhooks for data acquisition.
· Hands-on experience with cloud platforms (Azure/AWS) and orchestration tools like Apache Airflow or equivalent.
· Experience with CI/CD pipelines, automated testing, and code versioning tools (e.g., Git).
· Familiarity with dbt or similar transformation tools and best practices for modular transformation development.
· Exposure to data visualization tools like Power BI for supporting downstream analytics is a plus.
· Strong interpersonal and communication skills with the ability to lead discussions with technical and business stakeholders.
Education
Bachelor’s or Master’s degree in Computer Science/Information technology or related field.
Equivalent academic and work experience can be considered.








