Data Engineer at Miracle Software Systems, Inc · Visakhapatnam · 3 - 5 years · ₹2L - ₹4L / yr · Profitable · Posted 29 Nov 2022

Duration : Full Time
Location : Vishakhapatnam, Bangalore, Chennai
years of experience : 3+ years
Job Description :
- 3+ Years of working as a Data Engineer with thorough understanding of data frameworks that collect, manage, transform and store data that can derive business insights.
- Strong communications (written and verbal) along with being a good team player.
- 2+ years of experience within the Big Data ecosystem (Hadoop, Sqoop, Hive, Spark, Pig, etc.)
- 2+ years of strong experience with SQL and Python (Data Engineering focused).
- Experience with GCP Data Services such as BigQuery, Dataflow, Dataproc, etc. is an added advantage and preferred.
- Any prior experience in ETL tools such as DataStage, Informatica, DBT, Talend, etc. is an added advantage for the role.

About Miracle Software Systems, Inc
About
Similar jobs (10)
Job Summary
Role Overview
We are looking for an experienced Data Engineer with strong expertise in Python, ETL, Advanced SQL, CI/CD, DevOps, and Data Analytics. The ideal candidate should have hands-on experience designing and developing scalable data pipelines, transforming large datasets, and supporting data-driven applications.
Experience with Google Cloud Platform (GCP) will be an added advantage.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines using Python and SQL.
- Develop complex and optimized SQL queries, stored procedures, and data transformations.
- Build and maintain reliable data integration workflows across multiple data sources.
- Perform data cleansing, validation, transformation, and quality checks.
- Analyze data and provide insights to support business and technical requirements.
- Implement and maintain CI/CD pipelines for data engineering applications.
- Work with DevOps practices and tools to automate deployments, monitoring, and infrastructure processes.
- Troubleshoot data pipeline failures, performance issues, and production incidents.
- Optimize data processing workflows for performance, scalability, and reliability.
- Collaborate with Data Analysts, Data Scientists, Developers, and other stakeholders.
- Follow best practices for version control, testing, documentation, and deployment.
- Contribute to cloud-based data engineering initiatives, preferably on GCP.
Required Skills
- 5–7 years of hands-on experience in Data Engineering.
- Strong programming skills in Python.
- Strong expertise in Advanced SQL and database concepts.
- Hands-on experience with ETL/ELT processes and data pipelines.
- Good understanding of Data Warehousing and Data Modeling concepts.
- Experience with CI/CD practices and tools.
- Strong understanding of DevOps principles, automation, and deployment processes.
- Strong data analytics and problem-solving skills.
- Experience working with large datasets and performance optimization.
- Good understanding of Git/version control and software development best practices.
Good to Have
- Hands-on experience with Google Cloud Platform (GCP).
- Exposure to GCP data services such as BigQuery, Cloud Storage, Dataflow, Composer, or Pub/Sub.
- Experience with containerization/orchestration technologies such as Docker/Kubernetes.
- Experience with workflow orchestration tools such as Airflow.
- Knowledge of cloud-based data architecture and distributed data processing.
Preferred Candidate Profile
- Strong analytical and problem-solving abilities.
- Good communication and stakeholder management skills.
- Ability to work independently as well as in a collaborative team environment.
- Strong ownership of data pipelines and production systems.
- Candidates who can join at short notice are preferred.
Mandatory Skills
Data Engineer, Python , ETL, GCP, Advanced SQL, Strong Data Analytics skills, CICD, Devops
Job Description – Senior GCP Data Engineer
Position: Senior GCP Data Engineer
Experience: 8+ Years
Budget: Up to 30 LPA
Location: Bangalore / Hyderabad
Relocation: Candidates from Chennai / Pune willing to relocate are also welcome.
Notice Period: Immediate to 15 Days
Interview Process:
- Round 1: Virtual Interview
- Round 2 / DM Round: Face-to-Face Interview
Required Skills
- Strong hands-on experience in GCP Data Engineering.
- Good programming experience in Python.
- Strong experience with PySpark / Apache Spark.
- Proficiency in SQL and database concepts.
- Experience in developing and maintaining data pipelines.
- Good understanding of data processing, transformation, and integration.
- Experience in handling large-scale data processing.
- Strong problem-solving and debugging skills.
- Good understanding of cloud-based data engineering concepts.
- Experience in optimizing data pipelines for performance and scalability.
Preferred Skills
- Previous experience in a Lead Data Engineer role.
- Experience in technical leadership, mentoring, and guiding team members.
- Ability to collaborate with cross-functional teams and deliver data engineering solutions.
Roles & Responsibilities
- Design, develop, and maintain scalable data pipelines using GCP.
- Develop data processing and transformation workflows using Python and PySpark.
- Write and optimize SQL queries for efficient data processing.
- Build and maintain reliable data engineering solutions.
- Troubleshoot data pipeline issues and optimize performance.
- Ensure data quality, reliability, and scalability.
- Collaborate with stakeholders and team members to deliver project requirements.
- Lead and guide team members where applicable.
- Important: Candidates must have strong Senior Data Engineer experience. Lead experience is preferred but not mandatory.
🚀 Hiring: Senior GCP Data Engineer
We are looking for experienced Senior Data Engineers with strong hands-on expertise in Google Cloud Platform (GCP), Python, PySpark, and SQL. Candidates with team lead experience will be preferred.
📌 Job Details:
- Role: Senior GCP Data Engineer
- Experience: 8+ Years
- Budget: Up to ₹30 LPA
- Location: Bangalore / Hyderabad
- Relocation: Candidates from Chennai and Pune willing to relocate are welcome.
- Notice Period: Immediate to 15 days
- Interview Process: L1 – Virtual | L2 / DM – Face-to-Face (F2F)
💻 Required Technical Skills:
- Strong hands-on experience with GCP data engineering.
- Excellent proficiency in Python, PySpark, and SQL.
- Experience in designing, developing, and optimizing data pipelines.
- Good understanding of ETL/ELT processes and large-scale data processing.
- Experience working with cloud-based data platforms and data warehousing.
- Strong analytical, problem-solving, and communication skills.
⭐ Preferred Skills:
- Previous experience as a Technical Lead or leading a data engineering team.
- Knowledge of GCP services such as BigQuery, Dataproc, Dataflow, and Cloud Storage.
Role Overview
We are looking for a GCP Data Engineer with 10+ years of experience to design, develop, and optimize scalable cloud-based data solutions. The ideal candidate will have strong hands-on expertise in GCP, BigQuery, and advanced SQL, with experience building data pipelines and working with large-scale datasets.
Key Responsibilities
- Design and develop scalable data pipelines and ETL/ELT processes on GCP.
- Build, optimize, and maintain data solutions using Google BigQuery.
- Develop complex SQL queries for data transformation, aggregation, and analysis.
- Design efficient data models and optimize pipelines for performance, scalability, and cost.
- Integrate data from multiple sources and ensure data quality, reliability, and availability.
- Troubleshoot pipeline and data issues and drive continuous improvement.
- Collaborate with data architects, analysts, application teams, and business stakeholders.
- Follow best practices for cloud security, data governance, testing, and documentation.
Required Skills
- 8+ years of Data Engineering experience
- Strong hands-on experience with GCP, Django, and MongoDB
- Extensive experience with BigQuery
- Advanced SQL skills
- Strong understanding of ETL/ELT and data pipeline development
- Data modeling and data warehousing experience
- Experience handling large-scale datasets and performance optimization
- Strong problem-solving and communication skills
Good to Have
- GCP services such as Cloud Storage, Dataflow, Pub/Sub, Cloud Composer, or Cloud Functions
- Python or other data engineering languages
- Experience with data governance and security
- Agile development experience
GCP Data engineer (L1 virtual, L2 or DM F2F )
GCP + Python + Pyspark + sql + Lead
8+yrs
Bangalore/hyderabad location ( relocation profiles also from Chennai pune location)
immediate to 15days
1. Company Description:
Tatvic, is a marketing analytics company focusing on generating insights from data using long association with Google & its infrastructure. We breed,recognize and reward performance. As a company we are growing very fast & we are under transformation. To enable this transformation we need future leaders with eyesight which balances execution & strategic understanding.
Website: www.tatvic.com
2. Role Details
- Role: Lead Data Engineer
- Band: L4
- Department: Data Engineering
- Reporting to: L5 / Head of Delivery
- Location: Ahmedabad
- Job Type: Full Time
- Experience: 6-8 years of relevant experience
- Education: Bachelor’s or Master’s degree in Computer Science, Data Science, or a related technical field.
3. Mission & Role Overview
- Mission: To create high-level organizational impact by leading a team to design and deliver scalable, high-performance cloud-native data solutions. The Lead Data Engineer (L4) is responsible for ensuring technical excellence—specifically in BigQuery optimization and secure GCP/AWS architectures—while driving the transition to Agentic AI workflows and creating value through the development of L1-L3 engineers.
- Role Overview: This is a pivotal leadership role on the Management Track, responsible for end-to-end data outcomes for the function. The Lead Engineer ensures the quality of engineering execution, manages team utilization and resource allocation, and serves as the primary technical representative in cross-functional forums with Marketing, Strategy, and Product teams.
4. Key Responsibilities
- Lead the design, development, and deployment of scalable and efficient cloud-based data pipelines and architectures.
- Build reusable data solutions and software components that serve multiple customers and use cases.
- Architect cloud environments using GCP, ensuring best practices in IAM, Security, and Networking.
- Conduct Exploratory Data Analysis (EDA) on clickstream and behavioral datasets to derive insights.
- Manage end-to-end ETL processes, including data extraction, transformation, and loading using Python, SQL, and Airflow.
- Design and build production-grade software (APIs, services, internal tools) with sound engineering practices — version control, testing, CI/CD, and code review.
- Extend data platforms with AI capabilities — integrating LLMs, RAG pipelines, and agentic workflows where they add clear business value.
- Perform Root Cause Analysis (RCA) and resolve data quality, pipeline, or application issues.
- Collaborate cross-functionally with Marketing, Insights, Product, and Engineering teams to align data initiatives with business goals.
- Document architectures, design decisions, and operations clearly and consistently.
- Coach and mentor team members, ensuring technical excellence and continuous learning.
- Participate in recruitment and knowledge-sharing through interviews, blogs, and webinars.
5. Must-Have & Good-to-Have Skills
Must-Have Skills:
- Strong understanding of clickstream data and data pipeline architecture
- Hands-on experience with cloud platforms (GCP)
- Expertise in SQL, Python, and Airflow
- Solid software engineering foundation — API design, testing, version control, and deployment practices
- Proven ability to perform exploratory data analysis and data validation
- Knowledge of cloud security, IAM, and networking best practices
- Working knowledge of building or integrating AI/LLM-based components into existing systems
- Excellent problem-solving, stakeholder management, and communication skills
Good-to-Have Skills:
- Certifications such as: Google Cloud Professional Data Engineer / Cloud Architect
- AWS Certified Data Analytics or Azure Data Engineer Associate
- Google Analytics 4 (GAIQ)
- Experience in marketing attribution, commerce data, or analytics ecosystems
- Exposure to cost optimization and cloud resource management
- Experience with agent frameworks (LangChain, ADK, MCP) or LLM APIs
- Experience building automation frameworks or internal data tools
6. Not-a-Fit Criteria
- Individual Contributor Focus: Operates as the team's best individual contributor instead of building team capability or empowering L3s.
- Information Hoarding: Keeps architectural patterns or tribal knowledge trapped in their head rather than creating reusable playbooks and documentation.
- Avoidance of Conflict: Avoids difficult performance conversations with underperforming team members, allowing capability gaps to persist.
- Activity Over Outcomes: Measures success by "tasks completed" rather than pipeline stability, data accuracy, or business impact.
- Functional Siloing: Fails to build partnerships with Marketing or Product teams, leading to misaligned data delivery.
Our Culture & Perks - Where Passion Meets Purpose:
- Competitive CTC: Based on experience and skillset
- Medical Insurance for you and your family
- Return-to-Work Program for New Moms — because career breaks shouldn’t break momentum
- 1 Work From Home Day/Month — flexibility when life calls
- 2 Birthday Leaves/Year — one for you, one for someone you love
- Monthly Engagement Activities — from game nights to learning sessions
- Inclusive Culture & Equal Opportunity Employer — diversity drives our innovation
- We Think Like Engineers & Athletes: we build, we iterate, we scale, we win — together
- 5-day workweek — because balance drives brilliance
Data Engineer
Experience - 5+ years
6-7 LPA
Remote
Duration: 1 month contract (We can take as a tentative, It can be extended)
Scope: Subscriber Activation, Churn, FTE and future reporting requirements, with BigQuery as the centralized data warehouse and Power BI as the proposed reporting layer.
Key Skills:
Strong hands-on experience with GCP & BigQuery
Data warehouse architecture, design and implementation
Data ingestion/integration across multiple source systems
ETL/ELT and data pipeline development
Data modelling for reporting and analytics
Experience integrating BigQuery with Power BI or similar reporting tools
Job Description – Data Engineer
Role: Data Engineer
Experience: 9+ Years
Location: Bangalore / Hyderabad
Notice Period: Immediate to 15 Days
Interview Process: 1st Round – Virtual | 2nd Round – F2F
Mandatory Skills
- Python
- PySpark
- SQL
- Azure Data Engineering
Job Description
We are looking for an experienced Azure Data Engineer with 9+ years of experience and strong hands-on expertise in Python, PySpark, SQL, and Azure Data Engineering.
Key Responsibilities
- Develop and maintain scalable data engineering solutions using Azure.
- Build and optimize data processing pipelines using PySpark and Python.
- Write complex SQL queries for data extraction and transformation.
- Work with Azure data services and cloud-based data platforms.
- Perform data processing, transformation, and integration.
- Troubleshoot data pipeline and production issues.
- Collaborate with technical and business teams to deliver data solutions.
Preferred: Immediate to 15 Days joiners.
Data Engineer – Contract Opportunity
We are looking for an experienced Data Engineer with 5+ years of experience to work on subscriber activation, churn, FTE, and future reporting requirements.
Key Responsibilities:
- Work on data requirements related to Subscriber Activation, Churn, FTE, and future reporting.
- Work with BigQuery as the centralized data warehouse.
- Develop and maintain data ingestion and integration pipelines across multiple source systems.
- Design and implement ETL/ELT processes.
- Develop data models for reporting and analytics.
- Integrate BigQuery with Power BI or similar reporting tools.
Required Skills:
- Strong hands-on experience with GCP & BigQuery
- Data warehouse architecture, design, and implementation
- Data ingestion/integration across multiple source systems
- ETL/ELT and data pipeline development
- Data modelling for reporting and analytics
- Experience integrating BigQuery with Power BI or similar reporting tools
Contract: 1 month initially, with potential extension
Compensation: ₹6–7 LPA
Work Mode: Remote
Important
Since this is only a 1-month contract, mention “Potential extension” rather than saying it will definitely be extended.
Job Title : Data / AI / GenAI – Engineering & Analytics
Experience : 4+ Years
Location : Noida / Gurugram / Ahmedabad
Employment Type : Full-time | On-site at client location
Working Days : 5 days per week
Working Hours : Standard business hours
Position Overview : We are seeking professionals to deliver modern data engineering, business intelligence, cloud analytics and AI-powered applications, according to their specialization.
Mandatory Skills :
Python, SQL, ETL/ELT, Data Engineering, Power BI, Azure Data Factory, Databricks, PySpark, Data Modeling, GenAI/LLMs, RAG, Vector Databases, AI Agents (as per role specialization).
Key Roles / Specializations :
- Power BI Developers : Dashboards, DAX, Power Query, reporting and data modeling
- Azure Data Engineers : Azure Data Factory, Data Lake, Azure SQL and cloud pipelines
- Databricks Engineers : Apache Spark, PySpark, Delta Lake and scalable processing
- Data Engineers : ETL/ELT, SQL, Python, data warehousing and quality
- GenAI / RAG Engineers : LLMs, prompts, embeddings, vector databases and retrieval pipelines
- Agentic AI Engineers : AI agents, tool calling, orchestration and multi-agent workflows
Key Responsibilities :
- Design, develop and maintain data pipelines, analytics solutions or AI applications.
- Build and optimize data integration, transformation and processing workflows.
- Develop dashboards and analytical models for business decision-making.
- Use cloud data platforms and modern engineering frameworks.
- Develop and evaluate LLM applications, RAG solutions or AI agents as applicable.
- Ensure data quality, security, performance and reliability.
- Collaborate with engineering teams and stakeholders on testing, deployment and documentation.
Required Skills & Qualifications :
- Bachelor’s degree in Computer Science, IT, Data Science, Engineering or related discipline.
- 4–5 years of relevant experience in data, analytics, AI or software engineering.
- Hands-on expertise in at least one listed specialization; not all technologies are required.
- Relevant Python, SQL, DAX or other technical skills depending on the position.
- Understanding of cloud platforms, APIs, integration and software practices.
Preferred Qualifications :
- Azure, Databricks or Microsoft Fabric experience.
- For GenAI roles : Azure OpenAI, OpenAI APIs, LangChain, LlamaIndex or LangGraph.
- For relevant roles : vector databases, CI/CD, Docker, MLOps or LLMOps.
Note : Candidates are expected to have expertise in their relevant specialization, not in every listed technology or role.









