AWS Senior Data Engineer at Expand My Business · Bengaluru (Bangalore), Mumbai, Chennai · 7 - 15 years · ₹10L - ₹28L / yr · Profitable · Posted 9 Jul 2023

Design, implement, and improve the analytics platform
Implement and simplify self-service data query and analysis capabilities of the BI platform
Develop and improve the current BI architecture, emphasizing data security, data quality
and timeliness, scalability, and extensibility
Deploy and use various big data technologies and run pilots to design low latency
data architectures at scale
Collaborate with business analysts, data scientists, product managers, software development engineers,
and other BI teams to develop, implement, and validate KPIs, statistical analyses, data profiling, prediction,
forecasting, clustering, and machine learning algorithms
Educational
At Ganit we are building an elite team, ergo we are seeking candidates who possess the
following backgrounds:
7+ years relevant experience
Expert level skills writing and optimizing complex SQL
Knowledge of data warehousing concepts
Experience in data mining, profiling, and analysis
Experience with complex data modelling, ETL design, and using large databases
in a business environment
Proficiency with Linux command line and systems administration
Experience with languages like Python/Java/Scala
Experience with Big Data technologies such as Hive/Spark
Proven ability to develop unconventional solutions, sees opportunities to
innovate and leads the way
Good experience of working in cloud platforms like AWS, GCP & Azure. Having worked on
projects involving creation of data lake or data warehouse
Excellent verbal and written communication.
Proven interpersonal skills and ability to convey key insights from complex analyses in
summarized business terms. Ability to effectively communicate with multiple teams
Good to have
AWS/GCP/Azure Data Engineer Certification

Similar jobs (10)
Position title: Business Intelligence and Data Analyst
Summary -
• Operate and continuously improve the CARS/BI backend within the global Enterprise Data and Business Intelligence platform, ensuring system stability, continuous data loading, and Warehouse the timely delivery of business-critical reports.
• Own the underlying data foundation — SQL pipelines, relational data models, and data warehouse structures — that internal reporting teams and global Data Management initiatives depend on, and act as 1st and 2nd level support for internal customers such as SCM and Sales.
• The role is needed to secure daily BI availability in the Asian time zone, reduce the risk of late or incorrect reporting, and add dedicated database and ETL capacity to the global BI team, including support to the Data Centre team on infrastructure-related issues.
Responsibilities:
• Operate, monitor, and maintain the CARS/BI data integration and data processing workflows, ensuring continuous data loading and stable daily business operations.
• Provide 1st and 2nd level support for CARS/BI, including user support, incident handling, and root-cause analysis of data issues.
• Develop, maintain, and optimise SQL-based data pipelines and transformations within the Enterprise Data Warehouse.
• Design and maintain relational data models and data warehouse structures for CARS BI.
• Integrate data from ERP and other enterprise systems into the BI backend.
• Ensure data consistency, integrity, and performance at the database level, including query tuning and database efficiency improvements.
• Administer the BI technical environment and contribute to its continuous enhancement as part of a global team.
• Support reporting teams by providing structured, reliable datasets and safeguarding the timely delivery of business-critical reports.
• Contribute to global Data Management initiatives, with a focus on Master Data Management and the development of a Common Data Model within the Business Integration Platform.
• Collaborate with the Data Centre team to resolve infrastructure-related issues affecting BI availability.
Education and Experience:
Bachelor's degree in Engineering (BE/B.Tech) or equivalent in Computer Science, Information Technology, or a comparable technical field.
Minimum 3 years of relevant professional experience in Business Intelligence, data warehousing, or database development, including hands-on SQL and ETL work in an enterprise environment.
Experience supporting business users in a global or multi-time-zone IT organisation is an advantage.
Competencies:
• Knowledge about either BI platforms (e.g. IBM Cognos BI suite) or ETL tools (e.g. Informatica PowerCenter)
• Database, data modeling and SQL (preferred Oracle PLSQL)
• Good analytical and communication skills
• Teamplayer
• English
• Strong hands-on experience with SQL (advanced level)
• Solid understanding of relational databases and data warehouse concepts
• Experience with ETL tools and database technologies (e.g., Oracle, SQL Server, SAP BW,Informatica or similar)
• Performance tuning and query optimization skills
• Structured, detail-oriented, and quality-focused working style
• Good understanding of enterprise data flows (SAP/CARS is a plus)
Key Interfaces and Stakeholders:
Only internal customers with different topics: e.g. SCM, Sales etc.
Geography to cover and Travel requirements:
Asian Time Zone, Sometimes travel is required
Behavioral Characteristics
Reliability and accountability — the role safeguards daily reporting availability, so dependable ownership of monitoring and issue follow-up is expected. Structured, analytical problem solving with the patience for thorough root-cause analysis. Service orientation and clear communication towards internal customers such as SCM and Sales. Initiative taking and self-reliance, given largely independent work in the Asian time zone. Cooperation and team spirit within a globally distributed BI team across cultures and time zones. Flexibility and resilience under time pressure, including occasional off-hours support during critical data loads. Integrity and discretion when handling confidential business data. Quality focus and attention to detail, with a continuous improvement mindset.
Interview process
2 rounds - Virtual interview and 1 round Face to Face
Any other Criteria
- Notice Period: Below 60 or 90 Days . No Negotiation on Notice Period
- Gender: Female and Male; Female preferred
- Qualification:Bachelor's degree in Engineering (BE/B.Tech) or equivalent in Computer Science, Information Technology,
Job Summary
We are looking for a skilled and experienced Data Engineer to join our growing data team. The ideal candidate will have strong expertise in Python, PySpark, Data Modeling, and Power BI, with hands-on experience in designing, developing, and optimizing scalable data solutions. The role requires working closely with business stakeholders, data architects, and analytics teams to build robust data pipelines and semantic models that enable data-driven decision-making.
Technical Skills
- Strong hands-on experience in Python and PySpark development.
- Expertise in building and optimizing Data Engineering solutions and ETL pipelines.
- Strong understanding of Data Modeling concepts (Star Schema, Snowflake Schema, Dimensional Modeling).
- Experience with Power BI Data Modeling and Semantic Layer development.
- Proficiency in DAX (Data Analysis Expressions).
- Experience designing and managing Semantic Models in Power BI.
- Strong SQL skills and experience working with large datasets.
- Knowledge of data warehousing concepts and best practices.
Preferred Skills
- Experience with cloud platforms such as Azure, AWS, or GCP.
- Exposure to modern data platforms like Databricks.
- Understanding of data governance and data quality frameworks.
This role will be permanent with NAM info and deploy to client location Hyderabad & Pune.
Work Mode: WORK FROM OFFICE
Role Descriptions:
- Perform detailed data analysis and support business decision-making
- Gather and document business requirements and translate them into technical specifications
- Work closely with stakeholders to define data needs and reporting requirements
- Create user stories, functional specifications, and support UAT activities
- Ensure alignment between business objectives and data solutions
Required Skills:
- Strong expertise in SQL and data querying
- Proven experience in data analysis, requirement gathering, and stakeholder management
- Ability to translate business requirements into technical solutions and user stories
- Good understanding of data models, reporting, and analytics concepts
Skills: Business Analysis~ORACLE SQL
Locations: ~HYDERABAD~PUNE~
Desire candidate
- Candidate should have valid PF.
Define and obtain source data required to deliver insights and use cases.
● Determine data mapping and join multiple data sets across various sources.
● Develop methods to highlight and report data inconsistencies for user review.
● Propose and assist with suitable data migration sets for stakeholders.
● Support teams in processing data migration sets and coordinating migration activities.
● Plan, track, and coordinate the data migration team and migration run-book.
● Collaborate with stakeholders to avoid negative customer and business impacts.
● Ensure robust communication and escalation mechanisms across project portfolios.
● Implement strategic solutions and avoid short-term workarounds.
● Maintain strong control and compliance standards in data handling.
Required Skills
● Minimum 7+ years of experience as a Data Analyst, preferably in financial services.
● Strong expertise in Pyspark, Python, and SQL.
● Experience with big data programs and data models in banking or financial markets.
● Ability to write SQL queries and navigate databases such as Hive, CMD, Putty, and Note++.
● Excellent analytical skills and commercial acumen.
● Strong verbal and written communication skills.
● Proven ability to manage multiple priorities and deliver within tight deadlines.
● Business analysis skills, including defining and understanding requirements.
● Familiarity with SDLC, Agile processes, and a bias towards TDD.
● Attention to detail and a proactive, problem-solving mindset.
Nice to Have
● Knowledge and experience in Data Quality & Governance.
● Working experience with Spark Scala or Java for Spark.
● Proven track record of managing small, delivery-focused data teams (for senior roles).
● Experience with market data vendors and domains such as Party/Client, Trade, Settlements, Payments, Instrument and Pricing, Market and/or Credit Risk.
Job Description
• Design and Implement Data Solutions: Lead the design, development, and implementation of scalable and secure Azure-
based data platforms, ensuring integration with various data sources and business systems. Deliver at least 2 major
projects every year with a focus on data engineering best practices.
• Optimize Data Pipelines: Build and optimize end-to-end data pipelines using Azure Data Factory, Azure Databricks, and
Azure Synapse, with an emphasis on automating data workflows. Achieve a 20% reduction in pipeline execution times
within the first 6 months.
• Cloud Infrastructure Management: Manage and maintain the Azure data environment, ensuring high availability, disaster
recovery, and cost optimization. Track and improve system uptime to exceed 99.9% reliability.
• Collaborate with Cross-Functional Teams: Partner with data scientists, data analysts, and business stakeholders to translate
business requirements into efficient data solutions. Facilitate at least 3 collaborative sessions per quarter to address key
business use cases.
• Ensure Data Security & Compliance: Implement data security measures, ensuring compliance with industry regulations
(GDPR, HIPAA, etc.) and company policies. Achieve and maintain full compliance in all data environments within the first
quarter of onboarding.
• Continuous Learning & Knowledge Sharing: Stay up-to-date with emerging Azure technologies, and mentor junior
engineers to promote knowledge sharing. Complete 1 Azure certification annually and conduct at least 2 internal
knowledge-sharing sessions per year.
• Sound knowledge of data governance practices, data quality management, and data security principles.
• Play a pivotal role in shaping our organization's data-driven journey, driving innovation through data analytics and insights.
• Optimize data storage, processing and retrieval mechanisms for performance, cost, and scalability using data storage
services (such as Azure Data Lake Storage, Azure SQL Database, etc.), data processing services (such as Azure Data Bricks,
Azure Synapse, etc.) and data visualization (PowerBI, Qlik, etc.) & integration services (Data API builder, logic apps, etc.)
• Monitor and troubleshoot data platform performance, identify and resolve issues, and provide recommendations for
continuous improvement.
• Collaborate with DevOps teams to automate deployment, configuration, and monitoring processes using Azure DevOps,
PowerShell, or other relevant tools.
• Stay up to date with the latest trends and advancements in cloud data services and provide recommendations on adopting
new technologies or features to enhance the data platform.
• Document technical designs, procedures, and guidelines for data platform engineering and operations
Knowledge, Skills & Experience
Job Experience • Bachelor's degree in Computer Science, Engineering, or a related field. Advanced
degree preferred.
• Proven 6-10 years experience in playing platform engineer or admin role
• Experience with big data technologies such as Apache Spark, Hadoop, or similar
frameworks.
• Solid understanding of cloud computing concepts and experience with cloud
infrastructure management and provisioning.
• Solid understanding of network security concepts and technologies (such as
firewalls, VPNs, intrusion detection/prevention systems, etc.) and data security
concepts and technologies (such as access controls, encryption, observability,
privacy laws/regulations, etc.)
• Experience in a Retail setup is preferred.
Required Skills The position will require someone with the following:
• Strategic Planning
Public
• Communication and Collaboration
• Problem Solving Skills A/B testing & experimentation
• SQL, BI tools, and storytelling with data
Hiring for Data Scientist / Senior Data Scientist
Exp : 4 - 12 yrs
Edu : BE/B.tech/MCA
Work Location : Pune
Notice Period : Immediate - 15 days
Skills :
4+ years of experience in data engineering, data science, or related domains.
Hands-on experience with SQL, Python, and distributed data systems.
Knowledge of machine learning techniques and statistical analysis.
Experience with cloud data platforms (Azure Data Factory, AWS Glue, GCP BigQuery).
Familiarity with DevOps practices and CI/CD for data pipelines.
Platforms & Operations Experience (Preferred)
- Experience working with Azure, AWS, or Google Cloud data tools.
Operational experience with data orchestration tools (Airflow, ADF, Glue).
Understanding of Kubernetes, Docker, or containerized environments.
Hands-on experience with data warehousing platforms (Snowflake, Redshift, BigQuery).
Experience in monitoring, logging, and alerting operations for data workflows.
CAP-190 : Senior Data Analyst
📍Location : Bangalore / Hyderabad / Chennai / Pune / NCR
🧠Experience : 7 - 15 Years
🆔Job Code : CAP-190
🏢Work Type : Hybrid - 3 Days in a Week
About the Client (CODE: CAP)
CAP operates at the forefront of the financial services industry, providing consulting, technology, and digital transformation solutions to leading organizations worldwide. With a focus on innovation, CAP empowers clients to navigate complex regulatory landscapes, optimize operations, and drive business growth. The company fosters a collaborative and agile culture, encouraging continuous learning and excellence.
Key Responsibilities
● Define and obtain source data required to deliver insights and use cases.
● Determine data mapping and join multiple data sets across various sources.
● Develop methods to highlight and report data inconsistencies for user review.
● Propose and assist with suitable data migration sets for stakeholders.
● Support teams in processing data migration sets and coordinating migration activities.
● Plan, track, and coordinate the data migration team and migration run-book.
● Collaborate with stakeholders to avoid negative customer and business impacts.
● Ensure robust communication and escalation mechanisms across project portfolios.
● Implement strategic solutions and avoid short-term workarounds.
● Maintain strong control and compliance standards in data handling.
Required Skills
● Minimum 7+ years of experience as a Data Analyst, preferably in financial services.
● Strong expertise in Pyspark, Python, and SQL.
● Experience with big data programs and data models in banking or financial markets.
● Ability to write SQL queries and navigate databases such as Hive, CMD, Putty, and Note++.
● Excellent analytical skills and commercial acumen.
● Strong verbal and written communication skills.
● Proven ability to manage multiple priorities and deliver within tight deadlines.
● Business analysis skills, including defining and understanding requirements.
● Familiarity with SDLC, Agile processes, and a bias towards TDD.
● Attention to detail and a proactive, problem-solving mindset.
Nice to Have
● Knowledge and experience in Data Quality & Governance.
● Working experience with Spark Scala or Java for Spark.
● Proven track record of managing small, delivery-focused data teams (for senior roles).
● Experience with market data vendors and domains such as Party/Client, Trade, Settlements, Payments, Instrument and Pricing, Market and/or Credit Risk.
Why Join CAP (Code Name)
Join CAP to work on impactful data initiatives within the financial services sector, tackling complex technical challenges and driving meaningful business outcomes. You'll collaborate with talented professionals in a dynamic, agile environment that values innovation and continuous improvement. CAP offers opportunities for professional growth, skill development, and the chance to contribute to high-visibility projects that shape the future of financial technology.
About the Employment Model
Direct Hire (Client Payroll) : For this role, you’ll be hired directly by the client and be part of their internal team. Straatix supports the hiring process, but your employment, payroll, and benefits are all managed by the client.
Description
We are looking for Senior Data Engineers to join our Data Platform team and build scalable, high-performance data platforms that power data processing, analytics, and downstream applications.
The ideal candidate will have strong experience in distributed data processing, ETL pipelines, and Big Data technologies, with hands-on expertise in Apache Spark and Python Scala.
You will be responsible for designing, developing, and optimizing large-scale data pipelines while collaborating closely with cross-functional engineering teams to build reliable, production-grade data solutions.
Key Responsibilities
- Design, develop, and maintain scalable ETL and data processing pipelines for large-scale datasets.
- Build and optimize distributed data applications using Apache Spark and Python Scala.
- Develop reliable, high-performance data pipelines for batch and streaming workloads.
- Design and manage data workflows using Apache Airflow.
- Build and operate data workloads on AWS, with strong usage of Amazon S3 for large-scale data storage.
- Work with large datasets to ensure data quality, consistency, reliability, and performance.
- Collaborate with engineering, product, analytics, and other platform teams to deliver robust data solutions.
- Optimize data workflows for scalability, reliability, performance, and cost efficiency.
- Troubleshoot production issues, identify bottlenecks, and continuously improve platform performance.
Requirements
Candidates who demonstrate:
- 5+ years of experience in Data Engineering, Big Data Engineering, or a similar role.
- Strong hands-on experience with Apache Spark and Scala.
- Experience designing, building, and maintaining large-scale ETL pipelines.
- Strong hands-on experience with AWS, particularly Amazon S3.
- Hands-on experience with Apache Airflow for workflow orchestration and scheduling.
- Strong SQL skills and a solid understanding of distributed data processing concepts.
- Experience working with batch and/or streaming data pipelines.
- Excellent debugging, problem-solving, and performance optimization skills.
- Strong communication and collaboration skills.
Good to Have
- Experience with Databricks and the broader Databricks data platform.
- Familiarity with streaming technologies such as Apache Kafka.
- Experience working on large-scale data platforms handling high-volume data workloads.
- Exposure to additional AWS data services and cloud-native data architectures.
Location: Hyderabad / Chennai
Experience: 5+ years
Employment type: Full-time, permanent
Work Hours: General Shift
website: www.amazech.com
Qualifications:
- B.E./B.Tech/M.E./M.Tech in Computer Science, Information Technology, Data Science, or related disciplines.
- Strong academic background with relevant industry experience in Data Engineering and Data Warehousing.
Key Responsibilities:
· Design, develop, and maintain scalable data warehouse solutions using Snowflake.
· Write, optimize, troubleshoot, and enhance Snowflake SQL queries with a focus on performance and scalability.
· Develop and support ETL processes using Talend to ensure reliable and efficient data movement.
· Collaborate with business, analytics, and application teams to enable reporting, dashboards, metrics, and data exploration capabilities.
· Perform data analysis and resolve issues across data ingestion, transformation, and reporting pipelines.
· Debug and troubleshoot Python-based data processing scripts and automation workflows.
· Implement best practices for data quality, testing, deployment, and code reviews.
· Work across UI, API, and Data Warehouse layers to support end-to-end data integration and business requirements.
· Monitor, optimize, and maintain data warehouse performance and operational stability.
· Create and maintain technical documentation, data models, and process workflows.
Required Skills and Experience:
· Strong hands-on expertise in Snowflake Data Warehouse.
· Advanced SQL skills with experience handling large-scale datasets.
· Strong understanding of Data Warehousing concepts, dimensional modelling, and data architecture.
· Hands-on experience with Analytical SQL functions, query tuning, and performance optimization.
· Experience developing and maintaining ETL solutions using Talend.
· Proficiency in Python for scripting, debugging, automation, and data processing.
· Experience integrating UI, API, and Data Warehouse workflows.
· Strong problem-solving and analytical skills.
· Experience with testing, code reviews, and deployment best practices.
· Excellent communication and stakeholder management skills.
The Power BI Intern will assist the analytics team in using Microsoft Power BI to create interactive dashboards and reports. Working with actual datasets to assist well-informed business decision-making, this position provides practical exposure to data analysis, visualization, and business intelligence techniques.







