Data architect at AES Technologies · Dubai · 2 - 4 years · Raised funding · Posted 16 Mar 2022
As a Data Engineer, your role will encompass:
- Designing and building production data pipelines from ingestion to consumption within a hybrid big data architecture using Scala, Python, Talend etc.
- Gather and address technical and design requirements.
- Refactor existing applications to optimize its performance through setting the appropriate architecture and integrating the best practices and standards.
- Participate in the entire data life-cycle mainly focusing on coding, debugging, and testing.
- Troubleshoot and debug ETL Pipelines.
- Documentation of each process.
Technical Requirements: -
- BSc degree in Computer Science/Computer Engineering. (Masters is a plus.)
- 2+ years of experience as a Data Engineer.
- In-depth understanding of core ETL concepts, Data Modelling, Data Lineage, Data Governance, Data Catalog, etc.
- 2+ years of work experience in Scala, Python, Java.
- Good Knowledge on Big Data Tools such as Spark/HDFS/Hive/Flume, etc.
- Hands on experience on ETL tools like Talend/Informatica is a plus.
- Good knowledge in Kafka and spark streaming is a big plus.
- 2+ years of experience in using Azure cloud and its resources/services (like Azure Data factory, Azure Databricks, SQL Synapse, Azure Devops, Logic Apps, Power Bi, Azure Event Hubs, etc).
- Strong experience in Relational Databases (MySQL, SQL Server)
- Exposure on data visualization tools like Power BI / Qlik sense / MicroStrategy
- 2+ years of experience in developing APIs (REST & SOAP protocols).
- Strong knowledge in Continuous Integration & Continuous Deployment (CI/CD) utilizing Docker containers, Jenkins, etc.
- Strong competencies in algorithms and software architecture.
- Excellent analytical and teamwork skills.
Good to have: -
- Previous on-prem working experience is a plus.
- In-depth understanding of the entire web development process (design, development, and deployment)
- Previous experience in automated testing including unit testing & UI testing.

About AES Technologies
About
Connect with the team
Similar jobs (10)
Job Description – Data Engineer
Role: Data Engineer
Experience: 9+ Years
Location: Bangalore / Hyderabad
Notice Period: Immediate to 15 Days
Interview Process: 1st Round – Virtual | 2nd Round – F2F
Mandatory Skills
- Python
- PySpark
- SQL
- Azure Data Engineering
Job Description
We are looking for an experienced Azure Data Engineer with 9+ years of experience and strong hands-on expertise in Python, PySpark, SQL, and Azure Data Engineering.
Key Responsibilities
- Develop and maintain scalable data engineering solutions using Azure.
- Build and optimize data processing pipelines using PySpark and Python.
- Write complex SQL queries for data extraction and transformation.
- Work with Azure data services and cloud-based data platforms.
- Perform data processing, transformation, and integration.
- Troubleshoot data pipeline and production issues.
- Collaborate with technical and business teams to deliver data solutions.
Preferred: Immediate to 15 Days joiners.
Job Title : Data / AI / GenAI – Engineering & Analytics
Experience : 4+ Years
Location : Noida / Gurugram / Ahmedabad
Employment Type : Full-time | On-site at client location
Working Days : 5 days per week
Working Hours : Standard business hours
Position Overview : We are seeking professionals to deliver modern data engineering, business intelligence, cloud analytics and AI-powered applications, according to their specialization.
Mandatory Skills :
Python, SQL, ETL/ELT, Data Engineering, Power BI, Azure Data Factory, Databricks, PySpark, Data Modeling, GenAI/LLMs, RAG, Vector Databases, AI Agents (as per role specialization).
Key Roles / Specializations :
- Power BI Developers : Dashboards, DAX, Power Query, reporting and data modeling
- Azure Data Engineers : Azure Data Factory, Data Lake, Azure SQL and cloud pipelines
- Databricks Engineers : Apache Spark, PySpark, Delta Lake and scalable processing
- Data Engineers : ETL/ELT, SQL, Python, data warehousing and quality
- GenAI / RAG Engineers : LLMs, prompts, embeddings, vector databases and retrieval pipelines
- Agentic AI Engineers : AI agents, tool calling, orchestration and multi-agent workflows
Key Responsibilities :
- Design, develop and maintain data pipelines, analytics solutions or AI applications.
- Build and optimize data integration, transformation and processing workflows.
- Develop dashboards and analytical models for business decision-making.
- Use cloud data platforms and modern engineering frameworks.
- Develop and evaluate LLM applications, RAG solutions or AI agents as applicable.
- Ensure data quality, security, performance and reliability.
- Collaborate with engineering teams and stakeholders on testing, deployment and documentation.
Required Skills & Qualifications :
- Bachelor’s degree in Computer Science, IT, Data Science, Engineering or related discipline.
- 4–5 years of relevant experience in data, analytics, AI or software engineering.
- Hands-on expertise in at least one listed specialization; not all technologies are required.
- Relevant Python, SQL, DAX or other technical skills depending on the position.
- Understanding of cloud platforms, APIs, integration and software practices.
Preferred Qualifications :
- Azure, Databricks or Microsoft Fabric experience.
- For GenAI roles : Azure OpenAI, OpenAI APIs, LangChain, LlamaIndex or LangGraph.
- For relevant roles : vector databases, CI/CD, Docker, MLOps or LLMOps.
Note : Candidates are expected to have expertise in their relevant specialization, not in every listed technology or role.
Job Summary
We are looking for a skilled and experienced Data Engineer to join our growing data team. The ideal candidate will have strong expertise in Python, PySpark, Data Modeling, and Power BI, with hands-on experience in designing, developing, and optimizing scalable data solutions. The role requires working closely with business stakeholders, data architects, and analytics teams to build robust data pipelines and semantic models that enable data-driven decision-making.
Technical Skills
- Strong hands-on experience in Python and PySpark development.
- Expertise in building and optimizing Data Engineering solutions and ETL pipelines.
- Strong understanding of Data Modeling concepts (Star Schema, Snowflake Schema, Dimensional Modeling).
- Experience with Power BI Data Modeling and Semantic Layer development.
- Proficiency in DAX (Data Analysis Expressions).
- Experience designing and managing Semantic Models in Power BI.
- Strong SQL skills and experience working with large datasets.
- Knowledge of data warehousing concepts and best practices.
Preferred Skills
- Experience with cloud platforms such as Azure, AWS, or GCP.
- Exposure to modern data platforms like Databricks.
- Understanding of data governance and data quality frameworks.
Location: Bangalore Experience: 5 to 7 years Employment type: Full-time, permanent Work Hours: General Shift (10.00 AM to 7.00 PM) website: www.amazech.com Qualifications: Minimum B.E./B.Tech, or higher in Computer Science, Information Technology, Data Engineering, or a related field, with a good academic background. Key Responsibilities: • Design, develop, and maintain end-to-end data pipelines. • Build and optimize ETL/ELT processes for large-scale data processing. • Implement Azure-based data solutions ensuring scalability and performance. • Collaborate with stakeholders to understand business data requirements. • Perform performance tuning and optimization across data platforms. • Support production environments, conduct root cause analysis, and resolve data-related issues. • Maintain comprehensive technical documentation and structured knowledge transfer documents. • Work effectively within Agile/Scrum frameworks and contribute to sprint planning and delivery. • Ensure secure and compliant data handling using Azure best practices. Required Skills & Experience • End-to-end ETL/ELT pipeline development, integration, and performance optimization • Azure Synapse, Azure Logic Apps, Azure SQL, and Azure Databricks, with a strong focus on performance tuning • Microsoft Azure services, including Storage Accounts, Key Vault, and Cognitive Services • Advanced proficiency in Python development and modern productivity tools such as GitHub Copilot and Cursor • Strong documentation discipline, including technical design documentation, and structured knowledge transfer documents • Experience operating within Agile/Scrum frameworks, including production support, root cause analysis, and effective stakeholder collaboration
Job Summary
Role Overview
We are looking for an experienced Data Engineer with strong expertise in Python, ETL, Advanced SQL, CI/CD, DevOps, and Data Analytics. The ideal candidate should have hands-on experience designing and developing scalable data pipelines, transforming large datasets, and supporting data-driven applications.
Experience with Google Cloud Platform (GCP) will be an added advantage.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines using Python and SQL.
- Develop complex and optimized SQL queries, stored procedures, and data transformations.
- Build and maintain reliable data integration workflows across multiple data sources.
- Perform data cleansing, validation, transformation, and quality checks.
- Analyze data and provide insights to support business and technical requirements.
- Implement and maintain CI/CD pipelines for data engineering applications.
- Work with DevOps practices and tools to automate deployments, monitoring, and infrastructure processes.
- Troubleshoot data pipeline failures, performance issues, and production incidents.
- Optimize data processing workflows for performance, scalability, and reliability.
- Collaborate with Data Analysts, Data Scientists, Developers, and other stakeholders.
- Follow best practices for version control, testing, documentation, and deployment.
- Contribute to cloud-based data engineering initiatives, preferably on GCP.
Required Skills
- 5–7 years of hands-on experience in Data Engineering.
- Strong programming skills in Python.
- Strong expertise in Advanced SQL and database concepts.
- Hands-on experience with ETL/ELT processes and data pipelines.
- Good understanding of Data Warehousing and Data Modeling concepts.
- Experience with CI/CD practices and tools.
- Strong understanding of DevOps principles, automation, and deployment processes.
- Strong data analytics and problem-solving skills.
- Experience working with large datasets and performance optimization.
- Good understanding of Git/version control and software development best practices.
Good to Have
- Hands-on experience with Google Cloud Platform (GCP).
- Exposure to GCP data services such as BigQuery, Cloud Storage, Dataflow, Composer, or Pub/Sub.
- Experience with containerization/orchestration technologies such as Docker/Kubernetes.
- Experience with workflow orchestration tools such as Airflow.
- Knowledge of cloud-based data architecture and distributed data processing.
Preferred Candidate Profile
- Strong analytical and problem-solving abilities.
- Good communication and stakeholder management skills.
- Ability to work independently as well as in a collaborative team environment.
- Strong ownership of data pipelines and production systems.
- Candidates who can join at short notice are preferred.
Mandatory Skills
Data Engineer, Python , ETL, GCP, Advanced SQL, Strong Data Analytics skills, CICD, Devops

We are hiring for a Data Engineer & Java scala for a full-time opportunity in Bangalore.
Experience: 4–10 Years
Must-Have Skills:
Java / Scala / Python, Data Engineering, Databricks / Snowflake, and Cloud (AWS / Azure / GCP).
We are looking for strong software engineers with hands-on experience in data platform development, scalable backend programming, data integration, and cloud technologies.
Experience in Banking, Capital Markets, Market Risk, or Regulatory Reporting will be an added advantage.

We are a Leading Delhi Based Consultant, currently we are hiring for IT Company for Noida Location.
Designation: Data Engineer
Reporting: Technical Director / Data Director
Desired Experience: 6 – 10 Years
Qualification: BE/ B Tech/ M Tech/ MCA and any Graduate.
Job Location: Noida Sec - 6 (Nearest Metro Station 15) (WFH/Work from Home Available)
Total Employees: 100+ Members
Working Days: Monday to Friday
What you will do:
- Be responsible for the successful and optimal use of the data platform by the global organization.
- Be responsible of the data infrastructure, create, maintain and optimize complex data pipelines to meet business requirements.
- Assemble large datasets from a wide variety of data sources using Snowflake and Talend technologies with data and analytics experts.
- Put in place automated processes, analytics and tools to ensure optimal data deliverability, quality and operational efficiency.
- Be the global point of contact of a multinational, cross-functional team of users for all data infrastructure matters.
- Work with stakeholders including Product, Data and IT teams to support the development of new products and ensure the full benefits of the data platform.
- Create, under the authority of the Data Director, company-wide data-related processes and guidelines to maximize the data adoption by all stakeholders.
- Work closely with the Data Director and the other key application owners to assist with data-related technical issues and new data infrastructure needs.
- Work closely with the IT and Executive on the roadmap of data infrastructure evolutions, in close collaboration with the Product and Data teams
- Be responsible for the data platform and make sure it is optimized in terms of security, speed, availability, connectivity ...
Your Qualifications:
- Bachelor’s from a recognized University
What you will need:
- You have a solid BIG DATA experience of at least 5 years.
- You speak English fluently and you write professionally in this language.
- You have advanced SQL knowledge and strong experience working with relational databases.
- You have a successful history of designing and optimizing complex big data architectures, pipelines, and datasets with another company.
- You have experience performing root cause analysis on internal and external data processes.
- You have experience performing data analytics and data mining to answer business needs.
- You have experience in dynamic data masking, row level security and other security and data sharing best practices.
- You are familiar with message queuing, stream processing and unstructured datasets.
- You are familiar with continuous deployment concepts.
- You have strong project and organizational skills and experience working with cross functional teams in a dynamic environment.
- You understand the key factors of success of a data platform as well as the typical failure causes.
- You are very familiar with several big data technologies, for having implemented or participated in their implementation.
- You are familiar with digital marketing concepts like leads management, reporting, segmentation, targeting, lists management...
- You are familiar with the creation of reports and dashboards.
- You are familiar with European Union’s General Data Protection Regulation (GDPR)
Key Skills:
- You have an experience with Snowflake, Talend Cloud
- You have coding experience with different technologies: Python, C#
- You have experience designing and interconnecting with external APIs.
- You are familiar with tools like Marketing Automation (HubSpot, Marketo, Selligent...), CRMs (Salesforce, Microsoft Dynamics, HubSpot...), PIMs (Akeneo, Pimcore...), BI (PowerBI, Qlik, Tableau...)
- You are familiar with Agile Methodologies and Continuous Delivery
Personal Skills:
- You are talented to connect and truly collaborate with colleagues, including distant collaboration.
- You are an achiever who is data driven.
- You are a quick learner, adaptative and flexible but also structured and well-organized.
- You are autonomous but appreciate teamwork.
Please Share the Following Details:
- Current CTC
- Expected CTC
- Notice Period
- Current Location
- Reason for Change
- Total Years of Experience
Kindly share references for the same opening, if available.
WhatsApp your CV at 7 5 0 3 8 6 6 1 9 6
We are hiring experienced Data Engineers for a permanent opportunity in Bangalore.
Job Description
Role: Data Engineer
Location: Bangalore
Experience: 6+ Years
Key Responsibilities:
- Design, develop, and maintain scalable data processing pipelines using Amazon EMR.
- Develop data engineering solutions using Python and Scala.
- Process and transform large volumes of structured and unstructured data.
- Build and optimize distributed data processing workflows for performance and scalability.
- Work with big data technologies and cloud-based data processing environments.
- Perform data integration, validation, transformation, and quality checks.
- Troubleshoot data pipeline issues and optimize processing performance.
- Collaborate with data architects, analysts, and development teams to deliver reliable data solutions.
Required Skills:
- Strong hands-on experience with Amazon EMR.
- Proficiency in Python and Scala.
- Experience in big data processing and data pipeline development.
- Good understanding of distributed computing and data transformation techniques.
- Experience in performance tuning and troubleshooting data processing jobs.
- Strong analytical, problem-solving, and communication skills.

We are looking for a Sr. Data Engineer to join our team with 4+ years of experience in SQL, PySpark, ETL, ADLS, Azure Databricks, Unity Catalog, and Azure technologies.
Responsibilities
- 3+ years of experience developing data pipelines using Python/PySpark, with proficiency in Spark SQL and Azure Databricks.
- 4+ years of experience with Azure data engineering technologies, including ADLS, Unity Catalog, Azure Data Factory, Azure Databricks, and Azure SQL/Synapse.
- 4+ years of experience with SQL.
- Experience in data modelling, including dimensional modelling, star schema and snowflake schemas.
- Proficiency in version control tools such as Git and project management tools such as Jira.
Qualifications
- Excellent verbal and written communication skills.
- UG: B.Sc, BCA, or B.Tech/B.E. in any specialization.
- Reliable internet connectivity is required.
Good to Have
- Experience working with financial data or finance-related datasets.
- Experience with Structured Streaming and Azure Event Hubs.
- Experience with Declarative Automation Bundles and Spark Declarative Pipelines (SDP).
- Azure certifications.

Job Title : Data Platform Engineer (SDE 2 / SDE 3)
Experience : 3 to 8 Years (SDE2 : 3 to 5 Years | SDE3 : 5.5 to 8 Years)
Location : Remote (Contract) → Pune (Post Conversion)
Employment Type : Contract-to-Hire (3 Months)
Mandatory Skills :
Java / Python / Go, SQL, Data Engineering, ETL / ELT, Apache Airflow, Apache Spark / Flink, Kafka, AWS/GCP/Azure, Distributed Systems, API Development, Docker, Kubernetes, CI/CD, System Design
Role Overview :
We are looking for a Data Platform Engineer with strong backend engineering expertise to build scalable, high-performance data platforms and distributed systems. The ideal candidate should have hands-on experience in developing production-grade backend applications along with designing and maintaining modern data pipelines.
Key Responsibilities :
- Build and maintain scalable ETL/ELT and data processing pipelines.
- Develop backend services and APIs using Java (preferred), Python, or Go.
- Design batch and real-time data pipelines using Spark, Flink, Kafka, and Airflow.
- Optimize SQL queries, data models, and distributed data systems.
- Work with cloud platforms (AWS, GCP, or Azure) and container technologies (Docker, Kubernetes).
- Implement CI/CD, monitoring, logging, and performance optimization.
- Collaborate with product and engineering teams on scalable system design and architecture.
Required Qualifications :
- SDE 2 : 3 to 5 years of Backend + Data Engineering experience.
- SDE 3 : 5.5 to 8 years of Backend + Data Engineering experience.
- Strong coding skills in Java (preferred), Python, or Go.
- Excellent SQL and data modeling knowledge.
- Hands-on experience with Airflow, Apache Spark / Apache Flink, or similar technologies.
- Experience building scalable backend services and APIs.
- Good understanding of distributed systems, system design. and scalable architecture.
- Experience with cloud platforms (AWS, Azure, or GCP).
- Hands-on experience with Docker and Kubernetes.
- Strong understanding of CI/CD pipelines.
- Excellent problem-solving and debugging skills.
Good to Have :
- Experience with Snowflake, BigQuery, or Redshift.
- Understanding of Kafka, Kinesis, or Pub/Sub
- Performance optimization of large-scale distributed systems
- FinTech or high-scale distributed systems experience.
- Knowledge of data governance, security, and compliance.
Preferred Candidate Profile :
- Strong Backend + Data Engineering experience
- Experience building scalable production systems
- Strong ownership mindset
- Good system design knowledge
- Experience processing millions of events using Kafka/Spark
- Built APIs supporting data infrastructure
- Production engineering experience
Interview Process :
- Take-home Coding Assignment (48 Hours)
- Leadership & Strategy Round (1 Hour)
- Technical Depth – Data Engineering & Performance (1 Hour)
- Culture & Values Fit (30 Minutes)







