Quantiphi

As a Senior Data Engineer, you will be responsible for designing, developing, and optimizing scalable cloud-native data platforms on AWS. You will build high-performance batch and analytical data pipelines using DBT (Cloud + Core), AWS Glue, SMUS, Redshift, Python, MWAA, APIs, and other AWS services while ensuring reliability, scalability, and operational excellence.

The role requires strong expertise in data engineering, SQL optimization, distributed data processing, and cloud-native architectures.

Must Have Primary Skills

Data Engineering

• 3+ years of hands-on experience building large-scale AWS Data Engineering solutions.
• Strong experience designing scalable batch and streaming data pipelines on AWS.
• Experience implementing monitoring, logging, alerting, and observability for production data pipelines.
• Strong understanding of data quality, troubleshooting, debugging, and production support.

DBT & Data Warehousing

• Strong hands-on experience with DBT (Cloud + Core) (Highly Recommended).
• Hands-on expertise with Amazon Redshift for Data Warehousing and Analytics.

Programming & Querying

• Strong expertise in:
• SQL (Analytical Queries, Window Functions, Stored Procedures)
• Python
• Spark / PySpark
• Strong experience in Spark/PySpark performance tuning and optimization.

Lakehouse & Apache Iceberg

• Hands-on experience designing and implementing Lakehouse solutions using Apache Iceberg.
• Experience optimizing Apache Iceberg and Amazon Aurora PostgreSQL for performance and scalability.
• Strong understanding of:
• Data Modeling
• Partitioning
• File Formats
• Lakehouse / Data Lake Architectures

AWS Cloud Services

Hands-on experience with AWS services including:

• AWS Glue
• Amazon MWAA
• Amazon EMR
• Amazon Redshift
• Amazon S3
• Amazon Athena
• AWS Glue Catalog
• Amazon Aurora PostgreSQL
• AWS Lambda
• Amazon EC2
• Amazon DynamoDB
• Amazon API Gateway
• Amazon CloudWatch
• Amazon SQS
• Amazon SNS
• Amazon EventBridge
• AWS Secrets Manager
• AWS IAM

Development Practices

• Experience with CI/CD.
• Strong knowledge of Git.
• Familiarity with Data Engineering best practices.

Soft Skills

• Strong communication skills.
• Excellent problem-solving ability.
• Stakeholder management experience.

Preferred Certification

• AWS Data Engineer Associate or equivalent AWS Certification.

Good to Have Skills

• AWS Step Functions
• Terraform / Infrastructure as Code (IaC)
• Kafka
• Hive
• HDFS
• Other Big Data technologies
• Experience using GenAI-assisted development tools such as:
• GitHub Copilot
• Cursor
• Kiro
• Similar AI coding assistants
• ClickHouse Database
• Telecom / Mobile Network domain knowledge
• AtScale design and development
• Docker
• Kubernetes 

Job Title: Senior Business Intelligence (BI) Engineer

Note: This is an onsite role based in Saudi Arabia (client location) for a duration of 3 months. Candidates should be willing to relocate and work on-site for the full engagement period.

Role & Responsibilities:

● Design, develop, and optimize BI dashboards and reports using Looker, Power BI, and Tableau.

● Create and maintain LookML models, explores, dimensions, and measures for efficient data visualization.

● Work closely with data analysts, business stakeholders, and engineering teams to translate business needs into actionable insights.

● Implement row-level security (RLS), column-level security (CLS), and user access management within BI platforms.

● Optimize BI performance by tuning SQL queries, caching strategies, and indexing techniques.

● Manage and automate data pipelines, ETL processes, and integrations across multiple data sources like BigQuery, SQL Server, and Snowflake.

● Leverage Looker API for embedding visualizations and automating reporting workflows.

● Ensure data governance, quality, and compliance while maintaining documentation for BI configurations.

● Work with version control tools like Git to manage LookML changes efficiently.

● Train and support business users on self-service analytics and BI best practices.

● Troubleshoot and resolve issues related to BI dashboards, data models, and report accuracy.

Skills & Qualifications:

● BI Tools: Expert in Looker (LookML), Power BI, Tableau, Sigma Computing.

● SQL & Databases: Strong proficiency in SQL, PL/SQL, T-SQL, working with BigQuery, SQL Server, MySQL, Oracle, and Snowflake.

● ETL & Data Engineering: Hands-on experience with SSIS, Azure Data Factory, IBM Datastage.

● Cloud Platforms: Experience working with Google Cloud Platform (GCP), Microsoft Azure.

● Programming & Scripting: Proficiency in Python, Shell scripting for automation and data processing.

● Data Modeling & Governance: Strong understanding of dimensional modeling, data lineage, and governance best practices.

● API & Automation: Experience integrating BI solutions with Looker API and other automation tools.

● Project Management & Agile: Ability to gather business requirements, track project progress, and communicate updates.

● Soft Skills: Strong problem-solving, stakeholder management, and communication skills.

Location: Mumbai (Work From Office)

About Quantiphi

Quantiphi is an award-winning AI-first digital engineering company driven by the desire to solve transformational business problems. By combining deep industry expertise, cloud and data engineering, and cutting-edge AI research, Quantiphi helps customers build smarter products, frictionless customer experiences, autonomous processes, and safer businesses.

As an Architect – Machine Learning Engineer, you will design and develop advanced machine learning models and algorithms to solve complex business problems. You will optimize and deploy these models on AWS infrastructure, ensuring scalability and reliability.

Must Have Skills

• 7+ years of hands-on experience implementing and developing cloud ML solutions on AWS.
• Strong experience with AWS SageMaker, including:
• Training Jobs
• Processing Jobs
• Batch & Real-time Inference
• Working with multiple data sources
• Strong NLP expertise:
• Deep Learning concepts (Transformers, BERT, Attention Models)
• Python
• Hugging Face Transformers
• SpaCy
• NLTK
• Stanford NLP
• NLP concepts including tokenization, embeddings, syntactic & semantic parsing, Named Entity Recognition (NER), and coreference resolution.
• Experience building Agentic AI applications:
• LangChain
• Amazon Bedrock Agents
• Autonomous task planning and multi-step reasoning
• Experience architecting AI solutions using AWS services:
• AWS Lambda
• Amazon Bedrock
• Step Functions
• S3
• API Gateway
• SageMaker
• Experience implementing Model Context Protocol (MCP) for state, memory, context window, and prompt orchestration.
• Experience integrating agentic workflows with LLMs such as:
• Titan
• Nova
• Cohere
• Claude
• Hands-on experience fine-tuning Large Language Models (LLMs), specifically Llama 2.
• Familiarity with:
• Prompt Engineering
• Tool Calling
• Vector Databases (OpenSearch, Pinecone, Elasticsearch, Bedrock Knowledge Bases)
• Context Management
• Model evaluation and optimization:
• Zero-shot/Few-shot evaluation
• Hyperparameter tuning
• Model interpretability
• Experience with workflow orchestration tools such as:
• Airflow
• AWS Step Functions
• SageMaker Pipelines
• Kubeflow
• Experience building secure, scalable APIs and integrating third-party data sources.
• Strong collaboration skills with Developers, QA, Product Managers, and cross-functional stakeholders.

Good to Have

• Experience working on EdTech use cases.
• Software development experience.

Quantiphi is an award-winning Applied AI and Big Data software and services company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented speed.

Some company highlights:

• Quantiphi has seen 2.5x growth YoY since its inception in 2013.
• Winner of the "Machine Learning Partner of the Year" award from Google for two consecutive years - 2017 and 2018.
• Winner of the "Social Impact Partner of the Year" award from Google for 2019.
• Headquartered in Boston, with 700+ data science professionals across different offices.

For more details, visit: our http://www.quantiphi.com/">Website or our https://www.linkedin.com/company/quantiphi/">LinkedIn Page

Job Description

Role:                                 Associate Tech Architect / Tech Architect – ReactJS +Python+AWS

Experience Level:           7-13 Years

Work location:                Mumbai & Bangalore

We are looking for an experienced full stack developer( ReactJS and Python ) who can help create dynamic software applications for our clients with their skill set. In this role, you will be responsible for gathering requirements from clients and accordingly write and test scalable code, and develop front end and back-end components.

Technologies worked on:

ReactJS, Python, AWS

Requirement Description:

• Full Stack developer with experience in ReactJS, Python, API Gateway, Fargate and ECS
• Well-experienced in working with tools like Git, Maven, JFrog
• Should have a solid understanding of object-oriented programming (OOP)
• Well-experienced to perform Unit Testing and Integration Testing and have good experience in Agile based development approach
• Expertise in developing enterprise-level web applications and REST and SOAP APIs using MicroServices, with demonstrable production-scale experience
• Demonstrate strong design and programming skills using JSON, Web Services, XML, XSLT, PL/SQL in Unix and Windows environments
• Strong background working with Linux/UNIX environments and strong Shell scripting experience
• Working knowledge with SQL or  No SQL databases
• Understand Architecture Requirements and ensure effective design, development, validation, and support activities
• Understanding of core AWS services, uses, and basic AWS architecture best practices
• Proficiency in developing, deploying, and debugging cloud-based applications using AWS
• Ability to use the AWS service APIs, AWS CLI, and SDKs to write applications
• Ability to identify key features of AWS services
• Identify bottlenecks and bugs, and recommend solutions by comparing the advantages and disadvantages of custom development
• Should contribute to team meetings, troubleshooting development and production problems across multiple environments and operating platforms
• Execute strong collaboration and communication skills within distributed project teams
• Continuously discover, evaluate, and implement new technologies to maximize development efficiency