
We are looking for a Senior Data Engineer with strong expertise in GCP, Databricks, and Airflow to design and implement a GCP Cloud Native Data Processing Framework. The ideal candidate will work on building scalable data pipelines and help migrate existing workloads to a modern framework.
- Shift: 2 PM 11 PM
- Work Mode: Hybrid (3 days a week) across Xebia locations
- Notice Period: Immediate joiners or those with a notice period of up to 30 days
Key Responsibilities:
- Design and implement a GCP Native Data Processing Framework leveraging Spark and GCP Cloud Services.
- Develop and maintain data pipelines using Databricks and Airflow for transforming Raw → Silver → Gold data layers.
- Ensure data integrity, consistency, and availability across all systems.
- Collaborate with data engineers, analysts, and stakeholders to optimize performance.
- Document standards and best practices for data engineering workflows.
Required Experience:
- 7-8 years of experience in data engineering, architecture, and pipeline development.
- Strong knowledge of GCP, Databricks, PySpark, and BigQuery.
- Experience with Orchestration tools like Airflow, Dagster, or GCP equivalents.
- Understanding of Data Lake table formats (Delta, Iceberg, etc.).
- Proficiency in Python for scripting and automation.
- Strong problem-solving skills and collaborative mindset.
⚠️ Please apply only if you have not applied recently or are not currently in the interview process for any open roles at Xebia.
Looking forward to your response!
Best regards,
Vijay S
Assistant Manager - TAG

About Xebia IT Architects
About
Connect with the team
Similar jobs
Key Responsibilities
AI Model Development
- Design and implement advanced Generative AI models (e.g., GPT-based, LLaMA, etc.) to support applications across various domains, including text generation, summarization, and conversational agents.
- Utilize tools like LangChain and LlamaIndex to build robust AI-powered systems, ensuring seamless integration with data sources, APIs, and databases.
Backend Development with FastAPI
- Develop and maintain fast, efficient, and scalable FastAPI services to expose AI models and algorithms via RESTful APIs.
- Ensure optimal performance and low-latency for API endpoints, focusing on real-time data processing.
Pipeline and Integration
- Build and optimize data processing pipelines for AI models, including ingestion, transformation, and indexing of large datasets using tools like LangChain and LlamaIndex.
- Integrate AI models with external services, databases, and other backend systems to create end-to-end solutions.
Collaboration with Cross-Functional Teams
- Collaborate with data scientists, machine learning engineers, and product teams to define project requirements, technical feasibility, and timelines.
- Work with front-end developers to integrate AI-powered functionalities into web applications.
Model Optimization and Fine-Tuning
- Fine-tune and optimize pre-trained Generative AI models to improve accuracy, performance, and scalability for specific business use cases.
- Ensure efficient deployment of models in production environments, addressing issues related to memory, latency, and resource management.
Documentation and Code Quality
- Maintain high standards of code quality, write clear, maintainable code, and conduct thorough unit and integration tests.
- Document AI model architectures, APIs, and workflows for future reference and onboarding of team members.
Research and Innovation
- Stay updated with the latest advancements in Generative AI, LangChain, and LlamaIndex, and actively contribute to the adoption of new techniques and technologies.
- Propose and explore innovative ways to leverage cutting-edge AI technologies to solve complex problems.
Required Skills and Experience
Expertise in Generative AI
Strong experience working with Generative AI models, including but not limited to GPT-3/4, LLaMA, or other large language models (LLMs).
LangChain & LlamaIndex
Hands-on experience with LangChain for building language model-driven applications, and LlamaIndex for efficient data indexing and querying.
Python Programming
Proficiency in Python for building AI applications, working with frameworks such as TensorFlow, PyTorch, Hugging Face, and others.
API Development with FastAPI
Strong experience developing RESTful APIs using FastAPI, with a focus on high-performance, scalable web services.
NLP & Machine Learning
Solid foundation in Natural Language Processing (NLP) and machine learning techniques, including data preprocessing, feature engineering, model evaluation, and fine-tuning.
Database & Storage Systems Familiarity with relational and NoSQL databases, data storage, and management strategies for large-scale AI datasets.
Version Control & CI/CD
Experience with Git, GitHub, and implementing CI/CD pipelines for seamless deployment.
Preferred Skills
Containerization & Cloud Deployment
Familiarity with Docker, Kubernetes, and cloud platforms (e.g., AWS, GCP, Azure) for deploying scalable AI applications.
Data Engineering
Experience in working with data pipelines and frameworks such as Apache Spark, Airflow, or Dask.
Knowledge of Front-End Technologies Familiarity with front-end frameworks (React, Vue.js, etc.) for integrating AI APIs with user-facing applications.
Java AWS engineer with experience in building AWS services like Lambda, Batch, SQS, S3, DynamoDB etc. using AWS Java SDK and Cloud formation templates.
- Java AWS engineer with experience in building AWS services like Lambda, Batch, SQS, S3, DynamoDB etc. using AWS Java SDK and Cloud formation templates.
- 4 to 8 years of experience in design, development and triaging for large, complex systems. Experience in Java and object-oriented design skills
- 3-4+ years of microservices development
- 2+ years working in Spring Boot
- Experienced using API dev tools like IntelliJ/Eclipse, Postman, Git, Cucumber
- Hands on experience in building microservices based application using Spring Boot and REST, JSON
- DevOps understanding – containers, cloud, automation, security, configuration management, CI/CD
- Experience using CICD processes for application software integration and deployment using Maven, Git, Jenkins.
- Experience dealing with NoSQL databases like Cassandra
- Experience building scalable and resilient applications in private or public cloud environments and cloud technologies
- Experience in Utilizing tools such as Maven, Docker, Kubernetes, ELK, Jenkins
- Agile Software Development (typically Scrum, Kanban, Safe)
- Experience with API gateway and API security.
Job Title: HR Intern
Duration: 3 Month
Qualification: Fresher / Experienced
Salary: Incentive-Based
Responsibilities :
👉 Developing own network of suitable candidates
👉 Interviewing candidates
👉 Effective Communication Skills
👉 Working with the organization to develop a recruitment plan
👉 Source potential candidates from different platforms
👉 Be active with online job portals for recruitment
Job Type: Remote internship.
Perks:
*Offer Letter with Appreciation
*Recommendation letter issued based on your performance
*Certification awarded at the end of the internship
*Job Offer, If found to be an Exceptional Performer
hashtag#hrcareers hashtag#managementcareer hashtag#hrinternship hashtag#remotework hashtag#freshershiring hashtag#mbafreshers hashtag#hrstudents hashtag#hrroles
hashtag#flexiblework
Lead Software Engineer - Backend
It is evolving the way people discover the world by connecting them with exceptional experiences in their city at the push of a button. We are building a magical platform that gets everyone to head out and have fun in a matter of seconds; no matter where you are and what you want to do. We are combining a delightful product experience, data-driven decisions, sophisticated supply side logistics network, and world-class operations to solve a huge basic human problem: how do we have a good time?
We’re growing rapidly with over $200M in annualized sales, 150,000 monthly transactions and profitable unit economics. We are backed by some of the finest investors in Silicon Valley & India.
We like to solve real-world problems in the simplest, most elegant manner possible. We’re looking for a QA Lead with the ability and passion for building solutions to people-centered problems that are created at the intersection of human behavior and technology. You should also be capable of building and mentoring a fast-growing passionate, young, and talented team. We love folks who have a sense of humor and know how to have fun.Dream, build and iterate. That's our mantra. Because good just isn't good enough.
👩💻 The Role
- Full responsibility of designing and building core modules on the application and infrastructure layer.
- Lead a fast-growing team of young, passionate, talented and fun loving superstars.
- Solve challenging architectural and design problems.
- Get your hands dirty with clustering, replication, databases, build systems and infrastructure automation etc.
- Be responsible for building concurrent, performant and scalable services which will power the entire Headout ecosystem.
- Build and contribute to open-source libraries and components.
🌟 Our Dream Engineer
- A penchant for learning and building with new technologies and frameworks.
- You love working with people and have worked in a lead position in the past.
- A knack for writing the most performance optimized code along with it being modular and scalable.
- No challenge is too big to solve; love thinking product and excited to ideate & build stuff all by yourself.
- You're interested in being an early employee at a growing company, with the influence and responsibility that entails.
- You have broad and deep knowledge across a variety of contemporary technologies.
💝 We like
- Strong CS fundamentals, good working knowledge of classic algorithms and data structures.
- 2+years experience developing server-side technologies using any language or framework.
- Excellent communication, collaboration and people management skills.
- Experience working with Spring, Relational Databases, Concurrent Programming, NoSQL flavors, AWS.
- Experience designing scalable, fault-tolerant systems and databases.
- Experience with setting setting up systems and infrastructure.
- Solid understanding of how the web works and its underlying communication protocols.
- People who can't live without solving that algorithm problem that they just stumbled upon.
- People who will give up anything to squeeze in that last bit-level performance.
- Anything else than can surprise us.
- Nice to Haves: An interest in travel, local experiences & hospitality.
Skills Required:
- Must worked on Enterprise Mobile app designs.
- Must understand user behaviour based designs
- Must have UX knowledge and exposure in building or improving UX
- Should have used Figma and Adobe XD
2) Experience of working with source control and bug tracking tools used for development
3) Experience in developing user interfaces using bootstrap for web applications
4) Exposure to OOPS concept
5) Exposure to different Framework & principles for SDLC development
6) Exposure to writing stored procedures, views & designing tables.
7) The developer will be an integral part of Applications engineering team.
8) Appreciate & Develop high quality Front End/UI for web applications.
We are looking for skilled Full stack Developer to join our team. The successful candidate will be responsible for developing, maintaining, and scaling our server-side application logic using Python and related frameworks. As a full-stack developer, you will work closely with front-end developers, data scientists, and project managers to develop scalable and reliable software solutions.
Responsibilities:
Developing and maintaining server-side application logic using Python and related frameworks
Designing and implementing APIs and web services using RESTful principles
Collaborating with front-end developers to integrate user-facing elements with server-side logic
Designing and implementing efficient database schemas and queries
Developing and maintaining automated testing and deployment pipelines
Ensuring high performance and scalability of software applications
Having knowledge of Node.js will be added advantage
Troubleshooting and debugging software issues
Staying up-to-date with emerging trends and technologies in backend development
Requirements:
Strong experience with Python and related frameworks such as Flask, Django, or Pyramid
Proficient understanding of SQL and NoSQL databases
Experience with AWS or other cloud platforms
Familiarity with version control systems such as Git
Excellent problem-solving and debugging skills
Strong communication and collaboration skills
Ability to work in a fast-paced, collaborative environment
If you are a passionate Backend Python Developer with a strong desire to work on complex, challenging problems, we encourage you to apply.
Job description
Finzly is a fintech company, providing innovative solutions to meet the growing needs of Banks and Financial services firms in North America.
Our award-winning open banking platform, BankOS, allows banks to innovate at the speed of “NOW” and compete with Fintech companies in the market.
This is an excellent opportunity to be part of a team bringing innovation in the finance industry and be a proud engineer. This means following the industry standards, using clean code and being bold while sharing your thoughts during tough technical conversations. We want you to be a part of all of this!
What we need from you:
- You will join our team to develop awesome products for our customers(Banks and Financial Institutions)
- You will be developing in Java, Spring Boot on the backend and Angular on the frontend
- Learn from our high performing teams, while at the same time providing feedback on how the team could do its job better
- Work with our product owners and help them to convert ideas into working products.
- Sharp focused on delivery. We are results-oriented and need self-starters who do not wait around for direction.
What we need you to bring:
- Deep passion for developing software and continuous learning attitude to write more efficient code.
- Someone who wants to work in a strong team and influence that team on how to perform better
- You enjoy sliding between both front-end and back-end stacks to solve problems instead of just “writing code”
- 5 or more years of experience writing code for web products.
- You have worked with cloud technology
Bonus Points / Nice to Have
- Understanding of CI/CD/Docker/
- Experience/understanding payment processing / payment gateways, e.g. ACH, RTP, SWIFT, PCI compliance
- Experience on messaging and distributed caching.
Our Interview process:
- Recruiter Call (15 min) – Specialist - Recruitment
- Online Programming Test/Offline Assignment(45 to 90 minutes) – Online (This is optional for early joiners)
- Technical Interview (45 to 90 minutes): Sr/Lead R&D Engineers
- System Design + Methodology Interview (1 hour): Director - Engineering
- Final Interview : India Head (1 hour)
DUKAAN - Create Your Online Store in 30 Seconds
Built by a team of 5, app "Dukaan" helps local offline stores launch their online store in 30 seconds. They can make beautiful product catalogues (catalogs) rjght from a smartphone and share with their customers easily on different social media apps such as Whatsapp Business, Whatsapp, Facebook, Instagram etc. Just in 2 months of launch, we have seen tremendous traction since publishing our app on Play Store on 9th June 2020. In this short time frame, we have signed up over 2.5 Lakh businesses, who digitised over 2 Mn products and have helped drive over INR 20 Cr in sales for these small businesses. Praised by users all over India, this app has saved declining businesses by helping them transfer their shop online. The journey has just begun and we are on a mission to make India Digital, One dukaan at a time.
DESCRIPTION
We are looking for a great Frontend developer who is proficient with React.js. Your primary focus will be on developing user interface components and implementing them following well-known React.js workflows (such as Flux or Redux). You will ensure that these components and the overall application are robust and easy to maintain. You will coordinate with the rest of the team working on different layers of the infrastructure. Therefore, a commitment to collaborative problem solving, sophisticated design, and quality product is important.
RESPONSIBILITIES
- Developing new user-facing features using React.js
- Building reusable components and front-end libraries for future use
- Translating designs and wireframes into high quality code
- Optimizing components for maximum performance across a vast array of web-capable devices and browsers
REQUIREMENTS
- Strong proficiency in JavaScript, including DOM manipulation and the JavaScript object model
- Thorough understanding of React.js and its core principles
- Experience with popular React.js workflows (such as Flux or Redux)
- Familiarity with newer specifications of EcmaScript
- Familiarity with RESTful APIs and sockets
- Knowledge of modern authorization mechanisms, such as JSON Web Token
- Familiarity with modern front-end build pipelines and tools
- Experience with common front-end development tools such as Babel, Webpack, NPM, etc.
- Ability to understand business requirements and translate them into technical requirements
- A knack for benchmarking and optimization
- Familiarity with code versioning tools
- Experience with PWAs and React Native is a huge plus
Our client is a Cloud Solutions startup that helps businesses manage their sales processes and clients well. It is a registered Salesforce partner and has been providing customised products and services to various companies for several years. Their serve clients from various sectors like Finance, Healthcare, Education and even NGOs.
Their team consists of certified salesforce developers, consultants and mobile application developers, having a combined experience of over 50 Man years and over 100 projects. Founded by an ex-Infosys employee, they are a team of dynamic developers who are pioneers in Cloud Computing and their projects have been successfully set up and run in India and North America.
- Providing Development, customisation, configuration and integration of products and services
- Upgrading the knowledge with each release and follow best industry practices and standards while providing the IT solution.
- Performing Software Unit test before delivering it to the users.
- Communicating with customer to confirm requirements and for integration testing
- Investigating existing Salesforce build to identify any additional external data requirements to fulfill the introduction of new data elements and associated processing.
- Helping with integration data mapping
- Creating functional transformations for inbound and outbound data flows
What you need to have:
- B.tech, M.tech,Msc.IT,Bsc.IT, BCA, MCA, PGDCA
- Salesforce Developer, Admin and Sales or Service Cloud Certification is a must.
- Salesforce Advanced Administrator certification.
- Good understanding of Salesforce governor limits and integration patterns.
- Strong and proven experience inSalesforce.com application development (Apex, Visual force, Salesforce Lightning and Web Services Integration).
- Strong experience of Java script framework (e.g. react JS, angular JS, etc.).
- Strong and proven experience of integration in Salesforce.
- Experience of working with sales, service and community clouds.
- Proficient skills using Salesforce Application Development, Salesforce Reporting and Analytics.
- Salesforce Experience proficiency with the Salesforce platform along with the general software development expertise









