Lead II - Data Engineering
at Global Digital Transformation Solutions Provider
Amazon Web Services (AWS)
PythonSENIOR DATA ENGINEER:
ROLE SUMMARY:
Own the design and delivery of petabyte-scale data platforms and pipelines across AWS and modern Lakehouse stacks. You’ll architect, code, test, optimize, and operate ingestion, transformation, storage, and serving layers. This role requires autonomy, strong engineering judgment, and partnership with project managers, infrastructure teams, testers, and customer architects to land secure, cost-efficient, and high-performing solutions.
RESPONSIBILITIES:
- Architecture and design: Create HLD/LLD/SAD, source–target mappings, data contracts, and optimal designs aligned to requirements.
- Pipeline development: Build and test robust ETL/ELT for batch, micro-batch, and streaming across RDBMS, flat files, APIs, and event sources.
- Performance and cost tuning: Profile and optimize jobs, right-size infrastructure, and model license/compute/storage costs.
- Data modeling and storage: Design schemas and SCD strategies; manage relational, NoSQL, data lakes, Delta Lakes, and Lakehouse tables.
- DevOps and release: Establish coding standards, templates, CI/CD, configuration management, and monitored release processes.
- Quality and reliability: Define DQ rules and lineage; implement SLA tracking, failure detection, RCA, and proactive defect mitigation.
- Security and governance: Enforce IAM best practices, retention, audit/compliance; implement PII detection and masking.
- Orchestration: Schedule and govern pipelines with Airflow and serverless event-driven patterns.
- Stakeholder collaboration: Clarify requirements, present design options, conduct demos, and finalize architectures with customer teams.
- Leadership: Mentor engineers, set FAST goals, drive upskilling and certifications, and support module delivery and sprint planning.
REQUIRED QUALIFICATIONS:
- Experience: 15+ years designing distributed systems at petabyte scale; 10+ years building data lakes and multi-source ingestion.
- Cloud (AWS): IAM, VPC, EC2, EKS/ECS, S3, RDS, DMS, Lambda, CloudWatch, CloudFormation, CloudTrail.
- Programming: Python (preferred), PySpark, SQL for analytics, window functions, and performance tuning.
- ETL tools: AWS Glue, Informatica, Databricks, GCP DataProc; orchestration with Airflow.
- Lakehouse/warehousing: Snowflake, BigQuery, Delta Lake/Lakehouse; schema design, partitioning, clustering, performance optimization.
- DevOps/IaC: Terraform with 15+ years of practice; CI/CD (GitHub Actions, Jenkins) with 10+ years; config governance and release management.
- Serverless and events: Design event-driven distributed systems on AWS.
- NoSQL: 2–3 years with DocumentDB including data modeling and performance considerations.
- AI services: AWS Entity Resolution, AWS Comprehend; run custom LLMs on Amazon SageMaker; use LLMs for PII classification.
NICE-TO-HAVE QUALIFICATIONS:
- Data governance automation: 10+ years defining audit, compliance, retention standards and automating governance workflows.
- Table and file formats: Apache Parquet; Apache Iceberg as analytical table format.
- Advanced LLM workflows: RAG and agentic patterns over proprietary data; re-ranking with index/vector store results.
- Multi-cloud exposure: Azure ADF/ADLS, GCP Dataflow/DataProc; FinOps practices for cross-cloud cost control.
OUTCOMES AND MEASURES:
- Engineering excellence: Adherence to processes, standards, and SLAs; reduced defects and non-compliance; fewer recurring issues.
- Efficiency: Faster run times and lower resource consumption with documented cost models and performance baselines.
- Operational reliability: Faster detection, response, and resolution of failures; quick turnaround on production bugs; strong release success.
- Data quality and security: High DQ pass rates, robust lineage, minimal security incidents, and audit readiness.
- Team and customer impact: On-time milestones, clear communication, effective demos, improved satisfaction, and completed certifications/training.
LOCATION AND SCHEDULE:
● Location: Outside US (OUS).
● Schedule: Minimum 6 hours of overlap with US time zones.
Shubham Vishwakarma
Full Stack Developer - Averlon
Similar jobs
Python
React.jsAbout the Role
We are looking for a talented LLM & Backend Engineer to join our AI innovation team at EaseMyTrip.com and help power the next generation of intelligent travel experiences. In this role, you will lead the integration and optimization of Large Language Models (LLMs) to create conversational travel agents that can understand, recommend, and assist travelers across platforms. You will work at the intersection of backend systems, AI models, and natural language understanding, bringing smart automation to every travel interaction.
Key Responsibilities:
- LLM Integration: Deploy and integrate LLMs (e.g., GPT-4, Claude, Mistral) to process natural language queries and deliver personalized travel recommendations.
- Prompt Engineering & RAG: Design optimized prompts and implement Retrieval-Augmented Generation (RAG) workflows to enhance contextual relevance in multi-turn conversations.
- Conversational Flow Design: Build and manage robust conversational workflows capable of handling complex travel scenarios such as booking modifications and cancellations.
- LLM Performance Optimization: Tune models and workflows to balance performance, scalability, latency, and cost across diverse environments.
- Backend Development: Develop scalable, asynchronous backend services using FastAPI or Django, with a focus on secure and efficient API architectures.
- Database & ORM Design: Design and manage data using PostgreSQL or MongoDB, and implement ORM solutions like SQLAlchemy for seamless data interaction.
- Cloud & Serverless Infrastructure: Deploy solutions on AWS, GCP, or Azure using containerized and serverless tools such as Lambda and Cloud Functions.
- Model Fine-Tuning & Evaluation: Fine-tune open-source and proprietary LLMs using techniques like LoRA and PEFT, and evaluate outputs using BLEU, ROUGE, or similar metrics.
- NLP Pipeline Implementation: Develop NLP functionalities including named entity recognition, sentiment analysis, and dialogue state tracking.
- Cross-Functional Collaboration: Work closely with AI researchers, frontend developers, and product teams to ship impactful features rapidly and iteratively.
Preferred Candidate Profile:
- Experience: Minimum 2 years in backend development with at least 1 year of hands-on experience working with LLMs or NLP systems.
- Programming Skills: Proficient in Python with practical exposure to asynchronous programming and frameworks like FastAPI or Django.
- LLM Ecosystem Expertise: Experience with tools and libraries such as LangChain, LlamaIndex, Hugging Face Transformers, and OpenAI/Anthropic APIs.
- Database Knowledge: Strong understanding of relational and NoSQL databases, including schema design and performance optimization.
- Model Engineering: Familiarity with prompt design, LLM fine-tuning (LoRA, PEFT), and evaluation metrics for language models.
- Cloud Deployment: Comfortable working with cloud platforms (AWS/GCP/Azure) and building serverless or containerized deployments.
- NLP Understanding: Solid grasp of NLP concepts including intent detection, dialogue management, and text classification.
- Problem-Solving Mindset: Ability to translate business problems into AI-first solutions with a user-centric approach.
- Team Collaboration: Strong communication skills and a collaborative spirit to work effectively with multidisciplinary teams.
- Curiosity and Drive: Passionate about staying at the forefront of AI and using emerging technologies to build innovative travel experiences.
📢 We're Hiring: Full-Time Recruiter (Remote)
We are looking for a Full-Time Recruiter to join our growing team!
🔹 Experience Required: Minimum 1 year in recruitment
🔹 Work Mode: Remote
🔹 Shift Timings: 10:00 AM – 6:00 PM
🔹 Working Days: Monday to Saturday
Key Responsibilities:
End-to-end recruitment process
Sourcing, screening & shortlisting candidates
Coordinating interviews and follow-ups
Maintaining candidate databases
Collaborating with internal teams to understand hiring needs
Requirements:
Proven experience of at least 1 year in recruitment
Strong communication and interpersonal skills
Self-motivated and able to work independently in a remote setup
If you're passionate about connecting talent with the right opportunity, we'd love to hear from you!
if anyone interested apply through link: https://tiny.cc/NGtalent
GitCandidate should be proficient in
Experience- 3+ years
Plugin development
Working with ACF's to build bespoke build
Knowledge of Root sage
Proficiency in MVC coding
Profieciency in working with Git and CI/CD tools
Third party API integration and Development
Must be Disciplined, Accountable for their Jobs and able to ensure timely delivery
Communication skill is important
Magento 2.0 or shopify could be an additional skill set to be considered.
Should be able to manage team
Immediate Joiner
Woo-commerce customization
Client is looking for a SFDC Developer to join our team of bright thinkers and doers. You will be part of a highly skilled capability group, working for clients across various industry verticals, to develop high-end software products/ services, involving configuration and customization. You should have an exceptional verbal and communication qualities and be able to present and communicate technical designs and solutions to peers. We are on a mission to transform the world, and you will be instrumental in shaping how we do it with your ideas, thoughts, and solutions.
Your Impact:
- Interact clearly with clients and the on-shore and off-shore project teams
- Regular involvement in thought leadership Best Practices development
- Facilitate end to end project design & development while working closely with global client
Your Skills & Experience:
- 4 to 10 years of development experience in SFDC
- Excellent hands-on experience in Salesforce application development including VF, Apex Triggers, Asynchronous Apex
- Deep knowledge of Lightning framework
- Expertise in Business Requirement gathering, Analysis & conceptualizing high-level architectural framework & design
- Experience working with Sales or Service cloud, Community Cloud, Marketing Cloud
- Conceptualize end to end integration projects & knowledge of authentication mechanism
- Experience in REST & SOAP APIs, knowledge of Governor limits involved during Integration
- Working knowledge on continuous integration, working with repositories (e.g. Git)
- Should have experience to design the data flow and work with any ETL or dataloader
- Excellent experience in designing and architecting large scale applications
- Thorough understanding of Solution architecting & Estimation process
- Excellent consulting skills, oral and written communication, presentation, and analytical skills
Set Yourself Apart With:
- Salesforce Certifications
- Knowledge of Heroku, Angular.js and Salesforce Einstein, Salesforce CPQ, CloudCraze B2B
- sIncident and problem management skills
- Ability to provide necessary coaching to bring juniors up to speed on the technology
- Exceptional written skill for solution documentation creation for both technical and non-technical material
- Background in force.com platform and deployment experience in an outsourced service environment
- Articulation skills & Good team player
- Self-starter and self-learner with keen interest to grow
- Process orientation and the ability to define and setup processes
- Mentoring team members
Benefits of Working Here:
- Gender Neutral Policy
- 18 paid holidays throughout the year for NCR/BLR (22 For Mumbai)
- Generous parental leave and new parent transition program
- Flexible work arrangements
- Employee Assistance Programs to help you in wellness and well being
Career level –Senior Associate
Salary Upto 35 LPA.
Location: Bengaluru / Noida / Gurugram , Also allows remote working from any where.
Python
Django
Flask
MongoDB• Design, build, and maintain scalable applications using Python.
• Contribute to the entire implementation process including driving the definition of improvements
based on business need and architectural improvements.
• Act as a subject matter expert for Application Software developers and Engineers.
• Handle server-side code for a production platform and contribute to new features
To be the right fit, you'll need:
• More than 4+ years of experience as a software developer in Python, with knowledge of at least one Python web framework such as Django, Flask, etc.
• Good understanding of common design patterns and architecture principles to design reliable and Scalable applications
• Strong communication skills
• Knowledge of databases line NoSQL or MongoDB
• Good to have AWS and Docker or Web services
• Basic understanding of front-end technologies, such as JavaScript, HTML5, and CSS3
Ruby on Rails (ROR)
RubyIf you were looking for a rocket-ship, this is it!
* 3+ years of experience with web development building good quality production software
* Proficiency in at least one of: Ruby/Rails or Elixir/Phoenix (Good working knowledge of Elixir, OTP or OO programming)
* Gained good knowledge of working with APIs and performance optimisation to identify bottlenecks and bugs, and devise solutions to these problems
* Familiar with data stores like PostgreSQL & Redis
* You write clean code, automate and continuously deploy it in fast development cycles.
* Experience in designing and building scalable and distributed systems
* Experience with CICD using Gitlab or AWS CodePipeline/CodeDeploy (Exposure to AWS is highly desirable)
* You are proactive and pay attention to the security, scalability, performance, availability and usability of systems
.NET
C#Experience: 4- 8 yrs
Notice Period: Immediate or 10 days
Role: Permanent
Communication: Must be good
No. of Positions: 2
Job Type: Full time
Job Location: NSP, Delhi
Desired Candidate Profile:
- 5+ years of rapid web development experience using http://asp.net/" target="_blank">ASP.NET MVC framework 2.0 - 4.5
- Advanced knowledge of Object-Oriented Design and Programming
- Development experience in HTML, XML, CSS
- Experience of developing Web Services (SOAP/ REST/ RESTFUL/ WCF/ WebAPI/ Microservices)
- Database experience with MSSQL/ MySQL/ others
Good to have:
- Front-end development experience with any 1 JS framework (Angular JS/ React JS/ Vue JS)
- jQuery, bootstrap, C#, .NET core
General expectations:
- Good understanding of web application development processes, from the layout/ user interface to relational database structure.
- Ability to understand Architecture and design applications accordingly
- Ability to understand and follow the software development processes
- Experience of managing a team of 2-3 developers
- Experience in handling clients.
- 4+ year of experience working as a Quality Assurance Engineer
- Experience in manual testing
- Experience in automation testing
- Bachelor's Degree
- Experience in Functional and UI testing (mobile, tablet and desktop).
- Experience in developing, documenting and coordinating the deployment of manual and automated tests for complex systems.
Preferred Qualifications :
- Experience in using Python, Selenium and SQL
- Strong project management skills, preferably with software testing or operations.
- Strong focus on customer experience, curiosity about how things fit together and a passion for driving improvements to raise the overall quality level of our software and operations environments.
- Creativity and initiative to improve the customer experience and advertising operations processes.
- Excel in communicating with technical and business leaders in advertising sales, campaign management, design, operations, developers, and technical leaders, even if they are remote.
- Ability to deal with ambiguity in a fast-paced environment where every change affects the experience of millions of customers.
- Experience working with global teams.
Purpose:
We are looking for an analytical and perceptive Brand Manager, fluent in English & a skilled communicator.
Role and Responsibilities:
- Conduct consumer and market research
- Identify how our brand is currently positioned in the market
- Design a research-based brand strategy
- Develop and execute marketing campaigns aimed at communicating our brand message
- Communicate our brand personality internally and align company around foundational ideas
- Lead marketing team members through campaigns
- Measure and report on success of marketing campaigns
- Anticipate consumer trends and keep brand up to date
Qualifications and Education Requirements:
Bachelors is a must. PG Preferred.
Preferred Skills
- 1 – 2 years’ experience in Beauty and Healthcare
- Proficiency in MS Excel, PowerPoint, and Word
- Experience working with popular social media advertising platforms found in Facebook, Twitter, and LinkedIn in particular
- Experience working with popular social media monitoring tools (Google, Radian 6, Twitter Search, Social Mention, Traackr, etc)
- Experience with website analysis using a variety of analytics tools including Google Analytics as well as internal reporting tools.
- Excellent presentation skills
- Working under pressure
- Being passionate and energetic about the brand
- Organizational and methodical skills are also a bonus
PHP
Angular (2+)
NodeJS (Node.js)MongoDB
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon