
Lead II - Data Engineering
at Global Digital Transformation Solutions Provider
SENIOR DATA ENGINEER:
ROLE SUMMARY:
Own the design and delivery of petabyte-scale data platforms and pipelines across AWS and modern Lakehouse stacks. You’ll architect, code, test, optimize, and operate ingestion, transformation, storage, and serving layers. This role requires autonomy, strong engineering judgment, and partnership with project managers, infrastructure teams, testers, and customer architects to land secure, cost-efficient, and high-performing solutions.
RESPONSIBILITIES:
- Architecture and design: Create HLD/LLD/SAD, source–target mappings, data contracts, and optimal designs aligned to requirements.
- Pipeline development: Build and test robust ETL/ELT for batch, micro-batch, and streaming across RDBMS, flat files, APIs, and event sources.
- Performance and cost tuning: Profile and optimize jobs, right-size infrastructure, and model license/compute/storage costs.
- Data modeling and storage: Design schemas and SCD strategies; manage relational, NoSQL, data lakes, Delta Lakes, and Lakehouse tables.
- DevOps and release: Establish coding standards, templates, CI/CD, configuration management, and monitored release processes.
- Quality and reliability: Define DQ rules and lineage; implement SLA tracking, failure detection, RCA, and proactive defect mitigation.
- Security and governance: Enforce IAM best practices, retention, audit/compliance; implement PII detection and masking.
- Orchestration: Schedule and govern pipelines with Airflow and serverless event-driven patterns.
- Stakeholder collaboration: Clarify requirements, present design options, conduct demos, and finalize architectures with customer teams.
- Leadership: Mentor engineers, set FAST goals, drive upskilling and certifications, and support module delivery and sprint planning.
REQUIRED QUALIFICATIONS:
- Experience: 15+ years designing distributed systems at petabyte scale; 10+ years building data lakes and multi-source ingestion.
- Cloud (AWS): IAM, VPC, EC2, EKS/ECS, S3, RDS, DMS, Lambda, CloudWatch, CloudFormation, CloudTrail.
- Programming: Python (preferred), PySpark, SQL for analytics, window functions, and performance tuning.
- ETL tools: AWS Glue, Informatica, Databricks, GCP DataProc; orchestration with Airflow.
- Lakehouse/warehousing: Snowflake, BigQuery, Delta Lake/Lakehouse; schema design, partitioning, clustering, performance optimization.
- DevOps/IaC: Terraform with 15+ years of practice; CI/CD (GitHub Actions, Jenkins) with 10+ years; config governance and release management.
- Serverless and events: Design event-driven distributed systems on AWS.
- NoSQL: 2–3 years with DocumentDB including data modeling and performance considerations.
- AI services: AWS Entity Resolution, AWS Comprehend; run custom LLMs on Amazon SageMaker; use LLMs for PII classification.
NICE-TO-HAVE QUALIFICATIONS:
- Data governance automation: 10+ years defining audit, compliance, retention standards and automating governance workflows.
- Table and file formats: Apache Parquet; Apache Iceberg as analytical table format.
- Advanced LLM workflows: RAG and agentic patterns over proprietary data; re-ranking with index/vector store results.
- Multi-cloud exposure: Azure ADF/ADLS, GCP Dataflow/DataProc; FinOps practices for cross-cloud cost control.
OUTCOMES AND MEASURES:
- Engineering excellence: Adherence to processes, standards, and SLAs; reduced defects and non-compliance; fewer recurring issues.
- Efficiency: Faster run times and lower resource consumption with documented cost models and performance baselines.
- Operational reliability: Faster detection, response, and resolution of failures; quick turnaround on production bugs; strong release success.
- Data quality and security: High DQ pass rates, robust lineage, minimal security incidents, and audit readiness.
- Team and customer impact: On-time milestones, clear communication, effective demos, improved satisfaction, and completed certifications/training.
LOCATION AND SCHEDULE:
● Location: Outside US (OUS).
● Schedule: Minimum 6 hours of overlap with US time zones.

Similar jobs
Summary/Objective:
We are seeking a highly skilled Graphic Designer to join our dynamic team at Avalon Solutions, preferably with expertise in the fashion & luxury sector. The ideal candidate will proficiently utilize AI tools for creative designs and have a strong skill set for creating compelling visuals for social media and digital platforms.
Responsibilities/Duties:
1. Design Creation:
- Create innovative, high-end designs for various luxury products, tailored for social media graphics and website elements, good to have experience in jewelry industry.
- Collaborate with marketing and other teams to grasp project requirements and objectives.
- Incorporate cutting-edge design techniques, including AI tools, to produce innovative visuals.
2. Brand Consistency:
· Create engaging content for social media platforms and digital marketing campaigns.
· Ensure designs are optimized for different platforms and adhere to brand guidelines.
· Work closely with the marketing team to contribute to the evolution of the brand identity.
3. Software Proficiency:
· Proficiency in graphic design software such as Adobe Photoshop, Illustrator, InDesign, and experience with AI design tools.
· Stay updated on industry trends and design tools to enhance creativity and efficiency.
· Excellent skills in color theory, typography, and layout design.
4. Feedback Incorporation:
· Receive and incorporate feedback from stakeholders into design iterations.
· Present design concepts and ideas to team members for review and approval.
5. Project Management:
· Manage multiple design projects simultaneously and meet deadlines.
· Collaborate with other designers and cross-functional teams to ensure project success.
Qualifications/Requirements:
Education:
· Bachelor’s degree in Graphic Design, Visual Arts, or a related field.
Experience:
· 1 to 2 years of professional graphic design experience.
· Experience in the e-commerce, jewelry or luxury industry is ideal.
· Good to have experience in marketing or advertising agency.
Skills:
· Strong creative and conceptual thinking.
· Excellent communication and collaboration skills.
· Ability to work collaboratively and independently.
· Attention to detail and the ability to work independently.
- To be successful as a Telemarketer you should have a positive attitude and excellent telephone etiquette.
- The ideal Telemarketer will remain calm and professional under pressure and always treat clients with respect.
- Contact potential clients telephonically.
- Read the prepared script when pitching the company's products and services.
- Provide any information that the client requests.
Type, Location: Remote, India
Desired Experience: 2+ years
Roles and Responsibilities :
- Hands-on GoLang development
- Go Lang developers perform tasks related to the design, development, modification, and administration of software systems and applications.
- Comfortable with algorithm design, scripting, and unit testing.
- Demonstrated skills in debugging, design patterns, and enterprise resource planning.
- Is skilled at problem-solving.
Must have skills :
● You must have 2+ years Golang experience.
● You must have (React.js or Node.js or Python or Java )experience.
● You must have any Frontent or Backend Technology with Golang
Your key responsibilities
- Create and maintain optimal data pipeline architecture. Should have experience in building batch/real-time ETL Data Pipelines. Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources
- The individual will be responsible for solution design, integration, data sourcing, transformation, database design and implementation of complex data warehousing solutions.
- Responsible for development, support, maintenance, and implementation of a complex project module
- Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
- Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
- Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
- Continually improve ongoing reporting and analysis processes, automating or simplifying self-service support.
- complete reporting solutions.
- Preparation of HLD about architecture of the application and high level design.
- Preparation of LLD about job design, job description and in detail information of the jobs.
- Preparation of Unit Test cases and execution of the same.
- Provide technical guidance and mentoring to application development teams throughout all the phases of the software development life cycle
Skills and attributes for success
- Strong experience in SQL. Proficient in writing performant SQL working with large data volumes. Proficiency in writing and debugging complex SQLs.
- Strong experience in database system Microsoft Azure. Experienced in Azure Data Factory.
- Strong in Data Warehousing concepts. Experience with large-scale data warehousing architecture and data modelling.
- Should have enough experience to work on Power Shell Scripting
- Able to guide the team through the development, testing and implementation stages and review the completed work effectively
- Able to make quick decisions and solve technical problems to provide an efficient environment for project implementation
- Primary owner of delivery, timelines. Review code was written by other engineers.
- Maintain highest levels of development practices including technical design, solution development, systems configuration, test documentation/execution, issue identification and resolution, writing clean, modular and self-sustaining code, with repeatable quality and predictability
- Must have understanding of business intelligence development in the IT industry
- Outstanding written and verbal communication skills
- Should be adept in SDLC process - requirement analysis, time estimation, design, development, testing and maintenance
- Hands-on experience in installing, configuring, operating, and monitoring CI/CD pipeline tools
- Should be able to orchestrate and automate pipeline
- Good to have : Knowledge of distributed systems such as Hadoop, Hive, Spark
To qualify for the role, you must have
- Bachelor's Degree in Computer Science, Economics, Engineering, IT, Mathematics, or related field preferred
- More than 6 years of experience in ETL development projects
- Proven experience in delivering effective technical ETL strategies
- Microsoft Azure project experience
- Technologies: ETL- ADF, SQL, Azure components (must-have), Python (nice to have)
Ideally, you’ll also have
About the Company
Peacock Engineering Ltd is a Gold-accredited IBM Premier Business Partner which has amassed over 300 person years of experience implementing business critical EAM (Enterprise Asset Management) solutions across a range of industries such as oil & gas, pharmaceuticals, utilities, facilities management, transport, and power generation.
Peacock Engineering Ltd specialise in providing consultancy services and support for the IBM Maximo EAM software product and maintain a pool of highly experienced and capable consultants fully conversant with IBM Maximo and its functionality, capabilities, and opportunities for customisation to meet business need.
Main Purpose:
Peacock Engineering’s Technical Services team is now looking for an experienced UI / Front End Developer who is proficient with React.js (16.8+) to join our international team of developers delivering innovative solutions to our major UK-based customers.
Your primary focus will be working on new user interface components which are modern, secure, performant, and easy to maintain - following well-known React.js workflows and recognised best practices.
You will coordinate with the rest of our multi-disciplined team working together on different layers of the solution architecture. A commitment to collaborative problem solving, sophisticated design, and delivering a high-quality product is essential.
Specific Responsibilities:
- Developing new user-facing features for our clients using React.js
- Translating functional requirements (User Stories/Tasks) and wireframes into high quality code with tests
- Working with architects, developers, and QA engineers to ensure that your work is testable, meets industry security standards and is written to deliver good performance/scalability.
- Perform application and solution development to meet project requirements.
- Develop and document detailed technical designs to meet business requirements.
- Manage multiple technical environments and support the development and testing processes.
- Identify areas of customization and optimization and provide solutions that meet the business requirements.
Skills & Personal Qualities – Required:
Experience working with the IBM Maximo software product within the following capacities:
- Tech. in Computer Science, Engineering or Business-related field and/or equivalent work experience.
- Thorough understanding of React.js and its core principles
- Minimum five (5) years of work experience in React application development.
- Strong proficiency in JavaScript, including DOM manipulation and the JavaScript object model
- Demonstrable expertise in software development in an Agile setting
- Ability to deliver well-tested code consistently in an Agile, CI/CD environment
- Experience with JavaScript Testing frameworks and principles (Jest preferable)
- Familiarity with newer specifications of ECMAScript
- Familiarity with RESTful APIs
- Knowledge of modern authentication/authorization mechanisms
- Familiarity with modern build pipelines and tools (Azure DevOps preferable)
- Experience with common front-end development tools such as Babel, Webpack/Parcel, NPM/Yarn, etc.
- Familiarity with Git
- Good time-management skills
- Great interpersonal and communication skills
- Good spoken & written English
Skills & Personal Qualities – Desired:
- To bring industry knowledge world class capabilities innovation and cutting-edge technology to our clients in the Resources industry to deliver business value.
- To work with leading Resources client’s major customers and suppliers to develop and execute projects and reliability strategies.
- To harness extensive knowledge combined with an integrated suite of methods people and assets to deliver sustainable long-term solution.
- IBM MobileFirst certification
- JAVA/ SQL Skills
Person Specification/Attributes:
- Professional and committed, with a disciplined approach to work.
- Motivated and driven by finding and providing solutions to problems.
- Polite, tactful, helpful, empathic nature, able to deliver to the needs of customers.
- Has respect for others and their views.
- Technology minded and focused, enthusiastic about technologies.
- Analytical, able to raise from the detail and see the bigger picture.
- Dedicated to continually updating and upgrading own knowledge.
- Carries a mind-set of continuous improvement, constantly looking for better and more efficient ways of doing things.
- Values quality at the centre of all things in work.
Due to considerable amounts of virtual working and interaction with colleagues and customers in different physical locations internationally, it is essential that the successful applicant has the drive and ethic to succeed working in small teams physically but in larger efforts virtually. Self-drive to communicate constantly using web collaboration and video conferencing is essential.
As an employee, you will be encouraged to continually develop your capability & attain certifications to reflect your growth as an individual.
Our client is more than 2 decades old NBFC registered with the RBI. The company was set up with an aim to empower rural entrepreneurs, SMEs, and small institutions by micro-financing. The company has come a long way since its inception in 1992 and has evolved with time with the introduction of its App in the small loans sector. At present, the company has more than 5000 employees and has serviced millions of borrowers to accomplish their dreams.
The group has diversified into the education segment and is running two schools. The schools are part of one of the largest private school chains in India. The schools have a flourishing family of 350 teachers and 6500 students. The leadership team at the helm of the company has demonstrable experience in financial services and has built the company by upholding the trust of its customers.
What you will do:
- Maintaining and reviewing proper accounting records, preparing the financial statements and also managing the books of accounts of the company
- Participating in various activities including but not limited to internal audits, budget planning and preparation, various financial transactions etc
- Recommending and implementing accounting systems and practices by being updated with the current practices and procedures
- Handling financial discrepancies, rectifying the same and also reporting it to the management in a timely manner
- Offering expert financial advice to the management in case of any concerns or improvements to be made with regards to any financial related aspect of the company
- Working closely with various external stakeholders and also ensuring compliance while handling bank related activities, company law and also rating agencies
- Providing assistance with tax planning and also managing the Tax and GST related compliances
- Ensuring compliance of rules, laws & regulations while handling and managing the various activities under the spectrum of accountancy
Desired Candidate Profile
What you need to have:- Qualified Chartered Accountant with minimum 5 years of banking work experience
- Immediate availability for joining preferred
- Expertise in Excel
- An eye for detail
Are you inspired by innovations?
Is problem-solving through teamwork in your DNA?
Do you have a never-ending passion for Robotics?
If your answer is 'YES' to any of the above questions, then you’ll fit right in here at ANSCER Robotics.
Why? Imagine a world where there is harmonious coexistence between robots and humans; to challenge this status quo, we apply cutting-edge technologies in robotics and software to solve real-world scenarios whilst creating a better world and elevating the human experience.
What do we do?
Design and build modular robotic systems that can be integrated across platforms and industries to work in harsh environments, be it land, air, water or space.
We call this "ANSCER ENGINE (AE)", which supports industry-leading performing chips to process all types of workload. It is packed with robust features like power management, I/O management, a cooling system with inbuilt gold-standard IMU and controllers.
All this incredible efficiency has been designed specifically for robots! With a heart and brain fused in a box, we offer a perfect platform for the development of industrial-use services robotic applications such as autonomous mobile robots (AMR) and autonomous mobile industrial robots (AMIR). Along with our software solution, we enable any developer or company to have API access to our computer vision, planning, telematics and security to build any type of robot in a brief time.
Who are we? A lean team where most of us are self-taught designers, coders, product developers, exploring the field of mechatronics and IoT. With a highly competitive market and limited time, we, as a bootstrapped company, are working with finite options and the choices we make are risky yet highly rewarding.
We are a growing, dynamic company with extensive plans for the future ― and our people! We harness our team's potential and intend to create a plethora of opportunities for every striving member. We’re passionate about our work, we believe there is always a better way and we’re in this for the long haul.
How far have we come? Incorporated in the month of July 2020, in less than a year, we translated our revolutionary idea and built a world-class robotics system that is made in India and produced more than 10 patentable technologies. On the brink of the COVID-19 pandemic, we built a game-changing solution that significantly eliminates the use of chemical disinfectants using our AE technology and won the "Hack For Cause" organized by the government of India, hack for Italy, the World Bank, Robotex and the European Union.
As a member of our Software Engineering Group, we look first and foremost for people who are passionate about solving business problems through innovation and engineering practices.
You'll be required to apply your depth of knowledge and expertise to all aspects of the software development lifecycle, as well as partner continuously with your many stakeholders on a daily basis to stay focused on common goals.
We’re looking for a motivated Full-Stack Web Developer who wants to be a big part of a small team in a stimulating start-up environment!
You’ll be leading the cloud team and have the opportunity to learn, design, build our cloud infrastructure and work on amazing products for product and external client projects.
This position offers opportunities for growth, creativity, and fun in a unique environment where your work will make an immediate impact!
What will you be doing?
- Design, develop, and maintain a range of web apps using the language of your choice for new and existing client projects
- Develop user-friendly and intuitive front-end interfaces using HTML/CSS, JavaScript, and React
- Provide technical support for ad hoc initiatives across all departments (e.g. automation, reporting, data analysis, marketing analytics, etc).
- Contribute product and feature ideas that solve problems for our clients, users, and internal team
- Work independently and exercise your own creative judgment to achieve high-level project goals
- Write clean, reusable, and well-documented code while keeping technical debt to a minimum
What we expect you to know?
- Back-end: Python, JavaScript, Postgres, GraphQL, Wagtail CMS, GraphCMS
- Front-end: HTML/CSS/Bootstrap, JavaScript (ES6), React
- Other: Git, AWS EC2/RDS, Docker, Webpack
- Excellent knowledge of Java technologies including core Java and SpringBoot
- Experience developing MicroServices
- Strong DB knowledge
- Well versed with cloud-native principles (Cloud Foundry or AWS)
- Front end development skills using Angular/React
- Working proficiency in developmental toolsets
- Knowledge of industry-wide technology trends and best practices
- Ability to work in large, collaborative teams to achieve organizational goals
- Passionate about building an innovative culture
RESPONSIBILITIES:
- Security: You must possess a base knowledge of security and the techniques involved for better performing at the outcome of such issues.
- Soft Skills: Knowing technical skills won't benefit the team, discipline, and the ability to accept criticism all add up to the soft skills of a developer.
- Web Architecture: Will be responsible for web architecture, code structure, data structure, file separation, and the location of computational tasks to help other developers develop applications and also be accountable for planning of the architecture to avoid unnecessary confusion related to the development cycle.
- Debugging: Bugs are relatively common in the development process, you will be responsible for setting up a system for developers to ensure that there are no bugs, and testing the code for bugs marks up as an essential skill.
- Building and Automation Tools: Web performance refers to the amount of time a web app takes to load. If performance time seems to be an issue, it is better to scale the images and omit irrelevant characters. Currently, carrying out this process can be time-consuming, you will be responsible for building and automation tools to come to the team's rescue.
- Database/Web Storage: Need to be an expert in relational databases, NoSQL databases, and memory storage with abilities to design and manipulate complex database queries.
- Developers must be aware of basic design techniques. It is crucial for designing neat and user-friendly websites that appeal to users; they must have fundamental design principles that include UI/UX design and knowing rapid prototype techniques using tools.
QUALIFICATIONS ( Must have skills):
- JavaScript (preferred MERN STACK)
- jQuery
- NPM
- Python
- HTTPS and REST
- AWS / GCP / Azure
- Know how to create your own AI solutions using existing open-source projects
- Micro Architecture
- Must have ability to handle, clean, visualize and analyze big data like (NumPy, Pandas, Sklearn, Matplotlib, Seaborn)
Bonus:
Mechatronics background with a bachelors degree or Ph.D. studentBeing aware of design techniques It is crucial for designing neat and user-friendly websites that appeal to users; with strong knowledge of fundamental design principles that include UI/UX design and knowing rapid prototype techniques using 3rd party tools.
NICE TO HAVE:
Docker, proficient in JS frontend frameworks, Browser Developer Tools, postman, C++, and DevOps.• Development and unit testing of web application including front-end (SPA) and back-end (microservices),
maintenance & support of the same
• Provide assistance to Project Managers and Technical Leads in the planning of projects (eg provision of
estimates, risk analysis, requirements analysis, technical options)
• Software Design
• Involvement in full life cycle of projects (including requirement analysis and system design, development
and support if required)
• Support and work collaboratively with teams across areas of design, development, quality assurance and
operations
• Commit your knowledge and experience into team success
• Be prepared to travel (when needed) to work with other offices
• Attend meetings if required to discuss and demonstrate solutions at both technical and business level
• To be a single person responsible for overall technical health and Tech Ownership
• To be a knowledge keeper for product, its architecture, design and implementation details
• Provide overall mentorship, coaching and on-demand trainings to improve and unify development style
REQUIRED SKILLS AND EXPERIENCE
• 7+ years in application development
• Understanding the sense of OOP/OOD/DDD
• Using of OOP and patterns
• ASP.NET MVC experience
• Database experience (MS SQL, MongoDB, ElasticSearch or similar) and ORM technologies (LINQ, EF or similar)
• MSBuild
• Performance optimization
• Security design and implementation
• API design and development including RPC-like / REST
• Distributed message based application design and implementation
• TDD practices
• CI/CD practices
• HTML5/CSS3/JavaScript/TypeScript and AJAX experience
• SPA (Single Page Application) design and implementation (Angular, React, Vue.js or similar)
DESIRABLE SKILLS AND EXPERIENCE
• CQRS and Event Sourcing pattern Experience
• AWS-based development
• Serverless
• Docker
• .Net Core
• MongoDB
• ElasticSearch
• Knockout.js
• Vue.js
• Design and usability skills are a plus
• Multi-tenant application development experience is a huge plus
PERSONAL SKILLS
• Clever personality
• Strong spirit skills set: conflict resistant, self -motivated, result-oriented, responsible, honest, “open”,
courageous











