Lead II - Data Engineering
at Global Digital Transformation Solutions Provider
Amazon Web Services (AWS)
PythonSENIOR DATA ENGINEER:
ROLE SUMMARY:
Own the design and delivery of petabyte-scale data platforms and pipelines across AWS and modern Lakehouse stacks. You’ll architect, code, test, optimize, and operate ingestion, transformation, storage, and serving layers. This role requires autonomy, strong engineering judgment, and partnership with project managers, infrastructure teams, testers, and customer architects to land secure, cost-efficient, and high-performing solutions.
RESPONSIBILITIES:
- Architecture and design: Create HLD/LLD/SAD, source–target mappings, data contracts, and optimal designs aligned to requirements.
- Pipeline development: Build and test robust ETL/ELT for batch, micro-batch, and streaming across RDBMS, flat files, APIs, and event sources.
- Performance and cost tuning: Profile and optimize jobs, right-size infrastructure, and model license/compute/storage costs.
- Data modeling and storage: Design schemas and SCD strategies; manage relational, NoSQL, data lakes, Delta Lakes, and Lakehouse tables.
- DevOps and release: Establish coding standards, templates, CI/CD, configuration management, and monitored release processes.
- Quality and reliability: Define DQ rules and lineage; implement SLA tracking, failure detection, RCA, and proactive defect mitigation.
- Security and governance: Enforce IAM best practices, retention, audit/compliance; implement PII detection and masking.
- Orchestration: Schedule and govern pipelines with Airflow and serverless event-driven patterns.
- Stakeholder collaboration: Clarify requirements, present design options, conduct demos, and finalize architectures with customer teams.
- Leadership: Mentor engineers, set FAST goals, drive upskilling and certifications, and support module delivery and sprint planning.
REQUIRED QUALIFICATIONS:
- Experience: 15+ years designing distributed systems at petabyte scale; 10+ years building data lakes and multi-source ingestion.
- Cloud (AWS): IAM, VPC, EC2, EKS/ECS, S3, RDS, DMS, Lambda, CloudWatch, CloudFormation, CloudTrail.
- Programming: Python (preferred), PySpark, SQL for analytics, window functions, and performance tuning.
- ETL tools: AWS Glue, Informatica, Databricks, GCP DataProc; orchestration with Airflow.
- Lakehouse/warehousing: Snowflake, BigQuery, Delta Lake/Lakehouse; schema design, partitioning, clustering, performance optimization.
- DevOps/IaC: Terraform with 15+ years of practice; CI/CD (GitHub Actions, Jenkins) with 10+ years; config governance and release management.
- Serverless and events: Design event-driven distributed systems on AWS.
- NoSQL: 2–3 years with DocumentDB including data modeling and performance considerations.
- AI services: AWS Entity Resolution, AWS Comprehend; run custom LLMs on Amazon SageMaker; use LLMs for PII classification.
NICE-TO-HAVE QUALIFICATIONS:
- Data governance automation: 10+ years defining audit, compliance, retention standards and automating governance workflows.
- Table and file formats: Apache Parquet; Apache Iceberg as analytical table format.
- Advanced LLM workflows: RAG and agentic patterns over proprietary data; re-ranking with index/vector store results.
- Multi-cloud exposure: Azure ADF/ADLS, GCP Dataflow/DataProc; FinOps practices for cross-cloud cost control.
OUTCOMES AND MEASURES:
- Engineering excellence: Adherence to processes, standards, and SLAs; reduced defects and non-compliance; fewer recurring issues.
- Efficiency: Faster run times and lower resource consumption with documented cost models and performance baselines.
- Operational reliability: Faster detection, response, and resolution of failures; quick turnaround on production bugs; strong release success.
- Data quality and security: High DQ pass rates, robust lineage, minimal security incidents, and audit readiness.
- Team and customer impact: On-time milestones, clear communication, effective demos, improved satisfaction, and completed certifications/training.
LOCATION AND SCHEDULE:
● Location: Outside US (OUS).
● Schedule: Minimum 6 hours of overlap with US time zones.
Shubham Vishwakarma
Full Stack Developer - Averlon
Similar jobs
About Wekan Enterprise Solutions
Wekan Enterprise Solutions is a leading Technology Consulting company and a strategic investment partner of MongoDB. We help companies drive innovation in the cloud by adopting modern technology solutions that help them achieve their performance and availability requirements. With strong capabilities around Mobile, IOT and Cloud environments, we have an extensive track record helping Fortune 500 companies modernize their most critical legacy and on-premise applications, migrating them to the cloud and leveraging the most cutting-edge technologies.
Job Description
We are seeking an experienced Project Manager to lead and manage the successful delivery of client projects within our services organization. The Project Manager will oversee all phases of the project lifecycle, ensuring that each project is delivered on time, within scope, and budget while meeting the company’s quality standards. This role involves working closely with clients, stakeholders, and cross-functional teams to deliver technology solutions and business outcomes tailored to the needs of each client.
Key Responsibilities:------
End-to-End Project Management: Lead and manage multiple client projects, from initiation to completion, ensuring timely delivery and adherence to project objectives.
Client Engagement: Serve as the primary point of contact for clients, fostering strong relationships and ensuring their needs and expectations are met throughout the project.
Team Leadership: Coordinate and collaborate with cross-functional teams (e.g., engineering, design, operations) to ensure effective execution of project tasks and milestones.
Scope and Change Management: Define project scope and objectives, ensuring scope changes are carefully managed and communicated to all stakeholders.
Budget and Resource Management: Develop and manage project budgets, allocate resources efficiently, and ensure the project is completed within financial constraints.
Risk Management: Identify potential project risks and issues, develop mitigation plans, and address challenges proactively to keep the project on track.
Quality Assurance: Ensure that all deliverables meet the quality standards and are aligned with the client’s requirements.
Reporting and Documentation: Provide regular updates to stakeholders and senior management on project status, risks, and outcomes. Maintain thorough project documentation for future reference.
Requirements:------
Bachelor’s degree in Computer Science, Business, or related field (Master’s degree or PMPcertification is a plus).
Overall 8+ years of experience managing technology or software development projects, preferably within a services or consulting organization.
Proven ability to deliver projects on time and within budget, with a strong track record in managing cross-functional teams.
Strong understanding of project management methodologies (Agile, Waterfall, or Hybrid).
Excellent leadership, communication, and negotiation skills.
Ability to manage multiple projects simultaneously, balancing priorities and deadlines.
Proficiency in project management tools (e.g., Jira, MS Project, Trello).
Preferred Qualifications:--
Experience in delivering digital transformation, cloud migrations, or application modernization projects.
Familiarity with software development processes and methodologies. Strong client-facing and stakeholder management skills.
What WeOffer:--
Competitive salary and benefits package. Opportunities for growth and professional development. A collaborative, innovative work environment.
Location: Chennai or Bangalore
Employment Type: Full-time
Job Title: QA Tester (Manual Testing)
Department: Technology
Location: Remote
Company: Mercer Talent Enterprise
Company Overview:
Mercer Talent Enterprise is a leading provider of talent management solutions, dedicated to helping organizations optimize their workforce. We foster a collaborative and innovative work environment where our team members can thrive and contribute to our mission of enhancing talent strategies for our clients.
Position Overview:
We are looking for a detail-oriented QA Tester to join our Lighthouse Tech Team. In this role, you will be responsible for performing manual testing of our software applications to ensure they meet the highest quality standards. You will work closely with developers and product managers to identify testing requirements and ensure that all features function as intended.
Key Responsibilities:
- Execute manual test cases and document results.
- Identify, report, and track defects in a timely manner.
- Collaborate with the development team to understand application functionality and testing requirements.
- Participate in test planning and design activities.
- Conduct regression testing and ensure that existing functionality is not affected by new changes.
- Provide feedback on usability and user experience.
- Assist in the development of testing documentation and processes.
Qualifications:
- Bachelor’s degree in Computer Science, Information Technology, or a related field.
- 1+ years of experience in manual software testing.
- Strong understanding of software testing methodologies and best practices.
- Experience with defect tracking tools (e.g., Azure,JIRA, Bugzilla).
- Excellent attention to detail and analytical skills.
- Strong communication and teamwork abilities.
Benefits:
- Competitive salary and performance-based bonuses.
- Professional development opportunities.
Location - Delhi NCR
Job Responsibilities:
● Responsible for leading the entire city.
● Manage the P&L and handle both revenue & profit targets
● Create a network of real estate corporate clients and channel partners
● Build ties and close deals with developers and channel partners in your region
● Ensure service delivery standards are being met
● Initiate creative local marketing strategies and partner growth campaigns
● Manage deployment and quality of channel partners
● Handle local banking relationships to ensure great service to the customer
● Drive PR in your region & our presence at local events
● Manage local regulatory concerns and local operation end-to-end
● Communicate and close gaps in coordination with Product and Central teams
● Help scale our other cities through developing and sharing best practices
Job Requirements:
● Highly analytical and customer-focused individual. Preferably from real estate background
● Min. 5+ years of operations management, consulting, investment banking or marketing
● Data-driven decision mentality and sound business judgement through strong analytical thinking
● Creative solutions driven mindset, with a get things done attitude
● Relevant experience in consumer service marketing is helpful
● Stellar networking skills and the ability to make smart partnerships happen.
PHP
Javascript
React.js
Angular (2+)
AngularJS (1.x)Reverate Tech is a product and service-based start-up, working with International Clients. Our services include Data Engineering, Web Development, BI/Data Warehousing, Enterprise Application Implementation (ERP/CRM), and NetSuite. Our product portfolio has business apps in the domain of ERP, Auto Service, and Personal Safety.
This is an exciting opportunity to work as a full-stack developer for our client SellerX.
The ideal candidate will efficiently and quickly write code in a timely and scalable way in order to improve the code-base of the company's products in meaningful ways. This candidate will be able to test the code and make adjustments where necessary.
Your background:
- 3+ years of experience working with PHP (preferably with Symfony)
- Understanding OOP principles & familiarity with best design practices
- Experience with JavaScript, Angular
- Technically proficient in SQL (preferably MySQL or MariaDB)
- Experience with NoSQL database
- Experience with Docker
We would consider it a plus if:
- You have some experience with Python or are willing to learn
- You have basic knowledge of message brokers such as RabbitMQ
- You have some experience working with AWS: RDS, S3, EC2, and Lambda functions
- Experience with search engines like Elastic Search or Solr
Benefits:
- 100% remote-working;
- Flexible working hours;
- Development of your personal strengths in a dynamic environment;
- An attractive and varied job with a high level of personal responsibility;
- A collegial togetherness and a modern management style/startup;
About our client
SellerX buys and builds Amazon businesses, helping entrepreneurs realize the next stage of their businesses and their lives. SellerX is the 3rd fastest-growing startup in Europe. Already a unicorn (1 billion euros in evaluation), SellerX plans to be a Decacorn in the coming 2-3 years.
- Interested? Join us and start your learning and growth journey.
Responsibilities
Meet and exceed sales targets
Maintain data on excel and successfully create a business from new and existing customer accounts
Build rapport and establish long-term relationships with clients
Qualifications
Good English speaking skills
Strong verbal communication skills
Who has 6 months and less than 6 months of experience in sales
Salary
2 to 3 LPA
Time and Location ( Work from Office)
The evening shift starts from 8 PM to 5 AM at East Delhi
HTML/CSSPosition Overview
Oracle Apex Engineer with good experience building reports using the latest versions of Oracle Apex
and experience in Apex Upgrade. Should have a good working knowledge of Oracle
Applications(R12).
Skills
1-2 end to end implementation/development project
Strong detail, quality, and solution orientation
5+ years of experience designing and implementing technical solutions that are aligned with
business strategy
5 years of applications development experience with Oracle APEX, Oracle SQL, PL/SQL
5+ years of Oracle APEX experience
5+ years experience in Oracle Databases
5+ years experience using PL/SQL
5+ years of JavaScript, HTML, CSS, and REST services
Oracle APEX 4.2 experience is a must and ability to Upgrade to higher versions
Ability to work on SQL performance issues
Ability to think critically and solve complex issues
Ability to work independently, while engaging the customer and providing information to the team
Strong ability to communicate both verbally and in writing with internal and external teams
Ability to prioritize across multiple projects and meet deadlines
Experience adapting in a dynamic work environment
Experience working in a customer-focused environment
Ability to troubleshooting issue
Proficiency in analysis, design, development, testing, implementation, and maintenance of
applications in Oracle Application Express (APEX).
Excellent conceptual knowledge of Oracle 11g.
Rich experience in writing SQL queries, Views, Materialized views, PL/SQL procedures, functions,
packages, triggers, cursors, collections, Ref cursor, cursor variables, System reference cursor,
Dynamic SQL.
Good knowledge of using PL/SQL Wrappers to protect the PL/SQL procedures and packages.
Docker
KubernetesPythonRole & responsibilities:
- Developing ETL pipelines for data replication
- Analyze, query and manipulate data according to defined business rules and procedures
- Manage very large-scale data from a multitude of sources into appropriate sets for research and development for data science and analysts across the company
- Convert prototypes into production data engineering solutions through rigorous software engineering practices and modern deployment pipelines
- Resolve internal and external data exceptions in timely and accurate manner
- Improve multi-environment data flow quality, security, and performance
Skills & qualifications:
- Must have experience with:
- virtualization, containers, and orchestration (Docker, Kubernetes)
- creating log ingestion pipelines (Apache Beam) both batch and streaming processing (Pub/Sub, Kafka)
- workflow orchestration tools (Argo, Airflow)
- supporting machine learning models in production
- Have a desire to continually keep up with advancements in data engineering practices
- Strong Python programming and exploratory data analysis skills
- Ability to work independently and with team members from different backgrounds
- At least a bachelor's degree in an analytical or technical field. This could be applied mathematics, statistics, computer science, operations research, economics, etc. Higher education is welcome and encouraged.
- 3+ years of work in software/data engineering.
- Superior interpersonal, independent judgment, complex problem-solving skills
- Global orientation, experience working across countries, regions and time zones
Kotlin
Android Development
JavaPHP
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon