Lead II - Data Engineering
at Global Digital Transformation Solutions Provider
Amazon Web Services (AWS)
PythonSENIOR DATA ENGINEER:
ROLE SUMMARY:
Own the design and delivery of petabyte-scale data platforms and pipelines across AWS and modern Lakehouse stacks. You’ll architect, code, test, optimize, and operate ingestion, transformation, storage, and serving layers. This role requires autonomy, strong engineering judgment, and partnership with project managers, infrastructure teams, testers, and customer architects to land secure, cost-efficient, and high-performing solutions.
RESPONSIBILITIES:
- Architecture and design: Create HLD/LLD/SAD, source–target mappings, data contracts, and optimal designs aligned to requirements.
- Pipeline development: Build and test robust ETL/ELT for batch, micro-batch, and streaming across RDBMS, flat files, APIs, and event sources.
- Performance and cost tuning: Profile and optimize jobs, right-size infrastructure, and model license/compute/storage costs.
- Data modeling and storage: Design schemas and SCD strategies; manage relational, NoSQL, data lakes, Delta Lakes, and Lakehouse tables.
- DevOps and release: Establish coding standards, templates, CI/CD, configuration management, and monitored release processes.
- Quality and reliability: Define DQ rules and lineage; implement SLA tracking, failure detection, RCA, and proactive defect mitigation.
- Security and governance: Enforce IAM best practices, retention, audit/compliance; implement PII detection and masking.
- Orchestration: Schedule and govern pipelines with Airflow and serverless event-driven patterns.
- Stakeholder collaboration: Clarify requirements, present design options, conduct demos, and finalize architectures with customer teams.
- Leadership: Mentor engineers, set FAST goals, drive upskilling and certifications, and support module delivery and sprint planning.
REQUIRED QUALIFICATIONS:
- Experience: 15+ years designing distributed systems at petabyte scale; 10+ years building data lakes and multi-source ingestion.
- Cloud (AWS): IAM, VPC, EC2, EKS/ECS, S3, RDS, DMS, Lambda, CloudWatch, CloudFormation, CloudTrail.
- Programming: Python (preferred), PySpark, SQL for analytics, window functions, and performance tuning.
- ETL tools: AWS Glue, Informatica, Databricks, GCP DataProc; orchestration with Airflow.
- Lakehouse/warehousing: Snowflake, BigQuery, Delta Lake/Lakehouse; schema design, partitioning, clustering, performance optimization.
- DevOps/IaC: Terraform with 15+ years of practice; CI/CD (GitHub Actions, Jenkins) with 10+ years; config governance and release management.
- Serverless and events: Design event-driven distributed systems on AWS.
- NoSQL: 2–3 years with DocumentDB including data modeling and performance considerations.
- AI services: AWS Entity Resolution, AWS Comprehend; run custom LLMs on Amazon SageMaker; use LLMs for PII classification.
NICE-TO-HAVE QUALIFICATIONS:
- Data governance automation: 10+ years defining audit, compliance, retention standards and automating governance workflows.
- Table and file formats: Apache Parquet; Apache Iceberg as analytical table format.
- Advanced LLM workflows: RAG and agentic patterns over proprietary data; re-ranking with index/vector store results.
- Multi-cloud exposure: Azure ADF/ADLS, GCP Dataflow/DataProc; FinOps practices for cross-cloud cost control.
OUTCOMES AND MEASURES:
- Engineering excellence: Adherence to processes, standards, and SLAs; reduced defects and non-compliance; fewer recurring issues.
- Efficiency: Faster run times and lower resource consumption with documented cost models and performance baselines.
- Operational reliability: Faster detection, response, and resolution of failures; quick turnaround on production bugs; strong release success.
- Data quality and security: High DQ pass rates, robust lineage, minimal security incidents, and audit readiness.
- Team and customer impact: On-time milestones, clear communication, effective demos, improved satisfaction, and completed certifications/training.
LOCATION AND SCHEDULE:
● Location: Outside US (OUS).
● Schedule: Minimum 6 hours of overlap with US time zones.
Shubham Vishwakarma
Full Stack Developer - Averlon
Similar jobs
Adobe XD
Adobe IllustratorThis is a full-time on-site role for a Graphic Designer located in Hyderabad. The Graphic Designer will be responsible for creating graphics, graphic design, logo design, branding, and typography for various projects.
*Position: Business Development Manager*
Shift Timing: 10 AM to 6 PM - Monday to Saturday (Remote)
Company: JNJ Technologies & Services LLP - http://jnjservices.co.in/
Location: Vijayawada, Andra Pradesh
Language: English
Salary: 5 LPA to 7.20 LPA
We are looking for a motivated and ambitious Business Development Manager to expand our clientele. You will be responsible for applying different sales strategies and work with dedication to increase sales. Your ultimate goal will be to drive sustainable financial growth by boosting sales and maintaining strong client relationships.
*Requirements:*
• Bachelor’s degree in business, marketing or related field.
• 4 - 8 Years of Experience in sales, marketing or related field.
• Strong communication skills and IT fluency.
• Ability to manage complex projects and multi-task.
• Excellent organizational skills.
• Ability to flourish with minimal guidance, be proactive, and handle uncertainty.
• Proficient in Word, Excel, Outlook, and PowerPoint.
• Comfortable using a computer for various tasks.
*Responsibilities:*
• Develop a growth strategy focused both on financial gain and customer satisfaction
• The responsibilities of a Sales Manager Own recruiting, objectives setting, coaching and performance monitoring of sales representatives.
• Keep records of sales, revenue, invoices etc.
• Provide trustworthy feedback and after-sales support
Dear Candidates,
Greetings from AxionConnect.
This is Shweta from the recruitment team of AxionConnect.
As per your profile on the job portal, currently, we have openings for SAS professionals.
- Experience in SAS development.
- Should have strong experience on Base SAS.
- Should have strong experience in SQL.
- Should have experience in Data Integration Studio (must have).
- Should have strong experience in Enterprise guide.
- Should have good communication skills.
- Exposure to BASE SAS, SAS MACROS, SAS Advance, and SAS Enterprise Guide.
- Banking or financial reporting experience.
Primary Skills
• SAS DI Studio (SAS Data Integration Studio) (Mandatory)
• SAS Eg (Enterprise Guide)
Experience: 3-5yrs
Location: Mumbai (onsite)
NodeJS (Node.js)
MongoDB
ExpressWe are looking for Sr. Node Js Developer
Experience - 3-5 years
Location - Ahmedabad, Gujarat. (Work from Office)
5 Days working
Should have good communication skills.
Requirements:
•API Development
• Mongodb or Firebase
•Designing and developing user interfaces using Angular OR JavaScript MV-VM/MVC frameworks
•Good understanding of AJAX and JavaScript, TypeScript Dom manipulation Techniques
•Experience with RESTful services
•Expert in any one of the modern JavaScript MV-VM/MVC frameworks (AngularJS, JQuery, ReactJS)
•Knowledge of Node.js, Express and frameworks available for it
•Understanding the nature of asynchronous programming and its quirks and workarounds
Google Analytics
HTML/CSSJob Description : SEO executive (4-5 years of exp)
We are looking for someone who has -
- Deep knowledge of offpage and preferably good knowledge of onpage
- Worked on increasing rankings, traffic, content marketing.
- Experience when it comes to using tools such as Google Analytics and Google Webmaster.
- Excellent time management skills.
- Solid knowledge of Backlinks
- Experience in HTML coding and JavaScript.
- Understanding of what works for and against Google’s algorithms.
- Keeps upgrading knowledge.
- Experience in using tools like Ahrefs, SEMrush and others
- Good communication skills.
HTML/CSS- Knowledge of front-end technologies including CSS3, JavaScript, HTML5, and jQuery.
- Good understanding of website architecture and aesthetics.
- Monitoring the performance of the live website
- Generating WordPress themes and plugins.
- Conducting website performance tests.
- Troubleshooting content issues.
- Ability to project manage.
- Good communication skills.
Java
ProgrammingB.E. / B.Tech/ M.Tech in Computer Science
Skills
●Proper understanding of different programmingsoftwares/subjects related to undergraduate courses ofComputer Science domain.
●Knowledge ofArtificial Intelligence and Machine learningwould be aplus.
●Excellent interpersonal and communication skills
●Problem solving attitude with good command on logicalreasoning skills
●Ability to work independently with minimal supervision
●Keen to learn about new tools & technologies for use inchanging situations.
●Comfortable in working in a fast paced environment withgreat efficiency.
Roles and Responsibilities
●Solving questions of the students from across the globeon the TutorBin board.
●Working on tasks involving various subjects/softwarerelated to undergraduate / postgraduate courses ofComputer Science.
●Reviewing the works completed by the tutor on ourplatform and providing necessary instructions forrectification as required.
●Ensuring the overall quality of work provided to thestudents from our platform.
●Management of the tutors on our platform, theiron-boarding and performance review.
●Planning & implementing the training of the new tutorson our platform.
Adobe XDQualification Required:
- Proven work experience as a UI/UX Designer.
- Minimum 3 to 7 years of experience designing interfaces for mobile and web applications.
- Portfolio of a design project.
- Up-to-date knowledge of design software like Adobe XD, Illustrator, and photoshop.
- Team spirit: strong communication skills to collaborate with various clients.
- Good time management skills.
- Thinker and problem-solving skills.
Responsibilities:
- Executing all visual design stages from concept to final hand-off to the client.
- Conceptualizing original ideas that bring simplicity with user-friendliness to the complex design.
- Create wireframes, storyboards, user flows, process flows and site maps to effectively communicate interaction and design ideas.
- Combine creativity with an awareness of the design elements.
- Conduct ongoing user research.
- Don't forget to attach previous work or Behance portfolio link.
Regards,
Deforus Technologies Pvt. Ltd.
React.js
Redux/Flux-Proficient understanding of web markup, including HTML5, CSS3
-Knowledge of JS based build tools like Grunt, Gulp, and Bower
-Knowledge of Unit Testing with Jest
-Exposure in SEO, Web Service integration, asynchronous request handling, partial page update etc.
-Exposure to Node.js would be an added advantage
-Knowledge of different process tools like Git, SVN, Jenkins etc.
DESIRED SKILLS:
-Strong experience in Responsive Design, React JS
-Understanding of Native and Cross Platform mobile applications and user experience best practices
-Exposure to Node.js, Angular and React Native would be an added advantage
React.js
Angular (2+)
JavascriptHTML/CSS
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon