Lead II - Data Engineering
at Global Digital Transformation Solutions Provider
Amazon Web Services (AWS)
PythonSENIOR DATA ENGINEER:
ROLE SUMMARY:
Own the design and delivery of petabyte-scale data platforms and pipelines across AWS and modern Lakehouse stacks. You’ll architect, code, test, optimize, and operate ingestion, transformation, storage, and serving layers. This role requires autonomy, strong engineering judgment, and partnership with project managers, infrastructure teams, testers, and customer architects to land secure, cost-efficient, and high-performing solutions.
RESPONSIBILITIES:
- Architecture and design: Create HLD/LLD/SAD, source–target mappings, data contracts, and optimal designs aligned to requirements.
- Pipeline development: Build and test robust ETL/ELT for batch, micro-batch, and streaming across RDBMS, flat files, APIs, and event sources.
- Performance and cost tuning: Profile and optimize jobs, right-size infrastructure, and model license/compute/storage costs.
- Data modeling and storage: Design schemas and SCD strategies; manage relational, NoSQL, data lakes, Delta Lakes, and Lakehouse tables.
- DevOps and release: Establish coding standards, templates, CI/CD, configuration management, and monitored release processes.
- Quality and reliability: Define DQ rules and lineage; implement SLA tracking, failure detection, RCA, and proactive defect mitigation.
- Security and governance: Enforce IAM best practices, retention, audit/compliance; implement PII detection and masking.
- Orchestration: Schedule and govern pipelines with Airflow and serverless event-driven patterns.
- Stakeholder collaboration: Clarify requirements, present design options, conduct demos, and finalize architectures with customer teams.
- Leadership: Mentor engineers, set FAST goals, drive upskilling and certifications, and support module delivery and sprint planning.
REQUIRED QUALIFICATIONS:
- Experience: 15+ years designing distributed systems at petabyte scale; 10+ years building data lakes and multi-source ingestion.
- Cloud (AWS): IAM, VPC, EC2, EKS/ECS, S3, RDS, DMS, Lambda, CloudWatch, CloudFormation, CloudTrail.
- Programming: Python (preferred), PySpark, SQL for analytics, window functions, and performance tuning.
- ETL tools: AWS Glue, Informatica, Databricks, GCP DataProc; orchestration with Airflow.
- Lakehouse/warehousing: Snowflake, BigQuery, Delta Lake/Lakehouse; schema design, partitioning, clustering, performance optimization.
- DevOps/IaC: Terraform with 15+ years of practice; CI/CD (GitHub Actions, Jenkins) with 10+ years; config governance and release management.
- Serverless and events: Design event-driven distributed systems on AWS.
- NoSQL: 2–3 years with DocumentDB including data modeling and performance considerations.
- AI services: AWS Entity Resolution, AWS Comprehend; run custom LLMs on Amazon SageMaker; use LLMs for PII classification.
NICE-TO-HAVE QUALIFICATIONS:
- Data governance automation: 10+ years defining audit, compliance, retention standards and automating governance workflows.
- Table and file formats: Apache Parquet; Apache Iceberg as analytical table format.
- Advanced LLM workflows: RAG and agentic patterns over proprietary data; re-ranking with index/vector store results.
- Multi-cloud exposure: Azure ADF/ADLS, GCP Dataflow/DataProc; FinOps practices for cross-cloud cost control.
OUTCOMES AND MEASURES:
- Engineering excellence: Adherence to processes, standards, and SLAs; reduced defects and non-compliance; fewer recurring issues.
- Efficiency: Faster run times and lower resource consumption with documented cost models and performance baselines.
- Operational reliability: Faster detection, response, and resolution of failures; quick turnaround on production bugs; strong release success.
- Data quality and security: High DQ pass rates, robust lineage, minimal security incidents, and audit readiness.
- Team and customer impact: On-time milestones, clear communication, effective demos, improved satisfaction, and completed certifications/training.
LOCATION AND SCHEDULE:
● Location: Outside US (OUS).
● Schedule: Minimum 6 hours of overlap with US time zones.
Shubham Vishwakarma
Full Stack Developer - Averlon
Similar jobs
About WINIT
We are an mSFA technology company with 25+ years of industry expertise and 600+ success stories in mobility, digitization and consultation. Over 75 enterprises trust WINIT mSFA across the globe. Our platform provides 24x7 support, integrated ML capabilities and continuous R&D to help customers innovate, grow sustainably and solve real-world distribution and retail problems.
Job Summary:
We are looking for a capable and adaptable candidate to provide onsite support for our client operations in Afghanistan. The role involves system support, coordination with local teams, and ensuring smooth technical/service assistance.
Key Responsibilities:
- Provide onsite support for system operations and troubleshooting.
- Coordinate with internal teams for timely issue resolution.
- Train users on system functionality if required.
- Prepare basic reports and updates on daily activities.
Requirements:
- Graduation in any field; technical background preferred.
- Good communication and problem-solving skills.
- Willingness to travel and stay in Afghanistan for 2 months.
- Prior support experience (IT/Operations) is an added advantage.
Benefits:
- Travel, accommodation & local logistics provided.
- Competitive project allowance.
Designation – Project Coordinator
Work Location – Ahmedabad (WFO)
Responsibilities:
Support the project manager with end-to-end project management activities.
Prepare project management deliverables such as the project charter, project plan or schedule, risk and issue tracker, communication plan, stakeholder mapping, MOM, and weekly reports.
Standardize processes and define templates for project deliverables. Prepare reports and dashboards.
Manage resourcing and optimize resource utilization handle knowledge management and organize trainings.
Manage document onboarding and off boarding processes.
Required Skills:
1 to 2 years of professional experience in the IT industry.
Good understanding of SDLC phases, knowledge of project management methodologies and models (Waterfall and Agile).
Hands-on experience with project management tools such as Jira, Asana, etc.
Excellent communication skills (both written and verbal).
Attention to detail, negotiation skills, critical thinking, and task management.
Python
Flask
MongoDBJob Description: Python Developer
Location: Pune Employment Type: Full-Time Experience: 0.6-1+ year
Role Overview
We are looking for a skilled Python Developer with 0.6-1+ years of experience to join our team. The ideal candidate should have hands-on experience in Python, REST APIs, Flask, and databases. You will be responsible for designing, developing, and maintaining scalable backend services.
Key Responsibilities
- Develop, test, and maintain high-quality Python applications.
- Design and build RESTful APIs using Flask.
- Integrate APIs with front-end and third-party services.
- Work with relational (PostgreSQL, MySQL) and NoSQL databases (MongoDB, Redis).
- Optimize performance and troubleshoot issues in backend applications.
- Collaborate with cross-functional teams to define and implement new features.
- Follow best practices for code quality, security, and performance optimization.
Required Skills
- Strong proficiency in Python (0.6-1+ years).
- Experience with Flask (or FastAPI/Django).
- Hands-on experience with REST API development.
- Proficiency in working with databases (SQL & NoSQL).
- Familiarity with Git, Docker, and CI/CD pipelines is a plus.
Preferred Qualifications
- Bachelor's degree in Computer Science, Engineering, or a related field.
- Experience working in Agile/Scrum environments.
- Ability to write clean, scalable, and well-documented code.
MDM Engineer / Developer
As a Developer, you are responsible for creating and maintaining software development lifecycle activities pertaining to the business applications. You will design, code, test, debug, and document existing and new enhancements.
Responsibilities:
- Works with project managers, business analysts, content specialists, and digital product owners to understand how business requirements and technical specifications will translate to actual work product across platform.
- Maintains a culture of open communication, collaboration, mutual respect and productive behaviors; hires, trains and retains top tier talent and mentors team members to new and fulfilling career experiences.
- Writes clean, efficient and well-engineered front-end code that can serve as standard of excellence for other team members.
- Conducts code reviews and provides guidance on code management, release management, environment management, process flows and documentation.
- Identifies risks, barriers, efficiencies and opportunities when thinking through development approach.
- Explores all technical options when considering a solution, including homegrown coding, third party sub-systems, enterprise platforms and existing technology components.
- Participates in collaborative efforts through all phases of software development life cycle (SDLC), including requirements analysis, technical design, coding, testing, and release support.
- Understands lifecycle of various technology sub-systems that comprise eCommerce platform (i.e., version, release, roadmap), including current capabilities, compatibilities, limitations and dependencies; understands and advises of optimal upgrade paths.
- Leverages relationships with key IT, QA and other corporate colleagues by communicating and collaborating on cross function initiatives.
- Participates in collaborative technology discussions and accepts and provides constructive criticism in a professional manner. Works with project managers, business analysts, content specialists, and digital product owners to understand how business requirements and technical specifications will translate to actual work product across platform.
- Develops technical documentation, such as system context diagrams, design documents and release procedures.
- Participates in troubleshooting efforts for production issues of all levels and severities, through a hands-on approach or through delegation, and assigns to third party front-end developers as appropriate and tracks progress.
- Participates in efforts to monitor web properties for uptime, and proactively identify future problems by analyzing trends, data and monitoring reporting.
Qualifications:
- Bachelor’s degree in eCommerce, eBusiness, information technology or related field required.
- 3 years required, 5 years preferred experience in a development role in an enterprise environment with responsibility for the delivery and support of world class technology solutions.
- 3 years required, 5 years preferred experience with coding experience in required language, platform, and/or technology.
- 3 years required, 5 years preferred experience developing solutions using modern tools and practices.
- Working knowledge with code management systems.
- Working knowledge with intake and task management tools.
- Working knowledge of the Software Development Lifecycle (SDLC)
- Working knowledge of development frameworks
- Working knowledge with build tools
- Working knowledge of Agile delivery methodologies
- Ability to multi-task and reprioritize in a dynamic environment
- Outstanding written and verbal communication skills
Java
Spring BootResponsibilities
- Software Engineering
- Design and develop highly scalable, available, reliable, secure and fault tolerant systems with minimal
guidance for a market leader in the logistics industry
- Partner with team members on functional and nonfunctional requirements and spread design
philosophy, goals and improve the code quality across the team
- Research new technologies and tools that enable building the next generation of our services
- Provide technology leadership to the team and foster engineering excellence
- Product Delivery
- Partner with product managers to define and execute on the feature roadmap
- Translate business requirements into scalable and extensible design
- Coordinate with various cross functional teams on planning and execution
- Maintaining automated build / test / deployment environments
Qualifications
- Software Engineering
- Should have at least 4 years of hands on experience in designing, developing, testing and deploying
applications on Java, Ruby, Kotlin, Python, Node or Go for large scale applications
- Deep knowledge of one of the programming language they have experience in
- Proficient in OOP and Design Patterns, experience with functional programming would be a plus
- Data modelling experience in Relational Databases
- Ability to design and implement low latency RESTful services
- Product Delivery
- Ability to scope, review and refine user stories for technical completeness and to alleviate dependency
risks.
- Well versed in working with agile methodologies which includes phases such as design, development,
code review, testing and release management
- Ability to have worked in a CI/CD environment, with hands on experience with Git or any similar source
code management tools
- Product Maintenance
- Experience troubleshooting server performance issues such as memory tuning, GC tuning, resource leaks
etc
- Continuously refactor applications to ensure high quality design.
Vue.js
AngularJS (1.x)
Angular (2+)
React.js
Javascript- Design, implementation, and deployment of successful LOS/LMS system features and services in support of our lending operations and the businesses they support
- Resolve bugs in the software features and deliver them on time with high quality
- Participate in the definition of secure, scalable, and low-latency services and efficient physical processes
- Work with cross-functional teams delivering on demanding projects
- Functionally decompose complex problems into simple, straight-forward solutions
- Understand system inter-dependencies and limitations
Flutter
iOS App DevelopmentJavascript
FinCRM is a cloud-based Customer Relationship Management Solution with enhanced Office Management capabilities. It helps companies and individuals manage their sales, marketing, and support efforts all from a single place. It is equipped to help businesses of all sizes build excellent customer relationships.
Roles and Responsibilities:
- Willing to familiarize yourself with the company's vision and mission, seeking to accomplish set goals and objectives.
- Conducting market research and identifying potential clients.
- Cultivating strong relationships with new clients, while maintaining existing client relationships.
- Developing and implementing sales strategies, client service, and retention plans, and analyzing sales data to inform or update marketing strategies.
- Assist with drafting business plans, sales pitches, presentations, reference material, and other documents as required.
- Identify new business opportunities and partners.
- Demonstrate strong interpersonal skills with the ability to engage effectively with various levels of management, staff, and clients.
Skills Required:
- Excellent written and verbal communication skills.
- Ability to handle multiple projects simultaneously and work under pressure.
- Proficient in MS Office and Excel.
- Great networking skills.
- Negotiation and Convincing skills.
- Reviewing client feedback and implementing necessary changes
- Technical and social skills needed to enhance sales.
DEPARTMENT Technology
COMPANY Sanghi Tech
SCENARIO Consulting Startup
REPORT TO IT Systems Administrator
We are looking for a technology enthusiast, carrying 2+ years of Assisting in IT Infrastructure setup in a startup environment with mixed computing (Windows + Mac) experience. This professional should be tech crazy, energetic and willing to learn new technologies and processes, and also assist the team in creating different solutions for the firm, and the external clients.
We are a futuristic startup, and this opportunity will not only enhance your existing skills, but also give you an edge over other tech professionals to learn and implement new technologies in-house, as well as, for external clients globally.
ABOUT COMPANY
Founded by Tarang Sanghi, Sanghi Tech is a tech consulting firm based in Jaipur, Rajasthan (INDIA).
We offer a wide variety of technology services tailored to our client's unique needs. We create high quality and scalable solutions across all stages of hardware and software setups — consultation, design, procurement, deployment, migration, and tech support.
For more details: www.sanghi.tech
ABOUT DEPARTMENT
We make awesome IT solutions using technology in creative ways and delivering the best user experience for all business requirements and provide business critical support. While ensuring all systems and applications run at peak performance. At SanghiTech, the Technology & Security team works together, to secure all information and physical infrastructure.
THE PROJECT(s)
Assist the team in developing and deploying the complete IT System backbone for our entire organisation and group businesses including, networking, security, storage and backup, user management etc.
Assist the team in deploying a CRM system across various sales teams.
Establish key relationships with various hardware and software vendors.
AREA OF RESPONSIBILITIES
IT SETUP
- Source- Assess pain-areas in which new technology, solutions and workflows can be implemented to improve efficiency and productivity.
- Identify- Test, flag and fix potential problems, inefficiencies and weaknesses in all IT platforms used across the company/ clients.
- Analyse- Analysing a company's IT system and infrastructure.
- Assistance- Assist the team in research, testing and deploying new solutions based on the requirements of different departments across the company - Admin, HR, IT, Accounts, Sales, Client Relations, Marketing & Design.
- Innovate- Evaluate and foster innovation, to deliver high impact IT solutions by coordinating the business process-integration, automation and operation of all IT systems across the company / clients.
- Implement- Installing computer equipment and software, working with users to recommend appropriate hardware and software upgrades.
- Rearrange- Dealing with product faults and arranging repairs and replacements.
- Maintain- Periodic updates and maintenance of all the software used across different departments.
- Manage- Handle all employee joining and exiting formalities, for a smooth experience.
- Update- Be able to provide strong day-to-day server and workstation support.
DOCUMENTATION
- Prepare accurate and timely reports.
- Document technical knowledge in the form of notes and manuals.
- Ensure the creation and maintenance of all written documentation, including system and user manuals, company wiki, license agreements, warranties, and modifications & upgrades.
VENDOR MANAGEMENT
- Coordinate with the vendors for specialised setups, be the company representative in supervising and coordination when an external agency is involved.
Years of Relevant Experience- 2+ years
Education & Certifications-
- We prioritise skills over degrees but B.E (Computer Science/ Computer Engg/ IT Engg.), MCA or equivalent education and experience is a bonus.
- Progressive IT experience, including experience in a multi-office environment.
- Some sort of certification and/or training on Mac based IT systems is highly desired.
- In depth knowledge and expertise of the latest Microsoft and Mac OS & Server systems. Mobile Devices: iPhone, Android
- GSuite / Google Workspace, Microsoft Office 365
- Experience in backup, restoration and NAS setup & management.
- Networking & Internet Technologies, Active Directory, Group Policy, DNS, DHCP, IIS, iSCSI, VPN
- SaaS Applications, Business Apps & Tools (CRM, POS, CMS, ERP, ATS, HRMS etc.)
- Knowledge of Adobe Creative Suite / Design software, Zoho products is a bonus.
Nature / Personality
- Hunger to learn and grow, with a can-do attitude and immense passion in technology and how it can enhance the way people work. Keeping current with the latest technologies and developments.
- A true “customer service” attitude is required along with excellent verbal/written communication skills, and strong time management/organisational skills.
- Good listener, confident personality, courteous and friendly manner, absolute integrity.
- Work to deadlines and adapt quickly to a fast changing environment.
- Should adhere to strict confidentiality in maintaining all company and client data.
- Good organization skills and the ability to work closely in collaboration with all teams and external vendors.
- The ability to troubleshoot in a complex technical environment and to work with limited supervision is critical.
- The ability to manage expectations in a deadline driven culture (where a feeling of urgency is the norm) is vital in this role.
- Must possess a strong creative ability to apply IT to solve business problems.
- Superior analytical, evaluative, technical, and problem-solving abilities.
- IT Budget, Procurement and Vendor management.
- IT Infrastructure Management.
Benefits
We offer competitive compensation and benefits.
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon