Amazon Web Services (AWS)
PythonData Engineer
Data Lakehouse & Platform Engineering
About the Role
We are hiring Data Engineer to own the lifecycle of our enterprise Data Lakehouse platform. We are looking for engineers who think in systems, make platform-level design decisions, and can build and operate a production-grade, multi-source lakehouse from the ground up, covering ingestion through consumption across a complex, multi-cloud source landscape.
You will be the technical authority for a platform that consolidates data from 18+ enterprise products (Costpoint, GovWin, Specpoint, Vantagepoint, and others) into a governed, medallion-architected data lake on AWS S3 with Apache Iceberg table format, orchestrated via AWS Step Functions, and queryable through AWS Athena and Trino. This role is end-to-end: you own ingestion, transformation, quality, orchestration, ML data supply, and BI consumption.
Key Responsibilities
• Architect and evolve the full medallion lakehouse — Bronze, Silver, and Gold layers — on AWS S3 with Apache Iceberg; own schema design, partitioning, compaction, and retention policies.
• Design and implement scalable Glue ETL (PySpark) pipelines for bronze_to_silver and silver_to_gold transformations, incorporating dbt for SQL-layer transformations where appropriate.
• Own and extend CDC ingestion via Fivetran; manage schema evolution, connector health, and sync reliability across 18+ source products.
• Build and maintain AWS Step Functions state machines and EventBridge schedules for end-to-end pipeline orchestration; implement Lambda-based quality and drift monitors.
• Govern the Glue Catalog and Lake Formation policies; enforce column-level security, row-level access controls, and audit logging to meet SOC2 and regulatory requirements.
• Architect the query layer — optimize Athena workgroups and partition pruning; plan and execute Trino-on-EKS deployment for sub-second analytics workloads.
• Partner with data science teams on SageMaker data supply: feature engineering pipelines, training dataset preparation, and model registry integration.
• Implement real-time and near-real-time streaming solutions using Kafka or Kinesis where sub-13-minute latency is required.
• Lead platform modernization initiatives: evaluate emerging formats (Iceberg vs. Delta Lake vs. Hudi), tooling, and cost optimization strategies.
• Establish and enforce data engineering best practices: code reviews, CI/CD for pipeline code, IaC (Terraform / CloudFormation), and incident response runbooks.
• Mentor and level up junior and mid-level data engineers; define team standards for pipeline design, testing, and documentation.
Required Qualifications
• Software or data engineering experience, with at least 4 years in an architect or technical lead capacity designing large-scale cloud data platforms.
• Deep, hands-on expertise with AWS data services: S3, Glue (PySpark ETL), Athena, Step Functions, Lambda, EventBridge, Lake Formation, SageMaker, and CloudWatch.
• Production experience with Apache Iceberg (or Delta Lake / Hudi) table formats — compaction, snapshot management, schema evolution, and time travel.
• Strong PySpark and Python skills; ability to write, review, and optimize distributed data processing jobs at scale.
• Hands-on experience with CDC-based ingestion platforms (Fivetran, Debezium, or equivalent) across heterogeneous source systems.
• Proven experience designing and implementing medallion (Bronze/Silver/Gold) or equivalent multi-hop lakehouse architectures.
• Experience with data pipeline orchestration: AWS Step Functions, Apache Airflow, or equivalent; event-driven pipeline design patterns.
• Strong SQL skills; experience with Athena, Trino, Presto, or equivalent query engines for large-scale analytical workloads.
• Familiarity with data governance tooling: catalog management (Glue Catalog, Apache Polaris/Iceberg REST), data lineage, access controls, and audit frameworks.
• Experience with Infrastructure as Code (Terraform or CloudFormation) for data platform provisioning and drift management.
• Solid understanding of dimensional modeling, schema design (star/snowflake), and data normalization for BI and analytics workloads.
• Bachelor's degree in Computer Science, Engineering, or a related field; or equivalent professional experience.
Preferred Qualifications
• Experience operating Trino or PrestoDB on Kubernetes (EKS); tuning for sub-second query latency and multi-tenant workloads.
• Familiarity with streaming platforms (Kafka, Kinesis, or Pub/Sub) and real-time lakehouse patterns.
• Experience with Apache Polaris or other Iceberg REST catalog implementations.
• Exposure to SageMaker MLOps pipelines, Model Registry, and feature store patterns for ML data supply.
• Experience with dbt (data build tool) for SQL-layer transformation and documentation in lakehouse environments.
• Government contracting or ERP domain knowledge (Costpoint, Deltek, Oracle, or similar enterprise platforms) is a strong plus.
• AWS certifications: Data Engineer Associate, Solutions Architect Professional, or equivalent.
What You Will Build
You will be a founding architect of a strategic, cross-product data platform that serves 18+ enterprise applications and their analytics, ML, and AI workloads. The decisions you make on schema, storage format, query layer, governance, and orchestration will shape the data foundation of the company for years. This is a high-impact, high-ownership role with direct visibility to senior leadership.
Shubham Vishwakarma
Full Stack Developer - Averlon
About Deltek
About
Project-based businesses transform the world we live in. Deltek innovates and delivers software and solutions that power them to achieve their purpose. Our industry-specific software and information solutions maximize our customers' performance at every stage of the project lifecycle by enabling superior levels of project intelligence, management and collaboration.
Deltek is the recognized global standard for project-based businesses across government contracting and professional services industries, helping more than 30,000 organizations of all sizes deliver on their mission.
With over 4,200 employees worldwide, our team of industry experts is passionately committed to creating exceptional customer experiences.
Company social profiles
Similar jobs
Job Title : Solution Architect – Denodo
Experience : 10+ Years
Location : Remote / Work from Home
Notice Period : Immediate joiners preferred
Job Overview :
We are looking for an experienced Solution Architect – Denodo to lead the design and implementation of data virtualization solutions. In this role, you will work closely with cross-functional teams to ensure our data architecture aligns with strategic business goals. The ideal candidate will bring deep expertise in Denodo, strong technical leadership, and a passion for driving data-driven decisions.
Mandatory Skills : Denodo, Data Virtualization, Data Architecture, SQL, Data Modeling, ETL, Data Integration, Performance Optimization, Communication Skills.
Key Responsibilities :
- Architect and design scalable data virtualization solutions using Denodo.
- Collaborate with business analysts and engineering teams to understand requirements and define technical specifications.
- Ensure adherence to best practices in data governance, performance, and security.
- Integrate Denodo with diverse data sources and optimize system performance.
- Mentor and train team members on Denodo platform capabilities.
- Lead tool evaluations and recommend suitable data integration technologies.
- Stay updated with emerging trends in data virtualization and integration.
Required Qualifications :
- Bachelor’s degree in Computer Science, IT, or a related field.
- 10+ Years of experience in data architecture and integration.
- Proven expertise in Denodo and data virtualization frameworks.
- Strong proficiency in SQL and data modeling.
- Hands-on experience with ETL processes and data integration tools.
- Excellent communication, presentation, and stakeholder management skills.
- Ability to lead technical discussions and influence architectural decisions.
- Denodo or data architecture certifications are a strong plus.
Machine Learning (ML)
Deep LearningRole: Sr. Data Scientist
Exp: 4 -8 Years
CTC: up to 28 LPA
Technical Skills:
o Strong programming skills in Python, with hands-on experience in deep learning frameworks like TensorFlow, PyTorch, or Keras.
o Familiarity with Databricks notebooks, MLflow, and Delta Lake for scalable machine learning workflows.
o Experience with MLOps best practices, including model versioning, CI/CD pipelines, and automated deployment.
o Proficiency in data preprocessing, augmentation, and handling large-scale image/video datasets.
o Solid understanding of computer vision algorithms, including CNNs, transfer learning, and transformer-based vision models (e.g., ViT).
o Exposure to natural language processing (NLP) techniques is a plus.
Cloud & Infrastructure:
o Strong expertise in Azure cloud ecosystem,
o Experience working in UNIX/Linux environments and using command-line tools for automation and scripting.
If interested kindly share your updated resume at 82008 31681
HTML/CSS
Javascript
Angular (2+)
AngularJS (1.x)Job Description
Role: : .NET Full Stack Developer
Designation : Software Engineer / Sr. Software Engineer
Location: : Ahmedabad
About the Team
An established IT Product & Engineering team following agile development principles, automated deployments, multiple staging environments. You will be joining experienced team of senior developers, UX/UI designers, DevOps, QA, product & project managers. Using various technologies and applications fully hosted on cloud.
Experience
- 6 to 12 years of experience in .Net technologies
- At least 2 years of hands-on experience designing & developing medium to large scale applications with Front-End JavaScript Frameworks, preferably Angular
- Well versed with advanced programming concepts of both front-end and back-end technologies
Responsibilities
- As a Software Engineer Professional, you will be responsible for the development, implementation, and maintenance of applications, using C#, .Net Core, NodeJS, Angular and ElectronJS, SQL, NoSQL and various other technologies.
- Develop high quality and reliable code with unit test cases, meeting given specifications.
- Develop front-end user interfaces using Angular.
- Implement back-end services and APIs using C# and .Net, .NET Core.
- Optimize application performance and ensure scalability.
- Collaborate with engineering, product team and UI/UX to deliver best products.
- Follow outlined standards of quality related to code and systems.
- Have a strong customer focus.
Essential Skills – Abilities
- Proven experience as a Full Stack Developer or similar role
- Strong Experience in C#, MVC and WEB API, Database Design and SQL queries using SQL server
- Experience in Angular
- Good Experience in .Net Core
- Ability to self-learn and deliver with minimal help / supervision
- Must have excellent communication & presentation skills.
- Good analytical and problem-solving skills
Value Add:
- Prior eCommerce industry domain experience
- Micro Front End Architecture
- NgRx for State Management
- NodeJs, Electron JS, PostgreSQL, Mongodb, Elasticsearch, Kafka, Redis, AngularJs (nice to have)
- Experience in Docker, Kubernetes
- Experience with working on highly scalable applications running as microservices on AWS / Azure.
Perks
- Work-life balance & Flexible working hours. 5 days a week.
- Every minute you work is paid.
- Hybrid working facilities.
- Mediclaim Insurance & Accidental death Insurance coverage
- Employee referral bonus scheme.
- 28 days holidays (up to 35 depending on years of service). No Sandwich leave policy.
- Enjoyable atmosphere, fast-Paced, fun, and creative space.
- Canteen full of fruits & beverages
- Learning & Development Opportunities
C#
.NETAngularJS (1.x)Angular (2+)Role
Being a part of the Products / Software Engineering team, this member is expected to work with the existing development team. Key responsibilities of this role include MS Tech stack-based applications as per the product roadmap / project scope. Coordinate with co-developers and contribute to all phases of the development lifecycle.
Experience
Around 4 years of experience in creating and implementing Web-based applications using
C#, ASP.net, Web API, MVC, Micro Services, JavaScript and SQL Server.
Familiarity or exposure to CI / CD, Dev Ops such as Dockers, containers, Azure, Pipeline is
highly recommended
Ability to work in an Agile, fast-paced environment, and learn rapidly.
Bachelor degree in computer science, computer engineering or similar.
Familiar with object-oriented development, design patterns and specifically in .NET
Framework (C#) with a strong background in web-based development and service-oriented
Architecture.
Expert in HTML, CSS, JavaScript, JQuery, JSON.
Writing clean, readable, and easily maintainable code.
Must have knowledge of project/task management tools like Jira,
Familiarity with Version Control like Bitbucket, Git etc.
Understanding of UI, cross-browser compatibility and web standards.
Build features and applications with responsive design
Good English communication skills, written and spoken.
Able to work with minimum supervision as well as perform under pressure and meet
Deadlines.
Key Responsibilities
- Recognizes and seizes opportunities to contribute to agency new business
- Build product GTM narrative, and clearly explain products, value proposition, commercial and engagement model
- Organize Product trainings and roadshows across agencies
- Accountable for maintaining a positive relationship with Media agency, and providing clear lanes of communication and support
- Responsible for development of direct reports
- Establish regular check-ins with key stakeholders
- Understand who and when to pull in Tech Product team to support client-direct conversations, and more specific requests
- Manage & prioritize incoming requests from agencies
- Partner with business stakeholders to define product application & usage goals and working to ensure solutions are properly integrated, applied, and activated
- Provide feedback to product team share client & agency specific feedback, areas for improvement, opportunities, etc.
- Display strong consulting and collaboration skills
- Exhibits enthusiasm for clients’ business and industry. Maintains leading edge of knowledge of clients’ business and industry
Requirements
- 10+ years of experience, ideally in a digital or media agency or consultancy
- Strong knowledge of leading data and technology tools
- Excellent written and verbal communication skills, including demonstrated ability to create and deliver professional presentations and customer deliverables requiring little review/input from others.
- Strong attention to detail, excellent organization skills, and ability to manage multiple projects
- Demonstrable track record of success in operations and client engagement in a cross-functional environment, including product, tech, or media.
- Has deep knowledge and experience with paid media agencies
PythonCompany Description
What We Do
Miratech helps visionaries to change the world. We are a global IT services and consulting company that brings together global enterprise innovation and start-up innovation. Today we support digital transformation for the largest enterprises on the planet.
By partnering with both large and small players, we stay at the leading edge of technology, remain nimble even as a global leader, and create technology that helps our clients further enhance their business. Our culture of Relentless Performance enables over 99% of Miratech’s engagements to succeed by meeting or exceeding scope, schedule and/or budget objectives since our inception in 1989.
Job Description
We are looking for a Senior Perl Developer to join our team, who will help us work on solutions and implement technologies that will improve user experience.
Responsibilities:
- Developing and maintaining large-scale Perl applications.
- Perform application modifications and enhancements based on business needs.
- Develop clean, high-quality and reusable codes based on programming standards.
- Coordinate with Project Manager to clearly understand business requirements and expectations.
- Stay abreast with latest trends in application development techniques and technologies.
- Suggest optimal application development solutions to meet or exceed business objectives.
- Develop best practices to ensure coding efficiency and quality.
- Analyze and resolve coding issues in a timely and accurate manner.
- Prepare and maintain coding documentations for reference purposes.
- Prioritize, plan and handle multiple tasks effectively.
- Ensure to complete the assigned development tasks within deadlines.
- Report project status to Manager on regular basis.
Qualifications
- 7+ years of experience in Perl development.
- Experience of developing and maintaining shell scripts.
- Strong working knowledge in Perl and Unix based systems.
- Experience of developing database-driven web services/applications against SQL databases such as Oracle or MySQL.
- Detail focused, experience of reviewing technical documentation, diagrams and plans in order to help meet and/or define requirements.
- Able to communicate technical information verbally in a clear manner to both technical and non-technical stakeholders.
HTML/CSSWe are currently looking for a Senior SEO and PPC Marketing Expert who will work with a team of developers, Product Owner, and Managers. You shall be responsible for conceiving and conducting the user research to translate them into actionable best SEO practices, activities and paid campaigns. You will also design the overall accessibility and 'findability' of the mobile application and web-platform, as well as other associated websites.
- Gather the user requirements in collaboration with the Product Owner and Manager.
- Prepare and present the rough drafts to internal teams.
- Assist in translating best practices that lead to targeted organic user experiences.
- Helping to facilitate the product owners' product visions by researching, conceiving and implementing best SEO + PPC practices to achieve the targest.
- Help identify design problems and devise elegant solutions.
- Work with the team to create a strategic design and SEO decisions related to core, and new, functions and features.
- Take a user-centered design approach and rapidly test and iterate your designs.
- Collaborate with a cross-functional team of designers, product managers, and leads on all phases of the product development life cycle
- Incorporate best practices for accessibility, usability, web performance, and design into our products and ultimately champion more consistent and delightful user experience.
- Work with front-end developers and designers in all aspects of UX development.
- Perform research, evaluations, and validations of moderate complexity.
- Provide solutions using appropriate research methodology, tools, and protocols considering a user-centered approach.
- Perform usability/heuristic evaluations and validations across the product or solution life-cycle.
Minimum Eligibility:
- Minimum 3 -4 years of experience in SEO and PPC
- Ability to effective communications and collaboration with other designers and product owners/managers to ensure the best possible ways of UX experience.
- Creative and Artistic nature.
- Knowledge of PPC and automation platforms would be ideal
- Experience in taking input from multiple sources and synthesizing it into coherent design ideas.
PythonOnly a solid grounding in computer engineering, Unix, data structures and algorithms would enable you to meet this challenge. 7+ years of experience architecting, developing, releasing, and maintaining large-scale big data platforms on AWS or GCP Understanding of how Big Data tech and NoSQL stores like MongoDB, HBase/HDFS, ElasticSearch synergize to power applications in analytics, AI and knowledge graphs Understandingof how data processing models, data location patterns, disk IO, network IO, shuffling affect large scale text processing - feature extraction, searching etc Expertise with a variety of data processing systems, including streaming, event, and batch (Spark, Hadoop/MapReduce) 5+ years proficiency in configuring and deploying applications on Linux-based systems 5+ years of experience Spark - especially Pyspark for transforming large non-structured text data, creating highly optimized pipelines Experience with RDBMS, ETL techniques and frameworks (Sqoop, Flume) and big data querying tools (Pig, Hive) Stickler of world class best practices, uncompromising on the quality of engineering, understand standards and reference architectures and deep in Unix philosophy with appreciation of big data design patterns, orthogonal code design and functional computation models |
Javascript
React.js
DockerHTML/CSSWe are building a workspace for Marketing teams - Think Webflow for Marketing teams, Grafana for Marketing teams who operate on large data sets and need a clear intuitive interface to look at all their data.
Traditionally Marketing teams have always had to depend on a large BI team to provide them with the data they need to make decisions. Clarisights eliminates this by giving Marketing teams everything they need in one intuitive, collaborative reporting platform.
We work with large enterprise Marketing teams around the world like Delivery Hero - The world's largest food delivery co., HelloFresh the world's largest mealkits delivery co. etc.
Our platform is central to how business teams make decisions and you will work on the interface that these teams use. We are helping non technical business users get comfortable with data by giving them a platform they can use to drive.
What makes this role challenging? Think Google Docs, Slides and Sheets all combined in one platform. We have a collaborative text editor which is used by teams together and we built our table grid which is extremely powerful. Tables, being one of the heaviest and most used widgets we have, have records composed of metric data(averages, share percentages, comparison data), multiple creatives(images, videos, gifs), trends(charts inside each cell) and a lot more.
The huge amount of data points naturally increases the amount of DOM nodes and thus it becomes memory heavy and CPU intensive to run the app in the browser. One table can have 500 records that the users can scroll through at once. Now imagine having 10+ of such tables in one tab, and each report comprising of multiple tabs. And we also support features like drilldowns/breakdowns, column freezing, row freezing, in the tables all while ensuring a smooth user experience.
We decided to build it from scratch using React Virtualize since most table libraries did not give us the performance or features we need. We also extensively use charts to visualize data and as we are scaling, a lot of these components have to be rebuilt to handle the volume of data we process.
We are only getting started, we want to make our platform a lot more collaborative and immersive by giving teams ability to interact with charts by adding annotations and ability to tag team members and leave notes for them. This might seem a solved problem when you look at collaboration on Google Docs but it's an extremely tricky problem for us as we don't deal with static data the way you have it with Google Docs.
Unlike read only dashboards which do not allow edits after building, our platform is meant for collaboration within teams. Think of how shitty collaboration was for design teams before Figma.
What we are looking for?
We are looking for someone who obsesses over performance and is comfortable with profiling performance, can think of frontend architecture. We are also looking for a lead who can mentor the team on performance and scale.
While working with such complex interfaces, often times, performance and the tech becomes a bottleneck for the user experience we strive for. We are looking for someone who —
- Understands fundamentals of Application Design and has designed/architected applications from scratch.
- Has worked on large-scale applications, and setup/maintained its data pipelines (data flows from backend to frontend)
- Has architected efficient and reusable front-end systems that drive complex web applications
Preferable Qualifications
- 3+ years of JavaScript experience, including concepts like asynchronous programming, closures, types.
- HTML/CSS experience, including concepts like layout, specificity, cross browser compatibility, and accessibility
- Experience with browser APIs and optimizing frontend performance
- Previous experience with dashboard apps, charts framework, window virtualisation
- Has written Generators for project setup
- Comfortable with tech like Postgres, Docker, Rails
- Understands tooling like Webpack, Babel
Experience with React and Typescript is preferable but not necessary.
First 30 days, one will work on
- Understanding the data flow and familiarise oneself with the app components
- One feature/task like updating something that touches majority of the app — this is again aimed to get familiarity with the whole codebase in the quickest way
- Synchronising the data pipelines by adopting better serialisation protocols
- Creating avenues to improve app performance (by profiling and benchmarking)
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon