PythonData Engineer — AI / BI
Artificial Intelligence & Business Intelligence | Data & Analytics
Who We Are:
Since our inception back in 2006, Navitas has grown to be an industry leader in the digital transformation space, and we’ve served as trusted advisors supporting our client base within the commercial, federal, and state and local markets.
What We Do:
At our very core, we’re a group of problem solvers providing our award-winning technology solutions to drive digital acceleration for our customers! With proven solutions, award-winning technologies, and a team of expert problem solvers, Navitas has consistently empowered customers to use technology as a competitive advantage and deliver cutting-edge transformative solutions.
Position Overview
We are seeking a Databricks Engineer to design, build, and operate a Data & AI platform with a strong foundation in the Medallion Architecture (raw/bronze, curated/silver, and mart/gold layers). This platform will orchestrate complex data workflows and scalable ELT pipelines to integrate data from enterprise systems such as PeopleSoft, D2L, and Salesforce, delivering high-quality, governed data for machine learning, AI/BI, and analytics at scale.
You will play a critical role in engineering the infrastructure and workflows that enable seamless data flow across the enterprise, ensure operational excellence, and provide the backbone for strategic decision-making, predictive modeling, and innovation
Responsibilities:
Data & AI Platform Engineering (Databricks-Centric):
- Design, implement, and optimize end-to-end data pipelines on Databricks, following the Medallion Architecture principles.
- Build robust and scalable ETL/ELT pipelines using Apache Spark and Delta Lake to transform raw (bronze) data into trusted curated (silver) and analytics-ready (gold) data layers.
- Operationalize Databricks Workflows for orchestration, dependency management, and pipeline automation.
- Apply schema evolution and data versioning to support agile data development.
Platform Integration & Data Ingestion:
- Connect and ingest data from enterprise systems such as PeopleSoft, D2L, and Salesforce using APIs, JDBC, or other integration frameworks.
- Implement connectors and ingestion frameworks that accommodate structured, semi-structured, and unstructured data.
- Design standardized data ingestion processes with automated error handling, retries, and alerting.
Data Quality, Monitoring, and Governance:
- Develop data quality checks, validation rules, and anomaly detection mechanisms to ensure data integrity across all layers.
- Integrate monitoring and observability tools (e.g., Databricks metrics, Grafana) to track ETL performance, latency, and failures.
- Implement Unity Catalog or equivalent tools for centralized metadata management, data lineage, and governance policy enforcement.
Security, Privacy, and Compliance:
- Enforce data security best practices including row-level security, encryption at rest/in transit, and fine-grained access control via Unity Catalog.
- Design and implement data masking, tokenization, and anonymization for compliance with privacy regulations (e.g., GDPR, FERPA).
- Work with security teams to audit and certify compliance controls.
AI/ML-Ready Data Foundation:
- Enable data scientists by delivering high-quality, feature-rich data sets for model training and inference.
- Support AIOps/MLOps lifecycle workflows using MLflow for experiment tracking, model registry, and deployment within Databricks.
- Collaborate with AI/ML teams to create reusable feature stores and training pipelines.
Cloud Data Architecture and Storage:
- Architect and manage data lakes on Azure Data Lake Storage (ADLS) or Amazon S3, and design ingestion pipelines to feed the bronze layer.
- Build data marts and warehousing solutions using platforms like Databricks.
- Optimize data storage and access patterns for performance and cost-efficiency.
Documentation & Enablement:
- Maintain technical documentation, architecture diagrams, data dictionaries, and runbooks for all pipelines and components.
- Provide training and enablement sessions to internal stakeholders on the Databricks platform, Medallion Architecture, and data governance practices.
- Conduct code reviews and promote reusable patterns and frameworks across teams.
Reporting and Accountability:
- Submit a weekly schedule of hours worked and progress reports outlining completed tasks, upcoming plans, and blockers.
- Track deliverables against roadmap milestones and communicate risks or dependencies.
Required Qualifications:
- Hands-on experience with Databricks, Delta Lake, and Apache Spark for large-scale data engineering.
- Deep understanding of ELT pipeline development, orchestration, and monitoring in cloud-native environments.
- Experience implementing Medallion Architecture (Bronze/Silver/Gold) and working with data versioning and schema enforcement in enterprise grade environments.
- Strong proficiency in SQL, Python, or Scala for data transformations and workflow logic.
- Proven experience integrating enterprise platforms (e.g., PeopleSoft, Salesforce, D2L) into centralized data platforms.
- Familiarity with data governance, lineage tracking, and metadata management tools.
Preferred Qualifications:
- Prior UMGC or USM experience preferred.
- Experience with Databricks Unity Catalog for metadata management and access control.
- Experience deploying ML models at scale using MLFlow or similar MLOps tools.
- Familiarity with cloud platforms like Azure or AWS, including storage, security, and networking aspects.
- Knowledge of data warehouse design and star/snowflake schema modeling.
Equal Employer/Veterans/Disabled
Navitas Business Consulting is an affirmative action and equal opportunity employer. If reasonable accommodation is needed to participate in the job application or interview process, to perform essential job functions, and/or to receive other benefits and privileges of employment, please contact Navitas Human Resources.
Navitas is an equal opportunity employer. We provide employment and opportunities for advancement, compensation, training, and growth according to individual merit, without regard to race, color, religion, sex (including pregnancy), national origin, sexual orientation, gender identity or expression, marital status, age, genetic information, disability, veteran-status veteran or military status, or any other characteristic protected under applicable Federal, state, or local law. Our goal is for each staff member to have the opportunity to grow to the limits of their abilities and to achieve personal and organizational objectives. We will support positive programs for equal treatment of all staff and full utilization of all qualified employees at all levels within Navitas.
Shubham Vishwakarma
Full Stack Developer - Averlon
About TECHNAVITAS INFO INDIA PVT LTD
About
Company social profiles
Similar jobs
NextJs (Next.js)The QA specialist is responsible for daily product testing, ensuring high-quality standards, and reporting issues directly to the Team Leader.
- Test the product every day to identify defects and ensure functionality.
- Assure the quality of the product by adhering to quality standards and specifications.
- Communicate proactively with the Team Leader (TL) for all identified issues, bugs, and status updates.
C++CThe Senior Software Engineer works with an experienced cross-functional team to deliver innovative wireless communication security products. They will utilize real world knowledge and a disciplined approach to product development, and adapt readily - Time-To-Market demands, ensuring product quality and timely delivery in a highly dynamic market environment.
ESSENTIAL FUNCTIONS :
- Design and deliver server platform based software products from conceptual stages to production delivery.
- Work independently on all phases of server centric software development including specification, architecture design, rapid prototyping, efficient coding, integration, debug and unit testing. Support UL and EN regulatory compliance
- Work collaboratively and effectively as part of a small team on fast paced projects that have tight deadlines.
- Support manufacturing life cycle for new products from NPI to production run and incremental software release of functionality.
- Lead, train, and mentor junior engineers
- Document and present design requirements to staff
- Possess a demonstrated ability to communicate with customers via email and phone
REQUIRED SPECIFIC JOB KNOWLEDGE, SKILL AND ABILITY :
The individual must possess the following knowledge, skills and abilities and be able to explain and demonstrate that he or she can perform the essential functions of the job, with or without reasonable accommodation, using some combination of skills and abilities.
- Must be an excellent SW developer. We expect experience developing software C/C++ in Linux and Perl. Other scripting languages is a plus (i.e. Python).
- Strong experience with SQL, Database design (MySQL a plus)
- Experience with Network Security Administration and understanding of the full SDLC.
- Experience with Multithread, Socket connection, OpenVPN server setup, OpenSSL, Certificate, Encryption, and TCP/IP troubleshooting.
- Experience with Testing tools, virtualizing servers, and using source control (SVN a plus).
- Experience with Linux development infrastructure, tool chain and build environment (Jenkins a plus).
- Experience developing both Linux application software; installing Linux software and configuring Linux systems.
- Experience with Application server remote update, and Apache Server authentication.
- Proven record of designing and delivering complex networking products from inception to production delivery.
- Previous experience developing quality software for commercial products.
- Experience with communication systems involving wireless, radio, security and mesh networking technologies is a plus.
Experience with OSI networking protocols and applications is a plus.
- Experience with system development tools, including Source-Level Debuggers, Protocol Analyzers (Wireshark), Code Analysis tools, etc.
- Experience with any of the following is nice to have: Apache Server, GPIO, TCL/Tk, BACnet, Cloud server setup, and WebGUI design (javascript and jQuery a plus).
Data AnalyticsThirumoolar IT Solutions is looking for a motivated and enthusiastic Fresher Trained Dataset Engineer to join our team. This entry-level position is ideal for recent graduates who are eager to apply their academic knowledge in a practical setting and contribute to the development of high-quality datasets for machine learning applications.
Responsibilities
Assist in the collection, cleaning, and preprocessing of data to ensure it is ready for training machine learning models.
Collaborate with senior dataset engineers and data scientists to understand the requirements for specific machine learning tasks.
Participate in the annotation and labeling of datasets, ensuring accuracy and consistency in data representation.
Conduct quality checks on datasets to identify and rectify errors or inconsistencies.
Support the development of documentation and guidelines for data annotation processes.
Stay updated with the latest tools and techniques in data processing and machine learning.
Skills and Qualifications
Bachelor’s degree in Computer Science, Data Science, Mathematics, or a related field.
Basic understanding of machine learning concepts and the importance of high-quality datasets.
Familiarity with programming languages such as Python or R is a plus.
Knowledge of data manipulation libraries (e.g., Pandas, NumPy) is advantageous.
Strong analytical skills and attention to detail.
Excellent communication and teamwork abilities.
A passion for learning and a desire to grow in the field of data engineering.
Preferred Location
Candidates based in Tamil Nadu or those willing to work from home are encouraged to apply.
Responsibilities:
-- Contact potential and existing customers to inform them about fabric products and services using sales scripts
-- Answer questions about fabrics and the company
-- Understand customer requirements and close sales
-- Direct prospects to the field sales team when needed
-- Enter and update customer information in the database
-- Take and process fabric orders accurately
-- Handle customer grievances to preserve the company's reputation
-- Meet sales quotas and facilitate future sales
-- Keep records of calls, sales, and useful customer information
-Requirements:
-- 2+ years of proven experience as a telesales representative or in other sales/customer service roles
-- Demonstrated track record of successfully meeting sales quotas, preferably over the phone
-- Good knowledge of relevant computer programs (e.g. CRM software) and telephone systems
-- Ability to learn about fabric products and services and describe/explain them to prospects
-- Excellent communication and interpersonal skills
-- Ability to handle rejection and remain cool-tempered
-- Outstanding negotiation skills with the ability to resolve issues and address complaints
-- High school diploma; BSc/BA preferred
About the company
"Since 1966, Luthra Exports has been a leading name in India's textile industry, specializing in premium Surat-based fabrics. With offices in New Delhi and Surat, Gujarat, we serve customers nationwide with a wide range of quality polyester and viscose fabrics.
PHP
Laravel
CodeIgniterJob Purpose
We work in the latest technology, and our foundations are data structures, algorithms, solid logical reasoning, and mathematics. We are looking for very strong engineers who love coding, optimizing, and ensuring their code is the most efficient.
You will be involved with hardcore development. If you are an assembler of code or packages from different places to build something, you may not find our team to be the right fit.
You must be someone who can build anything from the ground up. Programming language should not be any barrier for you, as you should be able to pick up any programming language or underlying technology within a week.
Key Areas of Responsibility
Core development. Ready to participate in the designing, brainstorming, and development process. You must give sleepless nights to meet deadlines whenever required.
Desired Candidate Profile
Essential Skills
- Reliable, Accountable, and Trustworthy
- Ability to understand software requirements based on a wireframe/program specification
- Familiarity with GoLang / PHP / Python / Java / C / C++ / Linux Shell and Scripting / HTML / CSS / JS / Node.js is a plus
- Effective communication skills to ensure smooth coordination of tasks with the Team Leader.
- Knowledge of MongoDB, MySQL, and PL/SQL is a plus
- Familiarity with ML, TensorFlow, and Keras is a plus
- Knowledge of web servers such as Apache, NGNIX, and the HTTP protocol is a plus.
- Knowledge of multi-process, threads, memory, and filesystem on Linux is desirable.
- Must Solve The Following
To consider you for the current opening, please make sure to understand the following question and solve it. A simple program in any programing language would do. If you cannot solve this, please do not apply.
Write a function foo(x) where foo(foo(x)) = -x (assume x to be an integer, and foo(x) has to be always real), any programming language would do. Before submitting the answers, please verify that the output of foo(foo(10)) should be -10 and foo(foo(-10)) should be 10.
.NET
AngularJS (1.x)
Angular (2+)
JavascriptJD-
• Experience in C# ASP.NET + MVC + Entity Framework development
• Experience in JavaScript and jQuery
• Experience in Web Services and third party API Integrations
• Experience in SQL Server databases
Responsibilities
• Design, code, test, and manage various applications
• Collaborate with the engineering team and product team
• Follow outlined standards of quality related to code and systems
• Deploy tested code to the production environment
NodeJS (Node.js)
HTML/CSS
PostgreSQL
JavaRoles & Responsibilities:
- Work as a Web Developer to create front end & backend of websites
- Play a key role in the design lifecycle, from brief through to design and release/implementation
- Should have good knowledge of HTML, CSS, REACT JS, NODE JS, POSTGRES, GIT, REST API.
- A good understanding of servers, hosting, domains, DNS
- Ensure all designs work across all browsers and on all devices
- Help to design elements of mobile apps
- Ensure all designs are produced to deliver a great user experience
Key Skills/Experience:
- A minimum of one year of experience in designing and developing websites and web apps
- Good working experience in React JS, Redux, JavaScript ES6, NodeJS, AJAX, HTML, CSS, etc
- Knowledge about REST API
- Who has worked on libraries such as Bootstrap, Material is.
- Experience with Unit testing, Git, GitHub, and other DevOps and CI/CD tool
- A strong portfolio that demonstrates a range of work and techniques
- A passion for strong web design that delivers a great user experience
- A good understanding of the latest web design trends
React.jsJavascriptHTML/CSS
Vue.js
Required Skills/Experience
If a misaligned shadow bothers you, we already like you 😆
- Master's / Bachelor’s degree in Computer Science, Software Engineering, or Self taught developer.
- 3+ years of experience in fundamentals of web, HTML, CSS and JavaScript.
- Familiarity with JavaScript frameworks such as Vue or React.
- Understanding of product design, user experience and skills to recreate and match high quality pixel perfect designs and can go above and beyond in detailing.
- Has ability to build a ground up resoluble components and in-house UI system that can scale across the product.
Responsibilities
A collaborative role with Individual ownership ✅
- Ownership of developing UI related features. Work with with the rest of the engineering team to develop, launch or maintain features.
- Take ownership of design <> dev collaboration and participate in the education of both sides.
- Work closely with design team and become a bridge between engineering and design.
- Maintain code integrity.
JavascriptJava
Spring BootVue.jsAs a Technical member of the company, you should be comfortable around both front-end and back-end coding languages, development frameworks, and third-party libraries. You should also be a team player with a knack for visual design and utility.
React Native
Redux/FluxReact.jsResponsibilities
- Build pixel-perfect UIs across both mobile platforms.
- Leverage native APIs for deep integrations with both platforms.
- Diagnose and fix bugs and performance bottlenecks for performance that feels native.
- Maintain code and write automated tests to ensure the product is of the highest quality.
- 1- 3 years as a professional software developer.
- Experience with React, React Native and Redux
- Experience with at least one native mobile platform (bonus points if you moved to React Native from iOS or Android development).
- Firm grasp of the JavaScript language and its nuances, including ES6+ syntax. Knowledge in TypeScript is a plus point.
- Knowledge of functional and object-oriented programming.
- Familiarity with native build tools, like Xcode & Android Studio.
- Understanding of REST APIs, the document request model, and offline storage.
We are looking for passionate professionals who are crazy about breaking the norms and make people take notice. You should be obsessively result oriented, willing to take informed risks and learn fast from your mistakes. You’ll be working directly with the founders on the technology platform. Being part of the core team, will be working on challenging problems and will have complete ownership of various features of the products. Your opinion will count and your ideas will translate into reality. The position will be based out of Bangalore. You will, perhaps, lead our engineering efforts eventually.
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon