
Role Summary
We are hiring a Data Engineer / ML Data Pipeline Engineer to build and operate the data backbone of the Enterprise AI platform:
What You'll Own
- Ingestion & ETL/ELT pipelines for heterogeneous project folders (PDF drawings, SVG files, IFC models, BBS.json bar-bending-schedule data, Excel exports, and AI agent output JSON).
- AWS-based data architecture: S3 raw/staging/curated/outputs structuring, partitioning, versioning, and lifecycle management; querying via Athena/Glue and warehousing via Redshift or Snowflake as needed.
- Data validation frameworks: GUID cross-referencing between SVG and BBS data, schema enforcement, duplicate/orphan detection, reference integrity checks, and structured validation reporting.
- Agent run logging & observability: designing the database schema and pipelines that track every AI agent run (inputs, outputs, status, errors, cost, retries, reviewer feedback).
- AI Factory monitoring dashboards: operational dashboards (failure rates, retries, latency, data quality) and business dashboards (throughput, cost per run, rework rate) for Power BI/QuickSight or equivalent.
- ML data pipeline support: dataset preparation, labeling/annotation workflows, human-in-the-loop review tooling, and dataset versioning for models that classify or QC drawing issues.
- APIs: designing and building FastAPI/Flask endpoints to trigger validation runs and expose agent processing status to internal tools.
- Data quality & testing discipline: idempotent pipelines, quarantine/reject handling, regression and reconciliation testing, and root-cause debugging when pipelines or query performance degrade in production.
Key Skills — Non-Negotiable (Must-Have, Strong Level)
- Python — production-grade scripting: file/folder handling, JSON/schema processing, clean error handling, not just notebook-level scripting.
- SQL — strong hands-on ability, including GROUP BY/HAVING for duplicate detection, window functions, and daily aggregate/rate calculations (e.g., success-rate queries).
- AWS S3 data handling — practical experience structuring buckets for raw/staging/curated data, versioning, and avoiding overwrite issues at scale.
- Data validation — demonstrable experience building validation logic (set comparisons, duplicate/missing detection, structured pass/fail reporting), not just "I write assertions."
- ETL/ELT pipeline design — end-to-end ownership of at least one pipeline: source → transform → storage → validation → monitoring → business outcome, with clear articulation of what they personally built.
- Query/warehouse engine judgment — working knowledge of when to use Athena vs. Redshift vs. Snowflake (or equivalent), partitioning, clustering, sort/distribution keys, and storage format trade-offs (Parquet vs. JSON vs. CSV).
Key Skills — Good to Have
- Dashboarding — Power BI / QuickSight (or equivalent) fact/dimension table design, KPI cards, drill-downs; medium-to-strong level is a plus but trainable.
- FastAPI / Flask — building real endpoints with request/response schemas and basic error handling; especially valuable for validation-trigger and agent-status APIs.
- ML data pipeline experience — dataset labeling, annotation platform design, train/test/validation splitting, dataset versioning; strong on the pipeline/data side rather than model training itself.
- Human-in-the-loop / review tooling — experience building or contributing to browser-based labeling/review platforms (session persistence, label schema, export formats).
- Large-scale metadata querying — experience making file discovery fast across large volumes (1,000+ projects, thousands of files each) via metadata index tables, event-based ingestion, or catalog tools like AWS Glue.

About J&F
About
At J&F, we are a globally established engineering consultancy with over 500 engineers and detailers across five countries, delivering high-quality engineering solutions for buildings and infrastructure projects. We specialize in BIM-enabled Structural and MEP engineering, combining deep technical expertise with digital innovation to help clients execute complex projects efficiently, accurately, and at scale.
Through our two core business lines—Virtual Technical Office and End-to-End Engineering Solutions—we provide tailored engineering support as well as fully integrated project planning and supervision. By partnering closely with our clients, we deliver sustainable, cost-effective, and technology-driven solutions across a wide range of sectors, ensuring engineering excellence throughout every stage of the project lifecycle.
Similar jobs
Minimum 7 years experience : Individual Contributor ( Back-end plus Cloud- Infra)
Banking/Payments Domain : Worked on projects from scratch and scaled
Experience with Payment Gateway Companies is a plus
Tech Stack
Java SpringBoot,AWS,GCP,REST
Worked on CI/CD (Manage and setup )
Different SQL and NO-SQL Databases -,PostgreSQL,MongoDB
Responsibilities:
End to end coding ; from software architecture to managing scaling,of high throughput(100000)RPS high volume transactions.
DIscuss business requirements and timelines with management and create a task plan for junior members.
Manage the day to day activities of all team members and report their work progress
Mentoring the team on best coding practices and making sure modules are Live
on time.
Management of security vulnerabilities.
Be a full individual contributor which means can work in a team as well as alone.
Attitude:
Passion for tech innovation and solve problems
GoGetter Attitude
Extremely humble and polite
Experience in Product companies and Managing small teams is a plus
Qualifications:
• 10+ years native mobile development (iOS Swift + Android Kotlin)
• Proven experience building mission-critical, offline-first applications
• Deep understanding of mobile architecture patterns (MVVM, Clean Architecture)
• Expert-level API integration and data synchronization strategies
• Experience with emergency services, healthcare, or field operations software (preferred)
• Strong debugging, performance optimization, and memory management skills
• Demonstrated leadership in establishing mobile development best practices
TECHNICAL EXPERTISE:
• iOS: Swift 5.x, SwiftUI/UIKit, CoreData, CoreLocation, Background Tasks
• Android: Kotlin, Jetpack Compose, Room, WorkManager, Location Services
• Tools: Xcode, Android Studio, Git, Figma, Firebase, TestFlight/Play Console
• CI/CD: Fastlane, GitHub Actions, or similar automation tools
• APIs: RESTful services, JSON parsing, authentication/authorization
• Testing: XCTest, Espresso, automated UI testing frameworks
Responsibilities:
CORE RESPONSIBILITIES:
• Architect mobile applications for First Due's emergency response platform serving Fire and
EMS agencies nationwide
• Lead mobile development initiatives for the Hyderabad development center
• Design offline-first architectures ensuring reliability in low-connectivity emergency
scenarios
• Collaborate with cross-functional teams across US and India time zones
• Establish mobile CI/CD pipelines, coding standards, and quality assurance processes
• Mentor developers on mobile best practices and First Due's technology stack
• Drive sprint planning, velocity tracking, and technical roadmap for mobile development
• Ensure HIPAA compliance and data security for patient care reporting features
Work Location: Hyderabad, India
Work mode: Work From Office
5+ years of experience in developing web applications using Vuejs & ReactJS
- Building modular and reusable components and libraries
- Focus on security updates and issues found with Vue.js and all project dependencies
- Proficient with the JavaScript language and TypeScript
- Proficient with Vue.js framework and Vue3, HTML5 and CSS3, Java Script, TypeScript or its core principles such as components
- Familiarity with the Vue.js ecosystem, including Vue CLI, Vuex, Vue3
- Good understanding of HTML5 and CSS3
- Ability to write efficient, secure, well-documented, and clean JavaScript code
- Proficiency with modern development tools, like Git
- Experience with both consuming and designing RESTful APIs
- DevOps Mindset
- Strong communication skill and Good on soft skills as working with client directly
One of our premium-based product customers, we are looking to hire a team of software Developers in Bangalore, looking for Tech Geeks, who have 2+ years of experience full-time.
SENIOR SOFTWARE DEVELOPMENT ENGINEER - FRONTEND
● Overall, 2-4 years of experience.
● Solid foundations of Javascript, Responsive web, CSS, Semantic HTML and how the
internet works.
● Strong proficiency with React and its core principles. React Native is a plus.
● Solid understanding of Chrome dev tools, APIs and frontend performance.
● Working knowledge of GitHub and popular cloud platforms like AWS, Fly, Cloudflare,
etc.
● Understanding of software design patterns, high-level design and architecture.
● Ability to independently do LLD and technology exploration around a given problem
statement.
· Minimum 4+ years of experience as a Fullstack Developer with expertise in Angular, React, and Golang.
· Strong knowledge and hands-on experience in database technologies such as PostgreSQL, Redis, and Cassandra.
· Proficiency in front-end development using Angular and React frameworks.
· Solid understanding of server-side development using Golang and building RESTful APIs.
· Experience with database design, optimization, and query optimization techniques.
· Familiarity with version control systems (e.g., Git), issue tracking tools, and agile methodologies.
· Strong problem-solving and analytical skills.
· Excellent communication and collaboration abilities.
Ability to work effectively in a fast-paced, dynamic environment and meet project
About Tweeny:
We are a team of passionate software Ninjas who design scalable software solutions.
We solve some of the interesting problems for our clients in a variety of sectors. We are also developing our own products where we are seeking bright minds with creative thinking.
We are a fast-paced and young team of fun-loving engineers. For us, work is not just a job but it's a way to grow & learn together while doing what we love.
We are looking to hire on MERN stack position (full stack engineering profile) although if you have worked only on either ReactJS/Native or NodeJS stack, please do apply as well.
We are hiring for a few specific teams at our organization that is building utility and functional web application experiences (as marketplace applications) that solving some interesting problems for remote workforce management.
Requirements:
- 2-5 years of experience working with React JS, Node JS, and other advanced JavaScript libraries and frameworks.
- Ability to understand business requirements and translate them into technical requirements.
- Strong software engineering skills with the proven ability to build, deploy, and maintain a scalable codebase.
- Experience working with remote data using RESTful APIs and JSON.
- Strong understanding of development tools and technologies like ES6, Redux, Immutable, JSX Components, Bootstrap, HTML, CSS, Git, NPM, Express.
- Strong understanding of any build tool like Webpack, Babel, Gulp, or similar.
- Strong affinity for benchmarking and performance optimization.
- Experience deploying applications to the cloud and setting up CI/CD is a plus.
- Experience building container images using tools like Docker is a plus.
- Ability to learn new languages and technologies.
- B.E/B.Tech in Computer Science, Engineering, or a related field.
Responsibilities:
- Produce clean, efficient code based on specifications
- Integrate software components and third-party programs
- Verify and deploy programs and systems
- Troubleshoot, debug and upgrade existing software
- Recommend and execute improvements for the software development and software delivery life cycle
- Ensure the highest standard of performance, quality, and responsiveness of the applications.
Strong computer science fundamentals in algorithms, data
structures, storage technologies, distributed computing,
operating systems, etc.
Experience in designing and implementing scalable solutions
in a large scale distributed environment.
Robust and defensive coding skills using Java/Golang or any
other Object Oriented Programming Language.
Strong knowledge of RDBMS and any other NoSQL database
technologies (Cassandra, HBase, MongoDB, Dynamo etc.) .
Experience with building self healing, automatic fault
detection and recovery mechanisms is good to have.
Desired Skills and Experience
Java or golang
Job Description
Experience : 3+ years in end to end US Technical Hiring
Location : Pune
Notice Period : Immediate Preferred
To be eligible you must be:
- Excellent in sourcing through Job Portals, Social Media, x ray Search-Booleans, etc.
- Responsible for full-cycle recruiting: Sourcing the candidates, screening them, Interview coordination, rate negotiation and hand-holding all the way till closure
- Exceptional communication, interpersonal, and decision-making skills
- Able to analyze resumes and determine appropriate matches for vacancies
- Understanding of impact to business and metrics
- Technical expertise with an ability to understand and explain job requirements for IT roles
- Hands on experience with Applicant tracking systems
- Ability to listen, understand, convey, and relate ideas, concepts and issues clearly and confidently through all channels while having an awareness of environmental cues
- Understanding of various visa status and Tax Terms (C2C, C2H, W2, 1099, Permanent).
- Willing to work in Night Shift (USA TIME ZONE)
Roles & Responsibilities:
- Effectively sourcing right fit and getting closures on time
- Coordinate with multiple Vendors and onsite teams to gather exact requirements and schedule Interviews
- Maintain and develop pipeline of eligible candidates for future open positions
- Qualify or reject candidates based on interview feedback and resume reviews
- Serve as contact person for questions from candidates
- Understand hiring leaders needs and deliver value by crafting best solutions for them
- Work on different recruitment metrics and share with business/team as and when required
RESPONSIBILITIES AND QUALIFICATIONS
Responsibilities
+ Design, build and maintain low latency, high-performance electronic trading platform components, with a focus on market data, exchange and client connectivity and risk controls.
+ Deliver continuous optimization for latency, scale and resiliency improvements.
+ Participate in system builds for various markets globally, have curiosity and interest in understanding market microstructure details, work closely with engineering, sales and product teams globally for successful delivery of projects.
+ Basic Qualifications
+ Bachelors or Masters degree in computer science or engineering or equivalent experience
+ 5+ years of professional experience developing deterministic high performance, low latency systems in python/C++ (counted in single digit microseconds)
+ Prior experience with FIX and binary exchange connectivity and market data protocols preferred
+ Strong knowledge of object oriented programming, data structures, algorithms and design patterns
+ Critical path analysis, performance optimization and hardware acceleration.
+ Linux systems programming experience including memory management, concurrent programming infrastructure, and the networking stack
+ Experience developing distributed architecture systems and messaging protocols
+ Strong analytical and problem solving skills
+ Comfortable in a fast-paced environment, self-motivated, results driven and commercially focused
Preferred Qualifications
+ Software development in python/C++ in the context of high performance (low- latency, high-throughput) real-time computing.
+ Familiarity with STL and C++11 language extensions, Boost
+ Network programming (sockets, TCP/UDP/Multicast protocols)
+ Multi-threading, concurrent programming
+ Intimate knowledge of compilers, flow of data at hardware level (memory/ caches, buses) + Some experience with FPGA or other hardware acceleration technologies
+ Experience processing large static datasets as well as high volume ticking data sources
+ Over 3 years' experience in Financial industry (Plus)

- Deep experience on Performance Engineering with understanding of Java/J2EE technologies.
- Experienced in defining and realizing end-to-end Technical Architecture for large scale real- time enterprise systems. Ability to identify and define non-functional requirements and design systems to meet the same.
- Ability to review existing Architectures and identify Risks, Trade-offs, and share recommendations for addressing the identified issues.
- Demonstrate strong understanding of cloud architecture considerations when scaling and tuning application deployments. Must have hands on experience working on any of the Cloud deployments on AWS or Azure.
- Good experience on leveraging APM tools to provide deep dive analysis on performance problems. Deep understanding of the dashboards which can be built for CIO level interactions. Must have relevant experience on APM tools like Dynatrace or AppDynamics.
- Experience in performance optimization of J2EE systems on any of different types of application servers - WebLogic, WebSphere, JBoss etc. Deep expertise in any one of the application servers is a must.
- Experience in creating and reviewing technical documents like Architecture blueprint, Design specifications, Deployment architecture.
- Experience on working on Performance Testing Projects. Fair understanding of Performance Testing tools - Apache JMeter /Gatling/ HP Load Runner for Load testing. Must be in a position to review Performance Testing programs and steer directions towards right Workload Model, appropriate Test and Monitoring Strategy, build performance models and derive at right Capacity Planning.
- Experience in Big Data Analytics like - Apache Kafka, Apache Storm, Apache Hadoop, Apache Spark.
- Good skills in RDBMS like: Oracle, MS-SQL, MySQL, Cassandra, and Mongo DB
- Exposure to Agile methodologies & Continuous Integration Tools
- Entrepreneur / Intrapreneur (someone who has built technology teams ground-up, built new solutions from scratch)
- Very sound understanding of technology and have a consultative approach.
- Sound understanding of complex enterprise IT environment and issues faced by CIOs in the digital era.
- Excellent Pre-sales experience and have played a key role in winning business along with the sales team.
- Excellent communication, interpersonal, liaison and problem-solving skills with the ability to work in a multi-cultural environment
- Good negotiation skills
- Go getter and results oriented
- High energy level with ability to work well under pressure
- Good relationship building skills. Someone who enjoys CIOs trust and has an ability to develop relationships at all levels (technology teams) of the customer organization.








