Cutshort logo
Compile logo
Principal Data Engineer (Real World Data)
Principal Data Engineer (Real World Data)
Compile's logo

Principal Data Engineer (Real World Data)

Sarumathi NH's profile picture
Posted by Sarumathi NH
7 - 10 yrs
Best in industry
Bengaluru (Bangalore)
Skills
Data Warehouse (DWH)
Informatica
ETL
Spark

You will be responsible for designing, building, and maintaining data pipelines that handle Real-world data at Compile. You will be handling both inbound and outbound data deliveries at Compile for datasets including Claims, Remittances, EHR, SDOH, etc.

You will

  • Work on building and maintaining data pipelines (specifically RWD).
  • Build, enhance and maintain existing pipelines in pyspark, python and help build analytical insights and datasets.
  • Scheduling and maintaining pipeline jobs for RWD.
  • Develop, test, and implement data solutions based on the design.
  • Design and implement quality checks on existing and new data pipelines.
  • Ensure adherence to security and compliance that is required for the products.
  • Maintain relationships with various data vendors and track changes and issues across vendors and deliveries.

You have

  • Hands-on experience with ETL process (min of 5 years).
  • Excellent communication skills and ability to work with multiple vendors.
  • High proficiency with Spark, SQL.
  • Proficiency in Data modeling, validation, quality check, and data engineering concepts.
  • Experience in working with big-data processing technologies using - databricks, dbt, S3, Delta lake, Deequ, Griffin, Snowflake, BigQuery.
  • Familiarity with version control technologies, and CI/CD systems.
  • Understanding of scheduling tools like Airflow/Prefect.
  • Min of 3 years of experience managing data warehouses.
  • Familiarity with healthcare datasets is a plus.

Compile embraces diversity and equal opportunity in a serious way. We are committed to building a team of people from many backgrounds, perspectives, and skills. We know the more inclusive we are, the better our work will be.         

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Compile

Founded :
2011
Type :
Product
Size :
20-100
Stage :
Bootstrapped

About

Compile's data helps pharma and Medtech companies accelerate commercial effectiveness
Read more

Connect with the team

Profile picture
Clinton Fernandes
Profile picture
Yasharth Choudhary
Profile picture
Rejul S
Profile picture
Sanjay Pisharody
Profile picture
Anirudh Surendranath
Profile picture
Aditya Vikram Monga
Profile picture
Cyriac Thomas
Profile picture
Mithesh J C
Profile picture
Arjun Chilumula
Profile picture
Gayathri Balachandar
Profile picture
Naresh Kumar
Profile picture
Bharath Bommakanti
Profile picture
Ajmal Moideen
Profile picture
Shailesh Chitnis
Profile picture
Sarumathi NH
Profile picture
Xavier Mathew

Company social profiles

bloglinkedintwitter

Similar jobs

NeoGenCode Technologies Pvt Ltd
Akshay Patil
Posted by Akshay Patil
Remote only
5 - 12 yrs
₹2L - ₹10L / yr
Generative AI
Data engineering
AWS Bedrock
Retrieval Augmented Generation (RAG)
Llama
+6 more

Job Title : Data / Generative AI Engineer

Experience : 5+ Years (Mid-Level) | 10+ Years (Senior)

Location : Remote

Employment Type : Contract

Open Positions : 5


Job Overview :

We are hiring Data / Generative AI Engineers for remote contract engagements supporting client-facing AI implementations. The role involves building production-grade Generative AI solutions on AWS, including conversational AI systems, RAG-based architectures, intelligent automation platforms, and scalable data engineering pipelines.


Mandatory Skills :

Amazon Bedrock, Generative AI, RAG Architecture, LangChain/LlamaIndex/Bedrock Agents, Python (3.9+), AWS Serverless (Lambda, API Gateway, Step Functions), Vector Databases, Data Engineering & ETL, AWS Glue, Amazon Athena.


Key Responsibilities :

  • Design and build production-ready Generative AI applications on AWS.
  • Implement Retrieval-Augmented Generation (RAG) architectures for enterprise AI solutions.
  • Integrate Amazon Bedrock with foundation models and enterprise systems.
  • Develop AI agent orchestration workflows using frameworks such as LangChain, LlamaIndex, or Bedrock Agents.
  • Build and manage serverless architectures using AWS services like Lambda, API Gateway, and Step Functions.
  • Implement vector databases and semantic search solutions for intelligent knowledge retrieval.
  • Design and maintain data engineering pipelines and ETL workflows for large-scale data processing.
  • Use AWS Glue for data transformation and orchestration.
  • Utilize Amazon Athena for querying large datasets and performing analytics.
  • Develop scalable Python-based APIs and backend services.
  • Collaborate with cross-functional teams and clients to deliver AI-powered solutions in production environments.


Required Skills :

  • Strong experience with Amazon Bedrock and foundation model integrations
  • Hands-on experience with LangChain, LlamaIndex, or Bedrock Agents
  • Advanced Python (3.9+) development and API building
  • Experience with AWS serverless architectures (Lambda, API Gateway, Step Functions)
  • Experience implementing vector databases and semantic search systems
  • Strong knowledge of data engineering and ETL pipeline development
  • Hands-on experience with AWS Glue for data transformation and orchestration
  • Experience using Amazon Athena for querying and analytics
  • Experience building RAG-based AI applications

Engagement Details :

  • Contract Duration : Minimum 3 to 6 Months
  • Work Timing : 8:00 AM – 4:00 PM EST
  • Start Timeline : Within 2 Weeks
  • Open Positions : 5
Read more
Talent Pro
Bengaluru (Bangalore)
1 - 4 yrs
₹12L - ₹15L / yr
B2B sales
Supplychain Management

Strong Senior Solutions Engineer Profile

Mandatory (Experience 1) – Must have 1+ years of relevant experience in pre-sales solution engineering in a Supply Chain / Sourcing / Operations domain environment

Mandatory (Experience 2) – Must have hands-on experience conducting technical discovery sessions, client demos, and proof-of-concepts (POCs) with enterprise or mid-market clients

Mandatory (Experience 3) – Must have experience in solutioning, configuring, and implementing techical demos of SaaS products

Mandatory (Company) - B2B SaaS in Logistic Tech, Supply Chain Tech, Operations Tech, Retail Tech, ERP etc

Mandatory (Education): MBA + BE/B.Tech background required.

Read more
TheCodersHub
at TheCodersHub
2 candid answers
TheCodersHub Tech
Posted by TheCodersHub Tech
Remote only
0 - 0 yrs
₹0.1L - ₹0.1L / yr
skill iconFlutter
Firebase
BloC

Role Description

This is a volunteer remote Flutter unpaid internship role at TheCodersHub. The intern will be involved in day-to-day tasks related to Flutter development, assisting in app development projects, learning new technologies, and collaborating with team members remotely.


Qualifications

  • Flutter development skills
  • Experience in mobile app development
  • Basic knowledge of software development
  • Interest in learning and growing in the tech industry
  • Excellent problem-solving skills
  • Ability to work independently and remotely
  • Enrolled in or recent graduate from a relevant technical or computer science program


Benefits You’ll Receive:

  • Live Project Experience: Work on real-world projects to boost your practical knowledge.
  • Mentorship: Receive guidance from experienced developers to enhance your skills.
  • Internship Certificate: Awarded upon successful completion of the internship.
  • Skill Development: Improve your expertise in Flutter, state management, and project collaboration.


Read more
India’s largest mobility platform
India’s largest mobility platform
Agency job
via zyoin by Shubha N
Bengaluru (Bangalore)
3 - 9 yrs
₹9L - ₹45L / yr
skill iconSpring Boot
skill iconJava
Microservices

Roles and Responsibilities

Code, develop, design and architect features related to the existing application. We  expect you to own modules end to end and take pride in the work products you  ship.

Lead from the front, when it comes to delivering high quality work products. Serve as a mentor to the team members

Create and define performance metrics. Ideate, innovate and hack through the  existing systems to improve performance

Perform code reviews, set coding practices and guidelines within the team.

Make sense of the product specs, be nimble in getting the issues resolved. Be a thought leader.

Critical Functional Skills

Solid understanding and knowledge of Java/C/C++. You should understand the concepts of multithreading, I/O, messaging, instrumentation etc and their  implementation in Java/Any other ObjectOriented Language.

Proficiency in the implementation of algorithms and the use of advanced data  structures to solve problems in computing. A solid foundation in the principles of  computer science is desired.

Ability to write clean, modular, and loosely coupled code by the use of design patterns.

He/She should be able to break down and architect complex software systems. For example

BuildCars Availability Engine for Ola.

Strong decisionmaking ability

Deep expertise in at least one programming language & tech stack.

Substantial experience in building complex and scalable solutions.

Strong object oriented design skills, ability to apply design patterns, and an uncanny ability to design intuitive module and class level interfaces

The ability to do deep problem solving and build elegant, maintainable solutions to complex problems.

Experience leading multi engineer projects and mentoring junior engineers

Experience with full life cycle development in any programming language on a Linux platform

Comprehensive operational experience including, optimizations, deployments and tuning servers like apache/mysql/tomcat/solr

Prior experience in working with Agile software methodologies (XP, Scrum), TDD, and Continuous Integration(CI/CD) a plus.

Experience in building data driven web application design and development is a plus

Expert level experience in building a scalable, large and complex business application

.Experience Required

:Typically with an experience of 5+ years of development experience in a product  firm.

Must have lead, designed, architected and delivered at least 1 project in his previous assignments independently.

Minimum Qualifications Required

Btech/MS from a reputed Institute

Deep expertise with any or combination programming languages: Java, C++, C#, Ruby, Scala,

Go any object oriented high level proprietary or open source language with strong programming constructs. We are not skill specific but go by strength in  competencies Machine coding Single machine in memory program

Need a working code with functionality Readable and well designed code with right abstractions, separation of concerns,right design patterns

Performant code with concurrency and efficient data structures

Write test cases covering the happy path and edge cases

Problem Solving

Choose the right combination of data structures to solve the problem

Identify most edge cases for the problem

Identify opportunities of parallelism: utilizes multicore solutions where applicable

Design & Architecture

Distributed systems design and system interaction

Identify API signatures

LLD with class design

Solve for performance & availability

Read more
retail tech start-up
retail tech start-up
Agency job
via Qrata by Rayal Rajan
Bengaluru (Bangalore)
5 - 12 yrs
₹35L - ₹70L / yr
skill iconNodeJS (Node.js)

Engineering Manager

Bengaluru

Work Type: Full Time

 

We're building E-commerce, Fintech & Supply Chain stacks for Indian Retail & heads down focused on solving the hard, industry-defining challenges. If you love the first principle approach, freedom to build & own your outcomes, It is the place! Welcoming all entrepreneurial minds to BUILD & blitz scale with us!

 

Responsibilities:

  • Work with other our leaders to design and drive the plan for the company's vision.
  • Recruit great engineers, in collaboration with our recruiting team.
  • Develop engineers on the team, helping them advance in their careers.
  • Empower the engineering team to achieve a high level of technical productivity, reliability and simplicity.
  • Contribute to engineering-wide initiatives as a member of our engineering management team.

 

Requirements:

  • Bachelor's degree in Computer Science or related technical discipline (Tier I colleges preferable).
  • A track record of leading productive engineering teams.
  • Successfully recruited great people to your teams.
  • The ability to thrive on a high level of autonomy and responsibility.
  • The desire to encourage a healthy work environment that's both supportive and challenging.
  • A genuine excitement to help engineers develop new skills and advance in their careers.
  • Enough technical sense to ask engineers good questions about architecture and product decisions.
  • 7+ years of relevant engineering and hands-on technical management experience.
  • Previous experience at good tech startups/product companies.
  • Strong hands-on experience in full stack development and architecture using NodeJS, MVC, microservices, UI & UX (React), ORM tool (Sequelize), CICD tools (Git, Jenkins, AWS).
  • Excellent knowledge of RDBMS, SQL, NoSQL, Cache, Linux based systems.
  •  

About the company

 

Founded by ex-Flipkart leadership and IIT alumni, Arzooo is a vertical focused e-commerce startup, digitising the Consumer Electronics value chain in India.

 

It started as a B2B platform empowering thousands of Consumer Durables stores with the best of pricing & product selection through its e-commerce stack and also creating a very efficient supply chain infrastructure across tier-2,3,4 towns in India. The recent foray into fintech has enabled us to empower Indian retail with a low cost, digital-first Credit alternative, which is unlocking immense scale for us

 

We are the largest e-comm player in India in the Electronics domain, and scaling fast towards capturing this multi-billion opportunity. With a presence in 300+ cities, we're now building a direct to consumer platform on top of our existing network of thousands of Durables stores. Through the direct to consumer platform we're taking all these stores online with Live Commerce capabilities, building appliances focused shopping experience for tier-2+ India.

We're a team of 400+ with deep experience in scaling startups, and we are building this team further now.

Read more
EyeT Innovations Software Solutions Pvt Ltd
Kochi (Cochin)
1 - 2 yrs
₹2L - ₹3L / yr
Communication Skills
Lead Generation
Effective communication

Job Description - Online Bidder

Roles & Responsibilities:

  1. ·Manage company’s various online bidding profiles
  2. ·Identifying quality lead and bringing up the projects for the company
  3. ·Bidding on various portals like PPH/ GURU/ UPWORK / Freelancer and other relevant online platforms
  4. · Handle the initial discussions and collect the strategic information about the prospects
  5. ·Understand complex project requirements and prepare proposal /bid to generate leads
  6. ·Continue prospect engagement and account management throughout the sales cycle until closure.
  7. ·Independently collaborate with the technical team for presentation with prospects.
  8. · Scout for new bidding platforms and websites to catch out the opportunities.
  9. Skill & Experience Required
  10. ·       Excellent verbal and written communication skills, capable of converting the prospect with good linguistic ability.
  11. ·       Must have 1-3 years of experience in Web Development & Mobile Apps project acquisition and closure through the online bidding platforms.
  12. ·       Experience with lead generation and prospect management via various online bidding platforms.
  13. ·       Must have sound technical knowledge of advanced Web and Mobile technologies trending today.
  14. ·       Lead generation through LinkedIn, database, and other social networks would be an added value.
  15. ·       Ability to handle the sales independently or as part of a team.
  16. Education: Degree/ any diploma

Experience: 1- 3 years

Salary: negotiable

 

.

Read more
IT Consultancy
IT Consultancy
Agency job
via MNR Solutions by Neeraj Shukla
Remote, Mohali
3 - 8 yrs
₹12L - ₹15L / yr
DBMS
Database architecture
database developer
azure data factory
SSIS
+3 more

Roles & Responsibilities

Must Have

  • Ability to design and develop database architectures
  • Expert working knowledge and experience of DBMS
  • Ability to write complex T-SQL queries
  • Expert knowledge of Azure Data Factory (ADF)
  • Ability to create and manage SSIS packages while managing a full ETL lifecycle
  • Proficiency in data cleansing and reconciliation
  • Ability to assist others in topics related to data management
  • Ability to quickly investigate and troubleshoot any data/database issues
  • Expert knowledge in MS SQL Database Server administration, performance tuning and maintenance experience.

Should Have

  • Ability to work with end-users and project teams to analyze, document and create workflow processes
  • Knowledge of SSRS (SQL Server Reporting Services)
  • Attention to detail, critical thinking and problem solving skills.
  • Excellent verbal/written communication skills and be a good team player.
  • Azure SQL knowledge (SQL-as-a-service)
  • Understanding of Agile Methodology.
  • Working knowledge of Git.

 

Could Have

  • DevOps knowledge (Infrastructure-as-a-code)
  • Powershell scripting language
  • Monitoring tools like Nagios, Azure tools.
Knowledge of Azure data factory.
Read more
Banking client. Leading Bank
Banking client. Leading Bank
Agency job
via FlexAbility by Vanya Bawa
Bengaluru (Bangalore)
2 - 5 yrs
₹2L - ₹15L / yr
skill iconGo Programming (Golang)
skill iconJava
Microservices
'● Identify, analyze and develop interfaces and integration flows
● Be responsible for programming and software development using various programming languages and related tools and frameworks, reviewing code written by other programmers, requirement gathering, bug fixing, testing, documenting and implementation.
● Good understanding of GoLang and microservices
● To take up development and deployment of native code to manage the customer facing platforms
● Explain complex technical issues to project managers, developers, application leads and architects in an easy to understand manner, and recommend clearly thought out solutions.
● Knowledge of Integration Design patterns for building middleware systems from the ground up
● Knowledge of Web Services Interoperability, standards and ability to suggest, criticize and formulate solutions in a multi-vendor and architecture discussions.
● Develop solutions by designing system specifications, standards and programming
● Troubleshoot issues and provide bug fixes.
Read more
mind logicx
at mind logicx
3 recruiters
Shweta Grover
Posted by Shweta Grover
Bengaluru (Bangalore)
2 - 6 yrs
₹3L - ₹12L / yr
skill iconPython
skill iconDjango
skill iconPostgreSQL
skill iconBootstrap
skill iconAngular (2+)
+2 more
     
  Sr. Software Engineer - Open Source
  Department: MindLabs
  Location: Bangalore
     
  Job Description
  1. Develops software solutions by studying information needs; conferring with users; studying systems flow, data usage, and work processes; investigating problem areas; following the software development lifecycle.
  2. Determines operational feasibility by evaluating analysis, problem definition, requirements, solution development, and proposed solutions.
  3. Documents and demonstrates solutions by developing documentation, flowcharts, layouts, diagrams, charts, code comments and clear code.
  4. Prepares and installs solutions by determining and designing system specifications, standards, and programming.
  5. Provides information by collecting, analyzing, and summarizing development and service issues.
  6. Design, develop and implement new integration.
  7. Able to manage team of developers
     
  Skills:  
  -----------  
  1. Django full stack development experience more than 4 - 6 years (Python, Django, PostgreSQL)
  2. Experience of front-end development (Angular, Bootstrap, CSS, jQuery)
  3. Bug fixing in Django/Python/Web protocol
  4. Having experience in development of heavy traffic web solution
  5. Experience in working with LMS tools customization and integration will be added advantage
     
  Education
    Bachelor's degree in Computer Science or related field or equivalent degree
Read more
Codify Indi
at Codify Indi
1 recruiter
Dinesh Thakur
Posted by Dinesh Thakur
Remote, NCR (Delhi | Gurgaon | Noida)
2 - 5 yrs
₹4L - ₹9L / yr
skill iconNodeJS (Node.js)
skill iconJavascript
skill iconMongoDB
skill iconExpress
MySQL

Role and Responsibilities:

  • As a backend developer, your primary focus will be the development of all server-side systems
  • A basic understanding of front-end technologies is necessary as well. You will test, secure and deploy your code
  • Work experience on Node.js is a must along with a server-side framework like Express.js
  • Strong proficiency in JavaScript
  • Writing reusable, testable, and efficient code
  • Experience and proficiency integrating with REST APIs
  • Understanding of scalable computing systems, software architecture, data structures, and algorithms
  • Experience in working with databases such as MongoDB, Redis, Elasticsearch, etc.
  • AgileScrum development cycle understanding.

Skills Required:

  • At least 2 years of experience developing backends using NodeJS should be well versed with its asynchronous nature & event loop, and know its quirks and workarounds.
  • Good knowledge of MongoDB(Must) & any other MySQL Database.
  • Good knowledge of Redis, its data types, and their use cases.
  • Experience developing and deploying REST APIs.
  • Knowledge and working experience in Cloud environment - AWS or Azure
  • Good knowledge of Unit Testing and available Test Frameworks.
  • Should be a fast learner and a go-getter without any fear of trying out new things
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos