![Compile cover picture](/_next/image?url=https%3A%2F%2Fcdnv2.cutshort.io%2Fcompany-static%2F623c1c822824a500297f9edb%2Fuser_uploaded_data%2Fcover_pictures%2Fcompany_cover_pic_a6biEotL.jpg&w=3840&q=80)
Compile
http://compile.comJobs at Compile
![icon](/_next/image?url=https%3A%2F%2Fcdn.cutshort.io%2Fpublic%2Fimages%2Finfo_icon.png&w=48&q=75)
The recruiter has not been active on this job recently. You may apply but please expect a delayed response.
You will be responsible for designing, building, and maintaining data pipelines that handle Real-world data at Compile. You will be handling both inbound and outbound data deliveries at Compile for datasets including Claims, Remittances, EHR, SDOH, etc.
You will
- Work on building and maintaining data pipelines (specifically RWD).
- Build, enhance and maintain existing pipelines in pyspark, python and help build analytical insights and datasets.
- Scheduling and maintaining pipeline jobs for RWD.
- Develop, test, and implement data solutions based on the design.
- Design and implement quality checks on existing and new data pipelines.
- Ensure adherence to security and compliance that is required for the products.
- Maintain relationships with various data vendors and track changes and issues across vendors and deliveries.
You have
- Hands-on experience with ETL process (min of 5 years).
- Excellent communication skills and ability to work with multiple vendors.
- High proficiency with Spark, SQL.
- Proficiency in Data modeling, validation, quality check, and data engineering concepts.
- Experience in working with big-data processing technologies using - databricks, dbt, S3, Delta lake, Deequ, Griffin, Snowflake, BigQuery.
- Familiarity with version control technologies, and CI/CD systems.
- Understanding of scheduling tools like Airflow/Prefect.
- Min of 3 years of experience managing data warehouses.
- Familiarity with healthcare datasets is a plus.
Compile embraces diversity and equal opportunity in a serious way. We are committed to building a team of people from many backgrounds, perspectives, and skills. We know the more inclusive we are, the better our work will be.
![icon](/_next/image?url=https%3A%2F%2Fcdn.cutshort.io%2Fpublic%2Fimages%2Fsearch.png&w=48&q=75)
Similar companies
About the company
Jobs
5
About the company
Founded in 2017, LaunchMyDrug is a bootstrapped company based in Mumbai. It has 1-10 employees currently.
Jobs
3
About the company
Jobs
1
About the company
Jobs
1
About the company
Jobs
0
About the company
Jobs
2
About the company
Jobs
1
About the company
Jobs
1