11+ Apache Pig Jobs in Bangalore (Bengaluru) | Apache Pig Job openings in Bangalore (Bengaluru)

1) Must have experience working in Aviation / Aerospace industry.

2) Must hold Technician Diploma degree.

3) Familiarity with RTCA-DO-160E section 23., JAR/CS - 25, rules and rgulations

4) Familiar with CEMILAC, DGAQA, FAA/EASA for Design, Manufacturing and certifications  

5) Familirity with Testing methodologies (ATSM , JAR/CS-25)

Job Description: Data Engineer 

Position Overview:

Role Overview

We are seeking a skilled Python Data Engineer with expertise in designing and implementing data solutions using the AWS cloud platform. The ideal candidate will be responsible for building and maintaining scalable, efficient, and secure data pipelines while leveraging Python and AWS services to enable robust data analytics and decision-making processes.

Key Responsibilities

· Design, develop, and optimize data pipelines using Python and AWS services such as Glue, Lambda, S3, EMR, Redshift, Athena, and Kinesis.

· Implement ETL/ELT processes to extract, transform, and load data from various sources into centralized repositories (e.g., data lakes or data warehouses).

· Collaborate with cross-functional teams to understand business requirements and translate them into scalable data solutions.

· Monitor, troubleshoot, and enhance data workflows for performance and cost optimization.

· Ensure data quality and consistency by implementing validation and governance practices.

· Work on data security best practices in compliance with organizational policies and regulations.

· Automate repetitive data engineering tasks using Python scripts and frameworks.

· Leverage CI/CD pipelines for deployment of data workflows on AWS.

You will be responsible for designing, building, and maintaining data pipelines that handle Real-world data at Compile. You will be handling both inbound and outbound data deliveries at Compile for datasets including Claims, Remittances, EHR, SDOH, etc.

You will

• Work on building and maintaining data pipelines (specifically RWD).
• Build, enhance and maintain existing pipelines in pyspark, python and help build analytical insights and datasets.
• Scheduling and maintaining pipeline jobs for RWD.
• Develop, test, and implement data solutions based on the design.
• Design and implement quality checks on existing and new data pipelines.
• Ensure adherence to security and compliance that is required for the products.
• Maintain relationships with various data vendors and track changes and issues across vendors and deliveries.

You have

• Hands-on experience with ETL process (min of 5 years).
• Excellent communication skills and ability to work with multiple vendors.
• High proficiency with Spark, SQL.
• Proficiency in Data modeling, validation, quality check, and data engineering concepts.
• Experience in working with big-data processing technologies using - databricks, dbt, S3, Delta lake, Deequ, Griffin, Snowflake, BigQuery.
• Familiarity with version control technologies, and CI/CD systems.
• Understanding of scheduling tools like Airflow/Prefect.
• Min of 3 years of experience managing data warehouses.
• Familiarity with healthcare datasets is a plus.

Compile embraces diversity and equal opportunity in a serious way. We are committed to building a team of people from many backgrounds, perspectives, and skills. We know the more inclusive we are, the better our work will be.         

• 4+ years of experience with Node.js
• Expertise in Typescript, AWS, Firebase, MongoDB, and Express

You will be bringing:

• Hands-on experience in writing applications using Node.js (including Socket.io and Express or similar)
• Excellent knowledge of a few of the available databases such as MySQL, MongoDB, etc.
• Proficiency in application deployment on Linux or Ubuntu environments
• Proficiency in JavaScript languages like React and/or Angular, along with a comprehensive experience in open-source frameworks
• Experience in server-client architecture project(s)
• Ability to prioritize in a chaotic and ambiguous environment
• An open, growth mindset when giving and receiving feedback

About the Role

A highly motivated and passionate individual who has experience in executing end to end web based products and applications; bringing them to production quickly and with high quality. Passionate about building flexible and scalable solutions with an eye for detail and can weigh pros and cons to find best possible solutions. 

Role and Responsibilities

• Collaborate with Product Managers to plan, implement and deliver tasks and modules on a timely basis with best practices and adherence to SOPs.
• Understand the product requirements, ask questions, and gather information and feedback to design and deliver features both on Android and iOS.
• Create a roadmap of tasks to be delivered for both iOS and Android applications in sync, such that new features go to the end-user at same time. 
• Lead the design of Android and iOS applications in a modular fashion with reusable components.
• Proactively identify issues related to memory consumption, battery drain and multi-threading in the application by planning regular tests and analysis.
• Deliver Android and iOS applications with integration to backend services deployed on the cloud with high quality and responsiveness. 
• Create strong practices around test driven development, automating delivery of apps to the marketplace with strong CI/CD practices.
• Manage a highly skilled and efficient team by hiring, keeping the team motivated, and managing performance.
• Play the role of an unblocker in a tight scrum environment. Should be able to help other developers with challenges, problem solving, and help achieve milestones as per plan.
• Prioritize to manage ad-hoc requests in parallel with ongoing projects.
• Hands on with programming with 50%+ of bandwidth going into modules owned.

Skills/Experience

• A highly talented developer with 10+ years of hands-on experience in building apps that have been released to the Play Store(Android) and Appstore(iOS). 
• Demonstrated experience managing teams of 5-10 or more engineers in mobile application teams.
• Strong knowledge of Android, Kotlin, iOS, Swift, Objective C and working with MVVM, MVP, MVC patterns.
• Experience building mobile applications which lean heavily on connecting to cloud services to gather data and stream videos/content. 
• Working knowledge of Xamarin or Flutter (cross platform frameworks) is highly preferred. 
• Practitioner of test driven development practices. Experience in creating and adhering to best practices for development.

• Support for Incident and Request management tasks as assigned.
• Administration and understanding of the following network services to support Incident and Request tasks as assigned:
• Palo Alto Firewalls
• LAN Routing and Switching
• Microsoft Azure Networking – Vnets, Express Route, Vnet Peering, VPN Gateways
• LAN to LAN VPN Tunnels
• Arista Network devices
• Work with Networking Monitoring tools such as one or more of the following: Solar Winds, Splunk, Prime, NetMRI, Nagios
• Work directly with telecom carriers and Network infrastructure maintenance providers as needed, such as Verizon, Tata, Bharti, and Cisco.
• Maximize network performance by monitoring performance, troubleshooting network problems and outages, scheduling upgrades, and collaborating with network architects on network optimization
• Supports routing and switching and work on BGP, OSPF protocols
• Support China retail store infrastructure and data center through on-call rotations

QUALIFICATIONS:

• Graduate or above
• 6-7 years experience in LAN/WAN Routing including 2 or more years of LAN/WAN Administration experience within a multi-platform technical environment.
• In-depth understanding of voice and/or data technologies and subject matter expert in at least one area.
• Cisco Certified or equivalent combination of knowledge and experience.
• Understanding on IPsec, VPNs, GRE, NAT/PAT over varied platforms
• Expert knowledge of all LAN switching technologies eg Spanning Tree, VLAN management, and VTP concepts on Cisco, Nexus, and Arista
• Good understanding of MPLS routing and OSPF routing

• Someone who enjoys Sports, Marketing, and Fashion
• A skilled graphic designer based in Bangalore (or ready-to-move).
• Has a good understanding of graphic design principles and typography.
• We are looking for someone who is really creative and well-versed in the tools of the trade.
• Someone who is looking to get involved in more than just graphic design
• People who work well in teams