Big Data Engineer

empowers digital transformation for innovative and high grow

Big Data Engineer

Hirebound

Company

Home

Big Data Engineer

at empowers digital transformation for innovative and high grow

Agency job

via Hirebound

4 - 12 yrs

₹12L - ₹30L / yr

Pune

Skills

Hadoop

Spark

Apache Kafka

ETL

Java

Scala

Python

To be successful in this role, you should possess

• Collaborate closely with Product Management and Engineering leadership to devise and build the

right solution.

• Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big

Data tools and frameworks required to solve Big Data problems at scale.

• Design and implement systems to cleanse, process, and analyze large data sets using distributed

processing tools like Akka and Spark.

• Understanding and critically reviewing existing data pipelines, and coming up with ideas in

collaboration with Technical Leaders and Architects to improve upon current bottlenecks

• Take initiatives, and show the drive to pick up new stuff proactively, and work as a Senior

Individual contributor on the multiple products and features we have.

• 3+ years of experience in developing highly scalable Big Data pipelines.

• In-depth understanding of the Big Data ecosystem including processing frameworks like Spark,

Akka, Storm, and Hadoop, and the file types they deal with.

• Experience with ETL and Data pipeline tools like Apache NiFi, Airflow etc.

• Excellent coding skills in Java or Scala, including the understanding to apply appropriate Design

Patterns when required.

• Experience with Git and build tools like Gradle/Maven/SBT.

• Strong understanding of object-oriented design, data structures, algorithms, profiling, and

optimization.

• Have elegant, readable, maintainable and extensible code style.

You are someone who would easily be able to

• Work closely with the US and India engineering teams to help build the Java/Scala based data

pipelines

• Lead the India engineering team in technical excellence and ownership of critical modules; own

the development of new modules and features

• Troubleshoot live production server issues.

• Handle client coordination and be able to work as a part of a team, be able to contribute

independently and drive the team to exceptional contributions with minimal team supervision

• Follow Agile methodology, JIRA for work planning, issue management/tracking

Additional Project/Soft Skills:

• Should be able to work independently with India & US based team members.

• Strong verbal and written communication with ability to articulate problems and solutions over phone and emails.

• Strong sense of urgency, with a passion for accuracy and timeliness.

• Ability to work calmly in high pressure situations and manage multiple projects/tasks.

• Ability to work independently and possess superior skills in issue resolution.

• Should have the passion to learn and implement, analyze and troubleshoot issues

To be successful in this role, you should possess

• Collaborate closely with Product Management and Engineering leadership to devise and build the

right solution.

• Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big

Data tools and frameworks required to solve Big Data problems at scale.

• Design and implement systems to cleanse, process, and analyze large data sets using distributed

processing tools like Akka and Spark.

• Understanding and critically reviewing existing data pipelines, and coming up with ideas in

collaboration with Technical Leaders and Architects to improve upon current bottlenecks

• Take initiatives, and show the drive to pick up new stuff proactively, and work as a Senior

Individual contributor on the multiple products and features we have.

• 3+ years of experience in developing highly scalable Big Data pipelines.

• In-depth understanding of the Big Data ecosystem including processing frameworks like Spark,

Akka, Storm, and Hadoop, and the file types they deal with.

• Experience with ETL and Data pipeline tools like Apache NiFi, Airflow etc.

• Excellent coding skills in Java or Scala, including the understanding to apply appropriate Design

Patterns when required.

• Experience with Git and build tools like Gradle/Maven/SBT.

• Strong understanding of object-oriented design, data structures, algorithms, profiling, and

optimization.

• Have elegant, readable, maintainable and extensible code style.

You are someone who would easily be able to

• Work closely with the US and India engineering teams to help build the Java/Scala based data

pipelines

• Lead the India engineering team in technical excellence and ownership of critical modules; own

the development of new modules and features

• Troubleshoot live production server issues.

• Handle client coordination and be able to work as a part of a team, be able to contribute

independently and drive the team to exceptional contributions with minimal team supervision

• Follow Agile methodology, JIRA for work planning, issue management/tracking

Additional Project/Soft Skills:

• Should be able to work independently with India & US based team members.

• Strong verbal and written communication with ability to articulate problems and solutions over phone and emails.

• Strong sense of urgency, with a passion for accuracy and timeliness.

• Ability to work calmly in high pressure situations and manage multiple projects/tasks.

• Ability to work independently and possess superior skills in issue resolution.

• Should have the passion to learn and implement, analyze and troubleshoot issues

Users love Cutshort

Read about what our users have to say about finding their next opportunity on Cutshort.

Shubham Vishwakarma

Full Stack Developer - Averlon

I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.

Companies hiring on Cutshort

Similar jobs

Data Engineer

at Blurgs

Posted by Blurgs Innovations

Hyderabad

0 - 3 yrs

₹4L - ₹10L / yr

Apache

Databases

Infrastructure

Data Structures

Big Data

Job Title: Data Engineer

Location: Hyderabad

About us:

Blurgs AI is a deep-tech startup focused on maritime and defence data-intelligence solutions, specialising in multi-modal sensor fusion and data correlation. Our flagship product, Trident, provides advanced domain awareness for maritime, defence, and commercial sectors by integrating data from various sensors like AIS, Radar, SAR, and EO/IR.

At Blurgs AI, we foster a collaborative, innovative, and growth-driven culture. Our team is passionate about solving real-world challenges, and we prioritise an open, inclusive work environment where creativity and problem-solving thrive. We encourage new hires to bring their ideas to the table, offering opportunities for personal growth, skill development, and the chance to work on cutting-edge technology that impacts global defence and maritime operations.

Join us to be part of a team that's shaping the future of technology in a fast-paced, dynamic industry.

Job Summary:

We are looking for a Senior Data Engineer to design, build, and maintain a robust, scalable on-premise data infrastructure. You will focus on real-time and batch data processing using platforms such as Apache Pulsar and Apache Flink, work with NoSQL databases like MongoDB and ClickHouse, and deploy services using containerization technologies like Docker and Kubernetes. This role is ideal for engineers with strong systems knowledge, deep backend data experience, and a passion for building efficient, low-latency data pipelines in a non-cloud, on-prem environment.

Key Responsibilities:

Data Pipeline & Streaming Development
Design and implement real-time data pipelines using Apache Pulsar and Apache Flink to support mission-critical systems.
Develop high-throughput, low-latency data ingestion and processing workflows across streaming and batch workloads.
Integrate internal systems and external data sources into a unified on-prem data platform.
Data Storage & Modelling
Design efficient data models for MongoDB, ClickHouse, and other on-prem databases to support analytical and operational workloads.
Optimise storage formats, indexing strategies, and partitioning schemes for performance and scalability.
Infrastructure & Containerization
Deploy, manage, and monitor containerised data services using Docker and Kubernetes in on-prem environments.
Performance, Monitoring & Reliability
Monitor the performance of streaming jobs and database queries; fine-tune for efficiency and reliability.
Implement robust logging, metrics, and alerting solutions to ensure data system availability and uptime.
Identify bottlenecks in the pipeline and proactively implement optimisations.

Required Skills & Experience:

Strong experience in data engineering with a focus on on-premise infrastructure.
Strong expertise in streaming technologies like Apache Pulsar, Apache Flink, or similar.
Deep experience with MongoDB, ClickHouse, and other NoSQL or columnar storage databases.
Proficient in Python, Java, or Scala for data processing and backend development.
Hands-on experience deploying and managing systems using Docker and Kubernetes.
Familiarity with Linux-based systems, system tuning, and resource monitoring.

Preferred Qualifications:

Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field, or an equivalent combination of education and experience.

Additional Responsibilities for Senior Data Engineers :

For those hired as Senior Data Engineers, the role will come with added responsibilities, including:

Leadership & Mentorship: Guide and mentor junior engineers, sharing expertise and best practices.
System Architecture: Lead the design and optimization of complex real-time and batch data pipelines, ensuring scalability and performance.
Sensor Data Expertise: Focus on building and optimizing sensor-based data pipelines and stateful stream processing for mission-critical applications in domains like maritime and defense.
End-to-End Ownership: Take responsibility for the performance, reliability, and optimization of data systems.

Compensation:

Data Engineer CTC: 4 - 8 LPA
Senior Data Engineer CTC: 12 - 16 LPA

Job Title: Data Engineer

Location: Hyderabad

About us:

Join us to be part of a team that's shaping the future of technology in a fast-paced, dynamic industry.

Job Summary:

Key Responsibilities:

Data Pipeline & Streaming Development
Design and implement real-time data pipelines using Apache Pulsar and Apache Flink to support mission-critical systems.
Develop high-throughput, low-latency data ingestion and processing workflows across streaming and batch workloads.
Integrate internal systems and external data sources into a unified on-prem data platform.
Data Storage & Modelling
Design efficient data models for MongoDB, ClickHouse, and other on-prem databases to support analytical and operational workloads.
Optimise storage formats, indexing strategies, and partitioning schemes for performance and scalability.
Infrastructure & Containerization
Deploy, manage, and monitor containerised data services using Docker and Kubernetes in on-prem environments.
Performance, Monitoring & Reliability
Monitor the performance of streaming jobs and database queries; fine-tune for efficiency and reliability.
Implement robust logging, metrics, and alerting solutions to ensure data system availability and uptime.
Identify bottlenecks in the pipeline and proactively implement optimisations.

Required Skills & Experience:

Strong experience in data engineering with a focus on on-premise infrastructure.
Strong expertise in streaming technologies like Apache Pulsar, Apache Flink, or similar.
Deep experience with MongoDB, ClickHouse, and other NoSQL or columnar storage databases.
Proficient in Python, Java, or Scala for data processing and backend development.
Hands-on experience deploying and managing systems using Docker and Kubernetes.
Familiarity with Linux-based systems, system tuning, and resource monitoring.

Preferred Qualifications:

Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field, or an equivalent combination of education and experience.

Additional Responsibilities for Senior Data Engineers :

For those hired as Senior Data Engineers, the role will come with added responsibilities, including:

Leadership & Mentorship: Guide and mentor junior engineers, sharing expertise and best practices.
System Architecture: Lead the design and optimization of complex real-time and batch data pipelines, ensuring scalability and performance.
Sensor Data Expertise: Focus on building and optimizing sensor-based data pipelines and stateful stream processing for mission-critical applications in domains like maritime and defense.
End-to-End Ownership: Take responsibility for the performance, reliability, and optimization of data systems.

Compensation:

Data Engineer CTC: 4 - 8 LPA
Senior Data Engineer CTC: 12 - 16 LPA

Guidewire Billing Developer

at Cornertree

1 recruiter

Posted by Deepesh Shrimal

Hyderabad, Noida, Gurugram

5 - 12 yrs

₹5L - ₹40L / yr

Guidewire

billing cemter

Description:

 4+ Years of experience in systems development and Guidewire Billing experience.

 4+ years of technical experience in enterprise-level application design, execution, and software deployments.

 Hands-on development expertise on Guidewire BillingCenter with configuration.

 Configure business rules and other business logic in Gosu.

 Design and code integration components including plug-ins and programs that call the GW APIs Create form and letter templates and their supporting XML descriptor files.

 Skilled in the use of applicable programming languages for the areas of developing code for, to include but are not limited to Java, SQL etc.

 Experience leveraging source code management, such as GitHub or Bitbucket.

 Supports production deployments and automation, actively lead monitoring, job control, and production support, and participates in and provides support for production issues related to the Guidewire solution.

 Expertise configuring and developing several areas of BillingCenter including but not limited to Account/Policy/Producer Handling, Various Plan Types, Billing Instructions, Charges, Charge Patterns, Charge Invoicing, Invoice Items, Direct/List/Agency Bill Processing, Premium Reporting, Holds and writeoffs, Handling of Trouble Tickets/ Collaterals and Return Premium, Funds Tracking and Contacts.

 Well versed with all Guidewire Billing center configuration areas like PCF, Gosu, Business Rules, Invoicing, Billing Types, Charge Distributions, Payments, Delinquency process, Commissions, etc.

 Robust understanding of BillingCenter DataModel

Education:

 BE/B.Tech, BCA, B.SE, MCA, MBA / Any Graduate/Any Post Graduate