11+ OLTP Jobs in Hyderabad | OLTP Job openings in Hyderabad

JOB DETAILS:

* Job Title: Lead II - Software Engineering - AWS, Apache Spark (PySpark/Scala), Apache Kafka

* Industry: Global digital transformation solutions provider

* Salary: Best in Industry

* Experience: 5-8 years

* Location: Hyderabad

Job Summary

We are seeking a skilled Data Engineer to design, build, and optimize scalable data pipelines and cloud-based data platforms. The role involves working with large-scale batch and real-time data processing systems, collaborating with cross-functional teams, and ensuring data reliability, security, and performance across the data lifecycle.

Key Responsibilities

ETL Pipeline Development & Optimization

• Design, develop, and maintain complex end-to-end ETL pipelines for large-scale data ingestion and processing.
• Optimize data pipelines for performance, scalability, fault tolerance, and reliability.

Big Data Processing

• Develop and optimize batch and real-time data processing solutions using Apache Spark (PySpark/Scala) and Apache Kafka.
• Ensure fault-tolerant, scalable, and high-performance data processing systems.

Cloud Infrastructure Development

• Build and manage scalable, cloud-native data infrastructure on AWS.
• Design resilient and cost-efficient data pipelines adaptable to varying data volume and formats.

Real-Time & Batch Data Integration

• Enable seamless ingestion and processing of real-time streaming and batch data sources (e.g., AWS MSK).
• Ensure consistency, data quality, and a unified view across multiple data sources and formats.

Data Analysis & Insights

• Partner with business teams and data scientists to understand data requirements.
• Perform in-depth data analysis to identify trends, patterns, and anomalies.
• Deliver high-quality datasets and present actionable insights to stakeholders.

CI/CD & Automation

• Implement and maintain CI/CD pipelines using Jenkins or similar tools.
• Automate testing, deployment, and monitoring to ensure smooth production releases.

Data Security & Compliance

• Collaborate with security teams to ensure compliance with organizational and regulatory standards (e.g., GDPR, HIPAA).
• Implement data governance practices ensuring data integrity, security, and traceability.

Troubleshooting & Performance Tuning

• Identify and resolve performance bottlenecks in data pipelines.
• Apply best practices for monitoring, tuning, and optimizing data ingestion and storage.

Collaboration & Cross-Functional Work

• Work closely with engineers, data scientists, product managers, and business stakeholders.
• Participate in agile ceremonies, sprint planning, and architectural discussions.

Skills & Qualifications

Mandatory (Must-Have) Skills

1. AWS Expertise

• Hands-on experience with AWS Big Data services such as EMR, Managed Apache Airflow, Glue, S3, DMS, MSK, and EC2.
• Strong understanding of cloud-native data architectures.

1. Big Data Technologies

• Proficiency in PySpark or Scala Spark and SQL for large-scale data transformation and analysis.
• Experience with Apache Spark and Apache Kafka in production environments.

1. Data Frameworks

• Strong knowledge of Spark DataFrames and Datasets.

1. ETL Pipeline Development

• Proven experience in building scalable and reliable ETL pipelines for both batch and real-time data processing.

1. Database Modeling & Data Warehousing

• Expertise in designing scalable data models for OLAP and OLTP systems.

1. Data Analysis & Insights

• Ability to perform complex data analysis and extract actionable business insights.
• Strong analytical and problem-solving skills with a data-driven mindset.

1. CI/CD & Automation

• Basic to intermediate experience with CI/CD pipelines using Jenkins or similar tools.
• Familiarity with automated testing and deployment workflows.

Good-to-Have (Preferred) Skills

• Knowledge of Java for data processing applications.
• Experience with NoSQL databases (e.g., DynamoDB, Cassandra, MongoDB).
• Familiarity with data governance frameworks and compliance tooling.
• Experience with monitoring and observability tools such as AWS CloudWatch, Splunk, or Dynatrace.
• Exposure to cost optimization strategies for large-scale cloud data platforms.

Skills: big data, scala spark, apache spark, ETL pipeline development

******

Notice period - 0 to 15 days only

Job stability is mandatory

Location: Hyderabad

Note: If a candidate is a short joiner, based in Hyderabad, and fits within the approved budget, we will proceed with an offer

F2F Interview: 14th Feb 2026

3 days in office, Hybrid model.

Role & Responsibilities

• Lead enterprise-scale implementation of data warehouse data platforms on Databricks and Snowflake environments.
• Design and implement Medallion (Bronze/Silver/Gold) architecture and scalable enterprise data models.
• Establish data modeling standards (dimensional, data vault, lakehouse patterns) and ensure best practices across projects
• Establish enterprise data governance frameworks including cataloging, lineage, stewardship, and compliance using Atlan.
• Define and implement CI/CD pipelines for infrastructure and data platform deployments
• Design data architectures that support AI/ML and Generative AI workloads including vector storage, feature layers, and secure access patterns.
• Build scalable ingestion frameworks supporting batch, streaming, and CDC pipelines.
• Architect secure, high-performance data integration layers for analytics, BI, and AI consumption.
• Develop target-state architecture blueprints and enforce data standards, governance, and best practices across teams.
• Collaborate with engineering, analytics, and data science teams to ensure platform alignment and scalability.
• Engage with clients as a trusted advisor, driving data strategy, roadmap definition, and identifying opportunities for expansion.

Ideal Candidate

• Strong Databricks / AWS Data Architect profile
• Mandatory (Experience 1) – Must have minimum 8+ years of experience in Data Architecture / Data Engineering, with exposure in enterprise-scale data platform modernization initiatives
• Mandatory (Experience 2) – Must have minimum 3+ years of deep hands-on experience in Databricks-based lakehouse architecture on AWS, including large-scale data platform implementations
• Mandatory (Experience 3) – Strong expertise in Databricks ecosystem including Delta Lake, Databricks SQL, Unity Catalog, Delta Live Tables, and MLflow with focus on performance optimization and security
• Mandatory (Experience 4) – Strong experience with AWS data services including S3, Glue, EMR, Lambda, Redshift, Athena, Lake Formation, and DMS, with strong understanding of cloud-native architecture patterns
• Mandatory (Experience 5) – Proven experience designing and implementing Medallion (Bronze/Silver/Gold) architecture, scalable data models (Dimensional/Data Vault), and enterprise lakehouse platforms supporting batch and real-time processing
• Mandatory (Experience 6) – Must have hands-on experience building scalable ingestion frameworks including batch, streaming, and CDC pipelines using tools like Kafka, Kinesis, Spark, or similar technologies
• Mandatory (Skill 1) – Proven experience implementing CI/CD pipelines for data platforms, including infrastructure as code, automated deployments, and environment management
• Mandatory (Skill 2) – Hands-on experience enabling data platforms for AI/ML and Generative AI use cases, including feature stores, vector storage, and secure data access patterns
• Mandatory (Skill 3) – Experience with orchestration tools such as Apache Airflow or MWAA and designing integration layers for analytics, BI, and AI consumption
• Preferred (Company) – Product Companies.
• Preferred (Certification) – AWS / Databricks / Snowflake certifications; experience with Snowflake alongside Databricks; exposure to MDM, data quality frameworks, and enterprise metadata tools

Professional & Technical Skills: 

- Must To Have Skills: Proficiency in Microsoft Dynamics 365 Commerce Technical.

- Strong understanding of application development methodologies.

- Experience with integration of Microsoft Dynamics 365 with other systems.

- Ability to troubleshoot and resolve application issues effectively.

- Familiarity with user interface design principles and best practices.

Additional Information: 

- The candidate should have minimum 3 years of experience in Microsoft Dynamics 365 Commerce Technical.

Prolifics Looking for.NET Core Developer with experience in Web Api Applications

Role:.NET Core Developer.

Location: Hyderabad

Mode of Employment: Permanent

Experience Required: 3 to 8 Years

Primary Skills: 

.Net Core, Asp.NetCore Web Application

C#  

ROAD  

PL/SQL – prefer Oracle experience. 

Web API  

Regards,

Anil Kumar

CORE RESPONSIBILITIES

• Create and manage cloud resources in AWS 
• Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies 
• Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform 
• Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations 
• Develop an infrastructure to collect, transform, combine and publish/distribute customer data.
• Define process improvement opportunities to optimize data collection, insights and displays.
• Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible 
• Identify and interpret trends and patterns from complex data sets 
• Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders. 
• Key participant in regular Scrum ceremonies with the agile teams  
• Proficient at developing queries, writing reports and presenting findings 
• Mentor junior members and bring best industry practices 

QUALIFICATIONS

• 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales) 
• Strong background in math, statistics, computer science, data science or related discipline
• Advanced knowledge one of language: Java, Scala, Python, C# 
• Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake  
• Proficient with
• Data mining/programming tools (e.g. SAS, SQL, R, Python)
• Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
• Data visualization (e.g. Tableau, Looker, MicroStrategy)
• Comfortable learning about and deploying new technologies and tools. 
• Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines. 
• Good written and oral communication skills and ability to present results to non-technical audiences 
• Knowledge of business intelligence and analytical tools, technologies and techniques.

Mandatory Requirements 

• Experience in AWS Glue
• Experience in Apache Parquet 
• Proficient in AWS S3 and data lake 
• Knowledge of Snowflake
• Understanding of file-based ingestion best practices.
• Scripting language - Python & pyspark

Responsibilities:

- Collaborate with the development team to understand project requirements and provide input on testability.

- Design and develop comprehensive test plans and test cases for UI/ API, based on project requirements.

- Write and execute automated tests using JavaScript with Cypress or Playwright.

- Perform manual testing when necessary to ensure complete test coverage.

- Identify and document defects, and work closely with developers to resolve them.

- Conduct regression testing to ensure software quality and reliability.

- Collaborate with cross-functional teams to ensure that software meets quality standards.

- Participate in code reviews to ensure testability and maintainability of the codebase.

- Maintain and update test documentation as necessary.

- Stay up-to-date with industry trends and best practices in software testing.

- Continuously improve the testing process and suggest process enhancements.

Requirements:

- Bachelor's degree in Computer Science, Engineering, or a related field.

3-4 years of experience in software testing.

- Proficiency in writing test scripts using JavaScript.

- Experience with test automation tools such as Cypress or Playwright.

- Strong understanding of software testing methodologies and best practices.

- Excellent problem-solving and debugging skills.

- Strong attention to detail and commitment to quality.

- Good communication and collaboration skills.

- Eagerness to work from the office in Hyderabad.

Benefits:

- Office Gear allocation

- Mediclaim policy for self, spouse, kids, and parents

- Wellness policy for self

- PTO

- 5 days a week work

- Subscription reimbursements

- Reimbursements for self-learning and professional development

Responsibilities:

• Develop and maintain mobile applications using React Native.
• Collaborate with cross-functional teams to define, design, and ship new features.
• Ensure the performance, quality, and responsiveness of applications.
• Identify and fix bugs and performance bottlenecks.
• Write clean, maintainable, and testable code.
• Integrate third-party APIs and libraries.
• Stay updated with the latest industry trends and technologies.

Required Skills:

• Proficiency in JavaScript and React.
• Experience with React Native and its ecosystem.
• Understanding of mobile app development (iOS and Android).
• Familiarity with RESTful APIs and integration.
• Knowledge of version control systems (e.g., Git).
• Problem-solving skills and attention to detail.