

We are looking for a highly skilled Sr. Big Data Engineer with 3-5 years of experience in
building large-scale data pipelines, real-time streaming solutions, and batch/stream
processing systems. The ideal candidate should be proficient in Spark, Kafka, Python, and
AWS Big Data services, with hands-on experience in implementing CDC (Change Data
Capture) pipelines and integrating multiple data sources and sinks.
Responsibilities
- Design, develop, and optimize batch and streaming data pipelines using Apache Spark and Python.
- Build and maintain real-time data ingestion pipelines leveraging Kafka and AWS Kinesis.
- Implement CDC (Change Data Capture) pipelines using Kafka Connect, Debezium or similar frameworks.
- Integrate data from multiple sources and sinks (databases, APIs, message queues, file systems, cloud storage).
- Work with AWS Big Data ecosystem: Glue, EMR, Kinesis, Athena, S3, Lambda, Step Functions.
- Ensure pipeline scalability, reliability, and performance tuning of Spark jobs and EMR clusters.
- Develop data transformation and ETL workflows in AWS Glue and manage schema evolution.
- Collaborate with data scientists, analysts, and product teams to deliver reliable and high-quality data solutions.
- Implement monitoring, logging, and alerting for critical data pipelines.
- Follow best practices for data security, compliance, and cost optimization in cloud environments.
Required Skills & Experience
- Programming: Strong proficiency in Python (PySpark, data frameworks, automation).
- Big Data Processing: Hands-on experience with Apache Spark (batch & streaming).
- Messaging & Streaming: Proficient in Kafka (brokers, topics, partitions, consumer groups) and AWS Kinesis.
- CDC Pipelines: Experience with Debezium / Kafka Connect / custom CDC frameworks.
- AWS Services: AWS Glue, EMR, S3, Athena, Lambda, IAM, CloudWatch.
- ETL/ELT Workflows: Strong knowledge of data ingestion, transformation, partitioning, schema management.
- Databases: Experience with relational databases (MySQL, Postgres, Oracle) and NoSQL (MongoDB, DynamoDB, Cassandra).
- Data Formats: JSON, Parquet, Avro, ORC, Delta/Iceberg/Hudi.
- Version Control & CI/CD: Git, GitHub/GitLab, Jenkins, or CodePipeline.
- Monitoring/Logging: CloudWatch, Prometheus, ELK/Opensearch.
- Containers & Orchestration (nice-to-have): Docker, Kubernetes, Airflow/Step
- Functions for workflow orchestration.
Preferred Qualifications
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field.
- Experience in large-scale data lake / lake house architectures.
- Knowledge of data warehousing concepts and query optimisation.
- Familiarity with data governance, lineage, and cataloging tools (Glue Data Catalog, Apache Atlas).
- Exposure to ML/AI data pipelines is a plus.
Tools & Technologies (must-have exposure)
- Big Data & Processing: Apache Spark, PySpark, AWS EMR, AWS Glue
- Streaming & Messaging: Apache Kafka, Kafka Connect, Debezium, AWS Kinesis
- Cloud & Storage: AWS (S3, Athena, Lambda, IAM, CloudWatch)
- Programming & Scripting: Python, SQL, Bash
- Orchestration: Airflow / Step Functions
- Version Control & CI/CD: Git, Jenkins/CodePipeline
- Data Formats: Parquet, Avro, ORC, JSON, Delta, Iceberg, Hudi

About Inncircles
About
Similar jobs
Job Description
Product Analyst, Amplifai Pune
Amplifai transforms AI potential into measurable business value, guiding organizations from strategic planning to execution. With deep expertise in AI product development, technical architecture, regulatory compliance, and commercialization, we deliver secure, ethical, and high-performing solutions. Having co-founded one of Europe’s most innovative AI companies, our team drives unparalleled growth for clients through cutting-edge technologies like GPT tools, AI agents, and modern frameworks. Join our new Pune office to shape the future of AI-driven innovation!
Amplifai is seeking a dynamic Product Analyst to join our newly established Pune office and play a key role in turning business needs into reality. As a Product Analyst, you’ll bridge the gap between clients, UX designers, developers, and QA teams, ensuring seamless translation of ideas into high-quality, defect-free software. This role offers an exciting opportunity to work with AI technologies like GPT tools and AI agents, contributing to product descriptions, specifications, and test case creation in a fast-paced, collaborative environment.
Key Responsibilities:
· Gather, analyse, and prioritize business requirements, translating them into clear user stories and acceptance criteria for UX, development, and QA teams.
· Collaborate with stakeholders to align on project goals, ensuring solutions meet client needs and technical feasibility.
· Leverage GPT tools and AI agents to streamline product descriptions, requirement specifications, and test case creation.
· Facilitate Scrum ceremonies (sprint planning, daily stand-ups, reviews, and retrospectives) as a Scrum Master, fostering Agile best practices
· Manage and prioritize the product backlog, ensuring clarity and readiness for upcoming sprints.
· Conduct requirement analysis and support user acceptance testing (UAT) to ensure defect-free deliverables.
· Track project progress, identify risks, and resolve roadblocks to ensure timely delivery.
· Communicate effectively with clients and internal teams, presenting solutions and progress updates with clarity.
· Maintain comprehensive documentation of requirements, user stories, and sprint metrics.
· Identify opportunities to enhance Agile processes, team collaboration, and product outcomes through continuous improvement
Required Skills & Experience:
· Familiarity with AI technologies (e.g., GPT tools, AI agents) or a strong willingness to learn.
· Strong analytical and problem-solving skills with a keen attention to detail.
· Excellent communication and presentation skills, with the ability to engage clients and cross-functional teams.
· 3+ years of experience in product analysis, requirement gathering, or Scrum activities.
· Basic understanding of software testing and defect tracking processes.
· Exposure to Agile methodologies and Scrum frameworks.
· Team player with strong interpersonal skills and a collaborative mindset.
· Bachelor’s degree in business, IT, Computer Science, or a related field (MBA is a plus).
Preferred Qualifications
- Experience with automation tools for test case creation or requirement management (e.g., Jira, Confluence, or similar).
- Familiarity with cloud platforms (e.g., Azure) or modern development frameworks.
We’re looking for a HR Executive(Female) – Operations to join our growing team in Noida
✨ What you’ll do:
Welcome & onboard new joiners
Manage employee documentation
Support insurance onboarding
Handle smooth exit formalities
✨ What we’re looking for:
6 months – 1 year experience in HR
Freshers with HR internship experience are welcome!
Should have basic knowledge of PF/ESIC, HR operarions.
💰 Salary: ₹19,500 CTC in Hand 15000 Monthly
📍 Location: Noida-Sec-63
Shift- 10 to 7 PM 6 Days.
Preferred who can Join Immediately
If you’re passionate about HR and eager to grow, this could be your next big step!


We are seeking an experienced Data Scientist to join our data-driven team. As a Data Scientist, you will work with large datasets, apply advanced analytics techniques, and build machine learning models to provide actionable insights that drive business decisions. You will collaborate with various teams to translate complex data into clear recommendations and innovative solutions.
Key Responsibilities:
- Analyze large datasets to identify trends, patterns, and insights that can inform business strategy.
- Develop, implement, and maintain machine learning models and algorithms to solve complex problems.
- Work closely with stakeholders to understand business objectives and translate them into data science tasks.
- Preprocess, clean, and organize raw data from various sources for analysis.
- Conduct statistical analysis and build predictive models to support data-driven decision-making.
- Create data visualizations and reports to communicate findings clearly and effectively to both technical and non-technical teams.
- Design experiments and A/B testing to evaluate business initiatives.
- Ensure the scalability and performance of data pipelines and machine learning models.
- Collaborate with engineering teams to integrate data science solutions into production systems.
- Continuously stay updated with the latest developments in data science, machine learning, and analytics technologies.
Senior DevOps Engineer (8-12 yrs Exp)
Job Description:
We are looking for an experienced and enthusiastic DevOps Engineer. As our new DevOps
Engineer, you will be in charge of the specification and documentation of the new project
features. In addition, you will be developing new features and writing scripts for automation
using Java/BitBucket/Python/Bash.
Roles and Responsibilities:
• Deploy updates and fixes
• Utilize various open source technologies
• Need to have hands on experience on automation tools like Docker / Jenkins /
Puppet etc.
• Build independent web based tools, micro-services and solutions
• Write scripts and automation using Java/BitBucket/Python/Bash.
• Configure and manage data sources like MySQL, Mongo, Elastic search, Redis etc
• Understand how various systems work
• Manage code deployments, fixes, updates and related processes.
• Understand how IT operations are managed
• Work with CI and CD tools, and source control such as GIT and SVN.
• Experience with project management and workflow tools such as Agile, Redmine,
WorkFront, Scrum/Kanban/SAFe, etc.
• Build tools to reduce occurrences of errors and improve customer experience
• Develop software to integrate with internal back-end systems
• Perform root cause analysis for production errors
• Design procedures for system troubleshooting and maintenance
Requirements:
• More than six years of experience in a DevOps Engineer role (or similar role);
experience in software development and infrastructure development is a mandatory.
• Bachelor’s degree or higher in engineering or related field
• Proficiency in deploying and maintaining web applications
• Ability to construct and execute network, server, and application status monitoring
• Knowledge of software automation production systems, including code deployment
• Working knowledge of software development methodologies
• Previous experience with high-performance and high-availability open source web
technologies
• Strong experience with Linux-based infrastructures, Linux/Unix administration, and
AWS.
• Strong communication skills and ability to explain protocol and processes with team
and management.
• Solid team player.
Job Description
We are looking for a Senior Test Engineer who will work closely with the project team members and ensure the quality of the delivery.
Roles and Responsibilities
- Develop automated tests for product validation (regression and integration).
- Develop and execute test cases, scripts, plans, and procedures (manual and automated).
- Integrate and execute automated tests in CI/CD environments
- Troubleshoot, and improve existing automation scripts
- Act as a lead team member as the team grows, providing support and training to other team members
- Execute test cases against various software applications and document the results
- Perform ad hoc testing of new and existing features to ensure they meet design requirements, quality,
and usability standards
- Follow-up with and document resolution of bugs
- Maintain test cases for manual and automated tests
- Communicate defects to stakeholders in a clear and concise manner
Technical Skills
- Minimum 3 - 5 years experience in a diverse technology environment in a Quality Assurance role
- Experience developing testing strategies and test plans
- Experience creating and executing automated end-to-end tests, using tools such as Selenium,
Cucumber, or other automation frameworks
- Exposure to ‘Leapwork’ is good to have. Expertise on Java, OOPS Concepts
- Good understanding of software development lifecycles
- Ability to work in multiple application environments
Strong data analysis, data verification, and problem-solving abilities
You should have
- Fluency in written and communication skills in English
- Strong ability to work collaboratively in a team environment
- Excellent organizational skills including, management of multiple assignments, setting personal goals and
targets, and document management
- Excellent focus on detail through adherence to quality assurance best practices
Role and responsibilities:
- Develop recruitment goals and objectives.
- Develop sustainable recruiting strategy based on our goals and needs.
- Source passive candidates
- Search resume databases for the most fit candidates
- Communicate with Hiring Managers
- Determine the effectiveness and success of current recruiting plans and strategies.
- Write and proofread job descriptions.
- Recommend new sources for active and passive candidate recruiting.
- Build talent networks to find qualified active and passive candidates.
- Use multi-channel approach to recruit.
- Evaluate which sources bring best candidates.
- Identify key recruiting KPIs.
- Plan and implement a Recruitment Marketing and Employer Branding strategy to attract high quality applicants.
- Review applicants to evaluate if they meet the position requirements.
- Interview candidates following company's rules and regulations.
- Adhere to laws, rules, and regulations.
- Adhere to personal data privacy regulations.
- Responsible for end-to-end recruitment activities.
- Responsible for hiring decisions Offer Negotiation / DOJ negotiations / Notice period Negotiations with candidates.
- Rich experience in technical/Non-technical hiring across all levels (junior, middle & senior)
- Build a team with skills in ETL, reporting, MDM and ad-hoc analytics support
- Build technical solutions using latest open source and cloud based technologies
- Work closely with offshore senior consultant, onshore team and client's business and IT teams to gather project requirements
- Assist overall project execution from India - starting from project planning, team formation system design and development, testing, UAT and deployment
- Build demos and POCs in support of business development for new and existing clients
- Prepare project documents and PowerPoint presentations for client communication
- Conduct training sessions to train associates and help shape their growth


