
We are looking for a highly skilled Sr. Big Data Engineer with 3-5 years of experience in
building large-scale data pipelines, real-time streaming solutions, and batch/stream
processing systems. The ideal candidate should be proficient in Spark, Kafka, Python, and
AWS Big Data services, with hands-on experience in implementing CDC (Change Data
Capture) pipelines and integrating multiple data sources and sinks.
Responsibilities
- Design, develop, and optimize batch and streaming data pipelines using Apache Spark and Python.
- Build and maintain real-time data ingestion pipelines leveraging Kafka and AWS Kinesis.
- Implement CDC (Change Data Capture) pipelines using Kafka Connect, Debezium or similar frameworks.
- Integrate data from multiple sources and sinks (databases, APIs, message queues, file systems, cloud storage).
- Work with AWS Big Data ecosystem: Glue, EMR, Kinesis, Athena, S3, Lambda, Step Functions.
- Ensure pipeline scalability, reliability, and performance tuning of Spark jobs and EMR clusters.
- Develop data transformation and ETL workflows in AWS Glue and manage schema evolution.
- Collaborate with data scientists, analysts, and product teams to deliver reliable and high-quality data solutions.
- Implement monitoring, logging, and alerting for critical data pipelines.
- Follow best practices for data security, compliance, and cost optimization in cloud environments.
Required Skills & Experience
- Programming: Strong proficiency in Python (PySpark, data frameworks, automation).
- Big Data Processing: Hands-on experience with Apache Spark (batch & streaming).
- Messaging & Streaming: Proficient in Kafka (brokers, topics, partitions, consumer groups) and AWS Kinesis.
- CDC Pipelines: Experience with Debezium / Kafka Connect / custom CDC frameworks.
- AWS Services: AWS Glue, EMR, S3, Athena, Lambda, IAM, CloudWatch.
- ETL/ELT Workflows: Strong knowledge of data ingestion, transformation, partitioning, schema management.
- Databases: Experience with relational databases (MySQL, Postgres, Oracle) and NoSQL (MongoDB, DynamoDB, Cassandra).
- Data Formats: JSON, Parquet, Avro, ORC, Delta/Iceberg/Hudi.
- Version Control & CI/CD: Git, GitHub/GitLab, Jenkins, or CodePipeline.
- Monitoring/Logging: CloudWatch, Prometheus, ELK/Opensearch.
- Containers & Orchestration (nice-to-have): Docker, Kubernetes, Airflow/Step
- Functions for workflow orchestration.
Preferred Qualifications
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field.
- Experience in large-scale data lake / lake house architectures.
- Knowledge of data warehousing concepts and query optimisation.
- Familiarity with data governance, lineage, and cataloging tools (Glue Data Catalog, Apache Atlas).
- Exposure to ML/AI data pipelines is a plus.
Tools & Technologies (must-have exposure)
- Big Data & Processing: Apache Spark, PySpark, AWS EMR, AWS Glue
- Streaming & Messaging: Apache Kafka, Kafka Connect, Debezium, AWS Kinesis
- Cloud & Storage: AWS (S3, Athena, Lambda, IAM, CloudWatch)
- Programming & Scripting: Python, SQL, Bash
- Orchestration: Airflow / Step Functions
- Version Control & CI/CD: Git, Jenkins/CodePipeline
- Data Formats: Parquet, Avro, ORC, JSON, Delta, Iceberg, Hudi

About Inncircles
About
Similar jobs
Key Responsibilities:
- Keyword Research: Conduct thorough keyword research using SEO tools like Google Keyword Planner, SEMrush, and Ahrefs to identify target keywords for optimization.
- On-Page Optimization: Assist in optimizing web pages for SEO, including improving title tags, meta descriptions, headers, and internal linking.
- Content Optimization: Collaborate with the content team to optimize website content, blog posts, and landing pages to ensure they are search-engine friendly.
- Technical SEO Support: Assist in monitoring site performance and troubleshooting SEO-related issues like page speed, mobile-friendliness, and site architecture.
- SEO Audits: Conduct basic SEO audits and analyze websites for performance improvements, including broken links, duplicate content, and other technical factors.
- Competitor Analysis: Analyze competitor websites and their SEO strategies to uncover new opportunities for improvement.
- Link Building: Assist in identifying and reaching out for potential backlink opportunities to increase website authority.
- Reporting: Track SEO performance using Google Analytics, Google Search Console, and other tools to generate insights and monthly reports.
- Stay Updated: Keep up with the latest SEO trends, algorithm updates, and industry best practices to ensure our strategies are always up to date.
Job Title - Senior Backend Engineer
About Tazapay
Tazapay is a cross border payment service provider. They offer local collections via local payment methods, virtual accounts and cards in over 70 markets. The merchant does not need to create local entities anywhere and Tazapay offers the additional compliance framework to take care of local regulations and requirements. This results in decreased transaction costs, fx transparency and higher auth rates.
They are licensed and backed by leading investors. www.tazapay.com
What’s exciting waiting for You?
This is an amazing opportunity for you to join a fantastic crew before the rocket ship launch. It will be a story you will carry with you through your life and have the unique experience of building something ground up and have the satisfaction of seeing your product being used and paid for by thousands of customers. You will be a part of a growth story be it anywhere - Sales, Software Development, Marketing, HR, Accounting etc.
We believe in a culture of openness, innovation & great memories together.
Are you ready for the ride?
Find what interesting things you could do with us.
About the Backend Engineer role
Responsibilities (not exhaustive)
- Design, write and deliver highly scalable, reliable and fault tolerant systems with minimal guidance
- Participate in code and design reviews to maintain our high development standards
- Partner with the product management team to define and execute the feature roadmap
- Translate business requirements into scalable and extensible design
- Proactively manage stakeholder communication related to deliverables, risks, changes and dependencies
- Coordinate with cross functional teams (Mobile, DevOps, Data, UX, QA etc.) on planning and execution
- Continuously improve code quality, product execution, and customer delight
- Willingness to learn new languages and methodologies
- An enormous sense of ownership
- Engage in service capacity and demand planning, software performance analysis, tuning and optimization
The Ideal Candidate
Education
- Degree in Computer Science or equivalent with 5+ years of experience in commercial software development in large distributed systems
Experience
- Hands-on experience in designing, developing, testing and deploying applications on Golang, Ruby,Python, .Net Core or Java for large scale applications
- Deep knowledge of Linux as a production environment
- Strong knowledge of data structures, algorithms, distributed systems, and asynchronous architectures
- Expert in at least 1 of the following languages: Golang, Python, Ruby, Java, C, C++
- Proficient in OOP, including design patterns.
- Ability to design and implement low latency RESTful services
- Hands-on coder who has built backend services that handle high volume traffic.
- Strong understanding of system performance and scaling
- Possess excellent communication, sharp analytical abilities with proven design skills, able to think critically of the current system in terms of growth and stability
- Data modeling experience in both Relational and NoSQL databases
- Continuously refactor applications to ensure high-quality design
- Ability to plan, prioritize, estimate and execute releases with good degree of predictability
- Ability to scope, review and refine user stories for technical completeness and to alleviate dependency risks
- Passion for learning new things, solving challenging problems
- Ability to get stuff done!
Nice to have
- Familiarity with Golang ecosystem
- Familiarity with running web services at scale; understanding of systems internals and networking are a plus
- Be familiar with HTTP/HTTPS communication protocols.
Abilities and Traits
- Ability to work under pressure and meet deadlines
- Ability to provide exceptional attention to details of the product.
- Ability to focus for extended periods of repetitious activity.
- Ability to think ahead and anticipate problems, issues and solutions
- Work well as a team player and help the team members to resolve issues
- Be committed to quality and be structured in approach
- Excellent and demonstrable concept formulation, logical and analytical skills
- Excellent planning, organizational, and prioritization skills
Location - Chennai - India
Join our team and let's groove together to the rhythm of innovation and opportunity!
Your Buddy
Tazapay
The ideal candidate will be responsible for developing high-quality applications using Bubble.io, you will also be responsible for designing and implementing testable and scalable code.
Responsibilities
- Develop quality software and web applications using Bubble.io
- Accurately translate and interpret UI/UX designs from Figma into bubble.io including the configuration of responsive design parameters .
- Analyze and maintain existing software and Bubble.io applications
- Design highly scalable, testable code maintainable and well-documented Bubble.io applications
- Discover and fix programming bugs
- Extend Bubble.io front end capacity with custom HTML ,CSS, javascript
- Extend bubble.io's backend capacity by implementing plugins , API connections
Qualifications
- Bachelor's degree or equivalent experience in Computer Science or related field
- Development experience with programming languages
- Short course or equivalent experience with backend development languages (HTML, CSS , javascript)
- Short courses or equivalent experience with back-end development languages (e.g. NodeJS, Python)
- Short courses or equivalent experience working with databases (SQL, NoSQL) and APls.
Experience
• Over 6 months full-time experience working with Bubble.io (you will be required to show your portfolio of work of demonstrating a deep knowledge of Bubble during the process)
• One or more years of experience designing, implementing and maintaining Relational Databases
• One or more years of experience building web applications (any language) or work in a technical business analyst or product leadership role
• Client facing experience is highly regarded
Note: This is a full-time role based in Bangalore and will require you to work from the office.
Websites: www.rajivtalreja.com www.karanhasija.com www.quantumleap.co.in
Team:- We are a team of 9 data scientists working on Video Analytics Projects, Data Analytics projects for internal AI requirements of Reliance Industries as well for the external business. At a time, we make progress on multiple projects(atleast 4) in Video Analytics or Data Analytics.
Stipend will be based on the performance.
Job Description :
- Collaborate with cross-functional teams to define, design, and ship new features.
- Work with outside data sources and APIs.
- Worked on Dart.js
- Unit-test code for robustness, including edge cases, usability, and general reliability
- Work on bug fixing and improving application performance
- Continuously discover, evaluate, and implement new technologies to maximize development efficiency.
Responsibilities And Duties :
- Must have built at least one Android, iOS, apps with Flutter or Hybrid Framework.
Job description
We are looking for an experienced full stack developer, comfortable with both frontend and backend programming. You will be responsible for the development and maintenance of our web applications across the three products - Spectra, Drone Mission Ops and DronePass.
Spectra: An integrated drone data platform to visualize enterprise worksites and perform AI-powered analytics that helps teams plan better, construct faster, and sustain longer.
Drone Mission Ops (DMO): A full-stack drone flight solution that enables drone service providers, pilots, and enterprises to execute fast, accurate, and seamless drone missions
DronePass: Hardware module and integration solution that helps drone manufacturers, OEMs, and system integrators integrate their drones with Digital Sky for Unmanned Traffic Management.
Responsibilities
-
Build and deploy new tools to streamline the overall process flow as requirements develop
-
Explore new technologies and products to see how they can improve our products
-
Translate business requirements into technical specifications; communicate and get
stakeholder buy-in; iterate and refine
-
Review, prepare and present design/code to colleagues
-
Coordinating with the extended development team and cross-functional teams
Skillset
Must have
-
Proficiency with JavaScript and Python
-
2+ years experience working on web applications (building, maintaining and debugging)
-
2+ years experience working with either Django or Flask framework
-
2+ years experience working with either VueJS or React framework
-
Experience with databases such as PostgreSQL or MySQL or MongoDB
-
Experience in design and implementation of ReST APIs
-
Proficiency with Git version control
Good to have
-
Knowledge of TypeScript
-
Knowledge of GraphQL and PostGIS
-
Knowledge in test-driven development: unit tests and integration tests
-
Experience with deployment tools such as Docker and CI/CD
-
Experience with cloud services such as AWS or GCP
-
Experience with map-related libraries such as GDAL, Geopandas, MapBox, Leaflet etc.
Call Reception and Ticket Logging: Responsible for:
- Ensuring calls are answered professionally
- Ensuring that the relevant information is collected from a customer
- Ensuring that the correct level of priority is agreed with the customer
- Ensuring that the ticket is assigned to the correct engineer
- Ensuring that the engineer is aware that there is a new ticket assigned to their queue
SLA Management: Responsible for: - Ensuring that appropriate attention is paid to P1s
- TPMs engaged immediately for engineer dispatch to the site where applicable
- The customer is forwarded to an engineer for a possible remote fix
- Ensuring that all tickets are managed in line with SLAs
Jeopardy Management: Responsible for: - Ensuring that the ticket is managed in line with Company’s jeopardy management process
Escalation Management: Responsible for: - Ensuring that the ticket is escalated appropriately in line with Company’s escalation process
- Provide 1st line escalation to customers and channels (referring to Jeopardy and Escalation Manager)
- Provide 1st line escalation into TPM (referring to Jeopardy and Escalation Manager)
- Responsible for advising Service Centre Manager of any missing information in the knowledge database
Communication Responsible for: - Customer Communication
- Ensuring that the customer is updated regularly throughout the duration of the ticket
- Ensuring the quality of ticket input is of a high standard
- Ensuring that key internal contacts are advised of any issues
- Responsible for reading, understanding, and complying with Company’s Information Security policies.
FORMAL EDUCATION AND TRAINING
- Educated to an A-level minimum, with higher education qualification (degree or equivalent preferred). Alternatively, relevant and proven Industry experience would be accepted
- Industry or relevant business qualifications and accreditations would be desirable
- Proficiency involved in working in the service industry, with particular emphasis placed on customer focus issues.
- Ability to form close working relationships with the customer community, sub-contractors
- Excellent client-facing communications skills
- A Self-motivated team player with excellent interpersonal skills
- An outgoing individual willing to participate as part of a small and flexible team
- in European languages would be an advantage
- ITIL Foundation / ITIL v3 Foundation
- Overall telecommunications knowledge with an appreciation of the Nortel / Avaya / Genesys / AWS Product Sets
Key Competencies
- Customer Focused
- Relationship Building and Maintenance
- Decision-Making Ability
- Inspiring Communicator
- Initiating Action
- Personal Responsibility
Duties and Responsibilities
- Participate in requirements
- Maintain and improve web Design mobile-based web features.
- Work closely with Scrum team to ensure quality throughout the entire software development
- Maintain high standards of software quality by establishing, adopting and following good practices and processes
- Monitor systems to ensure they meet both customer needs and business goals
- Solve problems by crafting software solutions using maintainable, testable and modular code
- Collaborate within a team by participating in code reviews, pairing sessions, architecture discussions and planning
- Write robust, testable code, along with unit, functional, acceptance and/or user tests to validate every change
- Challenge your fellow team members to grow and enhance our team with new, diverse talent
- Mentor interns and other software engineers to grow their technical skills
- Work closely with Scrum team to ensure quality throughout the entire software development cycle.
- Identify and propose dev toolsets to enhance and extend the dev team’s capabilities & efficiency
- Manage business context and pressures around quality and time to market
- Stay up-to-date on emerging technologies









