





Senior Data Engineer Job Description
Overview
The Senior Data Engineer will design, develop, and maintain scalable data pipelines and
infrastructure to support data-driven decision-making and advanced analytics. This role requires deep
expertise in data engineering, strong problem-solving skills, and the ability to collaborate with
cross-functional teams to deliver robust data solutions.
Key Responsibilities
Data Pipeline Development: Design, build, and optimize scalable, secure, and reliable data
pipelines to ingest, process, and transform large volumes of structured and unstructured data.
Data Architecture: Architect and maintain data storage solutions, including data lakes, data
warehouses, and databases, ensuring performance, scalability, and cost-efficiency.
Data Integration: Integrate data from diverse sources, including APIs, third-party systems,
and streaming platforms, ensuring data quality and consistency.
Performance Optimization: Monitor and optimize data systems for performance, scalability,
and cost, implementing best practices for partitioning, indexing, and caching.
Collaboration: Work closely with data scientists, analysts, and software engineers to
understand data needs and deliver solutions that enable advanced analytics, machine
learning, and reporting.
Data Governance: Implement data governance policies, ensuring compliance with data
security, privacy regulations (e.g., GDPR, CCPA), and internal standards.
Automation: Develop automated processes for data ingestion, transformation, and validation
to improve efficiency and reduce manual intervention.
Mentorship: Guide and mentor junior data engineers, fostering a culture of technical
excellence and continuous learning.
Troubleshooting: Diagnose and resolve complex data-related issues, ensuring high
availability and reliability of data systems.
Required Qualifications
Education: Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science,
or a related field.
Experience: 5+ years of experience in data engineering or a related role, with a proven track
record of building scalable data pipelines and infrastructure.
Technical Skills:
Proficiency in programming languages such as Python, Java, or Scala.
Expertise in SQL and experience with NoSQL databases (e.g., MongoDB, Cassandra).
Strong experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services
(e.g., Redshift, BigQuery, Snowflake).
Hands-on experience with ETL/ELT tools (e.g., Apache Airflow, Talend, Informatica) and
data integration frameworks.
Familiarity with big data technologies (e.g., Hadoop, Spark, Kafka) and distributed
systems.
Knowledge of containerization and orchestration tools (e.g., Docker, Kubernetes) is a
plus.
Soft Skills:
Excellent problem-solving and analytical skills.
Strong communication and collaboration abilities.
Ability to work in a fast-paced, dynamic environment and manage multiple priorities.
Certifications (optional but preferred): Cloud certifications (e.g., AWS Certified Data Analytics,
Google Professional Data Engineer) or relevant data engineering certifications.
Preferred Qualifica
Experience with real-time data processing and streaming architectures.
Familiarity with machine learning pipelines and MLOps practices.
Knowledge of data visualization tools (e.g., Tableau, Power BI) and their integration with data
pipelines.
Experience in industries with high data complexity, such as finance, healthcare, or
e-commerce.
Work Environment
Location: Hybrid/Remote/On-site (depending on company policy).
Team: Collaborative, cross-functional team environment with data scientists, analysts, and
business stakeholders.
Hours: Full-time, with occasional on-call responsibilities for critical data systems.

About KJBN labs
About
With a strong foundation in technology and a deep understanding of the ever-evolving business landscape, we recognized the pressing need for user-friendly, scalable, and cost-effective SaaS solutions. Driven by this realisation, we embarked on a mission to craft software that seamlessly integrates into diverse industries, catering to their unique requirements and challenges.
Candid answers by the company
Agri tech product
Company social profiles
Similar jobs

💼 Position: Software Tester – Automation (On-Site)
📍 Location: Navi Mumbai
🕒 Immediate Joiners Preferred
✨ Why Join Us?
✅ Growth-driven environment with exciting projects
✅ Weekends off + provident fund benefits
✅ Supportive, collaborative & innovation-first culture
🔍 Role Overview
As a Software Tester, you’ll play a key role in ensuring product quality through manual, automation, and performance testing. You’ll collaborate with developers, project managers, and QA peers, while also exploring AI-driven testing approaches to innovate our QA practices.
Key Skills We’re Looking For:
Key Responsibilities
🧾 Requirement Analysis & Test Planning
• Attend client meetings to gather and understand testing needs.
• Translate business and technical requirements into structured test plans and test cases.
🧪 Manual Testing
• Execute functional, UI, smoke, sanity, and exploratory tests.
• Perform validations across development, QA, and production environments.
🤖 Automation Development & Maintenance
• Design and maintain automated test scripts using Selenium and TestNG.
• Integrate scripts into CI pipelines for continuous testing coverage.
🐞 Defect Management
• Log, track, and retest bugs using Zoho BugTracker, Jira, or similar tools.
• Ensure clear status updates, steps to reproduce, and proper defect lifecycle management.
🧠 AI-Driven Testing Exploration
• Research and experiment with AI tools or agents to streamline testing processes.
• Suggest areas for AI testing implementation within test cycles.
🤝 Collaboration & Communication
• Sync daily with developers, project managers, and QA peers during stand-ups.
• Actively report blockers, coverage updates, and test progress.
📊 Test Reporting & Metrics
• Compile dashboards and reports to reflect test progress, automation coverage, defect trends, and potential risks.
Performance Indicators (KPIs)
✅ Strong knowledge of Python
✅ Hands-on with Selenium (Python)
✅ Functional/Manual Testing expertise
✅ Pytest Framework proficiency
✅ API Testing (Postman/Swagger)
✅ CI/CD Pipeline Integration experience
✅ Proficiency in Git Version Control
✅ Familiarity with JMeter/LoadRunner, TestNG, Jira/Zoho BugTracker
Soft Skills That Set You Apart:
🌐 Strong communication & collaboration
🔍 Attention to detail & problem-solving mindset
JOB DESCRIPTION
· Develop business plans for allocated accounts. Achieve revenue targets
· Develop loyalty program strategy, design and develop programs to achieve identified engagement objectives.
· Own agency deliverables wrt to allocated accounts – Program KPIs, operational SLAs, reporting & MIS, technology development, customer care operations, creative services, event management, print & productions etc.
· Upsell and cross-sell Colorgenics’s services by finding new avenues of revenue generation within allocated accounts
· Conduct quarterly and annual program reviews with client’s senior management teams.
· Share strategic inputs, industry best practices with clients and help driving the program performance
· Develop and implement tactical campaigns to improve engagement through various initiatives and promotions.
· Giving creative direction to the team. And act as a creative output reviewer and approver.
· Team mentoring & reviews.
· Act as a facilitator of 3rd party auditors appointed by clients.
· Keeping total control on invoicing and collections.
CANDIDATE PROFILE AND QUALIFICATION:
· Thorough knowledge of CRM & loyalty marketing. A seasonal professional with at least 8 years’ experience in heading big accounts
· Marketing & Analytics knowledge, excellent communication skills, Technical and Managerial experience in designing, developing & growing a loyalty program.
· This role requires a solid background in loyalty program management and client relationship management.
· Team handling exposure and aptitude to handle challenging circumstances.
· MBA / PGDBM is required
What you can expect at Colorgenics?
A Dynamic workplace with start-up attitude which fuels your passion to learn and unlearn. You may expect a fantastic work atmosphere of like-minded individuals keen to do something out of the box and disruptive.

Must have :
- Strong Experience in Python development
- Familiarity with Data Structures and Algorithms
- Experience in developing Enterprise scale applications
- Exposure to NLP
- Exposure / awareness of AI, ML
- Exposure to Windows Azure is an added advantage
- God understanding of project architecture and software development processes such as Agile and Scrum
Responsibilities :
- Partner with Business Stakeholders to translate business objectives into clearly defined analytical Projects
- Own the end-end process, from recognizing the problem to implementing the solution
- Understand customer’s requirements and design the optimum solution using Icertis’ AI applications
- Configure, Extend, and optimize Icertis AI app through Python scripts, NLP NER Analysis and other mechanisms
- Take full ownership of project / product features to implement, provide bug fixes and write tests and tooling for those features to ensure they work well at cloud scale.
- Plan and identify solutions and risks in assigned work
- You are expected to be hands on and write code on day to day basis and also mentor other team members


Machine Learning & Deep Learning – Strong
Experienced in TensorFlow, PyTorch, ONNX, Object Detection, Pretrained Models like YOLO, SSD, Faster RCNN, etc…
Python – Strong
NumPy, Pandas, OpenCV
Problem Solving - strong
C++ - average
It will be good if candidate have working experience in C++ in any domain
Note :: Looking for Immediate to 30 days of Notice Period


- Developing front-end website architecture.
- Designing user interactions on web pages.
- Developing back-end website applications.
- Creating servers and databases for functionality.
- Ensuring cross-platform optimization for mobile phones.
- Ensuring responsiveness of applications.
- Working alongside graphic designers for web design features.
- Seeing through a project from conception to finished product.
- Designing and developing APIs.
- Meeting both technical and consumer needs.
- Staying abreast of developments in web applications and programming languages.
- Degree in computer science.
- Strong organizational and project management skills.
- Proficiency with fundamental front-end languages such as HTML, CSS, and JavaScript.
- Familiarity with JavaScript frameworks such as React(mandatory/preferred), Angular JS, and Amber.
- Proficiency with server-side languages such as Node.js(mandatory/preferred), Java, PHP.
- Familiarity with database technology such as MySQL, Oracle, and MongoDB.
- Excellent verbal communication skills.
- Good problem-solving skills.
- Attention to detail.


Key Responsibilities
- Learn, design and implement the architecture with the team
- Build a team of A-players with veto rights for each member
- Work to design and build for speed and scalability
- Design and implementation of continuous integration and deployment
- Create security and data protection settings
- Build features and applications with a mobile responsive design
- Write technical documentation
Recommended
- Experience developing desktop and mobile applications of a minimum of 2 years
- Familiarity with common tech stacks and Headless Ecommerce
- Knowledge of multiple front-end languages and libraries (js, React, React Native)
- Knowledge of back-end languages and libraries (Node.js, MongoDB, PHP, MySQL)
- Experience implementing testing platforms and unit tests
- Strong organizational and project management skills
- Excellent communication and teamwork skills
- Attention to detail

- Substantial experience in building large complex and performant web applications using HTML5, CSS3, Typescript and Javascript across multiple browsers (Especially IE11).
- Experience in frameworks such as React (Redux, Redux Thunk or Saga, React Router, React Hooks) , Node JS and good understanding of the basics of these frameworks and their life cycles.(MUST HAVE)
- Experience in frameworks like Bootstrap and CSS pre-processors like SASS and LESS is desirable.
- Deeper understanding of network layer, HTTP, HTTPS, cookies, local storage.
- Knowledge to handle real-time async data would be a plus.
- Good knowledge on build tools like Webpack and Gulp
- Good knowledge on testing tools like Jest, Cypress, Jasmine, Karma, etc
- Experience in Git source control
- Deeper understanding of Chrome Dev Tools.
- Deeper knowledge of UI optimizations and performance.
- Excellent communication skills, good visual design sense, in-depth experience in developing web-based applications.
- Experience leading multi engineer projects and mentoring junior engineers.
- Command an impressive portfolio of the latest UI technologies is a plus

