
Senior Data Engineer Job Description
Overview
The Senior Data Engineer will design, develop, and maintain scalable data pipelines and
infrastructure to support data-driven decision-making and advanced analytics. This role requires deep
expertise in data engineering, strong problem-solving skills, and the ability to collaborate with
cross-functional teams to deliver robust data solutions.
Key Responsibilities
Data Pipeline Development: Design, build, and optimize scalable, secure, and reliable data
pipelines to ingest, process, and transform large volumes of structured and unstructured data.
Data Architecture: Architect and maintain data storage solutions, including data lakes, data
warehouses, and databases, ensuring performance, scalability, and cost-efficiency.
Data Integration: Integrate data from diverse sources, including APIs, third-party systems,
and streaming platforms, ensuring data quality and consistency.
Performance Optimization: Monitor and optimize data systems for performance, scalability,
and cost, implementing best practices for partitioning, indexing, and caching.
Collaboration: Work closely with data scientists, analysts, and software engineers to
understand data needs and deliver solutions that enable advanced analytics, machine
learning, and reporting.
Data Governance: Implement data governance policies, ensuring compliance with data
security, privacy regulations (e.g., GDPR, CCPA), and internal standards.
Automation: Develop automated processes for data ingestion, transformation, and validation
to improve efficiency and reduce manual intervention.
Mentorship: Guide and mentor junior data engineers, fostering a culture of technical
excellence and continuous learning.
Troubleshooting: Diagnose and resolve complex data-related issues, ensuring high
availability and reliability of data systems.
Required Qualifications
Education: Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science,
or a related field.
Experience: 5+ years of experience in data engineering or a related role, with a proven track
record of building scalable data pipelines and infrastructure.
Technical Skills:
Proficiency in programming languages such as Python, Java, or Scala.
Expertise in SQL and experience with NoSQL databases (e.g., MongoDB, Cassandra).
Strong experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services
(e.g., Redshift, BigQuery, Snowflake).
Hands-on experience with ETL/ELT tools (e.g., Apache Airflow, Talend, Informatica) and
data integration frameworks.
Familiarity with big data technologies (e.g., Hadoop, Spark, Kafka) and distributed
systems.
Knowledge of containerization and orchestration tools (e.g., Docker, Kubernetes) is a
plus.
Soft Skills:
Excellent problem-solving and analytical skills.
Strong communication and collaboration abilities.
Ability to work in a fast-paced, dynamic environment and manage multiple priorities.
Certifications (optional but preferred): Cloud certifications (e.g., AWS Certified Data Analytics,
Google Professional Data Engineer) or relevant data engineering certifications.
Preferred Qualifica
Experience with real-time data processing and streaming architectures.
Familiarity with machine learning pipelines and MLOps practices.
Knowledge of data visualization tools (e.g., Tableau, Power BI) and their integration with data
pipelines.
Experience in industries with high data complexity, such as finance, healthcare, or
e-commerce.
Work Environment
Location: Hybrid/Remote/On-site (depending on company policy).
Team: Collaborative, cross-functional team environment with data scientists, analysts, and
business stakeholders.
Hours: Full-time, with occasional on-call responsibilities for critical data systems.

About KJBN labs
About
With a strong foundation in technology and a deep understanding of the ever-evolving business landscape, we recognized the pressing need for user-friendly, scalable, and cost-effective SaaS solutions. Driven by this realisation, we embarked on a mission to craft software that seamlessly integrates into diverse industries, catering to their unique requirements and challenges.
Candid answers by the company
Agri tech product
Company social profiles
Similar jobs
Flutter Developer (Android + iOS) | 2 Years
We are looking for a Flutter Developer with 2 years of experience in building and maintaining Android & iOS applications.
Responsibilities:
• Develop and maintain mobile apps using Flutter & Dart
• Work with device features (storage, media, contacts, permissions, API integrations, OffAI/ ONAI)
• Integrate AdMob and In-App Purchases
• Publish apps to Play Store & App Store
• Fix crashes, optimize performance, and scale apps long-term
Must Have:
• 2+ years Flutter experience
• Live apps on Play Store / App Store
• Knowledge of App Store & Play Store guidelines
• Experience with Firebase, crash fixing & performance optimization
About StepSecurity
StepSecurity, a US-based cybersecurity startup prevents, detects, and responds to software supply chain attacks by analyzing behavior across the full software development lifecycle for both developers and AI coding agents. We are building a vertical AI agent for supply chain security across three pillars: securing AI agents on developer machines, OSS package security, and CI/CD security, covering the entire agentic pipeline from dev environment to cloud.
We are a 16-person team, founded by Varun Sharma (ex-Microsoft, 21 years, led supply chain security for Azure) and Ashish Kurmi (ex-Uber, Microsoft, Plaid, 17 years).
About the Job
We are seeking backend engineers to build and maintain our CI/CD security platform's backend systems and components (GitHub Actions). This high-impact role involves setting best practices and owning engineering processes, with contributions used by thousands of developers globally. Our primary languages are Golang and Node.js.
Requirements
- 2–5 years of experience, strong engineering fundamentals (cyber security background not mandatory), AI-native mindset, comfortable with a hands-on zero-to-one environment. We use Golang as our primary language.
- Must-haves: Golang backend programming; AWS/Azure/GCP background; scalable/fault-tolerant system design.
- For all engineering positions, prior early-stage startup experience is a must-have requirement.
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- Solid understanding of software development principles, design patterns, and best practices.Expertise in building scalable and fault-tolerant systems.
- Strong collaborative and problem-solving skills.
- Self-motivated, creative thinker with a drive for continuous improvement.
- Experience in a startup or high-impact, outcome-driven environment.
Location
India remote. Candidates should be able to overlap a few hours with Pacific Time (PT) when working on urgent customer issues as required.
Responsibilities
- Design, develop, and maintain robust, scalable software solutions.
- Architect and implement CI/CD components (GitHub Actions).
- Deliver features incrementally in quick iterations.
- Write clean, efficient, and maintainable code following industry best practices.
- Conduct code reviews and provide constructive feedback.
- Troubleshoot and debug complex software issues promptly.
Why Join Us
- StepSecurity is at the forefront of supply chain security research and product development. We were the first to detect several major supply chain attacks in 2025 and 2026 such as the axios npm compromise, tj-actions, etc (https://www.stepsecurity.io/newsroom)
- Our research and findings are regularly cited by major publications such as Bloomberg, TechCrunch, Hacker News, and Dark Reading. The Cybersecurity and Infrastructure Security Agency (CISA), the primary cybersecurity agency for the US federal government, has published several cybersecurity advisories citing StepSecurity (e.g., https://www.cisa.gov/news-events/alerts/2025/09/23/widespread-supply-chain-compromise-impacting-npm-ecosystem)
- In addition to having several enterprise customers, StepSecurity has been adopted by more than 15,000 open-source projects, including projects from Microsoft, Google, Amazon, Datadog, and others.
- Engineers joining now get to work on hard, high-impact problems at the intersection of security, AI, and open source, with meaningful equity upside at an early stage.
- Key Responsibilities
- · Design and produce motion graphics and animations for videos, ensuring high-quality visuals and seamless integration.
- · Edit raw video footage and enhance it with graphics, animations, special effects, sound, and music.
- · Collaborate with the content team to conceptualise and execute video projects that align with our brand and marketing objectives.
- · Create engaging and on-brand graphics for video thumbnails, social media posts, and other digital content.
- · Edit and enhance video footage using Adobe Premiere Pro or similar tools.
- · Design visually appealing graphics using Adobe Photoshop, Illustrator, and InDesign.
- · Manage multiple projects simultaneously and meet tight deadlines.
- · Stay updated with the latest trends and best practices in motion graphics and video production.
- · Maintain organised project files and documentation for easy collaboration and future reference.
Should have aldready worked as Lead and mentored and managed Junior Team Members
4Yrs + on MEAN Stack or if total Experience more than 6Yrs; 3years + Could be MEAN
Worked in Product Based COmpanies
Deisgn,Develop, Debug ,Deploy! All Individually
Micro Service Architecture
Experience in FIn-tech/Finance based companies are a plus!
AWS,Google CLoud & SOcket Programming
Worked on Angular 4+ (5,6,7,8)
- Microsoft development experience using C#, ASP.NET Core Web API, MVC, Authentication and
Authorization, and proficient in developing large scale web applications using a .Net framework.
- Hands-on working experience with setting up applications using Azure Functions, Azure SQL and
NoSQL
- Guide the development team with building applications on Azure Cloud
- Learn and research new solutions for application development that can be applicable to the
business problems we solve
Requirements:
- Problem solver using data and deep understanding of designing/setting up solutions
- Minimum of 2 years experience using and implementing Azure Active Directory, Azure Functions
with various triggers
- Strong interpersonal and communication skills and flexibility to work US Hours if needed
- Be flexible to learn new technologies and apply them to solve business problems
- Strong Communication skills (verbal and written).
- Extremely detail-oriented and well-organized.
- Ability to positively engage with the clients and build strong long-term relationships.
- Ability to work efficiently and effectively in a high-paced environment and under deadlines.
About Us:
DataBeat.io is a data and analytics services company that provides big data, analytics and
operations management services to various companies globally.
Working at DataBeat.io helps you to be at the forefront of the big data and analytics ecosystem. You
will work with clients who are leading companies that develop breakthrough solutions, concepts that
are shaping the technology world and cutting-edge tools. Fast-growing company where your
performance and contribution could move you into leadership positions fairly quickly.
•Design and develop distributed, scalable, high availability web services.
•Work independently completing small to Mid-sized projects while
managing competing priorities in a demanding production environment.
•you will be writing reusable and maintainable quality code.
What You'll Bring
•BS in CS (or equivalent) and 4+ years of hands-on software design and
development experience in building high-availability, scalable backend
systems.
•hands-on coding experience is a must.
•Expertise in working on Java technology stacks in Linux environment -
Java, Spring/ Hibernate, MVC frameworks, TestNG, JUnit.
•Expertise in Database Schema Design, performance efficiency, and SQL
working on leading RDBMS such as MySQL, Oracle, MSSQL, etc.
•Expertise in OOAP, Restful Web Services, and building scalable systems
Preferred Qualifications:
•Experience using Platforms such as Drools, Solr, Memcached, AKKA, Scala,
Kafka etc. is a plus
•Participation in and Contributions to Open-Source Software Development and contributions
Your responsibilities as a backend engineer will include:
- Back-end software development
- Software engineering and designing data models and write effective APIs
- Working together with engineers and product teams
- Understanding business use cases and requirements for different internal teams
- Maintenance of existing projects and New feature development
- Consume and integrate classifier/ ML snippets from Data science team
What we are looking for:
- 2+ years of industry experience with the Python and Django framework.
- Degree in Computer Science or related field
- Good analytical skills with strong fundamentals of data structures and algorithms
- Experience building backend services with hands-on experience through all stages of Agile software development life cycle.
- Ability to write optimized codes,debug programs, and integrate applications with third party tools by developing various APIs
- Experience with Databases.
- Experience with writing REST-APIs.
- Prototyping initial collection and leveraging existing tools and/or creating new tools
- Experience working different types of datasets (e.g. unstructured, semi-structured, with missing information)
- Ability to think critically and creatively in a dynamic environment, while picking up new tools and domain knowledge along the way
- A positive attitude, and a growth mindset
Bonus:
- Experience with relevant Python libraries such as Requests, sklearn, Selenium
- Hands on experience in Machine learning implementations
- Experience with Cloud infrastructure (e.g. AWS) and relevant microservices
- Good Humor
Note- We are currently working from home due to the pandemic. If selected you may work from a remote location though once office reopens candidate must work from Office.
Role: Java developer
Location: Gurgaon
Exp-3-5 yrs
Description:
- 3+ years of Coding and development experience
2. Hands on technical experience in must have technical requirements.
3. Strong working knowledge of Developing, Designing and implementing large scale enterprise applications.
4. Possess strong analytical skills, organizational skills, attention to detail, and excellent verbal and written communication skills.
5. Ability to establish and maintain effective working relationships with co-workers, managers and internal and/or external customers.
6. Knowledge of Agile process
REQUIRED TECHNICAL SKILL SET
Must have: AWS, Java, J2EE, Angular, React, Javascript, Spring MVC, Webservices (REST), Servlets, Hibernate
Nice to have: EXTJS, JBoss Drools Rules Engine, JQuery
RESPONSIBILITIES
1. Analyses and evaluates detailed business and technical requirements.
2. Codes and maintains complex components of information systems.
3. Develops and performs unit testing and fixes defects identified during testing and re-executes unit tests to validate results.
4. Ensure code quality by performing technical design and code reviews
5. Perform integration via Services/Batch with external and internal systems; develop presentation, business/application services and persistence components
6. Module level ownership and ensure that any development that occurs in that module is as per the agreed solution.
7. Profiling & Performance turning of Javaapplications
Skills:
- Should have Extensive command of the English language.
- Deep understanding of content marketing principles, approach, and execution.
- Should be able to work and deliver quality SEO-based content in a fast-paced and dynamic environment
- Should be able to develop and implement a content strategy that encourages high levels of engagement.

- Deploying, managing, and operating scalable, highly available, and fault-tolerant systems on AWS.
- Implementing and controlling the flow of data to and from AWS.
- Selecting the appropriate AWS service based on compute, data, or security requirements.
- Identifying appropriate use of AWS operational best practices.
- Estimating AWS usage costs and identifying operational cost control mechanisms.
- Managing & troubleshooting on Linux Based Platforms.
- Ensuring efficient functioning of data storage and processing functions in accordance with company security policies and best practices in cloud security.
- Identifying, analyzing, and resolving infrastructure vulnerabilities and application deployment issues.
- Regularly reviewing existing systems and making recommendations for improvements
Essential Criteria:
- Two or more years of hands-on experience operating AWS-based applications.
- Experience provisioning, operating and maintaining systems running on AWS.
- Strong troubleshooting skills like Jboss, Tomcat on Linux Platforms.
- Explicit knowledge of Computing, Storage, Networking, and Security technologies in the Amazon AWS hosting environment.
- Experience in setting up Cloud Monitoring using CloudWatch or any other tool.
- Knowledge of Load Balancers, Firewalls, and network switching components.
- Ability to identify and gather requirements to define a solution to be built and operated on AWS.
- Capabilities to provide AWS operations and deployment guidance and best practices throughout the lifecycle of a project.
- Efficient management of the Company’s IT Assets and Infrastructure.
- Strong knowledge of Linux, shell scripts, Apache, Mysql, Development Operations, Configuration management, monitoring, and TCP/IP protocols.
- Highly self-motivated and hard-working with excellent communication skills. Excellent English verbal and written proficiency is essential.
- Understanding of the basics of scalable SaaS systems /Cloud fundamentals.
- Understanding of security best practices.
- Ability to work with very little supervision and to work well in a team environment.








