Setter

Senior Data Engineer Job Description

Overview

The Senior Data Engineer will design, develop, and maintain scalable data pipelines and

infrastructure to support data-driven decision-making and advanced analytics. This role requires deep

expertise in data engineering, strong problem-solving skills, and the ability to collaborate with

cross-functional teams to deliver robust data solutions.

Key Responsibilities

Data Pipeline Development: Design, build, and optimize scalable, secure, and reliable data

pipelines to ingest, process, and transform large volumes of structured and unstructured data.

Data Architecture: Architect and maintain data storage solutions, including data lakes, data

warehouses, and databases, ensuring performance, scalability, and cost-efficiency.

Data Integration: Integrate data from diverse sources, including APIs, third-party systems,

and streaming platforms, ensuring data quality and consistency.

Performance Optimization: Monitor and optimize data systems for performance, scalability,

and cost, implementing best practices for partitioning, indexing, and caching.

Collaboration: Work closely with data scientists, analysts, and software engineers to

understand data needs and deliver solutions that enable advanced analytics, machine

learning, and reporting.

Data Governance: Implement data governance policies, ensuring compliance with data

security, privacy regulations (e.g., GDPR, CCPA), and internal standards.

Automation: Develop automated processes for data ingestion, transformation, and validation

to improve efficiency and reduce manual intervention.

Mentorship: Guide and mentor junior data engineers, fostering a culture of technical

excellence and continuous learning.

Troubleshooting: Diagnose and resolve complex data-related issues, ensuring high

availability and reliability of data systems.

Required Qualifications

Education: Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science,

or a related field.

Experience: 5+ years of experience in data engineering or a related role, with a proven track

record of building scalable data pipelines and infrastructure.

Technical Skills:

Proficiency in programming languages such as Python, Java, or Scala.

Expertise in SQL and experience with NoSQL databases (e.g., MongoDB, Cassandra).

Strong experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services

(e.g., Redshift, BigQuery, Snowflake).

Hands-on experience with ETL/ELT tools (e.g., Apache Airflow, Talend, Informatica) and

data integration frameworks.

Familiarity with big data technologies (e.g., Hadoop, Spark, Kafka) and distributed

systems.

Knowledge of containerization and orchestration tools (e.g., Docker, Kubernetes) is a

plus.

Soft Skills:

Excellent problem-solving and analytical skills.

Strong communication and collaboration abilities.

Ability to work in a fast-paced, dynamic environment and manage multiple priorities.

Certifications (optional but preferred): Cloud certifications (e.g., AWS Certified Data Analytics,

Google Professional Data Engineer) or relevant data engineering certifications.

Preferred Qualifica

Experience with real-time data processing and streaming architectures.

Familiarity with machine learning pipelines and MLOps practices.

Knowledge of data visualization tools (e.g., Tableau, Power BI) and their integration with data

pipelines.

Experience in industries with high data complexity, such as finance, healthcare, or

e-commerce.

Work Environment

Location: Hybrid/Remote/On-site (depending on company policy).

Team: Collaborative, cross-functional team environment with data scientists, analysts, and

business stakeholders.

Hours: Full-time, with occasional on-call responsibilities for critical data systems.

A SaaS startup founded in April 2020.

What’s the opportunity?

Are you a backend developer looking to fast-track your learning and growth? Have you looked at world-class products like Asana, Notion, or Airtable, and felt “I wish I were part of the early team that built these products”?

We’re a team that has previously built and rolled out globally successful SaaS products used by tens of thousands of customers.

We’re laser-focused on delivering a world-class product again, and looking for an ambitious backend engineer to join our existing team of 9 engineers.

If it excites you to think of a fast-paced start-up environment, building something big from scratch, breaking down new problems, creating new APIs, working on performance issues, getting hands-on with DevOps initiatives, and showcasing demos of your work every Friday with a happy and passionate team, then this is the right opportunity for you.

Some of the tech problems you get to work on as a backend engineer would be to build the backend for a modern spreadsheet experience from scratch, work on infra as code, write robust code that is fault-tolerant, work on performant code that adheres to SLOs set by the organization. 

About you:

● 3- 5 years of experience

● Expertise in the following areas ○ Java ○ HTTP Protocol

● You’ve heard of or worked with some of the following tech stacks/products

○ Spring

○ PostgreSQL

○ Redis ○ Docker

○ Message brokers

○ GitHub

● These non-functional areas are familiar to you

○ Performance

○ Debugging

○ Log management

Nice to have:

● Familiarity with AWS 

What’s in it for you?

● Great opportunity: We genuinely care about everyone we hire. You’ll learn new things and grow no matter how experienced you are; you will be working with founders who have more than three decades of collective experience in building significant B2B SaaS startups.

● Great team: Work with a world-class, high-velocity team that truly embodies the values of empathy, curiosity, and customer-centricity. Check out the MTT(Meet The Team) videos on our LinkedIn.

● Great culture: An open, fun, and exciting startup culture that empowers its people to champion big problems with the freedom to think and innovate.

● Growth: You could easily and quickly transition into other roles you might like.

● Impact: You get to be part of a global, passionate team in a fast-paced and growth-oriented environment. The team has a work philosophy of being high on ambition, ownership, and a bias for action.

● Monetary rewards and benefits: Competitive stipend, flexible leave policy, and more

The responsibilities would include, but not be limited to, the following:

Financial Reporting: You will be providing timely and accurate financial reporting to management together with strategic insights on the company s financial position. 

Accounting Systems and Processes - Understanding requirements, identifying, evaluating and implementing the most suitable accounting system/ tools needed to support the accounting needs of the organization

Implementing best in class accounting practices and Internal Control procedures considering:

• Accounts Payables - Purchase to Procurement Cycle & Policies, SOPs and SLAs
• Accounts Receivables - Billing Processes and Systems to raise timely invoices and perform ageing analysis
• Revenue and Cash Reconciliations and suggesting and implementing SOPs and SLAs

Financial Closure - Ensure timely and accurate monthly closures. Consistent analyzing of financial data and presenting financial reports in an accurate and timely manner; clearly communicate monthly, quarterly, and annual financial statements; monitor progress, changes and keep senior leadership abreast of the financial status;

Audit - Ensure timely year end financial closures – Statutory, Tax and IFC. Handle end to end audit process and ensure timely completion of audits

Compliances and knowledge - Understand the applicability and ensure compliance with all the relevant statutes impacting the company. Keep abreast with all regulations impacting the companies accounting, compliance and reporting requirements as well as those impacting the company’s operations. Understanding of Income Tax, GST, imports and exports, FDI Regulation, Companies Act, and other tax regulations

Automation - Identify and implement processes to automate all routine repetitive tasks.

Assisting leadership in the annual budgeting and planning process; administering and reviewing all financial plans and comparing to actual results with a view to identifying, explaining and correcting variances as appropriate;  

 Leveraging strengths of the finance team members; providing clarity on the roles and responsibilities; developing and implementing training programmes to maximize and help them reach optimal individual and organizational goals; 

• Own the product analytics of bidgely’s end user-facing products, measure and identify areas of improvement through data
• Liaise with Product Managers and Business Leaders to understand the product issues, priorities and hence support them through relevant product analytics
• Own the automation of product analytics through good SQL knowledge
• Develop early warning metrics for production and highlight issues and breakdowns for resolution
• Resolve client escalations and concerns regarding key business metrics
• Define and own execution
• Own the Energy Efficiency program designs, dashboard development, and monitoring of existing Energy efficiency program
• Deliver data-backed analysis and statistically proven solutions
• Research and implement best practices
• Mentor team of analysts

• B.Tech from a premier institute with 5+ years analytics experience or Full-time MBA from a premier b-school with 3+ years of experience in analytics/business or product analytics
• Bachelor's degree in Business, Computer Science, Computer Information Systems, Engineering, Mathematics, or other business/analytical disciplines

• Proven analytical and quantitative skills and an ability to use data and metrics to back up assumptions, develop business cases, and complete root cause
  analyses
• Excellent understanding of retention, churn, and acquisition of user base
• Ability to employ statistics and anomaly detection techniques for data-driven
  analytics
• Ability to put yourself in the shoes of the end customer and understand what
  “product excellence” means
• Ability to rethink existing products and use analytics to identify new features and product improvements.
• Ability to rethink existing processes and design new processes for more effective analyses
• Strong SQL knowledge, working experience with Looker and Tableau a great plus
• Strong commitment to quality visible in the thoroughness of analysis and techniques employed
• Strong project management and leadership skills
• Excellent communication (oral and written) and interpersonal skills and an ability to effectively communicate with both business and technical teams
• Ability to coach and mentor analysts on technical and analytical skills
• Good knowledge of statistics, basic machine learning, and AB Testing is
  preferable
• Experience as a Growth hacker and/or in Product analytics is a big plus

• BS in CS or EE or equivalent
• Experience working on large scale systems in rapid growth environments
• Experience with public cloud offerings (AWS, GCP, Azure)
• Solid programming skills; preferred experience in Java, and/or Python
• Experience with modern web frameworks, advanced algorithms/data intelligence, public
• cloud platforms and streaming data pipelines
• Familiarity with containerization, microservices architecture, continuous integration, and delivery
• 5+ years’ experience preferred

With the ever-increasing demand in the educational industry, our client acts as an ed-tech platform that provides various interdisciplinary courses, in turn providing critical future skills.

They follow a curriculum that is collated globally and has been developed by industry experts. Some of the programmes offered by them include Artificial Intelligence, iOS App Development, Robotics, Augmented & Virtual Reality (AR/VR), etc. Benefits of their platform include online accessibility 24*7, live & practical application, programmes for every age group, etc.

Headquartered in Gurugram, our client was founded by a veteran entrepreneur who is an alumnus of Harvard Business School.

As a Sales Head B2B, you will be responsible for leading the targets towards attaining that goal, tracking and reporting critical performance indicator data for your team.

What you will do:

• Rolling out new sales initiatives, targeted pitches, and modified sales approach depending on the nature of the business you are approaching
• Implementing the required sales training processes for your sales associates, preparing them for their responsibilities most effectively and efficiently possible
• Delivering pitches to critical clients and other key accounts in your zone yourself
• Being abreast of the latest developments in the space and implementing strategic/ tactical plans if needed
• Mapping the market on product/ competition and the onboarding of customers when they enter the company
• Actively approaching targeted business clients (telephone, email, social networks, events, etc.)
• Searching for new client leads
• Managing relationships with existing customers
• Creating and maintaining a database of current and potential customers
• Explaining and demonstrating features of products and services
• Upselling products and services

Desired Candidate Profile

• MBA from tier 1 B School
• Proficiency in Microsoft Office [Word, Excel and PowerPoint] and CRM software [Zoho CRM]
• Prior experience in B2B sales desired
• Excellent communication skills, both verbal and written
• Good organizational skills and the ability to multitask
• Excellent phone and cold calling skills
• Ability to build and maintain solid and lasting business relationships with colleagues and clients alike
• Ability to work with aggressive targets and think of out-of-the-box solutions when in a deadlock
• Demonstrated ability to maintain a high level of enthusiasm and motivation
• Aspiration to be the best in the business with your every action
• Very good connects with B grade Schools for Edtech product sales