redshift engineer at decisionfoundry · Remote only · 2 - 5 years · Bootstrapped · Remote only · Posted 4 Jul 2023

Description
About us
Welcome to Decision Foundry!
We are both a high growth startup and one of the longest tenured Salesforce Marketing Cloud Implementation Partners in the ecosystem. Forged from a 19-year-old web analytics company, Decision Foundry is the leader in Salesforce intelligence solutions.
We win as an organization through our core tenets. They include:
- One Team. One Theme.
- We sign it. We deliver it.
- Be Accountable and Expect Accountability.
- Raise Your Hand or Be Willing to Extend it
Requirements
• Strong understanding of data management principles and practices (Preferred experience: AWS Redshift).
• Experience with Tableau server administration, including user management and permissions (preferred, not mandatory).
• Ability to monitor alerts and application logs for data processing issues and troubleshooting.
• Ability to handle and monitor support tickets queues and act accordingly based on SLAs and priority.
• Ability to work collaboratively with cross-functional teams, including Data Engineers and BI team.
• Strong analytical and problem-solving skills.
• Familiar with data warehousing concept and ETL processes.
• Experience with SQL, DBT and database technologies such as Redshift, Postgres, MongoDB, etc.
• Familiar with data integration tools such as Fivetran or Funnel.io
• Familiar with programming languages such as Python.
• Familiar with cloud-based data technologies such as AWS.
• Experience with data ingestion and orchestration tools such as AWS Glue.
• Excellent communication and interpersonal skills.
• Should possess experience of 2+ years.

Similar jobs (10)
Strong Data Engineer (AWS) Profile
2
Mandatory (Experience 1) – Must have minimum 6+ years of experience in Data Engineering, with strong experience designing, developing, and maintaining scalable data pipelines and ETL processes.
3
Mandatory (Experience 2) – Must have 3+ years of hands-on experience with AWS data engineering services, particularly S3, AWS Glue, EMR, Lambda, and Redshift.
4
Mandatory (Experience 3) – Must have strong programming experience in Python, Java, or Scala, with hands-on development of data processing and pipeline solutions.
5
Mandatory (Experience 4) – Must have strong expertise in SQL, data warehousing, and database technologies, including experience with both SQL and NoSQL databases.
6
Mandatory (Experience 5) – Must have hands-on experience working with Big Data technologies and distributed data processing, including designing and optimizing large-scale data pipelines.
7
Mandatory (Experience 6) – Must have experience with data pipeline troubleshooting, monitoring, data quality, governance, and security best practices.
8
Mandatory (Education) – B.Tech / B.E./ M.Tech
Strong Data Engineer (AWS) Profile
2
Mandatory (Experience 1) – Must have minimum 6+ years of experience in Data Engineering, with strong experience designing, developing, and maintaining scalable data pipelines and ETL processes.
3
Mandatory (Experience 2) – Must have 3+ years of hands-on experience with AWS data engineering services, particularly S3, AWS Glue, EMR, Lambda, and Redshift.
4
Mandatory (Experience 3) – Must have strong programming experience in Python, Java, or Scala, with hands-on development of data processing and pipeline solutions.
5
Mandatory (Experience 4) – Must have strong expertise in SQL, data warehousing, and database technologies, including experience with both SQL and NoSQL databases.
6
Mandatory (Experience 5) – Must have hands-on experience working with Big Data technologies and distributed data processing, including designing and optimizing large-scale data pipelines.
7
Mandatory (Experience 6) – Must have experience with data pipeline troubleshooting, monitoring, data quality, governance, and security best practices.
8
Mandatory (Education) – B.Tech / B.E./ M.Tech
Job Summary
Role Overview
We are looking for an experienced Data Engineer with strong expertise in Python, ETL, Advanced SQL, CI/CD, DevOps, and Data Analytics. The ideal candidate should have hands-on experience designing and developing scalable data pipelines, transforming large datasets, and supporting data-driven applications.
Experience with Google Cloud Platform (GCP) will be an added advantage.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines using Python and SQL.
- Develop complex and optimized SQL queries, stored procedures, and data transformations.
- Build and maintain reliable data integration workflows across multiple data sources.
- Perform data cleansing, validation, transformation, and quality checks.
- Analyze data and provide insights to support business and technical requirements.
- Implement and maintain CI/CD pipelines for data engineering applications.
- Work with DevOps practices and tools to automate deployments, monitoring, and infrastructure processes.
- Troubleshoot data pipeline failures, performance issues, and production incidents.
- Optimize data processing workflows for performance, scalability, and reliability.
- Collaborate with Data Analysts, Data Scientists, Developers, and other stakeholders.
- Follow best practices for version control, testing, documentation, and deployment.
- Contribute to cloud-based data engineering initiatives, preferably on GCP.
Required Skills
- 5–7 years of hands-on experience in Data Engineering.
- Strong programming skills in Python.
- Strong expertise in Advanced SQL and database concepts.
- Hands-on experience with ETL/ELT processes and data pipelines.
- Good understanding of Data Warehousing and Data Modeling concepts.
- Experience with CI/CD practices and tools.
- Strong understanding of DevOps principles, automation, and deployment processes.
- Strong data analytics and problem-solving skills.
- Experience working with large datasets and performance optimization.
- Good understanding of Git/version control and software development best practices.
Good to Have
- Hands-on experience with Google Cloud Platform (GCP).
- Exposure to GCP data services such as BigQuery, Cloud Storage, Dataflow, Composer, or Pub/Sub.
- Experience with containerization/orchestration technologies such as Docker/Kubernetes.
- Experience with workflow orchestration tools such as Airflow.
- Knowledge of cloud-based data architecture and distributed data processing.
Preferred Candidate Profile
- Strong analytical and problem-solving abilities.
- Good communication and stakeholder management skills.
- Ability to work independently as well as in a collaborative team environment.
- Strong ownership of data pipelines and production systems.
- Candidates who can join at short notice are preferred.
Mandatory Skills
Data Engineer, Python , ETL, GCP, Advanced SQL, Strong Data Analytics skills, CICD, Devops
Data Engineer
Experience - 5+ years
6-7 LPA
Remote
Duration: 1 month contract (We can take as a tentative, It can be extended)
Scope: Subscriber Activation, Churn, FTE and future reporting requirements, with BigQuery as the centralized data warehouse and Power BI as the proposed reporting layer.
Key Skills:
Strong hands-on experience with GCP & BigQuery
Data warehouse architecture, design and implementation
Data ingestion/integration across multiple source systems
ETL/ELT and data pipeline development
Data modelling for reporting and analytics
Experience integrating BigQuery with Power BI or similar reporting tools
Job Title: Senior Data Architect
Experience: 7+ Years
Location: India (Ahmedabad / Hybrid/Remote)
Job Summary
We are looking for an experienced Senior Data Architect to support the modernization and enhancement of Enterprise Analytic Data Warehouse (ADW). The candidate will be responsible for evaluating existing data architecture, designing scalable data models, assessing data integration across clinical, operational and financial domains, and establishing data governance and data quality standards.
Key Responsibilities
- Assess and review the existing Enterprise Analytic Data Warehouse architecture, database structures and data integration processes.
- Design and improve enterprise data models covering clinical, operational, financial and revenue-cycle information.
- Define data architecture standards, database structures, data relationships and integration strategies.
- Evaluate data flows between source systems and the data warehouse.
- Design and review source-to-target mappings and data lineage.
- Identify architectural gaps affecting data completeness, consistency, integrity and reporting accuracy.
- Establish standardized data definitions, data governance practices and metadata management.
- Ensure consistent patient, facility, payer and other critical identifiers across different datasets.
- Support integration of billing, claims, payment, denial and accounts receivable (AR) data.
- Work with SQL and Python-based data processing solutions to investigate and validate data structures.
- Recommend improvements to warehouse scalability, performance, reliability and maintainability.
- Develop a prioritized architecture and modernization roadmap for future implementation.
- Coordinate with data engineers, analytics engineers and business stakeholders.
Required Technical Skills
- Strong experience in Data Architecture and Enterprise Data Warehousing.
- Advanced SQL and relational database concepts.
- Experience with data modelling (conceptual, logical and physical).
- Knowledge of ETL/ELT pipelines and data integration.
- Experience with data profiling, data lineage and metadata management.
- Understanding of data governance, data quality and data validation frameworks.
- Experience working with large and complex datasets.
- Python knowledge for data analysis and validation.
- Experience with cloud-based data platforms or modern data warehouse technologies.
Preferred Skills
- Experience with Databricks, Azure, AWS or similar cloud data platforms.
- Experience with healthcare data warehouses.
- Knowledge of clinical, financial, billing and claims datasets.
- Understanding of HIPAA, PHI and healthcare data security principles.
- Experience with healthcare analytics, reimbursement and revenue-cycle data.
We are looking for Data engineer with strong expertise in Data warehousing to join our team.
Key skills : ab initio, ssis , Informatica, Hadoop and Teradata
SHARE YOUR RESUME : { pavithra.e @vysystems.com },
{ 8 9 2 5 8 0 2 4 5 7 }
Job Description – Data / Metadata Engineer
Position
Data / Metadata Engineer
Location
Pune
Experience
- 6–9 Years: Up to 28 LPA
- 10–17 Years: Up to 32 LPA
Notice Period
Immediate to 15 Days Joiners Preferred
Role Overview
We are looking for an experienced Data / Metadata Engineer with strong expertise in Data Engineering, Metadata Management, Data Modeling, Cloud technologies, Python/PySpark, and ETL/Data Pipelines.
The ideal candidate should have hands-on experience designing and developing data solutions, working with metadata and data models, and building scalable data pipelines on cloud platforms.
Mandatory Skills
- Strong experience in Data Engineering
- Hands-on experience in Metadata Management / Metadata Engineering
- Strong understanding of Data Modeling
- Experience with DDL and ER/Data Modeling
- Experience with Cloud technologies – Any Cloud Platform
- Strong programming experience in Python or PySpark
- Experience with ETL processes and Data Pipelines
- Good understanding of data architecture and data integration concepts
Key Responsibilities
- Design, develop, and maintain scalable data engineering solutions.
- Develop and manage data pipelines and ETL workflows.
- Work with metadata and data cataloging concepts.
- Create and maintain data models, DDLs, ER diagrams, and database structures.
- Develop data processing solutions using Python or PySpark.
- Work with cloud-based data platforms and services.
- Collaborate with Data Architects, Data Engineers, Developers, and Business teams.
- Ensure data quality, consistency, availability, and reliability across data pipelines.
- Troubleshoot and optimize existing data pipelines and data processes.
- Follow best practices for data engineering, modeling, and cloud-based implementations.
Candidate Profile
- Strong experience in Data Engineering + Metadata + Data Modeling.
- Good hands-on experience with Python/PySpark and ETL/Data Pipelines.
- Experience working with any major cloud platform.
- Strong understanding of databases, data structures, and data modeling concepts.
- Candidates who can join immediately or within 15 days are preferred.
Job Details
Role: Data / Metadata Engineer
Location: Pune
Experience: 6–17 Years
Budget: 28 LPA (6–9 Yrs) / 32 LPA (10–17 Yrs)
Notice Period: Immediate to 15 Days

Job Title: Senior Data Analyst
Location: Sharnam Metrolinks, Amraiwadi, Ahmedabad
Working Days: 6 Days a Week
Department: MDO
Reporting To: COO
Employment Type: Full-Time
Job Summary
We are seeking a highly analytical and detail-oriented Senior Data Analyst to lead data management, reporting, automation, and system development initiatives across the organization.
The role focuses on transforming raw data into meaningful insights, designing and implementing automated systems, strengthening data structures, and supporting cross-functional teams with accurate, actionable intelligence to drive strategic and operational business decisions.
Key Responsibilities
1. Data Management & Reporting
● Collect, clean, validate, and consolidate data from multiple internal and external sources.
● Prepare and deliver daily, weekly, and monthly MIS reports for management and departments.
● Design, develop, and maintain dashboards to track KPIs, performance metrics, and operational trends.
2. Database & Data Accuracy Management
● Manage and regularly update internal databases, spreadsheets, and reporting systems.
● Ensure data accuracy, consistency, integrity, and confidentiality across all platforms.
● Implement best practices for data validation, version control, and audit checks.
3. Data Analysis & Business Insights
● Analyze large and complex datasets to identify trends, patterns, gaps, and anomalies.
● Translate data findings into clear, actionable insights and recommendations to support
strategic and operational decision-making.
4. Reporting Automation, System Recommendation & Implementation
● Identify opportunities to replace manual or semi-manual processes with automated, data-driven systems.
● Design and implement automated reporting frameworks, dashboards, and data pipelines using Excel (Power Query, VBA, Macros), SQL, BI tools, and Python.
● Proactively suggest new automation tools, system enhancements, or integrations to
improve efficiency, accuracy, and scalability.
● Lead the end-to-end implementation of approved automation initiatives, including requirement gathering, system design, testing, deployment, and stabilization.
● Continuously monitor and optimize automated systems in line with business growth and evolving data needs.
5. Cross-Functional Coordination & Support
● Collaborate with Sales, HR, Finance, Operations, and other departments to understand
reporting and data requirements.
● Provide support for ad-hoc analysis, custom reports, and special data requests.
● Act as a data partner to department heads for decision support and performance tracking.
6. Documentation & Compliance
● Maintain complete and updated documentation for MIS processes, reports, data models,
automation logic, and system changes.
● Ensure compliance with company data governance policies and applicable data protection standards.
System Development & Data Structuring Responsibilities
● Study and understand departmental workflows to evaluate how data is generated, processed, and utilized.
● Review existing manual and digital data systems to identify operational gaps, risks, and
mprovement opportunities.
● Recommend structured data models, reporting formats, and storage solutions aligned with
business requirements.
● Coordinate with department heads to define data structures, access levels, and reporting
standards.
● Implement new or upgraded data systems (Excel-based models, cloud platforms, ERP
integrations) with minimal operational disruption.
● Design structured data formats and role-based access controls to ensure secure and
organized data management.
● Train employees on newly implemented systems and provide post-implementation
support.
● Monitor system performance, resolve issues, and continuously improve systems based on
user feedback and organizational growth.
Qualifications & Experience
● Bachelor’s degree in Commerce, Statistics, Computer Applications, or a related field.
● 3–5 years of experience in data analytics, reporting, or system automation roles.
● Strong analytical thinking, logical reasoning, and problem-solving abilities.
● High attention to detail with excellent organizational and documentation skills.
Technical Skills (Must Have)
● Advanced Excel: Power Query, Power Pivot, VBA basics, Macros, Charts
● BI Tools: Power BI or Tableau (DAX, data modeling, dashboard optimization)
● Google Apps Script: Automation in Google Sheets, custom functions, triggers, API integrations, workflow optimization
● Vlook
Preferred Skills
● Strong verbal and written communication skills
● Ability to handle sensitive and confidential information responsibly
● Quick learner with a tech-savvy, improvement-driven, and solution-oriented mindset
Immediate Joining
We are looking for a Dedicated Resource on Contract for –
Role: Data Engineer
Experience: 5+ Years
Location: Remote
Duration: 3+ Months
Strong hands-on experience with Snowflake, including writing SQL queries, creating views, stored procedures, and functions.
Good knowledge of AI tools such as Claude.
Experience with ETL tools like Alteryx is good to have.
Power BI experience is good to have.
Strong communication skills.
About Us
We believe the future of software development is AI-native — where engineers operate at a higher level of abstraction and quality remains non-negotiable.
Incubyte is a software craft consultancy where the “how” of building software matters as much as the “what”.
We partner with companies of all sizes, from helping enterprises build, scale, and modernize to early-stage founders bring their ideas to life.
Our engineers operate in an AI-native development model, using AI as a collaborator across the SDLC to accelerate development while upholding the discipline of software craftsmanship. Guided by Software Craftsmanship and Extreme Programming practices, we build reliable, maintainable, and scalable systems with speed, without compromising quality. If this way of building software resonates with you, we’d like to talk.
Our Guiding Principles
These principles define how we work at Incubyte. They are non-negotiable.
Relentless Pursuit of Quality with Pragmatism
We build high-quality systems without losing sight of delivery.
Extreme Ownership
We take responsibility end-to-end for decisions, execution, and outcomes.
Proactive Collaboration
We collaborate closely, challenge each other, and solve problems together.
Active Pursuit of Mastery
We continuously improve our craft and raise our bar.
Invite, Give, and Act on Feedback
We seek, give, and act on feedback to get better every day.
Ensuring Client Success
We act as trusted partners and focus on real outcomes, not just output.
Job Description
This is a remote position.
Experience Level
2+ years of experience in SQL, Python, and Snowflake (or equivalent cloud data warehouse), Azure Cloud services.
Role Overview
If you're a Data Craftsperson who takes pride in clean, well-tested data solutions and believes in the principles of Extreme Programming, we'd love to meet you. At Incubyte, we're a DevOps organization where developers own the entire release cycle — you'll get hands-on experience across data engineering, analytics, cloud infrastructure, and direct client communication. This role sits primarily in data engineering (80%) with a meaningful analytics component (20%), supporting our client's data systems end-to-end.
What You'll Do
- Design, build, and maintain data pipelines and infrastructure using SQL and Python
- Work within Snowflake to build and optimize data models supporting business use cases
- Parse and process structured and semi-structured data (JSON, XML) from varied sources
- Diagnose issues across raw, intermediate, and summary tables
- Build SQL queries to support repeatable analytics use cases based on stakeholder requirements
- Investigate and resolve data quality issues, including time-sensitive or urgent ones
- Identify opportunities to consolidate models and maintain a single source of truth (SSOT)
Requirements
What We're Looking For
- 2+ years of experience with SQL and relational databases, with the ability to understand complex data relationships and transformations (required)
- 2+ years of experience with Python for data engineering tasks (required)
- Experience with Snowflake or an equivalent cloud data warehouse (required)
- Experience working with Snowflake Coco or any other AI tools(required)
- Experience parsing JSON and XML data (a plus)
- A strong eye for data quality and attention to detail
- Knowledge of Git (required)
- Knowledge of Azure cloud services such as Azure Data Factory, Azure Blob Storage, and Azure SQL Database (required)
- Knowledge of data infrastructure/modeling tools like DBT, Fivetran (a plus)
- Experience with BI tools like Power BI(a plus, not core to this role)
- Knowledge of Docker, Linux, Shell/Bash, and virtualization technologies (a plus)
- Knowledge of SSIS packages (a plus)
- Familiarity with CI/CD methodologies
Benefits
Life at Incubyte
We are a remote-first company with structured flexibility. Teams commit to shared rhythms during core hours, ensuring smooth collaboration while maintaining autonomy. Twice a year, we come together in person for a co-working sprint and once a year for a retreat - with all travel expenses covered.
Our environment is built for crafters: pairing, refactoring, experimenting with AI, and pushing the boundaries of software excellence. We are all lifelong learners, and our work is our passion.
Perks
- Dedicated learning & development budget.
- Sponsorship for conference talks.
- Comprehensive medical & term insurance.
- Employee-friendly leave policies.
- Home Office fund
- Medical Insurance












