Data Engineer

Daily and monthly responsibilities

• Review and coordinate with business application teams on data delivery requirements.
• Develop estimation and proposed delivery schedules in coordination with development team.
• Develop sourcing and data delivery designs.
• Review data model, metadata and delivery criteria for solution.
• Review and coordinate with team on test criteria and performance of testing.
• Contribute to the design, development and completion of project deliverables.
• Complete in-depth data analysis and contribution to strategic efforts
• Complete understanding of how we manage data with focus on improvement of how data is sourced and managed across multiple business areas.

Basic Qualifications

• Bachelor’s degree.
• 5+ years of data analysis working with business data initiatives.
• Knowledge of Structured Query Language (SQL) and use in data access and analysis.
• Proficient in data management including data analytical capability.
• Excellent verbal and written communications also high attention to detail.
• Experience with Python.
• Presentation skills in demonstrating system design and data analysis solutions.

Company Profile :

Merilytics, an Accordion company is a fast-growing analytics firm offering advanced a and intelligent analytical solutions to clients globally. We combine domain expertise, advanced analytics, and technology to provide robust solutions for clients' business problems. You can find further details about the company at https://merilytics.com.

We partner with our clients in Private Equity, CPG, Retail, Healthcare, Media & Entertainment, Technology, Logistics industries etc. by providing analytical solutions to generate superior returns. We solve clients' business problems by analyzing large amount of data to help guide their Operations, Marketing, Pricing, Customer Strategies, and much more.

Position :

- Business Associate at Merilytics will be working on complex analytical projects and is the primary owner of the work streams involved.

- The Business Associates are expected to lead the team of Business Analysts to deliver robust analytical solutions consistently and mentor the Analysts for professional development.

Location : Hyderabad

Roles and Responsibilities :

The roles and responsibilities of a Business Associate will include the below:

- Proactively provide thought leadership to the team and have complete control on the delivery process of the project.

- Understand the client's point of view and translate it into sound judgment calls in ambiguous analytical situations.

- Highlight potential analytical issues upfront and resolve them independently.

- Synthesizes the analysis and derives insights independently.

- Identify the crux of the client problem and leverage it to draw relevant actionable insights from the analysis/work.

- Ability to manage multiple Analysts and provide customized guidance for individual development.

- Resonate with our five core values - Client First, Excellence, Integrity, Respect and Teamwork.

Pre-requisites and skillsets required to apply for this role :

- Undergraduate degree (B.E/B.Tech.) from tier-1/tier-2 colleges are preferred.

- Should have 2-4 years of experience.

- Strong leadership & proactive communication to coordinate with the project team and other internal stakeholders.

- Ability to use business judgement and a structured approach towards solving complex problems.

- Experience in client-facing/professional services environment is a plus.

- Strong hard skills on analytics tools such as R, Python, SQL, and Excel is a plus.

Why Explore a Career at Merilytics :

- High growth environment: Semi-annual performance management and promotion cycles coupled with a strong meritocratic culture, enables fast track to leadership responsibility.

- Cross Domain Exposure: Interesting and challenging work streams across industries and domains that always keep you excited, motivated, and on your toes.

- Entrepreneurial Environment: Intellectual freedom to make decisions and own them. We expect you to spread your wings and assume larger responsibilities.

- Fun culture and peer group: Non-bureaucratic and fun working environment; Strong peer environment that will challenge you and accelerate your learning curve.

Other benefits for full time employees:

(i) Health and wellness programs that include employee health insurance covering immediate family members and parents, term life insurance for employees, free health camps for employees, discounted health services (including vision, dental) for employee and family members, free doctor's consultations, counselors, etc.

(ii) Corporate Meal card options for ease of use and tax benefits.

(iii) Work dinners, team lunches, company sponsored team outings and celebrations.

(iv) Reimbursement support for travel to the office, as and when promulgated by the Company.

(v) Cab reimbursement for women employees beyond a certain time of the day.

(vi) Robust leave policy to support work-life balance. Specially designed leave structure to support woman employees for maternity and related requests.

(vii) Reward and recognition platform to celebrate professional and personal milestones.

(viii) A positive & transparent work environment including various employee engagement and employee benefit initiatives to support personal and professional learning and development.

ADF Developer with top Conglomerates for Kochi location_ Air India

conducting F2F Interviews on 22nd April 2023

Experience - 2-12 years.

Location - Kochi only (work from the office only)

Notice period - 1 month only.

If you are interested, please share the following information at your earliest

Title:  Data Engineer – Snowflake

Location: Mysore (Hybrid model)

Exp-2-8 yrs

Type: Full Time

Walk-in date: 25th Jan 2023 @Mysore 

Job Role: We are looking for an experienced Snowflake developer to join our team as a Data Engineer who will work as part of a team to help design and develop data-driven solutions that deliver insights to the business. The ideal candidate is a data pipeline builder and data wrangler who enjoys building data-driven systems that drive analytical solutions and building them from the ground up. You will be responsible for building and optimizing our data as well as building automated processes for production jobs. You will support our software developers, database architects, data analysts and data scientists on data initiatives

Key Roles & Responsibilities:

• Use advanced complex Snowflake/Python and SQL to extract data from source systems for ingestion into a data pipeline.
• Design, develop and deploy scalable and efficient data pipelines.
• Analyze and assemble large, complex datasets that meet functional / non-functional business requirements.
• Identify, design, and implement internal process improvements. For example: automating manual processes, optimizing data delivery, re-designing data platform infrastructure for greater scalability.
• Build required infrastructure for optimal extraction, loading, and transformation (ELT) of data from various data sources using AWS and Snowflake leveraging Python or SQL technologies.
• Monitor cloud-based systems and components for availability, performance, reliability, security and efficiency
• Create and configure appropriate cloud resources to meet the needs of the end users.
• As needed, document topology, processes, and solution architecture.
• Share your passion for staying on top of tech trends, experimenting with and learning new technologies

Qualifications & Experience

Qualification & Experience Requirements:

• Bachelor's degree in computer science, computer engineering, or a related field.
• 2-8 years of experience working with Snowflake
• 2+ years of experience with the AWS services.
• Candidate should able to write the stored procedure and function in Snowflake.
• At least 2 years’ experience in snowflake developer.
• Strong SQL Knowledge.
• Data injection in snowflake using Snowflake procedure.
• ETL Experience is Must (Could be any tool)
• Candidate should be aware of snowflake architecture.
• Worked on the Migration project
• DW Concept (Optional)
• Experience with cloud data storage and compute components including lambda functions, EC2s, containers.
• Experience with data pipeline and workflow management tools: Airflow, etc.
• Experience cleaning, testing, and evaluating data quality from a wide variety of ingestible data sources
• Experience working with Linux and UNIX environments.
• Experience with profiling data, with and without data definition documentation

• Familiar with Git
• Familiar with issue tracking systems like JIRA (Project Management Tool) or Trello.
• Experience working in an agile environment.

Desired Skills:

• Experience in Snowflake. Must be willing to be Snowflake certified in the first 3 months of employment.
• Experience with a stream-processing system: Snowpipe
• Working knowledge of AWS or Azure
• Experience in migrating from on-prem to cloud systems

Role Description:

• You will be part of the data delivery team and will have the opportunity to develop a deep understanding of the domain/function.
• You will design and drive the work plan for the optimization/automation and standardization of the processes incorporating best practices to achieve efficiency gains.
• You will run data engineering pipelines, link raw client data with data model, conduct data assessment, perform data quality checks, and transform data using ETL tools.
• You will perform data transformations, modeling, and validation activities, as well as configure applications to the client context. You will also develop scripts to validate, transform, and load raw data using programming languages such as Python and / or PySpark.
• In this role, you will determine database structural requirements by analyzing client operations, applications, and programming.
• You will develop cross-site relationships to enhance idea generation, and manage stakeholders.
• Lastly, you will collaborate with the team to support ongoing business processes by delivering high-quality end products on-time and perform quality checks wherever required.

• Key responsibility is to design and develop a data pipeline including the architecture, prototyping, and development of data extraction, transformation/processing, cleansing/standardizing, and loading in Data Warehouse at real-time/near the real-time frequency. Source data can be structured, semi-structured, and/or unstructured format.
• Provide technical expertise to design efficient data ingestion solutions to consolidate data from RDBMS, APIs, Messaging queues, weblogs, images, audios, documents, etc of  Enterprise Applications, SAAS applications, external 3rd party sites or APIs, etc through ETL/ELT, API integrations, Change Data Capture, Robotic Process Automation, Custom Python/Java Coding, etc
• Development of complex data transformation using Talend (BigData edition), Python/Java transformation in Talend, SQL/Python/Java UDXs, AWS S3, etc to load in OLAP Data Warehouse in Structured/Semi-structured form
• Development of data model and creating transformation logic to populate models for faster data consumption with simple SQL.
• Implementing automated Audit & Quality assurance checks in Data Pipeline
• Document & maintain data lineage to enable data governance
• Coordination with BIU, IT, and other stakeholders to provide best-in-class data pipeline solutions, exposing data via APIs, loading in down streams, No-SQL Databases, etc

Requirements

• Programming experience using Python / Java, to create functions / UDX
• Extensive technical experience with SQL on RDBMS (Oracle/MySQL/Postgresql etc) including code optimization techniques
• Strong ETL/ELT skillset using Talend BigData Edition. Experience in Talend CDC & MDM functionality will be an advantage.
• Experience & expertise in implementing complex data pipelines, including semi-structured & unstructured data processing
• Expertise to design efficient data ingestion solutions to consolidate data from RDBMS, APIs, Messaging queues, weblogs, images, audios, documents, etc of  Enterprise Applications, SAAS applications, external 3rd party sites or APIs, etc through ETL/ELT, API integrations, Change Data Capture, Robotic Process Automation, Custom Python/Java Coding, etc
• Good understanding & working experience in OLAP Data Warehousing solutions (Redshift, Synapse, Snowflake, Teradata, Vertica, etc) and cloud-native Data Lake (S3, ADLS, BigQuery, etc) solutions
• Familiarity with AWS tool stack for Storage & Processing. Able to recommend the right tools/solutions available to address a technical problem
• Good knowledge of database performance and tuning, troubleshooting, query optimization, and tuning
• Good analytical skills with the ability to synthesize data to design and deliver meaningful information
• Good knowledge of Design, Development & Performance tuning of 3NF/Flat/Hybrid Data Model
• Know-how on any No-SQL DB (DynamoDB, MongoDB, CosmosDB, etc) will be an advantage.
• Ability to understand business functionality, processes, and flows
• Good combination of technical and interpersonal skills with strong written and verbal communication; detail-oriented with the ability to work independently

Functional knowledge

• Data Governance & Quality Assurance
• Distributed computing
• Linux
• Data structures and algorithm
• Unstructured Data Processing

Specialism- Advance Analytics, Data Science, regression, forecasting, analytics, SQL, R, python, decision tree, random forest, SAS, clustering classification

Senior Analytics Consultant- Responsibilities

• Understand business problem and requirements by building domain knowledge and translate to data science problem
• Conceptualize and design cutting edge data science solution to solve the data science problem, apply design thinking concepts
• Identify the right algorithms , tech stack , sample outputs required to efficiently adder the end need
• Prototype and experiment the solution to successfully demonstrate the value
  Independently or with support from team execute the conceptualized solution as per plan by following project management guidelines
• Present the results to internal and client stakeholder in an easy to understand manner with great story telling, story boarding, insights and visualization
• Help build overall data science capability for eClerx through support in pilots, pre sales pitches, product development , practice development initiatives

• Hands-on experience in Development
• 4-6 years of Hands on experience with Python scripts
• 2-3 years of Hands on experience in PySpark coding. Worked in spark cluster computing technology.
• 3-4 years of Hands on end to end data pipeline experience working on AWS environments
• 3-4 years of Hands on experience working on AWS services – Glue, Lambda, Step Functions, EC2, RDS, SES, SNS, DMS, CloudWatch etc.
• 2-3 years of Hands on experience working on AWS redshift
• 6+ years of Hands on experience with writing Unix Shell scripts
• Good communication skills