MSBI Developer

Greetings!!

We are looking for a Machine Learning engineer for on of our premium client.
Experience: 2-9 years
Location: Gurgaon/Bangalore
Tech Stack:
Python, PySpark, the Python Scientific Stack; MLFlow, Grafana, Prometheus for machine learning pipeline management and monitoring; SQL, Airflow, Databricks, our own open-source data pipelining framework called Kedro, Dask/RAPIDS; Django, GraphQL and ReactJS for horizontal product development; container technologies such as Docker and Kubernetes, CircleCI/Jenkins for CI/CD, cloud solutions such as AWS, GCP, and Azure as well as Terraform and Cloudformation for deployment

Data Modeler JD: - 

 

1. Understand and translate business needs into dimension models supporting long-term solutions

 

2. Experience on building models on ERwin or similar tools.

 

3. Experience and understanding on dimensional data model, customer 360 and Entity relationship model.

 

4. Work with the Development team to implement data strategies, build data flows and develop conceptual data models.

 

5. Create logical and physical data models using best practices to ensure high data quality and reduced redundancy

 

6. Optimize and update logical and physical data models to support new and existing projects

 

7. Maintain conceptual, logical, and physical data models along with corresponding metadata

 

8. Develop best practices for standard naming conventions and coding practices to ensure consistency of data models

 

9. Recommend opportunities for reuse of data models in new environments

 

10. Perform reverse engineering of physical data models from databases and SQL scripts

 

11. Evaluate models and physical databases for variances and discrepancies

 

12. Validate business data objects for accuracy and completeness

 

13. Analyze data-related system integration challenges and propose appropriate solutions

 

14. Develop data models according to company standards

 

15. Guide System Analysts, Engineers, Programmers and others on project limitations and capabilities, performance requirements and interfaces

 

16. Good to have Home appliance/Retail domain knowledge and Azure Synapse.

 

Job Functions: Information Technology 

 

Employment Type - Full-time 

 

Thank you!

 

 

JOB DESCRIPTION:. THE IDEAL CANDIDATE WILL:

• Ensure new features and subject areas are modelled to integrate with existing structures and provide a consistent view. Develop and maintain documentation of the data architecture, data flow and data models of the data warehouse appropriate for various audiences. Provide direction on adoption of Cloud technologies (Snowflake) and industry best practices in the field of data warehouse architecture and modelling.

• Providing technical leadership to large enterprise scale projects. You will also be responsible for preparing estimates and defining technical solutions to proposals (RFPs). This role requires a broad range of skills and the ability to step into different roles depending on the size and scope of the project Roles & Responsibilities.

ELIGIBILITY CRITERIA: Desired Experience/Skills:
• Must have total 5+ yrs. in IT and 2+ years' experience working as a snowflake Data Architect and 4+ years in Data warehouse, ETL, BI projects.
• Must have experience at least two end to end implementation of Snowflake cloud data warehouse and 3 end to end data warehouse implementations on-premise preferably on Oracle.

• Expertise in Snowflake – data modelling, ELT using Snowflake SQL, implementing complex stored Procedures and standard DWH and ETL concepts
• Expertise in Snowflake advanced concepts like setting up resource monitors, RBAC controls, virtual warehouse sizing, query performance tuning, Zero copy clone, time travel and understand how to use these features
• Expertise in deploying Snowflake features such as data sharing, events and lake-house patterns
• Hands-on experience with Snowflake utilities, SnowSQL, SnowPipe, Big Data model techniques using Python
• Experience in Data Migration from RDBMS to Snowflake cloud data warehouse
• Deep understanding of relational as well as NoSQL data stores, methods and approaches (star and snowflake, dimensional modelling)
• Experience with data security and data access controls and design
• Experience with AWS or Azure data storage and management technologies such as S3 and ADLS
• Build processes supporting data transformation, data structures, metadata, dependency and workload management
• Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot
• Provide resolution to an extensive range of complicated data pipeline related problems, proactively and as issues surface
• Must have expertise in AWS or Azure Platform as a Service (PAAS)
• Certified Snowflake cloud data warehouse Architect (Desirable)
• Should be able to troubleshoot problems across infrastructure, platform and application domains.
• Must have experience of Agile development methodologies
• Strong written communication skills. Is effective and persuasive in both written and oral communication

Nice to have Skills/Qualifications:Bachelor's and/or master’s degree in computer science or equivalent experience.
• Strong communication, analytical and problem-solving skills with a high attention to detail.

 

About you:
• You are self-motivated, collaborative, eager to learn, and hands on
• You love trying out new apps, and find yourself coming up with ideas to improve them
• You stay ahead with all the latest trends and technologies
• You are particular about following industry best practices and have high standards regarding quality

Technical/Core skills

1. Minimum 3 yrs of exp in Informatica Big data Developer(BDM) in Hadoop environment.
2. Have knowledge of informatica Power exchange (PWX).
3. Minimum 3 yrs of exp in big data querying tool like Hive and Impala.
4. Ability to designing/development of complex mappings using informatica Big data Developer.
5. Create and manage Informatica power exchange and CDC real time implementation
6. Strong Unix knowledge skills for writing shell scripts and troubleshoot of existing scripts.
7. Good knowledge of big data platforms and its framework.
8. Good to have an experience in cloudera data platform (CDP)
9. Experience with building stream processing systems using Kafka and spark
10. Excellent SQL knowledge

 

Soft skills :

1. Ability to work independently 
2. Strong analytical and problem solving skills
3. Attitude of learning new technology
4. Regular interaction with vendors, partners and stakeholders

 

What you need to have:

 

• Be part of the CS Strategy & Operations team that strives to make a difference.
• Assimilate data and analytics to create daily, weekly, monthly and quarterly reports.
• Analyze reports to detect problems during data collection and help review data that has been collected.
• Monitor data to identify trends and anomalies that might showcase abnormal behavior.
• Interpret data, develop dashboards and reports.
• Generate and share routine/ ad-hoc reports as required.
• Work with team members to drive CS processes.
• Monitor, update, and drive implementation of MIS reports.

Our ideal candidate:

• Experience of 2-3 years in a high-transaction MIS environment.
• Knowledge of Google Sheets / Excel (vLookup, pivot table, charts, and adept in trend Metrics)
• Strong knowledge of Power BI, SQL, Data Studio
• Good written and verbal communication.
• Willingness to learn new things and is able to quickly deploy them.
• Is an empathetic team player.

1. Sr. Data Engineer:

 Core Skills – Data Engineering, Big Data, Pyspark, Spark SQL and Python

Candidate with prior Palantir Cloud Foundry OR Clinical Trial Data Model background is preferred

Major accountabilities:

• Responsible for Data Engineering, Foundry Data Pipeline Creation, Foundry Analysis & Reporting, Slate Application development, re-usable code development & management and Integrating Internal or External System with Foundry for data ingestion with high quality.
• Have good understanding on Foundry Platform landscape and it’s capabilities
• Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
• Defines company data assets (data models), Pyspark, spark SQL, jobs to populate data models.
• Designs data integrations and data quality framework.
• Design & Implement integration with Internal, External Systems, F1 AWS platform using Foundry Data Connector or Magritte Agent
• Collaboration with data scientists, data analyst and technology teams to document and leverage their understanding of the Foundry integration with different data sources - Actively participate in agile work practices
• Coordinating with Quality Engineer to ensure the all quality controls, naming convention & best practices have been followed

Desired Candidate Profile :

• Strong data engineering background
• Experience with Clinical Data Model is preferred
• Experience in
• SQL Server ,Postgres, Cassandra, Hadoop, and Spark for distributed data storage and parallel computing
• Java and Groovy for our back-end applications and data integration tools
• Python for data processing and analysis
• Cloud infrastructure based on AWS EC2 and S3
• 7+ years IT experience, 2+ years’ experience in Palantir Foundry Platform, 4+ years’ experience in Big Data platform
• 5+ years of Python and Pyspark development experience
• Strong troubleshooting and problem solving skills
• BTech or master's degree in computer science or a related technical field
• Experience designing, building, and maintaining big data pipelines systems
• Hands-on experience on Palantir Foundry Platform and Foundry custom Apps development
• Able to design and implement data integration between Palantir Foundry and external Apps based on Foundry data connector framework
• Hands-on in programming languages primarily Python, R, Java, Unix shell scripts
• Hand-on experience in AWS / Azure cloud platform and stack
• Strong in API based architecture and concept, able to do quick PoC using API integration and development
• Knowledge of machine learning and AI
• Skill and comfort working in a rapidly changing environment with dynamic objectives and iteration with users.

 Demonstrated ability to continuously learn, work independently, and make decisions with minimal supervision

The Data Analyst in the CoE will provide end to end solution development, working in conjunction with the Domain Leads and Technology Partners. He is responsible for the delivery of solutions and solution changes which are driven by the business requirements as well as providing technical and development capabilities. Knowledge

Responsibilities:
● Ability to do exploratory analysis: Fetch data from systems and analyze trends.
● Developing customer segmentation models to improve the efficiency of marketing and product
campaigns.
● Establishing mechanisms for cross functional teams to consume customer insights to improve
engagement along the customer life cycle.
● Gather requirements for dashboards from business, marketing and operations stakeholders.
● Preparing internal reports for executive leadership and supporting their decision making.
● Analyse data, derive insights and embed it into Business actions.
● Work with cross functional teams.
Skills Required
• Data Analytics Visionary.
• Strong in SQL & Excel and good to have experience in Tableau.
• Experience in the field of Data Analysis, Data Visualization.
• Strong in analysing the Data and creating dashboards.
• Strong in communication, presentation and business intelligence.
• Multi-Dimensional, "Growth Hacker" Skill Set with strong sense of ownership for work.
• Aggressive “Take no prisoners” approach.

• Proactively assist customers with technical issues that may arise with their solution implementation. Troubleshoot and perform root cause analysis. Identify and provide timely workarounds and solutions when possible, to meet customer’s business needs. • Reproduce in house when possible and file engineering tickets. Work with engineering and product management to prioritize as customer advocate to get resolutions in next release. When possible, analyze code and participate in engineering processes to develop and deploy defect fixes as service packs/hot fixes. • Constantly stay ahead in communicating with customers. Manage expectations properly to avoid escalations. Be a strong voice of customers during engineering planning. • Assist through release cycles in testing new features, enhancements and defect fixes. • Work with client business areas to design, build, enhance, and deliver enterprise wide data analytic dashboards and reports supporting multiple business units. • Collaborate with key business users to identify needs and opportunities for improved data management and delivery. • Design and build ETL processes and scripts. • Provide technical knowledge and business support to the BI team. Candidate fitment: • 6-8 years experience in Cognos Business Analytics Reporting and Analytical roles; proficiency in SQL, Excel, Relational Databases, Oracle, SQL Server • Ability to manage multiple timelines and priorities. • Experience in manufacturing industry is a PLUS. • Highly developed analytical, problem-solving, and consulting skills, with a proven track record of using data to provide actionable business results. • Experience in validating an overall solution from the perspective of performance, scalability, security and capacity. • The ideal candidate is dedicated to making it easy for customers to use our product by leveraging business expertise and using rigorous logic and creative methods to solve difficult problems with effective solutions.