Sr Data Engineer

at Infogain

icon
Bengaluru (Bangalore), Pune, Noida, Delhi, Gurugram, Noida
icon
7 - 10 yrs
icon
₹20L - ₹25L / yr
icon
Full time
Skills
Data engineering
Python
SQL
Spark
PySpark
Cassandra
Groovy
Amazon Web Services (AWS)
Amazon S3
Windows Azure
Foundry
Good Clinical Practice
E2
R
palantir
  1. Sr. Data Engineer:

 Core Skills – Data Engineering, Big Data, Pyspark, Spark SQL and Python

Candidate with prior Palantir Cloud Foundry OR Clinical Trial Data Model background is preferred

Major accountabilities:

  • Responsible for Data Engineering, Foundry Data Pipeline Creation, Foundry Analysis & Reporting, Slate Application development, re-usable code development & management and Integrating Internal or External System with Foundry for data ingestion with high quality.
  • Have good understanding on Foundry Platform landscape and it’s capabilities
  • Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
  • Defines company data assets (data models), Pyspark, spark SQL, jobs to populate data models.
  • Designs data integrations and data quality framework.
  • Design & Implement integration with Internal, External Systems, F1 AWS platform using Foundry Data Connector or Magritte Agent
  • Collaboration with data scientists, data analyst and technology teams to document and leverage their understanding of the Foundry integration with different data sources - Actively participate in agile work practices
  • Coordinating with Quality Engineer to ensure the all quality controls, naming convention & best practices have been followed

Desired Candidate Profile :

  • Strong data engineering background
  • Experience with Clinical Data Model is preferred
  • Experience in
    • SQL Server ,Postgres, Cassandra, Hadoop, and Spark for distributed data storage and parallel computing
    • Java and Groovy for our back-end applications and data integration tools
    • Python for data processing and analysis
    • Cloud infrastructure based on AWS EC2 and S3
  • 7+ years IT experience, 2+ years’ experience in Palantir Foundry Platform, 4+ years’ experience in Big Data platform
  • 5+ years of Python and Pyspark development experience
  • Strong troubleshooting and problem solving skills
  • BTech or master's degree in computer science or a related technical field
  • Experience designing, building, and maintaining big data pipelines systems
  • Hands-on experience on Palantir Foundry Platform and Foundry custom Apps development
  • Able to design and implement data integration between Palantir Foundry and external Apps based on Foundry data connector framework
  • Hands-on in programming languages primarily Python, R, Java, Unix shell scripts
  • Hand-on experience in AWS / Azure cloud platform and stack
  • Strong in API based architecture and concept, able to do quick PoC using API integration and development
  • Knowledge of machine learning and AI
  • Skill and comfort working in a rapidly changing environment with dynamic objectives and iteration with users.

 Demonstrated ability to continuously learn, work independently, and make decisions with minimal supervision

Read more

About Infogain

Founded
Type
Size
employees
Stage
View full company details
Why apply to jobs via Cutshort
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
2101133
Matches delivered
3712187
Network size
15000
Companies hiring

Similar jobs

Senior Machine Learning Engineer | Permanent WFH

at Delivery Solutions

Founded 2015  •  Product  •  100-500 employees  •  Profitable
Python
NumPy
pandas
SQL
Docker
icon
Remote only
icon
3 - 6 yrs
icon
₹7L - ₹19L / yr
Title: Senior Software Engineer - AI/ML

  • Minimum 3 years of technical experience in AI/ML (you can include internships & freelance work towards this)
  • Excellent proficiency in Python (Numpy, Pandas)
  • Experience working with SQL/NoSQL databases
  • Experience working with AWS, Docker
  • Should have worked with a large set of data
  • Should be familiar with MI model building and deployment on AWS.
  • Good communication skills and very good problem-solving skills 

Perks & Benefits @Delivery Solutions: 

  • Permanent Remote work - (Work from anywhere)
  • Broadband reimbursement
  • Flexi work hours - (Login/Logout flexibility)
  • 21 Paid leaves in a year (Jan to Dec) and 7 COVID leaves
  • Two appraisal cycles in a year
  • Encashment of unused leaves on Gross
  • RNR - Amazon Gift Voucher
  • Employee Referral Bonus
  • Technical & Soft skills training
  • Sodexo meal card
  • Surprise on birthday/ service anniversary/new baby/wedding gifts
  • Annual trip 
Read more
Job posted by
Ayyappan Paramasivam

Chief Architect

at NA

Agency job
via Talent folks
Java
Python
Big Data
icon
Bengaluru (Bangalore)
icon
15 - 25 yrs
icon
₹10L - ₹15L / yr

Job Description

  • Design, development and deployment of highly-available and fault-tolerant enterprise business software at scale.

  • Demonstrate tech expertise to go very deep or broad in solving classes of problems or creating broadly leverage-able solutions.

  • Execute large-scale projects - Provide technical leadership in architecting and building product solutions.

  • Collaborate across teams to deliver a result, from hardworking team members within your group, through smart technologists across lines of business.

  • Be a role model on acting with good judgment and responsibility, helping teams to commit and move forward.

  • Be a humble mentor and trusted advisor for both our talented team members and passionate leaders alike. Deal with differences in opinion in a mature and fair way.

  • Raise the bar by improving standard methodologies, producing best-in-class efficient solutions, code, documentation, testing, and monitoring.

Qualifications

      • 15+ years of relevant engineering experience.

  • Proven record of building and productionizing highly reliable products at scale.

  • Experience with Java and Python

  • Experience with the Big Data technologie is a plus.

  • Ability to assess new technologies and make pragmatic choices that help guide us towards a long-term vision

  • Can collaborate well with several other engineering orgs to articulate requirements and system design

Additional Information

Professional Attributes:
• Team player!

• Great interpersonal skills, deep technical ability, and a portfolio of successful execution.

• Excellent written and verbal communication skills, including the ability to write detailed technical documents.

• Passionate about helping teams grow by inspiring and mentoring engineers.



Read more
Job posted by
Rijooshri Saikia
Data Science
Deep Learning
Machine Learning (ML)
Natural Language Processing (NLP)
Artificial Neural Network (ANN)
Matlab
Computer Vision
Python
TensorFlow
Keras
Weka
icon
Bengaluru (Bangalore)
icon
3 - 8 yrs
icon
₹20L - ₹40L / yr
Roles and Responsibilities

● Research and develop advanced statistical and machine learning models for
analysis of large-scale, high-dimensional data.

● Dig deeper into data, understand characteristics of data, evaluate alternate
models and validate hypotheses through theoretical and empirical approaches.

● Productize has proven or working models into production-quality code.

● Collaborate with product management, marketing, and engineering teams in
Business Units to elicit & understand their requirements & challenges and
develop potential solutions

● Stay current with the latest research and technology ideas; share knowledge by
clearly articulating results and ideas to key decision-makers.

● File patents for innovative solutions that add to the company's IP portfolio

Requirements

● 4 to 6 years of strong experience in data mining, machine learning and
statistical analysis.

● BS/MS/Ph.D. in Computer Science, Statistics, Applied Math, or related areas
from Premier institutes ( only IITs / IISc / BITS / Top NITs or top US university
should apply)

● Experience in productizing models to code in a fast-paced start-up
environment.

● Fluency in analytical tools such as Matlab, R, Weka etc.

● Strong intuition for data and Keen aptitude on large scale data analysis

● Strong communication and collaboration skills.
Read more
Job posted by
Naveen Taalanki

Data Engineer

at Marktine

Founded 2014  •  Products & Services  •  20-100 employees  •  Bootstrapped
Data Warehouse (DWH)
Spark
Data engineering
Python
PySpark
Snow flake schema
SQL
PL/SQL
Microsoft Windows Azure
Amazon Web Services (AWS)
icon
Remote, Bengaluru (Bangalore)
icon
3 - 7 yrs
icon
₹5L - ₹10L / yr

Basic Qualifications

- Need to have a working knowledge of AWS Redshift.

- Minimum 1 year of designing and implementing a fully operational production-grade large-scale data solution on Snowflake Data Warehouse.

- 3 years of hands-on experience with building productized data ingestion and processing pipelines using Spark, Scala, Python

- 2 years of hands-on experience designing and implementing production-grade data warehousing solutions

- Expertise and excellent understanding of Snowflake Internals and integration of Snowflake with other data processing and reporting technologies

- Excellent presentation and communication skills, both written and verbal

- Ability to problem-solve and architect in an environment with unclear requirements

Read more
Job posted by
Vishal Sharma

Data Engineer (Pyspark+SQL)

at Fragma Data Systems

Founded 2015  •  Products & Services  •  employees  •  Profitable
PySpark
SQL
icon
Remote only
icon
1.5 - 5 yrs
icon
₹8L - ₹15L / yr
• Responsible for developing and maintaining applications with PySpark 
• Contribute to the overall design and architecture of the application developed and deployed.
• Performance Tuning wrt to executor sizing and other environmental parameters, code optimization, partitions tuning, etc.
• Interact with business users to understand requirements and troubleshoot issues.
• Implement Projects based on functional specifications.

Must Have Skills:
• Good experience in Pyspark - Including Dataframe core functions and Spark SQL
• Good experience in SQL DBs - Be able to write queries including fair complexity.
• Should have excellent experience in Big Data programming for data transformation and aggregations
• Good at ELT architecture. Business rules processing and data extraction from Data Lake into data streams for business consumption.
• Good customer communication.
• Good Analytical skills
Read more
Job posted by
Evelyn Charles

PBI Developer

at Loyalytics

Founded 2015  •  Products & Services  •  20-100 employees  •  Bootstrapped
PowerBI
Business Intelligence (BI)
SQL
Communication Skills
icon
Remote, Bengaluru (Bangalore)
icon
2 - 4 yrs
icon
₹9L - ₹15L / yr
Job Description
We are looking for a business intelligence (BI) developer who will be working on designing various analytical reports on company data and delivering them to top management and other interested parties. As a BI developer, you will be working with business users, collecting their requests, and then creating BI reports to accommodate business needs. BI developers will be expected to establish company standards and common reporting terminology, and to help align existing and future reporting requests to such standards. You will also be interacting with data engineers whenever data schemas need redesigning to accommodate new reporting requirements.

Responsibilities
• Collect and maintain the set of business reporting requirements.
• Implement BI reports based on the above requirements.
• Analyze existing reports and optimize them for standardization across the company.
• Set up and maintain BI tools, infrastructure, and integration with company data sources.
• Work with data engineers, data scientists, and data collection application engineers. Propose data schema and data flow optimization for reporting performance and enhancement as needed.
Skills
• Adept at the use of BI reporting tools such as Power BI, Apache Superset.
• Additional exposure to other BI reporting tools such as Grafana, Tableau would be helpful.
• Adept at using automation tools in BI reporting for alerts, emails and scheduled jobs for dataset refreshes.
• Strong understanding of DAX queries for creating business metrics
• Understanding data modeling, data schemas (normalized, flat, star, snowflake, etc.).
• Expertise in SQL and ability to make complex queries and troubleshoot
• Skilled in data and query optimization, query profiling, and query performance monitoring tools and techniques.
• Understanding database operations and optimization for database such as Microsoft SQL Server, PostgreSQL, NoSQL, Timeseries database.
• Good analytical mindset and teamwork spirit.
• Excellent verbal and written communication skills.
• Creating and maintaining business requirements and other technical documentation.
• Problem solving abilities and keen eye for details.

Skills keywords:
Microsoft Power BI, Power Query, DAX, SQL, Grafana, BI, Business Intelligence, Power Automate, Microsoft Flow, Apache Superset, interactive visual, KPI

Additional Weightage
• Pyspark
• Python
• Good skills on advanced Excel
Read more
Job posted by
Bettina George

Data/Sr. Data Scientist

at Antuit

Founded 2013  •  Product  •  100-500 employees  •  Profitable
Data Science
Machine Learning (ML)
Artificial Intelligence (AI)
Python
Algorithms
Linear regression
Logistic regression
Time series
PySpark
icon
Bengaluru (Bangalore)
icon
4 - 7 yrs
icon
₹15L - ₹20L / yr

About antuit.ai

 

Antuit.ai is the leader in AI-powered SaaS solutions for Demand Forecasting & Planning, Merchandising and Pricing. We have the industry’s first solution portfolio – powered by Artificial Intelligence and Machine Learning – that can help you digitally transform your Forecasting, Assortment, Pricing, and Personalization solutions. World-class retailers and consumer goods manufacturers leverage antuit.ai solutions, at scale, to drive outsized business results globally with higher sales, margin and sell-through.

 

Antuit.ai’s executives, comprised of industry leaders from McKinsey, Accenture, IBM, and SAS, and our team of Ph.Ds., data scientists, technologists, and domain experts, are passionate about delivering real value to our clients. Antuit.ai is funded by Goldman Sachs and Zodius Capital.

 

The Role:

 

Antuit is looking for a Data / Sr. Data Scientist who has the knowledge and experience in developing machine learning algorithms, particularly in supply chain and forecasting domain with data science toolkits like Python.

 

In this role, you will design the approach, develop and test machine learning algorithms, implement the solution.  The candidate should have excellent communication skills and be results driven with a customer centric approach to problem solving.  Experience working in the demand forecasting or supply chain domain is a plus. This job also requires the ability to operate in a multi-geographic delivery environment and a good understanding of cross-cultural sensitivities.

 

Responsibilities:

 

Responsibilities includes, but are not limited to the following:

 

  • Design, build, test, and implement predictive Machine Learning models.
  • Collaborate with client to align business requirements with data science systems and process solutions that ensure client’s overall objectives are met.
  • Create meaningful presentations and analysis that tell a “story” focused on insights, to communicate the results/ideas to key decision makers.
  • Collaborate cross-functionally with domain experts to identify gaps and structural problems.
  • Contribute to standard business processes and practices as part of a community of practise.
  • Be the subject matter expert across multiple work streams and clients.
  • Mentor and coach team members.
  • Set a clear vision for the team members and working cohesively to attain it.

 

Qualifications and Skills:

 

Requirements

  • Experience / Education:
    • Master’s or Ph.D. in Computer Science, Computer Engineering, Electrical Engineering, Statistics, Applied Mathematics or other related 
  • 5+ years’ experience working in applied machine learning or relevant research experience for recent Ph.D. graduates.
  • Highly technical:
  • Skilled in machine learning, problem-solving, pattern recognition and predictive modeling with expertise in PySpark and Python.
  • Understanding of data structures and data modeling.
  • Effective communication and presentation skills
  • Able to collaborate closely and effectively with teams.
  • Experience in time series forecasting is preferred.
  • Experience working in start-up type environment preferred.
  • Experience in CPG and/or Retail preferred.
  • Effective communication and presentation skills.
  • Strong management track record.
  • Strong inter-personal skills and leadership qualities.

 

Information Security Responsibilities

  • Understand and adhere to Information Security policies, guidelines and procedure, practice them for protection of organizational data and Information System.
  • Take part in Information Security training and act accordingly while handling information.
  • Report all suspected security and policy breach to Infosec team or appropriate authority (CISO).

 

EEOC

 

Antuit.ai is an at-will, equal opportunity employer.  We consider applicants for all positions without regard to race, color, religion, national origin or ancestry, gender identity, sex, age (40+), marital status, disability, veteran status, or any other legally protected status under local, state, or federal law.
Read more
Job posted by
Purnendu Shakunt
Data Science
Natural Language Processing (NLP)
Data Scientist
R Programming
Python
icon
Chennai
icon
1 - 5 yrs
icon
₹6L - ₹12L / yr
Skills
  • Python coding skills
  • Scikit-learn, pandas, tensorflow/keras experience
  • Machine learning: designing ml models and explaining them for regression, classification, dimensionality reduction, anomaly detection etc
  • Implementing Machine learning models and pushing it to production 
  • Creating docker images for ML models, REST API creation in Python
1) Data scientist with NLP experience
  • Additional Skills Compulsory:
    • Knowledge and professional experience of text and NLP related projects such as - text classification, text summarization, topic modeling etc
2) Data scientist with Computer vision for documents experience
  • Additional Skills Compulsory:
    • Knowledge and professional experience of vision and deep learning for documents - CNNs, Deep neural networks using tensorflow for Keras for object detection, OCR implementation, document extraction etc
Read more
Job posted by
Priyanka U

Internship- JAVA / Python / AI / ML

at Wise Source

Founded 2014  •  Product  •  20-100 employees  •  Profitable
Artificial Intelligence (AI)
Machine Learning (ML)
Internship
Java
Python
icon
Remote, Guindy
icon
0 - 2 yrs
icon
₹1L - ₹1.5L / yr
Looking out for Internship Candidates . Designation:- Intern/ Trainee Technology : .NET/JAVA/ Python/ AI/ ML Duration : 2-3 Months Job Location :Online Internship Joining :Immediately Job Type :Internship Job Description - MCA/M.Tech/ B.Tech/ BE who need 2-6 months internship project to be done. - Should be available to join us immediately. - Should be flexible to work on any Skills/ Technologies. - Ready to work in long working hours. - Must possess excellent analytical and logical skills. - Internship experience is provided from experts - Internship Certificate will be provided at the end of training. - The requirement is strictly for internship and not a permanent job - Stipend will be provided only based on the performance.
Read more
Job posted by
Wise HR

Data Scientist

at Kstych Pvt Ltd

Founded 2012  •  Products & Services  •  0-20 employees  •  Bootstrapped
Python
Deep Learning
MySQL
icon
NCR (Delhi | Gurgaon | Noida)
icon
0 - 5 yrs
icon
₹2L - ₹5L / yr
Job Description: Data Science Analyst/ Data Science Senior Analyst Job description KSTYCH is seeking a Data Science Analyst to join our Data Science team. Individuals in this role are expected to be comfortable working as a software engineer and a quantitative researcher, should have a significant theoretical foundation in mathematical statistics. The ideal candidate will have a keen interest in the study of Pharma sector, network biology, text mining, machine learning, and a passion for identifying and answering questions that help us build the best consulting resource and continuous support to other teams. Responsibilities Work closely with a product scientific, medical, business development and commercial to identify and answer important healthcare/pharma/biology questions. Answer questions by using appropriate statistical techniques and tools on available data. Communicate findings to project managers and team managers. Drive the collection of new data and the refinement of existing data sources Analyze and interpret the results of an experiments Develop best practices for instrumentation and experimentation and communicate those to other teams Requirements B. Tech, M.Tech, M.S. or Ph.D. in a relevant technical field, or 1+ years experience in a relevant role Extensive experience solving analytical problems using quantitative approaches Comfort manipulating and analyzing complex, high-volume, high-dimensionality data from varying sources A strong passion for empirical research and for answering hard questions with data A flexible analytic approach that allows for results at varying levels of precision Ability to communicate complex quantitative analysis in a clear, precise, and actionable manner Fluency with at least one scripting language such as Python or PHP Familiarity with relational databases and SQL Experience working with large data sets, experience working with distributed computing tools a plus (KNIME, Map/Reduce, Hadoop, Hive, etc)
Read more
Job posted by
Sanatan Upmanyu
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
Get to hear about interesting companies hiring right now
iconFollow Cutshort
Want to apply to this role at Infogain?
Why apply via Cutshort?
Connect with actual hiring teams and get their fast response. No spam.
Learn more
Get to hear about interesting companies hiring right now
iconFollow Cutshort