Data Engineer

at Shyftlabs

DP
Posted by rajan bharti
icon
Hyderabad
icon
3 - 4 yrs
icon
₹8L - ₹20L / yr
icon
Full time
Skills
Snow flake schema
SQL
Python
Data-flow analysis
Big Data

We celebrate diversity, embrace a data-driven culture, and deeply encourage professional development through classes, certifications, and conferences. The reciprocity of sharing knowledge and growth with each other, our clients, and partners is a foundation we live by. Employees at Shyftlabs enjoy unlimited paid time off, 11 paid holidays, comprehensive health, vision, and dental benefits, and profit-sharing.

 

 

Key Responsibilities

 

  • Design, implement and operate stable, scalable, low-cost solutions to flow data from production systems into the data lake and into end-user facing applications.
  • Design automated processes for in-depth analysis databases.
  • Design automated data control processes.
  • Collaborate with the software development team to build and test the designed solutions.
  • Learn, publish, analyze and improve management information dashboards, operational business metrics decks, and key performance indicators.
  • Improve tools, processes, scale existing solutions, create new solutions as required based on stakeholder needs.
  • Provide in-depth analysis to management with the support of accounting, finance, and transportation teams.
  • Perform monthly variance analysis and identify risks & opportunities.

 

Basic Qualifications

 

  • 3+ years of experience as a Data Engineer or in a similar role
  • Experience with data modeling, data warehousing, and building ETL pipelines
  • Experience in SQL

 

Preferred Qualifications

 

  • Degree in Computer Science, Engineering, Mathematics, or a related field and 4+ years industry experience
  • Graduate degree in Computer Science, Engineering or related technical field
  • Knowledge of professional software engineering practices & best practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations
  • Proficiency with at least one Object Oriented language (e.g. Java, Python, Ruby)
  • Strong customer focus, ownership, urgency, and drive.
  • Excellent communication skills and the ability to work well in a team.
  • Effective analytical, troubleshooting, and problem-solving skills.
  • Experience building data products incrementally and integrating and managing datasets from multiple sources
  • Experience with AWS Tools and Technologies (Redshift, S3, EC2, Glue)
  • Expertise with Data modeling skills, Advanced SQL with Oracle, MySQL, and Columnar Databases
  • Experience with Snowflake
 
See less
 
Read more

About Shyftlabs

Founded
2019
Type
Products & Services
Size
0-20 employees
Stage
Bootstrapped
View full company details
Why apply to jobs via Cutshort
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
2101133
Matches delivered
3712187
Network size
15000
Companies hiring

Similar jobs

Principal AI Researcher

at Synapsica Healthcare

Founded 2019  •  Product  •  20-100 employees  •  Raised funding
SVM
OpenCV
Machine Learning (ML)
Deep Learning
Artificial Intelligence (AI)
Python
PyTorch
Keras
Graphics Processing Unit (GPU)
DSP
CNN
icon
Bengaluru (Bangalore)
icon
4 - 8 yrs
icon
₹20L - ₹45L / yr

Introduction

Synapsica is a series-A funded HealthTech startup founded by alumni from IIT Kharagpur, AIIMS New Delhi, and IIM Ahmedabad. We believe healthcare needs to be transparent and objective while being affordable. Every patient has the right to know exactly what is happening in their bodies and they don't have to rely on cryptic 2 liners given to them as a diagnosis. 

Towards this aim, we are building an artificial intelligence enabled cloud based platform to analyse medical images and create v2.0 of advanced radiology reporting.  We are backed by IvyCap, Endia Partners, YCombinator and other investors from India, US, and Japan. We are proud to have GE and The Spinal Kinetics as our partners. Here’s a small sample of what we’re building: https://www.youtube.com/watch?v=FR6a94Tqqls

 

Your Roles and Responsibilities

Synapsica is looking for a Principal AI Researcher to lead and drive AI based research and development efforts. Ideal candidate should have extensive experience in Computer Vision and AI Research, either through studies or industrial R&D projects and should be excited to work on advanced exploratory research and development projects in computer vision and machine learning to create the next generation of advanced radiology solutions.

The role involves computer vision tasks including development customization and training of Convolutional Neural Networks (CNNs); application of ML techniques (SVM, regression, clustering etc.), and traditional Image Processing (OpenCV, etc.). The role is research-focused and would involve going through and implementing existing research papers, deep dive of problem analysis, frequent review of results, generating new ideas, building new models from scratch, publishing papers, automating and optimizing key processes. The role will span from real-world data handling to the most advanced methods such as transfer learning, generative models, reinforcement learning, etc., with a focus on understanding quickly and experimenting even faster. Suitable candidate will collaborate closely both with the medical research team, software developers and AI research scientists. The candidate must be creative, ask questions, and be comfortable challenging the status quo. The position is based in our Bangalore office.

 

 

Primary Responsibilities

  • Interface between product managers and engineers to design, build, and deliver AI models and capabilities for our spine products.
  • Formulate and design AI capabilities of our stack with special focus on computer vision.
  • Strategize end-to-end model training flow including data annotation, model experiments, model optimizations, model deployment and relevant automations
  • Lead teams, engineers, and scientists to envision and build new research capabilities and ensure delivery of our product roadmap.
  • Organize regular reviews and discussions.
  • Keep the team up-to-date with latest industrial and research updates.
  • Publish research and clinical validation papers

 

Requirements

  • 6+ years of relevant experience in solving complex real-world problems at scale using computer vision-based deep learning.
  • Prior experience in leading and managing a team.
  • Strong problem-solving ability
  • Prior experience with Python, cuDNN, Tensorflow, PyTorch, Keras, Caffe (or similar Deep Learning frameworks).
  • Extensive understanding of computer vision/image processing applications like object classification, segmentation, object detection etc
  • Ability to write custom Convolutional Neural Network Architecture in Pytorch (or similar)
  • Background in publishing research papers and/or patents 
  • Computer Vision and AI Research background in medical domain will be a plus
  • Experience of GPU/DSP/other Multi-core architecture programming
  • Effective communication with other project members and project stakeholders
  • Detail-oriented, eager to learn, acquire new skills
  • Prior Project Management and Team Leadership experience
  • Ability to plan work and meet the deadline
Read more
Job posted by
Human Resources

Data Scientist

at Billeasy

Founded 2016  •  Products & Services  •  0-20 employees  •  Raised funding
Python
Machine Learning (ML)
Data Science
Natural Language Processing (NLP)
recommendation algorithm
icon
Mumbai
icon
5 - 7 yrs
icon
₹5L - ₹9L / yr

Job Details:-

Designation - Data Scientist

Urgently required. (NP of maximum 15 days)

Location:- Mumbai

Experience:- 5-7 years.

Package Offered:- Rs.5,00,000/- to Rs.9,00,000/- pa.

 

Data Scientist

 

Job Description:-

Responsibilities:

  • Identify valuable data sources and automate collection processes
  • Undertake preprocessing of structured and unstructured data
  • Analyze large amounts of information to discover trends and patterns
  • Build predictive models and machine-learning algorithms
  • Combine models through ensemble modeling
  • Present information using data visualization techniques
  • Propose solutions and strategies to business challenges
  • Collaborate with engineering and product development teams

 

Requirements:

  • Proven experience as a Data Scientist or Data Analyst
  • Experience in data mining
  • Understanding of machine-learning and operations research
  • Knowledge of R, SQL and Python; familiarity with Scala, Java is an asset
  • Experience using business intelligence tools (e.g. Tableau) and data frameworks (e.g. Hadoop)
  • Analytical mind and business acumen
  • Strong math skills (e.g. statistics, algebra)
  • Problem-solving aptitude
  • Excellent communication and presentation skills
  • BSc/BA in Computer Science, Engineering or relevant field; graduate degree in Data Science or other quantitative field is preferred
Read more
Job posted by
Kayum Ansari

Senior Data Analyst

at Rebel Foods

Founded 2011  •  Product  •  500-1000 employees  •  Raised funding
Data Analytics
NOSQL Databases
Python
NumPy
pandas
Data Visualization
SQL
icon
Mumbai
icon
6 - 10 yrs
icon
₹16L - ₹28L / yr

About Rebel Foods:

World's leading consumer companies are all technology / new age companies - Amazon (retail), Airbnb (Hospitality), Uber (mobility), Netflix / Spotify (Entertainment). The only sector, where traditional companies are still the largest ones is restaurants - McDonald's (with a market cap of 130 BN USD). With Food Delivery growing exponentially worldwide, there is an opportunity to build the world's most valuable restaurant company on the internet, superfast. We have the formula to be that company. Today, we can safely say we are world's largest delivery only / internet restaurant company, and by a wide margin with 4000+ individual internet restaurants, in 40+ cities and 7 countries (India, Indonesia, UAE, UK, Malaysia, Singapore, Bangladesh. It's still Day 1, but we know we are onto something very, very big.

 

We have a once-in-a-lifetime opportunity to change the 500-year-old industry that hasn’t been disrupted at its core by technology. For more details on how we are changing the restaurant industry from the core, please refer below. It's important reading if you want to know our company better and really explore working with us:

 

https://medium.com/@jaydeep_barman/why-is-rebel-foods-hiring-super-talented-engineers%20b88586223ebe" target="_blank">link


https://medium.com/@jaydeep_barman/how-to-build-1000-restaurants-in-24-months-the-rebel-method%20cb5b0cea4dc8" target="_blank">link 1


https://medium.com/faasos-story/winning-the-last-frontier-for-consumer-internet-5f2a659c43db%20https://medium.com/faasos-story/a-unique-take-on-food-tech-dcef8c51ba41" target="_blank">link 2


https://medium.com/faasos-story/a-unique-take-on-food-tech-dcef8c51ba41" target="_blank">link 4


The Role

  • Understanding Business and Data Requirements from stakeholders
  • Creating Business Reports
  • Report Automation
  • Creating Dashboards/Visualizations for Business KPIs
  • Data Mining for Business Insights
  • Initiatives based on business needs and requirements
  • Evaluating business processes, uncovering areas of improvement, optimizing strategies and implementing solutions
  • Problem solving skills

 

Requirements:

  • Acquire, aggregate, restructure, and analyse large datasets.
  • Ability to work with various SQL and No-SQL data sources, S3, APIs etc.
  • Data manipulation experience with Python/Pandas
  • Exhibit strong analytic, technical, trouble-shooting, and problem-solving skills
  • Ability to work in a team-oriented, fast-paced environment managing multiple
    priorities
  • Project management and organizational skills

 

 

Unique Opportunity

  • Get a chance to work on interesting Data Scientists/Machine Learning problems in the areas of Computer Vision, Natural Language Processing, and Time-Series Forecasting
  • Get a chance to work on Deep Analytics systems built on large amounts of multi-source data using advanced Data Engineering

 

Languages - SQL, Python (Pandas)

BI Tools - Tableau/Power BI/Quicksight

 

The Rebel Culture

We believe in empowering and growing people to perform the best at their job functions. We follow outcome-oriented, fail-fast iterative & collaborative culture to move fast in building tech solutions.

Rebel is not a usual workplace. The following slides will give you a sense of our culture, how Rebel conducts itself and who will be the best fit for our company. We suggest you go through it before making up your mind.

https://www.slideshare.net/JaydeepBarman/culture-rebel" target="_blank">link 5

 

Read more
Job posted by
Ankit Suman

Data Engineer - (Azure, Logic apps, Powerapp)

at Onepoint IT Consulting Pvt Ltd

Founded 2008  •  Services  •  20-100 employees  •  Profitable
SQL
logic apps
ADF
snowflake
loqic apps
power apps
icon
Pune
icon
2 - 8 yrs
icon
₹7L - ₹15L / yr
This developer will focus on developing new features, implementing unit test and help develop forward thinking development strategies.

Is this you?

 

  • I am passionate about developing software and scripts to maintain complex Systems.
  • I have vision and talent to contribute in new emerging areas such as cloud technologies.
  • I love logic and solving puzzles.
  • I strive working with a diverse, highly skilled team based in the UK and India.
  • I am fluent in English, both written and spoken.

 

Qualifications

 

  • Experience in Azure (ADF, Logic App), Azure Functions
  • Experience with SQL and Databases.
  • Knowledge of data warehousing/ data modeling knowledge
  • Knowledge of Snowflake
  • Knowledge or experience in low code applications (e.g. PowerApp)
  • Knowledge of design patterns and Software Development Life Cycle.

 

Competencies

 

  • Excellent written and verbal communication skills in English and Hindi.
  • Excellent interpersonal skills to collaborate with various stakeholders.
  • Good reasoning and logical ability
  • Identifying the right questions and understand the big picture.
  • Constant learning which enjoys new challenges.
  • Self-Starter with excellent time management skills.

 

Benefits

Excellent work life balance, including flexible working hours within core working hours.

  • Actively encouraged in decision making at all levels.
  • Assigned mentor for self-development.
  • 18 days annual leave.
  • Medical Insurance and Provident Fund.
  • Flexible work culture
Read more
Job posted by
Maithili Shetty

Data Engineer

at AI enabled SAAS organisation

Data engineering
Data Engineer
AWS Lambda
Microservices
ETL
Python
MongoDB
MySQL
Cassandra
Docker
GitHub
Tableau
airflow
icon
Bengaluru (Bangalore)
icon
1 - 8 yrs
icon
₹5L - ₹40L / yr
Required Skills & Experience:
• 2+ years of experience in data engineering & strong understanding of data engineering principles using big data technologies
• Excellent programming skills in Python is mandatory
• Expertise in relational databases (MSSQL/MySQL/Postgres) and expertise in SQL. Exposure to NoSQL such as Cassandra. MongoDB will be a plus.
• Exposure to deploying ETL pipelines such as AirFlow, Docker containers & Lambda functions
• Experience in AWS loud services such as AWS CLI, Glue, Kinesis etc
• Experience using Tableau for data visualization is a plus
• Ability to demonstrate a portfolio of projects (GitHub, papers, etc.) is a plus
• Motivated, can-do attitude and desire to make a change is a must
• Excellent communication skills
Read more
Job posted by
Kalindi Maheshwari

Data Scientist

at leading pharmacy provider

Agency job
via Econolytics
Data Science
Python
R Programming
Algorithms
Predictive modelling
icon
Noida, NCR (Delhi | Gurgaon | Noida)
icon
4 - 10 yrs
icon
₹18L - ₹24L / yr
Job Description:

• Help build a Data Science team which will be engaged in researching, designing,
implementing, and deploying full-stack scalable data analytics vision and machine learning
solutions to challenge various business issues.
• Modelling complex algorithms, discovering insights and identifying business
opportunities through the use of algorithmic, statistical, visualization, and mining techniques
• Translates business requirements into quick prototypes and enable the
development of big data capabilities driving business outcomes
• Responsible for data governance and defining data collection and collation
guidelines.
• Must be able to advice, guide and train other junior data engineers in their job.

Must Have:

• 4+ experience in a leadership role as a Data Scientist
• Preferably from retail, Manufacturing, Healthcare industry(not mandatory)
• Willing to work from scratch and build up a team of Data Scientists
• Open for taking up the challenges with end to end ownership
• Confident with excellent communication skills along with a good decision maker
Read more
Job posted by
Jyotsna Econolytics
PySpark
Big Data
Spark
Data Warehouse (DWH)
SQL
Data engineering
Apache Synapse
icon
Abu Dhabi, Dubai
icon
6 - 12 yrs
icon
₹18L - ₹25L / yr
Must-Have Skills:
• Good experience in Pyspark - Including Dataframe core functions and Spark SQL
• Good experience in SQL DBs - Be able to write queries including fair complexity.
• Should have excellent experience in Big Data programming for data transformation and aggregations
• Good at ELT architecture. Business rules processing and data extraction from Data Lake into data streams for business consumption.
• Good customer communication.
• Good Analytical skill
 
 
Technology Skills (Good to Have):
  • Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub.
  • Experience in migrating on-premise data warehouses to data platforms on AZURE cloud. 
  • Designing and implementing data engineering, ingestion, and transformation functions
  • Azure Synapse or Azure SQL data warehouse
  • Spark on Azure is available in HD insights and data bricks
Read more
Job posted by
Evelyn Charles

Machine Learning Engineer

at Koo

Founded 2020  •  Product  •  20-100 employees  •  Raised funding
Machine Learning (ML)
Deep Learning
Python
SQL
Natural Language Processing (NLP)
Amazon Web Services (AWS)
icon
Bengaluru (Bangalore)
icon
4 - 6 yrs
icon
₹20L - ₹30L / yr
Job description

Problem Statement-Solution
Only 10% of India speaks English and 90% speak over 25 languages and 1000s of dialects.
The internet has largely been in English. A good part of India is now getting internet
connectivity thanks to cheap smartphones and Jio. The non-English speaking internet users
will balloon to about 600 million users out of the total 750 million internet users in India by
2020. This will make the vernacular segment one of the largest segments in the world -
almost 2x the size of the US population. The vernacular segment has very few products that
they can use on the internet.

One large human need is that of sharing thoughts and connecting with people of the same
community on the basis of language and common interests. Twitter serves this need globally
but the experience is mostly in English. There’s a large unaddressed need for these vernacular
users to express themselves in their mother tongue and connect with others from their
community. Koo is a solution to this problem.
About Koo

Koo was founded in March 2020, as a micro-blogging platform in both Indian languages and
English, which gives a voice to the millions of Indians who communicate in Indian
languages.
Currently available in Assamese, Bengali, English, Hindi, Kannada, Marathi, Tamil and
Telugu, Koo enables people from across India to express themselves online in their mother
tongues. In a country where under 10% of the population speaks English as a native
language, Koo meets the need for a social media platform that can deliver an immersive
language experience to an Indian user, thereby enabling them to connect and interact with
each other. The recently introduced ‘Talk to Type’ enables users to leverage the voice
assistant to share their thoughts without having to type. In August 2021, Koo crossed 10
million downloads, in just 16 months of launch.
Since June 2021, Koo is available in Nigeria.
Founding Team
Koo is founded by veteran internet entrepreneurs – Aprameya Radhakrishna (CEO,
Taxiforsure) and Mayank Bidawatka (Co-founder, Goodbox & Coreteam, redBus).

Technology Team & Culture
 
The technology team comprises sharp coders, technology geeks and guys who have been
entrepreneurs or are entrepreneurial and extremely passionate towards technology. Talent is
coming from the likes of Google, Walmart, Redbus, Dailyhunt. Anyone being part of a
technology team will have a lot to learn from their peers and mentors. Download our android
app and take a look at what we’ve built. Technology stack compromises of a wide variety of cutting-edge technologies like Kotlin, Java 15, Reactive Programming, MongoDB,
Cassandra, Kubernetes, AWS, NodeJS, Python, ReactJS, Redis, Aerospike, ML, Deep
learning etc. We believe in giving a lot of independence and autonomy to ownership-driven
individuals.
Problems we Solve
[email protected] is a small and focused team with the following main objectives:
1. Make Koo a clean and safe platform.
2. Recommend content and "people to follow" to users they might be interested in.
3. Make content more discoverable by extracting structures in it, such as topics.
4. Each of the above objectives are open problems, when combined with challenges like
people being creative while being mischievous and working with Indic languages
where not much NLP work has been done. We use the latest technologies to solve
these problems and meanwhile build our own state-of-the-art algorithms.

Job Description
● Design, develop, test, deploy, maintain and improve ML models/infrastructure and
software that uses these models.
● Manage individual project priorities, deadlines and deliverables.
● Contribute to engineering efforts from planning and organization to execution and
delivery.
● Design and build new data pipelines from scratch, all the way to deploying them to
production
● Build models and algorithms to understand user interest, user intent, and improve
content relevancy.
● Improve existing recommendation systems, experiment with new directions, and
provide ML solutions in recommendation systems.
● Mentor junior ML engineers in their growth and project deliverables.
Requirements:
● Minimum 4 years’ experience in the field of Machine Learning.
● Proficiency in Python, SQL
● Strong theoretical foundations in ML.
● Experience working with ML and DL frameworks (Scikit-learn, Tensorflow, PyTorch,
Keras)
● Experience with AWS infrastructure (Sagemaker, S3, EKS etc.)
● Experience in NLP/NLU
● Comfortable with frameworks like MLFlow, AirFlow, Git, Flask, Docker, Spark
Technology skill sets required for a matching profile
1. Building and deploying ML models.
2. AWS infrastructure management.
3. Constructing, evaluating, and tuning ML Pipelines.
4. Spark, python, MLFlow, AirFlow, Git, SQ
Read more
Job posted by
Neha Gandhi

Business Intelligence Lead

at Kaleidofin

Founded 2018  •  Products & Services  •  100-1000 employees  •  Profitable
Business Intelligence (BI)
PowerBI
Python
SQL
R Language
Tableau
Data management
icon
Chennai, Bengaluru (Bangalore)
icon
5 - 7 yrs
icon
Best in industry
We are looking for a leader to design, develop and deliver strategic data-centric insights leveraging the next generation analytics and BI technologies. We want someone who is data-centric and insight-centric, less report centric. We are looking for someone wishing to
make an impact by enabling innovation and growth; someone with passion for what they do and a vision for the future.

Responsibilities:

  • Be the analytical expert in Kaleidofin, managing ambiguous problems by using data to execute sophisticated quantitative modeling and deliver actionable insights.
  • Develop comprehensive skills including project management, business judgment, analytical problem solving and technical depth.
  • Become an expert on data and trends, both internal and external to Kaleidofin.
  • Communicate key state of the business metrics and develop dashboards to enable teams to understand business metrics independently.
  • Collaborate with stakeholders across teams to drive data analysis for key business questions, communicate insights and drive the planning process with company executives.
  • Automate scheduling and distribution of reports and support auditing and value realization.
  • Partner with enterprise architects to define and ensure proposed.
  • Business Intelligence solutions adhere to an enterprise reference architecture.
  • Design robust data-centric solutions and architecture that incorporates technology and strong BI solutions to scale up and eliminate repetitive tasks

Requirements:

  • Experience leading development efforts through all phases of SDLC.
  • 5+ years "hands-on" experience designing Analytics and Business Intelligence solutions.
  • Experience with Quicksight, PowerBI, Tableau and Qlik is a plus.
  • Hands on experience in SQL, data management, and scripting (preferably Python).
  • Strong data visualisation design skills, data modeling and inference skills.
  • Hands-on and experience in managing small teams.
  • Financial services experience preferred, but not mandatory.
  • Strong knowledge of architectural principles, tools, frameworks, and best practices.
  • Excellent communication and presentation skills to communicate and collaborate with all levels of the organisation.
  • Team handling preferred for 5+yrs experience candidates.
  • Notice period less than 30 days.
Read more
Job posted by
Poornima B

Bigdata

at OpexAI

Founded 2017  •  Products & Services  •  20-100 employees  •  Profitable
Business Intelligence (BI)
Python
Big Data
icon
Hyderabad
icon
0 - 1 yrs
icon
₹1L - ₹1L / yr
Bigdata, Business intelligence , python, R with their skills
Read more
Job posted by
Jasmine Shaik
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
Get to hear about interesting companies hiring right now
iconFollow Cutshort
Want to apply to this role at Shyftlabs?
Why apply via Cutshort?
Connect with actual hiring teams and get their fast response. No spam.
Learn more
Get to hear about interesting companies hiring right now
iconFollow Cutshort