11+ Data flow Jobs in Delhi, NCR and Gurgaon | Data flow Job openings in Delhi, NCR and Gurgaon
Apply to 11+ Data flow Jobs in Delhi, NCR and Gurgaon on CutShort.io. Explore the latest Data flow Job opportunities across top companies like Google, Amazon & Adobe.
Noida
2 - 5 yrs
₹20L - ₹35L / yr
Linux/Unix
PythonHadoop
Apache Spark
MongoDB +4 more
Responsibilities
● Create and maintain optimal data pipeline architecture.
● Assemble large, complex data sets that meet functional / non-functional
business requirements.
● Building and optimizing ‘big data’ data pipelines, architectures and data sets.
● Maintain, organize & automate data processes for various use cases.
● Identifying trends, doing follow-up analysis, preparing visualizations.
● Creating daily, weekly and monthly reports of product KPIs.
● Create informative, actionable and repeatable reporting that highlights
relevant business trends and opportunities for improvement.
Required Skills And Experience:
● 2-5 years of work experience in data analytics- including analyzing large data sets.
● BTech in Mathematics/Computer Science
● Strong analytical, quantitative and data interpretation skills.
● Hands-on experience with Python, Apache Spark, Hadoop, NoSQL
databases(MongoDB preferred), Linux is a must.
● Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
● Experience with Google Cloud Data Analytics Products such as BigQuery, Dataflow, Dataproc etc. (or similar cloud-based platforms).
● Experience working within a Linux computing environment, and use of
command-line tools including knowledge of shell/Python scripting for
automating common tasks.
● Previous experience working at startups and/or in fast-paced environments.
● Previous experience as a data engineer or in a similar role.
● Create and maintain optimal data pipeline architecture.
● Assemble large, complex data sets that meet functional / non-functional
business requirements.
● Building and optimizing ‘big data’ data pipelines, architectures and data sets.
● Maintain, organize & automate data processes for various use cases.
● Identifying trends, doing follow-up analysis, preparing visualizations.
● Creating daily, weekly and monthly reports of product KPIs.
● Create informative, actionable and repeatable reporting that highlights
relevant business trends and opportunities for improvement.
Required Skills And Experience:
● 2-5 years of work experience in data analytics- including analyzing large data sets.
● BTech in Mathematics/Computer Science
● Strong analytical, quantitative and data interpretation skills.
● Hands-on experience with Python, Apache Spark, Hadoop, NoSQL
databases(MongoDB preferred), Linux is a must.
● Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
● Experience with Google Cloud Data Analytics Products such as BigQuery, Dataflow, Dataproc etc. (or similar cloud-based platforms).
● Experience working within a Linux computing environment, and use of
command-line tools including knowledge of shell/Python scripting for
automating common tasks.
● Previous experience working at startups and/or in fast-paced environments.
● Previous experience as a data engineer or in a similar role.
Read more
NCR (Delhi | Gurgaon | Noida)
2 - 5 yrs
₹20L - ₹30L / yr
Python
Machine Learning (ML)Natural Language Processing (NLP)
NOSQL Databases
Spotmentor is focussed on using the Intelligence-age tools and technologies like AI and Text analytics to create HR technology products which go beyond compliance and ERPs to give HR the power to become strategic, improve business results and increase the competitiveness. The HR and People departments have long sought to become strategic partners with businesses. We are focussed on taking this concept out of the board room meetings and making it a reality and you can be a part of this journey. At the end of it, you would be able to claim that there was an inflection point in History, which changed how business was transacted and you made that happen.
Our first product is a Learning and Skill development platform which helps the organisations to acquire capabilities critical for them by helping employees attain their best potential through learning opportunities.
Spotmentor was started by 4 IIT Kharagpur alumni with experiences in creating Technology products and Management consulting.
We are looking for a Data Scientist who will help discover the information hidden in vast amounts of data, and help us make smarter decisions that benefit the employees of our customer organisations. Your primary focus will be on applying data mining techniques, doing statistical analysis, and building high quality prediction systems using structured and unstructured data.
Technical Responsibilities:
- Selecting features, building and optimizing classifiers using machine learning techniques
- Data mining using state-of-the-art methods
- Extending the existing data sets with third party sources of information
- Processing, cleansing, and verifying the integrity of data used for analysis
- Build recommendation systems
- Automate scoring of documents using machine learning techniques
Salary: This is a founding team member role with a salary of 20 Lacs to 30 Lacs per year and a meaningful ESOP component.
Location: Gurgaon
We believe in making Spotmentor the best place for the pursuit of excellence and diversity of opinions is an important tool to achieve that. Although as a startup our primary objective is growth, Spotmentor is focussed on creating a diverse and inclusive workplace where everyone can attain their best potential and we welcome female, minority and specially abled candidates to apply.
Read more
Chennai, Pune, Noida, Bengaluru (Bangalore)
5 - 15 yrs
₹10L - ₹15L / yr
Apache Kafka
Big Data
JavaSpark
Hadoop
+1 more
- KSQL
- Data Engineering spectrum (Java/Spark)
- Spark Scala / Kafka Streaming
- Confluent Kafka components
- Basic understanding of Hadoop
Read more
Who Are We
A research-oriented company with expertise in computer vision and artificial intelligence, at its core, Orbo is a comprehensive platform of AI-based visual enhancement stack. This way, companies can find a suitable product as per their need where deep learning powered technology can automatically improve their Imagery.
ORBO's solutions are helping BFSI, beauty and personal care digital transformation and Ecommerce image retouching industries in multiple ways.
WHY US
- Join top AI company
- Grow with your best companions
- Continuous pursuit of excellence, equality, respect
- Competitive compensation and benefits
You'll be a part of the core team and will be working directly with the founders in building and iterating upon the core products that make cameras intelligent and images more informative.
To learn more about how we work, please check out
https://www.orbo.ai/">https://www.orbo.ai/.
We at Orbo are looking for developers who have passion for technology, ability to deploy new and novel technologies in environments that are often low on humans as well as capital. From solving complex algorithm problems, software development engineers also develop complex algorithms to solve real-life crises and are involved in the system design of several applications and thus contributing to their technical architecture.
Responsibilities:
- To determine the scope of software development projects.
- Collaborating with the software development team on application design and development.
- Developing software and overseeing the deployment of applications across platforms.
- Performing diagnostic tests and debugging procedures.
- Creating end-user application feedback channels.
- Optimizing software by performing maintenance, updates, and upgrades.
- Documenting processes and maintaining software development records.
- Keeping up to date with C++ standards and advancements in application development.
Requirements:
- Bachelor's degree in computer science, information systems, or similar.
- Strong understanding of OOPs, SDL.
- Problem solving with data structure and algorithms.
- Build tools(make/Cmake/Ninja/Bazel)
- Experience with OS & hardware specific development (SIMD, AVX, AVX2)
- Having knowledge of 3rd Party library integration (OpenCV, Tensorflow, NCNN, TNN, liptorch, Openvino, ONNX runtime)
- Worked with Modern C++
- Worked with Linux & Windows
- Experience with multi threading and multi processing
- Superb analytical and problem-solving skills.
- Excellent collaboration and communication skills.
- Great organizational and time management skills.
Read more
Remote, Jaipur, NCR (Delhi | Gurgaon | Noida)
7 - 10 yrs
₹15L - ₹25L / yr
MySQL DBA
Relational Database (RDBMS)
Amazon Web Services (AWS)MySQL
MongoDB +2 more
About this role
We are seeking a seasoned DBA to join our team. You will have extensive experience in a mission-critical environment as a database administrator over a successful career. You will primarily work on the Supporting our Databases, AWS RDS (MySQL), and MongoDB/ Cassandra.
What You’ll Do
- Provide leadership in database scaling & monitoring. Maintain runbooks for our 24x7 SRE team.
- Assist in troubleshooting and resolution of database issues. Perform database upgrades and patches.
- Define and develop data pipelines between platforms in a mission-critical environment using DMS, Fivetran, Kafka, etc.
- Work with our developers to optimize and tune their SQL queries.
- Assist in application development, debugging, and optimization with respect to data concerns.
- Provide input in the design and implementation of backup, recovery, and DR strategy
- Review application and database design for compliance.
What You’ll Need
- Ability to script in a high-level language like Python, Ruby, etc for Automation.
- 8+ years of experience in AWS database services like RDS (Mysql), MongoDB/ Cassandra.
- 4+ years of experience in database design and DevOps on AWS.
- Must demonstrate a clear understanding of logical and physical database design and standards.
- Experience in columnar data warehouse solutions like Redshift or Snowflake.
- Must have extensive hands-on experience with MySQL in a large scale 24x7 production environment with millions of records.
- Bachelor of Science in Computer Science, Mathematics, or Engineering; or equivalent work experience
Bonus Points If You Have
- Experience with NoSQL solutions such as Cassandra/MongoDB etc.
- Experience with software development life cycle (SDLC) in an agile environment
- Hands-on production experience with Big Data applications such as Spark.
- Knowledge of development best practices (source control with Git, continuous integration, automated testing).
Read more
Remote, NCR (Delhi | Gurgaon | Noida)
4 - 6 yrs
₹5L - ₹12L / yr
Big Data
Spark
Hadoop
SQL
Python +1 more
JD:
Required Skills:
- Intermediate to Expert level hands-on programming using one of programming language- Java or Python or Pyspark or Scala.
- Strong practical knowledge of SQL.
Hands on experience on Spark/SparkSQL - Data Structure and Algorithms
- Hands-on experience as an individual contributor in Design, Development, Testing and Deployment of Big Data technologies based applications
- Experience in Big Data application tools, such as Hadoop, MapReduce, Spark, etc
- Experience on NoSQL Databases like HBase, etc
- Experience with Linux OS environment (Shell script, AWK, SED)
- Intermediate RDBMS skill, able to write SQL query with complex relation on top of big RDMS (100+ table)
Read more
NCR (Delhi | Gurgaon | Noida)
0 - 3 yrs
₹2L - ₹4L / yr
Tech Support
Communication Skills
PHPMongoDBDatabases
+1 more
We are looking for candidate who would be responsible for the smooth running of our cloud based platform and ensuring customers get maximum benefits from them.
Individual tasks vary depending on the size and structure, But may include:
Bridge between operations team and technical team
Managing Data uploads/ integrity and synchronisation for Clients
Installing and configuring computer hardware operating systems and applications
monitoring and maintaining cloud platform and networks
Talking to tech support team and clients through a series of actions, either face-to-face or over the telephone, to help set up systems or resolve issues;
Troubleshooting system and network problems and diagnosing and solving hardware or software faults;
Providing support, including procedural documentation and relevant reports;
Following standard operating procedures to repair a fault or set up a System;
Supporting the roll-out of new applications;
Setting up new users' accounts and profiles and dealing with password issues;
Prioritising and managing many open cases at one time;
Testing and evaluating new technology
Read more
NCR (Delhi | Gurgaon | Noida)
4 - 6 yrs
₹15L - ₹18L / yr
Machine Learning (ML)PythonCassandra
MySQL
Apache Kafka
+2 more
Requirements:
Minimum 4-years work experience in building, managing and maintaining Analytics applications
B.Tech/BE in CS/IT from Tier 1/2 Institutes
Strong Fundamentals of Data Structures and Algorithms
Good analytical & problem-solving skills
Strong hands-on experience in Python
In depth Knowledge of queueing systems (Kafka/ActiveMQ/RabbitMQ)
Experience in building Data pipelines & Real time Analytics Systems
Experience in SQL (MYSQL) & NoSQL (Mongo/Cassandra) databases is a plus
Understanding of Service Oriented Architecture
Delivered high-quality work with a significant contribution
Expert in git, unit tests, technical documentation and other development best practices
Experience in Handling small teams
Read more
NCR (Delhi | Gurgaon | Noida)
0 - 8 yrs
₹7L - ₹14L / yr
Computer Security
Image processing
OpenCV
PythonRational ClearCase
+8 more
FarmGuide is a data driven tech startup aiming towards digitizing the periodic processes in place and bringing information symmetry in agriculture supply chain through transparent, dynamic & interactive software solutions. We, at FarmGuide (https://angel.co/farmguide) help Government in relevant and efficient policy making by ensuring seamless flow of information between stakeholders.Job Description :We are looking for individuals who want to help us design cutting edge scalable products to meet our rapidly growing business. We are building out the data science team and looking to hire across levels.- Solving complex problems in the agri-tech sector, which are long-standing open problems at the national level.- Applying computer vision techniques to satellite imagery to deduce artefacts of interest.- Applying various machine learning techniques to digitize existing physical corpus of knowledge in the sector.Key Responsibilities :- Develop computer vision algorithms for production use on satellite and aerial imagery- Implement models and data pipelines to analyse terabytes of data.- Deploy built models in production environment.- Develop tools to assess algorithm accuracy- Implement algorithms at scale in the commercial cloudSkills Required :- B.Tech/ M.Tech in CS or other related fields such as EE or MCA from IIT/NIT/BITS but not compulsory. - Demonstrable interest in Machine Learning and Computer Vision, such as coursework, open-source contribution, etc.- Experience with digital image processing techniques - Familiarity/Experience with geospatial, planetary, or astronomical datasets is valuable- Experience in writing algorithms to manipulate geospatial data- Hands-on knowledge of GDAL or open-source GIS tools is a plus- Familiarity with cloud systems (AWS/Google Cloud) and cloud infrastructure is a plus- Experience with high performance or large scale computing infrastructure might be helpful- Coding ability in R or Python. - Self-directed team player who thrives in a continually changing environmentWhat is on offer :- High impact role in a young start up with colleagues from IITs and other Tier 1 colleges- Chance to work on the cutting edge of ML (yes, we do train Neural Nets on GPUs) - Lots of freedom in terms of the work you do and how you do it - Flexible timings - Best start-up salary in industry with additional tax benefits
Read more
NCR (Delhi | Gurgaon | Noida)
0 - 5 yrs
₹2L - ₹5L / yr
Python
Deep LearningMySQL
Job Description: Data Science Analyst/ Data Science Senior Analyst
Job description
KSTYCH is seeking a Data Science Analyst to join our Data Science team. Individuals in this role are expected to be comfortable working as a software engineer and a quantitative researcher, should have a significant theoretical foundation in mathematical statistics. The ideal candidate will have a keen interest in the study of Pharma sector, network biology, text mining, machine learning, and a passion for identifying and answering questions that help us build the best consulting resource and continuous support to other teams.
Responsibilities
Work closely with a product scientific, medical, business development and commercial to identify and answer important healthcare/pharma/biology questions.
Answer questions by using appropriate statistical techniques and tools on available data.
Communicate findings to project managers and team managers.
Drive the collection of new data and the refinement of existing data sources
Analyze and interpret the results of an experiments
Develop best practices for instrumentation and experimentation and communicate those to other teams
Requirements
B. Tech, M.Tech, M.S. or Ph.D. in a relevant technical field, or 1+ years experience in a relevant role
Extensive experience solving analytical problems using quantitative approaches
Comfort manipulating and analyzing complex, high-volume, high-dimensionality data from varying sources
A strong passion for empirical research and for answering hard questions with data
A flexible analytic approach that allows for results at varying levels of precision
Ability to communicate complex quantitative analysis in a clear, precise, and actionable manner
Fluency with at least one scripting language such as Python or PHP
Familiarity with relational databases and SQL
Experience working with large data sets, experience working with distributed computing tools a plus (KNIME, Map/Reduce, Hadoop, Hive, etc)
Read more
Noida, NCR (Delhi | Gurgaon | Noida)
3 - 7 yrs
₹5L - ₹12L / yr
Spark
Apache Kafka
Hadoop
Pig
HDFS
Together we will create wonderful solutions which deliver value for us and our customers.
Read more
Follow CutshortWhy apply via Cutshort?
Connect with actual hiring teams and get their fast response. No spam.
Find more jobs