Cutshort logo
DemandMatrix logo
Data Engineer
DemandMatrix's logo

Data Engineer

Harwinder Singh's profile picture
Posted by Harwinder Singh
9 - 12 yrs
₹25L - ₹30L / yr
Remote only
Skills
Big Data
PySpark
Apache Hadoop
Spark
skill iconPython
Design patterns
Data Structures
Algorithms

Only a solid grounding in computer engineering, Unix, data structures and algorithms would enable you to meet this challenge.

7+ years of experience architecting, developing, releasing, and maintaining large-scale big data platforms on AWS or GCP

Understanding of how Big Data tech and NoSQL stores like MongoDB, HBase/HDFS, ElasticSearch synergize to power applications in analytics, AI and knowledge graphs

Understandingof how data processing models, data location patterns, disk IO, network IO, shuffling affect large scale text processing - feature extraction, searching etc

Expertise with a variety of data processing systems, including streaming, event, and batch (Spark,  Hadoop/MapReduce)

5+ years proficiency in configuring and deploying applications on Linux-based systems

5+ years of experience Spark - especially Pyspark for transforming large non-structured text data, creating highly optimized pipelines

Experience with RDBMS, ETL techniques and frameworks (Sqoop, Flume) and big data querying tools (Pig, Hive)

Stickler of world class best practices, uncompromising on the quality of engineering, understand standards and reference architectures and deep in Unix philosophy with appreciation of big data design patterns, orthogonal code design and functional computation models
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos

About DemandMatrix

Founded :
2015
Type :
Services
Size
Stage :
Profitable

About

DemandMatrix is an AI-powered Technographics and Intent Data provider that helps B2B marketing and sales teams identify and target the right accounts based on their propensity to buy-into a particular technology.
Read more

Connect with the team

Profile picture
Sudarshana Mukherjee
Profile picture
Rutuja Pawar
Profile picture
Jobs DemandMatrix
Profile picture
Harwinder Singh

Company social profiles

blog

Similar jobs

Apptware solutions LLP Pune
Pune
6 - 10 yrs
₹9L - ₹15L / yr
skill iconDocker
skill iconKubernetes
DevOps
skill iconAmazon Web Services (AWS)
Google Cloud Platform (GCP)
+5 more

Company - Apptware Solutions

Location Baner Pune

Team Size - 130+


Job Description -

Cloud Engineer with 8+yrs of experience


Roles and Responsibilities


● Have 8+ years of strong experience in deployment, management and maintenance of large systems on-premise or cloud

● Experience maintaining and deploying highly-available, fault-tolerant systems at scale

● A drive towards automating repetitive tasks (e.g. scripting via Bash, Python, Ruby, etc)

● Practical experience with Docker containerization and clustering (Kubernetes/ECS)

● Expertise with AWS (e.g. IAM, EC2, VPC, ELB, ALB, Autoscaling, Lambda, VPN)

● Version control system experience (e.g. Git)

● Experience implementing CI/CD (e.g. Jenkins, TravisCI, CodePipeline)

● Operational (e.g. HA/Backups) NoSQL experience (e.g. MongoDB, Redis) SQL experience (e.g. MySQL)

● Experience with configuration management tools (e.g. Ansible, Chef) ● Experience with infrastructure-as-code (e.g. Terraform, Cloudformation)

● Bachelor's or master’s degree in CS, or equivalent practical experience

● Effective communication skills

● Hands-on cloud providers like MS Azure and GC

● A sense of ownership and ability to operate independently

● Experience with Jira and one or more Agile SDLC methodologies

● Nice to Have:

○ Sensu and Graphite

○ Ruby or Java

○ Python or Groovy

○ Java Performance Analysis


Role: Cloud Engineer

Industry Type: IT-Software, Software Services

Functional Area: IT Software - Application Programming, Maintenance Employment Type: Full Time, Permanent

Role Category: Programming & Design

Read more
Digiactive Technologies private limited
Delhi
4 - 10 yrs
₹1L - ₹9L / yr
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconNodeJS (Node.js)
skill iconMongoDB
+3 more

Require a confident person who can manage a team can also hire good candidates if required anyone having experience in fintech will be prefered

Read more
Mobile Programming LLC
at Mobile Programming LLC
1 video
34 recruiters
Sukhdeep Singh
Posted by Sukhdeep Singh
Bengaluru (Bangalore)
8 - 11 yrs
₹10L - ₹15L / yr
skill iconDocker
skill iconKubernetes
DevOps
skill iconAmazon Web Services (AWS)
Windows Azure
+1 more


Role Introduction

• This role involves guiding the DevOps team towards successful delivery of Governance and

toolchain initiatives by removing manual tasks.

• Operate toolchain applications to empower engineering teams by providing, reliable, governed

self-service tools and supporting their adoption

• Driving good practice for consumption and utilisation of the engineering toolchain, with a focus

on DevOps practices

• Drive good governance for cloud service consumption

• Involves working in a collaborative environment and focus on leading team and providing

technical leadership to team members.

• Involves setting up process and improvements for teams on supporting various DevOps tooling

and governing the tooling.

• Co-ordinating with multiple teams within organization

• Lead on handovers from architecture teams to support major project rollouts which require the

Toolchain governance DevOps team to operationally support tooling

What you will do

• Identify and implement best practices, process improvement and automation initiatives for

improvement towards quicker delivery by removing manual tasks

• Ensure best practices and process are documented for reusability and keeping up-to date on

good practices and standards.

• Re-usable automation and compliance service, tools and processes

• Support and management of toolchain, toolchain changes and selection

• Identify and implement risk mitigation plans, avoid escalations, resolve blockers for teams.

Toolchain governance will involve operating and responding to alerts, enforcing good tooling

governance by driving automation, remediating technical debt and ensuring the latest tools

are utilised and on the latest versions

• Triage product pipelines, performance issues, SLA/SLO breaches, service unavailable along

with ancillary actions such as providing access to logs, tools, environments.

• Involve in initial / detailed estimates during roadmap planning or feature

estimation/planning of any automation identified for a given toolset.

• Develop, refine, and tune integrations between various tools

• Discuss with Product Owner/team on any challenges from implementation, deployment

perspective and assist in arriving probable solution and escalate any risks to get them

resolved w.r.t DevOps toolchain.

• In consultation with Head of DevOps and other stake holders, prioritization of items, item-

task breakdown; accountable for squad deliverables for sprint

• Involve in reviewing current components and plan for upgrade and ensure its communicated

to wider audience within Organization

• Involve in reviewing access / role and enhance and automate provisioning.

• Identify and encourage areas for growth and improvement within the team e.g conducts

regular 1-2-1’s with squad members to provide support, mentoring and goal setting

• Involve in performance management ,rewards and recognition of team members, Involve in

hiring process.• Plan for upskill of team to know about tools and perform tasks. Ensure quicker onboarding

of new joiners/freshers to team to be productive.

• Review ticket metrics to measure the health of the project including SLAs and plan for

improvement.

• Requirement for on call for critical incidents that happen Out of Hours, based on tooling SLA.

This may include planning standby schedule for squad, carrying out retrospective for every

callout and reviewing SLIs/SLOs.

• Owns the tech/repair debt, risk and compliance for the tooling with respect to

infrastructure, pipelines, access etc

• Track optimum utilization of resources and monitor/track the delivery schedule

• Review solutions designs with the Architects / Principal DevOps Engineers as required

• Provide monthly reporting which align to DevOps Tooling KPIs

What you will have

• Candidate should have 8+ years of experience and Hands-on DevOps experience and

experience in team management.

• Strong communication and interpersonal skills, Team player

• Good working experience of CI/CD tools like Jenkins, SonarQube, FOSSA, Harness, Jira, JSM,

ServiceNow etc.

• Good hands on knowledge of AWS Services like EC2, ECS, S3, IAM, SNS, SQS, VPC, Lambda,

API Gateway, Cloud Watch, Cloud Formation etc.

• Experience in operating and governing DevOps Toolchain

• Experience in operational monitoring, alerting and identifying and delivering on both repair

and technical debt

• Experience and background in ITIL/ITSM processes. The candidate will ensure development

of the appropriate (ITSM) model and processes, based on the ITIL Service Management

framework. This includes the strategic, design, transition, and operation services and

continuous service improvement

• Provide ITSM leadership experience and coaching processes

• Experience on various tools like Jenkins, Harness, Fossa,

• Experience of hosting and managing applications on AWS/AZURE•

• Experience in CI/CD pipeline (Jenkins build pipelines)

• Experience in containerization (Docker/Kubernetes)

• Experience in any programming language (Node.js or Python is preferred)

• Experience in Architecting and supporting cloud based products will be a plus

• Experience in PowerShell & Bash will be a plus

• Able to self manage multiple concurrent small projects, including managing priorities

between projects

• Able to quickly learn new tools

• Should be able to mentor/drive junior team members to achieve desired outcome of

roadmap-

• Ability to analyse information to identify problems and issues, and make effective decisions

within short span

• Excellent problem solving and critical thinking

• Experience in integrating various components including unit testing / CI/CD configuration.

• Experience to review current toolset and plan for upgrade.

• Experience with Agile framework/Jira/JSM tool.• Good communication skills and ability to communicate/work independently with external

teams.

• Highly motivated, able to work proficiently both independently and in a team environment

Good knowledge and experience with security constructs –


Read more
VeloxCore
Ahmedabad
0 - 2 yrs
₹2.4L - ₹3.6L / yr
skill icon.NET
skill iconC#
skill iconAngular (2+)
Object Oriented Programming (OOPs)

Apply only if you are Fresher to 2 Years experience and located or ready to relocate to Ahmedabad. We have 5 opening for .Net Developer.

 

Are you a top-notch software engineer with a creative flare, strong problem-solving skills, the drive to build extraordinary product, a solid computer science foundation, and the desire to build next generation Internet-facing applications? Come talk with us about joining our team to grow with us.

Veloxcore have been founded in 2014 and since then we are delivering highly maintainable, scalable solutions to our global clientele. We are Microsoft Partner company and we specializes in developing next-generation, cloud-based, reactive, and data-intensive applications using web technologies. We have great culture, open and collaboration focused environment, highly experienced leadership and cutting edge technology based projects. We are 100% cloud based company and being a Microsoft Partner we heavily rely on Azure for ourselves and for our clients.

 

Skills & Requirements

  • BS or MS in Computer Science or in a relevant Engineering discipline
  • Strong understanding of OOPs fundamentals.
  • Proficiency in at least one modern object-oriented programming language such as C# or Java.
  • Hands on experience with any server-side web frameworks: ASP.NET, ASP.NET Core, Web API.
  • Experience with web technologies such as HTML5, CSS3, jQuery.
  • Experience with test-driven development, continuous integration.
  • React/AngularJS, REST API, Grunt/Gulp/webpack, MS SQL would be an asset.
  • Experience with Git or similar source-control.

 

Duties and Responsibilities

  • Development: Work alongside product architects and senior developers to build (design, develop, test) new features for Vital Objects. Deliver thoroughly tested and functional code.
  • Design: Working with team members, understand business requirements and participate in software design.
  • Research: Work with development team in the implementation of new technologies and components. Find new solutions to help solve problems – new and old.
  • Debugging: Work on production issues as required.
  • Provide accurate estimates of work effort and be accountable to those estimates.

 

Who you are

  • Enthusiastic about developing the best software available and providing the ultimate customer experience.
  • Interested in staying current by applying new technologies.
  • Able to work in a collaborative environment with a willingness to share your ideas.
  • Able to work independently on modules and complete tasks with high quality, but unafraid to seek out suggestions from other team members.
  • Excited to work on cutting-edge technology!

 

Some of our job benefits

  • Best hardware money can buy.
  • Microsoft Azure credits each month to try and learn Azure services.
  • Fortnightly sessions by colleges on bleeding edge technologies.
  • Modern spacious open office with flexible seating arrangement.
  • Lively work environment with no hierarchy.
  • Of Course, work environment is amazing, so are the projects.
Read more
An US based firm offering permanent WFH
An US based firm offering permanent WFH
Agency job
via Jobdost by Riya Roy
Remote only
1 - 10 yrs
₹8.5L - ₹14.5L / yr
Internet of Things (IOT)
Software Testing (QA)
Performance Testing
Mobile App Testing (QA)
Test Planning
+1 more

We are looking for a can do it attitude, and the ability to deliver with high velocity and high-quality at the same time. 

 

This person MUST have: 

- BE Computer Science, MCA or equivalent. 

- Experience testing IOT devices managed by cloud. 

- Manual testing experience and a desire to learn and work with the latest technologies. Web, Cloud and Mobile App testing. 

- Develop test plans, cases, and scripts; schedule and execute test cycles; contribute to testability & quality of software. 

- Reports all defects accurately; facilitate problem tracking and successful resolution; assess and communicate various risks involved and provide necessary assistance to engineers and stakeholders. 

- Basic knowledge of automation know-how [ API automation, Python] - Test to fail mindset, Solid test strategy experience, well versed with QA processes. - Hands on experience on Performance test angle. 

 

Experience

- Min 1 year experience 

- Not more than 10 year experience. 

 

Location 

- Remotely, anywhere in India 

 

Timings:

- 40 hours a week (9 PM IST to 2 AM IST(10 hours in your suitable time) , Monday to Saturday). 

 

Position: 

- Full time/Direct 

- We have great benefits such as PF, medical insurance, 12 annual company holidays, 12 PTO leaves per year, annual increments, Diwali bonus, spot bonuses and other incentives etc. 

- We dont believe in locking in people with large notice periods. You will stay here because you love the company. We have only a 15 days notice period. 

Read more
Mobile Programming LLC
at Mobile Programming LLC
1 video
34 recruiters
Abha Sharma
Posted by Abha Sharma
Bengaluru (Bangalore), Mumbai, Gurugram, Mohali, Pune
3 - 6 yrs
₹2L - ₹12L / yr
skill iconJava
J2EE
Struts
Spring
Hibernate (Java)
+1 more
Must have min 2-6 years of experience in Spring boot, java, Hybernate J2EE and SQL
  • Proven hands-on Software Development experience
  • Proven working experience in Java development
  • Hands on experience in designing and developing applications using Java EE platforms
  • Object Oriented analysis and design using common design patterns.
Read more
Transportation | Warehouse Optimization
Tom Moore
Posted by Tom Moore
Remote, Any city, Pune, Bengaluru (Bangalore), Mumbai, NCR (Delhi | Gurgaon | Noida), Hyderabad, Chandigarh, Trichur, Mysore
4 - 12 yrs
₹10L - ₹25L / yr
Windows Azure
skill iconC++
skill iconKubernetes
skill iconPython
skill iconC#
+1 more
Our current operations research product is deployed at some of the largest organizations in the world. This role will be responsible for re-architecting the existing solution and adding components of machine learning and intelligence to its logic. We are looking for a passionate individual who loves technology and is willing to design and create a flexible long-lasting product architecture.
Read more
Our client is a leading IT service providers in India
Our client is a leading IT service providers in India
Agency job
via GSN Consulting by Mahendrand Deepak
Bengaluru (Bangalore)
5 - 8 yrs
₹15L - ₹20L / yr
TIBCO Spotfire
TIBCO
DXP
Spotfire
Dashboard
+2 more
  • 4+ years of extensive EXP in TIBCO SPOTFIRE Dashboard Development is MUST
  • Design and create data visualizations in TIBCO Spotfire
  • Proven EXP in delivering Spotfire solutions to advance business goals and needs.
  • Detailed knowledge of TIBCO Spotfire - report developer configuration
  • EXP on creating all charts that exist in Spotfire (scatter, line, bar, combo, pie, etc.) and how to manipulate every property associated with a visualization (trellis, color, shape, size, etc.)
  • EXP in writing efficient SQL queries, views in relational databases such as Oracle, SQL Server, Postgres and BigQuery (Optional).
  • Ability to incorporate multiple data sources into one Spotfire DXP and have that information linked via data table relations.
  • EXP with Spotfire Administrative tasks, load balancing, installation/configuration of servers and clients, upgrades and patches would be a plus.
  • Strong background in analytical visualizations and building executive dashboards.
  • In-depth knowledge & understanding of BI and Datawarehouse concepts
Read more
TRADEJINI
at TRADEJINI
2 recruiters
Prateek Gupta
Posted by Prateek Gupta
Bengaluru (Bangalore)
1 - 5 yrs
₹2L - ₹6L / yr
Sales
Telesales
Team Management
Report Writing
Inside Sales
+1 more
We are looking for an experienced Inside Sales Manager to oversee and support our inside sales representatives team. The Inside Sales Manager will monitor sales metrics and manage the entire sales administration process. They will collaborate with various professionals, so it’s essential that they have excellent communication skills and feel comfortable working in a team environment. They should also be able to lead and motivate the sales team to achieve specific goals. Ultimately, the Inside Sales Manager should be able to build a high-performance sales team to ensure customer satisfaction. Responsibilities • Manage the inside sales representatives team • Set and track sales targets for your team • Prepare monthly, quarterly and annual sales forecasts • Use customer feedback to generate ideas about new features or products • Research and discover methods to increase customer engagement Requirements • Proven work experience as an Inside sales manager • Hands on experience with Ms Office • Excellent interpersonal and team management skills
Read more
Foghorn Systems
at Foghorn Systems
1 recruiter
Abhishek Vijayvargia
Posted by Abhishek Vijayvargia
Pune
0 - 7 yrs
₹15L - ₹50L / yr
skill iconR Programming
skill iconPython
skill iconData Science

Role and Responsibilities

  • Execute data mining projects, training and deploying models over a typical duration of 2 -12 months.
  • The ideal candidate should be able to innovate, analyze the customer requirement, develop a solution in the time box of the project plan, execute and deploy the solution.
  • Integrate the data mining projects embedded data mining applications in the FogHorn platform (on Docker or Android).

Core Qualifications
Candidates must meet ALL of the following qualifications:

  • Have analyzed, trained and deployed at least three data mining models in the past. If the candidate did not directly deploy their own models, they will have worked with others who have put their models into production. The models should have been validated as robust over at least an initial time period.
  • Three years of industry work experience, developing data mining models which were deployed and used.
  • Programming experience in Python is core using data mining related libraries like Scikit-Learn. Other relevant Python mining libraries include NumPy, SciPy and Pandas.
  • Data mining algorithm experience in at least 3 algorithms across: prediction (statistical regression, neural nets, deep learning, decision trees, SVM, ensembles), clustering (k-means, DBSCAN or other) or Bayesian networks

Bonus Qualifications
Any of the following extra qualifications will make a candidate more competitive:

  • Soft Skills
    • Sets expectations, develops project plans and meets expectations.
    • Experience adapting technical dialogue to the right level for the audience (i.e. executives) or specific jargon for a given vertical market and job function.
  • Technical skills
    • Commonly, candidates have a MS or Ph.D. in Computer Science, Math, Statistics or an engineering technical discipline. BS candidates with experience are considered.
    • Have managed past models in production over their full life cycle until model replacement is needed. Have developed automated model refreshing on newer data. Have developed frameworks for model automation as a prototype for product.
    • Training or experience in Deep Learning, such as TensorFlow, Keras, convolutional neural networks (CNN) or Long Short Term Memory (LSTM) neural network architectures. If you don’t have deep learning experience, we will train you on the job.
    • Shrinking deep learning models, optimizing to speed up execution time of scoring or inference.
    • OpenCV or other image processing tools or libraries
    • Cloud computing: Google Cloud, Amazon AWS or Microsoft Azure. We have integration with Google Cloud and are working on other integrations.
    • Decision trees like XGBoost or Random Forests is helpful.
    • Complex Event Processing (CEP) or other streaming data as a data source for data mining analysis
    • Time series algorithms from ARIMA to LSTM to Digital Signal Processing (DSP).
    • Bayesian Networks (BN), a.k.a. Bayesian Belief Networks (BBN) or Graphical Belief Networks (GBN)
    • Experience with PMML is of interest (see www.DMG.org).
  • Vertical experience in Industrial Internet of Things (IoT) applications:
    • Energy: Oil and Gas, Wind Turbines
    • Manufacturing: Motors, chemical processes, tools, automotive
    • Smart Cities: Elevators, cameras on population or cars, power grid
    • Transportation: Cars, truck fleets, trains

 

About FogHorn Systems
FogHorn is a leading developer of “edge intelligence” software for industrial and commercial IoT application solutions. FogHorn’s Lightning software platform brings the power of advanced analytics and machine learning to the on-premise edge environment enabling a new class of applications for advanced monitoring and diagnostics, machine performance optimization, proactive maintenance and operational intelligence use cases. FogHorn’s technology is ideally suited for OEMs, systems integrators and end customers in manufacturing, power and water, oil and gas, renewable energy, mining, transportation, healthcare, retail, as well as Smart Grid, Smart City, Smart Building and connected vehicle applications.

Press:  https://www.foghorn.io/press-room/">https://www.foghorn.io/press-room/

Awards: https://www.foghorn.io/awards-and-recognition/">https://www.foghorn.io/awards-and-recognition/

  • 2019 Edge Computing Company of the Year – Compass Intelligence
  • 2019 Internet of Things 50: 10 Coolest Industrial IoT Companies – CRN
  • 2018 IoT Planforms Leadership Award & Edge Computing Excellence – IoT Evolution World Magazine
  • 2018 10 Hot IoT Startups to Watch – Network World. (Gartner estimated 20 billion connected things in use worldwide by 2020)
  • 2018 Winner in Artificial Intelligence and Machine Learning – Globe Awards
  • 2018 Ten Edge Computing Vendors to Watch – ZDNet & 451 Research
  • 2018 The 10 Most Innovative AI Solution Providers – Insights Success
  • 2018 The AI 100 – CB Insights
  • 2017 Cool Vendor in IoT Edge Computing – Gartner
  • 2017 20 Most Promising AI Service Providers – CIO Review

Our Series A round was for $15 million.  Our Series B round was for $30 million October 2017.  Investors include: Saudi Aramco Energy Ventures, Intel Capital, GE, Dell, Bosch, Honeywell and The Hive.

About the Data Science Solutions team
In 2018, our Data Science Solutions team grew from 4 to 9.  We are growing again from 11. We work on revenue generating projects for clients, such as predictive maintenance, time to failure, manufacturing defects.  About half of our projects have been related to vision recognition or deep learning. We are not only working on consulting projects but developing vertical solution applications that run on our Lightning platform, with embedded data mining.

Our data scientists like our team because:

  • We care about “best practices”
  • Have a direct impact on the company’s revenue
  • Give or receive mentoring as part of the collaborative process
  • Questions and challenging the status quo with data is safe
  • Intellectual curiosity balanced with humility
  • Present papers or projects in our “Thought Leadership” meeting series, to support continuous learning

 

Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos