Cutshort logo
DemandMatrix logo
Data Engineer
DemandMatrix's logo

Data Engineer

Harwinder Singh's profile picture
Posted by Harwinder Singh
9 - 12 yrs
₹25L - ₹30L / yr
Remote only
Skills
Big Data
PySpark
Apache Hadoop
Spark
skill iconPython
Design patterns
Data Structures
Algorithms

Only a solid grounding in computer engineering, Unix, data structures and algorithms would enable you to meet this challenge.

7+ years of experience architecting, developing, releasing, and maintaining large-scale big data platforms on AWS or GCP

Understanding of how Big Data tech and NoSQL stores like MongoDB, HBase/HDFS, ElasticSearch synergize to power applications in analytics, AI and knowledge graphs

Understandingof how data processing models, data location patterns, disk IO, network IO, shuffling affect large scale text processing - feature extraction, searching etc

Expertise with a variety of data processing systems, including streaming, event, and batch (Spark,  Hadoop/MapReduce)

5+ years proficiency in configuring and deploying applications on Linux-based systems

5+ years of experience Spark - especially Pyspark for transforming large non-structured text data, creating highly optimized pipelines

Experience with RDBMS, ETL techniques and frameworks (Sqoop, Flume) and big data querying tools (Pig, Hive)

Stickler of world class best practices, uncompromising on the quality of engineering, understand standards and reference architectures and deep in Unix philosophy with appreciation of big data design patterns, orthogonal code design and functional computation models
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About DemandMatrix

Founded :
2015
Type :
Services
Size
Stage :
Profitable

About

DemandMatrix is an AI-powered Technographics and Intent Data provider that helps B2B marketing and sales teams identify and target the right accounts based on their propensity to buy-into a particular technology.
Read more

Connect with the team

Profile picture
Sudarshana Mukherjee
Profile picture
Rutuja Pawar
Profile picture
Jobs DemandMatrix
Profile picture
Harwinder Singh

Company social profiles

blog

Similar jobs

Product and Service based company
Product and Service based company
Agency job
via Jobdost by Sathish Kumar
Hyderabad, Ahmedabad
4 - 8 yrs
₹15L - ₹30L / yr
skill iconAmazon Web Services (AWS)
Apache
Snow flake schema
skill iconPython
Spark
+13 more

Job Description

 

Mandatory Requirements 

  • Experience in AWS Glue

  • Experience in Apache Parquet 

  • Proficient in AWS S3 and data lake 

  • Knowledge of Snowflake

  • Understanding of file-based ingestion best practices.

  • Scripting language - Python & pyspark

CORE RESPONSIBILITIES

  • Create and manage cloud resources in AWS 

  • Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies 

  • Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform 

  • Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations 

  • Develop an infrastructure to collect, transform, combine and publish/distribute customer data.

  • Define process improvement opportunities to optimize data collection, insights and displays.

  • Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible 

  • Identify and interpret trends and patterns from complex data sets 

  • Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders. 

  • Key participant in regular Scrum ceremonies with the agile teams  

  • Proficient at developing queries, writing reports and presenting findings 

  • Mentor junior members and bring best industry practices.

 

QUALIFICATIONS

  • 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales) 

  • Strong background in math, statistics, computer science, data science or related discipline

  • Advanced knowledge one of language: Java, Scala, Python, C# 

  • Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake  

  • Proficient with

  • Data mining/programming tools (e.g. SAS, SQL, R, Python)

  • Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)

  • Data visualization (e.g. Tableau, Looker, MicroStrategy)

  • Comfortable learning about and deploying new technologies and tools. 

  • Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines. 

  • Good written and oral communication skills and ability to present results to non-technical audiences 

  • Knowledge of business intelligence and analytical tools, technologies and techniques.

Familiarity and experience in the following is a plus: 

  • AWS certification

  • Spark Streaming 

  • Kafka Streaming / Kafka Connect 

  • ELK Stack 

  • Cassandra / MongoDB 

  • CI/CD: Jenkins, GitLab, Jira, Confluence other related tools

Read more
Wissen Technology
at Wissen Technology
4 recruiters
Vijayalakshmi Selvaraj
Posted by Vijayalakshmi Selvaraj
Pune, Mumbai, Bengaluru (Bangalore)
4 - 9 yrs
Best in industry
Rancher
skill iconKubernetes
K8s
DevOps
Puppet

Job Summary:

We are seeking a skilled DevOps Engineer to join our dynamic team. The ideal candidate will be responsible for managing, maintaining, and troubleshooting Rancher clusters, with a strong emphasis on Kubernetes operations. This role requires expertise in automation through shell scripting and proficiency in configuration management tools like Puppet and Ansible. Candidates should be highly self-motivated, capable of working on a rotating schedule, and committed to owning tasks through to delivery.

Key Responsibilities:

  • Set up, operate, and maintain Rancher and Kubernetes (K8s) clusters, including on bare-metal environments.
  • Perform upgrades and manage the lifecycle of Rancher clusters.
  • Troubleshoot and resolve Rancher cluster issues efficiently.
  • Write, maintain, and optimize shell scripts to automate Kubernetes-related tasks.
  • Work collaboratively with the team to implement best practices for system automation and orchestration.
  • Utilize configuration management tools like Puppet and Ansible (preferred but not mandatory).
  • Participate in a rotating schedule, with the ability to work until 1 AM as required.
  • Take ownership of tasks, ensuring timely delivery with high-quality standards.

Key Requirements:

  • Strong expertise in Rancher and Kubernetes operations and maintenance.
  • Experience in setting up and managing Kubernetes clusters on bare-metal systems is highly desirable.
  • Proficiency in shell scripting for task automation.
  • Familiarity with configuration management tools like Puppet and Ansible (good to have).
  • Strong troubleshooting skills for Kubernetes and Rancher environments.
  • Ability to work effectively in a rotating schedule and flexible hours.
  • Strong ownership mindset and accountability for deliverables.


Read more
Greyblue Ventures
Shabina Khan
Posted by Shabina Khan
Gurugram
1 - 3 yrs
₹3L - ₹4L / yr
Fire ball
Troubleshooting
Hardware troubleshooting
Software troubleshooting
Office 365
+4 more

Key Responsibilities:

-Provide technical support and troubleshooting assistance to end-users for hardware, software, and networking issues.

-Must have the knowledge of SharePoint.

-Manage and maintain Microsoft 365 applications, including Outlook, Word, Excel, and PowerPoint.

-Administer and monitor Microsoft Azure services, ensuring smooth operation and security compliance.

-Perform machine repairs and maintenance tasks, including diagnosing hardware issues and replacing faulty components.

-Collaborate with third-party IT vendors for procurement, installation, and maintenance of IT infrastructure and services.


Requirements:

*Bachelor's degree in Computer Science, Information Technology, or related field.

*Minimum 2 years of experience in IT support roles, with proficiency in Microsoft 365 and Microsoft Azure.

*Strong knowledge and experience in machine repairing and troubleshooting hardware issues.

*Excellent communication and interpersonal skills, with the ability to effectively interact with end-users and third-party vendors.

*Ability to work independently and prioritize tasks in a fast-paced environment.

Certification in Microsoft 365 or Microsoft Azure is preferred but not mandatory.


Read more
F5 Networks
Hyderabad
15 - 20 yrs
Best in industry
DNS
skill iconC
skill iconC++
skill iconPython
skill iconJavascript
+8 more

At F5, we strive to bring a better digital world to life. Our teams empower organizations across the globe to create, secure, and run applications that enhance how we experience our evolving digital world. We are passionate about cybersecurity, from protecting consumers from fraud to enabling companies to focus on innovation. 
 

Everything we do centers around people. That means we obsess over how to make the lives of our customers, and their customers, better. And it means we prioritize a diverse F5 community where each individual can thrive.

  • Design, coding, enhancements, and bug fixing in DNS and related areas.

  • Bring up new ideas to improve the day-to-day challenges in the design/functionality.

  • Should be able to provide technical direction to the ongoing and future projects in the team.

  • Keep the product vulnerability free by uplifting/fixing the open issues.

  • Build tools and infrastructure to improve these F5’s components and features. 

  • Set an example of software design and development innovation and excellence. 

  • Research, investigate and define new areas of technology to enhance existing or new products directions

  • Evaluate performance of products to fine-tune, and refactor the design as per the requirements to scale up.

  • Must have worked in security and related areas.

  • Document software designs via functional specifications and other design documents

  • Conduct presentations internal and external, mentoring the team members

  • May participate in the hiring and onboarding process

  • Collaborate with team members and technical leads

  • Responsible for upholding F5’s Business Code of Ethics and for promptly reporting violations of the Code or other company policies.

  

Knowledge, Skills and Abilities: 

Essential 

  • Deep understanding of data structures & algorithm. 

  • Expert in C, C++ with hands-on experience

  • Fair understanding of scripting languages Python and JavaScript

  • Expertise in Linux user-level programming and exposure to Linux networking stack.

  • Good understanding on TCP/IP concepts.

  • Proven experience with security standards.

  • Excellent analytical and problem-solving skills. 

  • Good understanding of Network security and DNS modules

  • Excellent Understanding of networking technologies and OS internals.

  • Prior experience in leading and delivering project/programs involving multiple teams.

  • Prior experience of leading and mentoring senior engineers to deliver critical projects.

 

Nice-to-have 

  • Prior experience developing DNS and related modules is a Plus.

  • Good understanding of network protocols like TCP, UDP, HTTP, SSL, DNS, FTP etc. 

  • Experience with CI/CD (git, pipeline etc.). 

 

Qualifications

  • Requires a minimum of 15+ years of related experience with a Bachelor of Engineering in ECE/Computers or similar years’ experience with ME/MTech in ECE/Computers.

  • Excellent organizational agility and interpersonal skills throughout the organization.

  • Ability to work flexible hours for better collaboration with international teams.

F5 Inc. is an equal opportunity employer and strongly supports diversity in the workplace. The Job Description is intended to be a general representation of the responsibilities and requirements of the job. However, the description may not be all-inclusive, and responsibilities and requirements are subject to change.

Read more
eStomi
Sharada Shankar
Posted by Sharada Shankar
Nipani
2 - 5 yrs
₹3L - ₹12L / yr
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJavascript
+4 more

Job Description

We are looking for a Full stack PHP Developer responsible for managing back-end services and the interchange of data between the server and the users. Your primary focus will be the development of all server-side and user-side logic, definition and maintenance of the central database, and ensuring high performance and responsiveness to requests from the front-end. You will also be responsible for integrating the front-end elements into the application. Therefore, understanding of front-end technologies is necessary as well.

  Responsibilities

  • User-facing elements developed by front-end developers
  • Build efficient, testable, and reusable PHP modules
  • Solve complex performance problems and architectural challenges
  • Integration of data storage

 

Experience: 2-5years

 

Key Skills: PHP, Angular JS, React JS, MySQL

 

Desired Skills and competencies

 

  • Understanding of MVC design patterns
  • Strong knowledge of PHP web frameworks {such as Laravel, Yii, etc depending on your technology stack}, preferably into SaaS Product development
  • Understanding the fully synchronous behavior of PHP
  • Basic understanding of front-end technologies, such as JavaScript, HTML5, and CSS3
  • Knowledge of object oriented PHP programming
  • Strong knowledge of the common PHP or web server exploits and their solutions
  • User authentication and authorization between multiple systems, servers, and environments
  • Integration of multiple data sources and databases into one system
  • Familiarity with limitations of PHP as a platform and its workarounds
  • Creating database schemas that represent and support business processes
  • Strong knowledge of SQL/NoSQL databases and their declarative query languages

Proficient understanding of code versioning tools, such as GITLab

 

Preferred Skills

 

  • Knowledge on Linux/Shell commands 
  • Demonstrates ability to communicate effectively in both technical and business environments.
  • Willingness to learn Perl, NodeJS and new technologies
  • Willingness to work in a collaborative, innovative, flexible and team-oriented environment
  • Demonstrates ability to communicate effectively in both technical and business environments.

 

 

Read more
B2B Cloud Telephony Co | REMOTE
B2B Cloud Telephony Co | REMOTE
Agency job
via Unnati by Astha Bharadwaj
Remote only
1 - 2 yrs
₹4L - ₹5L / yr
Instructional design
skill iconAdobe Illustrator
Adobe Captivate
Camtasia Studio
Adobe After Effects
+4 more
Are you looking to join a fast growing cloud telephony company where you could use your experience and leverage on the growth? Then, please read on.

Our client is a call management solutions company, which helps small to mid-sized businesses use its virtual call center to manage customer calls and queries. It is an AI and cloud-based call operating facility that is affordable as well as feature-optimized. The advanced features offered like call recording, IVR, toll-free numbers, call tracking, etc are based on automation and enhances the call handling quality and process, for each client as per their requirements. They service over 6,000 business clients including large accounts like Flipkart and Uber.
 
Currently operating in major cities, the startup is focused on increasing its reach in tier 2 and 3 cities and towns, which are largely untapped markets. They also have their operations set up across South Asia, Middle East, and Latin America. Led by a visionary founder, whose experience covers business, technology, sales, and operations, the team is built on trust, motivation, learning, and improvement.
 
As a Jr Instructional Designer, you will be responsible for assisting with training needs and helping deliver learning solutions to address performance gaps.
 
You will utilize instructional design and performance improvement processes to analyze, design, develop, implement, and evaluate instructional materials.
 
What you will do:
  • Working with key stakeholders and subject matter experts to help design and develop training interventions that incorporate best practices in behavioural and cognitive sciences to effectively address business and performance issues.
  • Assisting in designing and developing learning solutions for multiple delivery methods including instructor-led, web-based, virtual classroom, and blended instruction, Simulations & Gamified.
  • Creating engaging learning activities and compelling course content
  • Working with subject matter experts to identify the target audience’s training needs
  • Visualizing instructional graphics, the user interface, and the finished product
  • Analyzing and applying trends and best practices in learning technologies and instructional design
  • Providing exercises and activities that enhance the learning process
  • Creating supporting material/ media (audio, video, simulations, role-plays, games, etc)
  • Maintaining project documentation and course folders

 

 

What you need to have:
  • Graduate in any stream
  • Good command over the English Language
  • Creativity, Research Skills
  • People Skills, Time Management Skills
  • Flexibility
Good working knowledge & experience in the following tools:
  • Adobe Captivate
  • Adobe Photoshop
  • Adobe Illustrator
  • Powtoons
  • Addon - Camtasia, After effects, HTML 5
Read more
Yulu Bikes
at Yulu Bikes
1 video
3 recruiters
Varigonda  Kavyasree
Posted by Varigonda Kavyasree
Bengaluru (Bangalore)
1 - 3 yrs
₹13L - ₹16L / yr
skill iconSwift
skill iconObjective C
skill iconiOS App Development
Xcode
Model-View-View-Model (MVVM)
+1 more
Role Summary
Driving design and innovation in the user-facing application to manage Yulus’ fleet, you will be working on Yulu Mobile Application which will include Maps, interaction with IoT devices via Bluetooth, and various other features. You will use your expertise in application development to evaluate and select development methods, processes, standard methodologies and tools. An eye for detail, Pixel perfection
and walking the extra mile to deliver a great user experience is essential.

Key Responsibilities
● Designing and building mobile applications for Apple’s iOS platform.
● Collaborating with the design team to define app features.
● Develop test specs and approaches for the application
● Investigate and resolve performance issues, and inefficiencies
● Ensuring quality and performance of the application to specifications.
● Identifying potential problems and resolving application bottlenecks.
● Fixing application bugs before the final release.
● Understand the market and participate in product roadmap discussions

Key Requirements
● Degree from a top engineering college, or equivalent technical background is preferred
● Agility and ability to adapt quickly to changing requirements, scope and priorities
● 2-4 years of industry experience in iOS Mobile Application design and development, with minimum 2 apps deployed in App Store
● A deep familiarity with Swift. Experience working with iOS frameworks such as Maps, core Location, core Bluetooth and Core Animation
● Strong UX/UI design exposure and experience in making apps work intuitively
● Ability to identify issues and improve application performance
● Experience in the usage of instruments to detect memory leaks for performance optimization
● Develop unit and functional test cases
● Familiar with the following – Git repository, Restful API, MVC, MVP, MVVM
● Strong CS fundamentals (with competencies in algorithms and data structures)
● Experience with third-party libraries and APIs Solid understanding of the full mobile development life cycle.
● Highly accountable and takes ownership, with a collaborative attitude, and a lifelong learner
Read more
AvatarLife
at AvatarLife
1 recruiter
Gaurav Gupta
Posted by Gaurav Gupta
Gurugram
2 - 4 yrs
₹20L - ₹45L / yr
skill iconNodeJS (Node.js)
skill iconPostgreSQL
TypeScript

As the backend engineer developer, you will drive the vision of AvatarLife and make it a significant player in metaverse gaming space. You will steer the development of our games and everything that comes with it.

Skills Required

  • 2+ years experience in Node.js is required
  • Experience in game development
  • Familiarity with typescript is a plus

We are looking for individuals who can work independently and are fine with unstructured scenarios. We are flexible with the job location, working hours and compensation structure. We will match industry standard when it comes to all aspects of your professional development to make sure you can focus on making a great product.

Read more
A Leading IT Company
A Leading IT Company
Agency job
via Sanguine Global by Shreshthi Sharma
Remote only
2 - 5 yrs
₹2L - ₹4L / yr
Business Development
Lead Generation
Email Marketing
Communication Skills
Telesales
  • Professional cold calling to convert suspect lead to prospect quality lead.
  • Schedule business development meetings with prospective clients Email company profiles to prospective clients.
  • Call on leads.
  • Promote company services features with precise presentation and identify client requirements in the meeting.
  • Share email quotation and the rate bifurcation.
  • Ensuring adherence to SGB levies and Guidelines.
  • Rapport building, Convincing and negotiating, and a strong follow-up to confirm the business with the client.
  • Update new client details in the system and share them with the team. 
Read more
JS TechAlliance Consulting Pvt Ltd.
Kumar Anand
Posted by Kumar Anand
Indore
10 - 100 yrs
₹8L - ₹12L / yr
skill iconAmazon Web Services (AWS)
Chef
DevOps
skill iconGit
skill iconJenkins
+2 more
About Company - JS Tech Alliance is a global, Top leading, end-to-end IT services and solutions provider to businesses ranging from mid-sized to global fortune enterprises.We brings unique blend of enterprise, mobility and IT consulting solutions across all domains. We have been in IT business for over 7 years to develop an IT solutions . We are working harder and are committed to remain among the industry's leading employers for attracting global talent with a focus on quality , leadership and excellence . In order to achieve excellence in right sourcing . We intensify the base of highly skillful project managers /supervisors and invest in earning and retaining knowledge related to specific industry verticals and business practice of our client . We follows a 360-degree business approach. We partner with our customers to understand their business vision and align our services to optimize profitability, improve ROI and increase the efficiency. We help our customers leverage our global delivery model from product management to innovation. Job Description - Job Title: DevOps Engineer Project Location: Indore, M.P., India Salary : Open Job Purpose :- This position represents a unique opportunity to help drive the evolution of our messaging platform. As a software engineer with experience in DevOps, you would be responsible for evolving the core messaging and presence platform in a large scale distributed environment. Your responsibilities will include designing and developing new features and capabilities in the EDevOps based components with a focus on aggressive growth and scale. Skills Required for this position : AWS, Chef, Go, Ruby, Jenkins/Rundeck/Consul, Docker As follows : 1. Linux Admin 2. Cloud Computing ( Public Cloud : AWS/Rackspace, Private Cloud : Openstack/VMware ) 3. Deployment ( There are many tools I am using like: Capistrano, Webistrano, Jenkins, Custom shell scripts etc. ) 4. Monitoring ( Nagios, Cacti, Big brother, etc) 5. MySQL DBA ( Installtion, Configuration, Management, Replication Master-Master, Master-Slave, Multi-master) 6. Development ( Agile Methodology, MVC architecture, Custom Framework) 7. Webhosting (Various Control Panel and webhosting tools) Essential Duties & Responsibilities: Play a significant role in establishing operational processes Improve and champion our build and deployment process Develop (and automate where possible) standard operating procedures around common failure scenarios (e.g. scripted/automated rollback, failovers, escalation procedures, etc.) Monitor, analyze, and report performance statistics Consult on overall production system architecture Implement security best practice Identify root causes to critical problems throughout the platform and take necessary steps to resolve them Create and follow up on site incident reports with other members of the engineering team and see them through to resolution
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos