Cutshort logo
SmartHub Innovation Pvt Ltd logo
Big Data Engineer
SmartHub Innovation Pvt Ltd's logo

Big Data Engineer

Sathya Venkatesh's profile picture
Posted by Sathya Venkatesh
5 - 7 yrs
₹15L - ₹20L / yr
Bengaluru (Bangalore)
Skills
Spark
Hadoop
Big Data
Data engineering
PySpark
skill iconPostgreSQL
skill iconMongoDB
SQL

JD Code: SHI-LDE-01 

Version#: 1.0 

Date of JD Creation: 27-March-2023 

Position Title: Lead Data Engineer 

Reporting to: Technical Director 

Location: Bangalore Urban, India (on-site) 

 

SmartHub.ai (www.smarthub.ai) is a fast-growing Startup headquartered in Palo Alto, CA, and with offices in Seattle and Bangalore. We operate at the intersection of AI, IoT & Edge Computing. With strategic investments from leaders in infrastructure & data management, SmartHub.ai is redefining the Edge IoT space. Our “Software Defined Edge” products help enterprises rapidly accelerate their Edge Infrastructure Management & Intelligence. We empower enterprises to leverage their Edge environment to increase revenue, efficiency of operations, manage safety and digital risks by using Edge and AI technologies. 

 

SmartHub is an equal opportunity employer and will always be committed to nurture a workplace culture that supports, inspires and respects all individuals, encourages employees to bring their best selves to work, laugh and share. We seek builders who hail from a variety of backgrounds, perspectives and skills to join our team.  

Summary 

This role requires the candidate to translate business and product requirements to build, maintain, optimize data systems which can be relational or non-relational in nature. The candidate is expected to tune and analyse the data including from a short and long-term trend analysis and reporting, AI/ML uses cases. 

We are looking for a talented technical professional with at least 8 years of proven experience in owning, architecting, designing, operating and optimising databases that are used for large scale analytics and reports. 

Responsibilities 

  • Provide technical & architectural leadership for the next generation of product development. 
  • Innovate, Research & Evaluate new technologies and tools for a quality output. 
  • Architect, Design and Implement ensuring scalability, performance and security. 
  • Code and implement new algorithms to solve complex problems. 
  • Analyze complex data, develop, optimize and transform large data sets both structured and unstructured. 
  • Ability to deploy and administrator the database and continuously tuning for performance especially container orchestration stacks such as Kubernetes  
  • Develop analytical models and solutions Mentor Junior members technically in Architecture, Designing and robust Coding. 
  • Work in an Agile development environment while continuously evaluating and improvising engineering processes 

Required 

  • At least 8 years of experience with significant depth in designing and building scalable distributed database systems for enterprise class products, experience of working in product development companies. 
  • Should have been feature/component lead for several complex features involving large datasets. 
  • Strong background in relational and non-relational database like Postgres, MongoDB, Hadoop etl. 
  • Deep exp database optimization, tuning ertise in SQL, Time Series Databases, Apache Drill, HDFS, Spark are good to have 
  • Excellent analytical and problem-solving skill sets. 
  • Experience in  for high throughput is highly desirable 
  • Exposure to database provisioning in Kubernetes/non-Kubernetes environments, configuration and tuning in a highly available mode. 
  • Demonstrated ability to provide technical leadership and mentoring to the team 


Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About SmartHub Innovation Pvt Ltd

Founded :
2020
Type :
Product
Size :
0-20
Stage :
Raised funding

About

SmartHub.ai is a fast-growing company headquartered in Bay Area, CA, with offices in Seattle and Bangalore. As an award-winning Edge Automation SaaS company, SmartHub.ai is revolutionizing Enterprise Edge Infrastructure Management & Edge Intelligence Space. Our AI-powered software solutions simplify the complexity of EDGE / IoT infrastructure lifecycle management by eliminating silos, enhancing operational efficiencies through automation, and delivering real-time visibility, performance, and intelligence insights. Trusted by the major Fortune 500 companies across various sectors, our solutions benefit both Information Technology (IT) and Operational Technology (OT) organizations. By securing and utilizing valuable edge data, our customers can achieve significant outcomes such as predictive analytics and preventative maintenance, resulting in zero downtime, continuous compliance, and effective risk management.
Read more

Company social profiles

linkedin

Similar jobs

Eureka Outsourcing Solution Private limited
Eureka Outsourcing Solution Private limited
Agency job
Koremangala bangalore
1 - 1.5 yrs
₹3L - ₹3.2L / yr
Management Information System (MIS)
Business Process Outsourcing (BPO)

Prepare and maintain daily, weekly, and monthly MIS reports

Data analysis, tracking performance metrics & dashboards

Strong working knowledge of MS Excel (VLOOKUP, Pivot, formulas)

Coordinate with operations and management for data accuracy

Ensure timely and accurate reporting

Read more
Chennai, Delhi
5 - 7 yrs
₹11L - ₹15L / yr
B2B sales
ERP sales

Strong B2B Tech Sales profiles

Mandatory (Experience 1): Must have a minimum 5+ YOE in B2B SaaS / Enterprise Tech sales, preferably in ERP, CAD, or Factory Automation tools.

Mandatory (Experience 2): At least 3+ YOE selling ERP solutions or CAD Softwares.

Mandatory (Experience 3): Proven track record in offline / field sales and experience in selling complex solutions.

Mandatory (Tools): Proficient in CRM systems (HubSpot, Zoho, Salesforce, etc.) and lead generation tools (LinkedIn Sales Navigator, Apollo, ZoomInfo, etc.)

Mandatory (Company): Experience in B2B SaaS Product companies or IT/Tech Services companies.

Mandatory (Note 1) - Total experience should not be more than 7 Years.

Mandatory (Note 2) - Overall Expected CTC should not be more than 15L

Read more
Healthcare startup - develops a cloud-native platform.
Healthcare startup - develops a cloud-native platform.
Agency job
via Qrata by Blessy Fernandes
Bengaluru (Bangalore)
1 - 12 yrs
₹15L - ₹60L / yr
skill iconReact.js
skill iconRedux/Flux
TypeScript
About the Job:
We are looking for a Frontend Developer who would be working on the bleeding edge of technologies.We work primarily with React, Typescript and Redux.

Responsibilities:
• Understand why a particular design was chosen and code accordingly
• Will have to deliver clean bug free unit tested code with minimal guidance
• Strive for continuous improvement by refactoring and applying best practices
• Learn and adapt to new technologies as necessary.

Requirements:
• Must be proficient in React, Redux, Redux Toolkit and Typescript
• Used Typescript for React Components
• Unit Testing, Component Testing, and Custom React hook tests with React Testing Library
• Integration Tests with Cypress
• Data Fetching libraries like Axios, React Query, RTK Query etc.
• Should have maintained React Components with Storybook.
• Experience contributing to open-source software will be preferred
• Used various CSS stylings methods like CSS Modules, LESS, SCSS, Tailwind, Styled Components, Emotion etc.
• Should understand Git
• Ability to work in a fast-paced and dynamic work environment
Read more
Motherson
Motherson
Agency job
via Aavyan Consulting by Jayatri Paul
Pune, Hyderabad, Coimbatore, Bengaluru (Bangalore)
5.5 - 9 yrs
₹20L - ₹22L / yr
SAP EWM
Supply Chain Management (SCM)

Key Requirements:

At least 2 end-to-end SAP EWM implementations

Strong experience in SAP EWM 9.5 and S/4HANA Embedded EWM Proficiency in EWM-ERP integration, IDOCs, CIF, RFC

Good grasp of Inbound, Outbound, Warehousing, Packaging processes Prior work in the Auto/Manufacturing industry (minimum 2 years)


Preferred:

SAP EWM certification Experience with SAP TM, Value-Added Services (VAS), and automated warehouses

Read more
Fintech-building payment solutions
Fintech-building payment solutions
Agency job
via Qrata by Rayal Rajan
Bengaluru (Bangalore)
3 - 8 yrs
₹15L - ₹40L / yr
Test Automation (QA)
Manual testing
Software Testing (QA)
Selenium
About
It is a mission-oriented high-growth fintech startup building payment &
lending products to simplify education payments. Jodo’s suite of products make education payments convenient & affordable for parents while simplifying & streamlining fee collections for educational institutes. We aim to be a category-defining company with a mission to be a
trusted partner to parents in fulfilling their aspirations for their kids’ education.

We are backed by marquee VC investors – Elevation Capital and Matrix Partners – to realize this mission. Jodo is started by three co-founders who have a pedigreed education (IIT/IIM) and professional background (Nomura, Goldman Sachs, Morgan Stanley, Barclays, Matrix Partners)

Job Description:
We are looking for a QA Lead who will be owning the overall quality and reliability of our products. As a leader, you will mentor and build a team of QA engineers, acquiring in-depth knowledge of our products, establishing best practices/processes, and value automation over manual testing. If you enjoy building impactful products from scratch and influencing product direction, the role is for you.

Key Responsibilities
● Own overall quality of our products
● Automate all aspects of QA
● Develop test plans, test cases, test scripts and test reports on multiple products
● Establish and maintain QA processes, champion continuous testing/automation
● Mentor a team of QA engineers
● Troubleshoot production defects and performance issues
● Work closely with the Product and Development teams to build world-class products

📃Requirements
● 6+ years of proven experience in software testing
● 4+ years of experience in Test automation, should be able to the device and implement an automation strategy
● Good Understanding of Testing frameworks and agile methodologies
● Experience in Selenium with Java / Python or equivalent frameworks, REST API Test automation
● Knowledge of Performance / Load testing
● Detail-oriented, Excellent Analytical and Problem-solving skills
● Self-starter and ability to take the ownership
● Prior experience working in a startup environment is great to have

Benefits
● Becoming a part of the early core team
● Competitive salary
● Work with colleagues from strong backgrounds & hungry to succeed
● Opportunity to interact with and learn from high-pedigree investors & mentors -
○ VCs: Elevation Capital (erstwhile SAIF Partners), Matrix Partners
○ Select angel investors: Kunal Shah, Nithin Kamath, Amit Ranjan

What are we looking for?
● Self-starter with a high sense of ownership → Comfortable to work with minimal supervision
● Hungry to learn and grow → Passion to learn & be a better version of oneself; motivated to succeed
● Bias for action → Have the temperament to experiment and execute in uncertainty
● Hustler → Ability to generate resources to solve a problem
● Intellectual honesty → Always seeking and presenting truth irrespective of personal POV or beliefs
● Mission-oriented → Deeply care about delivering value and making an impact on customer's lives.
Read more
Quotient
Quotient
Agency job
via Hiringhut Solutions Pvt Ltd by Abhishek chetty
Bengaluru (Bangalore)
7 - 8 yrs
₹10L - ₹12L / yr
skill iconPython
Snowflake
SQL
DDL
DML
+1 more

Job Description

Title - Lead Snowflake Developer

Location - Chennai/Hyderabad/Bangalore

Role - Fulltime

Notice Period/Availability - Immediate

Years of Experience - 6+

 

Job Description:

  • Overall 6 years of experience in IT/Software development
  • Minimum 3 years of experience working with Snowflake.
  • Designing, implementing and testing cloud computing solutions using Snowflake technology.
  • Creating, monitoring and optimization of ETL/ELT processes.
  • Migrating solutions from on-premises to public cloud platforms.
  • Experience in SQL language and data warehousing concepts.
  • Experience in Cloud technologies: AWS, Azure or GCP.


Read more
GreenBill
at GreenBill
1 recruiter
Shubham Lohade
Posted by Shubham Lohade
Mumbai, Nagpur, Nashik, Pune
0 - 2 yrs
₹2L - ₹4L / yr
Field Sales
Sales
Business Development
The candidate for this position will excel at creating and closing new opportunities. By using a consultative approach to selling, this person will use their expertise to identify and qualify leads, leading to sales opportunities with both new and existing customers.

Responsibilities
Meet and exceed sales targets
Successfully create business from new and existing customer accounts
Manage complex negotiations with senior-level executives
Build rapport and establish long term relationships with customers
Field sales

Qualifications
0-2 years' quota carrying sales experience
Experience and working knowledge of CRM systems
Demonstrable track record of over-achieving quota
Strong written and verbal communication skills
Read more
SarvaGram
at SarvaGram
1 recruiter
Suraj Mundada
Posted by Suraj Mundada
Pune
1 - 6 yrs
₹6L - ₹30L / yr
skill iconSpring Boot
Spring MVC
Spring
skill iconJava
J2EE
+2 more
Responsibilities -
1. Be hands-on and ship good quality code Fast
2. Understand business and product requirements and brainstorm the technology solutions
3. Take responsibility for the individual modules development, maintenance, deployment
4. Understand existing code, maintain and improve it.

Qualifications -
1. 1+ years of Hands on experience in Core Java,Spring Boot, Spring MVC, Hibernate, Play etc
2. Hands on experience in SQL and NoSQL databases like Postgres, MongoDB, ElasticSearch, Redis
3. Knowledge of software development models like RAD and Agile
4. Quick Learner
Read more
This IT company is looking for this profile
This IT company is looking for this profile
Agency job
via IT company by Damini Rautela
Hyderabad
8 - 15 yrs
₹8L - ₹14L / yr
skill iconPython
skill iconJavascript
Web API
skill iconDjango
skill iconXML
+12 more
NOTE- we are looking for those who can join immediatley or within 15-20 days of NP.
key requirements-


• 8+ years professional experience in commercial or web-scale system software development and delivery Strong analytical skills
• 5+ years Experience in building micro services, WebAPIs using Python, Django, Angular, JavaScript, Node.js, XML, PHP, PostgreSQL
• 2+ year hands-on Azure experience.
• Experience in handling messages through distributed system (SOA Architecture)
• Date store - MySQL, PostgreSQL, Redis etc
• In-depth hands on technology experience in the following areas:
- Strong in Object Oriented Programming concepts
- Experience in developing software using PHP, Python, Django, CI/CD pipeline
- Experience in Test driven development using NUnit, mocking framework
- Database - ORM and PostgreSQL, Redis
- Mobile application development and architecture aware
- Client/server - Networking, multithreading
- Deployment - Docker, Kubernetes
- Understanding of Cloud concepts, cloud deployments
- In depth understanding of IIS, security, Web API
- Working knowledge of Azure
- Exposure to Agile Scrum way of working, pair programming
- REST, JSON, JSON Schema
- Client / server, networking,
- Internet services, Windows Services, Security
- Any unit test framework (Nunit, MSTest), Mocking Framework (Moq, RhinoMock), TDD, Git , Jira
• 5+ years experience in Architecting solutions in software industry
• Experience architecting large scale web applications/products is a MUST
• Experience with technologies like PHP, Angular, MySQL, Node.js, Python, Django, PostgreSQL & other new- edge technologies
• Experience with architecting, developing, and deploying on Azure Cloud platform is a must
• SaaS experience preferred in-depth working experience
• Must have experience in scalability, reliability, performance optimization, developing and deploying API based applications.
• In depth knowledge in DB Schema Design, Data Structures and trade- offs involved in writing queries

• Vast experience in integrating with external APIs and SDKs

Education

Bachelor or Masters Education in electronics, computer, software engineering or other relevant discipline.
Read more
Moonraft Innovation Labs
at Moonraft Innovation Labs
35 recruiters
Sreesha Thoprath
Posted by Sreesha Thoprath
Bengaluru (Bangalore), Pune
5 - 8 yrs
₹10L - ₹15L / yr
skill iconReact Native
skill iconJavascript
Mobile App Development
Brief Summary:

We are looking for talented front-end developers who can help us in enabling our customers deliver excellent experiences to end users. As a customer experience management firm , we are constantly enhancing user experiences in several of our customers' online platforms. The role of a front-end developer in our teams is crucial in realizing our design solutions without any loss in translation. We are looking for developers who can contribute in building the best in class digital experiences through the right use of frameworks , technologies and code.

Key Skills:

3+ years of professional Mobile Development experience Core strength with React or React Native Experience with Typescript, Redux, Node.JS is desired Proficiency with Native iOS or Android App Development (both would be a major plus) Knowledge of App deployment processes through Apple App Store or Google Play Store A working understanding and experience of Test-Driven Development and CI/CD best practices Ability to use a wide variety of open-source technologies and cloud services (experience with AWS is a plus)

About Moonraft Innovation Labs
We are here to advance human experience through design-driven innovation. Design, to us, is all
about creating new meanings, while art is about self expression and emotive appeal. Bringing these
two creative disciplines together and operating at their intersection with business and technology, we
drive business innovations with differentiating customer experience.
We place the human at the center, bringing quantitative and qualitative techniques together to
develop consumer insights. Our techno-creative team, bridging consumer insights, business
understanding and advanced technology skills, then builds humanistic technology solutions.
We believe experimentation is at the core of every innovation. Radical innovation, in our view, is
just an event recognized in hindsight when a number of trial-and-error attempts spark off a
breakthrough. Our approach embraces rapid prototyping and empirical evidence in everything we
do. As the name says, we are Moonraft Innovation Labs, driving innovation through
experimentation.
"Rafters", who inhabit Moonraft, recognize only idea as the boss. They live by imagination,
simplicity and speed. Our egalitarian culture and environment are designed for rafters to thrive and
deliver elegant solutions for complex problems.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos