Cutshort logo
SmartHub Innovation Pvt Ltd logo
Big Data Engineer
SmartHub Innovation Pvt Ltd's logo

Big Data Engineer

Sathya Venkatesh's profile picture
Posted by Sathya Venkatesh
5 - 7 yrs
₹15L - ₹20L / yr
Bengaluru (Bangalore)
Skills
Spark
Hadoop
Big Data
Data engineering
PySpark
skill iconPostgreSQL
skill iconMongoDB
SQL

JD Code: SHI-LDE-01 

Version#: 1.0 

Date of JD Creation: 27-March-2023 

Position Title: Lead Data Engineer 

Reporting to: Technical Director 

Location: Bangalore Urban, India (on-site) 

 

SmartHub.ai (www.smarthub.ai) is a fast-growing Startup headquartered in Palo Alto, CA, and with offices in Seattle and Bangalore. We operate at the intersection of AI, IoT & Edge Computing. With strategic investments from leaders in infrastructure & data management, SmartHub.ai is redefining the Edge IoT space. Our “Software Defined Edge” products help enterprises rapidly accelerate their Edge Infrastructure Management & Intelligence. We empower enterprises to leverage their Edge environment to increase revenue, efficiency of operations, manage safety and digital risks by using Edge and AI technologies. 

 

SmartHub is an equal opportunity employer and will always be committed to nurture a workplace culture that supports, inspires and respects all individuals, encourages employees to bring their best selves to work, laugh and share. We seek builders who hail from a variety of backgrounds, perspectives and skills to join our team.  

Summary 

This role requires the candidate to translate business and product requirements to build, maintain, optimize data systems which can be relational or non-relational in nature. The candidate is expected to tune and analyse the data including from a short and long-term trend analysis and reporting, AI/ML uses cases. 

We are looking for a talented technical professional with at least 8 years of proven experience in owning, architecting, designing, operating and optimising databases that are used for large scale analytics and reports. 

Responsibilities 

  • Provide technical & architectural leadership for the next generation of product development. 
  • Innovate, Research & Evaluate new technologies and tools for a quality output. 
  • Architect, Design and Implement ensuring scalability, performance and security. 
  • Code and implement new algorithms to solve complex problems. 
  • Analyze complex data, develop, optimize and transform large data sets both structured and unstructured. 
  • Ability to deploy and administrator the database and continuously tuning for performance especially container orchestration stacks such as Kubernetes  
  • Develop analytical models and solutions Mentor Junior members technically in Architecture, Designing and robust Coding. 
  • Work in an Agile development environment while continuously evaluating and improvising engineering processes 

Required 

  • At least 8 years of experience with significant depth in designing and building scalable distributed database systems for enterprise class products, experience of working in product development companies. 
  • Should have been feature/component lead for several complex features involving large datasets. 
  • Strong background in relational and non-relational database like Postgres, MongoDB, Hadoop etl. 
  • Deep exp database optimization, tuning ertise in SQL, Time Series Databases, Apache Drill, HDFS, Spark are good to have 
  • Excellent analytical and problem-solving skill sets. 
  • Experience in  for high throughput is highly desirable 
  • Exposure to database provisioning in Kubernetes/non-Kubernetes environments, configuration and tuning in a highly available mode. 
  • Demonstrated ability to provide technical leadership and mentoring to the team 


Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About SmartHub Innovation Pvt Ltd

Founded :
2020
Type :
Product
Size :
0-20
Stage :
Raised funding

About

SmartHub.ai is a fast-growing company headquartered in Bay Area, CA, with offices in Seattle and Bangalore. As an award-winning Edge Automation SaaS company, SmartHub.ai is revolutionizing Enterprise Edge Infrastructure Management & Edge Intelligence Space. Our AI-powered software solutions simplify the complexity of EDGE / IoT infrastructure lifecycle management by eliminating silos, enhancing operational efficiencies through automation, and delivering real-time visibility, performance, and intelligence insights. Trusted by the major Fortune 500 companies across various sectors, our solutions benefit both Information Technology (IT) and Operational Technology (OT) organizations. By securing and utilizing valuable edge data, our customers can achieve significant outcomes such as predictive analytics and preventative maintenance, resulting in zero downtime, continuous compliance, and effective risk management.
Read more

Company social profiles

linkedin

Similar jobs

Semi-Conductor Industry
Semi-Conductor Industry
Agency job
via Peak Hire Solutions by Dharati Thakkar
Hyderabad, Bengaluru (Bangalore)
10 - 12 yrs
₹30L - ₹35L / yr
skill iconPython
Perl
EDA
Test Automation (QA)
Supply Chain Management (SCM)
+90 more

MANDATORY CRITERIA:

  • Education: B.Tech / M.Tech in ECE / CSE / IT
  • Experience: 10–12 years in hardware board design, system hardware engineering, and full product deployment cycles
  • Proven expertise in digital, analog, and power electronic circuit analysis & design
  • Strong hands-on experience designing boards with SoCs, FPGAs, CPLDs, and MPSoC architectures
  • Deep understanding of signal integrity, EMI/EMC, and high-speed design considerations
  • Must have successfully completed at least two hardware product development cycles from high-level design to final deployment
  • Ability to independently handle schematic design, design analysis (DC drop, SI), and cross-team design reviews
  • Experience in sourcing & procurement of electronic components, PCBs, and mechanical parts for embedded/IoT/industrial hardware
  • Strong experience in board bring-up, debugging, issue investigation, and cross-functional triage with firmware/software teams
  • Expertise in hardware validation, test planning, test execution, equipment selection, debugging, and report preparation
  • Proficiency in Cadence Allegro or Altium EDA tools (mandatory)
  • Experience coordinating with layout, mechanical, SI, EMC, manufacturing, and supply chain teams
  • Strong understanding of manufacturing services, production pricing models, supply chain, and logistics for electronics/electromechanical components


DESCRIPTION:

COMPANY OVERVIEW:

The company is a semiconductor and embedded system design company with a focus on Embedded, Turnkey ASICs, Mixed Signal IP, Semiconductor & Product Engineering and IoT solutions catering to Aerospace & Defence, Consumer Electronics, Automotive, Medical and Networking & Telecommunications.


REQUIRED SKILLS:

  • Extensive experience in hardware board designs and towards multiple product field deployment cycles.
  • Strong foundation and expertise in analyzing digital, Analog and power electronic circuits.
  • Proficient with SoC, FPGAs, CPLD and MPSOC architecture-based board designs.
  • Knowledgeable in signal integrity, EMI/EMC concepts for digital and power electronics.
  • Completed at least two project from high-level design to final product level deployment.
  • Capable of independently managing product’s schematic, design analysis DC Drop, Signal Integrity, and coordinating reviews with peer of layout, mechanical, SI, and EMC teams.
  • Sourcing and procurement of electronic components, PCBs, and mechanical parts for cutting-edge IoT, embedded, and industrial product development.
  • Experienced in board bring-up, issue investigation, and triage in collaboration with firmware and software teams.
  • Skilled in preparing hardware design documentation, validation test planning, identifying necessary test equipment, test development, execution, debugging, and report preparation.
  • Effective communication and interpersonal skills for collaborative work with cross-functional teams, including post-silicon bench validation, BIOS, and driver development/QA.
  • Hands-on experience with Cadence Allegro/Altium EDA tools is essential.
  • Familiarity with programming and scripting languages like Python and Perl, and experience in test automation is advantageous.
  • Should have excellent exposure with coordination of Manufacturing Services, pricing model for production value supply chain & Logistics in electronics and electromechanical components domain.
Read more
Wissen Technology
Pune
4 - 15 yrs
₹10L - ₹30L / yr
skill iconC++
low latency
Network protocols
FIX

C++ engineer - Responsible for writing market data feed handlers for various derivatives exchange. Worked on Exchange Protocols (FIX, SBE, OMNet, ITCH), Network Protcols, low latency programming.


Experience: 4+ years (full time experience)


Location: Pune (hybrid)

Read more
Leading providers of Voice Recording. ( TR1)
Leading providers of Voice Recording. ( TR1)
Agency job
via Multi Recruit by Chandra Kanth
Bengaluru (Bangalore)
3 - 10 yrs
₹20L - ₹25L / yr
skill iconJava
Microservices
J2EE
Spring
  • Strong experience in Java programming.
  • Must have experience on MicroServices using Spring boots /Jersy /Swagger / any other Microservices technology stack
  • Good experience in either Spring or Hibernate
  • Must have at least 1to 2 years’ experience in Web application
  • Knowledge of OOP concepts, industry best practices, and design
  • Good understanding of web technology/enterprise-level applications
  • Good to have experience in JavaScript frameworks
  • Good to have experience in Agile Methodology
BEHAVIORAL SKILLS
  • Self-motivated and a Quick Learner
  • Creative ideas with a problem-solving mindset.
  • Ability to consistently perform and meet deadlines
  • Attention to detail and follow-through
  • A good understanding of customer satisfaction
  • Ability to work effectively in a team as well as in an individual environment
  • Excellent written and verbal communication skills
Read more
YRAL
YRAL
Agency job
via TIGI HR Solution Pvt. Ltd. by Vaidehi Sarkar
Remote only
3 - 7 yrs
₹14L - ₹15L / yr
skill iconRust
Test driven development (TDD)
WebAssembly
CI/CD
skill iconGitHub

Experience Required: 3 - 7 years

Working Days: 5 days/week


Role & Responsibilities

  • You will be working with the Rust compiler and will be responsible for compiling to alternate targets such as WebAssembly
  • You will be exposed with TDD for unit testing individual functions and integration testing for testing publicly exposed APIs
  • Working with a Git style workflow where every commit deploys to a stagingenvironment and merged pull requests deploy to production
  • Setting up CI/CD pipelines for testing and deployment (canary, staging) using Github actionsaccording to project needs
  • Developing software in Rust
  • Maintaining and improving existing rust codebases.


Ideal Candidate

  • Excited about working with Rust
  • 4 -7 years of experience in shipping production applications
  • B.Tech in Computer Science Engineering from Tier 1 Colleges only


Read more
VAYUZ Technologies
at VAYUZ Technologies
1 video
4 recruiters
Pooja Chauhan
Posted by Pooja Chauhan
Remote, Ahmedabad, Pune
8 - 10 yrs
₹8L - ₹11L / yr
skill iconPython
pytest
Automation
Agile/Scrum
Embedded software
+7 more

Our Requirement

  • Hands on experience in developing test codes using Python and Pytest frameworks for a minimum of 3 years
  • Experience in writing test cases for embedded software for a minimum of 1 years
  • Experience with Agile Software Workflows such as Scrum
  • Experience with Git, Jira and Confluence
  • Should be an expert in Python
  • Hand on experience with OOPS
  • Strong communication skills
  • Hands-on experience in API testing & developing automation test script for mobile or tablet devices using Appium
  • Ability to identify new testing techniques and tools
  • Excellent problem-solving skills
  • Excellent team player and exhibit a positive attitude
  • Strong collaboration, oral and written skills

Preferred Skills:

  • Strong understanding of Bluethooth, BLE, understanding of WiFi (802.11a/b/g/n)
  • Ability to propose new ideas on how to improve customer satisfaction and quality of product
  • Ability to carefully examine requirements and specifications to anticipate quality issues and provide timely feedback when specifications are incomplete or inaccurate
  • Experience testing Firmware is plus
  • Develop and implement unit and integration test cases and scripts for embedded firmware

Other Important Criteria's 
  • Required Educational Qualifications: Minimum B.E/B.Tech with 60% in academics.
  • Min. Experience Required: 8 years.
  • Should be able to join immediately or within 15 days
Read more
Vithamas Technologies Pvt LTD
at Vithamas Technologies Pvt LTD
2 candid answers
moshin ayaz
Posted by moshin ayaz
Mysore
2 - 4 yrs
₹6L - ₹15L / yr
Software Testing (QA)
Test Automation (QA)
Appium
Selenium
Microsoft TFS
+5 more

Must have Experience of UI testing using Automation tools like Selenium for Web and , Appium for Mobile application. • Must have clear understanding about Selenium/Appium Architecture, Page Object Model, Page Factory designs, Singleton and Builder Design Pattern • Good Experience of using locators (CSS/Xpath), Action Interface, JavaScript Executor • Have good exposure in validating API’s using any tool such as Postman/SoapUI • Basic understanding of API testing using Rest Assured. • Basic understanding of BDD concept with Cucumber as Tool • Experience with TFS/ GitHub • Must have Knowledge of TestNG/Junit . • Must have Programming languages knowledge: Java with strong knowledge of OOPS concept,Exception Handling, Reflection, Serialization and Collection Framework • Must have worked with following technologies Extent Report, Apache POI, Log4J, JSON • Experience of working with any of the databases (e.g.: MSSQL, PostgreSQL, Mongo Db etc.) • Knowledge of Maven, Jenkins and Docker or equivalent CI/CD • Must have good Manual testing experience of STLC, creating test scenarios, test cases with different test design techniques, Logging defects • Strong team player, flexible and should be able to shape up with different teams. • Demonstrated ability to focus and complete multi tasks on time. • Above average communication and should be able to explain architecture of current project. • Working experience in testing the AUT developed/delivered with Agile project framework. • Hands on experience on at least one Test Management or Defect Management tool for example ALM, JIRA, or any Microsoft tool etc. If this role sounds exciting to you and fulfil your future goals, then we would love to hear from you.

Read more
shaadi.com
shaadi.com
Agency job
via Qrata by Revathi Satish
Mumbai
3 - 7 yrs
₹9L - ₹18L / yr
skill iconNodeJS (Node.js)
skill iconJavascript
skill iconExpress
Responsibilities:-

Review requirements, design specifications and propose solution and have discussion before implementation

Work with team leads on the requirements and create estimates against those requirements

Deliver projects on time in an agile and continuous development environment

Writing tests in a client-side test framework such as Jest, Jasmine, Mocha, etc.

Work withQA team for resolving issues

Report status with tools like JIRA to stakeholders


Requirements:
  • 3-5 years of work experience developing complex software
  • Minimum 2years sound experience with back-end development in Java-script frameworks like loopback, Express, etc
  • A solid understanding of core Javascript principles and its fundamentals
  • Familiarity with popular Javascript tools, frameworks and design principles, and enjoy staying up to date with the changing Javascript ecosystem
  • Strong communication skills across the board, with a passion for finding and sharing best practices and driving.

 

Skills:
  • Javascript • Node • Express • Loopback • OAuth • API Development
  • Plus Points • Knowledge of Go, Ruby, Python, Closure or any other languages • Test Driven Development (TDD) • Knowledge of front-end development
Read more
Magicflare Software Services LLP
Akshata bhosle
Posted by Akshata bhosle
Pune
4 - 7 yrs
₹5L - ₹18L / yr
skill iconNodeJS (Node.js)
skill iconReact.js
skill iconJavascript
skill iconHTML/CSS
User Interface (UI) Design
Looking for UI Developer who have hands on experience on Nodejs and React Node.
Experience: 4 to 6 years prefreable. 
Read more
Pangolin Marketing
at Pangolin Marketing
2 recruiters
Debarshi Chowdhury
Posted by Debarshi Chowdhury
Remote, Pune, Indore, Kolkata, Lucknow, Hyderabad, Pondicherry, Goa, Shillong, Guwahati, Ranchi, Kochi (Cochin), Bengaluru (Bangalore), Chennai, Nagpur, Raipur
2 - 8 yrs
₹2.4L - ₹7L / yr
Social Media Marketing (SMM)
Community Management
Viral Marketing
Content Writing
Web Analytics
+7 more

About:

Pangolin is a brand consultancy and creative agency. We help companies create positive change in the world by raising awareness through branding and inspiring through storytelling. We’re growing our team of creatives and strategists. Join us if you’re craving work that makes a real difference in the world, and a work culture that allows you to have a balanced life. 


Role:

B2B Social Media Expert


Description:

Are you intimately familiar with the LinkedIn algorithm? Do you specialize in growing brand following on Twitter? Are you proficient in defining and executing social media strategies for Quora, Reddit, Instagram, and Facebook?  We’re looking for an expert with a solid understanding of how each social media channel works and how to optimize content so that it is engaging. As the B2B Digital Marketing Specialist, you will also be responsible for organizing and producing content that follows our clients’ brand guidelines.


Competencies:

  • Consistent and self-driven to learn about social media platforms and trends. 
  • Strong creative storytelling skills with a focus on visual and content aesthetics.

Skills:

  • Working knowledge of SMM tools like Hootsuite, Moz, Loomly, etc.
  • Working knowledge of design applications like Adobe Suite, Canva, etc., and other video editing tools.
  • Adept at digital tools like Facebook Insights, Twitter Analytics, Google Analytics/Google Ad Manager.
  • Adept at communicating in a professional, but unique social media “voice” for each client; directly aligned with the clients’ thought leadership and content platform.

Experience:

  • Demonstrable B2B social networking experience and social analytics tools.
  • Experience in managing multiple digital marketing campaigns with the ability to analyze and make recommendations on performance.
  • Strong understanding of social media KPIs, keyword optimization tools, and social media algorithms.

Location and Type: 

Remote, Full-time


Evaluation:

Portfolios will be checked for expertise in the B2B domain. Please share only case studies of growth where the strategy and execution were owned end-to-end by you. Shortlisting will be followed by a video interview.

Read more
Freightsy Innovations
at Freightsy Innovations
1 recruiter
Hanish Agarwal
Posted by Hanish Agarwal
Mumbai
3 - 7 yrs
₹6L - ₹12L / yr
Sales
Business Development
Lead Generation
Lead Prospecting
Presales
+1 more
We are looking for some amazing people who can sell. Freightsy is a B2B platform for optimizing global supply chains.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos