Cutshort logo
SmartHub Innovation Pvt Ltd logo
Big Data Engineer
SmartHub Innovation Pvt Ltd's logo

Big Data Engineer

Sathya Venkatesh's profile picture
Posted by Sathya Venkatesh
5 - 7 yrs
₹15L - ₹20L / yr
Bengaluru (Bangalore)
Skills
Spark
Hadoop
Big Data
Data engineering
PySpark
skill iconPostgreSQL
skill iconMongoDB
SQL

JD Code: SHI-LDE-01 

Version#: 1.0 

Date of JD Creation: 27-March-2023 

Position Title: Lead Data Engineer 

Reporting to: Technical Director 

Location: Bangalore Urban, India (on-site) 

 

SmartHub.ai (www.smarthub.ai) is a fast-growing Startup headquartered in Palo Alto, CA, and with offices in Seattle and Bangalore. We operate at the intersection of AI, IoT & Edge Computing. With strategic investments from leaders in infrastructure & data management, SmartHub.ai is redefining the Edge IoT space. Our “Software Defined Edge” products help enterprises rapidly accelerate their Edge Infrastructure Management & Intelligence. We empower enterprises to leverage their Edge environment to increase revenue, efficiency of operations, manage safety and digital risks by using Edge and AI technologies. 

 

SmartHub is an equal opportunity employer and will always be committed to nurture a workplace culture that supports, inspires and respects all individuals, encourages employees to bring their best selves to work, laugh and share. We seek builders who hail from a variety of backgrounds, perspectives and skills to join our team.  

Summary 

This role requires the candidate to translate business and product requirements to build, maintain, optimize data systems which can be relational or non-relational in nature. The candidate is expected to tune and analyse the data including from a short and long-term trend analysis and reporting, AI/ML uses cases. 

We are looking for a talented technical professional with at least 8 years of proven experience in owning, architecting, designing, operating and optimising databases that are used for large scale analytics and reports. 

Responsibilities 

  • Provide technical & architectural leadership for the next generation of product development. 
  • Innovate, Research & Evaluate new technologies and tools for a quality output. 
  • Architect, Design and Implement ensuring scalability, performance and security. 
  • Code and implement new algorithms to solve complex problems. 
  • Analyze complex data, develop, optimize and transform large data sets both structured and unstructured. 
  • Ability to deploy and administrator the database and continuously tuning for performance especially container orchestration stacks such as Kubernetes  
  • Develop analytical models and solutions Mentor Junior members technically in Architecture, Designing and robust Coding. 
  • Work in an Agile development environment while continuously evaluating and improvising engineering processes 

Required 

  • At least 8 years of experience with significant depth in designing and building scalable distributed database systems for enterprise class products, experience of working in product development companies. 
  • Should have been feature/component lead for several complex features involving large datasets. 
  • Strong background in relational and non-relational database like Postgres, MongoDB, Hadoop etl. 
  • Deep exp database optimization, tuning ertise in SQL, Time Series Databases, Apache Drill, HDFS, Spark are good to have 
  • Excellent analytical and problem-solving skill sets. 
  • Experience in  for high throughput is highly desirable 
  • Exposure to database provisioning in Kubernetes/non-Kubernetes environments, configuration and tuning in a highly available mode. 
  • Demonstrated ability to provide technical leadership and mentoring to the team 


Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About SmartHub Innovation Pvt Ltd

Founded :
2020
Type :
Product
Size :
0-20
Stage :
Raised funding

About

SmartHub.ai is a fast-growing company headquartered in Bay Area, CA, with offices in Seattle and Bangalore. As an award-winning Edge Automation SaaS company, SmartHub.ai is revolutionizing Enterprise Edge Infrastructure Management & Edge Intelligence Space. Our AI-powered software solutions simplify the complexity of EDGE / IoT infrastructure lifecycle management by eliminating silos, enhancing operational efficiencies through automation, and delivering real-time visibility, performance, and intelligence insights. Trusted by the major Fortune 500 companies across various sectors, our solutions benefit both Information Technology (IT) and Operational Technology (OT) organizations. By securing and utilizing valuable edge data, our customers can achieve significant outcomes such as predictive analytics and preventative maintenance, resulting in zero downtime, continuous compliance, and effective risk management.
Read more

Company social profiles

linkedin

Similar jobs

Wissen Technology
at Wissen Technology
4 recruiters
Shakthi M
Posted by Shakthi M
Bengaluru (Bangalore)
3 - 14 yrs
Best in industry
skill iconPython
Azure
DevOps
Agentic AI
Terraform
+2 more
  • Strong hands-on experience in Microsoft Azure Cloud.
  • Good understanding of Azure services such as Compute, Storage, Event Hub, Event Subscription, Storage Queue, and PaaS services.
  • Basic understanding of Azure AI Foundry and AI-related Azure service setup.
  • Good Azure networking basics: VNet, subnet, routing, and basic troubleshooting.
  • Strong knowledge of Terraform, especially:
  • Terraform state
  • plan / apply
  • troubleshooting failures
  • migration risks
  • Terraform Enterprise concepts
  • Strong Python coding capability, not just basic scripting.
  • Experience using Python for API integration, automation, JSON/YAML handling, and internal tooling.
  • Good understanding of CI/CD pipelines.
  • Ability to troubleshoot pipeline failures.
  • Comfortable with YAML and JSON.
  • Ability to troubleshoot Azure infrastructure/platform issues.
  • Ability to collect logs/evidence and coordinate with network/app/Microsoft support teams.
  • Basic awareness of agentic AI / LLM concepts.
  • Awareness of security and cost best practices.

Good to Have Skills

  • Hands-on experience with Harness.
  • Hands-on experience with Terraform Enterprise.
  • Exposure to LangGraph / LangChain.
  • Exposure to agentic AI workflows or skill creation.
  • Exposure to Claude or enterprise LLM integrations.
  • Knowledge of Azure ML Workspace, model registry, and managed endpoints.
  • MLOps / LLMOps knowledge.
  • FinOps / Azure cost optimization experience.
  • Azure certifications: AZ-104, AZ-305, AZ-400, AZ-500.

 

Screening Priority:

Azure Cloud + Terraform + Python Coding + CI/CD Troubleshooting + YAML/JSON + Basic Agentic AI Awareness

 

Read more
codersbrain
at codersbrain
1 recruiter
Tanuj Uppal
Posted by Tanuj Uppal
Pune
8 - 16 yrs
₹5L - ₹30L / yr
SAP
Troubleshooting
SME
  • A job description for an SAP subject matter expert (SME) may include the following skills and responsibilities:
  • Analytical and problem-solving skills: SMEs need to be able to analyze complex problems, identify patterns, and propose solutions. 

  • Communication skills: SMEs need to be able to share their expertise with others, including in meetings, training sessions, and seminars. They may also need to interact with customers. 

  • Commitment to relevancy: SMEs need to keep up with changes in industry practices and protocols. 

  • Continuous learning and adaptability: SMEs need to be eager to learn and stay current with the latest updates. 

  • SAP functional skills: SMEs need to have a deep understanding of SAP modules. 

  • Process standardization: SMEs may be responsible for standardizing processes and ensuring proper alignment within their area of the business. 

  • Identifying and fixing operational issues: SMEs may identify and fix operational issues that staff face on a daily basis


Read more
GoProtoz
at GoProtoz
3 recruiters
Kiruthika V
Posted by Kiruthika V
Remote only
0 - 1.5 yrs
₹2L - ₹3.5L / yr
User Experience (UX) Design

Roles and Responsibility

Utilize design tools and processes to create new product design elements Participate in peer reviews of design work to evaluate design techniques and overall success in meeting the compelling user experience objectives Lead the enhancement the current design system containing our re-usable design elements and components, style guide, WCAG compliance standards, and developer instructions Work with team members of all levels to complete daily tasks, share design and development knowledge, follow-up and escalate issues appropriately, and recommend design and process enhancement Take part in user-centered design methods including user research & synthesis, exploration, story-telling, detailed design, journey mapping and prototyping Design and present findings to the business on 2 to 3 actionable items to enhance the customer experience Create and communicate your design and user experience insights to company leaders Document design notes, element construction, development processes, and other supporting materials Manage project plans, feature design and delivery Work alongside a UX Designer to conduct user research into how users work through data entry forms and obtain user feedback on existing designs that will help inform new design improvements

Read more
foriio
Avinash Varma
Posted by Avinash Varma
Remote only
2 - 4 yrs
₹8L - ₹18L / yr
skill iconFlutter
Mobile App Development

As a Flutter developer, you’ll work on our mobile app that is built with Flutter. You’ll help to plan and develop new features, review other people’s code, fix bugs, help in technological and business decisions, and support the internal team. You will take initiative to run projects/features smoothly.

 

Requirements:

  • At least 1 year of Flutter experience in a production environment
  • At least 3 years of industry experience

Nice to have:

  • Having the knowledge required to write native plugins in Swift or Kotlin is an asset
  • Having a background in native iOS and/or Android development is a big plus (e.g. experience with Xcode, Gradle, Android Studio).
  • Familiar with one or more CI/CD environments: CircleCI, Gitlab, Github, etc. Knowing your way around Fastlane to build & deploy your app comes in handy
  • Experience in working with state management libraries such as Riverpod
  • Familiar with writing tests for your application: unit tests, widget tests and integration tests
  • UI / UX design principles
  • Good understanding of coding best practices and design patterns
  • Understanding of security technologies (encryption, authentication, OAuth 2.0)
  • Contribution to open source projects
  • Interest and ability to learn other coding languages as needed
Read more
Genius Placement Service
at Genius Placement Service
2 recruiters
Muskan Keshvani
Posted by Muskan Keshvani
Ahmedabad
3 - 5 yrs
₹3L - ₹5L / yr
User Interface (UI) Design
User Experience (UX) Design
skill iconHTML/CSS
skill iconJavascript
Illustration
+1 more

Skills:

HTML, CSS, Javascript, UI Prototyping, Photoshop, Illustrator, Corel Draw, Adobe

Must Knowledge of Adobe XD

 
Experience : 3 to 5 yrs 

Read more
Stealth mode Ai. Domain startup of US.
Stealth mode Ai. Domain startup of US.
Agency job
via zyoin by RAKESH RANJAN
Remote, Bengaluru (Bangalore)
0 - 5 yrs
₹15L - ₹90L / yr
skill iconGo Programming (Golang)
skill iconNodeJS (Node.js)
skill iconJava
skill iconRuby on Rails (ROR)
skill iconPython
+2 more

Founder’s LinkedIn profile

Dheeraj Pandey

(Founder, Investor, & Then-CEO of Nutanix / One of the Indian origin guy out of 10 Board Member of- Adobe / Alumni- IIT, Kanpur & University of Texas, Austin)

https://www.linkedin.com/in/dpandey/">https://www.linkedin.com/in/dpandey/

 

&

Chandra Nath

(Vice President- Nutanix/ Vice President, Head of International- Ola (ANI Technologies Pvt Ltd) – Alumni- IIT, Kanpur, The University of Chicago Booth School of Business)

https://www.linkedin.com/in/chandranath/">https://www.linkedin.com/in/chandranath/

 

&

Manoj Agarwal

(Co-Founder at Stealth Startup, Previously SVP Engineering & GM Hybrid Cloud at Nutanix/ Alumni- IIT, Kanpur)

https://www.linkedin.com/in/devreveler/">https://www.linkedin.com/in/devreveler/


  • Headquarters: Austin, Texas, United States
  • Year founded: 2020.
  • Work Location: Bangalore
  • Team size: 35-40 (In US from companies like Google, Airbnb, Blizzard, Facebook, Palantir, Microsoft, CapitalOne, Nutanix and Confluent)
  • Funding: 50 M USD (raised the largest seed round in the history of Silicon Valley)

Note:

We already have a team of 30-35 people in San Jose, California, United States, now we are building a new team in india and they are hiring 0-5 years of rock stars from top notch colleges (Top 5 ranked IIT’s only & BITS) & companies only.

Note:

 

Basically, I did not have the exact JD with myself, but I can arrange an Exploratory call for you with above senior and core members of a company (Dheeraj/Chandra/Manoj).

Job Role – Backend developer.

If you think, you are one of them then please reply with your interest and we will take your candidature ahead for next level of evaluation. (No Bar of budget for strong candidate).

Looking forward to taking you to the next level of technology.

Warm Regards,

Rahul Rajput

Senior talent acquisition 

 

Read more
V2 Tech Ventures Pvt Ltd
Jalaj Sharma
Posted by Jalaj Sharma
Bengaluru (Bangalore), Udaipur, Baroda, Mumbai
10 - 16 yrs
₹10L - ₹25L / yr
Salesforce
Adobe Marketing Cloud
SFDC
SFMC

 

     Designation – Tech Architect

 

 

 

Brief Summary of the Role:

Oversee IT assignments that are aimed at improving the business, and ensuring that projects run smoothly

Review business structures in order to ensure the proper flow and functionality of projects

Provide technical assistance to resources

 

 

Detailed Roles & Responsibilities

1. To define an ongoing architectural strategy for the business

2. To define an architectural road map for the business that supports the product road map

3. To identify organization's needs and breaking large system requirements down into manageable parts for proper execution

4. To produce a detailed technical design document to match the solution design specifications

5. To explain the structure to the designers and developers, and helping them to build it

6. To develop and carry out acceptance testing procedures to make sure systems are working properly

7. To ensure system meets quality standards

8. To advise senior project managers about how to plan their future IT needs.

9. To manage multiple development designs and projects to meet project and customer required time lines.

10. To maintain an awareness of what competitors in the market are performing and using it to inform the technical road map

11. To provide architectural oversight to the team, acting as the ultimate design authority on significant technical decisions

12. To provide a focal point for all technical issues and initiatives on the project

13. To ensure that all components of the technical architecture are properly implemented.

 

Skills – Salesforce

 

Qualification – BE/ BSC/ BTECH

Experience – 12- 15 Years

 

 

 


 

Read more
Ideapoke Technologies
at Ideapoke Technologies
7 recruiters
Bhandavya DR
Posted by Bhandavya DR
Remote, Bengaluru (Bangalore)
4 - 6 yrs
₹4L - ₹10L / yr
skill iconJava
J2EE
Struts
Spring
Hibernate (Java)
+1 more

Job Title : Sr Java Developer

Job Description 

We are seeking a well experienced full stack Java developer for our product. As a member of the software engineering division, you will assist in defining and developing software for tasks associated with the developing, debugging or designing of software applications or operating systems. Provide technical leadership to other software developers. Specify, design and implement modest changes to existing software architecture to meet changing needs. 
  Roles and responsibilities? 

  • Design, develop and implement software programming applications.
  • Build highly scalable product.
  • Participate in gathering business requirements and assessing existing architectures and resources.
  • Work with application development team in delivering the project and deliverable within time and with good quality.
  • Perform unit testing, oversee quality assurance of applications through system testing.
  • Establishes processes for performance and conducts code review.
  • Manage and mentor junior members of the team on good coding practice

Skills and experiences would I bring into this role? 

  1. E/ B.Tech / MCA in computer science or a related field
  2. 4+ Years of Java/J2EE work experience.
  3. Object-Oriented design, patterns, algorithms, data structures
  4. Well knowledge about Spring Hibernate framework.
  5. Exposure to React JS / Angular JS.
  6. Experience with SQL/No-SQL database technologies – MySQL, Mongo dB, Cassandra, Redis, PostgreSQL, etc.
  7. Experience in Web services (REST or SOAP)
  8. End to end web development experience is highly preferred
  9. Good understanding of unit testing methodologies.
  10. Good analytical and communication skills
  11. Startup work culture mindset.
Read more
GiveIndia
Bengaluru (Bangalore)
1 - 3 yrs
₹3L - ₹7L / yr
skill iconJavascript
skill iconReact.js
skill iconExpress
skill iconSASS
skill iconHTML/CSS
Introduction Give is India’s largest and most trusted giving platform, and our mission is promote effective and efficient giving, so that our poor have a chance. With contributions of over 300 crores made to our 200+ vetted and trusted nonprofits, our giving community of 1M+ donors has impacted lives of 4M+ people across 23 states in India. We are an extremely rare workplace that brings a fast-paced, high-growth startup work culture together with a compassion-driven high-impact work environment. Give Platform We are building one of the world’s best tech platforms for online giving, where we provide opportunities for people to donate to any cause, non-profit or geography that they care about, in the most simple, personalised and effective manner. We hope to scale our impact on the lives of millions of underprivileged people every year, by democratizing philanthropy, through our workplace giving, subscription giving and crowdfunding products. Give Tech Stack Details: https://stackshare.io/giveindia Role At Give, we are looking for top-talent for our engineering team - software engineers who want to solve really complex problems, continually learn, and most importantly, make a real impact in the lives of others. At Give, you will… work alongside product to understand their requirements, and design, develop and iterate. think through complex architecture to build robust platforms. build well-abstracted modules and services follow scrum methodology to iterate and deploy fast. Apply if you… like to build responsive user-facing web applications that are built with mobile and desktop in mind have experience with medium to large-scale web applications have solid understanding of interface design principles are known for good aesthetic taste and design sense have experience in turning mockups and wireframes into elegantly executed code like to work with product, design and other stakeholders in the company to identify customer pain points, come up with solutions, prototype, iterate and ship daily have used version control systems (Git, Subversion etc.) like to improve developer productivity by investing in tools, frameworks and internal products Good to have… A Github account, Stack Overflow account or equivalent that demonstrates your ability to work on complicated projects or some other way to validate your expertise.
Read more
BSA Logistics
at BSA Logistics
1 recruiter
Maria Michael
Posted by Maria Michael
NCR (Delhi | Gurgaon | Noida)
1 - 4 yrs
₹2L - ₹3L / yr
Business administration
Communication Skills
Business Development
Management Information System (MIS)
Interpersonal Skills
+1 more
Urgently required a female candidate:

  • Good Communication and interpersonal skills
  • Proficient in MS Office
  • Well versed with written and spoken english
  • Self motivated and hard working
  • Salary no bar for deserving candidates
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos