Cutshort logo
SmartHub Innovation Pvt Ltd logo
Big Data Engineer
SmartHub Innovation Pvt Ltd's logo

Big Data Engineer

Sathya Venkatesh's profile picture
Posted by Sathya Venkatesh
5 - 7 yrs
₹15L - ₹20L / yr
Bengaluru (Bangalore)
Skills
Spark
Hadoop
Big Data
Data engineering
PySpark
skill iconPostgreSQL
skill iconMongoDB
SQL

JD Code: SHI-LDE-01 

Version#: 1.0 

Date of JD Creation: 27-March-2023 

Position Title: Lead Data Engineer 

Reporting to: Technical Director 

Location: Bangalore Urban, India (on-site) 

 

SmartHub.ai (www.smarthub.ai) is a fast-growing Startup headquartered in Palo Alto, CA, and with offices in Seattle and Bangalore. We operate at the intersection of AI, IoT & Edge Computing. With strategic investments from leaders in infrastructure & data management, SmartHub.ai is redefining the Edge IoT space. Our “Software Defined Edge” products help enterprises rapidly accelerate their Edge Infrastructure Management & Intelligence. We empower enterprises to leverage their Edge environment to increase revenue, efficiency of operations, manage safety and digital risks by using Edge and AI technologies. 

 

SmartHub is an equal opportunity employer and will always be committed to nurture a workplace culture that supports, inspires and respects all individuals, encourages employees to bring their best selves to work, laugh and share. We seek builders who hail from a variety of backgrounds, perspectives and skills to join our team.  

Summary 

This role requires the candidate to translate business and product requirements to build, maintain, optimize data systems which can be relational or non-relational in nature. The candidate is expected to tune and analyse the data including from a short and long-term trend analysis and reporting, AI/ML uses cases. 

We are looking for a talented technical professional with at least 8 years of proven experience in owning, architecting, designing, operating and optimising databases that are used for large scale analytics and reports. 

Responsibilities 

  • Provide technical & architectural leadership for the next generation of product development. 
  • Innovate, Research & Evaluate new technologies and tools for a quality output. 
  • Architect, Design and Implement ensuring scalability, performance and security. 
  • Code and implement new algorithms to solve complex problems. 
  • Analyze complex data, develop, optimize and transform large data sets both structured and unstructured. 
  • Ability to deploy and administrator the database and continuously tuning for performance especially container orchestration stacks such as Kubernetes  
  • Develop analytical models and solutions Mentor Junior members technically in Architecture, Designing and robust Coding. 
  • Work in an Agile development environment while continuously evaluating and improvising engineering processes 

Required 

  • At least 8 years of experience with significant depth in designing and building scalable distributed database systems for enterprise class products, experience of working in product development companies. 
  • Should have been feature/component lead for several complex features involving large datasets. 
  • Strong background in relational and non-relational database like Postgres, MongoDB, Hadoop etl. 
  • Deep exp database optimization, tuning ertise in SQL, Time Series Databases, Apache Drill, HDFS, Spark are good to have 
  • Excellent analytical and problem-solving skill sets. 
  • Experience in  for high throughput is highly desirable 
  • Exposure to database provisioning in Kubernetes/non-Kubernetes environments, configuration and tuning in a highly available mode. 
  • Demonstrated ability to provide technical leadership and mentoring to the team 


Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About SmartHub Innovation Pvt Ltd

Founded :
2020
Type :
Product
Size :
0-20
Stage :
Raised funding

About

SmartHub.ai is a fast-growing company headquartered in Bay Area, CA, with offices in Seattle and Bangalore. As an award-winning Edge Automation SaaS company, SmartHub.ai is revolutionizing Enterprise Edge Infrastructure Management & Edge Intelligence Space. Our AI-powered software solutions simplify the complexity of EDGE / IoT infrastructure lifecycle management by eliminating silos, enhancing operational efficiencies through automation, and delivering real-time visibility, performance, and intelligence insights. Trusted by the major Fortune 500 companies across various sectors, our solutions benefit both Information Technology (IT) and Operational Technology (OT) organizations. By securing and utilizing valuable edge data, our customers can achieve significant outcomes such as predictive analytics and preventative maintenance, resulting in zero downtime, continuous compliance, and effective risk management.
Read more

Company social profiles

linkedin

Similar jobs

Technoidentity
Human Resources
Posted by Human Resources
Hyderabad
4 - 7 yrs
Best in industry
Distributed Systems
skill iconJava
skill iconGo Programming (Golang)
AWS CloudFormation
PL/SQL

Job Description:

Role: Senior Backend Developer

Mode of work: WFO

Supercharge Your Career as a Senior Backend Developer at Technoidentity!

Are you ready to solve people challenges that fuel business growth? At Technoidentity, we’re a Data+AI product engineering company building cutting-edge solutions in the FinTech domain for over 13 years—and we’re expanding globally. It’s the perfect time to join our team of tech innovators and leave your mark!

 

What’s in it for You?

We are looking for a highly motivated Senior Backend Developer with 4-6 years of experience to join our team. The ideal candidate will have strong backend development expertise, a deep understanding of distributed systems, and a high sense of ownership. This role requires working independently on POCs and projects while also mentoring junior team members and enabling scalable delivery.

 

What Will You Be Doing?

  • Design, develop, and maintain scalable backend systems and services.
  • Work independently on project implementations and backend solution development.
  • Implement distributed architecture design patterns to build reliable and high-performance systems.
  • Collaborate with cross-functional teams to deliver robust backend solutions.
  • Guide and mentor junior developers, ensuring quality implementation and adherence to best practices.
  • Participate in system design discussions, code reviews, and technical decision-making.
  • Ensure high ownership in delivering solutions aligned with project timelines and goals.

What Makes You the Perfect Fit?

  • 4-6 years of backend development experience with strong expertise in Java or Go,
  • Hands-on exposure to distributed systems, and solid knowledge of PL/SQL, with the ability to work independently and take high ownership of deliverables.
  • Strong problem-solving and critical thinking abilities.
  • Experience working with distributed systems and architecture design patterns.
  • Strong database development skills with PL/SQL.
  • Excellent team coordination and collaboration skills.
  • High sense of ownership, accountability, and commitment towards project delivery.
  • Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related technical field is required.

 

Good to Have Skills

  • Exposure to Cloud platforms (AWS or GCP).
  • Understanding of Frontend technologies or DevOps practices.
  • Experience with workflow orchestration tools such as Temporal or similar platforms.

Work Requirements:

  • Willingness to work in US or flexible shift timings based on project requirements
  • Ability to work independently on POCs/projects and help scale additional pods of work
  • Guide and direct junior team members to ensure proper implementation


 

 

Read more
Deqode
at Deqode
1 recruiter
Apoorva Jain
Posted by Apoorva Jain
Bengaluru (Bangalore), Delhi, Gurugram, Noida, Ghaziabad, Faridabad, Pune, Hyderabad, Mumbai, Nagpur, Ahmedabad, Jaipur
4 - 8 yrs
₹5L - ₹15L / yr
skill iconJava
06692
Microservices

Job Description:

We are looking for a highly experienced Java Developer with expertise in Spring Boot and Microservices architecture. The ideal candidate will have 4+ years of experience in building scalable, high-performance applications.


Key Responsibilities:

  • Develop and maintain Java-based applications using Spring Boot and Microservices.
  • Create and implement RESTful APIs and integrate with third-party services.
  • Design and build scalable, resilient microservices.
  • Perform code reviews and optimize applications for performance and security.
  • Deploy and manage applications on cloud platforms (AWS, Azure, or GCP).
  • Implement CI/CD pipelines for continuous integration and deployment.
  • Diagnose and resolve technical issues and production bugs.

Required Skills:


  •  Java 8+ or 11+ (strong proficiency)
  •  Spring Boot, Spring MVC, Spring Security
  •  Microservices architecture and distributed systems
  •  RESTful APIs and API gateways
  •  SQL and NoSQL databases (PostgreSQL, MongoDB, etc.)
  •  Cloud platforms (AWS, Azure, or GCP)
  •  Containerization (Docker, Kubernetes)
  •  CI/CD pipelines (Jenkins, GitLab CI)
  •  Message brokers (Kafka, RabbitMQ)


Read more
Risosu Consulting LLP
Vandana Saxena
Posted by Vandana Saxena
Bengaluru (Bangalore)
5 - 7 yrs
₹12L - ₹18L / yr
skill iconPython
PySpark
SQL

Job Title: Python Developer

Location: Bangalore

Experience: 5–7 Years

Employment Type: Full-Time


Job Description:


We are seeking an experienced Python Developer with strong proficiency in data analysis tools and PySpark, along with a solid understanding of SQL syntax. The ideal candidate will work on large-scale data processing and analysis tasks within a fast-paced environment.


Key Requirements:


Python: Hands-on experience with Python, specifically in data analysis using libraries such as pandas, numpy, etc.


PySpark: Proficiency in writing efficient PySpark code for distributed data processing.


SQL: Strong knowledge of SQL syntax and experience in writing optimized queries.


Ability to work independently and collaborate effectively with cross-functional teams.

Read more
DevDarshan
at DevDarshan
1 recruiter
Suyash Taneja
Posted by Suyash Taneja
Remote only
1 - 5 yrs
₹10L - ₹20L / yr
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconNodeJS (Node.js)
skill iconMongoDB
+1 more

DevDarshan is a devotional platform launched by IIT graduates to promote the teachings of Indian culture and the Hindu way of life in India around the world. In the 21st century, where everything around is digitized then why not temples. That’s the idea behind DevDarshan.We’ve built a community of devotees from multiple Countries, through our Mobile Application that connects Temples and Devotees, have successfully raised seed investment and also started to generate revenue for the temples and Priests associated with us.Right now we are looking to grow our team and build new exciting features for devotees all around the world.

This is where you come in.

We are looking for a passionate and self-motivated individual to help our Web frontend too.


Requirements:

  • Strong Design and User Experience. Have worked on building High Quality Web experiences and extremely focussed on coding for the best User Experience
  • Experience in any frontend framework like ReactJS, VueJs
  • Good understanding and experience of NoSQL and SQL Databases, which to be used when.
  • Experience with CI/CD Systems like Jenkins, Github Actions.
  • Some Experience with Realtime Databases/Systems or Socket based applications would be preferred.
  • Some Experience with building Algorithms, Social Apps is preferred.
  • Any experience with Handling Video Delivery like ffmpeg/HLS/WebRTC is preferred but not mandatory.


The Role

  • You will be involved at all stages of the product development process, from design to development and deployment.
  • You possess a passion for improving techniques, processes, tracking, and continuously improve our engineering practices and would work on a daily basis towards that




Read more
Spanidea Systems
Gokul Krishnan
Posted by Gokul Krishnan
Remote, Bengaluru (Bangalore), Hyderabad
5 - 10 yrs
₹20L - ₹25L / yr
Verification and validation
BMC
BIOS

Job Description

  • Ensure hardware quality by performing client's qualification tests on servers and components 
  • Draft organized and detailed qual reports of tests showing outputs and PASS/FAIL results 
  • Debug HW issues found during tests by running investigative steps such as reproduction tests, problem isolation and fix verification. 
  • Prepare servers for test by validating HW config and updating FW 
  • Provide progress updates of tests on a regular basis in task tracker 
  • Attend stakeholder meetings to provide updates to open qualifications 
  • Support building out diagnostic definitions for hardware failures 

Qualifications

  • 5+ years of BMC test experience  
  • Experience with data center server (x86) and component testing and debug - CPU, DIMM, Motherboard, BMC, SATA/NVME Drive, NIC, PSU 
  • Experience with data center server FW component testing and debug - BIOS, BMC/IPMI/redfish, Drive FW, NIC FW, RAID FW, CPLD 
  • Experience with Linux shell/bash scripting to support HW testing 
  • Experience on Python automation  


Read more
Innovatily
at Innovatily
5 recruiters
Bhavani P
Posted by Bhavani P
Bengaluru (Bangalore)
8 - 20 yrs
₹10L - ₹15L / yr
skill iconJava
skill iconSpring Boot
skill iconPython
skill iconJavascript
Spring
+7 more

About the job

We focus on client adoption of disruptive technologies, technology architecture and providing specialized skills related to integration, custom software engineering, testing, application modernization, agile and more. We help our clients with the most complex projects including working in open web platforms, DevOps platforms as well as intelligent Computing and Architecture enhancement.

 

We are looking for hands on, smart thinking Applications developer to join our fast-growing team of talented professionals. You will have the opportunity to work on large enterprise solutions and deliver solutions that deliver business performance for our customers.

 

WORK YOU’LL DO

  • Design and develop microservices/APIs using either Java/Spring boot, ISTIO, Kubernetes, Docker, CI / CD Pipelines
  • You would scale micro services using Kafka or similar messaging systems.
  • Collaborate with clients, architects, and application architectures to understand the operational objectives and purpose of the future system integration.
  • Understand the points of integration between the different systems and highlight the potential risks associated with the delivery of solutions
  • Collaborate with Functional Designers and Developers in order to find best solutions
  • Produce detailed functional and technical specifications.
  • Assist in producing solutions with threat assessments and associated security awareness.
  •  

WHAT WE ARE LOOKING FOR

  • 5- 8 years of hands-on experience designing and developing microservices using either Java/Spring Boot
  • 3-5 years of experience with system integration
  • Minimum of 3 years of relevant experience with API concepts and technologies such as REST, JSON, XML, SOAP, YAML, GraphQL, and Swagger
  • Experience developing within agile methodology using CI/CD pipeline
  • Experienced in 3-tier, n-tier, cloud computing, microservices architectures and SOA.
  • Good knowledge of integration architectures
  • Experience supporting and/or implementing complex integration projects
  • Excellent client management skills
  • Experience with Data modelling would be an asset

 

QUALIFICATIONS

  • Experience of working in an Agile Environment
  • Ability to drive design from Stories and Requirements
  • Adept at UML, Design Patterns, Reusable Services Development,
  • Knowledge on Scaling Microservices
Read more
Mobile Programming India Pvt Ltd
at Mobile Programming India Pvt Ltd
1 video
17 recruiters
Inderjit Kaur
Posted by Inderjit Kaur
Chennai
3 - 8 yrs
₹6L - ₹12L / yr
skill iconAngularJS (1.x)
skill iconAngular (2+)
Angular
Designation - Angular Developer
Experience - 3 to 6 Years
Location  - Preffered Chennai
NP - Immediate to 7 Days

Candidates must have experience in Angular Front End Development.
Read more
Photon Commerce
at Photon Commerce
1 recruiter
Photon Commerce
Posted by Photon Commerce
Remote only
6 - 10 yrs
₹18L - ₹30L / yr
skill iconPython
skill iconAmazon Web Services (AWS)
skill iconNodeJS (Node.js)
skill iconMachine Learning (ML)
skill iconData Science
+1 more

Senior Full Stack Python Engineer at Silicon Valley AI company

 

Company

Photon Commerce (http://www.photoncommerce.com">www.photoncommerce.com)

 

Title

Senior software development engineer

 

Commitment

Full-time. Remote (San Francisco, CA). Starting as soon as possible.

 

About the company

Photon empowers financial services and eCommerce businesses with computer vision to automate invoices and receipts. Photon turns paper and pdf invoices, receipts, POs, and packing slips into a modern collaboration platform for commerce, preventing problems before they become costly. Backed by the Nasdaq Entrepreneurial Center and Village Global, its leadership brings experience from eCommerce and SaaS unicorns, Google AI, Y Combinator, Stanford, and 4 exits and an IPO.

 

What you will do

·     Build a python/Django/Flask app that processes PDFs, images, invoices, and receipts for Quickbooks and Shopify

·     Create integrations, APIs for the captured structured data

·     Build a document and invoice collaboration app with embedded chat, like Slack for documents/invoices

·     Deploy the app into production

 

Experience

·     6-10 years of experience having launched apps in production with real users in React, Node, Javascript, Python, Django/Flask, SQL, AWS, and full-stack web development

·     Have repos and/or demos to show your previous work

·     Knowledge in and/or passion for enterprise SaaS, and AWS devops

·     Excellent communication, critical thinking, problem-solving, and team skills

 

What you’ll receive

·     Join an exciting, high growth startup led by serial entrepreneurs and backed by top tier Silicon Valley investors and billionaire industry leaders in tech

·     Competitive compensation commensurate with experience and performance

 

 

 

 

Read more
Lowest brokerage fee in Stock market Industry. (AB1)
Lowest brokerage fee in Stock market Industry. (AB1)
Agency job
via Multi Recruit by Ravish E
Bengaluru (Bangalore)
1 - 2 yrs
₹8L - ₹10L / yr
skill iconPHP
skill iconLaravel
skill iconFlutter
skill iconNodeJS (Node.js)
  • Expertise in building web applications and APIs.
  • Strong knowledge in PHP core and web framework Laravel
  • Basic understanding of front-end technologies such as HTML, CSS, Javascript, Bootstrap, AJAX.
  • Familiar with MYSQL query language
  • Knowledge of frontend backend integration
  • Knowledge in Linux based OS like Ubuntu is an added advantage
  • writing well designed, testable, efficient code
  • Excellent Communication Skills
  • Willingness to own a responsibility
  • Ability to work in a team as well as an individual
  • Ability to work under pressure and maintain deadlines
  • Good to have worked on end to end in projects
Read more
UcodeSoft
at UcodeSoft
1 recruiter
Sonal Khatri
Posted by Sonal Khatri
Mohali
1 - 6 yrs
₹2L - ₹8L / yr
skill iconLaravel
skill iconPHP
MySQL
skill iconCakePHP
skill iconjQuery
+2 more
QUALIFICATION B.E./B.Tech./M.E./M.Tech./MCA (in any stream, preferably Computer Science) 2 years in a professional development capacity MUST-HAVES Solid understanding of Object-Oriented Design Considerable experience with PHP, Git, and MySQL Familiarity with CakePHP or Laravel Framework Experience using Bootstrap and/or Foundation Love for clean, standards-compliant, well-tested, well-patterened code Passion for software development, learning and growing their craft Experience interacting maturely with clients NICE-TO-HAVE Experience implementing responsive frontend code Familiarity with TDD & PHPUnit Familiarity with continuous integration Experience developing RESTful APIs Experience with modern front-end frameworks such as Vue, React, Backbone etc. Experience with Vagrant, Continuous Delivery/Deployment, Linux administration, and server configuration Experience with mobile app development and deployment WHAT WE OFFER Salaries at par with industry standards 5 days working week Flexible office timings Health insurance (covering you and your family) 24 days of paid leave and 10 national holidays EPF deduction and employer contribution
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos