Cutshort logo
SpringML logo
Lead Data Engineer
Lead Data Engineer
SpringML's logo

Lead Data Engineer

Astha Deep's profile picture
Posted by Astha Deep
6 - 12 yrs
₹6L - ₹26L / yr
Remote, Hyderabad
Skills
Google Cloud Platform (GCP)
Python

Hi All,

We are hiring!!

Company: SpringML India Pvt Ltd.

Role:Lead Data Engineer

Location: Hyderabad  

Website: https://springml.com/">https://springml.com/

 

 

About Company:

At SpringML, we are all about empowering the 'doers' in companies to make smarter decisions with their data. Our predictive analytics products and solutions apply machine learning to today's most pressing business problems so customers get insights they can trust to drive business growth.

We are a tight-knit, friendly team of passionate and driven people who are dedicated to learning, get excited to solve tough problems and like seeing results, fast. Our core values include placing our customers first, empathy and transparency, and innovation. We are a team with a focus on individual responsibility, rapid personal growth, and execution. If you share similar traits, we want you on our team.

What's the opportunity?

SpringML is looking to hire a top-notch Lead Data Engineer who is passionate about working with data and using the latest distributed framework to process large dataset.

As a Lead Data Engineer, your primary role will be to design and build data pipelines. You will be focused on helping client projects on data integration, data prep and implementing machine learning on datasets. 

In this role, you will work on some of the latest technologies, collaborate with partners on early win, consultative approach with clients, interact daily with executive leadership, and help build a great company. Chosen team members will be part of the core team and play a critical role in scaling up our emerging practice.


Responsibilities:

  •  Ability to work as a member of a team assigned to design and implement data integration solutions.
  •  Build Data pipelines using standard frameworks in Hadoop, Apache Beam and other open-source solutions.
  •  Learn quickly – ability to understand and rapidly comprehend new areas – functional and technical – and apply detailed and critical thinking to customer solutions.
  •  Propose design solutions and recommend best practices for large scale data analysis

 

Skills:

  •  B.tech degree in computer science, mathematics or other relevant fields.
  •  6+years of experience in ETL, Data Warehouse, Visualization and building data pipelines.
  •  Strong Programming skills – experience and expertise in one of the following: Java, Python, Scala, C.
  •  Proficient in big data/distributed computing frameworks such as Apache Spark, Kafka,
  •  Experience with Agile implementation methodology 
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos

About SpringML

Founded :
2015
Type
Size :
100-1000
Stage :
Profitable
About
SpringML provides consulting, services & accelerators to support digital transformation journeys, data modernization, cloud migrations & adoption of AI/ML
Read more
Company video
SpringML's video section
SpringML's video section
Connect with the team
Profile picture
Aashish Sukka
Profile picture
Anamika Gupta
Profile picture
Astha Deep
Profile picture
Sai Raj Sampath
Company social profiles
bloglinkedintwitterfacebook

Similar jobs

Zopper
at Zopper
1 recruiter
Agency job
via zyoin by Siddha Jain
Kolkata, Noida
3 - 5 yrs
₹5L - ₹15L / yr
Python
Django
MongoDB

Responsibilities:

  • Participate in the entire application lifecycle, focusing on coding and debugging.
  • Write clean code to develop functional web applications.
  • Troubleshoot and debug applications.
  • Perform UI tests to optimize performance.
  • Manage cutting-edge technologies to improve legacy applications.
  • Collaborate with Front-end developers to integrate user-facing elements with server side logic.
  • Provide training and support to internal teams.

 

Requirements:

  • Experience: 3- 6 years.
  • Education Qualification: B. E/ MCA/ B. Tech/ M. Tech/ BCA.
  • Skills: Python, Django, Flask, SQL, AWS, Azure, Git.
  • Having 3 years of experience in developing backend distributed applications in Python.
  • Solid hands-on experience as Python Developer in advanced Python programming.
  • Strong knowledge of building RESTful APIs using Python frameworks (e. g. Django, Flask, Web2Py, Tornado).
  • Good knowledge on development and accessing web services (REST).
  • Should have worked on cloud platforms/services offered by AWS, Azure or GCP (Google Cloud Platform).
  • Good understanding of Data Structures and Oops Concepts.
  • Understanding of databases and SQL.
  • Expertise in developing production ready Micro services in Python.
  • Understanding of the threading limitations of Python, and multi-process architecture.
  • Proficient understanding of code versioning tools, such as Git.
  • Effective oral & written communication skills.
Read more
Gurugram
4 - 8 yrs
₹15L - ₹18L / yr
Splunk
GitHub
Integration
API
RESTful APIs
+6 more

Job Description

Roles and Responsibilities

· Design, Code, test, debug, implement and document complex WSO2 sequences.

· Monitoring and logging tool stacks - Splunk/ELK/Prometheus, Grafana 4 Design, Code, test, debug, implement and document complex WSO2 sequences.

· Perform Build activities for WSO2 ESB Middleware integration, involves writing XSLT, ESB coding, configuration, and Analysis activities.

· Trouble shooting various problems in different stages of development using logs files, Traces and Log Analyzer.

· Responsible for understanding the requirement, solution design, coordinate the development and testing activities (end to end)

· Guide the team regarding WSO2 platform best practices, framework, reusable artefacts and ensure code quality and timely deliverables.

· Work with functional and technical customers to determine solutions that drive additional business value.

· Work with Github, Azure Devops and CI tools to automate dev, build, deployment and testing.

· Good knowledge in messaging brokers: WSO2 Message Broker, Apache Kafka.

· Monitoring the server (Monitoring logs and WSO2 metrics).

· Desired Candidate Profile

 

Desired Candidate Profile

· Candidate must have minimum 2+ years of hands-on experience in WSO2, preferably with WSO2 certification.

· Extensive experience in Integration by using WSO2 Product Stack (API Manager 2.6/3.x, Enterprise Integrator 6.5 and Identity Server 5.7.0)

· Experience in Implementing APIs in WSO2 EI and On-boarding APIs into WSO2 API Manager

· Experience in WSO2 API Manager for designing API facades and designing and implementing API Proxies.

· Hands-on experience in designing and developing high volume web services using API Protocols and Data Formats (REST, JSON, SOAP & XML).

· Must have hands on experience / knowledge with CI tools to automate dev, build, deploy.

· Experience in programming languages: Java, JavaScript, Python

· Experience in on boarding web applications into WSO2 Identity Server for authentication and authorizatio

Qualifications

• Minimum of a Bachelor's or Master’s degree in Computer Science, or a related four-year degree.

• 4 years of hands on experience in Integration

Read more
HeyMath
at HeyMath
1 recruiter
Sivakumar Periadurai
Posted by Sivakumar Periadurai
Chennai
7 - 15 yrs
₹15L - ₹25L / yr
Java
J2EE
Architecture
Python
Javascript
We are looking out for: Senior tech enthusiasts who are passionate about technology, enjoy using it to create solutions that drive the business. Creating software solutions that enable the innovation and growth of business You should be a self-starter who enjoys managing and working with a team of smart, entrepreneurial engineers & business teams, and like solving challenges. You will be building solutions that enable the business to grow faster, and help software platforms get out of the way of that growth. About Us Incorporated in June 2000, HeyMath! is an Ed-tech product company, based in Chennai and focused on improving the quality of Maths education globally through our flagship products: HeyMath! We develop our products in formal collaboration with the University of Cambridge who we have partnered with since our inception. You can check us out here: https://plp.heymath.com/ Over 95% of our work is with overseas customers, and we are investing heavily in building world-class capabilities in Software Engineering to support our next phase of growth – which will include consumer facing Apps in multiple languages, offline delivery capabilities as well as server side integration with our distribution partners to deliver the best user experience. The office environment is very collegiate and you will get to work in small, high-impact teams.
Read more
Bengaluru (Bangalore)
8 - 15 yrs
₹40L - ₹80L / yr
Software Development
C++
Java
J2EE
Python
Required Experience and Skills:
  • Degree in Computer Science (BS/MS), related technical field or equivalent practical experience
  • 8+ years of industry experience in product development
  • Experience in coaching and mentoring team members
  • Must own a specific component of the product. Gathering requirements by working with product management. Working closely with development managers in defining external product interfaces
  • Must have excellent written and verbal communication skills. Must articulate various design approaches and design decisions clearly - within the team and across the teams.
  • Must work with QA engineers to devise proper test constructs - unit testing and integration tests.
Read more
Censiusai
at Censiusai
1 recruiter
Censius Team
Posted by Censius Team
Remote only
4 - 10 yrs
₹20L - ₹30L / yr
Python
Django
Flask
Java
SQL

Our goal

We are reinventing the future of MLOps. Censius Observability platform enables businesses to gain greater visibility into how their AI makes decisions to understand it better. We enable explanations of predictions, continuous monitoring of drifts, and assessing fairness in the real world. (TLDR — build the best ML monitoring tool)

 

The culture

We believe in constantly iterating and improving our team culture, just like our product. We have found a good balance between async and sync work — default is still Notion docs over meetings, but at the same time, we recognize that as an early-stage startup brainstorming together over calls leads to results faster. If you enjoy taking ownership, moving quickly, and writing docs, you will fit right in.

 

The role:

Our engineering team is growing and we are looking to bring on board a senior software engineer who can help us transition to the next phase of the company. As we roll out our platform to customers, you will be pivotal in refining our system architecture, ensuring the various tech stacks play well with each other, and smoothening the DevOps process.

On the platform, we use Python (ML-related jobs), Golang (core infrastructure), and NodeJS (user-facing). The platform is 100% cloud-native and we use Envoy as a proxy (eventually will lead to service-mesh architecture).

By joining our team, you will get the exposure to working across a swath of modern technologies while building an enterprise-grade ML platform in the most promising area.

 

Responsibilities

  • Be the bridge between engineering and product teams. Understand long-term product roadmap and architect a system design that will scale with our plans.
  • Take ownership of converting product insights into detailed engineering requirements. Break these down into smaller tasks and work with the team to plan and execute sprints.
  • Author high-quality, highly-performance, and unit-tested code running on a distributed environment using containers.
  • Continually evaluate and improve DevOps processes for a cloud-native codebase.
  • Review PRs, mentor others and proactively take initiatives to improve our team's shipping velocity.
  • Leverage your industry experience to champion engineering best practices within the organization.

 

Qualifications

Work Experience

  • 5+ years of industry experience (3+ years in a senior engineering role) preferably with some exposure in leading remote development teams in the past.
  • Proven track record building large-scale, high-throughput, low-latency production systems with at least 3+ years working with customers, architecting solutions, and delivering end-to-end products.
  • Fluency in writing production-grade Go or Python in a microservice architecture with containers/VMs for over 5+ years.
  • 2+ years of DevOps experience (Kubernetes, Docker, Helm and public cloud APIs)
  • Worked with relational (SQL) as well as non-relational databases (Mongo or Couch) in a production environment.
  • (Bonus: worked with big data in data lakes/warehouses).
  • (Bonus: built an end-to-end ML pipeline)

Skills

  • Strong documentation skills. As a remote team, we heavily rely on elaborate documentation for everything we are working on.
  • Ability to motivate, mentor, and lead others (we have a flat team structure, but the team would rely upon you to make important decisions)
  • Strong independent contributor as well as a team player.
  • Working knowledge of ML and familiarity with concepts of MLOps

Benefits

  • Competitive Salary 💸
  • Work Remotely 🌎
  • Health insurance 🏥
  • Unlimited Time Off ⏰
  • Support for continual learning (free books and online courses) 📚
  • Reimbursement for streaming services (think Netflix) 🎥
  • Reimbursement for gym or physical activity of your choice 🏋🏽‍♀️
  • Flex hours 💪
  • Leveling Up Opportunities 🌱

 

You will excel in this role if

  • You have a product mindset. You understand, care about, and can relate to our customers.
  • You take ownership, collaborate, and follow through to the very end.
  • You love solving difficult problems, stand your ground, and get what you want from engineers.
  • Resonate with our core values of innovation, curiosity, accountability, trust, fun, and social good.
Read more
The Solar Labs
at The Solar Labs
3 recruiters
Siddharth Gangal
Posted by Siddharth Gangal
Remote, Noida, NCR (Delhi | Gurgaon | Noida)
1 - 4 yrs
₹8L - ₹11L / yr
Javascript
Python
Graphic Designing
We are looking for a skilled graphics engineer to help develop our next generation 3D design and simulation engine. You will work on our client side canvas-based design and rendering engine as well as our parallelized python shading engine. As an early engineering hire you will have the opportunity to grow professionally along multiple dimensions. Engineers will make key technical decisions, participate in product design, and play crucial roles in hiring and internship mentoring. Requirements Knowledge of Javascript and Python Knowledge of common graphics APIs Familiarity with linear algebra and calculus Experience with geometry and graph algorithms Passionate about renewable energy and sustainability Familiarity with 3D design tools/CAD tools Bonus Experience with threeJS Game Development experience WebGL/OpenGL experience Job Perks Stock options, free tea and coffee,
Read more
Zydelo
at Zydelo
1 recruiter
Aastha Sharma
Posted by Aastha Sharma
Remote only
4 - 6 yrs
₹5L - ₹10L / yr
Python
Django
Amazon Web Services (AWS)
SQL
NOSQL Databases

We are looking for a Backend Developer who has 4-6 years of experience in designing, developing, and implementing backend services using Python and Django.

- Responsibilities-

- Design highly scalable, testable code and follow Test Driven Development methodology 

 

- Able to write well-organized, modularised code with test cases.

- Contribute to the design and architecture of our backend APIs and deployment of microservices

- Ensure adherence to engineering best practices and maintain the overall quality of our codebase.

- Work with the product team to translate powerful ideas into everyday business value.

- Skills-

- Back-end programming language: Python

- Familiarity with Django or Flask framework

- Familiarity with AWS and Elastic Search

- Experience in SQL and NoSQL databases with an insight into various data modeling use cases

- Experience with system & unit testing

- Familiarity with containerized deployment

- Proficiency with Git

- Sound with data structures and algorithms and have a good understanding of design patterns, software architectures

Read more
DataMetica
at DataMetica
1 video
7 recruiters
Nikita Aher
Posted by Nikita Aher
Pune
1.5 - 2.5 yrs
₹1L - ₹10L / yr
Java
Scala
Python
Maven
Oracle
+2 more
Mandatory Skills:
  • As a polyglot developer Ideally, you should have:
  • 1.5+ years of development experience using any of technology java, scala, python or any similar exciting technologies.
  • Hands-on experience in coding, and implementation of complex, custom-built applications Working knowledge of build tool like maven/sbt and code versioning systems like git/bitbucket/cvs/svn
  • Familiarity with few databases, like MySQL, Oracle, PostgreSQL, SQL Server, NoSQL etc Great OO skills, including strong design patterns knowledge
  • Good communication and ability to work in a consulting environment is essential
Good to Have:
  • Think through hard problems in a consultancy environment, and work with amazing people to make the solutions a reality Work in a dynamic, collaborative, non-hierarchical environment where your talent is valued over your job title or years of experience
  • Build custom software using the latest technologies and tools Craft your own career path
You'll be responsible for:
  • Providing solution to real problems in Bigdata world.
  • RnD on using the latest tools,techniques and cloud services.
  • Automating the manual-timetaking tasks.
  • Hands-on coding, usually in a pair programming environment.
  • Working in highly collaborative teams and building quality code
  • Working in lots of different domains and client environments
  • Understanding the business domain deeply
What we do:
We are a team of technology agnostic, passionate people who aim to provide solution to real world Bigdata problems.
We are building solutions that will help our customers to do automatic migration of their RDBMS systems to latest BIGDATA platforms and tools such as Spark, Apex, Flink etc. For more information do visit our products webpage.  
Read more
BrowserStack
at BrowserStack
1 video
8 recruiters
Vineeta Vishwanath
Posted by Vineeta Vishwanath
Mumbai
3 - 6 yrs
Best in industry
NodeJS (Node.js)
Data Structures
Algorithms
Ruby on Rails (ROR)
Python
+2 more

What do Microsoft, The Gap, Royal Bank of Scotland, Lockheed Martin, and top Open Source projects like JQuery have in common? They all use BrowserStack, as do over 25,000 other customers!

 

BrowserStack is the industry-leading, cloud web and mobile testing platform that enables developers to test their websites and apps on different operating systems and mobile devices. Since launching in 2011, our mission has been bold yet simple: To be the testing infrastructure for the internet. 6 years and billions of tests later, we are ready for our next phase of hyper growth. Bootstrapped for the first 6 years, we continue to be profitable since inception with a near exponential https://workable.com/nr?l=https%3A%2F%2Fwww.browserstack.com%2Fgrowth">growth in customers around the globe. Recently, we closed $50M in Series A funding from Accel

 

Are you are the one who wants to work on a tech-heavy product, and the challenging technical problems that it entails? Problems vary, and can be as diverse as scaling the product smoothly as the company grows, to setting up a device farm, or solving streaming issues through a browser, without the use of plugins. Will you be excited for the challenge to transform and think critically on many computer science disciplines including product design, usability, building APIs and user-centric online applications, business logic, scaling performance, and 24x7 reliability?

 

JOB RESPONSIBILITIES

  • Writing high quality code, participating in code reviews, designing/architecting systems of varying complexity and scope, and creating high quality documentation supporting the design/coding tasks
  • Lead out team meetings, stand-ups, and architecture/design discussions
  • Identify areas of improvement in our frameworks, tools, processes and strive to make them better. Evaluate our success metrics and evolve our reporting systems
  • Works on the web application layer, backend, systems, streaming and other associated technology to build our product and components
  • Find solutions and solve issues around a variety of operating systems or programming languages
  • Researching new technologies and adapt them to BrowserStack requirements
  • Own and commit to all your work, and be accountable for your results
  • Using and understanding code from Open Source
  • Teaching others how to use new software
  • Willing to learn new programming languages and databases
  • Able to write efficient SQL queries and design schemas for relational databases
  • Participate in a culture of code reviews, writing tech specs, and collaborating closely with other people (no lone wolves)
  • Produce high quality software that is unit tested, code reviewed, and checked in regularly for continuous integration
  • Develop multi-tier scalable, high-volume performing, and reliable user-centric applications that operate 24x7
  • Scale distributed applications, make architectural trade-offs applying synchronous and asynchronous design patterns, write code, and deliver with speediness and quality
REQUIREMENTS
  • Good experience in at least one scripting language: Ruby, Nodejs, Python, AppleScript, Unix shell or similar
  • Familiarity with one compiled language: C, Java, Go or similar
  • Good knowledge of operating systems and networking concepts
  • Reasonable knowledge of Windows and/or Linux operating systems
  • Ability to work on Windows and Linux platform below the application layer, including file systems, kernels, custom installations, shell scripting, internal APIs, etc
  • Aggressive problem diagnosis and creative problem solving skills
  • Startup mentality, high willingness to learn, and hardworking
  • Experience of 3-6 years
Read more
Civil Maps
at Civil Maps
4 recruiters
Venkata Kolla
Posted by Venkata Kolla
Hyderabad
7 - 12 yrs
₹25L - ₹30L / yr
Javascript
Python
Linux/Unix
NodeJS (Node.js)
NOSQL Databases
+3 more
We are Civil Maps Civil Maps, provider of 3D mapping technology for fully autonomous vehicles, has raised a $6.6 million seed funding round from Ford Motor Company, Motus Ventures, Wicklow Capital, StartX Stanford and Yahoo cofounder Jerry Yang’s AME Cloud Ventures. Civil Maps’ mission is to make it possible for fully autonomous vehicles (SAE Levels 4-5) to drive anywhere smoothly and safely. Through artificial intelligence and vehicle-based local processing, Civil Maps converts sensor data into meaningful map information built specifically to direct fully autonomous vehicles. The company will use the seed investment to accelerate product development and deployment with a number of leading automotive companies and technology partners. Civil Maps’ artificial intelligence software aggregates raw 3D data from LiDAR (high-resolution laser imaging), camera and other sensors onboard autonomous vehicles and organizes the information into machine-readable maps. The information is vastly more actionable information than today’s mapping systems and requires a fraction of the data storage and transmission for existing technologies. Thanks to this light data footprint, Civil Maps’ spatial information is far less costly to transmit over cellular networks, enabling the company to more easily crowdsource, update and share road data in real time—a major improvement over the lengthy processes that require human annotation in current use. As a result, the company can quickly generate and maintain maps that give fully autonomous vehicles the comprehensive and precise knowledge to autonomous operate safely and smoothly on all roads. About the Opportunity This is an opportunity to work on some of the most exciting problems in the autonomous vehicle industry. Civil Maps is looking for a developer to grow its backend infrastructure. You will be interacting with a completely custom-made distributed computing framework, handling terabytes and petabytes of machine vision data, and millions of requests from robotic platforms. In our interdisciplinary teams, you will get acquainted with the many facets of 3D map creation: data collection, geospatial registration, feature extraction, auditing. Come work on novel challenges, learn and grow while helping Civil Maps achieve on-demand perception of the world around us. Qualifications 6+ years of software development experience in the below technologies. Solid understanding of JavaScript prototypes, callbacks, promises, performance issues. Experience designing and using REST services which can scale horizontally. Experience with Node.js and Express. Experience with unit testing, automation and validation frameworks. Experience with NoSQL databases (data model design), MongoDB or similar. Experience with Identity Management and Security (SSL protocols, data encryption, user authentication, authorization services). Experience with OAuth. Experience with messaging and caching frameworks. Experience with Linux based operating systems. Experience building applications in a cloud environment (ideally AWS). Experience with C++, Python is a plus
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos