Cutshort logo
Needl.ai logo
Software Engineer (Data Pipeline)
Software Engineer (Data Pipeline)
Needl.ai's logo

Software Engineer (Data Pipeline)

Reshika Mendiratta's profile picture
Posted by Reshika Mendiratta
2yrs+
Upto ₹25L / yr (Varies
)
Bengaluru (Bangalore)
Skills
skill iconPython
SQL
skill iconElastic Search
skill iconKubernetes
prometheus
skill icongrafana
Linux/Unix
Ubuntu

About Needl.ai


Needl.ai is a company with a vision to leverage design and technology to elevate the productivity of professionals across different domains using AI. We see professionals spending too much time managing inconsistencies across information types and sources, instead of doing impactful work. We have built a robust platform with the latest AI technologies to help professionals be more productive.


Needl.ai Platform

  • Seamless Information Collation: A single platform for users to seamlessly collate personal and public information from varied sources.
  • RAG Platform: A patent-pending platform that helps users chat with their data.
  • User Preferences System: A curated and adaptive system to reduce cognitive overload.
  • Powerful Search Engine: Cuts across multiple platforms for information querying on unstructured data.


Position Overview:

We are seeking an experienced Software Engineer to join our dynamic and innovative team. As a Software Engineer, you will play a crucial role in designing, developing, and maintaining high-quality software solutions. You will be responsible for contributing to the architecture, ensuring scalability, leading code reviews, and upholding accountability for the success of the projects. Your strong expertise in Python, SQL, operating systems, database concepts, Kubernetes, and AWS will be essential in driving our technology stack forward.


Required Skills:

  • Python, SQL, Elasticsearch, Kubernetes.
  • Experience with observability tools such as Prometheus and Grafana is a plus.
  • Good understanding of Linux systems, preferably Ubuntu.


Responsibilities:

  • Design, develop, and deploy robust and scalable software solutions.
  • Implement best practices for coding, testing, and deploying software applications.
  • Contribute to the architectural decisions of the projects, ensuring they align with scalability, performance, and reliability requirements.
  • Drive the development of scalable software solutions that can handle increased user loads and data volumes, while maintaining high performance and availability.
  • Lead and participate in code reviews, providing constructive feedback to team members to ensure code quality, maintainability, and adherence to coding standards.
  • Take ownership of software development projects from inception to delivery, ensuring deadlines are met and solutions meet quality standards.


Qualifications:

  • Minimum of 2 years of hands-on experience as a software engineer, with a strong focus on Python and SQL development.


If you are a highly motivated and experienced Software Engineer with a passion for delivering scalable and innovative software solutions, we encourage you to apply and join our team.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos

About Needl.ai

Founded :
2019
Type
Size
Stage :
Bootstrapped
About

Search, discover and share information from your preferred apps, websites, and formats in one workspace to collaborate, without organizing or missing out on anything.


Needl is a platform that helps users save a significant amount of time each day by simplifying the process of researching new ideas, companies, and sectors, and keeping up-to-date with business-critical information.


It eliminates the barriers of information silos between teams by providing a unified view of data streams and enabling seamless collaboration. Needl combines and auto-organizes content and updates from your preferred news websites, blogs, emails, Twitter, apps like Slack, Teams, WhatsApp, Telegram, Stock Exchange websites, Cloud drives and more.


With Needl, users can automate tedious tasks such as collecting and organizing information, allowing them to focus on more valuable activities like analyzing and discussing ideas with their teams to generate successful outcomes.

Read more
Company social profiles
bloglinkedintwitter

Similar jobs

vGics Global
Prachi Gupta
Posted by Prachi Gupta
Noida
0 - 1 yrs
₹3L - ₹5L / yr
Linux/Unix
Red Hat Linux
Linux administration
Debian Linux
SUSE Linux
+7 more

Requirements:

• Installing and configuring software, hardware and networks. •Administrate infrastructure, including firewalls, databases, malware protection software and other processes

•Provide technical support for hardware/software issues and resolve help desk requests

•Monitor the system daily and respond immediately to security or usability concerns.

•Upgrade systems with new releases and models and ensuring security and efficiency of IT infrastructure.

•Constant finetuning of the OS for improving the performance of the system.

•Coordinating with OEM support teams in case of any dockets raised and ensure the issues are resolved.

•Provisioning Operational support and troubleshooting the issues related to system administration.

•Perform in 24 x 7 environment in shift roaster and attend calls whenever assigned

•Must be Red Hat certified professional.


Skills Required:

•Red Hat (Primary)

•Debian

•Ubuntu

•SUSE

Read more
Chennai
2 - 5 yrs
₹3L - ₹14L / yr
skill iconPython
SQL
Linux/Unix

Technical Skills Required – Mandatory:

 

- Cloud Technologies – AWS OR Bigdata (Basic Level)

- Python (Highly Experience Level)

- Databases – SQL (Highly Experience Level)

- Operating Systems – Unix (Highly Experience Level)

 

Strong knowledge in writing complex SQL queries and Knowledge of Performance Tuning

Excellent working knowledge of production support role and Strong debug/troubleshooting skills

Provide 24×7 operational support to all production practices on holidays and weekends.

Hands-on experience in production support for data engineering processes, root cause analysis, and identifying opportunities to improve existing processes.

Roles and Responsibilities:

Set up and optimize the existing integration, monitoring and alerting processes.

Working knowledge of ETL/ELT in Hadoop, Spark and MPP databases is required.

Effectively collaborate with the partners (SMEs, DBA, and Business users) to ensure the reliability of the Data systems.

 

Read more
Zepto
at Zepto
1 recruiter
Agency job
via SUVI BUSINESS VENTURE by VINOTH KUMAR
Bengaluru (Bangalore)
4 - 9 yrs
₹10L - ₹15L / yr
skill iconJava
skill iconPython
Data Structures
Algorithms
skill iconPostgreSQL
+2 more
❖ Closely collaborate with product, design and business teams to
understand product ideas and business needs and help deliver these
as a series of ultra-fast experiments.
❖ Architect and implement backend services with high reliability and
scalability.
❖ Contribute to system architecture and database design.
❖ Set up best practices for development and champion their adoption.
❖ Write quality documentation and handle conflicts well to build
consensus.
❖ Learn about new technologies and incorporate them.
❖ Mentor young minds and foster team spirit.
We can provide upto 35LPA as per candidate's experience and knowledge.
Read more
US Based Product Organization
US Based Product Organization
Agency job
via e-Hireo by Biswajit Banik
Bengaluru (Bangalore)
10 - 15 yrs
₹25L - ₹45L / yr
Hadoop
HDFS
Apache Hive
Zookeeper
Cloudera
+8 more

Responsibilities :

  • Provide Support Services to our Gold & Enterprise customers using our flagship product suits. This may include assistance provided during the engineering and operations of distributed systems as well as responses for mission-critical systems and production customers.
  • Lead end-to-end delivery and customer success of next-generation features related to scalability, reliability, robustness, usability, security, and performance of the product
  • Lead and mentor others about concurrency, parallelization to deliver scalability, performance, and resource optimization in a multithreaded and distributed environment
  • Demonstrate the ability to actively listen to customers and show empathy to the customer’s business impact when they experience issues with our products


Requires Skills :

  • 10+ years of Experience with a highly scalable, distributed, multi-node environment (100+ nodes)
  • Hadoop operation including Zookeeper, HDFS, YARN, Hive, and related components like the Hive metastore, Cloudera Manager/Ambari, etc
  • Authentication and security configuration and tuning (KNOX, LDAP, Kerberos, SSL/TLS, second priority: SSO/OAuth/OIDC, Ranger/Sentry)
  • Java troubleshooting, e.g., collection and evaluation of jstacks, heap dumps
  • Linux, NFS, Windows, including application installation, scripting, basic command line
  • Docker and Kubernetes configuration and troubleshooting, including Helm charts, storage options, logging, and basic kubectl CLI
  • Experience working with scripting languages (Bash, PowerShell, Python)
  • Working knowledge of application, server, and network security management concepts
  • Familiarity with virtual machine technologies
  • Knowledge of databases like MySQL and PostgreSQL,
  • Certification on any of the leading Cloud providers (AWS, Azure, GCP ) and/or Kubernetes is a big plus
Read more
Quest Global Technologies Ltd
Remote only
1 - 3 yrs
₹1.8L - ₹5.5L / yr
skill iconAmazon Web Services (AWS)
skill iconDocker
DevOps
Operating systems
Linux/Unix
+4 more
Greetings from Quest Global Technologies Ltd !!

 
Job-Description:
  • 2 years of hands-on Linux System Administration experience (RHEL / CentOS). 
  • 2 years experience in AWS Cloud administration 
  • 2 years relevant work experience in a high-volume and/or critical production service environment. 
  • Minimum 1+ years experience with Windows Server operating system administration 
  • Minimum 2 years experience with Cloud Service Providers (AWS)
  • Minimum 2 years experience in enterprise environments 
  • Bachelor degree or equivalent experience preferred 
Technical Skills:
  • Any Amazon Web Services (AWS) certification preferred. 
  • Understanding of supporting Enterprise applications such as SAP systems and databases on AWS EC2 like (HANA, Db2, Oracle) with cluster management, HA management, etc. 
  • Implement security policies and controls (e.g. CIS, malware, anti-virus, secret management) using AWS services 
  • Strong ability to document standards, methods and produce drawings of systems and applications. 
  • Strong Scripting skills with any scripting languages (Python (Lambda), Bash Shell) 
  • Administration of Linux / Windows servers 
  • Deep understanding of AWS of IT Infra Architecture, Automations in deployments, SAP Architecture, Integration of On-Prem, Hybrid Infra, etc. 
  • Participate in Design Discussion, a new way of working (Automations, operational management), etc. 
  • Must have knowledge of AWS, Azure, Git
Read more
Indium Software
at Indium Software
16 recruiters
Karunya P
Posted by Karunya P
Bengaluru (Bangalore), Hyderabad
1 - 9 yrs
₹1L - ₹15L / yr
SQL
skill iconPython
Hadoop
HiveQL
Spark
+1 more

Responsibilities:

 

* 3+ years of Data Engineering Experience - Design, develop, deliver and maintain data infrastructures.

SQL Specialist – Strong knowledge and Seasoned experience with SQL Queries

Languages: Python

* Good communicator, shows initiative, works well with stakeholders.

* Experience working closely with Data Analysts and provide the data they need and guide them on the issues.

* Solid ETL experience and Hadoop/Hive/Pyspark/Presto/ SparkSQL

* Solid communication and articulation skills

* Able to handle stakeholders independently with less interventions of reporting manager.

* Develop strategies to solve problems in logical yet creative ways.

* Create custom reports and presentations accompanied by strong data visualization and storytelling

 

We would be excited if you have:

 

* Excellent communication and interpersonal skills

* Ability to meet deadlines and manage project delivery

* Excellent report-writing and presentation skills

* Critical thinking and problem-solving capabilities

Read more
Promotup HR Solutions
Ahmedabad
3 - 8 yrs
₹5L - ₹12L / yr
Software Development
SDET
skill iconPython
Perl
Shell Scripting
+3 more
We are seeking an engineer to join its highly skilled engineering team. The job involves creating
and executing test cases, defect reporting/verification on web based application.
Qualifications: BCA / MCA / M.Sc IT / B.E. / B.Tech / M.E. / M. Tech (Preferably in Computer Science)
from a reputed institute.
 The role involves requirement understanding, script development and test across different
platforms using PowerShell and Shell script for Vulnerability detection
 Along with Script development, you will be responsible for provisioning test machines on
AWS/Azure
 Primary goals would be to create highly reliable scripts which basically works on all the
platforms
Basic Requirements:
o 2-6 years of experience with scripting/programming language like Powershell/Shell
script/Python/Java
o Experience on version controlling systems like Git
o Strong understanding on Linux and Windows
o Strong verbal and written communication skills
o Good to have knowledge of Kotlin programming language
o Good to have understanding of different cloud providers like AWS/Azure
o Experience on Kotlin programming language
Read more
A Product Development Company
A Product Development Company
Agency job
via Multi Recruit by Ranjini A R
Bengaluru (Bangalore)
5 - 8 yrs
₹4L - ₹7L / yr
VBA
VBA Developer
Excel VBA
SQL
Macros
+1 more
  • 5 to 8 years of hands on experience in automating MS Office applications like Excel, Word, PPT and Outlook using VBA 
  • 5 plus years of experience in the design, development, and implementation of programming code
  • Experience in database development
  • VBA - Should have good experience in developing efficient logic/algorithms using VBA
  • Solid understanding of SDLC concepts 
  • Solid experience in MS Excel (2003, 2007, 2010, 2013,2016)
  • Must be good at all excel features and excel formulas 
  • Well versed with complete MS Office package (Excel, Word, Outlook, PPT)
  • Work both independently and as part of a team 
  • Experience in requirements gathering, effort estimate, designing and implementation and creating mock-up screens 
  • Experience in databases like MS SQL Server (2005 to 2012,2014), MySQL and MS Access 
  • Must have strong database concepts and DB designing skills 
  • SQL - must be good at writing efficient, fine-tuned queries using joins and aggregates 
  • Experience in writing Stored procedures, Triggers and T-SQL
  • Nice to have programming knowledge in C# 
 
Key Skills:
 
  • VBA, SQL 
 
Interpersonal skills
 
  • Strong analytical and problem-solving skills 
  • Excellent interpersonal and communication skills 
  • Should be able to take complete ownership of the project from requirements gathering to delivery and maintenance 
  • Should be able to work independently 
  • Must be Proactive and Self-motivated
  • Must have the ability to prioritize the work, execute tasks and meet the deadline without fail 
  • Effective time management skills 
  • Customer Focus, Willing to learn and self- teach any new technology 
  • Strong business and collaboration skills, and responsive to service needs and operational demands.
Read more
IT solutions specialized in Apps Lifecycle management. (MG1)
IT solutions specialized in Apps Lifecycle management. (MG1)
Agency job
via Multi Recruit by Ayub Pasha
Bengaluru (Bangalore)
5 - 6 yrs
₹10L - ₹12L / yr
Mlops
skill iconKubernetes
skill iconDocker
Ansible
PySpark
+3 more
  • Automate and maintain ML and Data pipelines at scale
  • Collaborate with Data Scientists and Data Engineers on feature development teams to containerize and build out deployment pipelines for new modules
  • Maintain and expand our on-prem deployments with spark clusters
  • Design, build and optimize applications containerization and orchestration with Docker and Kubernetes and AWS or Azure
Skills:
  • 5 years of IT experience in data-driven or AI technology products
  • Understanding of ML Model Deployment and Lifecycle
  • Extensive experience in Apache airflow for MLOps workflow automation
  • Experience is building and automating data pipelines
  • Experience in working on Spark Cluster architecture
  • Extensive experience with Unix/Linux environments
  • Experience with standard concepts and technologies used in CI/CD build, deployment pipelines using Jenkins
  • Strong experience in Python and PySpark and building required automation (using standard technologies such as Docker, Jenkins, and Ansible).
  • Experience with Kubernetes or Docker Swarm
  • Working technical knowledge of current systems software, protocols, and standards, including firewalls, Active Directory, etc.
  • Basic knowledge of Multi-tier architectures: load balancers, caching, web servers, application servers, and databases.
  • Experience with various virtualization technologies and multi-tenant, private and hybrid cloud environments.
  • Hands-on software and hardware troubleshooting experience.
  • Experience documenting and maintaining configuration and process information.
  • Basic Knowledge of machine learning frameworks: Tensorflow, Caffe/Caffe2, Pytorch
Read more
New Startup Co
at New Startup Co
1 recruiter
Shrivardhan Kallani
Posted by Shrivardhan Kallani
Bengaluru (Bangalore)
3 - 5 yrs
₹5L - ₹10L / yr
skill iconJavascript
skill iconHTML/CSS
MySQL
skill iconPython
skill iconjQuery
+2 more
This is a startup about to be launched. We are looking for tech co founder who is willing to work on a great product built on Python and requires AI and Analytics. If this interests you then do join us.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos