DevOps Engineer

Job Summary:

Seeking a seasoned SQL + ETL Developer with 4+ years of experience in managing large-scale datasets and cloud-based data pipelines. The ideal candidate is hands-on with MySQL, PySpark, AWS Glue, and ETL workflows, with proven expertise in AWS migration and performance optimization.

Key Responsibilities:

• Develop and optimize complex SQL queries and stored procedures to handle large datasets (100+ million records).
• Build and maintain scalable ETL pipelines using AWS Glue and PySpark.
• Work on data migration tasks in AWS environments.
• Monitor and improve database performance; automate key performance indicators and reports.
• Collaborate with cross-functional teams to support data integration and delivery requirements.
• Write shell scripts for automation and manage ETL jobs efficiently.

Required Skills:

• Strong experience with MySQL, complex SQL queries, and stored procedures.
• Hands-on experience with AWS Glue, PySpark, and ETL processes.
• Good understanding of AWS ecosystem and migration strategies.
• Proficiency in shell scripting.
• Strong communication and collaboration skills.

Nice to Have:

• Working knowledge of Python.
• Experience with AWS RDS.

1. Design cloud infrastructure that is secure, scalable, and highly available on AWS, Azure and GCP
2. Work collaboratively with software engineering to define infrastructure and deployment requirements
3. Provision, configure and maintain AWS, Azure, GCP cloud infrastructure defined as code
4. Ensure configuration and compliance with configuration management tools
5. Administer and troubleshoot Linux based systems
6. Troubleshoot problems across a wide array of services and functional areas
7. Build and maintain operational tools for deployment, monitoring, and analysis of AWS, Azure Infrastructure and systems
8. Perform infrastructure cost analysis and optimization

Responsibilities

● Be a hands-on engineer, ensure frameworks/infrastructure built is well designed,

scalable & are of high quality.

● Build and/or operate platforms that are highly available, elastic, scalable, operable and

observable.

● Build/Adapt and implement tools that empower the TI AI engineering teams to

self-manage the infrastructure and services owned by them.

● You will identify, articulate, and lead various long-term tech vision, strategies,

cross-cutting initiatives and architecture redesigns.

● Design systems and make decisions that will keep pace with the rapid growth of TI AI.

● Document your work and decision-making processes, and lead presentations and

discussions in a way that is easy for others to understand.

● Available for on-call during emergencies to handle and resolve problems in a quick and

efficient manner.

Requirements

● 2+ years of Hands-on experience as a DevOps / Infrastructure engineer with AWS and

Kubernetes or similar infrastructure platforms. (preferably AWS)

● Hands-on with DevOps principles and practices ( Everything-as-a-code, CI/CD, Test

everything, proactive monitoring etc).

● Experience in building and operating distributed systems.

● Understanding of operating systems, virtualization, containerization and networks

preferable

● Hands-on coding on any of the languages like Python or GoLang.

● Familiarity with software engineering practices including unit testing, code reviews, and

design documentation.

● Strong debugging and problem-solving skills Curiosity about how things work and love to

share that knowledge with others.

Benefits :

● Work with a world class team working on a very forward looking problem

● Competitive Pay

● Flat hierarchy

● Health insurance for the family

• Design, Develop, deploy, and run operations of infrastructure services in the Acqueon AWS cloud environment
• Manage uptime of Infra & SaaS Application
• Implement application performance monitoring to ensure platform uptime and performance
• Building scripts for operational automation and incident response
• Handle schedule and processes surrounding cloud application deployment
• Define, measure, and meet key operational metrics including performance, incidents and chronic problems, capacity, and availability
• Lead the deployment, monitoring, maintenance, and support of operating systems (Windows, Linux)
• Build out lifecycle processes to mitigate risk and ensure platforms remain current, in accordance with industry standard methodologies
• Run incident resolution within the environment, facilitating teamwork with other departments as required
• Automate the deployment of new software to cloud environment in coordination with DevOps engineers
• Work closely with Presales, understand customer requirement to deploy in Production
• Lead and mentor a team of operations engineers
• Drive the strategy to evolve and modernize existing tools and processes to enable highly secure and scalable operations
• AWS infrastructure management, provisioning, cost management and planning
• Prepare RCA incident reports for internal and external customers
• Participate in product engineering meetings to ensure product features and patches comply with cloud deployment standards
• Troubleshoot and analyse performance issues and customer reported incidents working to restore services within the SLA
• Monthly SLA Performance reports

As a Cloud Operations Manager in Acqueon you will need…. 

• 8 years’ progressive experience managing IT infrastructure and global cloud environments such as AWS, GCP (must)
• 3-5 years management experience leading a Cloud Operations / Site Reliability / Production Engineering team working with globally distributed teams in a fast-paced environment
• 3-5 years’ experience in IAC (Terraform, K8)
• 3+ years end-to-end incident management experience
• Experience with communicating and presenting to all stakeholders
• Experience with Cloud Security compliance and audits
• Detail-oriented. The ideal candidate is one who naturally digs as deep as they need to understand the why
• Knowledge on GCP will be added advantage
• Manage and monitor customer instances for uptime and reliability
• Staff scheduling and planning to ensure 24x7x365 coverage for cloud operations
• Customer facing, excellent communication skills, team management, troubleshooting

DevOps Engineer 

Notice Period: 45 days / Immediate Joining

Banyan Data Services (BDS) is a US-based Infrastructure services Company, headquartered in San Jose, California, USA. It provides full-stack managed services to support business applications and data infrastructure. We do provide the data solutions and services on bare metal, On-prem, and all Cloud platforms. Our engagement service is built on the DevOps standard practice and SRE model.

We are looking for a DevOps Engineer to help us build functional systems that improve customer experience. we offer you an opportunity to join our rocket ship startup, run by a world-class executive team. We are looking for candidates that aspire to be a part of the cutting-edge solutions and services we offer, that address next-gen data evolution challenges. Candidates who are willing to use their experience in areas directly related to Infrastructure Services, Software as Service, and Cloud Services and create a niche in the market.

Key Qualifications

· 4+ years of experience as a DevOps Engineer with monitoring, troubleshooting, and diagnosing infrastructure systems.

· Experience in implementation of continuous integration and deployment pipelines using Jenkins, JIRA, JFrog, etc

· Strong experience in Linux/Unix administration.

· Experience with automation/configuration management using Puppet, Chef, Ansible, Terraform, or other similar tools.

· Expertise in multiple coding and scripting languages including Shell, Python, and Perl

· Hands-on experience Exposure to modern IT infrastructure (eg. Docker swarm/Mesos/Kubernetes/Openstack)

· Exposure to any of relation database technologies MySQL/Postgres/Oracle or any No-SQL database

· Worked on open-source tools for logging, monitoring, search engine, caching, etc.

· Professional Certificates in AWS or any other cloud is preferable

· Excellent problem solving and troubleshooting skills

· Must have good written and verbal communication skills

Key Responsibilities

Ambitious individuals who can work under their own direction towards agreed targets/goals.

 Must be flexible to work on the office timings to accommodate the multi-national client timings.

 Will be involved in solution designing from the conceptual stages through development cycle and deployments.

 Involve development operations & support internal teams

 Improve infrastructure uptime, performance, resilience, reliability through automation

 Willing to learn new technologies and work on research-orientated projects

 Proven interpersonal skills while contributing to team effort by accomplishing related results as needed.

 Scope and deliver solutions with the ability to design solutions independently based on high-level architecture.

 Independent thinking, ability to work in a fast-paced environment with creativity and brainstorming

http://www.banyandata.com" target="_blank">www.banyandata.com 

• Automate deployments of infrastructure components and repetitive tasks.
• Drive changes strictly via the infrastructure-as-code methodology.
• Promote the use of source control for all changes including application and system-level changes.
• Design & Implement self-recovering systems after failure events.
• Participate in system sizing and capacity planning of various components.
• Create and maintain technical documents such as installation/upgrade MOPs.
• Coordinate & collaborate with internal teams to facilitate installation & upgrades of systems.
• Support 24x7 availability for corporate sites & tools.
• Participate in rotating on-call schedules.
• Actively involved in researching, evaluating & selecting new tools & technologies.

• Cloud computing – AWS, OCI, OpenStack
• Automation/Configuration management tools such as Terraform & Chef
• Atlassian tools administration (JIRA, Confluence, Bamboo, Bitbucket)
• Scripting languages - Ruby, Python, Bash
• Systems administration experience – Linux (Redhat), Mac, Windows
• SCM systems - Git
• Build tools - Maven, Gradle, Ant, Make
• Networking concepts - TCP/IP, Load balancing, Firewall
• High-Availability, Redundancy & Failover concepts
• SQL scripting & queries - DML, DDL, stored procedures
• Decisive and ability to work under pressure
• Prioritizing workload and multi-tasking ability
• Excellent written and verbal communication skills

• Database systems – Postgres, Oracle, or other RDBMS
• Mac automation tools - JAMF or other
• Atlassian Datacenter products
• Project management skills

• 3+ years of hands-on experience in the field or related area
• Requires MS or BS in Computer Science or equivalent field

The expectation is to set up complete automation of CI/CD pipeline & monitoring and ensure high availability of the pipeline. The automated deployment environment can be on-prem or cloud (virtual instances, containerized and serverless). Complete test automation and ensure Security of Application as well as Infrastructure.

ROLES & RESPONSIBILITIES

Configure Jenkins with load distribution between master/slave Setting up the CI pipeline with Jenkins and Cloud(AWS or Azure) Code Build Static test (Quality & Security) Setting up Dynamic Test configuration with selenium and other tools Setting up Application and Infrastructure scanning for security. Post-deployment security plan including PEN test. Usage of RASP tool. Configure and ensure HA of the pipeline and monitoring Setting up composition analysis in the pipeline Setting up the SCM and Artifacts repository and management for branching, merging and archiving Must work in Agile environment using ALM tool like Jira DESIRED SKILLS

Extensive hands-on Continuous Integration and Continuous Delivery technology experience of .Net, Node, Java and C++ based projects(Web, mobile and Standalone). Experience configuring and managing

• ALM tools like Jira, TFS, etc.
• SCM such as GitHub, GitLab, CodeCommit
• Automation tools such as Terraform, CHEF, or Ansible
• Package repo configuration(Artifactory / Nexus), Package managers like Nuget & Chocholatey
• Database Configuration (sql & nosql), Web/Proxy Setup(IIS, Nginx, Varnish, Apache).

Deep knowledge of multiple monitoring tools and how to mine them for advanced data Prior work with Helm, Postgres, MySQL, Redis, ElasticSearch, microservices, message queues and related technologies Test Automation with Selenium / CuCumber; Setting up of test Simulators. AWS Certified Architect and/or Developer; Associate considered, Professional preferred Proficient in: Bash, Powershell, Groovy, YAML, Python, NodeJS, Web concepts such as REST APIs and Aware of MVC and SPA application design. TTD experience and quality control with Sonarqube or Checkmarx, Tics Tiobe and Coverity Thorough with Linux(Ubuntu, Debian CentOS), Docker(File/compose/volume), Kubernetes cluster setup Expert in Workflow tools: Jenkins(declarative, plugins)/TeamCity and Build Servers configuration Experience with AWS CloudFormation / CDK and delivery automation Ensure end-to-end deployments succeed and resources come up in an automated fashion Good to have ServiceNow configuration experience for collaboration

What you will get:

1. To be a part of the Core-Team 💪
2. A Chunk of ESOPs 🚀
3. Creating High Impact by Solving a Problem at Large (No one in the World has a similar product) 💥
4. High Growth Work Environment ⚙️

What we are looking for:

1. An 'Exceptional Executioner' -> Leader -> Create an Impact & Value 💰
2. Ability to take Ownership of your work
3. Past experience in leading a team