Sr. Data Engineer

About Lean Technologies

Lean is on a mission to revolutionize the fintech industry by providing developers with a universal API to access their customers' financial accounts across the Middle East. We’re breaking down infrastructure barriers and empowering the growth of the fintech industry. With Sequoia leading our $33 million Series A round, Lean is poised to expand its coverage across the region while continuing to deliver unparalleled value to developers and stakeholders.

Join us and be part of a journey to enable the next generation of financial innovation. We offer competitive salaries, private healthcare, flexible office hours, and meaningful equity stakes to ensure long-term alignment. At Lean, you'll work on solving complex problems, build a lasting legacy, and be part of a diverse, inclusive, and equal opportunity workplace.

About the role:

Are you a highly motivated and experienced software engineer looking to take your career to the next level? Our team at Lean is seeking a talented engineer to help us build the distributed systems that allow our engineering teams to deploy our platform in multiple geographies across various deployment solutions. You will work closely with functional heads across software, QA, and product teams to deliver scalable and customizable release pipelines.

Responsibilities

• Distributed systems architecture – understand and manage the most complex systems
• Continual reliability and performance optimization – enhancing observability stack to improve proactive detection and resolution of issues
• Employing cutting-edge methods and technologies, continually refining existing tools to enhance performance and drive advancements
• Problem-solving capabilities – troubleshooting complex issues and proactively reducing toil through automation
• Experience in technical leadership and setting technical direction for engineering projects
• Collaboration skills – working across teams to drive change and provide guidance
• Technical expertise – depth skills and ability to act as subject matter expert in one or more of: IAAC, observability, coding, reliability, debugging, system design
• Capacity planning – effectively forecasting demand and reacting to changes
• Analyze and improve efficiency, scalability, and stability of various system resources
• Incident response – rapidly detecting and resolving critical incidents. Minimizing customer impact through effective collaboration, escalation (including periodic on-call shifts) and postmortems

Requirements

• 10+ years of experience in Systems Engineering, DevOps, or SRE roles running large-scale infrastructure, cloud, or web services
• Strong background in Linux/Unix Administration and networking concepts
• We work on OCI but would accept candidates with solid GCP/AWS or other cloud providers’ knowledge and experience
• 3+ years of experience with managing Kubernetes clusters, Helm, Docker
• Experience in operating CI/CD pipelines that build and deliver services on the cloud and on-premise
• Work with CI/CD tools/services like Jenkins/GitHub-Actions/ArgoCD etc.
• Experience with configuration management tools either Ansible, Chef, Puppet, or equivalent
• Infrastructure as Code - Terraform
• Experience in production environments with both relational and NoSQL databases
• Coding with one or more of the following: Java, Python, and/or Go

Bonus

• MultiCloud or Hybrid Cloud experience
• OCI and GCP

Why Join Us?

At Lean, we value talent, drive, and entrepreneurial spirit. We are constantly on the lookout for individuals who identify with our mission and values, even if they don’t meet every requirement. If you're passionate about solving hard problems and building a legacy, Lean is the right place for you. We are committed to equal employment opportunities regardless of race, color, ancestry, religion, gender, sexual orientation, or disability.

Key Sills Required for Lead DevOps Engineer

Containerization Technologies

Docker, Kubernetes, OpenShift

Cloud Technologies

AWS/Azure, GCP

CI/CD Pipeline Tools

Jenkins, Azure Devops

Configuration Management Tools

Ansible, Chef,

SCM Tools

Git, GitHub, Bitbucket

Monitoring Tools

New Relic, Nagios, Prometheus

Cloud Infra Automation

Terraform

Scripting Languages

Python, Shell, Groovy

·       Ability to decide the Architecture for the project and tools as per the availability

·       Sound knowledge required in the deployment strategies and able to define the timelines

·       Team handling skills are a must

·       Debugging skills are an advantage

·       Good to have knowledge of Databases like Mysql, Postgresql

It is advantageous to be familiar with Kafka. RabbitMQ

·       Good to have knowledge of Web servers to deploy web applications

·       Good to have knowledge of Code quality checking tools like SonarQube and Vulnerability scanning

·       Advantage to having experience in DevSecOps

Note: Tools mentioned in bold are a must and others are added advantage

Roles and Responsibilities:

• Gather and analyse cloud infrastructure requirements

• Automating system tasks and infrastructure using a scripting language (Shell/Python/Ruby

preferred), with configuration management tools (Ansible/ Puppet/Chef), service registry and

discovery tools (Consul and Vault, etc), infrastructure orchestration tools (Terraform,

CloudFormation), and automated imaging tools (Packer)

• Support existing infrastructure, analyse problem areas and come up with solutions

• An eye for monitoring – the candidate should be able to look at complex infrastructure and be

able to figure out what to monitor and how.

• Work along with the Engineering team to help out with Infrastructure / Network automation needs.

• Deploy infrastructure as code and automate as much as possible

• Manage a team of DevOps

Desired Profile:

• Understanding of provisioning of Bare Metal and Virtual Machines

• Working knowledge of Configuration management tools like Ansible/ Chef/ Puppet, Redfish.

• Experience in scripting languages like Ruby/ Python/ Shell Scripting

• Working knowledge of IP networking, VPN's, DNS, load balancing, firewalling & IPS concepts

• Strong Linux/Unix administration skills.

• Self-starter who can implement with minimal guidance

• Hands-on experience setting up CICD from SCRATCH in Jenkins

• Experience with Managing K8s infrastructure

We are looking for a DevOps Engineer for managing the interchange of data between the server and the users. Your primary responsibility will be the development of all server-side logic, definition, and maintenance of the central database, and ensuring high performance and responsiveness to request from the frontend. You will also be responsible for integrating the front-end elements built by your co-workers into the application. Therefore, a basic understanding of frontend technologies is necessary as well.

What we are looking for

• Must have strong knowledge of Kubernetes and Helm3
• Should have previous experience in Dockerizing the applications.
• Should be able to automate manual tasks using Shell or Python
• Should have good working knowledge on AWS and GCP clouds
• Should have previous experience working on Bitbucket, Github, or any other VCS.
• Must be able to write Jenkins Pipelines and have working knowledge on GitOps and ArgoCD.
• Have hands-on experience in Proactive monitoring using tools like NewRelic, Prometheus, Grafana, Fluentbit, etc.
• Should have a good understanding of ELK Stack.
• Exposure on Jira, confluence, and Sprints.

What you will do:

• Mentor junior Devops engineers and improve the team’s bar
• Primary owner of tech best practices, tech processes, DevOps initiatives, and timelines
• Oversight of all server environments, from Dev through Production.
• Responsible for the automation and configuration management
• Provides stable environments for quality delivery
• Assist with day-to-day issue management.
• Take lead in containerising microservices
• Develop deployment strategies that allow DevOps engineers to successfully deploy code in any environment.
• Enables the automation of CI/CD
• Implement dashboard to monitors various
• 1-3 years of experience in DevOps
• Experience in setting up front end best practices
• Working in high growth startups
• Ownership and Be Proactive.
• Mentorship & upskilling mindset.
• systems and applications
• 
  what you’ll get
  • Health Benefits
  • Innovation-driven culture
  • Smart and fun team to work with
  • Friends for life

Cloud Software Engineer

Notice Period: 45 days / Immediate Joining

Banyan Data Services (BDS) is a US-based Infrastructure services Company, headquartered in San Jose, California, USA. It provides full-stack managed services to support business applications and data infrastructure.  We do provide the data solutions and services on bare metal, On-prem, and all Cloud platforms.  Our engagement service is built on the DevOps standard practice and SRE model.

We offer you an opportunity to join our rocket ship startup, run by a world-class executive team. We are looking for candidates that aspire to be a part of the cutting-edge solutions and services we offer, that address next-gen data evolution challenges. Candidates who are willing to use their experience in areas directly related to Infrastructure Services, Software as Service, and Cloud Services and create a niche in the market.

Roles and Responsibilities

· A wide variety of engineering projects including data visualization, web services, data engineering, web-portals, SDKs, and integrations in numerous languages, frameworks, and clouds platforms

· Apply continuous delivery practices to deliver high-quality software and value as early as possible.

· Work in collaborative teams to build new experiences

· Participate in the entire cycle of software consulting and delivery from ideation to deployment

· Integrating multiple software products across cloud and hybrid environments

· Developing processes and procedures for software applications migration to the cloud, as well as managed services in the cloud

· Migrating existing on-premises software applications to cloud leveraging a structured method and best practices

Desired Candidate Profile : *** freshers can also apply ***

· 2+years of experience with 1 or more development languages such as Java, Python, or Spark.

· 1 year + of experience with private/public/hybrid cloud model design, implementation, orchestration, and support.

· Certification or any training's completion of any one of the cloud environments like AWS, GCP, Azure, Oracle Cloud, and Digital Ocean.

· Strong problem-solvers who are comfortable in unfamiliar situations, and can view challenges through multiple perspectives

· Driven to develop technical skills for oneself and team-mates

· Hands-on experience with cloud computing and/or traditional enterprise datacentre technologies, i.e., network, compute, storage, and virtualization.

· Possess at least one cloud-related certification from AWS, Azure, or equivalent

· Ability to write high-quality, well-tested code and comfort with Object-Oriented or functional programming patterns

· Past experience quickly learning new languages and frameworks

· Ability to work with a high degree of autonomy and self-direction

http://www.banyandata.com" target="_blank">www.banyandata.com 

Role 

We are looking for an experienced DevOps engineer that will help our team establish DevOps practice. You will work closely with the technical lead to identify and establish DevOps practices in the company.

You will also help us build scalable, efficient cloud infrastructure. You’ll implement monitoring for automated system health checks. Lastly, you’ll build our CI pipeline, and train and guide the team in DevOps practices.

This would be a hybrid role and the person would be expected to also do some application level programming in their downtime.

Responsibilities

• Deployment, automation, management, and maintenance of production systems.
• Ensuring availability, performance, security, and scalability of production systems.
• Evaluation of new technology alternatives and vendor products.
• System troubleshooting and problem resolution across various application domains and platforms.
• Providing recommendations for architecture and process improvements.
• Definition and deployment of systems for metrics, logging, and monitoring on AWS platform.
• Manage the establishment and configuration of SaaS infrastructure in an agile way by storing infrastructure as code and employing automated configuration management tools with a goal to be able to re-provision environments at any point in time.
• Be accountable for proper backup and disaster recovery procedures.
• Drive operational cost reductions through service optimizations and demand based auto scaling.
• Have on call responsibilities.
• Perform root cause analysis for production errors
• Uses open source technologies and tools to accomplish specific use cases encountered within the project.
• Uses coding languages or scripting methodologies to solve a problem with a custom workflow.

Requirements

• Systematic problem-solving approach, coupled with strong communication skills and a sense of ownership and drive.

• Prior experience as a software developer in a couple of high level programming languages.

• Extensive experience in any Javascript based framework since we will be deploying services to NodeJS on AWS Lambda (Serverless)

• Extensive experience with web servers such as Nginx/Apache

• Strong Linux system administration background.
• Ability to present and communicate the architecture in a visual form.
• Strong knowledge of AWS (e.g. IAM, EC2, VPC, ELB, ALB, Autoscaling, Lambda, NAT gateway, DynamoDB)
• Experience maintaining and deploying highly-available, fault-tolerant systems at scale (~ 1 Lakh users a day)
• A drive towards automating repetitive tasks (e.g. scripting via Bash, Python, Ruby, etc)
• Expertise with Git
• Experience implementing CI/CD (e.g. Jenkins, TravisCI)
• Strong experience with databases such as MySQL, NoSQL, Elasticsearch, Redis and/or Mongo.
• Stellar troubleshooting skills with the ability to spot issues before they become problems.
• Current with industry trends, IT ops and industry best practices, and able to identify the ones we should implement.
• Time and project management skills, with the capability to prioritize and multitask as needed.

Total Experience: 6 – 12 Years

Required Skills and Experience 

• 3+ years of relevant experience with DevOps tools Jenkins, Ansible, Chef etc
• 3+ years of experience in continuous integration/deployment and software tools development experience with Python and shell scripts etc
• Building and running Docker images and deployment on Amazon ECS
• Working with AWS services (EC2, S3, ELB, VPC, RDS, Cloudwatch, ECS, ECR, EKS)
• Knowledge and experience working with container technologies such as Docker and Amazon ECS, EKS, Kubernetes
• Experience with source code and configuration management tools such as Git, Bitbucket, and Maven
• Ability to work with and support Linux environments (Ubuntu, Amazon Linux, CentOS)
• Knowledge and experience in cloud orchestration tools such as AWS Cloudformation/Terraform etc
• Experience with implementing "infrastructure as code", “pipeline as code” and "security as code" to enable continuous integration and delivery
• Understanding of IAM, RBAC, NACLs, and KMS
• Good communication skills

Good to have:

• Strong understanding of security concepts, methodologies and apply them such as SSH, public key encryption, access credentials, certificates etc.
• Knowledge of database administration such as MongoDB.
• Knowledge of maintaining and using tools such as Jira, Bitbucket, Confluence.

Responsibilities

• Work with Leads and Architects in designing and implementation of technical infrastructure, platform, and tools to support modern best practices and facilitate the efficiency of our development teams through automation, CI/CD pipelines, and ease of access and performance.
• Establish and promote DevOps thinking, guidelines, best practices, and standards.
• Contribute to architectural discussions, Agile software development process improvement, and DevOps best practices.