Sr. Data Engineer

DevOps Engineer

Our engineering team is looking for Big-Data DevOps engineers to join the engineering team and help us automate the build, release, packaging and infrastructure provisioning and support processes. The candidate is expected to own the full life-cycle of provisioning, configuration management, monitoring, maintenance and support for cloud as well as on premise deployments.

Responsibilities

• 3-plus years of DevOps experience managing the Big Data application stack including HDFS, YARN, Spark, Hive and Hbase
• Deeper understanding of all the configurations required for installing and maintaining the infrastructure in the long run
• Experience setting up high availability, configuring resource allocation, setting up capacity schedulers, handling data recovery tasks
• Experience with middle-layer technologies including web servers (httpd, ningx),

application servers (Jboss, Tomcat) and database systems (postgres, mysql)

• Experience setting up enterprise security solutions including setting up active directories, firewalls, SSL certificates, Kerberos KDC servers, etc.
• Experience maintaining and hardening the infrastructure by regularly applying required security packages and patches
• Experience supporting on-premise solutions as well as on AWS cloud
• Experience working with and supporting Spark-based applications on YARN
• Experience with one or more automation tools such as Ansible, Terraform, etc
• Experience working with CI/CD tools like Jenkins and various test report and coverage Plugins
• Experience defining and automating the build, versioning and release processes for complex enterprise products
• Experience supporting clients remotely and on-site
• Experience working with and supporting Java- and Python-based tech stacks would be a Plus

Job Purpose and Impact

The DevOps Engineer is a key position to strengthen the security automation capabilities which have been identified as a critical area for growth and specialization within Global IT’s scope. As part of the Cyber Intelligence Operation’s DevOps Team, you will be helping shape our automation efforts by building, maintaining and supporting our security infrastructure.

Key Accountabilities

• Collaborate with internal and external partners to understand and evaluate business requirements.
• Implement modern engineering practices to ensure product quality.
• Provide designs, prototypes and implementations incorporating software engineering best practices, tools and monitoring according to industry standards.
• Write well-designed, testable and efficient code using full-stack engineering capability.
• Integrate software components into a fully functional software system.
• Independently solve moderately complex issues with minimal supervision, while escalating more complex issues to appropriate staff.
• Proficiency in at least one configuration management or orchestration tool, such as Ansible.
• Experience with cloud monitoring and logging services.

Qualifications

Minimum Qualifications

• Bachelor's degree in a related field or equivalent exp
• Knowledge of public cloud services & application programming interfaces
• Working exp with continuous integration and delivery practices

Preferred Qualifications

• 3-5 years of relevant exp whether in IT, IS, or software development
• Exp in:
•  Code repositories such as Git
• Scripting languages (Python & PowerShell)
• Using Windows, Linux, Unix, and mobile platforms within cloud services such as AWS
• Cloud infrastructure as a service (IaaS) / platform as a service (PaaS), microservices, Docker containers, Kubernetes, Terraform, Jenkins
• Databases such as Postgres, SQL, Elastic

Client: Sony Corporation

Position: 3

Exp: 5-8Years

DevOps Engineer

Location: Bangalore

Budget: 16.5 LPA Max

Gerrit ,Jenkins, Rabbit MQ AWS Linux
Python ,Ansible, Tomcat ,Postgresql
Grafana ,Groovy,HTML,Shell,Apache,Git , ELK

Job description

The role requires you to design development pipelines from the ground up, Creation of Docker Files,  design and operate highly available systems in AWS Cloud environments. Also involves Configuration Management, Web Services Architectures, DevOps Implementation, Database management, Backups, and Monitoring.

Key responsibility area
- Ensure reliable operation of CI/CD pipelines
- Orchestrate the provisioning, load balancing, configuration, monitoring and billing of resources in the cloud environment in a highly automated manner
- Logging, metrics and alerting management.
- Creation of Bash/Python scripts for automation
- Performing root cause analysis for production errors.

Requirement
- 2 years experience as Team Lead.
- Good Command on kubernetes.
- Proficient in Linux Commands line and troubleshooting.
- Proficient in AWS Services. Deployment, Monitoring and troubleshooting applications in AWS.
- Hands-on experience with CI tooling preferably with Jenkins. 
- Proficient in deployment using Ansible.
- Knowledge of infrastructure management tools (Infrastructure as cloud) such as terraform, AWS cloudformation etc.
- Proficient in deployment of applications behind load balancers and proxy servers such as nginx, apache. 
- Scripting languages: Bash, Python, Groovy.
- Experience with Logging, Monitoring, and Alerting tools like ELK(Elastic-search, Logstash, Kibana), Nagios. Graylog, splunk Prometheus, Grafana is a plus.

Must Have:
Linux, CI/CD(Jenkin), AWS, Scripting(Bash,shell Python, Go), Ngnix, Docker.

Good to have
Configuration Management(Ansible or similar tool), Logging tool( ELK or similar), Monitoring tool(Ngios or similar), IaC(Terraform, cloudformation).

Job Summary

You'd be meticulously analyzing project requirements and carry forward the development of highly robust, scalable and easily maintainable backend applications, work independently, and you'll have the support & opportunity to thrive in a fast-paced environment.

Responsibilities and Duties:

• building and setting up new development tools and infrastructure
• understanding the needs of stakeholders and conveying this to developers
• working on ways to automate and improve development and release processes
• testing and examining code written by others and analysing results
• ensuring that systems are safe and secure against cybersecurity threats
• identifying technical problems and developing software updates and ‘fixes’
• working with software developers and software engineers to ensure that development follows established processes and works as intended
• planning out projects and being involved in project management decisions

Skill Requirements:

1. Managing GitHub (example: - creating branches for test, QA, development and production, creating Release tags, resolve merge conflict)
2. Setting up of the servers based on the projects in either AWS or Azure (test, development, QA, staging and production)
3. AWS S3 configuring and s3 web hosting, Archiving data from s3 to s3-glacier
4. Deploying the build(application) to the servers using AWS CI/CD and Jenkins (Automated and manual)
5. AWS Networking and Content delivery (VPC, Route 53 and CloudFront)
6. Managing databases like RDS, Snowflake, Athena, Redis and Elasticsearch
7. Managing IAM roles and policies for the functions like Lambda, SNS, aws cognito, secret manager, certificate manager, Guard Duty, Inspector EC2 and S3.
8. AWS Analytics (Elasticsearch, Athena, Glue and kinesis).
9. AWS containers (elastic container registry, elastic container service, elastic Kubernetes service, Docker Hub and Docker compose
10. AWS Auto scaling group (launch configuration, launch template) and load balancer
11. EBS (snapshots, volumes and AMI.)
12. AWS CI/CD build spec scripting, Jenkins groovy scripting, shell scripting and python scripting.
13. Sagemaker, Textract, forecast, LightSail
14. Android and IOS automation building
15. Monitoring tools like cloudwatch, cloudwatch log group, Alarm, metric dashboard, SNS(simple notification service), SES(simple email service)
16. Amazon MQ
17. Operating system Linux and windows
18. X-Ray, Cloud9, Codestar
19. Fluent Shell Scripting
20. Soft Skills
21. Scripting Skills , Good to have knowledge (Python, Javascript, Java,Node.js)
22. Knowledge On Various DevOps Tools And Technologies

Qualifications and Skills

Job Type: Full-time

Experience: 4 - 7 yrs

Qualification: BE/ BTech/MCA.

Location: Bengaluru, Karnataka

Designation : DevOp Engineer

Location : HSR, Bangalore

About the Company

Making impact driven by Data. 

Vumonic Datalabs is a data-driven startup providing business insights to e-commerce & e-tail companies to help them make data-driven decisions to scale up their business and understand their competition better. As one of the EU's fastest growing (and coolest) data companies, we believe in revolutionizing the way businesses make their most important business decisions by providing first-hand transaction based insights in real-time.. 

About the Role

We are looking for an experienced and ambitious DevOps engineer who will be responsible for deploying product updates, identifying production issues and implementing integrations that meet our customers' needs. As a DevOps engineer at Vumonic Datalabs, you will have the opportunity to work with a thriving global team to help us build functional systems that improve customer experience. If you have a strong background in software engineering, are hungry to learn, compassionate about your work and are familiar with the mentioned technical skills, we’d love to speak with you.

What you’ll do

• Optimize and engineer the Devops infrastructure for high availability, scalability and reliability.
• Monitor Logs on servers & Cloud management
• Build and set up new development tools and infrastructure to reduce occurrences of errors 
• Understand the needs of stakeholders and convey this to developers
• Design scripts to automate and improve development and release processes
• Test and examine codes written by others and analyze results
• Ensure that systems are safe and secure against cybersecurity threats
• Identify technical problems, perform root cause analysis for production errors and develop software updates and ‘fixes’
• Work with software developers, engineers to ensure that development follows established processes and actively communicates with the operations team.
• Design procedures for system troubleshooting and maintenance.

What you need to have

TECHNICAL SKILLS

• Experience working with the following tools : Google Cloud Platform, Kubernetes, Docker, Elastic Search, Terraform, Redis

• Experience working with following tools preferred : Python, Node JS, Mongo-DB, Rancher, Cassandra
• Experience with real-time monitoring of cloud infrastructure using publicly available tools and servers
• 2 or more years of experience as a DevOp (startup/technical experience preferred)

You are

• Excited to learn, are a hustler and “Do-er”
• Passionate about building products that create impact.
• Updated with the latest technological developments & enjoy upskilling yourself with market trends.
• Willing to experiment with novel ideas & take calculated risks.
• Someone with a problem-solving attitude with the ability to handle multiple tasks while meeting expected deadlines.
• Interested to work as part of a supportive, highly motivated and fun team.

• You have experience of 2-4 years in building high-performance consumer-facing mobile applications at Product companies of a decent scale.
• You can write code preferably in Golang and Python.
• You have experience with debugging production issues and writing RCAs.
• You have demonstrable stories of being on-call and how outages have been handled.
• You have experience developing products on Kubernetes and cloud providers like GCP and AWS.
• You have worked with Cloud Native (CNCF) technologies.
• You have experience automating CI/CD pipelines.
• You are an excellent collaborator & communicator. You know that start-ups are a team sport.
• You listen to others, aren’t afraid to speak your mind and always try to ask the right questions.
• You are excited by the prospect of working in a distributed team and company

Creates, modifies, and maintains software applications individually or as part of a team.  Provides technical leadership on a team, including training and mentoring of other team members.  Provides technology and architecture direction for the team, department, and organization.

• Develops software applications and supporting infrastructure using established coding standards and methodologies
• Sets example for software quality through multiple levels of automated tests, including but not limited to unit, API, End to End, and load.
• Self-starter and self-organized - able to work without supervision
• Develops tooling, test harnesses and innovative solutions to understand and monitor the quality of the product 
• Develops infrastructure as code to reliably deploy applications on demand or through automation
• Understands cloud managed services and builds scalable and secure applications using them
• Creates proof of concepts for new ideas that answer key questions of feasibility, desirability, and viability
• Work with other technical leaders to establish coding standards, development best practices and technology direction
• Performs thorough code reviews that promote better understanding throughout the team
• Work with architects, designers, business analysts and others to design and implement high quality software solutions
• Builds intuitive user interfaces with the end user persona in mind using front end frameworks and styling
• Assist product owners in backlog grooming, story breakdown and story estimation
• Collaborate and communicate effectively with team members and other stakeholders throughout the organization
• Document software changes for use by other engineers, quality assurance and documentation specialists
• Master the technologies, languages, and practices used by the team and project assigned
• Train others in the technologies, languages, and practices used by the team
• Trouble shoot, instrument and debug existing software resolving root causes of defective behavior
• Guide the team in setting up the infrastructure in the cloud.
• Setup the security protocols for the cloud infrastructure
• Works with the team in setting up the data hub in the cloud
• Create dashboards for the visibility of the various interactions between the cloud services
• Other duties as assigned

• BA/BS in Computer Science, a related field or equivalent work experience

• Mastered advanced programming concepts, including object oriented programming
• Mastered technologies and tools utilized by team and project assigned
• Able to train others on general programming concepts and specific technologies
• Minimum 8 years’ experience developing software applications

• Must be expert in advanced programming skills and database technology
• Must be expert in at least one technology and/or language and proficient in multiple technologies and languages:
• (Specific languages needed will vary based on development department or project)
• .Net Core, C#, Java, SQL, JavaScript, Typescript, Python
• Additional desired skills:
  • Single-Page Applications, Angular (v9), Ivy, RXJS, NGRX, HTML5, CSS/SASS, Web Components, Atomic Design
  • Test First approach, Test Driven Development (TDD), Automated testing (Protractor, Jasmine), Newman Postman, artillery.io
  • Microservices, Terraform, Jenkins, Jupyter Notebook, Docker, NPM, Yarn, Nuget, NodeJS, Git/Gerrit, LaunchDarkly
  • Amazon Web Services (AWS), Lambda, S3, Cognito, Step Functions, SQS, IAM, Cloudwatch, Elasticache
  • Database Design, Optimization, Replication, Partitioning/Sharding, NoSQL, PostgreSQL, MongoDB, DynamoDB, Elastic Search, PySpark, Kafka
  • Agile, Scrum, Kanban, DevSecOps
• Strong problem-solving skills
• Outstanding communications and interpersonal skills
• Strong organizational skills and ability to multi-task
• Ability to track software issues to successful resolution
• Ability to work in a collaborative fast paced environment
• Setting up complex AWS data storage hub
• Well versed in setting up infrastructure security in the interactions between the planned components
• Experienced in setting up dashboards for analyzing the various operations in the AWS infra setup.
• Ability to learn new development language quickly and apply that knowledge effectively

We are a growth-oriented, dynamic, multi-national startup, so those that are looking for that startup excitement, dynamics, and buzz are here at the right place. Read on -

FrontM (http://www.frontm.com/" target="_blank">www.frontm.com) is an edge AI company with a platform that is redefining how businesses and people in remote and isolated environments (maritime, aviation, mining....) collaborate and drive smart decisions.

Successful candidate will lead the back end architecture working alongside VP of delivery, CTO and CEO

The problem you will be working on:

- Take ownership of AWS cloud infrastructure

- Overlook tech ops with hands-on CI/CD and administration

- Develop Node.js Java and backend system procedures for stability, scale and performance

- Understand FrontM platform roadmap and contribute to planning strategic and tactical capabilities

- Integrate APIs and abstractions for complex requirements

Who you are:

- You are an experienced Cloud Architect and back end developer

- You have experience creating AWS Serverless Lambdas EC2 MongoDB backends

- You have extensive CI/CD and DevOps experience

- You can take ownership of continuous server uptime, maintenance, stability and performance

- You can lead a team of backend developers and architects

- You are a die-hard problem solver and never-say-no person

- You have 10+ years experience

- You are very sound in English language

- You have the ability to initiate and lead teams working with senior management

Additional benefits

- Generous pay package, flexible for the right candidate

- Career development and growth planning

- Entrepreneurial environment that nurtures and promotes innovation

- Multi-national team with an enjoyable culture

We'd love to talk to you if you find this interesting and like to join in on our exciting journey