Sr. Data Engineer

Preferred Education & Experience: 
• Bachelor’s or master’s degree in Computer Engineering,
Computer Science, Computer Applications, Mathematics, Statistics or related technical field or
equivalent practical experience. Relevant experience of at least 3 years in lieu of above if from a
different stream of education.
• Well-versed in DevOps principals & practices and hands-on DevOps
tool-chain integration experience: Release Orchestration & Automation, Source Code & Build
Management, Code Quality & Security Management, Behavior Driven Development, Test Driven
Development, Continuous Integration, Continuous Delivery, Continuous Deployment, and
Operational Monitoring & Management; extra points if you can demonstrate your knowledge with
working examples.
• Hands-on experience with demonstrable working experience with DevOps tools
and platforms viz., Slack, Jira, GIT, Jenkins, Code Quality & Security Plugins, Maven, Artifactory,
Terraform, Ansible/Chef/Puppet, Spinnaker, Tekton, StackStorm, Prometheus, Grafana, ELK,
PagerDuty, VictorOps, etc.
• Well-versed in Virtualization & Containerization; must demonstrate
experience in technologies such as Kubernetes, Istio, Docker, OpenShift, Anthos, Oracle VirtualBox,
Vagrant, etc.
• Well-versed in AWS and/or Azure or and/or Google Cloud; must demonstrate
experience in at least FIVE (5) services offered under AWS and/or Azure or and/or Google Cloud in
any categories: Compute or Storage, Database, Networking & Content Delivery, Management &
Governance, Analytics, Security, Identity, & Compliance (or) equivalent demonstratable Cloud
Platform experience.
• Well-versed with demonstrable working experience with API Management,
API Gateway, Service Mesh, Identity & Access Management, Data Protection & Encryption, tools &
platforms.
• Hands-on programming experience in either core Java and/or Python and/or JavaScript
and/or Scala; freshers passing out of college or lateral movers into IT must be able to code in
languages they have studied.
• Well-versed with Storage, Networks and Storage Networking basics
which will enable you to work in a Cloud environment.
• Well-versed with Network, Data, and
Application Security basics which will enable you to work in a Cloud as well as Business
Applications / API services environment.
• Extra points if you are certified in AWS and/or Azure
and/or Google Cloud.

Candidates MUST HAVE : 

• Experience with Infrastructure-as-Code tools(IaS) like Terraform and Cloud Formation.
• Proficiency in cloud-native technologies and architectures (Docker/ Kubernetes), Ci/CD pipelines.
• Good experience in Javascript.
• Expertise in Linux / Windows environment.
• Good Experience in Scripting languages like PowerShell / Bash/ Python.
• Proficiency in revision control and DevOps best practices like Git

DevOps Engineer

Our engineering team is looking for Big-Data DevOps engineers to join the engineering team and help us automate the build, release, packaging and infrastructure provisioning and support processes. The candidate is expected to own the full life-cycle of provisioning, configuration management, monitoring, maintenance and support for cloud as well as on premise deployments.

 

Responsibilities

 

• 3-plus years of DevOps experience managing the Big Data application stack including HDFS, YARN, Spark, Hive and Hbase
• Deeper understanding of all the configurations required for installing and maintaining the infrastructure in the long run
• Experience setting up high availability, configuring resource allocation, setting up capacity schedulers, handling data recovery tasks
• Experience with middle-layer technologies including web servers (httpd, ningx),

application servers (Jboss, Tomcat) and database systems (postgres, mysql)

• Experience setting up enterprise security solutions including setting up active directories, firewalls, SSL certificates, Kerberos KDC servers, etc.
• Experience maintaining and hardening the infrastructure by regularly applying required security packages and patches
• Experience supporting on-premise solutions as well as on AWS cloud
• Experience working with and supporting Spark-based applications on YARN
• Experience with one or more automation tools such as Ansible, Terraform, etc
• Experience working with CI/CD tools like Jenkins and various test report and coverage Plugins
• Experience defining and automating the build, versioning and release processes for complex enterprise products
• Experience supporting clients remotely and on-site
• Experience working with and supporting Java- and Python-based tech stacks would be a Plus

 

Job Description:

Responsibilities

·       Having E2E responsibility for Azure landscape of our customers

·       Managing to code release and operational tasks within a global team with a focus on automation, maintainability, security and customer satisfaction

·       Make usage of CI/CD framework to rapidly support lifecycle management of the platform

·       Acting as L2-L3 support for incidents, problems and service request

·       Work with various Atos and 3rd party teams to resolve incidents and implement changes

·       Implement and drive automation and self-healing solutions to reduce toil

·       Enhance error budgets and hands on design and development of solutions to address reliability issues and/or risks

·       Support ITSM processes and collaborate with service management representatives

 

Job Requirements

·       Azure Associate certification or equivalent knowledge level

·       5+ years of professional experience

·       Experience with Terraform and/or native Azure automation

·       Knowledge of CI/CD concepts and toolset (i.e. Jenkins, Azure DevOps, Git)

·       Must be adaptable to work in a varied, fast paced exciting, ever changing environment

·       Good analytical and problem-solving skills to resolve technical issues

·       Understanding of Agile development and SCRUM concepts a plus

·       Experience with Kubernetes architecture and tools a plus

Client: Sony Corporation

Position: 3

Exp: 5-8Years

DevOps Engineer

Location: Bangalore

Budget: 16.5 LPA Max

 

Gerrit ,Jenkins, Rabbit MQ AWS Linux
Python ,Ansible, Tomcat ,Postgresql
Grafana ,Groovy,HTML,Shell,Apache,Git , ELK

 

You will work on: 

 

You will be working on some of our clients massive scale Infrastructure and DevOps requirements - designing for microservices and large scale data analytics. You will be working on enterprise scale problems - but will be part of our agile team that delivers like a startup. You will have opportunity to be part of team that's building and managing large private cloud.

 
What you will do (Responsibilities):

• Work on cloud marketplace enablements for some of our clients products
• Write Kubernetes Operators to automate custom PaaS solutions
•  Participate in cloud projects to implement new technology solutions, Proof of concepts to improve cloud technology offerings.               
• Work with developers to deploy to private or public cloud/on-premise services, debug and resolve issues. 
• On call responsibilities to respond to emergency situations and scheduled maintenance. 
• Contribute to and maintain documentation for systems, processes, procedures and infrastructure configuration 

 

What you bring (Skills):
 

•  Experience with administering of and debugging on Linux based systems with programming skills in Scripting, Golang, Python among others
•  Expertise in Git repositories specifically on GitHub, Gitlab, Bitbucket, Gerrit 
•  Comfortable with DevOps for  Big Data databases like Terradata, Netezza, Hadoop based ecosystems,   BigQuery, RedShift among others
• Comfortable in interfacing with SQL and No-SQL databases like MySQL, Postgres, MongoDB, ElasticSearch, Redis 

 

Great if you know (Skills):

• Understanding various build and CI/CD systems – Maven, Gradle, Jenkins, Gitlab CI, Spinnaker or Cloud based build systems 
• Exposure to deploying and automating on any public cloud – GCP, Azure or AWS 
• Private cloud experience – VMWare or OpenStack 
• Big DataOps experience – managing infrastructure and processes for Apache Airflow, Beam, Hadoop clusters 
• Containerized applications – Docker based image builds and maintainenace. 
• Kubernetes applications – deploy and develop operators, helm charts, manifests among other artifacts. 

 

Advantage Cognologix:

•  Higher degree of autonomy, startup culture & small teams 
•  Opportunities to become expert in emerging technologies 
•  Remote working options for the right maturity level 
•  Competitive salary & family benefits 
•  Performance based career advancement 

 

About Cognologix: 

Cognologix helps companies disrupt by reimagining their business models and innovate like a Startup. We are at the forefront of digital disruption and take a business first approach to help meet our client’s strategic goals.

We are DevOps focused organization helping our clients focus on their core product activities by handling all aspects of their infrastructure, integration and delivery.

Benefits Working With Us:

• Health & Wellbeing
• Learn & Grow
• Evangelize 
• Celebrate Achievements
• Financial Wellbeing
• Medical and Accidental cover.
• Flexible Working Hours.
• Sports Club & much more.

• Cloud and virtualization-based technologies (Amazon Web Services (AWS), VMWare).
• Java Application Server Administration (Weblogic, WidlFfy, JBoss, Tomcat).
• Docker and Kubernetes (EKS)
• Linux/UNIX Administration (Amazon Linux and RedHat).
• Developing and supporting cloud infrastructure designs and implementations and guiding application development teams.
• Configuration Management tools (Chef or Puppet or ansible).
• Log aggregations tools such as Elastic and/or Splunk.
• Automate infrastructure and application deployment-related tasks using terraform.
• Automate repetitive tasks required to maintain a secure and up-to-date operational environment.

Responsibilities

• Build and support always-available private/public cloud-based software-as-a-service (SaaS) applications.
• Build AWS or other public cloud infrastructure using Terraform.
• Deploy and manage Kubernetes (EKS) based docker applications in AWS.
• Create custom OS images using Packer.
• Create and revise infrastructure and architectural designs and implementation plans and guide the implementation with operations.
• Liaison between application development, infrastructure support, and tools (IT Services) teams.
• Development and documentation of Chef recipes and/or ansible scripts. Support throughout the entire deployment lifecycle (development, quality assurance, and production).
• Help developers leverage infrastructure, application, and cloud platform features and functionality participate in code and design reviews, and support developers by building CI/CD pipelines using Bamboo, Jenkins, or Spinnaker.
• Create knowledge-sharing presentations and documentation to help developers and operations teams understand and leverage the system's capabilities.
• Learn on the job and explore new technologies with little supervision.
• Leverage scripting (BASH, Perl, Ruby, Python) to build required automation and tools on an ad-hoc basis.

Who we have in mind:

• Solid experience in building a solution on AWS or other public cloud services using Terraform.
• Excellent problem-solving skills with a desire to take on responsibility.
• Extensive knowledge in containerized application and deployment in Kubernetes
• Extensive knowledge of the Linux operating system, RHEL preferred.
• Proficiency with shell scripting.
• Experience with Java application servers.
• Experience with GiT and Subversion.
• Excellent written and verbal communication skills with the ability to communicate technical issues to non-technical and technical audiences.
• Experience working in a large-scale operational environment.
• Internet and operating system security fundamentals.
• Extensive knowledge of massively scalable systems. Linux operating system/application development desirable.
• Programming in scripting languages such as Python. Other object-oriented languages (C++, Java) are a plus.
• Experience with Configuration Management Automation tools (chef or puppet).
• Experience with virtualization, preferably on multiple hypervisors.
• BS/MS in Computer Science or equivalent experience.
• Excellent written and verbal skills.

Education or Equivalent Experience:

• Bachelor's degree or equivalent education in related fields
• Certificates of training in associated fields/equipment’s

 

 

Position Summary:
You will be responsible for
1. Setting up, maintaining cloud (AWS/GCP/Azure) and kubernetes cluster and automating
their operation
2. All operational aspects of devtron platform including maintenance, upgrades,
automation.
3. Providing kubernetes expertise to facilitate smooth and fast customer onboarding on
devtron platform
Responsibilities:
1. Manage devtron platform on multiple kubernetes clusters
2. Designing and embedding industry best practices for online services including disaster
recovery, business continuity, monitoring/alerting, and service health measurement
3. Providing operational support for day to day activities involving the deployment of
services
4. Identify opportunities for improving the security, reliability, and scalability of the platform
5. Facilitate smooth and fast customer onboarding on devtron platform
6. Drive customer engagement
Requirements:
● Bachelor's Degree in Computer Science or a related field.
● 2+ years working as a devops engineer
● Proficient in 1 or more programming languages (e.g. Python, Go, Ruby).
● Familiar with shell scripts, Linux commands, network fundamentals
● Understanding of large scale distributed systems
● Basic understanding of cloud computing (AWS/GCP/Azure)
Preferred Qualifications:
● Great analytical and interpersonal skills
● Passion for creating efficient, reliable, reusable programs/scripts.
● Excited about technology, have a strong interest in learning about and playing with the
latest technologies and doing POC.
● Strong customer focus, ownership, urgency and drive.
● Knowledge and experience with cloud native tools like prometheus, kubernetes, docker,
grafana.

YOE: 1- 3years
Skill: Python, Docker or Ansible , AWS

➢ Experience Building a multi-region highly available auto-scaling infrastructure that optimizes
performance and cost. plan for future infrastructure as well as Maintain & optimize existing
infrastructure.
➢ Conceptualize, architect and build automated deployment pipelines in a CI/CD environment like
Jenkins.
➢ Conceptualize, architect and build a containerized infrastructure using Docker,Mesosphere or
similar SaaS platforms.
Work with developers to institute systems, policies and workflows which allow for rollback of
deployments Triage release of applications to production environment on a daily basis.
➢ Interface with developers and triage SQL queries that need to be executed inproduction
environments.
➢ Maintain 24/7 on-call rotation to respond and support troubleshooting of issues in production.
➢ Assist the developers and on calls for other teams with post mortem, follow up and review of
issues affecting production availability.
➢ Establishing and enforcing systems monitoring tools and standards
➢ Establishing and enforcing Risk Assessment policies and standards
➢ Establishing and enforcing Escalation policies and standards