Cutshort logo
 is a software product company that provides  logo
Sr. Data Engineer
is a software product company that provides
 is a software product company that provides 's logo

Sr. Data Engineer

at is a software product company that provides

6 - 15 yrs
₹11L - ₹15L / yr
Hyderabad
Skills
skill iconPython
Spark
SQL Azure
Apache Kafka
skill iconMongoDB
skill iconVisual Studio
Responsive Design
SSIS
databricks

5+ years of experience designing, developing, validating, and automating ETL processes 3+ years of experience traditional ETL tools such as Visual Studio, SQL Server Management Studio, SSIS, SSAS and SSRS 2+ years of experience with cloud technologies and platforms, such as: Kubernetes, Spark, Kafka, Azure Data Factory, Snowflake, ML Flow, Databricks, Airflow or similar Must have experience with designing and implementing data access layers Must be an expert with SQL/T-SQL and Python Must have experience in Kafka Define and implement data models with various database technologies like MongoDB, CosmosDB, Neo4j, MariaDB and SQL Serve Ingest and publish data from sources and to destinations via an API Exposure to ETL/ELT with using Kafka or Azure Event Hubs with Spark or Databricks is a plus Exposure to healthcare technologies and integrations for FHIR API, HL7 or other HIE protocols is a plus


Skills Required :


Designing, Developing, ETL, Visual Studio, Python, Spark, Kubernetes, Kafka, Azure Data Factory, SQL Server, Airflow, Databricks, T-SQL, MongoDB, CosmosDB, Snowflake, SSIS, SSAS, SSRS, FHIR API, HL7, HIE Protocols

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Information Solution Provider Company
Information Solution Provider Company
Agency job
via Jobdost by Sathish Kumar
Delhi, Gurugram, Noida, Ghaziabad, Faridabad
2 - 7 yrs
₹10L - ₹15L / yr
Big Data
skill iconPython
skill iconJava
CI/CD
Shell Scripting

DevOps Engineer

Our engineering team is looking for Big-Data DevOps engineers to join the engineering team and help us automate the build, release, packaging and infrastructure provisioning and support processes. The candidate is expected to own the full life-cycle of provisioning, configuration management, monitoring, maintenance and support for cloud as well as on premise deployments.

 

Responsibilities

 

  • 3-plus years of DevOps experience managing the Big Data application stack including HDFS, YARN, Spark, Hive and Hbase
  • Deeper understanding of all the configurations required for installing and maintaining the infrastructure in the long run
  • Experience setting up high availability, configuring resource allocation, setting up capacity schedulers, handling data recovery tasks
  • Experience with middle-layer technologies including web servers (httpd, ningx),

application servers (Jboss, Tomcat) and database systems (postgres, mysql)

  • Experience setting up enterprise security solutions including setting up active directories, firewalls, SSL certificates, Kerberos KDC servers, etc.
  • Experience maintaining and hardening the infrastructure by regularly applying required security packages and patches
  • Experience supporting on-premise solutions as well as on AWS cloud
  • Experience working with and supporting Spark-based applications on YARN
  • Experience with one or more automation tools such as Ansible, Terraform, etc
  • Experience working with CI/CD tools like Jenkins and various test report and coverage Plugins
  • Experience defining and automating the build, versioning and release processes for complex enterprise products
  • Experience supporting clients remotely and on-site
  • Experience working with and supporting Java- and Python-based tech stacks would be a Plus

 

Read more
Cargill Business Services
Vignesh R
Posted by Vignesh R
Bengaluru (Bangalore)
4 - 7 yrs
Best in industry
skill iconDocker
skill iconKubernetes
DevOps
skill iconAmazon Web Services (AWS)
Windows Azure
+2 more

Job Purpose and Impact

The DevOps Engineer is a key position to strengthen the security automation capabilities which have been identified as a critical area for growth and specialization within Global IT’s scope. As part of the Cyber Intelligence Operation’s DevOps Team, you will be helping shape our automation efforts by building, maintaining and supporting our security infrastructure.

Key Accountabilities

  • Collaborate with internal and external partners to understand and evaluate business requirements.
  • Implement modern engineering practices to ensure product quality.
  • Provide designs, prototypes and implementations incorporating software engineering best practices, tools and monitoring according to industry standards.
  • Write well-designed, testable and efficient code using full-stack engineering capability.
  • Integrate software components into a fully functional software system.
  • Independently solve moderately complex issues with minimal supervision, while escalating more complex issues to appropriate staff.
  • Proficiency in at least one configuration management or orchestration tool, such as Ansible.
  • Experience with cloud monitoring and logging services.

Qualifications

Minimum Qualifications

  • Bachelor's degree in a related field or equivalent exp
  • Knowledge of public cloud services & application programming interfaces
  • Working exp with continuous integration and delivery practices

Preferred Qualifications

  • 3-5 years of relevant exp whether in IT, IS, or software development
  • Exp in:
  •  Code repositories such as Git
  • Scripting languages (Python & PowerShell)
  • Using Windows, Linux, Unix, and mobile platforms within cloud services such as AWS
  • Cloud infrastructure as a service (IaaS) / platform as a service (PaaS), microservices, Docker containers, Kubernetes, Terraform, Jenkins
  • Databases such as Postgres, SQL, Elastic
Read more
HCL
HCL
Agency job
via Saiva System by Sunny Kumar
Bengaluru (Bangalore)
5 - 8 yrs
₹3L - ₹15L / yr
skill iconDocker
skill iconKubernetes
DevOps
skill iconJenkins
Ansible
+8 more

Client: Sony Corporation

Position: 3

Exp: 5-8Years

DevOps Engineer

Location: Bangalore

Budget: 16.5 LPA Max

 

Gerrit ,Jenkins, Rabbit MQ AWS Linux
Python ,Ansible, Tomcat ,Postgresql
Grafana ,Groovy,HTML,Shell,Apache,Git , ELK

Read more
MyOperator - VoiceTree Technologies
at MyOperator - VoiceTree Technologies
1 video
3 recruiters
Sanmeet Singh Sahni
Posted by Sanmeet Singh Sahni
Remote only
4 - 8 yrs
₹12L - ₹15L / yr
skill iconDocker
skill iconKubernetes
DevOps
skill iconAmazon Web Services (AWS)
CI/CD
+10 more
Job description
The role requires you to design development pipelines from the ground up, Creation of Docker Files,  design and operate highly available systems in AWS Cloud environments. Also involves Configuration Management, Web Services Architectures, DevOps Implementation, Database management, Backups, and Monitoring.

Key responsibility area

- Ensure reliable operation of CI/CD pipelines
- Orchestrate the provisioning, load balancing, configuration, monitoring and billing of resources in the cloud environment in a highly automated manner
- Logging, metrics and alerting management.
- Creation of Bash/Python scripts for automation
- Performing root cause analysis for production errors.


Requirement
- 2 years experience as Team Lead.
- Good Command on kubernetes.
- Proficient in Linux Commands line and troubleshooting.
- Proficient in AWS Services. Deployment, Monitoring and troubleshooting applications in AWS.
- Hands-on experience with CI tooling preferably with Jenkins.
- Proficient in deployment using Ansible.
- Knowledge of infrastructure management tools (Infrastructure as cloud) such as terraform, AWS cloudformation etc.
- Proficient in deployment of applications behind load balancers and proxy servers such as nginx, apache.
- Scripting languages: Bash, Python, Groovy.
- Experience with Logging, Monitoring, and Alerting tools like ELK(Elastic-search, Logstash, Kibana), Nagios. Graylog, splunk Prometheus, Grafana is a plus.


Must Have:
Linux, CI/CD(Jenkin), AWS, Scripting(Bash,shell Python, Go), Ngnix, Docker.
Good to have
Configuration Management(Ansible or similar tool), Logging tool( ELK or similar), Monitoring tool(Ngios or similar), IaC(Terraform, cloudformation).
Read more
Hashtaag  KGJ Software Technologies Pvt Ltd
Bengaluru (Bangalore)
4 - 7 yrs
₹8L - ₹10L / yr
skill iconGitHub
CI/CD
skill iconAmazon Web Services (AWS)
skill iconPython
skill iconJavascript
+2 more

Job Summary

You'd be meticulously analyzing project requirements and carry forward the development of highly robust, scalable and easily maintainable backend applications, work independently, and you'll have the support & opportunity to thrive in a fast-paced environment.

 

Responsibilities and Duties:

 

  • building and setting up new development tools and infrastructure
  • understanding the needs of stakeholders and conveying this to developers
  • working on ways to automate and improve development and release processes
  • testing and examining code written by others and analysing results
  • ensuring that systems are safe and secure against cybersecurity threats
  • identifying technical problems and developing software updates and ‘fixes’
  • working with software developers and software engineers to ensure that development follows established processes and works as intended
  • planning out projects and being involved in project management decisions

 

Skill Requirements:

 

  1. Managing GitHub (example: - creating branches for test, QA, development and production, creating Release tags, resolve merge conflict)
  2. Setting up of the servers based on the projects in either AWS or Azure (test, development, QA, staging and production)
  3. AWS S3 configuring and s3 web hosting, Archiving data from s3 to s3-glacier
  4. Deploying the build(application) to the servers using AWS CI/CD and Jenkins (Automated and manual)
  5. AWS Networking and Content delivery (VPC, Route 53 and CloudFront)
  6. Managing databases like RDS, Snowflake, Athena, Redis and Elasticsearch
  7. Managing IAM roles and policies for the functions like Lambda, SNS, aws cognito, secret manager, certificate manager, Guard Duty, Inspector EC2 and S3.
  8. AWS Analytics (Elasticsearch, Athena, Glue and kinesis).
  9. AWS containers (elastic container registry, elastic container service, elastic Kubernetes service, Docker Hub and Docker compose
  10. AWS Auto scaling group (launch configuration, launch template) and load balancer
  11. EBS (snapshots, volumes and AMI.)
  12. AWS CI/CD build spec scripting, Jenkins groovy scripting, shell scripting and python scripting.
  13. Sagemaker, Textract, forecast, LightSail
  14. Android and IOS automation building
  15. Monitoring tools like cloudwatch, cloudwatch log group, Alarm, metric dashboard, SNS(simple notification service), SES(simple email service)
  16. Amazon MQ
  17. Operating system Linux and windows
  18. X-Ray, Cloud9, Codestar
  19. Fluent Shell Scripting
  20. Soft Skills
  21. Scripting Skills , Good to have knowledge (Python, Javascript, Java,Node.js)
  22. Knowledge On Various DevOps Tools And Technologies

 

 

Qualifications and Skills

Job Type: Full-time

Experience: 4 - 7 yrs

Qualification: BE/ BTech/MCA.

Location: Bengaluru, Karnataka

Read more
VUMONIC
at VUMONIC
2 recruiters
Simran Bhullar
Posted by Simran Bhullar
Bengaluru (Bangalore)
1 - 3 yrs
₹5L - ₹7.5L / yr
skill iconDocker
skill iconKubernetes
DevOps
Google Cloud Platform (GCP)
skill iconElastic Search
+3 more

Designation : DevOp Engineer

Location : HSR, Bangalore


About the Company


Making impact driven by Data. 


Vumonic Datalabs is a data-driven startup providing business insights to e-commerce & e-tail companies to help them make data-driven decisions to scale up their business and understand their competition better. As one of the EU's fastest growing (and coolest) data companies, we believe in revolutionizing the way businesses make their most important business decisions by providing first-hand transaction based insights in real-time.. 



About the Role

 

We are looking for an experienced and ambitious DevOps engineer who will be responsible for deploying product updates, identifying production issues and implementing integrations that meet our customers' needs. As a DevOps engineer at Vumonic Datalabs, you will have the opportunity to work with a thriving global team to help us build functional systems that improve customer experience. If you have a strong background in software engineering, are hungry to learn, compassionate about your work and are familiar with the mentioned technical skills, we’d love to speak with you.



What you’ll do


  • Optimize and engineer the Devops infrastructure for high availability, scalability and reliability.
  • Monitor Logs on servers & Cloud management
  • Build and set up new development tools and infrastructure to reduce occurrences of errors 
  • Understand the needs of stakeholders and convey this to developers
  • Design scripts to automate and improve development and release processes
  • Test and examine codes written by others and analyze results
  • Ensure that systems are safe and secure against cybersecurity threats
  • Identify technical problems, perform root cause analysis for production errors and develop software updates and ‘fixes’
  • Work with software developers, engineers to ensure that development follows established processes and actively communicates with the operations team.
  • Design procedures for system troubleshooting and maintenance.


What you need to have


TECHNICAL SKILLS

  • Experience working with the following tools : Google Cloud Platform, Kubernetes, Docker, Elastic Search, Terraform, Redis
  • Experience working with following tools preferred : Python, Node JS, Mongo-DB, Rancher, Cassandra
  • Experience with real-time monitoring of cloud infrastructure using publicly available tools and servers
  • 2 or more years of experience as a DevOp (startup/technical experience preferred)

You are

  • Excited to learn, are a hustler and “Do-er”
  • Passionate about building products that create impact.
  • Updated with the latest technological developments & enjoy upskilling yourself with market trends.
  • Willing to experiment with novel ideas & take calculated risks.
  • Someone with a problem-solving attitude with the ability to handle multiple tasks while meeting expected deadlines.
  • Interested to work as part of a supportive, highly motivated and fun team.
Read more
It gives instant visibility to the company’s cash. (BC1)
It gives instant visibility to the company’s cash. (BC1)
Agency job
via Multi Recruit by Ayub Pasha
Bengaluru (Bangalore)
2 - 4 yrs
₹15L - ₹20L / yr
Golang
skill iconPython
CI/CD
skill iconGo Programming (Golang)
skill iconKubernetes
+2 more
  • You have experience of 2-4 years in building high-performance consumer-facing mobile applications at Product companies of a decent scale.
  • You can write code preferably in Golang and Python.
  • You have experience with debugging production issues and writing RCAs.
  • You have demonstrable stories of being on-call and how outages have been handled.
  • You have experience developing products on Kubernetes and cloud providers like GCP and AWS.
  • You have worked with Cloud Native (CNCF) technologies.
  • You have experience automating CI/CD pipelines.
  • You are an excellent collaborator & communicator. You know that start-ups are a team sport.
  • You listen to others, aren’t afraid to speak your mind and always try to ask the right questions.
  • You are excited by the prospect of working in a distributed team and company

 

 

Read more
Greenway Health
at Greenway Health
2 recruiters
Gayathri Rajan
Posted by Gayathri Rajan
Bengaluru (Bangalore)
7 - 15 yrs
₹5L - ₹25L / yr
DevOps
skill iconDocker
skill iconJenkins
Terraform
skill iconAmazon Web Services (AWS)
+7 more

Job Summary

Creates, modifies, and maintains software applications individually or as part of a team.  Provides technical leadership on a team, including training and mentoring of other team members.  Provides technology and architecture direction for the team, department, and organization.

Essential Duties & Responsibilities

  • Develops software applications and supporting infrastructure using established coding standards and methodologies
  • Sets example for software quality through multiple levels of automated tests, including but not limited to unit, API, End to End, and load.
  • Self-starter and self-organized - able to work without supervision
  • Develops tooling, test harnesses and innovative solutions to understand and monitor the quality of the product 
  • Develops infrastructure as code to reliably deploy applications on demand or through automation
  • Understands cloud managed services and builds scalable and secure applications using them
  • Creates proof of concepts for new ideas that answer key questions of feasibility, desirability, and viability
  • Work with other technical leaders to establish coding standards, development best practices and technology direction
  • Performs thorough code reviews that promote better understanding throughout the team
  • Work with architects, designers, business analysts and others to design and implement high quality software solutions
  • Builds intuitive user interfaces with the end user persona in mind using front end frameworks and styling
  • Assist product owners in backlog grooming, story breakdown and story estimation
  • Collaborate and communicate effectively with team members and other stakeholders throughout the organization
  • Document software changes for use by other engineers, quality assurance and documentation specialists
  • Master the technologies, languages, and practices used by the team and project assigned
  • Train others in the technologies, languages, and practices used by the team
  • Trouble shoot, instrument and debug existing software resolving root causes of defective behavior
  • Guide the team in setting up the infrastructure in the cloud.
  • Setup the security protocols for the cloud infrastructure
  • Works with the team in setting up the data hub in the cloud
  • Create dashboards for the visibility of the various interactions between the cloud services
  • Other duties as assigned

Experience

Education

  • BA/BS in Computer Science, a related field or equivalent work experience

Minimum Qualifications

  • Mastered advanced programming concepts, including object oriented programming
  • Mastered technologies and tools utilized by team and project assigned
  • Able to train others on general programming concepts and specific technologies
  • Minimum 8 years’ experience developing software applications

 

 

Skills/Knowledge

  • Must be expert in advanced programming skills and database technology
  • Must be expert in at least one technology and/or language and proficient in multiple technologies and languages:
  • (Specific languages needed will vary based on development department or project)
  • .Net Core, C#, Java, SQL, JavaScript, Typescript, Python
  • Additional desired skills:
    • Single-Page Applications, Angular (v9), Ivy, RXJS, NGRX, HTML5, CSS/SASS, Web Components, Atomic Design
    • Test First approach, Test Driven Development (TDD), Automated testing (Protractor, Jasmine), Newman Postman, artillery.io
    • Microservices, Terraform, Jenkins, Jupyter Notebook, Docker, NPM, Yarn, Nuget, NodeJS, Git/Gerrit, LaunchDarkly
    • Amazon Web Services (AWS), Lambda, S3, Cognito, Step Functions, SQS, IAM, Cloudwatch, Elasticache
    • Database Design, Optimization, Replication, Partitioning/Sharding, NoSQL, PostgreSQL, MongoDB, DynamoDB, Elastic Search, PySpark, Kafka
    • Agile, Scrum, Kanban, DevSecOps
  • Strong problem-solving skills
  • Outstanding communications and interpersonal skills
  • Strong organizational skills and ability to multi-task
  • Ability to track software issues to successful resolution
  • Ability to work in a collaborative fast paced environment
  • Setting up complex AWS data storage hub
  • Well versed in setting up infrastructure security in the interactions between the planned components
  • Experienced in setting up dashboards for analyzing the various operations in the AWS infra setup.
  • Ability to learn new development language quickly and apply that knowledge effectively
Read more
frontm
frontm
Agency job
Bengaluru (Bangalore)
10 - 18 yrs
₹15L - ₹25L / yr
skill iconAmazon Web Services (AWS)
CI/CD
skill iconNodeJS (Node.js)
skill iconJava
skill iconMongoDB
+2 more

We are a growth-oriented, dynamic, multi-national startup, so those that are looking for that startup excitement, dynamics, and buzz are here at the right place. Read on -

FrontM (http://www.frontm.com/" target="_blank">www.frontm.com) is an edge AI company with a platform that is redefining how businesses and people in remote and isolated environments (maritime, aviation, mining....) collaborate and drive smart decisions.

Successful candidate will lead the back end architecture working alongside VP of delivery, CTO and CEO

 

The problem you will be working on:

- Take ownership of AWS cloud infrastructure

- Overlook tech ops with hands-on CI/CD and administration

- Develop Node.js Java and backend system procedures for stability, scale and performance

- Understand FrontM platform roadmap and contribute to planning strategic and tactical capabilities

- Integrate APIs and abstractions for complex requirements

 

Who you are:

- You are an experienced Cloud Architect and back end developer

- You have experience creating AWS Serverless Lambdas EC2 MongoDB backends

- You have extensive CI/CD and DevOps experience

- You can take ownership of continuous server uptime, maintenance, stability and performance

- You can lead a team of backend developers and architects

- You are a die-hard problem solver and never-say-no person

- You have 10+ years experience

- You are very sound in English language

- You have the ability to initiate and lead teams working with senior management

 

Additional benefits

- Generous pay package, flexible for the right candidate

- Career development and growth planning

- Entrepreneurial environment that nurtures and promotes innovation

- Multi-national team with an enjoyable culture

We'd love to talk to you if you find this interesting and like to join in on our exciting journey

Read more
Fintech
Fintech
Agency job
via Ixora Global Services by Tilak Perala
Bengaluru (Bangalore)
3 - 5 yrs
₹6L - ₹10L / yr
Chef
DevOps
Linux/Unix
skill iconPython
Shell Scripting
+3 more
DevOps Engineer Position: Full time Base Location: Bangalore, with extensive and frequent travel to SEA R&R: ● Work with people across various levels right from delivery team level to top management ● Support internal product and external customers on multiple platforms ● Working with customer teams (specifically development team) to analyse their process, and environments to improve user satisfaction ● Improve client Devops team by enabling them with DevOps concepts, and processes. ● Act as the technical expert across multiple client projects helping them in enhancing their delivery pipeline , and overall DevOps and Agile practices ● Identify state of the art CI/CD tools, prepare decision proposals, implementation plans for these tools and carry out introduction & training, allowing client delivery to move faster. ● Bring in new and cutting-edge methodologies in DevOps both for Greyamp and for clients. Need to have: ● 3 - 5 years of experience of relevant experience (at least 1 year experience in development, and 2+ in Devops) ● Understanding of Linux/Unix Administration ● Understanding of one scripting language (python, shell, ruby or pearl) ● Experience working with different OS Servers (RedHat, Oracle, Microsoft) ● Strong understanding of version control (GIT) ● Good understanding of build tools like ANT or Maven or gradle ● Experience with setting up relevant dashboard using tools around code quality and vulnerability checks (SonarQube) ● Experience implementing and maintaining CI/CD pipelines (Jenkins or Circle CI or GoCD) ● Good understanding and working experience with Docker Containers ● Experience working with configuration management tools(chef, puppet or ansible) ● Extensive knowledge on working with cloud platform and maintaining automation scripts using terraform or similar tools. ( preferably AWS or Azure or GCP ) ● Basic knowledge on working with the cloud product suite ( preferably AWS or Azure or GCP ) ● Understanding and experience working on Saas architecture ● Understanding and experience with VMware or other virtual environments. Nice to have: ● Experience working with Testing automation tools (Preferably Selenium) ● Knowledge and experience with Kubernetes ● Understanding and experience with Monitoring tools like ELK stack, prometheus and grafana, Nagios, or Dynatrace ● Experience working with DataBase deployments ● Client handling experience and stakeholder management
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos