11+ Data flow Jobs in Pune | Data flow Job openings in Pune

Role Overview:

Virtana is looking for a Senior DevOps Engineer to join our R&D Infrastructure team. In this role, you won't just follow conventions — you'll help redefine them. You will own the architecture, build, and day-to-day operations of the GCP-based cloud platform that powers Virtana's SaaS products and the AI-driven observability experience our Global 2000 customers depend on. This is a hands-on senior individual contributor role with meaningful technical leadership scope, working alongside engineers and architects on a unified observability platform.

Work Location: Pune

Job Type: Hybrid

Role Responsibilities:

• GCP Cloud Operations: Develop, deploy, operate, and support production cloud infrastructure primarily on GCP — leveraging GKE, BigTable, BigQuery, Dataflow, Cloud Storage, IAM, and core networking services.
• Reliability & SLAs: Ensure production systems are running at all times with multiple levels of redundancy to meet committed SLAs; lead incident response, root cause analysis, and post-incident reviews.
• Build & Release Automation: Design, implement, and continuously improve scalable CI/CD pipelines and test frameworks leveraged by QA and development teams across the company.
• Infrastructure as Code: Manage large-scale, repeatable deployments using Terraform, Ansible, Puppet, or SaltStack; champion Git-based workflows and version control standards for distributed engineering teams.
• Security & Availability: Maintain the ongoing maintenance, security, patching, and availability of services in line with tight operations, security, and procedural models.
• Monitoring & Alerting: Plan and deliver high-value monitoring and alerting features to support operations, support, and customer-facing reliability — eating our own dog food with the Virtana Platform wherever possible.
• Capacity & Cost: Forecast capacity, plan upgrades, patches, and migrations, and drive cloud cost efficiency across hybrid and multi-cloud environments.
• Cross-Functional Partnership: Work with development, operations, and support personnel to identify, isolate, and diagnose issues; handle support escalations and drive permanent fixes.

Required Qualifications:

• Bachelor's degree in Computer Science / Engineering or equivalent relevant experience.
• 5–7 years of professional hands-on DevOps / SRE experience supporting production cloud environments.
• Strong, demonstrable production experience on GCP — including GKE, BigTable, BigQuery, Dataflow, IAM, and core GCP networking services.
• Deep, hands-on expertise with container orchestration (Kubernetes) and Docker in production.
• Advanced proficiency with at least one infrastructure-as-code / configuration management tool: Terraform, Ansible, Puppet, or SaltStack.
• Solid understanding of networking, firewalls, load balancers, DNS, and database operations.
• Strong working knowledge of Git-based workflows and version control standards for distributed engineering teams.
• Comfort operating hybrid environments that include both Linux and Windows ecosystems.
• Excellent verbal and written communication skills, with the ability to explain highly technical topics to both technical and non-technical audiences.
• Self-motivated, detail-oriented, and able to work both independently and within a globally distributed team.

Good to Have:

• Strong scripting skills and a demonstrated ability to automate operational toil — Python preferred; Bash, Go, or Groovy a plus.
• Hands-on experience designing and operating CI/CD pipelines with Jenkins (Spinnaker, GitHub Actions, or GitLab CI also welcome).
• Exposure to AWS or other public clouds in addition to GCP.
• Experience operating SaaS platforms built on microservices architectures.

JOB DETAILS:

* Job Title: Specialist I - DevOps Engineering

* Industry: Global Digital Transformation Solutions Provider

* Salary: Best in Industry

* Experience: 7-10 years

* Location: Bengaluru (Bangalore), Chennai, Hyderabad, Kochi (Cochin), Noida, Pune, Thiruvananthapuram

Job Description

Job Summary:

As a DevOps Engineer focused on Perforce to GitHub migration, you will be responsible for executing seamless and large-scale source control migrations. You must be proficient with GitHub Enterprise and Perforce, possess strong scripting skills (Python/Shell), and have a deep understanding of version control concepts.

The ideal candidate is a self-starter, a problem-solver, and thrives on challenges while ensuring smooth transitions with minimal disruption to development workflows.

Key Responsibilities:

• Analyze and prepare Perforce repositories — clean workspaces, merge streams, and remove unnecessary files.
• Handle large files efficiently using Git Large File Storage (LFS) for files exceeding GitHub’s 100MB size limit.
• Use git-p4 fusion (Python-based tool) to clone and migrate Perforce repositories incrementally, ensuring data integrity.
• Define migration scope — determine how much history to migrate and plan the repository structure.
• Manage branch renaming and repository organization for optimized post-migration workflows.
• Collaborate with development teams to determine migration points and finalize migration strategies.
• Troubleshoot issues related to file sizes, Python compatibility, network connectivity, or permissions during migration.

Required Qualifications:

• Strong knowledge of Git/GitHub and preferably Perforce (Helix Core) — understanding of differences, workflows, and integrations.
• Hands-on experience with P4-Fusion.
• Familiarity with cloud platforms (AWS, Azure) and containerization technologies (Docker, Kubernetes).
• Proficiency in migration tools such as git-p4 fusion — installation, configuration, and troubleshooting.
• Ability to identify and manage large files using Git LFS to meet GitHub repository size limits.
• Strong scripting skills in Python and Shell for automating migration and restructuring tasks.
• Experience in planning and executing source control migrations — defining scope, branch mapping, history retention, and permission translation.
• Familiarity with CI/CD pipeline integration to validate workflows post-migration.
• Understanding of source code management (SCM) best practices, including version history and repository organization in GitHub.
• Excellent communication and collaboration skills for cross-team coordination and migration planning.
• Proven practical experience in repository migration, large file management, and history preservation during Perforce to GitHub transitions.

Skills: Github, Kubernetes, Perforce, Perforce (Helix Core), Devops Tools

Must-Haves

Git/GitHub (advanced), Perforce (Helix Core) (advanced), Python/Shell scripting (strong), P4-Fusion (hands-on experience), Git LFS (proficient)

• Seeking an Individual carrying around 5+ yrs of experience.
• Must have skills - Jenkins, Groovy, Ansible, Shell Scripting, Python, Linux Admin
• Terraform, AWS deep knowledge to automate and provision EC2, EBS, SQL Server, cost optimization, CI/CD pipeline using Jenkins, Server less automation is plus.
• Excellent writing and communication skills in English. Enjoy writing crisp and understandable documentation
• Comfortable programming in one or more scripting languages
• Enjoys tinkering with tooling. Find easier ways to handle systems by doing some research. Strong awareness around build vs buy.

About Us:

Varivas is a community that allows users to create, support, and recommend content. The mission of Varivas is to give community freedom, ease, and complete control of their content.

Varivas is an early-stage startup looking for its first few members.

 https://www.varivas.community/

Become part of a core team of an upcoming startup building an exciting product from scratch.

Your Responsibilities:

• Write scalable backend code and audit existing backend code for sanity, performance and security
• Design and implementation of on-demand scalable, and performant applications.
• Defining and setting development, test, release, update, and support processes for DevOps operation
• Incidence management and root cause analysis
• Selecting and deploying appropriate CI/CD tools for various test automation frameworks
• Monitoring the processes during the entire lifecycle Encouraging and building automated processes wherever possible
• Identifying and deploying cybersecurity measures by continuously performing vulnerability assessment and risk management
• Achieve repeatability, fast recovery, best practices, and delegate proper ownership permissions to teams
• Analyzes the technology currently being used and develops plans and processes for improvement and expansion for better cost and efficiency
• Collaborate with and assist QA in performing load tests and assessing performance optimization
• writing and maintaining the DevOps processes in tools such as confluence

We are looking for someone who is:

• Ready to take complete ownership of the whole infra at Varivas
• Has previous experience in building and maintaining live production app
• You have an eye for detail.
• You’re a problem solver and a perpetual learner.
• You possess a positive and solution-oriented mindset.
• Good Problem-solving skills and troubleshooting
• Build high-performing web and native applications that are robust and easy to maintain

Our Current DevOps stack:

• Github/bitbucket
• Azure cloud storage
• MongoDB Atlas
• JIRA
• Selenium, cypress test automation
• Heroku/digital ocean
• GoDaddy
• Google Analytics/search console
• SendGrid
• sentry.io
• hotjar

What we can offer:

• Payment for work done (of course 🙂)
• Remote work from anywhere
• part time or full time engagement
• Complete flexibility of working hours
• Complete freedom and ownership of your work
• No meetings, standups, or daily status group calls. (We prefer asynchronous communication like slack)

Role and responsibilities

• Expertise in AWS (Most typical Services),Docker & Kubernetes.
• Strong Scripting knowledge, Strong Devops Automation, Good at Linux
• Hands on with CI/CD (CircleCI preferred but any CI/CD tool will do). Strong Understanding of GitHub
• Strong understanding of AWS networking and. Strong with Security & Certificates.

Nice-to-have skills

• Involved in Product Engineering

Job Dsecription:

○ Develop best practices for team and also responsible for the architecture

○ solutions and documentation operations in order to meet the engineering departments quality and standards

○ Participate in production outage and handle complex issues and works towards Resolution

○ Develop custom tools and integration with existing tools to increase engineering Productivity

Required Experience and Expertise

○ Having a good knowledge of Terraform + someone who has worked on large TF code bases.

○ Deep understanding of Terraform with best practices & writing TF modules.

○ Hands-on experience of GCP  and AWS and knowledge on AWS Services like VPC and VPC related services like (route tables, vpc endpoints, privatelinks) EKS, S3, IAM. Cost aware mindset towards Cloud services.

○ Deep understanding of Kernel, Networking and OS fundamentals

NOTICE PERIOD - Max - 30 days

Minimum 4 years exp 

Skillsets:

1. Build automation/CI: Jenkins
2. Secure repositories: Artifactory, Nexus
3. Build technologies: Maven, Gradle
4. Development Languages: Python, Java, C#, Node, Angular, React/Redux
5. SCM systems: Git, Github, Bitbucket
6. Code Quality: Fisheye, Crucible, SonarQube
7. Configuration Management: Packer, Ansible, Puppet, Chef
8. Deployment: uDeploy, XLDeploy
9. Containerization: Kubernetes, Docker, PCF, OpenShift
10. Automation frameworks: Selenium, TestNG, Robot
11. Work Management: JAMA, Jira
12. Strong problem solving skills, Good verbal and written communication skills
13. Good knowledge of Linux environment: RedHat etc.
14. Good in shell scripting
15. Good to have Cloud Technology : AWS, GCP and Azure

• Designing and building infrastructure to support AWS, Azure, and GCP-based Cloud services and infrastructure.
• Creating and utilizing tools to monitor our applications and services in the cloud including system health indicators, trend identification, and anomaly detection.
• Working with development teams to help engineer scalable, reliable, and resilient software running in the cloud.
• Participating in on-call escalation to troubleshoot customer-facing issues
• Analyzing and monitoring performance bottlenecks and key metrics to optimize software and system performance.
• Providing analytics and forecasts for cloud capacity, troubleshooting analysis, and uptime.

• Should have strong experience of a couple of years, in leading DevOps team and planning, defining DevOps roadmap and executing as per the same along with the team 
• Familiarity with AWS cloud and JSON templates, Python, AWS Cloud formation templates
• Designing solutions using one or more AWS features, tools, and technologies such as EC2, EBS, Glacier, S3, ELB, CloudFormation, Lambada, CloudWatch, VPC, RDS, Direct Connect, AWS CLI, REST API
• Design and implement system architecture with AWS cloud - Develop automation scripts, ARM templates, Ansible, Chef, Python, Powershell Knowledge of AWS services and cloud design patterns- Knowledge on Cloud fundamentals like autoscaling, serverless
• Have experience with DevOps and Infrastructure as Code: AWS environment and application automation utilizing CloudFormation and third-party tools. CI/CD pipeline setup utilizing
• CI experience with the following is a must: Jenkins, Bitbucket/GIT, Nexus or Artifactory, SonarQube, WireMock or other mocking solution 
• Expert knowledge on Windows/Linux OS/Mac with at least 5-6 years of system administration experience
• Should have strong skills in using JIRA build tool
• Should have knowledge in managing the CI/CD pipeline on public cloud deployments using AWS
• Should have strong skills in using tools like Jenkins, Docker, Kubernetes (AWS EKS, Azure AKS), and Cloudformation.
• Experience in monitoring tools like Pingdom, Nagios, etc.
• Experience in reverse proxy services like Nginx and Apache
• Desirable experience in Bitbucket with version control tools like GIT/SVN
• Experience of manual/automated testing desired application deployments
• Experience in database technologies such as PostgreSQL, MySQL
• Knowledge of helm and terraform