Application Migration Architect

e are looking for a DevOps Architect/Engineer with strong technical expertise and decent years of experience to join our IT firm. You will be responsible for facilitating the development process and operations across our organization. Besides, you should own excellent leadership skills to mentor and guide the team members.

To be successful in this job role, you should be able to streamline all DevOps practices. You should be able to review technical operations and automate the process using the right tools and techniques.

Your knowledge of the latest industry trends will prove beneficial in designing efficient practices. Moreover, you should be able to demonstrate excellent research skills and outstanding problem-solving abilities. If you possess the required skills, knowledge, and experience, then do write to us. We would be happy to meet you.

Responsibilities

• Simplifying the development process and operations
• Analyzing any setbacks or shortcomings in the operations
• Developing appropriate DevOps channels
• Setting up a continuous build environment to boost software development
• Designing and delivering efficient and comprehensive best practices
• Reviewing and managing technical operations
• Analyzing and streamlining the existing DevOps practices
• Monitoring and guiding the development team
• Using the right tools and techniques to automate technical processes
• Handling all deployment processes
• Minimizing failures and troubleshooting any technical issues
• Implementing effective DevOps solutions
• Ensuring all systems are secure and scalable

Requirements

• Bachelor’s degree in Information Technology, Computer Science or a related discipline
• Previous work experience in the IT industry
• Complete knowledge of DevOps tools like Docker, Git, Puppet, and Jenkins
• Familiarity with the latest industry trends and best practices
• Basic understanding of cloud-based environments
• Know-how of software development, testing, and configuration methodologies
• Knowledge of scripting languages like Python, JavaScript, and HTML
• Excellent analytical and research skills
• Strong leadership skills
• Ability to motivate team members
• Highly innovative individual
• Excellent problem-solving ability
• Ability to organize and manage time effectively
• Ability to work collaboratively and independently
• Good communication skills
• Ability to drive the automation process
• Demonstrating multitasking skills
• Familiarity with deployment process and tools
• Ability to maintain the confidentiality of any sensitive information
• Willingness to work in a competitive environment

Description: 

As a Data Engineering Lead at Company, you will be at the forefront of shaping and managing our data infrastructure with a primary focus on Google Cloud Platform (GCP). You will lead a team of data engineers to design, develop, and maintain our data pipelines, ensuring data quality, scalability, and availability for critical business insights. 

Key Responsibilities: 

1. Team Leadership: 

a. Lead and mentor a team of data engineers, providing guidance, coaching, and performance management. 

b. Foster a culture of innovation, collaboration, and continuous learning within the team. 

2. Data Pipeline Development (Google Cloud Focus): 

a. Design, develop, and maintain scalable data pipelines on Google Cloud Platform (GCP) using services such as BigQuery, Dataflow, and Dataprep.

b. Implement best practices for data extraction, transformation, and loading (ETL) processes on GCP. 

3. Data Architecture and Optimization: 

a. Define and enforce data architecture standards, ensuring data is structured and organized efficiently. 

b. Optimize data storage, processing, and retrieval for maximum 

performance and cost-effectiveness on GCP. 

4. Data Governance and Quality: 

a. Establish data governance frameworks and policies to maintain data quality, consistency, and compliance with regulatory requirements. b. Implement data monitoring and alerting systems to proactively address data quality issues. 

5. Cross-functional Collaboration: 

a. Collaborate with data scientists, analysts, and other cross-functional teams to understand data requirements and deliver data solutions that drive business insights. 

b. Participate in discussions regarding data strategy and provide technical expertise. 

6. Documentation and Best Practices: 

a. Create and maintain documentation for data engineering processes, standards, and best practices. 

b. Stay up-to-date with industry trends and emerging technologies, making recommendations for improvements as needed. 

Qualifications 

● Bachelor's or Master's degree in Computer Science, Data Engineering, or related field. 

● 5+ years of experience in data engineering, with a strong emphasis on Google Cloud Platform. 

● Proficiency in Google Cloud services, including BigQuery, Dataflow, Dataprep, and Cloud Storage. 

● Experience with data modeling, ETL processes, and data integration. ● Strong programming skills in languages like Python or Java. 

● Excellent problem-solving and communication skills. 

● Leadership experience and the ability to manage and mentor a team.

●              Work with application development teams to identify and understand their operational pain points.

●              Document these challenges and define goals to be achieved by the infrastructure team.

●              Prototype and evaluate multiple solutions, often by experimenting with various vendors and tools available, to achieve the goals undertaken.

●              Rollout tools and processes with heavy focus on automation.

●              Evangelize and help onboard application development teams on the platforms provided by the infrastructure team.

●              Co-own the responsibility with application development teams to ensure the reliability of services.

●              Design and implement solutions around observability to ensure ease of maintenance and quick debugging of services

●              Establish and implement administrative and operational best practices in the application development teams.

●              Find avenues to reduce infrastructure costs and drive optimization in all services.

●              5+ years of experience as a DevOps / Infrastructure engineer with cloud platforms (preferably AWS)

●              Experience with git, CI / CD, Docker, etc

●              Experience in working with infrastructure as code (Terraform, etc).

●              Strong Linux Shell scripting experience

●              Experience with one of the programming languages like Python, Java, Kotlin, etc.

JD

Responsibilities:

• Design and development applications using C/C++/ VC++ (Windows /Linux), Embedded C
• Experience in UI development using C/C++/ VC++ related technologies (Eg: MFC, Xlib, Motif)
• Experience & knowledge in Software Development Life Cycle (SDLC)
• Technical communication with internal and external stake holders.
• Experience in design and development of software applications and frameworks.
• Experience in developing Windows /Linux based desktop applications using C++
• Good knowledge in Object-Oriented concepts
• Unit testing experience using CPP Unit, Google test or similar
• Excellent analytical, problem solving and debugging skills

Key Skills:

• Well versed in Git Repositories
• Good knowledge on Linux and Networking concepts

Personal Attributes

• Good team player
• Demonstrated leadership and personnel management skills.
• Good understanding of the organization’s goals and objectives.
• Strong interpersonal, written, and oral communication skills.
• Highly self-motivated and directed.
• Keen attention to detail.

• Design, build web crawlers to scrape data and URLs.
• Integrate the data crawled and scraped into our databases
• Create more/better ways to crawl relevant information
• Strong knowledge of web technologies (HTML, CSS, Javascript, XPath, Regex)
• Understanding of data privacy policies (esp. GDPR) and personally identifiable information
• Develop automated and reusable routines for extracting information from various data sources
• Prepare requirement summary and re-confirm with Operation team
• Translate business requirements into specific solutions
• Ability to relay technical information to non-technical users
• Demonstrate Effective problem solving and analytical skill
• Ability to pay attention to detail, pro-active, critical thinking and accuracy is essential
• Ability to work to deadlines and give realistic estimates

Skills & Expertise

• 2+ years of web scraping experience

• Experience with two or more of the following web scraping frameworks and tools: Selenium, Scrapy, Import.io, Webhose.io, ScrapingHub, ParseHub, Phantombuster, Octoparse, Puppeter, etc.
• Basic knowledge of data engineering (database ingestion, ETL, etc.) 
• Solution orientation and "can do" attitude - with a desire to tackle complex problems.

• We are looking for a Senior SRE with a proven track record of success leading complex cloud-hybrid environments. You will have:
• Strong sense of Being an Owner, Wearing the Customer Shoes, with the ability to Empower Others demonstrated through clear
• communication and collaboration.
• Skills to work independently with multiple global teams, developing, configuring, deploying, and operating our global infrastructure on AWS and on-prem.
• Operational experience in complex distributed and real-time systems, including experience with SLO/SLAs towards high availability,reliability and DR goals.
• DevOps experience in building tools and frameworks, with an understanding of continuous deployment processes.
• Ability to think at scale, bringing a focus on continuous delivery methodologies from design through deployment and operations.
• Experience building and managing systems with tools including Kubernetes, Chef/Ansible/Puppet, Kafka, Docker, and Terraform.

• 5+ years experience in a Software and/or Site Reliability Engineering role
• Experience writing automation code in GoLang, Python or Java
• Experience developing and operating large scale distributed systems with Kubernetes and Docker
• Experience in running real time and low latency high available applications (Kafka, gRPC, RTP)
• Experience running public cloud environments on AWS
• Experience running hybrid clouds and on-prem infrastructures on Red Hat Enterprise Linux / CentOS
• Bachelor degree in Engineering, Computer Science or equivalent experience
• The ability to lead, partner, and collaborate cross functionally across an engineering organization

• Have 3+ years of experience in Python development
• Be familiar with common database access patterns
• Have experience with designing systems and monitoring metrics, looking at graphs.
• Have knowledge of AWS, Kubernetes and Docker.
• Be able to work well in a remote development environment.
• Be able to communicate in English at a native speaking and writing level.
• Be responsible to your fellow remote team members.
• Be highly communicative and go out of your way to contribute to the team and help others