Responsibilities: • Design and build a hybrid data solution using a combination of on-premise and in-cloud AWS services. • Diagnose and troubleshoot complex distributed systems problems and develop solutions with a significant impact on our massive scale. • Build tools to ingest and process terabyte-scale data on a daily basis. • Communicate with a wide set of teams, including product owners, business analysts, data and enterprise architects, platform engineers, and cloud vendors, etc. • Compilation of detailed design documents, technical specification documents, and test plans as required. • Independently manage development tasks as per technical specification documents, prod deployment, post-prod support, etc • Managing support to Unit Testing, SIT & UAT • Co-ordinate with business and support teams on testing and migration activities. Requirement: • Hands-on experience in distributed systems and Hadoop and its Ecosystem. • 3-5 years of extensive experience of cloud-related services like compute, storage, messaging (Eg SNS, SQS). AWS experience is preferred. • Strong software development skills in at least one of Java, C/C++, Scala or Python (Preferred). • Strong knowledge on AWS Data Services - S3, RDS,Redshift,DynamoDB,AWS Glue,EMR,Lambda,etc • Good knowledge on Big Data ecosystem - PySpark, Hive, HDFS, Hbase. Strong SQL knowledge • Able to understand data models. Create and understand ETL/Data mapping sheets. • Good knowledge of developing batch, stream and event-based data pipelines. • Good knowledge of traditional Data Warehouse implementations and BI and ETL tools. • Experience with Agile/Scrum/DevOps software development methodologies. • Experience building and supporting large-scale systems in a production environment. Good to have: • Design Dimensional Models for Data Warehouse and Data Marts • Knowledge of version control systems, build automation and CI/CD tools and frameworks • Experience with operating system internals, file systems, disk/storage technologies, and storage protocols. • Good understanding of MDM solutions and experience working on any MDM tools like Informatica MDM, etcacross multiple cloud clusters.
Minimum 3+ years of experience in AWS Administration is required. Sound knowledge of Linux(Ubuntu Server Preferred) Managing a linux or Ubuntu server in AWS (Min.2 years exp) Experience in managing MYSQL database in AWS Environment (Min.2 year) In-depth knowledge and experience with Amazon Web Services (AWS), Microsoft Azure and Google Cloud. Working knowledge of cloud services: SaaS, PaaS, and IaaS Working knowledge of Multi-tier architectures: load balancers, caching, web servers, application servers and databases. Hands-on experience with Virtual Private Cloud (VPC) and Elastic Compute Cloud (EC2) , Identity and Access Management (IAM) , Lambda functions and Cloud watch ,Simple Storage Service (S3) , AWS DynamoDB and Relational Database Services (RDS) , AWS Kinesis and Redis cache , AWS API Gateway , Simple Notification Service (SNS), Simple Email Service (SES) and Simple Messaging Service (SMS) , Basics of Elastic Load Balancer (ELB) , CloudFront, Simple Workflow Services (SWS) and Elastic BeanStalk Experience with various virtualization technologies and multi-tenant, private and hybrid cloud environments. Working technical knowledge of in-house network, server, and platform operating systems. Working technical knowledge of current systems software, protocols, and standards, including firewalls, Active Directory, etc. Strong system administration (Linux/Unix or Windows) at the command-line level including IP tables. Experience in scripting (BASH, Perl, Powershell, Python) and building required automation (using standard technologies such as Puppet, Ansible and Chef) Strong knowledge of network administration. Hands-on software and hardware troubleshooting experience. Experience documenting and maintaining configuration and process information. Knowledge of broadcast transcoding and workflow automation systems. Skilled at working within a team-oriented, collaborative environment. Ability to conduct research into hardware and software issues and products as required. Preferred, certifications include: AWS Cloud Practitioner, AWS SysOps Administrator, AWS Solutions Architect.