Hiring Netskope Engineer

Must Have -

a. Background working with Startups

b. Good knowledge of Kubernetes & Docker

c. Background working in Azure

What you’ll be doing

• Ensure that our applications and environments are stable, scalable, secure and performing as expected.
• Proactively engage and work in alignment with cross-functional colleagues to understand their requirements, contributing to and providing suitable supporting solutions.
• Develop and introduce systems to aid and facilitate rapid growth including implementation of deployment policies, designing and implementing new procedures, configuration management and planning of patches and for capacity upgrades
• Observability: ensure suitable levels of monitoring and alerting are in place to keep engineers aware of issues.
• Establish runbooks and procedures to keep outages to a minimum. Jump in before users notice that things are off track, then automate it for the future.
• Automate everything so that nothing is ever done manually in production.
• Identify and mitigate reliability and security risks. Make sure we are prepared for peak times,
• DDoS attacks and fat fingers.
• Troubleshoot issues across the whole stack - software, applications and network.
• Manage individual project priorities, deadlines, and deliverables as part of a self-organizing team.
• Learn and unlearn every day by exchanging knowledge and new insights, conducting constructive code reviews, and participating in retrospectives.

Requirements

• 2+ years extensive experience of Linux server administration include patching, packaging (rpm), performance tuning, networking, user management, and security.
• 2+ years of implementing systems that are highly available, secure, scalable, and self-healingon Azure cloud platform
• Strong understanding of networking, especially in cloud environments along with a good understanding of CICD.
• Prior experience implementing industry standard security best practices, including those recommended by Azure
• Proficiency with Bash, and any high-level scripting language.
• Basic working knowledge of observability stacks like ELK, prometheus, grafana, Signoz etc
• Proficiency with Infrastructure as Code and Infrastructure Testing, preferably using Pulumi/Terraform.
• Hands-on experience in building and administering VMs and Containers using tools such as Docker/Kubernetes.
• Excellent communication skills, spoken as well as written, with a demonstrated ability to articulate technical problems and projects to all stakeholders.

Job Description:

As an Azure Data Engineer, your role will involve designing, developing, and maintaining data solutions on the Azure platform. You will be responsible for building and optimizing data pipelines, ensuring data quality and reliability, and implementing data processing and transformation logic. Your expertise in Azure Databricks, Python, SQL, Azure Data Factory (ADF), PySpark, and Scala will be essential for performing the following key responsibilities:

Designing and developing data pipelines: You will design and implement scalable and efficient data pipelines using Azure Databricks, PySpark, and Scala. This includes data ingestion, data transformation, and data loading processes.

Data modeling and database design: You will design and implement data models to support efficient data storage, retrieval, and analysis. This may involve working with relational databases, data lakes, or other storage solutions on the Azure platform.

Data integration and orchestration: You will leverage Azure Data Factory (ADF) to orchestrate data integration workflows and manage data movement across various data sources and targets. This includes scheduling and monitoring data pipelines.

Data quality and governance: You will implement data quality checks, validation rules, and data governance processes to ensure data accuracy, consistency, and compliance with relevant regulations and standards.

Performance optimization: You will optimize data pipelines and queries to improve overall system performance and reduce processing time. This may involve tuning SQL queries, optimizing data transformation logic, and leveraging caching techniques.

Monitoring and troubleshooting: You will monitor data pipelines, identify performance bottlenecks, and troubleshoot issues related to data ingestion, processing, and transformation. You will work closely with cross-functional teams to resolve data-related problems.

Documentation and collaboration: You will document data pipelines, data flows, and data transformation processes. You will collaborate with data scientists, analysts, and other stakeholders to understand their data requirements and provide data engineering support.

Skills and Qualifications:

Strong experience with Azure Databricks, Python, SQL, ADF, PySpark, and Scala.

Proficiency in designing and developing data pipelines and ETL processes.

Solid understanding of data modeling concepts and database design principles.

Familiarity with data integration and orchestration using Azure Data Factory.

Knowledge of data quality management and data governance practices.

Experience with performance tuning and optimization of data pipelines.

Strong problem-solving and troubleshooting skills related to data engineering.

Excellent collaboration and communication skills to work effectively in cross-functional teams.

Understanding of cloud computing principles and experience with Azure services.

Roles and Responsibility

Utilize design tools and processes to create new product design elements Participate in peer reviews of design work to evaluate design techniques and overall success in meeting the compelling user experience objectives Lead the enhancement the current design system containing our re-usable design elements and components, style guide, WCAG compliance standards, and developer instructions Work with team members of all levels to complete daily tasks, share design and development knowledge, follow-up and escalate issues appropriately, and recommend design and process enhancement Take part in user-centered design methods including user research & synthesis, exploration, story-telling, detailed design, journey mapping and prototyping Design and present findings to the business on 2 to 3 actionable items to enhance the customer experience Create and communicate your design and user experience insights to company leaders Document design notes, element construction, development processes, and other supporting materials Manage project plans, feature design and delivery Work alongside a UX Designer to conduct user research into how users work through data entry forms and obtain user feedback on existing designs that will help inform new design improvements

Job Requirements :

- 4+ years of Java development experience

- 4+ years of microservice development experience with Spring boot framework

- Core & Advanced Java (Threading, Design Patterns, Data Structures) J2EE, REST web services

- Excellent knowledge of Enterprise Design Patterns

- Full stack development with Angular 8 experience will be a plus

- Experience with test driven software development

- Exposure to telecom domain

- ETOM/ SID which make the TM Forum framework

About Mastercard

We are the global technology company behind the world’s fastest payments processing network.

We are a vehicle for commerce, a connection to financial systems for the previously excluded, a technology innovation lab, and the home of Priceless.

We ensure every employee has the opportunity to be a part of something bigger and to change lives.

We believe as our company grows, so should you.

We believe in connecting everyone to endless, priceless possibilities.

Overview Services and Data is helping to shape the future of data insights by leveraging billions of anonymized, aggregated transactions in a 10 petabyte date warehouse to help financial institutions, merchants, media, and governments manage their businesses more effectively.

Advanced Analytics is charged with servicing clients by centralizing and optimizing the world class analytical, modeling, software coding, data sourcing, product development, product management, econometrics, and associated delivery capabilities of the MasterCard Advisors organization.

It focuses on creating innovative technology solutions which leverage technology in the data science, artificial intelligence and analytics arenas; on enabling the field with industrialized, repeatable products and on researching and incubating emerging technology to determine how they might apply to our customers and facilitate positive outcomes.

What we are re looking for

• Are you motivated by developing new Analytical skills, leading to insights into issues and developing recommendations that add real value to clients?
• Have you managed the client independently and effectively?
• Do you want to play a key role in driving a world beyond cash?
• Leading the formulation of artificial intelligence and machine learning solution objectives. Working on technical requirements based on user need.
• Responsible for creating the framework of solutions that take data intensive and complex business challenges and provide easily consumed and automated outcomes
• Using unique visualization techniques, condenses large volumes of complex ideas into elegant and simple visual models
• Determine opportunities to exploit new data sources or leverage new outcomes from existing data sources, by applying new models and algorithms to create business value
• Influences a client's strategic decisions by using deep industry expertise and deploying innovative Deep Learning analytics solutions in the operational systems Leadership Skills
• Works closely with clients/internal stakeholders to understand their business needs and design a technical solution
• Proving viability of the solution through mechanisms like proof-of-concepts
• Thought Leadership in AI – Developing compelling audience-specific messages and tools. Capture and share best practices and insights internally and with partners and customers.
• Self-driven, energetic, creative with ability to work in global teams.
• Excellent communication skills and a wide knowledge base, to convince the Stakeholders on application of AI/ML
• Provide technical leadership to the team members in relevant topics on AI/ML
• Adaptable - Takes in stride and constantly attunes to the changing needs of a highly dynamic business
• Curious - our key contributors are always seeking to grow their knowledge, to gain new perspectives, and to find better ways forward by researching and showcasing latest AI tools, techniques and applications
• Tenacious - self-starters who will take ownership of projects and bring them to completion despite difficulties or setbacks
• Consulting and Project Management Experience preferred

Functional and Technical Skills

• Experience in building and implementing AI application in any of the two domains - Fraud, risk, marketing, finance, operations for Banks, Fintech, Ecommerce, merchants or retailers
• Has a deep understanding of business value industry requirements and advanced analytic models (statistical, operations research, computing process)
• Responsible for building applications using artificial intelligence/machine learning technology, applying latest industrial and academic developments, prefer Kaggle hackathon participant
• Expertise in deep learning frameworks for Production Systems like Tensorflow, Keras (for RPD and neural net architecture evaluation), PyTorch and Xgboost, Caffe, Theono
• Proficient in Deep Learning algorithm techniques like Random Forest, GBM, KNN, SVM, Bayesian, Text Mining techniques, Multilayer Perceptron, Neural Networks – Feedforward, CNN, LSTM’s GRU’s.
• Optimization techniques – Activity regularization (L1 and L2), Adam, Adagrad, Adadelta concepts; Cost Functions in Neural Nets – Contrastive Loss, Hinge Loss, Binary Cross entropy, Categorical Cross entropy; developed applications in KRR, NLP, Speech and Image processing
• Expertise in classical Machine Learning algorithms like Logistic Regression, Decision trees, Clustering (K-means, Hierarchical and Self-organizing Maps), TSNE, PCA, Bayesian models, Time Series ARIMA/ARMA, Recommender Systems - Collaborative Filtering, FPMC, FISM, Fossil etc
• Extensive experience in statistical tools and programming environments like Python, R, SAS, SQL
• Experience with BIG DATA platforms - Hadoop, Hive, Spark, GPU Clusters for deep learning

Qualifications

• Minimum Graduate degree in Mathematics/Computer Science/Engineering