Azure Specialist

Job Description: Data Engineer 

Position Overview:

Role Overview

We are seeking a skilled Python Data Engineer with expertise in designing and implementing data solutions using the AWS cloud platform. The ideal candidate will be responsible for building and maintaining scalable, efficient, and secure data pipelines while leveraging Python and AWS services to enable robust data analytics and decision-making processes.

Key Responsibilities

· Design, develop, and optimize data pipelines using Python and AWS services such as Glue, Lambda, S3, EMR, Redshift, Athena, and Kinesis.

· Implement ETL/ELT processes to extract, transform, and load data from various sources into centralized repositories (e.g., data lakes or data warehouses).

· Collaborate with cross-functional teams to understand business requirements and translate them into scalable data solutions.

· Monitor, troubleshoot, and enhance data workflows for performance and cost optimization.

· Ensure data quality and consistency by implementing validation and governance practices.

· Work on data security best practices in compliance with organizational policies and regulations.

· Automate repetitive data engineering tasks using Python scripts and frameworks.

· Leverage CI/CD pipelines for deployment of data workflows on AWS.

Required Skills and Qualifications

· Professional Experience: 5+ years of experience in data engineering or a related field.

· Programming: Strong proficiency in Python, with experience in libraries like pandas, pySpark, or boto3.

· AWS Expertise: Hands-on experience with core AWS services for data engineering, such as:

· AWS Glue for ETL/ELT.

· S3 for storage.

· Redshift or Athena for data warehousing and querying.

· Lambda for serverless compute.

· Kinesis or SNS/SQS for data streaming.

· IAM Roles for security.

· Databases: Proficiency in SQL and experience with relational (e.g., PostgreSQL, MySQL) and NoSQL (e.g., DynamoDB) databases.

· Data Processing: Knowledge of big data frameworks (e.g., Hadoop, Spark) is a plus.

· DevOps: Familiarity with CI/CD pipelines and tools like Jenkins, Git, and CodePipeline.

· Version Control: Proficient with Git-based workflows.

· Problem Solving: Excellent analytical and debugging skills.

Optional Skills

· Knowledge of data modeling and data warehouse design principles.

· Experience with data visualization tools (e.g., Tableau, Power BI).

· Familiarity with containerization (e.g., Docker) and orchestration (e.g., Kubernetes).

· Exposure to other programming languages like Scala or Java.

Education

· Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

Why Join Us?

· Opportunity to work on cutting-edge AWS technologies.

· Collaborative and innovative work environment.

Job Description

Build and maintain bots on Azure platform.  Integration with Active directory, WEB API based integration with external systems. Training and Integrate bots as per users’ requirements. Work in line with design guidelines, best practices and standards of bot deliverable. Creative approach to the conversation flow design, human aspects in the bot responses and sentiments

Qualifications

1. a) 5 years of experience in software development with clear understanding of the project life cycle
   b) Min 2-3 years of hands-on experience in Microsoft Azure Bot Framework , LUIS and other Cognitive services offered by Azure
   c) Hands on experience with Machine Learning based chat bots
   d) Experience with Azure bot services like Text Analytics etc.
   e)Strong database skills and hands-on experience on databases like SQL Server/Oracle
2. f) Strong experience on Azure Active directory and adaptive cards integration in Chat bot.
3. g) Strong experience designing and working with

with service-oriented architectures (SOA) and WebAPIs.

1. h) A strong experience on Microsoft Azure, ASPNET / MVC and programming languages such as C# / VBNET
2. i) Knowledge of Python and NodeJS is a plus
3. j) Ability to design and optimize SQL Server 2008 stored procedures.
4. k) Experience with JQuery, CSS3, HTML5 or similar technologies.
5. l) Ability to adapt quickly to an existing, complex environment.

About the Role:

We are seeking a talented and passionate DevOps Engineer to join our dynamic team. You will be responsible for designing, implementing, and managing scalable and secure infrastructure across multiple cloud platforms. The ideal candidate will have a deep understanding of DevOps best practices and a proven track record in automating and optimizing complex workflows.

Key Responsibilities:

Cloud Management:

• Design, implement, and manage cloud infrastructure on AWS, Azure, and GCP.
• Ensure high availability, scalability, and security of cloud resources.

Containerization & Orchestration:

• Develop and manage containerized applications using Docker.
• Deploy, scale, and manage Kubernetes clusters.

CI/CD Pipelines:

• Build and maintain robust CI/CD pipelines to automate the software delivery process.
• Implement monitoring and alerting to ensure pipeline efficiency.

Version Control & Collaboration:

• Manage code repositories and workflows using Git.
• Collaborate with development teams to optimize branching strategies and code reviews.

Automation & Scripting:

• Automate infrastructure provisioning and configuration using tools like Terraform, Ansible, or similar.
• Write scripts to optimize and maintain workflows.

Monitoring & Logging:

• Implement and maintain monitoring solutions to ensure system health and performance.
• Analyze logs and metrics to troubleshoot and resolve issues.

Required Skills & Qualifications:

• 3-5 years of experience with AWS, Azure, and Google Cloud Platform (GCP).
• Proficiency in containerization tools like Docker and orchestration tools like Kubernetes.
• Hands-on experience building and managing CI/CD pipelines.
• Proficient in using Git for version control.
• Experience with scripting languages such as Bash, Python, or PowerShell.
• Familiarity with infrastructure-as-code tools like Terraform or CloudFormation.
• Solid understanding of networking, security, and system administration.
• Excellent problem-solving and troubleshooting skills.
• Strong communication and teamwork skills.

Preferred Qualifications:

• Certifications such as AWS Certified DevOps Engineer, Azure DevOps Engineer, or Google Professional DevOps Engineer.
• Experience with monitoring tools like Prometheus, Grafana, or ELK Stack.
• Familiarity with serverless architectures and microservices.

Striim (pronounced “stream” with two i’s for integration and intelligence) was founded in 2012 with a simple goal of helping companies make data useful the instant it’s born.

Striim’s enterprise-grade, streaming integration with intelligence platform makes it easy to build continuous, streaming data pipelines – including change data capture (CDC) – to power real-time cloud integration, log correlation, edge processing, and streaming analytics.

Strong Core Java / C++ experience

·       Excellent understanding of Logical ,Object-oriented design patterns, algorithms and data structures.

·       Sound knowledge of application access methods including authentication mechanisms, API quota limits, as well as different endpoint REST, Java etc

·       Strong exp in databases - not just a SQL Programmer but with knowledge of DB internals

·       Sound knowledge of Cloud database available as service is plus (RDS, CloudSQL, Google BigQuery, Snowflake )

·       Experience working in any cloud environment and microservices based architecture utilizing GCP, Kubernetes, Docker, CircleCI, Azure or similar technologies

·       Experience in Application verticals such as ERP, CRM, Sales with applications such as Salesforce, Workday, SAP  < Not Mandatory - added advantage >

·       Experience in building distributed systems  < Not Mandatory - added advantage >

·       Expertise on Data warehouse < Not Mandatory - added advantage >

·       Exp in developing & delivering product as SaaS i< Not Mandatory - added advantage 

Hammoq is an exponentially growing Startup in US and UK. 

Design and implement secure automation solutions for development, testing, and production environments

• Build and deploy automation, monitoring, and analysis solutions

• Manage our continuous integration and delivery pipeline to maximize efficiency

• Implement industry best practices for system hardening and configuration management

• Secure, scale, and manage Linux virtual environments

• Develop and maintain solutions for operational administration, system/data backup, disaster recovery, and security/performance monitoring

• Continuously evaluate existing systems with industry standards, and make recommendations for improvement

Desired Skills & Experiences

• Bachelor’s or Master's degree in Computer Science, Engineering, or related field

• Understanding of system administration in Linux environments

• Strong knowledge of configuration management tools

• Familiarity with continuous integration tools such as Jenkins, Travis CI, Circle CI

• Proficiency in scripting languages including Bash, Python, and JavaScript

• Strong communication and documentation skills

• An ability to drive to goals and milestones while valuing and maintaining a strong attention to detail

• Excellent judgment, analytical thinking, and problem-solving skills

• Full understanding of software development lifecycle best practices

• Self-motivated individual that possesses excellent time management and organizational skills
  
  In PM's Words 
  Bash scripting, Containerd(or docker), Linux Operating system basics, kubernetes, git, Jenkins ( or any pipeline management), GCP ( or idea on any cloud technology)
  
  Linux is major..most of the people are coming from Windows.. we need Linux.. and if windows is also there it will be added advantage
  
  There is utmost certainilty that you will be working with an amazing team...

- You will manage all elements of the post-sale program relationship with your customers, starting with customer on-boarding and continuing throughout the customer relationship. 

- As the primary customer interface, you engage with customer teams to educate, identify needs, develop designs, set goals, manage and execute on plans that unlock continuous, incremental value from their investments in the CloudPassage Halo platform.

- You are hands-on during execution and thoroughly enjoy seeing your security projects come to life and supporting them afterwards. You are a trusted adviser.

Responsibilities :

- Manage a portfolio of 5+ Enterprise customer accounts with complex needs (typical enterprise customers invest between $500k and $4m+ per year with CloudPassage, have hundreds to tens of thousands of individual public cloud infrastructure deployments, and protect hundreds of thousands of cloud infrastructure assets with Halo).

- Provide level-3 technical support on your customer's most complex issues

- Lead implementation of low-level security controls in Cloud environments, for services, server and containers

- Remotely diagnose & resolve DevSecOps issues in customer environments - able to resolve their DevOps issues that may be interfering with CloudPassage processing.

- Interact with CloudPassage Engineering team by providing customer issue reproduction and data capture, technical diagnostics and validating fixes. QA experience preferred.

- Establish and program manage proactive, value-driven, high-touch relationships with your customers to understand, document and align customer strategies, business objectives, designs, processes and projects with Halo platform capabilities and broader CloudPassage services.

- Develop a trusted advisor relationship by building and maintaining appropriate relationships at all levels with your customer accounts, creating a premium and high-caliber experience.

- Ensure continued satisfaction, identify & confirm unaddressed customer needs that can be value-add opportunities for up-sell and cross-sell, and communicate those needs to the CloudPassage sales team. Identify any early CSAT issues and renewal risks and work with the internal team to remediate and ensure strong CSAT and a successful renewal.

- Be a strong customer advocate within CloudPassage and identify and support areas for improvement in the customer experience, both in our product and processes.

- Be team-oriented, but with a bias towards action to get things done for your customers.

Requirements : Strong cloud security knowledge & experience including :

- End-to-end enterprise security processes

- Cloud security - cloud migrations & shift in security requirements, tooling & approach

- Hands-on DevOps, DevSecOps architecture & automation (critical)

- 4+ years experience in security consulting and project/program management serving cybersecurity customers.

- Complex, level 3 technical support

- Remotely diagnosing & resolving DevSecOps issues in customer environments

- Interacting with CloudPassage Engineering team with customer issue reproduction

- Experience working in a security SaaS company in a startup environment.
 
- Experience working with Executive and C-Level teams.

- Ability to build and maintain strong relationships with internal and external constituents.

- Excellent organization, project management, time management, and communication skills.

- Understand and document customer requirements, map to product, track & report metrics, identify up-sell and cross-sell opportunities.
 
- Analytical both quantitatively and qualitatively.

- Excellent verbal and written communication skills.
 
- Security certifications (Security +, CISSP, etc.).

Expert Technical Skills :

- Consulting and project management : documenting project charters, project plans, executing delivery management, status reporting. Executive-level presentation skills.

- Security best practices expertise : software vulnerabilities, configuration management, intrusion detection, file integrity.

- System administration (including Linux and Windows) of cloud environments : AWS, Azure, GCP; strong networking/proxy skills.

Proficient Technical Skills :

- Configuration/Orchestration (Chef, Puppet, Ansible, SaltStack, CloudFormation, Terraform).

- CI/CD processes and environments.

Familiar Technical Skills & Knowledge : Python scripting & REST API's, Docker containers, Zendesk & JIRA.