Predictive Modelling And Optimization Consultant (SCM)

About the Company

Hypersonix.ai is disrupting the e-commerce space with AI, ML, and advanced decision-making capabilities to drive real-time business insights. Built from the ground up using modern technologies, Hypersonix simplifies data consumption for customers across various industry verticals. We are seeking a well-rounded, hands-on product leader to help manage key capabilities and features in our platform.

Position Overview

We are seeking a highly skilled Web Scraping Architect to join our team. The successful candidate will be responsible for designing, implementing, and maintaining web scraping processes to gather data from various online sources efficiently and accurately. As a Web Scraping Specialist, you will play a crucial role in collecting data for competitor analysis and other business intelligence purposes.

Responsibilities

• Scalability/Performance: Lead and provide expertise in scraping at scale e-commerce marketplaces.
• Data Source Identification: Identify relevant websites and online sources from which data needs to be scraped. Collaborate with the team to understand data requirements and objectives.
• Web Scraping Design: Develop and implement effective web scraping strategies to extract data from targeted websites. This includes selecting appropriate tools, libraries, or frameworks for the task.
• Data Extraction: Create and maintain web scraping scripts or programs to extract the required data. Ensure the code is optimized, reliable, and can handle changes in the website's structure.
• Data Cleansing and Validation: Cleanse and validate the collected data to eliminate errors, inconsistencies, and duplicates. Ensure data integrity and accuracy throughout the process.
• Monitoring and Maintenance: Continuously monitor and maintain the web scraping processes. Address any issues that arise due to website changes, data format modifications, or anti-scraping mechanisms.
• Scalability and Performance: Optimize web scraping procedures for efficiency and scalability, especially when dealing with a large volume of data or multiple data sources.
• Compliance and Legal Considerations: Stay up-to-date with legal and ethical considerations related to web scraping, including website terms of service, copyright, and privacy regulations.
• Documentation: Maintain detailed documentation of web scraping processes, data sources, and methodologies. Create clear and concise instructions for others to follow.
• Collaboration: Collaborate with other teams such as data analysts, developers, and business stakeholders to understand data requirements and deliver insights effectively.
• Security: Implement security measures to ensure the confidentiality and protection of sensitive data throughout the scraping process.

Requirements

• Proven experience of 7+ years as a Web Scraping Specialist or similar role, with a track record of successful web scraping projects
• Expertise in handling dynamic content, user-agent rotation, bypassing CAPTCHAs, rate limits, and use of proxy services
• Knowledge of browser fingerprinting
• Has leadership experience
• Proficiency in programming languages commonly used for web scraping, such as Python, BeautifulSoup, Scrapy, or Selenium
• Strong knowledge of HTML, CSS, XPath, and other web technologies relevant to web scraping and coding
• Knowledge and experience in best-of-class data storage and retrieval for large volumes of scraped data
• Understanding of web scraping best practices, including handling dynamic content, user-agent rotation, and IP address management
• Attention to detail and ability to handle and process large volumes of data accurately
• Familiarity with data cleansing techniques and data validation processes
• Good communication skills and ability to collaborate effectively with cross-functional teams
• Knowledge of web scraping ethics, legal considerations, and compliance with website terms of service
• Strong problem-solving skills and adaptability to changing web environments

Preferred Qualifications

• Bachelor’s degree in Computer Science, Data Science, Information Technology, or related fields
• Experience with cloud-based solutions and distributed web scraping systems
• Familiarity with APIs and data extraction from non-public sources
• Knowledge of machine learning techniques for data extraction and natural language processing is desired but not mandatory
• Prior experience in handling large-scale data projects and working with big data frameworks
• Understanding of various data formats such as JSON, XML, CSV, etc.
• Experience with version control systems like Git

About Vidhai :

Vidhai Technologies has built business-process expertise, in addition to knowledge of SAP application outsourcing. At Vidhai Technologies, we have a dedicated team of SAP consultants and we provide high quality work that complies with international standards.

Responsibilities :

• Technical analysis, designing, reviews, testing an implementation of SAP ECC/EWM developments, ranging from small enhancements to large projects
• Ensure compliance to existing and development of required data and reporting standards
• Ability to write and validate the technical specification and able to create test Scripts
• Cross-functional knowledge of Finance, Sales, Marketing, Logistics and their use of data. Rich experience with SAP ABAP & SAP EWM ABAP.
• Will work closely with the Business solutions group, to complete on demand work requests, as well as being assigned for large scale SAP cross functional project Projects.
• Keep abreast of SAP releases, enhancements/new functionality and perform application research.
• The Job role involves all phases of the project - Requirement gathering, Estimation, Project Planning, Execution, Go-live and support.
• Ability to help resolve complex technical issues and independently manage critical/complex situations.
• Proven success designing and developing SAP solutions on the SAP ECC/ SAP EWM platform.
• Strong oral and written communication ability.

Required Qualifications :

• Bachelor’s Degree – Engineering or Computer Science
• 8+ years overall SAP experience with minimum 2 End to End Implementations and at least 2 Support Projects
• Should have worked on SAP EWM S/4 2021.
• Must be expert at testing and debugging procedures.
• Must be able to evaluate user requirements relative to current application functionality.
• Requires clear written and verbal communication in a technical context.
• Should have thorough knowledge on EWM PPF, EWM RF framework, ITS Mobile, CIF, Reports, Forms, OOPS ABAP, BAPI, Enhancements, BADI, ALE.
• Experience in ECC <-> EWM integration.
• Ability to develop new and enhance existing RF functions.
• Experience in Smartforms, Label Development and EWM enhancements.
• Able to work with Functional and Technical Teams
• Proven ability Delivering complex and time sensitive projects
• Experience working on a team operating under an Agile Scrum delivery methodology
• Excellent analytical skills and the ability to provide alternative solutions to technical problems

Core Experience:

•Experience in Core Java, J2EE, Spring/Spring Boot, Hibernate, Spring REST, Linux, JUnit, Maven, Design Patterns.

• Sound knowledge of RDBMS like MySQL/Postgres, including schema design.

• Exposure to Linux environment.

• Exposure to Docker and Kubernetes.

• Basic Knowledge of Cloud Services of AWS, Azure, GCP cloud provider.

• Proficient in general programming, logic, problem solving, data structures & algorithms

• Good analytical, grasping and problem-solving skills.

Secondary Skills:

• Agile / Scrum Development Experience preferred.

• Comfortable working with a microservices architecture and familiarly with NoSql solutions.

• Experience in Test Driven Development.

• Excellent written and verbal communication skills.

• Hands-on skills in configuration of popular build tools, like Maven and Gradle

• Good knowledge of testing frameworks such as JUnit.

• Good knowledge of coding standards, source code organization and packaging/deploying.

• Good knowledge of current and emerging technologies and trends.

Job Responsibilities:

• Design, Development and Delivery of Java based enterprise-grade applications.

• Ensure best practices, quality and consistency within various design and development phases.

• Develop, test, implement and maintain application software working with established processes.

Work with QA and help them for test automation

• Work with Technical Writer and help them documenting the features you have developing.

Education and Experience:

• Bachelor’s / master’s degree in computer science or information technology or related field

Responsibilities:

• Involvement In Creating of the Test Cases, Test Scenarios and Test Data.
• Preparation Of Test Strategy.
• Involvement In Database Testing
• Responsible for GUI and Functional Testing, using Black Box Testing Techniques.
• Involvement in Test Execution, Result Analyzing, and Defect Reporting.
• Involved in Analyzing the Requirements and Communicating with BA Team for a Better Understanding of the Requirements.
• Responsible For Test Deliverables, Prioritizes and Monitors Activities to Meet Such Dates for Assigned Features
• Identified Test Cases and Test Data
• Execution of Test Cases From JIRA.
• Performing Functional Testing and Regression Testing, Integration, Testing, Sanity Testing.
• Identifying Test Cases for Automation.
• Reviewing the Automation Script

Skills:

• Proven experience as a Quality Assurance Tester or similar role
• Experience in project management and QA methodology
• Familiarity with Agile frameworks and regression testing is a plus
• Ability to document and troubleshoot errors
• Working knowledge of test management
• Excellent communication skills
• Attention to detail
• Analytical mind and problem-solving aptitude
• Strong organizational skills
• BSc/BA in Computer Science, Engineering, or a related field

• Participate and collaborate with the users, business analyst, quality assurance/quality control analyst in the gathering of user requirements and specifications.
• Analyze technical and business requirements and translate these into basic and detailed technical design.
• Participate and conduct feasibility study, research and development, prototyping and proof of concept (PoC) in implementing new/existing systems, solutions and processes.
• Participate in the technical and project documentation such as but not limited to functional, system and technical design, requirements and specifications.
• Develop, customize, enhance, fix and maintain codes, applications and systems.
• Create test scenarios and data and conduct or participate in non-functional and functional testing (e.g., unit testing, system testing, integration testing, etc.).
• Document, analyze and report test results.
• Develop and review codes, programs and configurations to verify consistency and conformance with established programming and industry standards, guidelines, policies and practices.
• Conduct incident and problem analysis, data gathering, investigation and resolution of issues, and provide technical consultancy, assistance and support.
• Deliver the required systems/applications/solutions on time and based on agreed budget and specifications.
• Identify, assess and recommend opportunities for application and process improvement.
• Prepare reports, manuals and other documentation on the status, operation and maintenance of software.
• Provide regular and effective progress updates to the project manager/team lead/supervisor/immediate manager.
• Actively participate in and lead the peer review and status meeting to communicate progress and escalate risks and roadblocks.
• Prepare training materials and provide assistance in conducting the training to users or other members of the team.
• Responsible for the information security by protecting confidential information from unauthorized access, ensuring the integrity of the information and information system, taking appropriate measures to manage security risks and following and complying with the laws, legislations and terms of contracts.
• Perform other duties as assigned, if necessary.

What you need to have:

Job description

    A minimum of 8-10 years of hands-on IT experience, developing at least more than two full life-cycle project using public Cloud technologies such as SOA Suite, OCI, AWS, GCP, Azure etc.
    At least 5 years of experience in Java/J2EE with Spring Boot, Spring Microservices, Angular, MongoDB & SOA Suite 12C. Willing to learn new technologies .
    NodeJS/Angular/Java/J2EE web application development
    Agile development concepts
    REST, JSON, and distributed application development
    Unit testing frameworks and approaches to coding
    Works on small to large, complex projects that require increased skill in multiple technical environments and possesses knowledge in a specific business area.
    Strong written and communications skills are a must. Must be able to document, present, and articulate designs and technical decisions in front of teams and key business design makers.
    Developer loves to write code, build products and see your creations used by customers around the world.
Excellent experience in XML technologies XML, XSD, XSLT, XPath and Web Services SOAP, WSDL
Knowledge in functional and technical aspects of SOA (Service Oriented Architecture)
    Front-end frameworks (React, Angular, JS, REST)
General Cloud or Oracle Cloud Infrastructure knowledge
Oracle Integration cloud experience
The cloud migration experience is a plus
Competitive knowledge will be a plus.

Job Responsibilities

    Translate application storyboards and use cases into functional applications
    Design, build and maintain efficient, reusable, and reliable Java/Node/SOA/Mulesoft code
To develop integration solutions using Oracle SOA Suite 12c and Oracle Integration Cloud.
    To Support SIT, UAT, Go-Live, Hyper care
    To Support and resolve L3 level issues
    Drive initial testing phase and quality assurance process.
    Log their hours correctly in the System so that they can be billed to the Customers accordingly.
    Deliver high-quality, fully tested, and fault-proof Customer Integration Developments, as per the Technical Mapping Specifications.
    Ensure implementation of optimized, reusable (where possible) deliverables that cater to customer needs and cause the least impact to the existing Customer Integration landscape.
    Extensive know-how on the relevant Customer Integration IT Products, Integration patterns, protocols, and tools.
    Testing bench skills
    Deployment process awareness in full Software Development Lifecycle
    To deliver quality Integration Solutions on time.
    To hand over the Integration Solution to support teams with quality documentation.
    To provide good support as L3 Support.
    To be able to handle multiple projects at a time.

• Write well-designed code.
• Produce detailed specifications.
• Troubleshoot, test and maintain the core product software and databases to ensure strong optimization and functionality.
• Contribute in all phases of the development lifecycle.
• Follow industry best practices.
• Develop and deploy new features to facilitate related procedures and tools if necessary

• Expertise in any MVC framework, RDBMS, JSON,PHP and Rest APIs.
• Good understanding of design patterns.
• Should be flexible to work on multiple technologies as per project requirements.
• Candidate should be able to handle given task independently with minimal help.
• He/She should be a team player and be able to complete assign tasks on time.