NodeJs Developer

About the Company

Hypersonix.ai is disrupting the e-commerce space with AI, ML, and advanced decision-making capabilities to drive real-time business insights. Built from the ground up using modern technologies, Hypersonix simplifies data consumption for customers across various industry verticals. We are seeking a well-rounded, hands-on product leader to help manage key capabilities and features in our platform.

Position Overview

We are seeking a highly skilled Web Scraping Architect to join our team. The successful candidate will be responsible for designing, implementing, and maintaining web scraping processes to gather data from various online sources efficiently and accurately. As a Web Scraping Specialist, you will play a crucial role in collecting data for competitor analysis and other business intelligence purposes.

Responsibilities

• Scalability/Performance: Lead and provide expertise in scraping at scale e-commerce marketplaces.
• Data Source Identification: Identify relevant websites and online sources from which data needs to be scraped. Collaborate with the team to understand data requirements and objectives.
• Web Scraping Design: Develop and implement effective web scraping strategies to extract data from targeted websites. This includes selecting appropriate tools, libraries, or frameworks for the task.
• Data Extraction: Create and maintain web scraping scripts or programs to extract the required data. Ensure the code is optimized, reliable, and can handle changes in the website's structure.
• Data Cleansing and Validation: Cleanse and validate the collected data to eliminate errors, inconsistencies, and duplicates. Ensure data integrity and accuracy throughout the process.
• Monitoring and Maintenance: Continuously monitor and maintain the web scraping processes. Address any issues that arise due to website changes, data format modifications, or anti-scraping mechanisms.
• Scalability and Performance: Optimize web scraping procedures for efficiency and scalability, especially when dealing with a large volume of data or multiple data sources.
• Compliance and Legal Considerations: Stay up-to-date with legal and ethical considerations related to web scraping, including website terms of service, copyright, and privacy regulations.
• Documentation: Maintain detailed documentation of web scraping processes, data sources, and methodologies. Create clear and concise instructions for others to follow.
• Collaboration: Collaborate with other teams such as data analysts, developers, and business stakeholders to understand data requirements and deliver insights effectively.
• Security: Implement security measures to ensure the confidentiality and protection of sensitive data throughout the scraping process.

Requirements

• Proven experience of 6+ years as a Web Scraping Specialist or similar role, with a track record of successful web scraping projects
• Expertise in handling dynamic content, user-agent rotation, bypassing CAPTCHAs, rate limits, and use of proxy services
• Knowledge of browser fingerprinting
• Has leadership experience
• Proficiency in programming languages commonly used for web scraping, such as Python, BeautifulSoup, Scrapy, or Selenium
• Strong knowledge of HTML, CSS, XPath, and other web technologies relevant to web scraping and coding
• Knowledge and experience in best-of-class data storage and retrieval for large volumes of scraped data
• Understanding of web scraping best practices, including handling dynamic content, user-agent rotation, and IP address management
• Attention to detail and ability to handle and process large volumes of data accurately
• Familiarity with data cleansing techniques and data validation processes
• Good communication skills and ability to collaborate effectively with cross-functional teams
• Knowledge of web scraping ethics, legal considerations, and compliance with website terms of service
• Strong problem-solving skills and adaptability to changing web environments

Preferred Qualifications

• Bachelor’s degree in Computer Science, Data Science, Information Technology, or related fields
• Experience with cloud-based solutions and distributed web scraping systems
• Familiarity with APIs and data extraction from non-public sources
• Knowledge of machine learning techniques for data extraction and natural language processing is desired but not mandatory
• Prior experience in handling large-scale data projects and working with big data frameworks
• Understanding of various data formats such as JSON, XML, CSV, etc.
• Experience with version control systems like Git

Immediate Joiners Preferred. Notice Period - Immediate to 30 Days

Interested candidates are requested to email their resumes with the subject line "Application for [Job Title]".

Only applications received via email will be reviewed. Applications through other channels will not be considered.

About Us

adesso India is a dynamic and innovative IT Services and Consulting company based in Kochi. We are committed to delivering cutting-edge solutions that make a meaningful impact on our clients. As we continue to expand our development team, we are seeking a talented and motivated Backend Developer to join us in creating scalable and high-performance backend systems.

Job Description

We are looking for an experienced Backend and Data Developer with expertise in Java, SQL, BigQuery development working on public clouds, mainly GCP. As a Senior Data Developer, you will play a vital role in designing, building, and maintaining robust systems to support our data analytics. This position offers the opportunity to work on complex services, collaborating closely with cross-functional teams to drive successful project delivery.

Responsibilities

• Development and maintenance of data pipelines and automation scripts with Python
• Creation of data queries and optimization of database processes with SQL
• Use of bash scripts for system administration, automation and deployment processes
• Database and cloud technologies
• Managing, optimizing and querying large amounts of data in an Exasol database (prospectively Snowflake)
• Google Cloud Platform (GCP): Operation and scaling of cloud-based BI solutions, in particular
• Composer (Airflow): Orchestration of data pipelines for ETL processes
• Cloud Functions: Development of serverless functions for data processing and automation
• Cloud Scheduler: Planning and automation of recurring cloud jobs
• Cloud Secret Manager: Secure storage and management of sensitive access data and API keys
• BigQuery: Processing, analyzing and querying large amounts of data in the cloud
• Cloud Storage: Storage and management of structured and unstructured data
• Cloud monitoring: monitoring the performance and stability of cloud-based applications
• Data visualization and reporting
• Creation of interactive dashboards and reports for the analysis and visualization of business data with Power BI

Requirements

• Minimum of 4-6 years of experience in backend development, with strong expertise in BigQuery, Python and MongoDB or SQL.
• Strong knowledge of database design, querying, and optimization with SQL and MongoDB and designing ETL and orchestration of data pipelines.
• Expierience of minimum of 2 years with at least one hyperscaler, in best case GCP
• Combined with cloud storage technologies, cloud monitoring and cloud secret management
• Excellent communication skills to effectively collaborate with team members and stakeholders.
• 
  

Nice-to-Have:

• Knowledge of agile methodologies and working in cross-functional, collaborative teams.

About the Company

An Online platform for creators, influencers and celebrities to grow, manage and monetise their community. It is aimed at both established and aspiring online creators who want to pursue their passion. Our vision is to enable anyone and everyone to make a successful living doing what they enjoy.

Skills And Qualification: -

• Must have experience with any scripting language (JavaScript/NodeJS preferred)

• Experience with API-driven and highly scalable application is a plus

• Good knowledge of non-relational DB (MongoDB preferred)

• Good with data structures and algorithms

• Good to have an experience with testing framework and CI/CD pipeline

• 1 years of experience in software development preferably B2C experience.

• Basic understanding of Frontend and client-side frameworks like React, Angular, Vue will be plus.

• Experience in building scalable Restful APIs & Services

Job Description:

• Bachelor's or Master's degree in Computer Science.
• Proven experience in leading a team of backend engineers
• Strong organizational and project management skills.
• Proficiency with fundamental front end languages such as HTML, CSS and JavaScript.
• Familiarity with Android development - kotlin, RX-java, design pattern.
• Proficiency with server-side languages such as Spring boot, Hibernate.
• Familiarity with database technology such as MySQL and MongoDB.
• Familiarity with cloud platforms(GCP).
• Experience with Agile/Scrum methodologies
• Excellent verbal communication skills.
• Good problem-solving skills.
• Attention to detail.

• Participate in the entire application lifecycle, focusing on coding and debugging
• Write clean code to develop functional web applications
• Troubleshoot and debug applications
• Collaborate with Front-end developers to integrate user-facing elements with server-side logic
• Gather and address technical and design requirements
• Provide training and support to internal teams
• Build reusable code and libraries for future use
• Liaise with developers, designers to identify new features
• Follow emerging technologies

• Spent at least 3 yrs in a solid back end role
• Experience taking a problem to a product solution (module/product)
• Prior experience working with startups and understand the fast-paced, dynamic nature of work

• Javascript, NodeJS
• Client-server architecture
• OOP concepts, including design patterns
• Understanding of RDBMS (MySQL, Postgresql)
• Understanding of REST API
• Familiarity with frameworks such as ExpressJs

• Knowledge of TDD frameworks mocha, chai, jest, etc
• Knowledge of AWS (Lambda, RDS, EC2, SQS, S3, ECS, etc)
• Basic knowledge of Typescript, NextJs
• Prior experience in fin-tech

Requirements and Qualifications :
- BS/MS degree in Computer Science, Engineering or a related subject
- 3-5 years of experience with Ruby and the Rails framework
- 3-5 years of experience with Git and Github
- 3-5 years of experience with SQL backends, preferably MongoDB, PostGre SQL
- Familiarity with testing tools such as Rspec
- Knowledge of Docker and docker-based deployment

- Critical thinker and problem-solving skills
- Team player
- Good time-management skills

Responsibilities
- Experience executing projects on WordPress
- Experience customizing existing WordPress plug-ins for integration or other requirements
- Expertise in customizing, developing, and integrating WordPress themes
- Manage the project giving importance to cost and quality
- Work with the user group to improve the solution

- Document existing functions and processes

Skills & Qualifications
- Minimum 4 year of hands on experience in WordPress development
- Good understanding of PHP, MYSQL, HTML5, CSS3 and jQuery
- Strong knowledge of PHP web frameworks
- Understanding the fully synchronous behavior of PHP
- Understanding fundamental design principles behind a scalable application
- Integration of multiple data sources and databases into one system
- Familiarity with SQL/NoSQL databases and their declarative query languages