About the Company
Hypersonix.ai is disrupting the e-commerce space with AI, ML, and advanced decision-making capabilities to drive real-time business insights. Built from the ground up using modern technologies, Hypersonix simplifies data consumption for customers across various industry verticals. We are seeking a well-rounded, hands-on product leader to help manage key capabilities and features in our platform.
Position Overview
We are seeking a highly skilled Web Scraping Architect to join our team. The successful candidate will be responsible for designing, implementing, and maintaining web scraping processes to gather data from various online sources efficiently and accurately. As a Web Scraping Specialist, you will play a crucial role in collecting data for competitor analysis and other business intelligence purposes.
Responsibilities
- Scalability/Performance: Lead and provide expertise in scraping at scale e-commerce marketplaces.
- Data Source Identification: Identify relevant websites and online sources from which data needs to be scraped. Collaborate with the team to understand data requirements and objectives.
- Web Scraping Design: Develop and implement effective web scraping strategies to extract data from targeted websites. This includes selecting appropriate tools, libraries, or frameworks for the task.
- Data Extraction: Create and maintain web scraping scripts or programs to extract the required data. Ensure the code is optimized, reliable, and can handle changes in the website's structure.
- Data Cleansing and Validation: Cleanse and validate the collected data to eliminate errors, inconsistencies, and duplicates. Ensure data integrity and accuracy throughout the process.
- Monitoring and Maintenance: Continuously monitor and maintain the web scraping processes. Address any issues that arise due to website changes, data format modifications, or anti-scraping mechanisms.
- Scalability and Performance: Optimize web scraping procedures for efficiency and scalability, especially when dealing with a large volume of data or multiple data sources.
- Compliance and Legal Considerations: Stay up-to-date with legal and ethical considerations related to web scraping, including website terms of service, copyright, and privacy regulations.
- Documentation: Maintain detailed documentation of web scraping processes, data sources, and methodologies. Create clear and concise instructions for others to follow.
- Collaboration: Collaborate with other teams such as data analysts, developers, and business stakeholders to understand data requirements and deliver insights effectively.
- Security: Implement security measures to ensure the confidentiality and protection of sensitive data throughout the scraping process.
Requirements
- Proven experience of 6+ years as a Web Scraping Specialist or similar role, with a track record of successful web scraping projects
- Expertise in handling dynamic content, user-agent rotation, bypassing CAPTCHAs, rate limits, and use of proxy services
- Knowledge of browser fingerprinting
- Has leadership experience
- Proficiency in programming languages commonly used for web scraping, such as Python, BeautifulSoup, Scrapy, or Selenium
- Strong knowledge of HTML, CSS, XPath, and other web technologies relevant to web scraping and coding
- Knowledge and experience in best-of-class data storage and retrieval for large volumes of scraped data
- Understanding of web scraping best practices, including handling dynamic content, user-agent rotation, and IP address management
- Attention to detail and ability to handle and process large volumes of data accurately
- Familiarity with data cleansing techniques and data validation processes
- Good communication skills and ability to collaborate effectively with cross-functional teams
- Knowledge of web scraping ethics, legal considerations, and compliance with website terms of service
- Strong problem-solving skills and adaptability to changing web environments
Preferred Qualifications
- Bachelor’s degree in Computer Science, Data Science, Information Technology, or related fields
- Experience with cloud-based solutions and distributed web scraping systems
- Familiarity with APIs and data extraction from non-public sources
- Knowledge of machine learning techniques for data extraction and natural language processing is desired but not mandatory
- Prior experience in handling large-scale data projects and working with big data frameworks
- Understanding of various data formats such as JSON, XML, CSV, etc.
- Experience with version control systems like Git
Shubham Vishwakarma
Full Stack Developer - Averlon
About Hypersonix Inc
About
Hypersonix offers a unified, AI-Powered Intelligent Enterprise Platform designed to help leading enterprises drive profitable revenue growth. It acts as the business's nerve system, detecting and reacting to changes in market conditions and the requirements of customers to obtain the best possible results and the most profitable profits. It analyzes all the data that is available in real-time to provide insight that may be used.
Users of Hypersonix can forecast and adjust prices, manage inventories, keep an eye on supply chains, and generate lucrative revenue growth by capitalizing on instantaneous shifts in consumer demand, fluctuations in supply networks, and inventory surpluses and shortages. We provide monitoring and diagnostics that cover the whole eCommerce process, from sales to shipment, as well as analysis of the competition, customer behavior, and demand projections. Hypersonix is compatible with the vast majority of eCommerce systems and may provide results in a matter of weeks, rather than months or years.
Our Mission
Our mission is to deliver a comprehensive, generative AI-driven operating system for every commerce business that is intelligent, predictive, prescriptive, and proactive.
Our Vision
The future of eCommerce will be shaped by AI-driven businesses that focus on driving profit and revenue growth, globally.
Candid answers by the company
Hypersonix AI simplifies the complex analysis of competitors, pricing, promotions, inventory, customer, behavior and campaigns, forecasts demand and plans and automates critical merchandising and marketing workflows to help retailers automates better and faster decisions, to grow profits.
Product showcase
Photos
Company social profiles
Similar jobs
- Experience in Python
- Experience in any Framework like Django, and Flask.
- Primary and Secondary skills - Python, OOPs and Data Structure
- Good understanding of Rest Api
- Familiarity with event-driven programming in Python
- Good analytical and troubleshooting skills
We are currently hiring a Python Developer to join our engineering team to develop dynamic
software applications.
Main Responsibilities of the Python Engineer:-
Your responsibilities will include:
• Writing effective and scalable Python codes
• Designing and implementing robust applications
• Debugging applications to ensure low-latency and high-availability
• Integrating user-facing elements with server-side logic
• Implementing security and data protection
• Accommodating various data storage solutions
Key Requirements:-
• Degree in Computer Science, Engineering or a related field
• You have prior experience as a Python Developer
• Good knowledge Django framework
• Good knowledge in Lambda and AWS.
• Familiarity with front-end technologies, such as JavaScript, HTML5, and CSS3
• Knowledge of ORM (Object Relational Mapper)
• Familiarity with various testing tools.
Work Location : Pune preferred, Remote option available
Work Timing US Shift 2:30 PM to 11:30 PM or 6:30pm to 3:30am IST
We are hiring a Magento Developer for Dehradun location with Ftechiz Solutions.
- Substantive experience developing on the Magento platform
- Expert in PHP programming along with Zend and CodeIgnitor framework
- Experience with MySQL database design and administration
- Experience with XML / SOAP / WDSL
- Experience with Subversion
- Knowledge of current HTML / CSS / XHTML standards
- Knowledge of JavaScript / AJAX technologies and methods
- Specific Magento experience...
- Configure multiple stores and authentication features
- Integrate creative designs into Magento from HTML templates
- Integrate with payment gateways (authorize.net, etc)
- Integrate with shipping providers (Fedex, UPS, etc)
- Installing and skinning Magento modules
- Creating custom Magento modules, a plus
- Customize product and inventory management features
- Take advantage of Magento web services
- Cross-browser testing and implementation
Job Summary
- Expand the product to suit the needs of all kinds of travellers. From family travellers to hardcore backpackers and from free independent travellers to those who need a more guided approach to planning their trip.
- Launch across more countries. This means adding support for more geographies, things to do, weather, currencies and payments, transport and accommodation.
- Scale it up to serve millions of users a year, from across the globe. We are seeing decent growth, but it is time to up the game.
Responsibilities and Duties
How you'll add value:
- Own the architecture and design decisions that go into shaping our backend microservices
- Build and ship robust features.
- Work with web and mobile engineers to design and build APIs to power the traveler and influencer applications.
- Help us scale out to multiple geographies and serve millions of travelers
Required Experience, Skills and Qualifications
- An innate desire to grow. Both personally and with respect to the value you add to other people's lives.
- 4+ years industry experience working with golang/Django
- Sound understanding of CS fundamentals. We don't expect you to remember every algorithm by heart. But if you know how to find the most appropriate one for any given problem, let's talk.
- Personal projects that show an aptitude for technical excellence and product sense.
- Interest in contributing to open source projects
- Bonus points if you have an interest in the philosophy behind technologies. - You are intrigued by why did people develop certain technologies the way they did.
Benefits
- Work with a bunch of amazing people on a challenging problem.
- 1 backpacking trip each year to travel outside India. We don't allow you to travel, we WANT you to travel.
- Stock.
- We don't mind work from home/cafe/some random city in the world as long as your work and your team is not disrupted.
- We don't have a leave policy (there is a guideline for legal reasons) but you are free to take as much personal time as you need as long as you get your job done.
Job Type: Full-time
Salary: ₹2,000,000.00 to ₹3,000,000.00 /year
Fulfil’s software engineers develop the next-generation technologies that change how millions of customer orders are fulfilled by merchants. Our products need to handle information at massive scale. We're looking for engineers who bring fresh ideas from all areas into our technology.
As a senior software engineer, you will work on our python based ORM and applications that scales to handle millions of transactions every hour. This is mission critical software and your primary focus will be building robust and scalable solutions that are easy to maintain.
In this role, you will be collaborating closely with the rest of the team working on different layers of infrastructure in an international environment. Therefore, a commitment to collaborative problem solving, sophisticated design, and quality product are important.
What You’ll Do:
- Own definition and implementation of API interfaces (REST and GraphQL). We take pride in our 100% open API with over 600 endpoints.
- Implement simple solutions to complex business logic that enables our merchants to manage financials, orders and shipments across millions of transactions.
- Build reusable components and packages for future use.
- Translate specs and user stories into reviewable, test covered patches.
- Peer review code and refactor existing code.
- Integrate with our eCommerce partners (Shopify, BigCommerce, Amazon), shipping partners (UPS, USPS, FedEx, DHL) and EDI.
- Manage Kubernetes and Docker based global deployment of our infrastructure.
Requirements We’re Looking for Someone With:
- Experience working with ORMs like SQLAlchemy or Django (2-3 years)
- Experience with SQL and databases (Postgres preferred)
- Experience in developing large server side applications and microservices
- Ability to create high quality code
- Experience with python testing tools (pytest) and test automation
- Familiarity with code versioning tools like GIT
- Strong sense of ownership and leadership quality
- Experienced in the tools of our web stack- Python, Celery, Postgres, Redis, RabbitMQ
Nice to Haves:
- Prior experience at a growth stage Internet/Software company
- Experience with ReactJS, Google Cloud, Heroku
- Cloud deployment and scaling experience
- Manage and improve the engineering process continuously and make sure the team delivers the quality code with zero-waste.
- Should provide technical leadership to major projects, but also build and manage a team of 5-8 top-notch engineers.
- Should do sprint planning and run daily stand-ups and deliver 100% hit rate.
- Maintain the legacy code base and reduce tech debt on a continuous basis.
- Able to handle multiple projects and deliver with stringent timelines without compromising the code quality.
- Work with the product team for roadmap planning and delivery as per the plan.
- Conduct sprint planning & sizing, engineering grooming, daily stand-ups, and deliver with zero spillovers.
- Prepare & publish sprint reports to the leadership team and provide visibility to stakeholders.
- Hire and mentor junior/ senior team and make them engineering champions.
- Mentor the engineering team with your technical skills to write scalable, generic, reusable code.
- Develop and Coach engineers on the team, share engineering pointers, conduct regular 1-1s with the team, and help them advance in their careers.
Requirements
- Having work experience in a Product organization with 7 -10 yrs also in leading a cross-functional engineering team that includes API Development and Backend & Middleware development.
- Should have experience in the continuous delivery process. Ship new features and improvising the code base continuously.
- Should have involved in setting up engineering process.
- Must have experience in microservices and distributed patterns.
- Must have worked on high traffic and throughput application.
- Must have prior experience in handling mid to large-size projects.
- Must have worked on high traffic and throughput application.
- Should have managed and lead the engineering team of Web App and Backend development teams.
- Must-Have Experience in Python programming & Postgressql/ Nosql (MongoDB as a data store.
- Must have experience in modern back-end tech stacks (Django, Postgress, NoSQL) and cloud design & deployment patterns.
- Must be conversant with AWS, Docker/Kubernetes
- Should be good with design patterns and integration patterns.
- Should have knowledge/ experience in concurrent programming & distributed locks.
- Requires solid understanding of technologies and architecture in a highly scalable and available set-up.
- Should have handled multiple epics, themes, and experience of delivering high-quality projects on time.
- Should have managed end to end development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations
An ideal candidate should have well-rounded experience (5-10 years) in various technologies - backend/web development (Python/Django), DevOps, Android and iOS - or at least 2 out of the above
The person would be managing an expanding team of developers and guide the product development, along with contributing significantly to the core decisions of the company.
An entrepreneurial spirit, and the passion to make a difference in the healthcare ecosystem of the country is recommended.
The candidate will be well compensated with a combination of cash + equity, depending on experience and expertise.
Location : Andheri east, Mumbai
Notice Period : Immediate to 15 days
Responsibilities :
- Create algorithms from scratch.
- Create products and backend API's as described by the business team.
- Back-test and create a hypothesis as desired by the research team.
- Code the backend of logics for consumption by the UI team.
- Deploy websockets, Django, rest API's & dynamic TCP, UDP based data flow.
- Deployment and maintenance of codes with version control.
- Spend most of your time developing brand new software in Python
- Build out a secure data replication infrastructure to replicate transactional data across a hierarchical system
- Build out APIs for supporting a fleet of 20k devices
- Build out a configurable data analytics and reporting framework
- Build out real time dashboards for getting a high level and deep dive view of the overall system
- Be responsible for independently designing and building out modules of the overall system
- Work with a team of smart peers and take ownership of the resulting system
- Push yourselves, create impact, learn and grow as an engineer
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon