Cutshort logo
Appic Labs logo
Senior Software Engineer Backend (Web Scraper / Crawler)
Senior Software Engineer Backend (Web Scraper / Crawler)
Appic Labs's logo

Senior Software Engineer Backend (Web Scraper / Crawler)

varun desai's profile picture
Posted by varun desai
2 - 10 yrs
₹3L - ₹7L / yr
Remote only
Skills
Crawler
Scraper
skill iconJava
skill iconGo Programming (Golang)
skill iconPython
skill iconPHP
skill iconAmazon Web Services (AWS)
skill iconMongoDB
Parallel computing
Multithreading
skill iconRedis
Cassandra

Stealth Fintech startup looking for Software Engineer with 2+ year of experience.
We are looking to hire few engineers for this position ASAP.

Well funded !
Permanent Remote Position !
Competitive Salary !

You will be a part of the founding engeering team. We are working cutting edge technology stack such as Cassandra, Terraform, Kubernetes, Redis, MongoDB, InfluxDB, Graphana, GoLang, AWS.
You will get the opportunity to work on a massive scale project, crawling 100+ Million pages per day, and very complex problems which will help you grow as an engineer.

Requirements:

  • Past work experience with crawler / scraper is a MUST
  • Self starter mentality who can pick up new skills & can work independently
  • Experience with programming languages like Java, C#, Go, Python, PHP
  • Understanding of concepts like HTTP, Sessions / Cookies, IP rotation
  • Expereince with AWS or Google Cloud
  • Familiar with multithreading architecture
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Appic Labs

Founded :
2020
Type :
Product
Size :
0-20
Stage :
Raised funding

About

Airbnb brought together some of the most talented and ambitious people from around the globe, who then built and scaled a very special company. Many of us were lucky enough to be early Airbnb employees, working through years of hyper-growth, across many disciplines. Now, in the spirit of being a host, we want to support ambitious new entrepreneurs as they embrace their new adventure. Companies we invest in get access to not just capital but also our wide breadth of experience and network. Our members are early Airbnb employees turned investors, entrepreneurs, and operators spread across the world. We have extensive backgrounds in engineering, product, growth, operations, brand, data science, marketplaces, international expansion, and policy. This expert network will supercharge the startups we back. We are global, ambitious, and ready to help.
Read more

Connect with the team

Profile picture
varun desai

Company social profiles

linkedin

Similar jobs

Talent Pro
Remote only
8 - 10 yrs
₹40L - ₹90L / yr
skill iconPython

8+ years backend engineering experience in production systems


Proven experience architecting large-scale distributed systems (high throughput, low latency, high availability)


Deep expertise in system design including scalability, fault tolerance, and performance optimization


Experience leading cross-team technical initiatives in complex systems


Strong understanding of security, privacy, compliance, and secure coding practices

Read more
Wissen Technology
at Wissen Technology
4 recruiters
Tony Tom
Posted by Tony Tom
Bengaluru (Bangalore)
3 - 9 yrs
Best in industry
skill iconC++
Multithreading
Linux/Unix

Looking for Immediate joiners Bangalore location(3-9years)


Key responsibilities:

  • Understand all requirements, Design, Develop and implement features, complying with engineering and regulatory standards and procedures for charging stations.
  • Create multiple concepts, evaluate, and implement the optimal one.
  • Develop and maintain product’s design integrity with good knowledge of software system architecture and design.
  • Apply problem-solving techniques and guide team towards arriving at solutions.
  • Work with cross functional team from Concept prototyping to Launch & thereafter.
  • Guide team towards creation and handling of all design and development related processes and documents like, defining requirements, high level design, low level design, DFMEA, DF’X’, Interface sign off, RCA, etc.

Key requirements

  • A Bachelor/ master’s degree in E&E/ECE engineering from premier institute
  • 5 years+ product development experience on Linux based systems, with full lifecycle experience for atleast 2 industry deployed products.
  • Software Design and Architecture experience on Linux platforms
  • Interfacing with SaaS via network or REST APIs 
  • Knowledge of CAN, RS485/Modbus protocols, Kafka, Distributed Messaging 
  • C++ with STL, Linux system programming, scripting, network/sockets programming, strong in UDP/TCP networking, libcurl + HTTP(s)
  • Knowledge of Bluetooth/BLE, Elastic Search + Logstash, Java performance tuning 
  • Knowledge of security-based Threat Modelling Design & Mitigation, TLS/SSL, Docker + Docker networking, Python + node.js + WebSocket’s, HTML5, JavaScript. 
  • Excellent communication, leadership, and problem-solving skills
  • Ability to work in a fast-paced and dynamic environment.


Read more
Acelucid Technologies Pvt Ltd
Ace Lucid
Posted by Ace Lucid
Dehradun
3 - 5 yrs
₹6L - ₹12L / yr
skill iconNodeJS (Node.js)
skill iconMongoDB
Mongoose
skill iconExpress
Expectation:

• Developing and maintaining all server-side network components.
• Ensuring optimal performance of the central database and responsiveness to front-end requests.
• Collaborating with front-end developers on the integration of elements.
• Designing customer-facing UI and back-end services for various business processes.
• Developing high-performance applications by writing testable, reusable, and efficient code.
• Implementing effective security protocols, data protection measures, and storage solutions.
• Running diagnostic tests, repairing defects, and providing technical support.
• Documenting Node.js processes, including database schemas, as well as preparing reports.
• Recommending and implementing improvements to processes and technologies.
• Keeping informed of advancements in the field of Node.js development.


Technical Skills:

• Bachelor's degree in computer science, information science, or similar.
• Minimum 3 years of experience as a Node.js developer.
• Extensive knowledge of JavaScript, web stacks, libraries, and frameworks.
• Knowledge of front-end technologies such as HTML5 and CSS3.
• Superb interpersonal, communication, and collaboration skills.
• Exceptional analytical and problem-solving aptitude.
• Great organizational and time management skills.
• Availability to resolve urgent web application issues outside of business hours
Read more
Ecommerce platform for Business consumables
Ecommerce platform for Business consumables
Agency job
via The Hub by Sridevi Viswanathan
Bangalore
4 - 7 yrs
₹15L - ₹22L / yr
skill iconPython
skill iconAmazon Web Services (AWS)
skill iconFlask
Architecture
skill iconReact.js
+1 more

Python Full stack developer.

1. Product based Full stack developer - Python back end - Core Python
2. Worked with Database - MongoDB/ MySql
3. Should have worked with ORMs
4. Knowledge of REST APIs
5. Should have developed Python applications.
6. Cloud Technology - Worked with AWS/ Azure. Not yet decided on what we
are going to go with.
7. Deplyment tools knowledge
8. Good knowledge of Front end dev - CSS/ JS/ React
9. Version Control - Git
10. Frameworks - Flask/ Django. (Ideally Flask)
11. Script writing

Should have worked on a full system design and architecture along with
coding up the same.
Read more
marsdevs.com
Vishvajit Pathak
Posted by Vishvajit Pathak
Remote, Pune
2 - 5 yrs
₹4L - ₹15L / yr
skill iconDjango
skill iconFlask
FastAPI
skill iconPython
skill iconDocker
+3 more

We are having an immediate requirement for a Python web developer.

 

You have:

  • At least 2 years of experience developing web applications with Django/Flask/FastAPI
  • Familiarity with Linux
  • Experience in both SQL and NoSQL databases.
  • Uses Docker and CI/CD
  • Writes tests
  • Experienced in application deployments and scaling them on AWS or GCP

 

You are:

  • Eager to work independently without being watched
  • Easy going.
  • Able to handle clients on your own

 

Location: Remote (in India)

 

Read more
BYJU’S - The Learning App
Agency job
via zyoin by RAKESH RANJAN
Bengaluru (Bangalore)
8 - 15 yrs
₹30L - ₹50L / yr
skill iconRuby on Rails (ROR)
skill iconGo Programming (Golang)
skill iconNodeJS (Node.js)
skill iconPython
Roles & Responsibilities
● Leads a project end-to-end and collaborates across functions. Drives planning,
estimation and execution.
● Understands requirements well and comes up with efficient design
● Develops complex, well backed and bug-free products. Estimates accurately.
● Takes well-reasoned tech decisions keeping in mind goals and trade-offs
● Becomes a go-to person in more than one area. Provide technical mentoring to team
● Communicates clearly, gets clarifications and establishes expectations for all parties
● Helps establish SDLC best practices and high standards of code quality
● Demonstrates excellent problem solving & debugging skills
● Proactively identifies and resolves issues in requirements, design and code
● Contributes in tech recruitment efforts
Ideal Candidate Profile
● Solid experience in RoR, Golang, NodeJS or Python. Good to have exposure to ML.
● Should have experience in cloud computing
● Has an ability to quickly learn and contribute in multiple codebase
● Overcomes roadblocks and requires minimal oversight
● Takes initiatives to fix issues/tech debts before assigned to him/her
● Able to deep dive into codebase and advise QA of possible regression impact
● Communicates tech decisions through design docs and tech talks
● Has delivered projects with end-to-end accountability
● Keeps track of industry trends and introduces right tech/tools for a given job
● Excellent understanding of software engineering practices, Design Patterns, Data
Structures, Algorithms
● 8+ years of experience in product driven organization
● A Bachelors or Masters degree in engineering from a reputed institute (preferably
IITs, NITs, or other top engineering institutes)
Read more
Torum Technology Sdn Bhd
at Torum Technology Sdn Bhd
2 recruiters
Teddy Tan
Posted by Teddy Tan
Remote only
3 - 5 yrs
₹10L - ₹20L / yr
skill iconNodeJS (Node.js)
skill iconMongoDB
Mongoose
skill iconExpress
skill iconElastic Search
+2 more

Are you passionate in coding and blockchain? Do you wish to face challenges ahead, develop and deliver features that will be extraordinary towards users? We are looking for experienced talents (React JS / Node JS / MongoDB / Web3.js / Solidity developers) to join our team and start a revolution!

 

Key Responsibilities and Scope

  • Framework development and integration
  • Prototype and Proof of concept development
  • Creation, configuration, and monitoring Shards sets. Architecture and capacity planning for MongoDB clusters. 
  • Assisting senior developers in detecting performance issues in the system by deploying MMS and MongoDB profilers
  • Implementation of MongoDB advanced concepts like locking, transactions, indexes, Sharding, replication, schema design. 
  • Maintain MongoDB replication with replica set factors, arbiters, voting, priority, server distribution, slave delays. 

 

Technical Skills

 

- Database & Languages:  MongoDB, B-tree, MongoDB Profiler, Javascript, MongoDB Compass, Mongo Booster

 

- Others: Elastic Stack, MMS, MongoDB Management service

 

Qualifications and Experience location GMT+8 or GMT+5:30

  • Ability to work remotely or on-site (if Malaysia)
  • Executing elastic stack in production scale Passion for best design, developing, and coding practices
  • Creating servers and databases for functionality
  • Maximizing application performance, uptime, and scalability, maintaining high standards of code quality and thoughtful application design
  • Excellent debugging and optimization skills
  • Unit/integration testing experience
  • Experience in analyzing and visualizing the data along with data modeling
  • Experience in upgrading different databases and also migration of data among multiple databases. 
  • Experience in MongoDB installation, patching, troubleshooting, performance, tracking/tuning, backup, and recovery in dynamic environments. 
  • Experience in managing the life cycle of MongoDB including sizing, automation, monitoring, and tuning
  • Experience in working with MongoDB ops Manager, Cloud Manager, and Atlas Manager
  • Experience in analyzing chunk migrations, splitting, and balancing across the clusters.
Read more
DashClicks India Pvt Ltd
at DashClicks India Pvt Ltd
3 recruiters
Priya Agarwal
Posted by Priya Agarwal
Remote only
4 - 10 yrs
₹8L - ₹17L / yr
skill iconNodeJS (Node.js)
skill iconMongoDB
Mongoose
skill iconExpress

Responsibilities:

  • Develop, implement, and maintain production timelines across multiple teams
  • Translate product’s strategy into detailed requirements for prototype construction and final product development
  • Analyze consumer needs, current market trends, and potential partnerships from an ROI
  • Outline the product vision, product strategy, and product roadmap
  • Assess current competitor offerings, seeking opportunities for differentiation
  • Appraise new product ideas and strategize appropriate to-market plans
  • Ensure that user story content and prioritization is aligned to the larger strategic objective
  • Recommend the scope of present and future product lines by reviewing product specifications and appraising adjustments
  • Provide information for management by preparing product sales forecasts and reports
  • Meet regularly with key customer-facing teams to collect and analyze user feedback to shape new product ideas and user requirements.
  • Help in the creation and maintenance of bona fide product documentation
  • Work with development leads so that product requirements are understood and built accordingly
  • Work within a software development methodology like AGILE
  • Coordinate product releases with marketing, sales, and development teams
  • Provide product training and technical expertise
  • Work with the leadership team in planning the product roadmap.
  • Be the product owner driving our strategic product and technology vision on the platform side of products 

Requirement:

  • 3+ years of experience as a Technical Products Manager in a software company.
  • Has deep knowledge of every stage of the product life-cycle -- introduction, growth, maturity, and decline -- and understands how it affects development adjustments.
  • Critical thinker & problem solver
  • Familiarity in the AGILE development framework will be preferable.
  • Strong understanding of cutting-edge tools and technologies for frontend and backend development
  • Data-oriented, have exceptional analytical skills
  • Experience working with the development teams directly will be a plus
  • Has the ability to set priorities and resolve issues and set realistic product development goals
  • Should be able to communicate technical solutions to both internal and external audiences
  • Understand industry flow and trends
  • Has the ability to evaluate key metrics to optimize performance
  • Demonstrated track record managing successful product development from feature definition to project deployment
  • Work with product management analytics tools
  • A people-friendly person with extraordinary organizational and leadership skills
Read more
It is a high-end product firm
Chennai
10 - 14 yrs
₹15L - ₹23L / yr
skill iconJava
skill iconSpring Boot
Microservices
skill iconAmazon Web Services (AWS)
skill iconAngular (2+)

Looking for a Java Technical Architect/ Java architect with experience between 10 to 14 years.

Candidate must have experience  in Java technologies along with SpringBoot and Microservices.
Must have experience in Cloud Technology - AWS.
Must have experience in Angular 4 or above version.

Note: 1. Candidate must be ready to work in night shift.
          2. Looking only for Tamilnadu based candidates.

Read more
Dunya Labs
at Dunya Labs
2 recruiters
Muralidhar BS
Posted by Muralidhar BS
Bengaluru (Bangalore)
3 - 7 yrs
₹6L - ₹14L / yr
skill iconC++
skill iconC
skill iconPython
Research Developer Dunya Labs is a deep tech product company currently focused on building infrastructure, developer tooling and middleware for deploying scalable blockchain applications. We combine a theoretical research team with a product team to lead cutting-edge developments in the blockchain space. Seeking a diligent, passionate and detailed-oriented Research Developer to drive theoretical research into various blockchain protocols and help ideate potential products. At Dunya Labs, you will be contributing to impactful solutions that can enable the decentralized world. We strongly prefer candidates who have strong academic research backgrounds and deep interest in blockchain technology - candidates who are agile and able to work in undefined areas. Key Responsibilities: The Research Team at Dunya Labs is focused on pioneering foundational research in blockchain technologies and use-cases. We explore the following: ● Foundational Research. Staying aware and updated on major cryptographic and theoretical computer science developments, including but not limited to: zero-knowledge, multiparty computation, new cryptographic primitives, transformers, and more. ● Protocol Research. Deep-dives into up-and-coming blockchain protocols through whitepaper analysis and discussions with the protocol teams themselves. ● Scaling. Sharding, Layer-2 Scaling (e.g. Lightning, Raiden), non-blockchain distributed networks, applications of discoveries and constructions in recent cryptography papers ● Privacy. Transactional privacy and data feed privacy on public blockchains (e.g. zk-snarks) ● Governance. Implications and results of on-chain and off-chain governance ● Smart Contract Standards/Security. Automation, formal verification, and termination of smart contracts Qualifications: ● Bachelor’s in Computer Science, Mathematics or a technical field. Masters/PhD preferred. ● Research or development experience in network security, algorithms, or theoretical computer science and mathematics ● Knowledge of distributed systems, game theory and/or cryptography is strongly preferred ● Record of academic publishing in related conferences and/or journals a plus Skills and Competencies: ● Ability to work creatively and independently on long-term technical problems ● You learn quickly and apply new skills effectively ● Ability to collaborate with other researchers and developers ● Brilliant analytical and problem solving skills, especially algorithmic knowledge Preferred Qualifications ● You work well with data and can use machine-learning tools to analyze datasets. ● Ability to code at a high level in C, C++, Python, Golang, Rust or any other common programming language ● Strong performance in competitive programming (TopCoder, HackerRank, CodeChef, Olympiads - IOI, INOI) WHAT WE OFFER: ● A collaborative environment for working with like-minded researchers and developers who carry out implementation of theoretical research results ● Opportunities to work with top research institutes such as ISI Cryptography, IISc and institutions abroad ● Highly competitive salary, healthcare benefits and other perks ● Flat organization with freedom to pursue desired research ABOUT DUNYA LABS: Today, we live in a world where the power of digital data is asymmetrically collected and held by a small handful of companies and political entities. These companies and entities also act as increasingly powerful intermediaries that enable, authenticate and settle digital transactions– of property, currency, identity/reputation, and many other forms of digital data. Blockchain, or cryptographically-secured replicated databases, has the potential to decentralize the transfer of value over the Internet, creating secure, decentralized peer-to-peer economies of trust. By doing so, blockchain disintermediates traditional industries, taking out rent-seeking middlemen who levy taxes on end-users as verifiers, trust-providers or settlors of transactions. Imagine a currency without a central bank (Bitcoin), a portable digital identity without a centralized authenticator (uPort), or a peer-to-peer global file storage system without reliance on centralized cloud-based server providers (Filecoin). Thus far, the “blockchain revolution” has been powered by speculative investment and misunderstanding. But we at Dunya Labs believe that innovations in cryptographically secured, replicated networks are maturing, and the exploration of blockchain as a foundational technology is moving into a mature phase driven by research and execution. Many esteemed academics and cryptographers have joined the field, including Silvio Micali (Algorand), Benn Lynn of BLS Signature Scheme (DFINITY), Andrew Yao (Conflux), Xinmin Luo (DFINITY), Dan Boneh, and more. We are building a knowledge company that focuses on just research and execution. Our mission is to bring blockchain use-cases to market.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos