Cutshort logo
Tracxn logo
Senior Engineer (Web Crawling & Automation)
Senior Engineer (Web Crawling & Automation)
Tracxn's logo

Senior Engineer (Web Crawling & Automation)

Tracxn Technologies's profile picture
Posted by Tracxn Technologies
1 - 12 yrs
₹5L - ₹30L / yr
Bengaluru (Bangalore)
Skills
skill iconHTML/CSS
skill iconJavascript
skill iconMongoDB
skill iconNextJs (Next.js)
web crawling
puppeteer
playwright
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)

Total Experience: 1+ years

Mode of Hire: Permanent


Required Skills Set (Mandatory): JavaScript/Node.js/Python, Web Crawling (Puppeteer/Playwright), Strong knowledge of web technologies


Desired Skills (Good if you have): HTML, Distributed Systems, Data pipelines, Proxy Management, Anti-bot Techniques


Job Responsibilities

  • Design scalable web crawling solutions using modern technologies like Puppeteer and Playwright.
  • Develop optimal and cost-effective methods for efficiently crawling diverse websites at scale.
  • Implement robust proxy management and sophisticated anti-bot techniques.
  • Create comprehensive debugging and monitoring systems for crawler performance.
  • Actively contribute to technical discussions and architectural decision-making processes.


Job Requirements

  • Experience in end-to-end management of large-scale distributed web crawling.
  • Deep understanding of website internal mechanics, enabling innovative data extraction strategies.
  • Expert-level proficiency in JavaScript/Node.js, web technologies, and anti-bot measures.
  • Demonstrated ability to understand, adapt, and extend current system architectures. 
  • Strong collaborative skills with the ability to work effectively within existing technical frameworks.


Preferred Qualifications

  • Advanced system optimization skills.
  • Proven experience with cloud platforms, databases, and distributed systems.
  • Comprehensive knowledge of data pipelines and data warehousing concepts.


Culture

  • Work with performance-oriented teams driven by ownership and passion.
  • Learn to design systems for high accuracy, efficiency, and scalability.
  • No strict deadlines, focus on delivering quality work.
  • Meritocracy-driven, candid culture. No politics.
  • Very high visibility regarding which startups and markets are exciting globally.


About Tracxn

Tracxn (Tracxn.com) is a Bangalore-based product company providing a research and deal sourcing platform for Venture Capital, Private Equity, Corp Dev, and professionals working around the startup ecosystem.

We are a team of 600+ working professionals serving customers across the globe. Our clients include Funds like Andreessen Horowitz, Matrix Partners, GGV Capital, and Large Corporations such as Citi, Embraer & Ferrero.


Founders

  • Neha Singh (ex-Sequoia, BCG | MBA - Stanford GSB)
  • Abhishek Goyal (ex-Accel Partners, Amazon | BTech - IIT Kanpur)


About Technology Team

Tracxn's Technology team is 50+ members strong and growing. The technology team is subdivided into multiple smaller teams, each owning one or more services/components of the technology platform. Ours is a young team of motivated engineers with a minimal management structure where almost everyone is actively involved in technical development and design activities. We have a team-centric culture where the ownership and responsibility of a feature or module lie with a team compared to an individual.

We work on an array of technologies, including but not limited to ReactJS, Next.js, Storybook, Webpack, Node, Mongo, AWS Lambda, Spring, Elastic Stack, MySQL, Kafka, Redis, Ansible, etc.

We value ownership, continuous learning, consistency, and discipline as a team.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Tracxn

Founded :
2013
Type :
Product
Size :
20-100
Stage :
Raised funding

About

We at Tracxn are building one of the world’s largest platform for tracking Startups, Private Companies and Emerging Innovative Sectors. Tracxn is powered by artificial intelligence and big data technology that scans through the company datapoints and incorporates the relevant information in its platform offering. A 100+ strong Sector-focussed Analyst team further enhances the relevance of the platform data. We work with over 5000 subscribers in over 30 countries across North America, Europe, Asia Pacific, Latin America & Middle East. Our clientele includes Venture Capitalists, Private Equity Funds, M&A and Innovation teams of Fortune 500 companies and Investment Banks who use Tracxn data for daily deal sourcing, identifying M&A targets, deal diligence and tracking emerging themes across Industries & Markets. Tracxn platform is also being used by the various Governments, Accelerators, Incubators and Universities for tracking innovative companies and sectors. Tracxn was founded in 2013 by, Neha Singh and Abhishek Goyal, ex-Venture Capitalists from Accel Partners & Sequoia Capital. With its unique offering, Tracxn has featured in Forbes Top 100 Global Analytics Startup List (2015), and Fortune 40 under 40 (2016, 2017). Tracxn was also ranked as the Coolest Startup of the year by Busine0ss Today (2017), Our investors include SAIF Partners, Accel Partners, Sequoia Capital along with marquee angel investors including Ratan Tata, Nandan Nilekani, Sachin Bansal, Binny Bansal amongst others. Whether you are researching companies in emerging sectors like Blockchain, IoT or AI or you want to do a targeted discovery in niche segments like Plant based Meat Products or AI based Payment Fraud Detection, we have got you covered.
Read more

Connect with the team

Profile picture
Sachin Kamkar

Company social profiles

linkedintwitterfacebook

Similar jobs

This is Full time role with Our Client.
This is Full time role with Our Client.
Agency job
via eTalent Services by JaiPrakash Bharti
Pune, Chennai
8 - 10 yrs
₹20L - ₹25L / yr
skill iconSpring Boot
skill iconNodeJS (Node.js)
Microservices
SQL
skill iconJava
+3 more

Role: Lead Java Developer

Work Location: Chennai, Pune

No of years’ experience: 8+ years

Hybrid (3 days office and 2 days home)

Type: Fulltime

 

Skill Set: Java + Spring Boot + Sql + Microservices + DevOps

 

Job Responsibilities:

Design, develop, and maintain high-quality software applications using Java and Spring Boot.

Develop and maintain RESTful APIs to support various business requirements.

Write and execute unit tests using TestNG to ensure code quality and reliability.

Work with NoSQL databases to design and implement data storage solutions.

Collaborate with cross-functional teams in an Agile environment to deliver high-quality software solutions.

Utilize Git for version control and collaborate with team members on code reviews and merge requests.

Troubleshoot and resolve software defects and issues in a timely manner.

Continuously improve software development processes and practices.

 

Description:

8 years of professional experience in backend development using Java and leading a team.

Strong expertise in Spring Boot, Apache Camel, Hibernate, JPA, and REST API design

Hands-on experience with PostgreSQL, MySQL, or other SQL-based databases

Working knowledge of AWS cloud services (EC2, S3, RDS, etc.)

Experience in DevOps activities.

Proficiency in using Docker for containerization and deployment.

Strong understanding of object-oriented programming, multithreading, and performance tuning

Self-driven and capable of working independently with minimal supervision

Read more
With A Reputed company
With A Reputed company
Agency job
via Jobdost by Saida Jabbar
Chennai
3 - 15 yrs
₹4L - ₹10L / yr
skill iconJava
Hibernate (Java)
Swing (Java)
skill iconXML
Mobile App Development
+1 more

Qualification:

  • 3+ Years’ software development experience in Core Java, Hibernate and swing
  • User Interface technologies: XML, HTML, HTML5/Application Cache /WebSQL, Backbone, Enyo, SmartClient
  • Should have worked of opensource ERP OpenBravo – not mandatory, preferred.
  • Proficient in SQL Queries using PostgreSQL / MySQL
  • Good analytical and communication skills.
  • Should be able to manage development team
  • Should be able to independently gather and analyze requirements with end users
  • Should have developed APIs Preferably developed Mobile application / app
  • Knowledge of development of Jasper Reports
  • Preferably knowledgeable of business functions like sales/ purchase/ inventory
  • Participate in technical design, development, testing, and documentation of plug-ins, modules or vertical requested by partners.

 

Job Functions:

  • Provide technical support for open bravo application.
  • Develop, test and deploy features that are given by the functional team.
Prepare technical documentation for the developed components.
Read more
Midas Minds
Coimbatore
4.5 - 7 yrs
₹10L - ₹14L / yr
skill iconAngular (2+)
skill iconSpring Boot
Microservices
skill iconJava

Key Responsibilities:


Full-Stack Development:

  • Engage in end-to-end development activities, from requirements gathering to deployment, ensuring high-quality deliverables.
  • Perform hands-on development using a mix of technologies including Angular 13+, Java / Springboot, Fast API, and SQL.
  • Collaborate with cross-functional teams to integrate front-end interfaces with back-end services and databases.

Team Leadership & Collaboration:

  • o Work closely with the Tech Lead / Solution Architect and Product Manager to help design and implement scalable and robust solutions leveraging Angular 13+, Java / Springboot, Microservices, Fast API, Java Reactive Programming, and SQL.
  • Assist in driving the architectural vision, ensuring alignment with business goals and provide technical guidance, participate in code reviews, and ensure adherence to best practices and coding standards.
  • Evaluate and recommend technologies and tools to optimize system performance, security, and reliability.

Databases & Data Management:

  • Demonstrate expertise in working with databases such as MongoDB, PostgreSQL, Azure Blob Storage, Neo4j (GraphDB is a plus), and Azure CosmosDB.
  • Design efficient database schemas, optimize query performance, and ensure data integrity and security.

Cloud Platform & Infrastructure:

  • Proficiency in Microsoft Azure, including the deployment, management, and optimization of cloud-based solutions.
  • Experience with containerization, orchestration, and Kubernetes Lens for managing containerized applications.

Tools & Collaboration:

  • Utilize tools such as GitHub for version control, JIRA for project management, Confluence for documentation, Keycloak for identity and access management, and other relevant tools to streamline development and collaboration processes.

Qualifications:

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
  • 5+ years of hands-on experience in full-stack development.
  • Strong expertise in Angular 13+, Java / Springboot, Microservices, Fast API, Java Reactive Programming, SQL.
  • Proven experience with databases including MongoDB, PostgreSQL, Azure Blob Storage, and Azure CosmosDB.
  • Strong communication and collaboration skills.
  • Experience with Agile development methodologies.
  • Understanding of the Microsoft Azure cloud platform and associated services.
  • Relevant certifications (e.g., Azure / AWS Certifications etc.;) are a plus.
Read more
ZeMoSo Technologies
Remote only
4 - 13 yrs
Best in industry
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJavascript
+5 more

What You will do

● Create beautiful software experiences for our customers using design thinking, lean and agile methodology.

● Design and develop software products from scratch using the latest cutting edge technologies, platforms and languages such as JAVA, python, Javascript, GoLang and Scala.

● Work in a dynamic, collaborative, transparent, non-hierarchical culture.

● Help to grow the next generation of developers and have a positive impact on the industry.

Basic Qualifications

● Experience: 8+ years.

● Engineering Degree in Computer Science OR Equivalent.

● Hands-on development experience with a broad mix of languages such as JAVA, Python, Javascript etc.

● Server-side development experience mainly in JAVA, (Python and nodeJS can be considerable)

● UI development experience in ReactJS or AngularJS or PolymerJS or EmberJS or Jquery etc.

● Passion for software engineering and follow the best coding concepts.

● Good to great problem solving and communication skills.

● Must have experience in technical architecture and design , code reviews and mentoring junior developers.

● Should have experience in stakeholder management and work along with architects as and when necessary to lead the project.

Nice to have Qualifications

● Product engineering and customer-centric mindset.

● Great OOP skills, including design patterns.

● Experience with devops, continuous integration & deployment.

● Exposure to big data technologies, Machine Learning and NLP will be a plus.

Benefits

● Competitive salary.

● Work from anywhere.

● Reimbursements for remote work set up.

● Insurance (including a top up insurance for COVID).

● Free Access to Online learning libraries such as O'reilly or equivalent

Location

Remote - work from anywhere.

Read more
Fintech product company with low code and no code technology
Fintech product company with low code and no code technology
Agency job
via The Hub by Sridevi Viswanathan
Gurugram, Mumbai, Bengaluru (Bangalore)
2 - 8 yrs
₹2L - ₹15L / yr
skill iconJava
skill iconJavascript
skill iconReact.js
skill iconAngular (2+)
skill iconAngularJS (1.x)
+10 more

What you need to succeed in this job ?


  • MS or BS/B.Tech in computer science or equivalent experience from top college.
  • Minimum 2+ Experience in Java 8, Spring Boot, Spring Cloud, Spring Cloud Gateway etc
  • Good understanding of Design Patterns usage and implementations.
  • REST Services and understanding and implementation of Microservices Architecture.
  • Unit testing tools – Junit & Mockito.
  • Experience is PostgreSQL database is must, 
  • Excellent data structure & algorithm and problem solving skills.
  • Should be an active contributor to developer communities like Stackoverflow is added advantage.
  • Experience and knowledge of open source tools & frameworks, broader cutting edge technologies around server side development (Prometheus, Elasticsearch, Kafka).
  • Must be a proven performer and team player that enjoy challenging assignments in a high- energy, fast growing and start-up workplace.
  • Must be a self-starter who can work well with minimal guidance and in fluid environment.
Read more
AppsTek Corp
AppsTek Corp
Agency job
via Venaatics Consulting by Mastanvali Shaik
Remote only
3 - 10 yrs
Best in industry
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJavascript
+4 more
  • Designing and developing user interfaces using angular.Js best practices.
  • Adapting interface for modern internet applications using the latest front-end technologies.
  • Writing JavaScript, CSS, and HTML.
  • Developing product analysis tasks.
  • Making complex technical and design decisions for AngularJS projects.
  • Developing application codes and unit tests in AngularJS, Java Technologies, and Rest Web Services.
  • Conducting performance tests.
  • Consulting with the design team.
  • Ensuring high performance of applications and providing support.

 

>> Qualification

 

  • Bachelor’s degree in computer science, computer engineering or similar.
  • Previous work experience as an angular JS developer.
  • Proficient in CSS, HTML, and writing cross-browser compatible code.
  • Experience using JavaScript building tools like Gulp or Grunt.
  • Knowledge of JavaScript MV-VM/MVC frameworks including Angular JS.
  • Excellent project management skills.
  • Proven experience implementing front-end and back-end JavaScript applications.
  • Excellent communication skills.
  • Critical thinker and good problem-solver.

 

Read more
Startup-E-Learning
Startup-E-Learning
Agency job
via Merito by Gaurav Bhosle
Remote
7 - 14 yrs
₹25L - ₹40L / yr
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJavascript
+5 more
Hello


SENIOR FULL STACK DEVELOPER (8-12 yrs)
Job Description:
Position: Full Stack Developer who also had good communication skills and problem-solving
ability. Senior level candidate is also expected to have team handling capabilities
Responsibilities:
• Development of JAVA & Angular based applications
• Writing of fully optimized code for optimum performance and efficiency of the
website.
• Adhere to the process and coding standards and guidelines.
• Resolving queries & help the development team.
• Promote continuous improvement.
Key Skills:
• Core JAVA Knowledge should be very strong - Mandatory.
• Java Spring Framework (Spring MVC, Springboot) programming skill should be very
strong - Mandatory
• Strong knowledge in Angular 2+ framework - Mandatory
• Proficiency in Javascript, CSS, HTML
• Experience in developing Restful API
• Solid understanding of object-oriented programming (OOP).
• Solid understanding of MVC design patterns
• Strong in writing optimized SQL queries, Database including PostgreSQL.
• Comfortable with Windows / Linux environments
• Good communication skills.
• Good understanding of Project Management Agile methodology
• Good understanding of CI/ CD (Bitbucket, Jenkins, Jira) - API Design - Restful
architecture
• Familiarity with AWS(Amazon Cloud platform), Docker, Jenkins, Elasticsearch, etc is a
plus.
• Good knowledge in AMP is a plus
• Proficiency in Node JS and MongoDB is a plus
• Knowedge of Swagger API documentation
• Knowledge of Best practices in Java/Angular coding
• Knowledge of Sonarqube, Vercel code quality tools
• Knowledge in leading a qualified, talented, developer team
Read more
Alchemy Solutions
Agency job
via HyreSpree by HyreSpree Team
Bangarmau
4 - 4 yrs
₹2L - ₹9L / yr
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJavascript
+4 more
Project Role Description :
Design, build and configure applications to meet business process and application requirements.

Must have Skills :
Java Full Stack Development, Spring Boot, React.js, Microservices and Light Weight Architecture

Good to Have Skills :
Core Java, Rest API

Job Requirements :
Key Responsibilities :
A:Minimum 4  years of technical experience and development expertise in Java, Java web stack ,J2EE, Spring frame work ,Java script B:Strong exposure on Core Java, Spring, Spring boot, REST APIs, Microservices C:Experience on messaging related technologies such as JMS, MQ and/or Kafka D:Possess advanced exposure to OOP based UI Frameworks AngularJS/ReactJS/NodeJS and Bootstrap

Technical Experience :
A:Having strong experience in Core Java, React js B:Understanding of relational Oracle, SQL Server and NoSQL DBs Mongo or Cassandra C:Exposure on Cloud integration and Container services D:Clear concepts on HTML5, CSS3, JavaScript, JQuery D:Prior financial/banking experience is highly desirable

Professional Attributes :
A:Have very strong communication interpersonal skills able to interact with all levels in the organization B:Strong team player who takes initiative, well organized, structured C:Ability to work in a fast-paced environment adhere to strict deadlines D:Flexible, adaptable
Read more
EZOPS
at EZOPS
1 recruiter
Agency job
via CETPA InfoTech by Rishbha Kalra
Noida, Delhi, Gurugram, Ghaziabad, Faridabad
4 - 8 yrs
₹5L - ₹15L / yr
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJavascript
+11 more
Must have:

  •  4-8 years of relevant experience in designing & developing and architecting systems/software
  • for large business environments (Java, J2EE).
  • • Strong design and coding skills in Enterprise Java, Hibernate, Spring, Spring Boot, REST web
  • services, JMS (ActiveMQ), XML, JSON.
  • • Must have good experience in Unix/Oracle/SQL.
  • • Experience in any communication framework (MQ) is an added advantage.
  • • Experience in Agile Development, Scrum, and Iterative approaches
  • • Participate in requirement gathering JAD sessions and support documentation
Read more
Hyderabad
2 - 5 yrs
₹4L - ₹10L / yr
skill iconJavascript
Angular
skill iconAngularJS (1.x)
skill iconSpring Boot
Hibernate (Java)
+3 more

Full Stack Developer

Skills:


  • Proficiency with JavaScript and HTML5

  • Minimum 2+ years of hands-on experience with AngularJS and Angular Frameworks

  • Experience with Java, JSON, Spring Boot and Hibernate 

  • Experience with MYSQL databases

  • Familiarity with Linux environments

  • Experience with GIT 

  • Hands on experience with AWS S3 is preferred

  • Experience with web servers & application servers such as Apache and Nginx is good to have


Responsibilities: 


  • Design and develop client-side and server-side architecture

  • Develop and manage well-functioning database

  • Implementation of approved user interface

  • Design and construction of REST APIs

  • Server management and deployment for the relevant environment

Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos