Cutshort logo
Tracxn logo
Senior Engineer (Web Crawling & Automation)
Senior Engineer (Web Crawling & Automation)
Tracxn's logo

Senior Engineer (Web Crawling & Automation)

Tracxn Technologies's profile picture
Posted by Tracxn Technologies
1 - 12 yrs
₹5L - ₹30L / yr
Bengaluru (Bangalore)
Skills
skill iconHTML/CSS
skill iconJavascript
skill iconMongoDB
skill iconNextJs (Next.js)
web crawling
puppeteer
playwright
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)

Total Experience: 1+ years

Mode of Hire: Permanent


Required Skills Set (Mandatory): JavaScript/Node.js/Python, Web Crawling (Puppeteer/Playwright), Strong knowledge of web technologies


Desired Skills (Good if you have): HTML, Distributed Systems, Data pipelines, Proxy Management, Anti-bot Techniques


Job Responsibilities

  • Design scalable web crawling solutions using modern technologies like Puppeteer and Playwright.
  • Develop optimal and cost-effective methods for efficiently crawling diverse websites at scale.
  • Implement robust proxy management and sophisticated anti-bot techniques.
  • Create comprehensive debugging and monitoring systems for crawler performance.
  • Actively contribute to technical discussions and architectural decision-making processes.


Job Requirements

  • Experience in end-to-end management of large-scale distributed web crawling.
  • Deep understanding of website internal mechanics, enabling innovative data extraction strategies.
  • Expert-level proficiency in JavaScript/Node.js, web technologies, and anti-bot measures.
  • Demonstrated ability to understand, adapt, and extend current system architectures. 
  • Strong collaborative skills with the ability to work effectively within existing technical frameworks.


Preferred Qualifications

  • Advanced system optimization skills.
  • Proven experience with cloud platforms, databases, and distributed systems.
  • Comprehensive knowledge of data pipelines and data warehousing concepts.


Culture

  • Work with performance-oriented teams driven by ownership and passion.
  • Learn to design systems for high accuracy, efficiency, and scalability.
  • No strict deadlines, focus on delivering quality work.
  • Meritocracy-driven, candid culture. No politics.
  • Very high visibility regarding which startups and markets are exciting globally.


About Tracxn

Tracxn (Tracxn.com) is a Bangalore-based product company providing a research and deal sourcing platform for Venture Capital, Private Equity, Corp Dev, and professionals working around the startup ecosystem.

We are a team of 600+ working professionals serving customers across the globe. Our clients include Funds like Andreessen Horowitz, Matrix Partners, GGV Capital, and Large Corporations such as Citi, Embraer & Ferrero.


Founders

  • Neha Singh (ex-Sequoia, BCG | MBA - Stanford GSB)
  • Abhishek Goyal (ex-Accel Partners, Amazon | BTech - IIT Kanpur)


About Technology Team

Tracxn's Technology team is 50+ members strong and growing. The technology team is subdivided into multiple smaller teams, each owning one or more services/components of the technology platform. Ours is a young team of motivated engineers with a minimal management structure where almost everyone is actively involved in technical development and design activities. We have a team-centric culture where the ownership and responsibility of a feature or module lie with a team compared to an individual.

We work on an array of technologies, including but not limited to ReactJS, Next.js, Storybook, Webpack, Node, Mongo, AWS Lambda, Spring, Elastic Stack, MySQL, Kafka, Redis, Ansible, etc.

We value ownership, continuous learning, consistency, and discipline as a team.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Tracxn

Founded :
2013
Type :
Product
Size :
20-100
Stage :
Raised funding

About

We at Tracxn are building one of the world’s largest platform for tracking Startups, Private Companies and Emerging Innovative Sectors. Tracxn is powered by artificial intelligence and big data technology that scans through the company datapoints and incorporates the relevant information in its platform offering. A 100+ strong Sector-focussed Analyst team further enhances the relevance of the platform data. We work with over 5000 subscribers in over 30 countries across North America, Europe, Asia Pacific, Latin America & Middle East. Our clientele includes Venture Capitalists, Private Equity Funds, M&A and Innovation teams of Fortune 500 companies and Investment Banks who use Tracxn data for daily deal sourcing, identifying M&A targets, deal diligence and tracking emerging themes across Industries & Markets. Tracxn platform is also being used by the various Governments, Accelerators, Incubators and Universities for tracking innovative companies and sectors. Tracxn was founded in 2013 by, Neha Singh and Abhishek Goyal, ex-Venture Capitalists from Accel Partners & Sequoia Capital. With its unique offering, Tracxn has featured in Forbes Top 100 Global Analytics Startup List (2015), and Fortune 40 under 40 (2016, 2017). Tracxn was also ranked as the Coolest Startup of the year by Busine0ss Today (2017), Our investors include SAIF Partners, Accel Partners, Sequoia Capital along with marquee angel investors including Ratan Tata, Nandan Nilekani, Sachin Bansal, Binny Bansal amongst others. Whether you are researching companies in emerging sectors like Blockchain, IoT or AI or you want to do a targeted discovery in niche segments like Plant based Meat Products or AI based Payment Fraud Detection, we have got you covered.
Read more

Connect with the team

Profile picture
Sachin Kamkar

Company social profiles

linkedintwitterfacebook

Similar jobs

Nirmitee.io
at Nirmitee.io
4 recruiters
Gitashri K
Posted by Gitashri K
Pune, Mumbai
5 - 11 yrs
₹5L - ₹20L / yr
skill iconJava
skill iconSpring Boot
Microservices
skill iconPython
skill iconAngular (2+)

Should have strong hands on experience of 8-10 yrs in Java Development.

Should have strong knowledge of Java 11+, Spring, Spring Boot, Hibernate, Rest Web Services.

Strong Knowledge of J2EE Design Patterns and Microservices design patterns.

Should have strong hand on knowledge of SQL / PostGres DB. Good to have exposure to Nosql DB.

Should have strong knowldge of AWS services (Lambda, EC2, RDS, API Gateway, S3, Could front, Airflow.

Good to have Python ,PySpark as a secondary Skill

Should have ggod knowledge of CI CD pipleline.

Should be strong in wiriting unit test cases, debug Sonar issues.

Should be able to lead/guide team of junior developers

Should be able to collab with BA and solution architects to create HLD and LLD documents

Read more
SmartDocs
at SmartDocs
4 recruiters
Anand Vigneshwaran
Posted by Anand Vigneshwaran
Jaipur
3 - 6 yrs
₹6L - ₹15L / yr
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJavascript
+6 more

Job Description:

 

Are you a fun loving and passionate to be a part of Global Innovator team? Are you planning to grow your career, which enhance your skills in technology? A career at SmartDocs can open many doors for you in the world of technology. If you are looking for a company that is dedicated to your ideas, recognizes you for your unique competency & contributions and provides a fun, flexible and delightful work atmosphere.

 

Then, we are the right place to ignite your passion. We are totally committed about our employees, our Clients & Customers, our work culture and especially our technology. We are an organization who encourages new ideas of employees through collaboration and creativity.

 

We are seeking for a dedicated individual to join SmartDocs Business Solutions. The candidate will work with the product development team and must be a subject matter expert in-order to deliver the best practices; an ideal candidate must possess excellent business skills with outstanding communication, professionalism & leadership and must have minimum 3 - 6 years of experience in JAVA as a full stack developer.

 

Desirable Skills & Expertise:

 

v  Minimum 3 – 6 years of experience as a full stack developer (Preferable from product based entity).  At least a year of experience in managing a team is mandatory.

v  Master’s or bachelor’s degree in Engineering (CSE / IT / MCA / Software) are preferred.

v  Work exp. in Java, Frame-works like : Spring, Spring boot; J2EE technologies like Servlets, JSP and Web Application Server is mandatory.

v  Strong skills in HTML, Java Script, XML, CSS and Mango DB.

v  Product development in Linux environment is an added advantage.

v  Possesses intellectual humility; smart, driven, creative and able to learn things from slipups, willing to raise others up.

v  Excellent Communication & Analytical skills with integrated professionalism at all levels.

 

Key Responsibilities:

 

Ø  The role is responsible for designing, coding and deploying of high-performance applications.

Ø  Deep expertise and hands on experience as a Core JAVA Developer.

Ø  Team Management, Excellent interpersonal, Communication and effective organizational skills and solid technical skills.

Ø  Should be able to communicate effectively with both technical and non-technical personnel.

Ø  Excellent trouble shootings & problem-solving skills.

Ø  Experience with SDLC from requirement analysis through testing and deployment.

Ø  Must be an expert in technologies like J2EE, JSP, Servlets, Web Application, HTML, Java Script, XML, CSS, Mango DB and JAVA frameworks – Spring boot.

Ø  Develop and maintain strong product knowledge.

Ø  Guide the clients through various stages of the project and transition to support organization.

Ø  Review existing business processes and participate in the Process Improvement Program.

 

 

                        SmartDocs, provides equal employment opportunity to all its employees and all qualified applicants for employment without regard to their race, caste, religion, color, ancestry, marital status, gender, sexual orientation, age, nationality, ethnic origin or disability. Our resource policies shall promote diversity and equality in the workplace while encouraging the adoption of international best practices.

Read more
Matellio India Private Limited
Harshit Sharma
Posted by Harshit Sharma
Remote only
5 - 9 yrs
₹6L - ₹15L / yr
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJavascript
+8 more

Requirements: 

  • 5-8 years of experience in software development 

  • Solid working experience in Java and J2EE development skills. 

  • Object-oriented and service-oriented design concepts, including knowledge of data transfer objects and associated design patterns. 

  • Experience with Angular Framework, JavaScript, and CSS. 

  • Comprehensive knowledge of Web design patterns and front end technologies like HTML5, JQuery and MVC framework like spring and Spring Boot. 

  • Excellent communication skills with the ability to solicit and formalize requirements and work with end users/customers. 

  • Experience with agile development methodology. 

Read more
Pune
7 - 12 yrs
Best in industry
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJavascript
+4 more

JOB DESCRIPTION :


COMPANY DESCRIPTION

Gurucul is transforming enterprise security with user behavior and predictive analytics. If you enjoy

working in a fast-paced, rapidly growing and progressive environment, this is the position for you.

Gurucul offers competitive compensation packages and full benefits for all full-time employees.


JOB DESCRIPTION: Technical Lead

Seeking a Java Technical Lead Developer, who will create scalable multi-tier web applications in an agile

software development environment. Applicant should have significant hands-on experience in designing

and coding server components.

The ideal candidate must be able to design and develop enterprise-scale information security software

in collaboration with the engineering team in India and with their counterparts in the US.


SKILLS AND QUALIFICATIONS


  • 8 to 14 years experience working as a Java developer on Web/EE applications, ideally multi-tenant SaaS products and at least 3 years as a tech lead.
  • Expert in core Java development and Java EE technologies.
  • Solid experience building server-side components for enterprise applications.
  • Good understanding of browser-side development using any one of the frameworks like Angular, React etc.
  • Good understanding of Single-page applications architecture.
  • Good understanding of HTML/HTML5, CSS/CSS3, Javascript and object-oriented javascript Should be well versed with server-side and client-side design patterns and anti-patterns.
  • Experience using Spring and Hibernate in a commercially available software product.
  • Good experience in MVC Architecture like Grails, Spring MVC, Servlets and JSP API programming.
  • Exposure to maven/Gradle build script.
  • Exposure/Experience with Hadoop and related big data technologies.
  • Experience with Git/Gitlab.
  • Experience in JMS, Kafka, and Logstash would be considered an added advantage.
  • Good understanding of REST APIs and JSON.
  • Expert in RDBMS like MySQL 8, SQL, SQL query design, tuning, and experience working with very large databases.
  • Experience in multi-threading, and building cluster-aware applications.
  • Strong communication skills.
  • BS/MS degree in Computer Science, Engineering or related discipline.
  • Experience with DevOps pipelines using tools like Jenkins, Gitlab, and Nexus would be a big plus.
  • Experience in working in SCRUM as a scrum master.


WHAT TO EXPECT

  • Provide inputs in the architecture and design of enterprise applications targeting Fortune 500 companies.
  • Development of web-based Enterprise Applications using cutting-edge technologies.
  • Gain an insight into enterprise security challenges as it relates to information/Application and infrastructure protection.
  • Work closely with a brilliant team based in the USA and India that has successfully launched several software companies.


LOCATION

  • The position is based in Pune (India)


Read more
Kyshac
Karnal, Delhi, Gurugram, Noida, Ghaziabad, Faridabad
3 - 7 yrs
₹4L - ₹15L / yr
skill iconJava
skill iconJavascript
skill iconMongoDB
skill iconNodeJS (Node.js)
skill iconSpring Boot
+1 more

The ideal candidate should have a strong foundation in computer science and a passion for building high-quality solutions. The role requires hands-on experience in designing, developing, and implementing scalable and high-performance mobile applications (company is looking for an employee to build a chat application from scratch)


Responsibilities:

1. Design, develop, and maintain a mobile application

2. Write clean, scalable, and maintainable code that

adheres to best practices and industry standards

3. Test applications to ensure they meet customer requirements and are free from defects

4. Implement security and data protection measures in applications

5. Troubleshoot and debug software applications


Requirements:

1. Bachelor's degree in Computer Science or a related field

2. Experience in developing applications using Java, and Javascript.

3. Strong understanding of the software development life cycle (SDLC) and Agile methodologies

4. Experience with front-end technologies such as HTML, CSS, and JavaScript

5. Experience with database design and management, particularly with MongoDB

6. Excellent debugging and troubleshooting skills

7. Strong communication and teamwork skills

Read more
EVC Ventures
at EVC Ventures
1 recruiter
Ankit Choudhary
Posted by Ankit Choudhary
Gurugram
3 - 7 yrs
Best in industry
skill iconJava
skill iconJavascript
skill iconReact.js
skill iconAngular (2+)
skill iconAngularJS (1.x)
+10 more

Full Stack Developer - Responsibilities:

 

  1. Perform design, development and support of existing and new products.
  2. Understand product vision and business needs to define product requirements and product architectural solutions.
  3. Develop architectural and design principles to improve performance, capacity, and scalability of product.
  4. Work with Product Manager in planning and execution of new product releases.
  5. Consult business management team to clarify objectives and functional requirements for new or modified products.
  6. Work with domain, product management and product engineering teams in the solution engineering efforts.
  7. Work with pre-sales and product management teams in solution demonstrations.
  8. Maintain product roadmap and architectural standards that assure product development projects optimally align with business objectives.
  9. Define product validation policies so as to deliver products that meet system and project expectations.
  10. Facilitate the creation, review, and sign off of project deliverables.
  11. Provide support for production escalations and problem resolution for customers.
  12. Assist technical team with issues needing technical expertise or complex systems knowledge.
  13. Develop broad knowledge about current and future product features.
  14. Analyze market segments and customer base to develop market solutions.
  15. Define product requirements that address market opportunities.

Skills:

Spring, Spring Microservices, Spring Data, SPRING BOOT & HIBERNATE, Java, JPA Oracle Certified Professional (Desirable), Java SE 8, SQL, AWS, JavaScript, Angular, ElasticSearch

Read more
Walnut Financial
Hana Bendy
Posted by Hana Bendy
Mumbai
4 - 12 yrs
₹1L - ₹15L / yr
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJavascript
+14 more
About the Role
As a Technical/Team Lead, you will be an integral member of a small, fast-paced engineering team building our core product and scaling it as the company grows. This is a tremendous  opportunity to influence the growth of a new team and build a novel and impactful technology that improves the financial well-being of patients. It’s an ideal position for those looking to build out a team and collaborate with top talent. 
 
Salary based on experience. Range: 45L - 67L (Total Comp: Base + Stock)
 
This is a hybrid position, with the expectation of a few days in an office.

What You'll Do

    • As an early member of our engineering team, you will work directly with the CTO and Head of Product to spec, design, and build the core product functionality
    • Help us build out a reliable team in India that knows our tech stack and is passionate about the work that we do.
    • Motivate and lead a team of software developers to reach and exceed company goals.
    • Solve problems you don't know how to solve: You'll encounter challenges we haven't yet come across yet. And when the time comes, you'll think through problems, evaluate approaches and teach yourself whatever is needed.
    • Lay a solid foundation for the product to scale, keep our technical debt in check and help us hire a team of incredible engineers.

What We're Looking For

    • 6+ years of experience as a software engineer
    • 1+ years of experience leading projects or teams of engineers
    • Hustle & Grit. Willingness and desire to take on personal responsibility for the business as a whole and “figure it out”, whether it’s in your exact functional lane or not.
    • Excitement and passion for expanding financial access to healthcare.
    • Experience with Java, a relational database, React (or a comparable front-end framework) and building full-stack web apps.
    • A great understanding of how Restful services and Gradle works
    • Ability to overlap with EST morning hours
    • Our full tech stack includes: Docker, Spring, Gradle, Hibernate, ExpressJS, NextJS, Amazon Web Services, Java, N8N, Python
Read more
Nisum Technologies
at Nisum Technologies
8 recruiters
Rohith Kumar Racharla
Posted by Rohith Kumar Racharla
Hyderabad
3 - 14 yrs
₹14L - ₹33L / yr
skill iconJava
skill iconReact.js
skill iconJavascript
skill iconSpring Boot
skill iconVue.js
+1 more
  • Looking for 0-30 Days and Notice Period Serving resources (Across the Globe)
  • 4-13 years developing n-tier modern software applications in a highly transparent agile organization with iterations, continuous integration, and a drive for quality
  • At least 4 years of experience in software development building Web Services in Java, SpringBoot, Elasticsearch, and Open source technologies
  • At least 4 years UI programming experience with JavaScript, CSS, JSON
  • At least 3 years using ReactJS or VueJS, jQuery and Bootstrap, or similar frameworks
  • Experienced in service layer integration (e.g. data, authentication, 3rd party systems) using Ajax and REST APIs.
  • Experienced in UI and backend unit testing, functional testing, and performance testing tools.
  • Must have experience building responsive web applications and related best practices.
  • Experience in building Micro Services using cloud native environments like Azure, Spring Cloud, AWS or GCP with sound understanding of Micro Services Design Patterns
  • Strong interpersonal, written communication, and presentation skills
  • Experience with real-time streaming processing (Kafka/Storm) is preferred
  • Proven ability to design and implement web services in a RESTful manner, along with understanding our broader service-oriented architectures
  • Proven ability to work within a cross functional agile team
  • Must be a self-starter and able to work well with others in a fast-paced agile environment with an emphasis on collaborating and assisting the team to meet business objectives
  • Ability to use tools such as JIRA, Git, etc. preferred
  • Experience with containerized environments such as PCF, Docker, etc. is highly desirable
Read more
Qurix
at Qurix
1 recruiter
Teja Thota
Posted by Teja Thota
Remote, Hyderabad
5 - 10 yrs
₹10L - ₹14L / yr
skill iconJavascript
skill iconAngular (2+)
PrimeFaces
skill iconFlutter
Java Server Faces (JSF)
+10 more

1. Strong fundamentals OOPS concepts, Exception Handling, Coding Standards, Logging

2. Creating custom, general use modules and components which extend the elements and modules of core Angular. 


3. Creating configuration, build, and test scripts for Continuous Integration environments


4. Communicating with external web services and processing data


5. Experience with offline storage threading and performance tuning


6. Review code and maintain the code quality and suggest best practices


7. Knowledge and experience on data science and programming languages


8. Demonstrable abilities to optimize code. Strong analytical skills for effective problem solving

Read more
Splenta Systems Private Limited
Rumita Chatterjee
Posted by Rumita Chatterjee
Bengaluru (Bangalore)
5 - 10 yrs
₹5L - ₹12L / yr
skill iconSpring Boot
skill iconJava
Data Structures
Algorithms
skill iconC++
+10 more

Opportunity to work as a Technical lead.

Company : Splenta Systems Pvt Ltd

Job location : Bangalore

- As a Java Full-stack Engineer or as Java Back-end Developer, you will be responsible for designing and implementing Microservices based application workloads on cloud platform.

- You should have expertise in building/implementing Microservices solution components and be able to put them on cloud platform with necessary configurations.

Top Skills : Java, Spring Boot, Spring Cloud, Microservices Architecture & API Design, Cloud Deployment, DevOps CICD and TDD.

Responsibilities :

- Should be able to provide technical direction and be hands-on with implementation skills for build new age application workloads with proper design considerations and align with overall architecture goals.

- The implementation should meet both functional and non-functional requirements.

- Able to lead team and multitask across different role expectations seamlessly - developer, Tech Lead, Designer.

- Create and review design and implement solution artefacts

- Proactively provide guidance on engineering methodologies, standards and leading practices for the development team.

- Able to design and implement e2e testing while adopting TDD and setting up required tooling infrastructure for automation.

- To help technical team with any code difficulties and manage task distribution and delivery for assigned team members

- Assist in qualifying team members addition by conducting technical interveiew

Experience :

- 4-5 years of experience in application development and deployment,

- Good technical design skills, implementing complex solutions on cloud.

- Have application specific configurations and troubleshooting experience.

- Design and implementation experience in asynchronous applications - event based.

- Application implementation with REST APIs and message integration workflows.

- Ability to implement and analyze application diagnostics and telemetry both from application and from platform.

Team Collaboration must have :

- Customer-oriented, diligent, proactive, focused on achieving customer's business objectives as top priority.

- Able to work successfully both individually and as a team member.

- Easy-going, friendly, communicative, positive in relations with colleagues.

Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos