Cutshort logo
Anakin logo
Lead Software Engineer - App Crawling
Lead Software Engineer - App Crawling
Anakin's logo

Lead Software Engineer - App Crawling

Siddharth Patra's profile picture
Posted by Siddharth Patra
3 - 10 yrs
₹20L - ₹30L / yr (ESOP available)
Remote only
Skills
skill iconPython
skill iconAmazon Web Services (AWS)
Web Scraping
Selenium
skill iconNodeJS (Node.js)

Your Responsibilities would be to:

  • Architect new and optimize existing software codebases and systems used to crawl, launch, run, and monitor the Anakin family of app crawlers
  • Deeply own the lifecycle of software, including rolling out to operations, managing configurations, maintaining and upgrading, and supporting end-users
  • Configure and optimize the automated testing and deployment systems used to maintain over 1000+ crawlers across the company
  • Analyze data and bugs that require in-depth investigations
  • Interface directly with external customers including managing relationships and steering requirements

Basic Qualifications:

  • Extremely effective, self-driven builder
  • 2+ years of experience as a backend software engineer
  • 2+ years of experience with Python
  • 2+ years of experience with AWS services such as EC2, S3, Lambda, etc.
  • Should have managed a team of software engineers
  • Deep experience with network debugging across all OSI layers (Wireshark)
  • Knowledge of networks or/and cybersecurity

Preferred Skills and Experience

  • Broad understanding of the landscape of software engineering design patterns and principles
  • Ability to work quickly and accurately in a highly stressful environment during removing bugs in run-time within minutes
  • Excellent communicator, both written and verbal

Additional Requirements

  • Must be available to work extended hours and weekends when needed to meet critical deadlines
  • Must have an aversion to politics and BS. Should let his/her work speak for him/her.
  • Must be comfortable with uncertainty. In almost all the cases, your job will be to figure it out.
  • Must not be bounded to comfort zone. Often, you will need to challenge yourself to go above and beyond.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Anakin

Founded :
2020
Type :
Product
Size :
0-20
Stage :
Raised funding

About

Know your competitors' strategy and industry trends LIVE! We offer a full suite of competitive intelligence software for retailers and brands. We provide global coverage on real-time product assortments and pricing data from e-commerce websites on over 100 million SKUs. We collect web data at scale so that you don’t have to. We track and categorize all this data using AI and machine learning.
 
Read more

Connect with the team

Profile picture
Kumari Bala
Profile picture
Mohit Prateek
Profile picture
Siddharth Patra

Company social profiles

N/A

Similar jobs

 An IT services and solutions provider based in Tokyo, Japan
An IT services and solutions provider based in Tokyo, Japan
Agency job
via Infinium Associate by Toshi Srivastava
TOKYO (Japan)
4 - 8 yrs
₹25L - ₹45L / yr
JLPT N2
IT infrastructure
Japanese Language Proficiency
Network engineering
cloud services
+4 more

A bilingual infrastructure engineer typically handles the design, implementation, and maintenance of IT infrastructure, including networks, servers, and storage systems. They are expected to have expertise in technologies like Linux, Windows, virtualization platforms, and scripting languages, along with strong communication skills in multiple languages. Responsibilities often include:

 

Monitoring and maintaining network and server operations.

Providing technical support for hardware and software systems.

Designing scalable and secure infrastructure solutions.

Collaborating with teams to ensure system reliability and efficiency.

Implementing disaster recovery and backup plans.

 

For bilingual roles, fluency in languages like English and Japanese is often required to facilitate communication across diverse teams and clients.

Read more
Codeft Software Solutions
Vishwanath Rasakatla
Posted by Vishwanath Rasakatla
Hyderabad, Bengaluru (Bangalore)
8 - 14 yrs
Best in industry
skill iconPHP
skill iconAmazon Web Services (AWS)
skill iconLaravel

We are seeking an experienced PHP Architect to lead the architectural design and development of our web applications. This role is perfect for a strategic thinker who thrives on solving complex problems and has a profound understanding of PHP and its ecosystem. You will collaborate with cross-functional teams to create robust, high-performing, and scalable solutions that propel our business forward.

Key Responsibilities

  • Architectural Leadership: Design and implement scalable, secure, and high-performance web architectures using PHP and related technologies.
  • Technical Strategy: Develop and drive the technology roadmap, ensuring alignment with business goals and emerging industry trends.
  • Code Excellence: Establish and enforce coding standards and best practices. Conduct code reviews to maintain code quality and integrity.
  • Team Collaboration: Work closely with front-end developers, UI/UX designers, product managers, and other stakeholders to deliver cohesive and user-centric products.
  • Performance Optimization: Identify bottlenecks and devise solutions to enhance application performance and user experience.
  • Mentorship: Provide guidance and mentorship to development teams, fostering a culture of continuous learning and improvement.
  • Security Compliance: Ensure applications adhere to security best practices and compliance requirements.
  • Documentation: Maintain comprehensive documentation of architectures, interfaces, and operational procedures.

Qualifications

Education:

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

Experience:

  • Minimum of 8 years of professional experience in PHP development.
  • At least 3 years in an architectural or lead developer role.

Technical Skills:

  • Expertise in PHP and PHP frameworks such as Laravel or CodeIgniter.
  • Proficient in object-oriented programming (OOP) and design patterns.
  • Strong experience with MySQL or other relational databases; familiarity with NoSQL databases is a plus.
  • Knowledge of front-end technologies including JavaScript, HTML5, CSS3, and frameworks like React or Angular.
  • Experience with RESTful APIs, microservices architecture, and SOA.
  • Familiarity with cloud platforms (AWS, Azure, or Google Cloud) and containerization tools like Docker and Kubernetes.
  • Understanding of CI/CD pipelines and DevOps practices.
  • Solid grasp of security principles and web application security standards.

Soft Skills:

  • Strategic Thinking: Ability to see the big picture and align architectural solutions with business objectives.
  • Problem-Solving: Exceptional analytical skills with a knack for tackling complex technical challenges.
  • Leadership: Proven ability to lead and inspire development teams.
  • Communication: Excellent verbal and written communication skills; able to articulate complex concepts clearly.
  • Collaboration: Strong interpersonal skills with a focus on teamwork and knowledge sharing.


Why Join Us?


If you are passionate about building exceptional web applications and want to grow your career as a PHP Architect, we’d love to hear from you. Apply now and become a part of our innovative and supportive team!

Read more
Automated lead conversion for modern revenue teams
Automated lead conversion for modern revenue teams
Agency job
via Qrata by Blessy Fernandes
Remote only
3 - 7 yrs
₹20L - ₹50L / yr
skill iconRuby on Rails (ROR)
skill iconPython
Things you enjoy:
● Learning new things, asking questions
● Analyzing user feedback with the team to learn on what to build
● Iterating on feedback to continuously improve features
● Building APIs and microservices for a system that can scale to millions of emails per
month
● Working closely with our product designers and frontend developers to provide a
delightful user experience
● TDD to make sure all features work as intended
Qualifications:
● B.Sc. in Computer Science or a related field, or equivalent experience
● 2+ years experience working as a software engineer
● Proficiency in Ruby / Rails or equivalent web development language/framework
● Strong in SQL and relational database such as PostgreSQL
Read more
Purpllecom
at Purpllecom
4 recruiters
Agency job
Mumbai
1 - 9 yrs
₹2L - ₹20L / yr
skill iconNodeJS (Node.js)
skill iconExpress
Qualifications
• Overall 4+ years of experience
• 2 year development experience in NodeJs(v4 and above)
• Knowledge in Unit testing frameworks like Mocha
• Experience in working with any NodeJs web framework(Express or Hapi)
• Development experience using any persistent store (NoSql or Relational) Formal Deliverables
• Design and development of new and enhance existing applications using Node.JS
• Collaborate with internal and external team members to ensure projects get delivered as planned
• Develop Backend services using HapiJs
• Develop background workers based on cron or rabbitmq messages
• Support existing and new features via bug fixes, prod support or monitoring scripts
• Unit testing for all the developed modules
Read more
Algoscale Technologies
at Algoscale Technologies
3 recruiters
Neeraj Agarwal
Posted by Neeraj Agarwal
Remote only
4 - 8 yrs
₹8L - ₹18L / yr
skill iconDjango
skill iconPython
RESTful APIs
skill iconElastic Search
skill iconMongoDB
+1 more

Responsibilities:

  • Develop cloud-based Python Django software products
  • Working closely with UX and Front-end Developers
  • Participating in architectural, design, and product discussions
  • Designing and creating RESTful APIs for internal and partner consumption
  • Working in an agile environment with an excellent team of engineers

 

Skills:

  • Highly proficient with Python 
  • Hands-on experience with the Django framework
  • Solid database skills in a relational database (i.e. PostgresSQL, MySQL, etc.)
  • Strongly preferred exposure with Elasticsearch
  • Knowledge of how to build and use RESTful APIs
  • Strong knowledge of version control (i.e. git, svn, etc.)
  • Experience deploying Python applications into production
  • Amazon Web Services (AWS) infrastructure knowledge is a plus
Read more
Bengaluru (Bangalore)
3 - 6 yrs
₹1L - ₹10L / yr
skill iconPython
RESTful APIs
Debugging

ROLES AND RESPONSIBILITIES

• Lead the Software Team. Ensure consistent deliveries of planned features while ensuring code quality, testing standards, and processes are maintained.

• Work with the leadership team to cultivate and grow the Internal Software Team Culture at

• Work across the full stack, building highly scalable distributed solutions that enable positive user experiences and measurable business growth

• Ensure application performance, uptime, and scale, maintaining high standards of code quality and thoughtful application design.

• Solve technical problems of high scope and complexity.

• Exert influence on the overall objectives and long-range goals of your team.

• Experience with performance and optimization problems, particularly at a large scale, and a demonstrated ability to both diagnose and prevent these problems.

• Help to define and improve our internal standards for style, maintainability, and best practices for a high-scale web environment. Maintain and advocate for these standards through code review.

 

CANDIDATES MUST HAVE

• Experienced in designing and integrating RESTful APIs

• Knowledge of Python

• Excellent debugging and optimization skills

 

DESIRED SKILLS & EXPERIENCE

• 3-5 years of experience building large-scale software applications and working with large software teams.

• Bachelor’s degree in computer science, information technology, or engineering • Experience designing and integrating RESTful APIs

• Knowledge of Python and Backend Development

• Experience building Web/Mobile applications

• Excellent debugging and optimization skills

• Unit and Integration testing experience

• Being knowledgeable about engineering processes and good practices

• Passionate about learning new tools. Ability to continuously learn and acquire knowledge.

• Able to adapt to changing complexity of tasks.

Read more
Strobes
at Strobes
1 recruiter
Swarnabh Das
Posted by Swarnabh Das
Hyderabad, Mumbai
3 - 7 yrs
₹15L - ₹25L / yr
skill iconPython
skill iconDjango
Web Development
Microservices
API
+1 more

Responsibilities:

  1. Writing reusable, testable, and efficient
  2. Design and implementation of low-latency, high-availability, and performant
  3. Integration of user-facing elements developed by front-end developers with server side
  4. Implementation of security and data
  5. Integration of data storage solutions may include databases, key-value stores, blob stores, etc. Experience administering innovation with methodologies such as design
  6. Experience working on Agile Scrum and DevOps aligned delivery
  7. Interest and ability to learn other coding languages as
  8. Strong communication skills and great product
  9. Proficient communication skills verbal and
  10. Understanding of accessibility and security compliance depending on the specific
  11. Knowledge of user authentication and authorization between multiple systems, servers, and environments.
  12. Understanding of fundamental design principles behind a scalable
  13. Familiarity with event-driven programming in
  14. Understanding of the differences between multiple delivery platforms, such as mobile vs desktop, and optimizing output to match the specific
  15. Able to create database schemas that represent and support business
  16. Strong unit test and debugging

Skills:

  1. Expert in Python, with knowledge of at least one Python web framework such as Django, Flask, etc depending on your technology
  2. Familiarity with some ORM (Object Relational Mapper)
  3. Able to integrate multiple data sources and databases into one
  4. Understanding of the threading limitations of Python, and multi-process
  5. Good understanding of server-side templating languages such as Jinja 2, Mako, etc depending on your technology
  6. Basic understanding of front-end technologies, such as JavaScript, HTML5, and
  7. Proficient understanding of code versioning tools such as Git, Mercurial or

 

Read more
India's Unicorn in Online Gaming Domain
India's Unicorn in Online Gaming Domain
Agency job
via zyoin by Nischay Gowda
Remote, Bengaluru (Bangalore)
12 - 20 yrs
₹50L - ₹150L / yr
architect
skill iconJava
skill iconPython
skill iconJavascript
skill iconAmazon Web Services (AWS)
+2 more

Responsibilities Include

You will break down business opportunities and problems into software solutions. You will work closely with the CTO to help product and marketing stakeholders distill the product vision and roadmap, into a technology vision. You will be responsible for the evolution of an already bleeding-edge highly distributed systems at the back-end, and would need to work with front-end architects to come up with the best user experience for the gaming platform. You will be required to make decisions quickly, and work under strict timelines. You would lead technology strategy through analysis of market trends and product requirements. You would help set coding guidelines and help bring the most modern tools to keep engineering processes most efficient.

 

Requirements

  • B.E/MS in Computer Science or equivalent.
  • 10+ years or more of progressive software technology experience with at least 3 years in an architectural role.
  • Completely hands on with technology and architecture. Start-up experience is a huge plus.
  • Ability to quickly prototype and demonstrate technology value adds and educate + drive adoption within the extended technology team
  • Excellent and robust understanding of scalable product system architecture(s), platforms and core technologies
  • Demonstrated problem-solving and leadership skills to pursue correct engineering process in adverse conditions. Ability to embrace and demonstrate leadership beyond ownership
  • Work with engineering leadership to setup and manage processes.
  • Track record of thought leadership and out of the box thinking in the technology arena.
  • Ability to work efficiently in an entrepreneurial and in a start-up environment
  • A Java/Spring/Akka, Javascript or Golang rockstar.
  • Deep and hands on knowledge of some of these technologies - MySQL, NodeJS, message brokers such as Kafka/RabbitMQ, NoSQL datastore such as Mongo, Cassandra, Arango, distributed caches such as Redis/memcached, container technology such as Docker and Kubernetes etc.
  • Great proficiency in distributed systems design, with an ability to make the right trade-offs for creating future-proof solutions.
  • Building quick PoCs and full-fledged solutions with various AWS managed services would be a big plus.
Read more
Innefu Labs Pvt
at Innefu Labs Pvt
2 recruiters
Vandana Chawla
Posted by Vandana Chawla
NCR (Delhi | Gurgaon | Noida)
1 - 4 yrs
₹2L - ₹5L / yr
skill iconDjango
skill iconPython
Web Scraping

Company Introduction –

  • Information Security & Data Analytics Series A funded company.
  • Working in cutting edge technologies - Using AI for predictive intelligence and Facial Biometrics.
  • Among Top 5 Cyber excellence companies globally (Holger Schulze awards)
  • Bronze award for best startup of the year (Indian Express IT awards), only cyber Security Company in top 3.
  • More than 100+ clients in India.

 

Job Description:-

 

Job Title: Python Developer

 

Key Requirements:-

 

  • Mine data from structured and unstructured data sources.
  • Extract data (text, images, and videos) from multiple documents in different formats.
  • Extract information and intelligence from data.
  • Extract data based on regular expressions.
  • Collect data from structured RDBMS databases.
  • Work closely with Project/Business/Research teams to provide mined data/intelligence for analysis.
  • Should have strong exposure to core python skills like multiprocessing, multithreading, file handling, data structure like JSON, Data frames, and User Defined Data structure.
  • Should have excellent knowledge of classes, file handling, memory manipulations.
  • Strong Knowledge in Python.
  • Strong exposure to frond end languages like CSS, JavaScript, Ajax etc.
  • Should have exposure to requests, Frontera, scarpy-cluster, elastic-search, distributed computing tools like Kafka, Hbase, Redis, Zookeeper, restAPI.
  • Should be familiar with *nix development environment.
  • Knowledge of Django will be added advantage.
  • Excellent knowledge on Web Crawling/Web scraping.
  • Should have used scraping modules like Selenium, Scrapy, and Beautiful soup.
  • Experience with text processing.
  • Basics of databases. Good troubleshooting and debugging skills.

Experience : 1-4 Years Experiene 

 
Education

 

   B.Tech, MCA, Computer Engineering

 

Read more
YuktaMedia
at YuktaMedia
1 video
3 recruiters
Pranjali Wandrekar
Posted by Pranjali Wandrekar
Baner, Pune
6 - 9 yrs
₹15L - ₹24L / yr
Hibernate (Java)
skill iconJava
J2EE
Spring
skill iconHTML/CSS
+2 more
Either Ready to work or working in a fast-paced start up environment. Strong working knowledge in Java EE. Hands-on experience on Java Spring / spring boot framework. Strong in ORM frameworks (Hibernate, JPA, MyBatis) Familiar with various Design Patterns Good to have: Client-side technologies like HTML, CSS, Angular, Node JS Analytical problem-solving skills Good in RDBMS and some NoSQL DB like Cassandra or Elasticsearch, Jira, Git, SVN
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos