Backend Developer

Django + Scraper Developer – Job Description

Position: Django + Scraper Developer

Job Summary

We are looking for a skilled Django + Web Scraping Developer with 3+ years of experience in developing scalable web applications using Django and building robust web scrapers. The ideal candidate should have strong Python knowledge, experience with scraping frameworks and APIs, and the ability to work with databases and third-party integrations.

Key Responsibilities

• Develop, maintain, and enhance web applications using Python and Django.
• Design and implement reliable web scraping solutions for extracting structured data from websites.
• Develop scrapers using tools such as Scrapy, Selenium, BeautifulSoup, Requests, or similar technologies.
• Handle dynamic websites, pagination, authentication, proxies, CAPTCHA-related challenges, and anti-bot mechanisms where legally and technically appropriate.
• Clean, validate, transform, and store scraped data in databases.
• Develop and integrate REST APIs and third-party APIs.
• Work with databases such as MySQL, PostgreSQL, or MongoDB.
• Optimize scraper performance, reliability, and data accuracy.
• Troubleshoot and fix issues related to scraping, Django applications, APIs, and databases.
• Write clean, reusable, and maintainable Python code.
• Collaborate with developers, project managers, and other stakeholders to understand project requirements.
• Perform testing, debugging, and performance optimization.

Required Skills

• 3+ years of professional experience in Python/Django development.
• Strong knowledge of Python and Django.
• Hands-on experience with Web Scraping / Data Extraction.
• Experience with Scrapy, Selenium, BeautifulSoup, Requests, or equivalent tools.
• Good understanding of HTML, CSS, JavaScript, DOM, and HTTP/HTTPS.
• Experience working with REST APIs and JSON.
• Good knowledge of SQL and databases such as MySQL/PostgreSQL.
• Understanding of Git/version control.
• Strong debugging and problem-solving skills.

Good to Have

• Experience with Celery, Redis, Docker, and Linux.
• Knowledge of cloud platforms such as AWS.
• Experience handling large-scale scraping projects.
• Understanding of proxy rotation, browser automation, and anti-bot techniques.
• Experience with data pipelines and ETL processes.

What We Offer

• Opportunity to work on challenging and real-world projects.
• Collaborative and growth-oriented work environment.
• Learning and professional development opportunities.
• Competitive salary based on skills and experience.

How to Apply

Interested candidates can share their updated resume along with their current salary, expected salary, notice period, and total experience.

• Strong understanding of Core Python, data structures, OOPs, exception handling, and logical problem-solving.
• Experience in at least one Python framework (FastAPI preferred, Flask/Django acceptable).
• Good knowledge of REST API development and API authentication (JWT/OAuth).
• Experience with SQL databases (MySQL/PostgreSQL) & NoSQL databases (MongoDB/Firestore).
• Basic understanding of cloud platforms (GCP or AWS).
• Experience with Git, branching strategies, and code reviews.
• Solid understanding of performance optimization and writing clean, efficient code.
• Develop, test, and maintain high-quality Python applications using FastAPI (or Flask/Django).
• Design and implement RESTful APIs with strong understanding of request/response cycles, data validation, and authentication.
• Work with SQL (MySQL/PostgreSQL) and NoSQL (MongoDB/Firestore) databases, including schema design and query optimization.
• Experience with Google Cloud (BigQuery, Dataflow, Notebooks) will be a strong plus.
• Work with cloud environments (GCP/AWS) for deployments, storage, logging, etc.
• Use version control tools such as Git/BitBucket for collaborative development.
• Support and build data pipelines using Dataflow/Beam and BigQuery if required.
• Experience with GCP services like BigQuery, Dataflow (Apache Beam), Cloud Functions, Notebooks etc
• Good to have Exposure to microservices architecture.
• Familiarity with Redis, Elasticsearch, or message queues (Pub/Sub, RabbitMQ, Kafka).
• 
  

Sr. Backend Engineer - (Django & Python)

Must have Crypto/Blockchain Experience.

CoinCROWD is an innovative Fintech company. We offer a crypto platform for seamless payments, Crypto Vouchers, crypto trading, portfolio management, real time market data, breaking news and powerful analytics.

Website: https://coincrowd.com/

Domain : Finance, Blockchain, Crypto

Role : Permanent full time Employment

Job Location : Work from Home / Remote

Job Responsibilities:

• Understand project requirements, writing bug free clean code and ensure that the solution works per the agreed architecture, SLAs, KPIs and business model
•  Integrate backend with third party APIs
• 100% Hands on role
•  Make design decisions that contribute to maintainable systems
• Adapt to rapidly evolving requirements and changing priorities and drive the team accordingly Responsible to drive and support e-commerce project activities and ensure marketplace implementation, deepen customer engagement, satisfaction, and user engagement
• Reverse engineer for debugging errors in code and ensuring quality control in the process.
• Continually drive products towards a meaningful balance between user needs, business objectives and technical feasibility
• Documentation and reference preparation for users by writing operating instructions including changes and revisions.

Qualifications:

• Bachelor or Master Degree in Computer Science, Software Engineering from a reputed University
• 5+ years of experience with at-least 2-3 years working in the Finance domain is Plus.
• Django , Django Rest Framework, Python 3, Mysql, Elasticsearch, websockets, javascript, JIRA, Gitlab, Rest API, GCP or AWS
• Finance, Social Analytical, debugging, and troubleshooting skill with proven experience troubleshooting and fixing production bugs
• Experience in writing unit testing and test case automation.
• Ability to operate in an Agile environment with a start-up mentality and unstructured environment, Energy, drive and passion to work, and operate in a digital world.
• Excellent communication skills and ability to work with remote teams

What We Offer:

In recognition of your valuable contributions, you will receive an equity-based compensation package. Join our dynamic and innovative team in the rapidly evolving fintech industry and play a key role in shaping the future of Coincrowd's success.

Basic Qualifications

Candidates for this role must have:

• Bachelor’s degree in computer science or a related field
• At least three years of experience writing production code of increasing complexity
• Strong understanding of computer science fundamentals, including algorithms, complexity analysis, data structures, problem solving, and object-oriented analysis and design
• Proficiency in at least one of the following: Java, C, C++, C#, Ruby, Scala, Python
• Experience refactoring code and evolving architectures
• Experience crafting unit, integration, functional and regression tests

 Preferred Qualifications

• Master’s degree in computer science or a related field
• Experience developing in a Linux environment
• Experience applying service-oriented architecture techniques to production use cases
• Experience in developing secure, multi-platform mobile applications

Be Part Of Building The Future

Dremio is the Data Lake Engine company. Our mission is to reshape the world of analytics to deliver on the promise of data with a fundamentally new architecture, purpose-built for the exploding trend towards cloud data lake storage such as AWS S3 and Microsoft ADLS. We dramatically reduce and even eliminate the need for the complex and expensive workarounds that have been in use for decades, such as data warehouses (whether on-premise or cloud-native), structural data prep, ETL, cubes, and extracts. We do this by enabling lightning-fast queries directly against data lake storage, combined with full self-service for data users and full governance and control for IT. The results for enterprises are extremely compelling: 100X faster time to insight; 10X greater efficiency; zero data copies; and game-changing simplicity. And equally compelling is the market opportunity for Dremio, as we are well on our way to disrupting a $25BN+ market.

About the Role

The Dremio India team owns the DataLake Engine along with Cloud Infrastructure and services that power it. With focus on next generation data analytics supporting modern table formats like Iceberg, Deltalake, and open source initiatives such as Apache Arrow, Project Nessie and hybrid-cloud infrastructure, this team provides various opportunities to learn, deliver, and grow in career. We are looking for innovative minds with experience in leading and building high quality distributed systems at massive scale and solving complex problems.

Responsibilities & ownership

• Lead, build, deliver and ensure customer success of next-generation features related to scalability, reliability, robustness, usability, security, and performance of the product.
• Work on distributed systems for data processing with efficient protocols and communication, locking and consensus, schedulers, resource management, low latency access to distributed storage, auto scaling, and self healing.
• Understand and reason about concurrency and parallelization to deliver scalability and performance in a multithreaded and distributed environment.
• Lead the team to solve complex and unknown problems 
• Solve technical problems and customer issues with technical expertise
• Design and deliver architectures that run optimally on public clouds like  GCP, AWS, and Azure
• Mentor other team members for high quality and design 
• Collaborate with Product Management to deliver on customer requirements and innovation
• Collaborate with Support and field teams to ensure that customers are successful with Dremio

Requirements

• B.S./M.S/Equivalent in Computer Science or a related technical field or equivalent experience
• Fluency in Java/C++ with 8+ years of experience developing production-level software
• Strong foundation in data structures, algorithms, multi-threaded and asynchronous programming models, and their use in developing distributed and scalable systems
• 5+ years experience in developing complex and scalable distributed systems and delivering, deploying, and managing microservices successfully
• Hands-on experience  in query processing or optimization, distributed systems, concurrency control, data replication, code generation, networking, and storage systems
• Passion for quality, zero downtime upgrades, availability, resiliency, and uptime of the platform
• Passion for learning and delivering using latest technologies
• Ability to solve ambiguous, unexplored, and cross-team problems effectively
• Hands on experience of working projects on AWS, Azure, and Google Cloud Platform 
• Experience with containers and Kubernetes for orchestration and container management in private and public clouds (AWS, Azure, and Google Cloud) 
• Understanding of distributed file systems such as  S3, ADLS, or HDFS
• Excellent communication skills and affinity for collaboration and teamwork
• Ability to work individually and collaboratively with other team members
• Ability to scope and plan solution for  big problems and mentors others on the same
• Interested and motivated to be part of a fast-moving startup with a fun and accomplished team