Senior Software Engineer Backend (Web Scraper / Crawler)

Key Responsibilities

AI/ML & Python Development

• Design, develop, and integrate AI-powered solutions and intelligent features using Python.
• Build and implement Retrieval-Augmented Generation (RAG) pipelines to enhance knowledge retrieval and contextual AI responses.
• Develop AI applications using modern frameworks and tools such as LangChain, LlamaIndex, and AI Agents/Autonomous Workflows.
• Integrate Large Language Model (LLM) APIs, including OpenAI and similar platforms, into enterprise-grade applications.
• Design, implement, and manage vector databases to enable semantic search and AI-driven information retrieval.
• Collaborate with cross-functional teams to evaluate, fine-tune, and optimize AI models for performance, scalability, and accuracy.
• Stay updated with emerging AI technologies, frameworks, and industry best practices to drive innovation.

We have an immediate opportunity for Sr Backend Developer position with one of our clients based out of Hyderabad location.

Please find the below Job Description.

Position : Sr Backend Developer

Work Location : Hyderabad

Experience : 8+ yrs

Job Type : Fulltime

Mode : Hybrid

Description:

We are looking for a skilled and proactive Backend Developer with strong hands-on experience in .NET 8, Entity Framework, and AWS services to join our dynamic development team. The ideal candidate will be passionate about building scalable APIs, working with microservices architecture, and deploying infrastructure using Terraform.

You will play a key role in designing, developing, and maintaining high-performance backend systems for cloud-native applications.

Key Responsibilities:

* Design, develop, and maintain robust and scalable APIs using .NET 8 and Entity Framework.

* Optimize data access and caching strategies using Redis Cache.

* Work with MySQL for efficient data storage and retrieval.

* Integrate and manage AWS services including:

 RDS for database hosting

 SQS and SNS for messaging and notifications

 ECS for containerized application deployments

 Secrets Manager and KMS for secrets and key management

* Write clean, maintainable, and testable code following best practices and SOLID principles.

* Collaborate with cross-functional teams in code reviews, architectural discussions, and deployment planning.

* Use GitLab for version control and CI/CD pipelines.

* Provision and manage infrastructure using Terraform.

* Monitor, troubleshoot, and enhance application performance and reliability.

Required Skills & Experience:

* Strong proficiency in .NET 8 and C#.

* Experience with Entity Framework Core.

* Proficient in building and consuming RESTful APIs.

* Hands-on experience with Redis for caching.

* Solid experience with MySQL or other relational databases.

* Practical knowledge of AWS services, especially:

 RDS, SQS, SNS, ECS, Secrets Manager, KMS

* Experience with GitLab for source control and DevOps pipelines.

* Familiarity with Terraform for infrastructure as code.

* Good understanding of microservices, containerization, and scalable architecture.

* Strong problem-solving and debugging skills.

Nice to Have:

* Experience with Docker and Kubernetes.

* Knowledge of monitoring tools (e.g. CloudWatch, Prometheus, Grafana).

* Exposure to CI/CD best practices.

Please send us your updated resume and the below required details for further process.

Full Name:

Email ID:

Contact No:

Skype ID:

Total Experience :

Relevant Experience :

Current Location :

Current CTC :

Expected CTC :

Notice Period :

Reason for Change :

References of your friends/colleagues will be appreciated.

Thanks & Regards,

Meghana

USP HR TECHNOLOGIES.(www.usptech.in)

Required Skills:

• 4+ year of experience in Development in JAVA technology.
• Strong Java Basics
• SpringBoot or Spring MVC
• Hands on experience on Relational Databases (SQL query or Hibernate) + Mongo (JSON parsing)
• Proficient in REST API development
• Messaging Queue (RabitMQ or Kafka)
• Microservices
• Any Caching Mechanism
• Good at problem solving

Good to Have Skills:

• 4+ years of experience in using Java/J2EE tech stacks
• Good understanding of data structures and algorithms.
• Excellent analytical and problem solving skills.
• Ability to work in a fast-paced internet start-up environment.
• Experience in technical mentorship/coaching is highly desirable.
• Understanding of AI/ML algorithms is a plus.

Software Developer

Roles and Responsibilities

• Apply knowledge set to fetch data from multiple online sources, cleanse it and build APIs on top of it
• Develop a deep understanding of our vast data sources on the web and know exactly how, when, and which data to scrap, parse and store
• We're looking for people who will naturally take ownership of data products and who can bring a project all the way from a fast prototype to production.

Desired Candidate Profile

• At Least 1-2 years of experience
• Strong coding experience in Python (knowledge of Javascripts is a plus)
• Strong knowledge of scraping frameworks in Python (Request, Beautiful Soup)
• Experience with SQL and NoSQL databases
• Knowledge in Version Control tools like GIT.
• Good understanding and hands-on with scheduling and managing tasks with cron.

Nice to have:

• Experience of having worked with elastic search
• Experience with multi-processing, multi-threading, and AWS/Azure is a plus
• Experience with web crawling is a plus
• Deploy server/related components to staging, live environments.
• Experience with cloud environments like AWS,etc as well as cloud solutions like Docker,Lambda, etc
• Experience in DevOps and related practices to improve development lifecycle, continuous delivery with high quality is an advantage.
• Compile and analyze data, processes, and codes to troubleshoot problems and identify areas for improvement

• No day is the same - you will create technical designs that support varying client requirements
• You'll design and develop full-stack web applications using the latest web technologies, primarily Python and Django
• Write code/unit tests and be part of the test-driven development environment
• Leverage your skills in industry-standard tools to deliver weekly code releases
• You'll work in a no silos environment, frequently collaborating with global teams and roles across the organization

Who you are:

• 7+ years of experience developing great web applications
• You can build products from scratch
• You have expertise in the Django backend framework
• You are fluent in the Python language
• You have dabbled in any one of these front-end frameworks - Angular, React, Vue
• You understand when to use NoSQL vs. relational database
• you understand reporting/dashboards framework
• You are comfortable working up and down the stack
• You are able to convert ideas into designs and build them out
• Benefit if you have worked with payment gateways such as visa, Mastercard, etc.