Data Engineer (Pyspark Developer)

Job Summary

We are looking for an experienced Backend Developer proficient in .NET, Node.js, and MS SQL Server to join our technical team. The candidate will be responsible for building, maintaining, and optimizing scalable backend services and APIs, ensuring system reliability, performance, and security.

Key Responsibilities

• Design, develop, and maintain backend applications and APIs using .NET (Core/ASP.NET) and Node.js.
• Develop and manage MS SQL Server databases, including schema design, stored procedures, indexing, and performance optimization.
• Integrate backend logic with various third-party systems and APIs.
• Ensure scalability, high performance, and security across backend systems.
• Write clean, maintainable, and well-documented code following best practices.
• Debug and resolve production issues, ensuring system stability and reliability.
• Collaborate with QA engineers, DevOps, and other backend developers to deliver end-to-end solutions.
• Participate in Agile development processes including sprint planning, daily stand-ups, and retrospectives.
• Stay updated with emerging backend technologies and contribute to continuous improvement.

Required Skills & Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• 3–4 years of professional experience in backend development.
• Strong hands-on experience with .NET Core / ASP.NET / C#.
• Strong hands-on experience with Node.js (Express.js or NestJS preferred).
• Proficiency in MS SQL Server (T-SQL, stored procedures, performance tuning, query optimization).
• Experience developing and consuming RESTful APIs.
• Knowledge of API security standards (JWT, OAuth2, etc.).
• Familiarity with Git or other version control systems.
• Experience in Agile/Scrum development environments.

Nice to Have

• Experience with cloud platforms like Azure or AWS.
• Familiarity with ORM frameworks (Entity Framework, Sequelize).
• Exposure to CI/CD pipelines and containerization (Docker).
• Understanding of Redis or message queue systems (RabbitMQ, Kafka).

Soft Skills

• Strong analytical and problem-solving mindset.
• Excellent communication and teamwork skills.
• High sense of responsibility and ownership of assigned projects.
• Ability to work independently under minimal supervision.

Compensation

• Competitive salary based on experience and technical expertise.
• Performance-based bonuses and career growth opportunities.

Job Type: Full-time

Salary (Lacs): Up to 22 LPA

Required Qualifications

•   4–7 years of total experience, with a minimum of 4 years in a full-time DevOps role

•   Hands-on experience with major cloud platforms (GCP, AWS, Azure, OCI), more than one will be a plus

•   Proficient in Kubernetes administration and container technologies (Docker, containerd)

•   Strong Linux fundamentals

•   Scripting skills in Python and shell scripting

•   Knowledge of infrastructure as code with hands-on experience in Terraform and/or Pulumi (mandatory)

•   Experience in maintaining and troubleshooting production environments

•   Solid understanding of CI/CD concepts with hands-on experience in tools like Jenkins, GitLab CI, GitHub Actions, ArgoCD, Devtron, GCP Cloud Build, or Bitbucket Pipelines

If Interested kindly share your updated resume on 82008 31681

Technical Skill Set:

1. ASP. NET Development – Strong expertise in C#, ASP.NET, WPF, and solid understanding of SOLID principles, API development, and databases.

2. Cloud Technologies – Hands-on experience with AWS, Azure, or Google Cloud.

3. Software Development & Architecture – Proficiency in SDLC, Agile, Scrum, and DevOps frameworks.

4. Project Planning & Management – Experience in task allocation, tracking, estimations, and deliverables management.

5. Repository & Version Control – Familiarity with Git, SVN, or similar tools, along with basic networking concepts.

6. Product Lifecycle Management – Knowledge of requirement analysis, documentation, testing, and release management.

7. Project Planning Tools – Experience with tools like Microsoft Project Plan, JIRA, Redmine, or HP ALM/Quality Centre.

Leadership & Soft Skills:

1. Team Leadership – Ability to guide, mentor, and manage a team while ensuring high-quality deliverables within tight deadlines.

2. Client Engagement & Requirement Gathering – Skilled in collaborating with stakeholders to enhance and refine project requirements.

3. Strong Communication & Problem-Solving – Effective at handling challenges, making decisions, and ensuring smooth project execution.

Profile: AWS Data Engineer

Mode- Hybrid

Experience- 5+7 years

Locations - Bengaluru, Pune, Chennai, Mumbai, Gurugram

Roles and Responsibilities

• Design and maintain ETL pipelines using AWS Glue and Python/PySpark
• Optimize SQL queries for Redshift and Athena
• Develop Lambda functions for serverless data processing
• Configure AWS DMS for database migration and replication
• Implement infrastructure as code with CloudFormation
• Build optimized data models for performance
• Manage RDS databases and AWS service integrations
• Troubleshoot and improve data processing efficiency
• Gather requirements from business stakeholders
• Implement data quality checks and validation
• Document data pipelines and architecture
• Monitor workflows and implement alerting
• Keep current with AWS services and best practices

Required Technical Expertise:

• Python/PySpark for data processing
• AWS Glue for ETL operations
• Redshift and Athena for data querying
• AWS Lambda and serverless architecture
• AWS DMS and RDS management
• CloudFormation for infrastructure
• SQL optimization and performance tuning

Skills Required:

- 4+ years of technical experience in a developer role

- Strong proficiency with Core Java

- Database experience preferably with DB2, Sybase, or Oracle

- Complete SDLC process and Agile Methodology (Scrum)

- Strong oral and written communication skills

- Excellent interpersonal skills and professional approach

- Bachelor’s degree in Computer Science, MIS, or other technology/engineering discipline

Skill Desired:

-Strong proficiency with Scala on Spark

- Previous experience in front office and back office reports

- Strong understanding Order Life Cycle management from Equities or Listed derivatives perspective

- Previous experience in Trade Surveillance or working with data from the order lifecycle

- Good to have knowledge on Hadoop Technologies

- High quality software architecture and design methodologies and patterns

- Work experience as level-3 support for applications

- Layered Architecture, Component based Architecture

- XML-based technologies

- Unix OS, Scripting, Python or Perl

- Experience in development on other application types (Web applications, batch, or streaming)

Job Description

Job Title: Data Engineer

Location: Hyderabad, India

Job Type: Full Time

Experience: 5 – 8 Years

Working Model: On-Site (No remote or work-from-home options available)

Work Schedule: Mountain Time Zone (3:00 PM to 11:00 PM IST)

Role Overview

The Data Engineer will be responsible for designing and implementing scalable backend systems, leveraging Python and PySpark to build high-performance solutions. The role requires a proactive and detail-orientated individual who can solve complex data engineering challenges while collaborating with cross-functional teams to deliver quality results.

Key Responsibilities

• Develop and maintain backend systems using Python and PySpark.
• Optimise and enhance system performance for large-scale data processing.
• Collaborate with cross-functional teams to define requirements and deliver solutions.
• Debug, troubleshoot, and resolve system issues and bottlenecks.
• Follow coding best practices to ensure code quality and maintainability.
• Utilise tools like Palantir Foundry for data management workflows (good to have).

Qualifications

• Strong proficiency in Python backend development.
• Hands-on experience with PySpark for data engineering.
• Excellent problem-solving skills and attention to detail.
• Good communication skills for effective team collaboration.
• Experience with Palantir Foundry or similar platforms is a plus.

Preferred Skills

• Experience with large-scale data processing and pipeline development.
• Familiarity with agile methodologies and development tools.
• Ability to optimise and streamline backend processes effectively.
• 
  

Egnyte is seeking an experienced Sr. Software Engineer to join our Software Engineering (Infrastructure) group. The Software Engineering (Infrastructure) group builds large distributed components and services that run Egnyte’s Cloud Platform. Our code serves billions of requests per day with sub-second latency in a fault-tolerant environment. Some of the responsibilities for this group include Egnyte’s Cloud File System, Object Store, Metadata Stores, Search Systems, Recommendations Systems, Synchronization, and intelligent caching of multi-petabyte datasets. We are looking for candidates with a shared passion for building large-scale distributed systems and a keen sense for tackling complexities that come with scaling through multiple orders of magnitude.

What You’ll Do (but is not limited to)

• Design and develop highly-scalable elastic cloud architecture that seamlessly integrates with on-premises systems
• Challenge and redefine existing architectural fundamentals in order to provide next level of performance and scalability; ability to foresee post-deployment design challenges, performance and scale bottlenecks
• Work with multicultural, geographically distributed teams and closely coordinate with cross-functional teams in multiple time zones.
• Deliver enterprise-grade products to customers and continuously work with engineering team to refine products in the field
• Mentor interns and junior engineers, collaborate with Operations, and work closely with CTO on roadmap items
• Extensive penetration testing to ensure security across a hybrid deployment between public/private cloud
• Monitor and manage 3,000+ nodes using modern DevOps tools and APM solutions
• Proactive performance and exception analysis

Your Qualifications

• 5+ years of relevant industry work Experience
• Demonstrated success designing and developing complex systems
• Expertise with multi-tenant, highly complex, cloud solutions
• Experience owning all aspects of software engineering, from design to implementation, QA and maintenance.
• Experience with the following technologies: Java, SQL, Linux, Python, HBase/BigTable
• Data driven decision process
• Relies on unit testing instead of manual QA
• Knowledge of DevOps techniques
• BS or MS degree in Computer Science or related field

Bonus Skills

• Experience with Hybrid and/or on-premises solutions 
• Experience in working with AWS or GCP
• Experience with the following technologies:, Nginx, Haproxy, BigQuery, New Relic, Graphite, and/or Puppet
• Security / Governance expertise

About Egnyte

In a content critical age, Egnyte fuels business growth by enabling content-rich business processes, while also providing organizations with visibility and control over their content assets. Egnyte’s cloud-native content services platform leverages the industry’s leading content intelligence engine to deliver a simple, secure, and vendor-neutral foundation for managing enterprise content across business applications and storage repositories. More than 16,000 customers trust Egnyte to enhance employee productivity, automate data management, and reduce file-sharing cost and complexity. Investors include Google Ventures, Kleiner Perkins, Caufield & Byers, and Goldman Sachs. For more information, visithttp://www.egnyte.com/"> http://www.egnyte.com/">www.egnyte.com

Senior Python Backend Developer 

Notice Period: 45 days / Immediate Joining

Banyan Data Services (BDS) is a US-based Infrastructure Services Company, headquartered in San Jose, California, USA. It provides full-stack managed services to support business applications and data infrastructure.  We are looking for a Senior Python Developer to join our development team based out of Bangalore. This teamwork on building the next-generation SAS application on the Hybrid Cloud platform.  

It's a once-in-a-lifetime opportunity to join our rocket ship startup run by a world-class executive team. We are looking for candidates that aspire to be a part of the cutting-edge solutions and services we offer that address next-gen data evolution challenges.  

Key Qualificatisons

· Ability to write high-quality code efficiently.

· Design and develop new services/micro-services.

· Participate in planning and management of development process.

· Share architectural design vision with both technical and non-technical team members, including fellow engineers.

· Works on improvements in development toolset including testing frameworks, deployment scripts, and monitoring libraries.

· Experience solving complex problems and implementing solutions for performance and scalability.

· Write clean, well-structured, and maintainable code with automated test coverage and corresponding documentation.

· Explore new latest relevant technology, techniques, frameworks, tools, methodologies, and processes.

· Comfortable working with all aspects of software development; including dev-ops, quality assurance, research, and design.

Requirements

· Minimum 3 years of experience as a Python Developer in application development.

· Experience in Developing applications/software using Python, developing web services using Django/Flask, working with REST API, and working with any databases technology.

· Strong in Reg expression and string handling.

· Strong in python programming and should be able to develop both API, UI, and backend validations.

· Integration of user-facing elements developed by front-end developers with server-side logic and Implementation of security and data protection.

· Experience in Developing applications, software using Python, developing web services using Django, Flask, working with REST API, and working with any databases technology.

· Worked on open-source tools for logging, monitoring, search engine, caching, etc.

· Exposure to any of relation database technologies MySQL/Postgres/Oracle or any No-SQL database.

· Experience working on DevOps tools for continuous integration.

· Performed App servers, application deployments, web server deployments.

· Design and implementation of low-latency, high-availability, and performant applications.

· Working knowledge of AWS, enough to be able to set up the environment for application development.

· Good good analytical and execution skills.

· Worked on open-source software for development, logging, monitoring, search engine, caching, etc.

http://www.banyandata.com" target="_blank">www.banyandata.com