Data Engineer (Pyspark Developer)

Job Summary:

We are seeking a skilled DevOps Engineer to join our dynamic team. The ideal candidate will be responsible for managing, maintaining, and troubleshooting Rancher clusters, with a strong emphasis on Kubernetes operations. This role requires expertise in automation through shell scripting and proficiency in configuration management tools like Puppet and Ansible. Candidates should be highly self-motivated, capable of working on a rotating schedule, and committed to owning tasks through to delivery.

Key Responsibilities:

• Set up, operate, and maintain Rancher and Kubernetes (K8s) clusters, including on bare-metal environments.
• Perform upgrades and manage the lifecycle of Rancher clusters.
• Troubleshoot and resolve Rancher cluster issues efficiently.
• Write, maintain, and optimize shell scripts to automate Kubernetes-related tasks.
• Work collaboratively with the team to implement best practices for system automation and orchestration.
• Utilize configuration management tools like Puppet and Ansible (preferred but not mandatory).
• Participate in a rotating schedule, with the ability to work until 1 AM as required.
• Take ownership of tasks, ensuring timely delivery with high-quality standards.

Key Requirements:

• Strong expertise in Rancher and Kubernetes operations and maintenance.
• Experience in setting up and managing Kubernetes clusters on bare-metal systems is highly desirable.
• Proficiency in shell scripting for task automation.
• Familiarity with configuration management tools like Puppet and Ansible (good to have).
• Strong troubleshooting skills for Kubernetes and Rancher environments.
• Ability to work effectively in a rotating schedule and flexible hours.
• Strong ownership mindset and accountability for deliverables.

Skills Required:

- 4+ years of technical experience in a developer role

- Strong proficiency with Core Java

- Database experience preferably with DB2, Sybase, or Oracle

- Complete SDLC process and Agile Methodology (Scrum)

- Strong oral and written communication skills

- Excellent interpersonal skills and professional approach

- Bachelor’s degree in Computer Science, MIS, or other technology/engineering discipline

Skill Desired:

-Strong proficiency with Scala on Spark

- Previous experience in front office and back office reports

- Strong understanding Order Life Cycle management from Equities or Listed derivatives perspective

- Previous experience in Trade Surveillance or working with data from the order lifecycle

- Good to have knowledge on Hadoop Technologies

- High quality software architecture and design methodologies and patterns

- Work experience as level-3 support for applications

- Layered Architecture, Component based Architecture

- XML-based technologies

- Unix OS, Scripting, Python or Perl

- Experience in development on other application types (Web applications, batch, or streaming)

Senior .NET Cloud (Azure) Practitioner

Job Description Experience: 5-12 years (approx.)

Education: B-Tech/MCA

Mandatory Skills

• Strong Restful API, Micro-services development experience using ASP.NET CORE Web APIs (C#);
• Must have exceptionally good software design and programming skills in .Net Core (.NET 3.X, .NET 6) Platform, C#, ASP.net MVC, ASP.net Web API (RESTful), Entity Framework & LINQ
• Good working knowledge on Azure Functions, Docker, and containers
• Expertise in Microsoft Azure Platform - Azure Functions, Application Gateway, API Management, Redis Cache, App Services, Azure Kubernetes, CosmosDB, Azure Search, Azure Service Bus, Function Apps, Azure Storage Accounts, Azure KeyVault, Azure Log Analytics, Azure Active Directory, Application Insights, Azure SQL Database, Azure IoT, Azure Event Hubs, Azure Data Factory, Virtual Networks and networking.
• Strong SQL Server expertise and familiarity with Azure Cosmos DB, Azure (Blob, Table, queue) storage, Azure SQL etc
• Experienced in Test-Driven Development, unit testing libraries, testing frameworks.
• Good knowledge of Object Oriented programming, including Design Patterns
• Cloud Architecture - Technical knowledge and implementation experience using common cloud architecture, enabling components, and deployment platforms.
• Excellent written and oral communication skills, along with the proven ability to work as a team with other disciplines outside of engineering are a must
• Solid analytical, problem-solving and troubleshooting skills

Desirable Skills:

• Certified Azure Solution Architect Expert
• https://ind01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcloudacademy.com%2Flearning-paths%2Faz-900-exam-preparation-microsoft-azure-fundamentals-524%2F&;data=05%7C01%7C%7Ce2e481ab8ccc4c589ba408dad36c9f29%7Ce9cb3c8041564c39a7fe68fe427a3d46%7C1%7C0%7C638054760717910671%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=TmO1fonUFFgb8LzUJHbL8IyOdQeUKdw6xHMM2asosiw%3D&reserved=0" target="_blank">Microsoft Certified: Azure – Fundamentals Exam AZ-900
• https://ind01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcloudacademy.com%2Flearning-paths%2Faz-104-exam-preparation-microsoft-azure-administrator-1-1332%2F&;data=05%7C01%7C%7Ce2e481ab8ccc4c589ba408dad36c9f29%7Ce9cb3c8041564c39a7fe68fe427a3d46%7C1%7C0%7C638054760718066923%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=EQPg%2FXxTdiYUCKCAvItXy6TY89udGTIehQ0m9irkGRk%3D&reserved=0" target="_blank">Microsoft Certified: Azure Administrator – Associate Exam AZ-104
• https://ind01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcloudacademy.com%2Flearning-paths%2Faz-204-exam-preparation-developing-solutions-for-microsoft-azure-1208%2F&;data=05%7C01%7C%7Ce2e481ab8ccc4c589ba408dad36c9f29%7Ce9cb3c8041564c39a7fe68fe427a3d46%7C1%7C0%7C638054760718066923%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=%2BnosXa4TdBUG4jrqP%2B0%2FOikDbQMBNqzuDpvGoUk0IE8%3D&reserved=0" target="_blank">Microsoft Certified: Azure Developer – Associate Exam AZ-204
• https://ind01.safelinks.protection.outlook.com/?url=https%3A%2F%2Facloudguru.com%2Fblog%2Fengineering%2Fwhich-azure-certification-is-right-for-me%23devops-engineer&;data=05%7C01%7C%7Ce2e481ab8ccc4c589ba408dad36c9f29%7Ce9cb3c8041564c39a7fe68fe427a3d46%7C1%7C0%7C638054760718066923%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=NZyP%2F3Euh1SkHfB7896ovm0HDt0vA8UgfHUvTBN4SPM%3D&reserved=0" target="_blank">Microsoft Certified: DevOps Engineer Expert (AZ-400)
• https://ind01.safelinks.protection.outlook.com/?url=https%3A%2F%2Facloudguru.com%2Fblog%2Fengineering%2Fwhich-azure-certification-is-right-for-me%23solutions-architect&;data=05%7C01%7C%7Ce2e481ab8ccc4c589ba408dad36c9f29%7Ce9cb3c8041564c39a7fe68fe427a3d46%7C1%7C0%7C638054760718066923%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=0infaLzjjPThGGkzwu50jJXikppcC8trnsLGtAoB7S4%3D&reserved=0" target="_blank">Microsoft Certified: Azure Solutions Architect Expert (AZ-305)
• Good understanding of software architecture, scalability, resilience, performance;
• Working knowledge of automation tools such as Azure DevOps, Azure Pipeline or Jenkins or similar

Roles & Responsibilities

• Defining best practices & standards for usage of libraries, frameworks and other tools being used;
• Architecture, design, and implementation of software from development, delivery, and releases.
• Breakdown complex requirements into independent architectural components, modules, tasks and strategies and collaborate with peer leadership through the full software development lifecycle to deliver top quality, on time and within budget.
• Demonstrate excellent communications with stakeholders regarding delivery goals, objectives, deliverables, plans and status throughout the software development lifecycle.
• Should be able to work with various stakeholders (Architects/Product Owners/Leadership) as well as team - Lead/ Principal/ Individual Contributor for Web UI/ Front End Development;
• Should be able to work in an agile, dynamic team environment;

Experience:

The candidate should have about 2+ years of experience with design and development in Java/Scala. Experience in algorithm, data-structure, database and distributed System is mandatory.

Required Skills:

Mandatory: -

1. Core Java or Scala
2. Experience in Big Data, Spark
3. Extensive experience in developing spark job. Should possess good Oops knowledge and be aware of enterprise application design patterns.
4. Should have the ability to analyze, design, develop and test complexity of spark job.
5. Working knowledge of Unix/Linux.
6. Hands on experience in Spark, creating RDD, applying operation - transformation-action

Good To have: -

1. Python
2. Spark streaming
3. Py Spark
4. Azure/AWS Cloud Knowledge of Data Storage and Compute side

Senior Python Backend Developer 

Notice Period: 45 days / Immediate Joining

Banyan Data Services (BDS) is a US-based Infrastructure Services Company, headquartered in San Jose, California, USA. It provides full-stack managed services to support business applications and data infrastructure.  We are looking for a Senior Python Developer to join our development team based out of Bangalore. This teamwork on building the next-generation SAS application on the Hybrid Cloud platform.  

It's a once-in-a-lifetime opportunity to join our rocket ship startup run by a world-class executive team. We are looking for candidates that aspire to be a part of the cutting-edge solutions and services we offer that address next-gen data evolution challenges.  

Key Qualificatisons

· Ability to write high-quality code efficiently.

· Design and develop new services/micro-services.

· Participate in planning and management of development process.

· Share architectural design vision with both technical and non-technical team members, including fellow engineers.

· Works on improvements in development toolset including testing frameworks, deployment scripts, and monitoring libraries.

· Experience solving complex problems and implementing solutions for performance and scalability.

· Write clean, well-structured, and maintainable code with automated test coverage and corresponding documentation.

· Explore new latest relevant technology, techniques, frameworks, tools, methodologies, and processes.

· Comfortable working with all aspects of software development; including dev-ops, quality assurance, research, and design.

Requirements

· Minimum 3 years of experience as a Python Developer in application development.

· Experience in Developing applications/software using Python, developing web services using Django/Flask, working with REST API, and working with any databases technology.

· Strong in Reg expression and string handling.

· Strong in python programming and should be able to develop both API, UI, and backend validations.

· Integration of user-facing elements developed by front-end developers with server-side logic and Implementation of security and data protection.

· Experience in Developing applications, software using Python, developing web services using Django, Flask, working with REST API, and working with any databases technology.

· Worked on open-source tools for logging, monitoring, search engine, caching, etc.

· Exposure to any of relation database technologies MySQL/Postgres/Oracle or any No-SQL database.

· Experience working on DevOps tools for continuous integration.

· Performed App servers, application deployments, web server deployments.

· Design and implementation of low-latency, high-availability, and performant applications.

· Working knowledge of AWS, enough to be able to set up the environment for application development.

· Good good analytical and execution skills.

· Worked on open-source software for development, logging, monitoring, search engine, caching, etc.

http://www.banyandata.com" target="_blank">www.banyandata.com 

We are hiring for a Software Engineer Team Lead - Backend, to join our education-focused fintech lending startup, GrayQuest. Our core product is a combination of a lending product, a rewards product and an insurance product to redefine the education fees payment across the country.

• Participate in all stages of the Software Development Lifecycle
• Develop back-end components, services, and APIs. Support integration of user-facing elements, and collaborate closely with the design and front-end development team.
• Write elegant, effective, and scalable code while maintaining the highest level of coding standards.
• Take complete ownership of projects and ensure timely deliveries
• Ability to debug, refine, review, and deploy code
• Work closely with the QA team to test, and document project features.
• Ability to interact with all stakeholders. Understand business requirements, and effectively convert them into technical specifications
• Mentor junior developers and participate in peer Review

Requirements:

• Demonstrable experience as a Python Developer (3+ years)
• Strong knowledge of Python frameworks (Django Rest, Flask)
• Experience working on REST APIs
• Strong knowledge of SQL and JavaScript
• Experience with Amazon Web Services (AWS)
• Working knowledge of React
• Familiarity with Agile development methodology
• Good understanding of task breakup, milestone definition, and work delegation.
• Past experience of working in a fintech/financial services domain or a consumer internet startup will be preferable but not required
• Work experience in early-stage startups (0 ->1) is a big plus
• Bachelors or equivalent degree from premier institutes is a plus
• Most importantly, the biggest skill we look for our prospective candidates is "Learnability" - how quickly can you learn. 

Why is this a great opportunity for the right candidate:

1. Work with a young dynamic core team backed by marquee investors from the financial services space
2. Work on a product/business that has achieved product market fit and take it to scale
3. Equity compensation and competitive market salaries
4. Work environment that prioritizes talent, hustle and dedication
   
   

We will also ensure we give a preference to applicants who directly email us with their background/context and why they think they should be a strong candidate for this position at GrayQuest. Email us at work (at the rate) grayquest (dot) com and cc Sonal (at the rate)grayquest (dot) com

Responsibilities:

• Your primary responsibility as a senior backend engineer will be to architect and develop a scalable and robust micro-services backend with strong Java, Spring(Boot), SQL, AWS/GCP.
• Experience being part of a software development team in an Agile/Lean/Continuous Delivery environment
• Be a key performer in a high-performance product engineering team

Qualifications:

• 2 to 4 years of overall IT experience. Most of this experience in Java (Core Java, Spring boot, Java collections, Java Multithreading)
• Should have experience designing database schemas - SQL and NoSQL.
• Exposure to frameworks like Spring, Hibernate, Play would be a plus
• Experience with microservices architecture would be beneficial.
• Working knowledge of any public cloud (AWS, GCP or Azure)
• Broad understanding and experience of real-time analytics, NoSQL data stores, data modeling and data management, analytical tools, languages, or libraries
• Knowledge of container tech like Docker, Kubernetes would be a plus.
• Bachelor's Degree in Computer Science or Engineering.

Role- Full time
Experience Level- 8 to 13 Years
Job Location- Hyderabad
Key Responsibilities :

Serves as a technical point of contact within the organization by:

Influencing the product requirements, behaviour and design (Automation Platform)

Driving early adoption of technology, features and best practices around product development

Lead development at all layers GUI, Backend ( DevOps Tools API integration) & DB

Work with a team of developers and testers in a highly agile environment to produce high-quality software.

Design and developing house tools. Also, expected to demonstrate new ideas through prototypes/Proof of Concepts.

Evaluate and Assess newer technologies/architecture for product development

Keeping up to date with emerging technologies/tools in DevOps Space and developments trends to assess the impact of the projects.

Must have:

Should possess Bachelors/Masters/ PhD in computer science with a minimum of 8+ years of experience

Should possess a minimum of 3 years of experience in Products/Tools Development

Should possess expertise in using various DevOps tools libraries and API's (Jenkins/JIRA/AWX/Nexus/GitHub/BitBucket/ SonarQube)

Experience in designing and developing products, tools or test automation frameworks using Java or Python technologies.

Should have a strong understanding of OOPs, SDLC (Agile Safe standards), STLC

Proficient in Python, with a good knowledge of its ecosystems (IDEs and Frameworks)

Familiar with designing and developing applications using AngularJS, HTML5, Bootstrap, NodeJS, MongoDB, etc.

Experience in implementing, consuming and testing Web services Rest APIs would be an added advantage.

Experience working as a Full-Stack developer would be an added advantage

Regards,
Talent Acquisition Team