Data Engineer (Pyspark Developer)

Egnyte is seeking an experienced Sr. Software Engineer to join our Software Engineering (Infrastructure) group. The Software Engineering (Infrastructure) group builds large distributed components and services that run Egnyte’s Cloud Platform. Our code serves billions of requests per day with sub-second latency in a fault-tolerant environment. Some of the responsibilities for this group include Egnyte’s Cloud File System, Object Store, Metadata Stores, Search Systems, Recommendations Systems, Synchronization, and intelligent caching of multi-petabyte datasets. We are looking for candidates with a shared passion for building large-scale distributed systems and a keen sense for tackling complexities that come with scaling through multiple orders of magnitude.

What You’ll Do (but is not limited to)

• Design and develop highly-scalable elastic cloud architecture that seamlessly integrates with on-premises systems
• Challenge and redefine existing architectural fundamentals in order to provide next level of performance and scalability; ability to foresee post-deployment design challenges, performance and scale bottlenecks
• Work with multicultural, geographically distributed teams and closely coordinate with cross-functional teams in multiple time zones.
• Deliver enterprise-grade products to customers and continuously work with engineering team to refine products in the field
• Mentor interns and junior engineers, collaborate with Operations, and work closely with CTO on roadmap items
• Extensive penetration testing to ensure security across a hybrid deployment between public/private cloud
• Monitor and manage 3,000+ nodes using modern DevOps tools and APM solutions
• Proactive performance and exception analysis

Your Qualifications

• 5+ years of relevant industry work Experience
• Demonstrated success designing and developing complex systems
• Expertise with multi-tenant, highly complex, cloud solutions
• Experience owning all aspects of software engineering, from design to implementation, QA and maintenance.
• Experience with the following technologies: Java, SQL, Linux, Python, HBase/BigTable
• Data driven decision process
• Relies on unit testing instead of manual QA
• Knowledge of DevOps techniques
• BS or MS degree in Computer Science or related field

Bonus Skills

• Experience with Hybrid and/or on-premises solutions 
• Experience in working with AWS or GCP
• Experience with the following technologies:, Nginx, Haproxy, BigQuery, New Relic, Graphite, and/or Puppet
• Security / Governance expertise

About Egnyte

In a content critical age, Egnyte fuels business growth by enabling content-rich business processes, while also providing organizations with visibility and control over their content assets. Egnyte’s cloud-native content services platform leverages the industry’s leading content intelligence engine to deliver a simple, secure, and vendor-neutral foundation for managing enterprise content across business applications and storage repositories. More than 16,000 customers trust Egnyte to enhance employee productivity, automate data management, and reduce file-sharing cost and complexity. Investors include Google Ventures, Kleiner Perkins, Caufield & Byers, and Goldman Sachs. For more information, visithttp://www.egnyte.com/"> http://www.egnyte.com/">www.egnyte.com

Job Overview:

We are seeking an experienced Senior Python Developer to join our dynamic team. The ideal candidate will have a strong background in Python development, with a focus on API development, integration, and experience in the deployment of machine learning pipelines. This is a crucial role in designing, implementing, and maintaining scalable and compliant Generative AI applications.

Must have:

• Expertise in programming languages - Python (primary), JavaScript, SQL, NodeJS
• Expertise in configuring and designing SQL and NoSQL databases (eg. Mongo)
• Expertise in API integration and APP serving frameworks (Flask, Django, FAST API)
• Experience in Schema definitions, parsing payload types (XSD/XML, JSON, Byte/Binary Encoded images,), etc.,
• Experience in User Authentication and Authorization frameworks and Active Directory Integration (SAML, OAuth, etc.,)
• Exposure to Large Language Models (LLMs) and Generative AI application development is a must.
• Experience working on Azure AI/ML stack is required.
• Familiarity with cloud platforms (e.g., AWS, Azure) and containerization (e.g., Docker).
• Solid understanding of software development best practices, including version control, code reviews, and testing.
• Lead code reviews, mentor junior developers, and provide technical guidance to the team.
• Strong communication and collaboration skills.
• Ability to work independently and lead technical initiatives.
• Familiarity with continuous integration and continuous deployment (CI/CD) pipelines.

Good to have:

• Previous experience with healthcare-related projects or HIPAA compliance is a plus.
• Experience with Django or Flask frameworks for web development.
• Knowledge of front-end technologies (HTML, CSS, JavaScript).

Qualifications:

• Bachelor's degree in Computer Science, Software Engineering, or related field.
• 6-8 years of proven experience as a Python Developer, with a strong focus on backend development.

Back-end developers design and enable code-based innovation in our suite of web-based platforms and databases. Together with the front-end development team output enabling a intuitive, highly functional and seamless experience that delights our users.

This opportunity will rely on your ability to develop backend code, create, edit, or manipulate platform databases, leverage an API based integration approach for platform development.

We are looking for:

• Prior experience designing and developing backend code in support of web applications and platforms
• Sound programming skills and logic
• Excellent team spirit: including daily engagement, strong communication skills and ability to easily collaborate with various stakeholders
• Excellent time-management skills and accountability for tasks on a daily, weekly and sprint basis

Skills Required:

• Sound knowledge and experience with backend technology such as Node, SQL, Python
• Understanding of secure API’s and the successful use in a commercial setting
• Understanding of JSON files, data manipulation techniques and products such as DataBricks
• Experience with Agile development efforts and Azure Dev/Ops tool

Key initial responsibilities:

• Design, develop, test and compile high quality code, data artifacts , processes, in support of the buildout of our platform and web applications
• Collaborating with Product Owners, Business Analysts, Designers and Front-end developers to establish and satisfy development objectives
• Foster innovation supporting new and existing programs, products, and features through a combination of thought leadership and emerging industry trends
• Reconciling data and reporting deliverables to internal and client teams
• Participating in continuing education and training to remain current on best practices, learn new programming languages, and better assist other team members.
• Taking lead on projects as needed.

We are a tech venture which provides Product Engineering, QA Automation, Infrastructure, Data, and Market Research services.

Technical Proficiency : 
Must have : 

• Strong development experience in Python in the environment of Unix/Linux/Ubuntu

• Strong practical knowledge of Python and its libraries.

• Current working experience with cloud deployment of AWS/Azure/GCP, Microservice architecture, and Docker in Python.

• Good knowledge of CI/CD and DevOps practices

• Good Experience of Python with Django/ Scrapy/ Flask frameworks.

• Good Experience in Jupyter/ Docker/ Elastic Search, etc.

• Solid understanding of software development principles and best practices.

• Strong analytical thinking and problem-solving skills.

• Proven ability to drive large-scale projects with a deep understanding of Agile SDLC, high collaboration, and leadership.
  
  Good to have : 

• Expected to have migration experience from one version to the other, as this project is about migration to the latest version.

• Preferred if had an OpenEdx platform experience or any LMS platform. 

   

Synapsica is a growth stage HealthTech startup founded by alumni from IIT Kharagpur, AIIMS New Delhi, and IIM Ahmedabad. We believe healthcare needs to be transparent and objective, while being affordable. Every patient has the right to know exactly what is happening in their bodies and they don’t have to rely on cryptic 2 liners given to them as diagnosis.

Towards this aim, we are building an artificial intelligence enabled cloud based platform to analyze medical images and create 2.0 of advanced radiologist reporting.

We are backed by YCombinator and other marquee investors from India, US and Japan. We are proud to have GE, AIIMS, the Spinal Kinetics as our partners.

Join us, if you find this as exciting as we do!

Description:

Synapsica is looking for a Node.js/Python developer who is passionate about designing and implementing scalable solutions with highest quality. You will be responsible for creating high performance, responsive, and secure server-side programs to manage Synapsica platform. You will be responsible for designing, managing and supporting cloud platform and scaling our database. This role is ideal for you if you have a background in bakcned development and are looking for the next level of career growth in a fast paced, learning based and merit driven work environment.

Responsibilities:
- Design and development of our new platform modules from scratch. 
- Hands on implementation of our APIs and integrations. 
- Design, scaling and integration of new/existing databases.
- Ensuring the entire stack is designed and built for speed and scalability
- Design and construction of our REST APIs with best secutiry mechanisms.
- Design and implementation of continuous integration and deployment pipelines in tandem with the respective team members.
- Performance tuning and improvements in large scale systems.
- Ensuring responsiveness and cross-platform compatibility of applications.
- Owning and delivering end-to-end products, features, enhancements.

Requirements:
- Degree in Computer Science or related discipline with strong competencies in data structures, algorithms, and software design
- At least 4+ years of experience with writing Python/NodeJS/PHP/Ruby on Rails. 
- Prior experience of database design and management in MongoDB, including being up on the latest practices and associated versions.
- Experience in building highly scalable business applications, which involve implementing large complex business flows and dealing with huge amount of data.
- Familiarity with AWS (or equivalent) ecosystem with end-to-end cloud deployment.
- Experience implementing code level unit tests.
- Proficiency with Git / Version control.
- Appreciation for clean and well documented code
- Excellent verbal communication skills.
- Good problem solving skills.
- Attention to detail.
- Very high sense of ownership.
- Deep interest and passion for technology

• Design, develop, implement, and maintain scala application phases, code, and software.
• Conduct software analysis, programming, testing, and debugging, as well as recommending changes to improve the established processes.

You’ll be our: Application Developer 

You’ll be based at: IBC Knowledge Park, Bengaluru

You’ll be Aligned with: Application Development Lead 

You’ll be the member of:VehicleSoftware Team 

What you’ll do at Ather:

• You will be developing the various Applications for the cloud to process data connecting with the vehicle 

• You shall work with the Lead and product team to define and deliver features. 

• Be part of the Agile team, to define Sprint work content definition. 

• Work with cross functional teams to drive overall feature delivery. 

• Be part of the initiatives that achieve the functional requirements of the team. Explore technical feasibility of solutions, propose and evaluate tech stacks. 

• Performance tuning and benchmarking of the features 

Here’s what we are looking for: 

• Strong knowledge and Hands on experience with Nodejs, RestAPI, Java Script, Java Development experience in cloud based infrastructure 

• Strong fundamentals in any fullstack of your choice, OOPS concepts, Google Cloud Platform. Knowledge of Java, React, React Native, Android Native , HTML5, Firebase and Go Programming is a plus. 

• Knowledge on CI/CD pipelines, JIRA, UML, Static Code Analysis tools and Unit test framework is required 

• Knowledge on the S/W communication protocols like gRPC, HTTP, MQTT is a plus Cross platform development experience would be needed. 

• Knowledge of Cloud Based solutions would be a plus. 

• App development for a product which is beyond a mobile platform would be a plus. Experience with Telematics/Infotainment projects would be a great advantage. 

• Strong experience with Agile methodology, along with tools such as JIRA, Confluence. 

• Flashing and debugging tools experience is a plus.

You bring to Ather: 

• Bachelor’s/Master’s in computer science or any other equivalent degree

Data Platform engineering at Uber is looking for a strong Technical Lead (Level 5a Engineer) who has built high quality platforms and services that can operate at scale. 5a Engineer at Uber exhibits following qualities: 

• Demonstrate tech expertise › Demonstrate technical skills to go very deep or broad in solving classes of problems or creating broadly leverageable solutions. 
• Execute large scale projects › Define, plan and execute complex and impactful projects. You communicate the vision to peers and stakeholders.
• Collaborate across teams › Domain resource to engineers outside your team and help them leverage the right solutions. Facilitate technical discussions and drive to a consensus.
• Coach engineers › Coach and mentor less experienced engineers and deeply invest in their learning and success. You give and solicit feedback, both positive and negative, to others you work with to help improve the entire team.
• Tech leadership › Lead the effort to define the best practices in your immediate team, and help the broader organization establish better technical or business processes.

What You’ll Do

• Build a scalable, reliable, operable and performant data analytics platform for Uber’s engineers, data scientists, products and operations teams.
• Work alongside the pioneers of big data systems such as Hive, Yarn, Spark, Presto, Kafka, Flink to build out a highly reliable, performant, easy to use software system for Uber’s planet scale of data. 
• Become proficient of multi-tenancy, resource isolation, abuse prevention, self-serve debuggability aspects of a high performant, large scale, service while building these capabilities for Uber's engineers and operation folks.

What You’ll Need

• 7+ years experience in building large scale products, distributed systems in a high caliber environment.
• Architecture: Identify and solve major architectural problems by going deep in your field or broad across different teams. Extend, improve, or, when needed, build solutions to address architectural gaps or technical debt.
• Software Engineering/Programming: Create frameworks and abstractions that are reliable and reusable. advanced knowledge of at least one programming language, and are happy to learn more. Our core languages are Java, Python, Go, and Scala.
• Platform Engineering: Solid understanding of distributed systems and operating systems fundamentals such as concurrency, multithreading, file systems, locking etc.
• Execution & Results: You tackle large technical projects/problems that are not clearly defined. You anticipate roadblocks and have strategies to de-risk timelines. You orchestrate work that spans multiple teams and keep your stakeholders informed.
• A team player: You believe that you can achieve more on a team that the whole is greater than the sum of its parts. You rely on others’ candid feedback for continuous improvement.
• Business acumen: You understand requirements beyond the written word. Whether you’re working on an API used by other developers, an internal tool consumed by our operation teams, or a feature used by millions of customers, your attention to details leads to a delightful user experience.