Spark Scala Developer

Key Responsibilities

• Provide technical leadership in the design, development, and delivery of scalable, high-performance software systems.
• Partner with product managers, architects, and cross-functional teams to define technical strategy and ensure alignment with business objectives.
• Lead by example in writing high-quality, testable, and maintainable code.
• Drive best practices in software engineering, including code reviews, system design, and performance optimization.
• Mentor and guide engineers across teams, fostering a culture of technical excellence and continuous learning.
• Evaluate and introduce new technologies, tools, and frameworks to improve productivity, scale and system robustness.

Required Skills & Qualifications

• Strong foundation in computer science fundamentals: data structures, algorithms, and functional programming techniques.
• Expertise in Scala, with strong preference for functional programming.
• Solid experience in software design, implementation, and debugging, including inter-process communication and multi-threading.
• Hands-on experience with distributed systems and event-driven architectures.
• Familiarity with databases (Postgres preferred).
• Proficiency with Apache Kafka for messaging and persistence.
• Working knowledge of Python for unit and integration testing.
• Basic to intermediate experience with Ansible for automation.
• Strong problem-solving, analytical, and communication skills.

Nice-to-Have / Bonus Skills

• Experience with modeling in YANG.
• Experience with Scala libraries such as Cats Effect (2/3), Monix, and Akka.
• Experience working in Agile/Scrum environments.

What We Offer

• Opportunity to work on cutting-edge technologies in a collaborative environment.
• A role with strong ownership, technical influence, and visibility across teams.
• Competitive compensation and benefits.

Basic Qualifications

Candidates for this role must have:

• Bachelor’s degree in computer science or a related field
• At least three years of experience writing production code of increasing complexity
• Strong understanding of computer science fundamentals, including algorithms, complexity analysis, data structures, problem solving, and object-oriented analysis and design
• Proficiency in at least one of the following: Java, C, C++, C#, Ruby, Scala, Python
• Experience refactoring code and evolving architectures
• Experience crafting unit, integration, functional and regression tests

 Preferred Qualifications

• Master’s degree in computer science or a related field
• Experience developing in a Linux environment
• Experience applying service-oriented architecture techniques to production use cases
• Experience in developing secure, multi-platform mobile applications

Be Part Of Building The Future

Dremio is the Data Lake Engine company. Our mission is to reshape the world of analytics to deliver on the promise of data with a fundamentally new architecture, purpose-built for the exploding trend towards cloud data lake storage such as AWS S3 and Microsoft ADLS. We dramatically reduce and even eliminate the need for the complex and expensive workarounds that have been in use for decades, such as data warehouses (whether on-premise or cloud-native), structural data prep, ETL, cubes, and extracts. We do this by enabling lightning-fast queries directly against data lake storage, combined with full self-service for data users and full governance and control for IT. The results for enterprises are extremely compelling: 100X faster time to insight; 10X greater efficiency; zero data copies; and game-changing simplicity. And equally compelling is the market opportunity for Dremio, as we are well on our way to disrupting a $25BN+ market.

About the Role

The Dremio India team owns the DataLake Engine along with Cloud Infrastructure and services that power it. With focus on next generation data analytics supporting modern table formats like Iceberg, Deltalake, and open source initiatives such as Apache Arrow, Project Nessie and hybrid-cloud infrastructure, this team provides various opportunities to learn, deliver, and grow in career. We are looking for innovative minds with experience in leading and building high quality distributed systems at massive scale and solving complex problems.

Responsibilities & ownership

• Lead, build, deliver and ensure customer success of next-generation features related to scalability, reliability, robustness, usability, security, and performance of the product.
• Work on distributed systems for data processing with efficient protocols and communication, locking and consensus, schedulers, resource management, low latency access to distributed storage, auto scaling, and self healing.
• Understand and reason about concurrency and parallelization to deliver scalability and performance in a multithreaded and distributed environment.
• Lead the team to solve complex and unknown problems 
• Solve technical problems and customer issues with technical expertise
• Design and deliver architectures that run optimally on public clouds like  GCP, AWS, and Azure
• Mentor other team members for high quality and design 
• Collaborate with Product Management to deliver on customer requirements and innovation
• Collaborate with Support and field teams to ensure that customers are successful with Dremio

Requirements

• B.S./M.S/Equivalent in Computer Science or a related technical field or equivalent experience
• Fluency in Java/C++ with 8+ years of experience developing production-level software
• Strong foundation in data structures, algorithms, multi-threaded and asynchronous programming models, and their use in developing distributed and scalable systems
• 5+ years experience in developing complex and scalable distributed systems and delivering, deploying, and managing microservices successfully
• Hands-on experience  in query processing or optimization, distributed systems, concurrency control, data replication, code generation, networking, and storage systems
• Passion for quality, zero downtime upgrades, availability, resiliency, and uptime of the platform
• Passion for learning and delivering using latest technologies
• Ability to solve ambiguous, unexplored, and cross-team problems effectively
• Hands on experience of working projects on AWS, Azure, and Google Cloud Platform 
• Experience with containers and Kubernetes for orchestration and container management in private and public clouds (AWS, Azure, and Google Cloud) 
• Understanding of distributed file systems such as  S3, ADLS, or HDFS
• Excellent communication skills and affinity for collaboration and teamwork
• Ability to work individually and collaboratively with other team members
• Ability to scope and plan solution for  big problems and mentors others on the same
• Interested and motivated to be part of a fast-moving startup with a fun and accomplished team

About Vymo

Vymo is a Sanfrancisco-based next-generation Sales productivity SaaS company with offices in 7 locations. Vymo is funded by top tier VC firms like Emergence Capital and Sequoia Capital. Vymo is a category creator, an intelligent Personal Sales Assistant who captures sales activities automatically, learns from top performers, and predicts ‘next best actions’ contextually. Vymo has 100,000 users in 60+ large enterprises such as AXA, Allianz, Generali.Vymo has seen 3x annual growth over the last few years and aspires to do even better this year by building up the team globally.

What is the Personal Sales Assistant

A game-changer! We thrive in the CRM space where every company is struggling to deliver meaningful engagement to their Sales teams and IT systems. Vymo was engineered with a mobile-first philosophy. The platform through AI/ML detects, predicts, and learns how to make Sales Representatives more productive through nudges and suggestions on a mobile device. Explore Vymo https://getvymo.com/">https://getvymo.com/

What you will do at Vymo

From young open source enthusiasts to experienced Googlers, this team develops products like Lead Management System, Intelligent Allocations & Route mapping, Intelligent Interventions, that help improve the effectiveness of the sales teams manifold. These products power the "Personal Assistant" app that automates the sales force activities, leveraging our cutting edge location based technology and intelligent routing algorithms.

A Day in your Life 

• Design, develop and maintain robust data platforms on top of Kafka, Spark, ES etc.
• Provide leadership to a group of engineers in an innovative and fast-paced environment.
• Manage and drive complex technical projects from the planning stage through execution.
  
  

What you would have done  

• B.E (or equivalent) in Computer Sciences
• 6-9 years of experience building enterprise class products/platforms.
• Knowledge of Big data systems and/or Data pipeline building experience is preferred.
• 2-3 years of relevant work experience as technical lead or technical management experience.
• Excellent coding skills in one of Core Java or NodeJS
• Demonstrated problem solving skills in previous roles.
• Good communication skills.

Requirements:

• Academic degree (BE / MCA) with 3-10 years of experience in back-end Development.
• Strong knowledge of OOPS concepts, Analyzing, Designing, Development and Unit testing
• Scala technologies, AKKA, REST Webservices, SOAP, Jackson JSON API, JUnit, Mockito, Maven
• Hands-on experience with Play framework
• Familiarity with Microservice Architecture
• Experience working with Apache Tomcat server or TomEE
• Experience working with SQL databases (MySQL, PostgreSQL, Cassandra), writing custom queries, procedures, and designing schemas.
• Good to have front end experience (JavaScript, Angular JS/ React JS)