Data Engineer

We are seeking a skilled Java Developer with hands-on experience in Java and Spark to build scalable data processing solutions. You'll contribute to high-performance data pipelines and analytics platforms in a dynamic Agile environment.

Key Responsibilities

• Design and develop Java applications integrated with Apache Spark for ETL processes, data transformations, and analytics.
• Build and optimize Spark jobs (Spark SQL, DataFrames, Streaming) for large-scale data processing.
• Collaborate with data engineers and analysts to implement robust data workflows.
• Write clean, maintainable Java code following best practices (Spring Boot, Microservices preferred).
• Perform code reviews, unit testing, and contribute to CI/CD pipelines.
• Troubleshoot and optimize Spark performance for production workloads.
• Document technical solutions and mentor junior developers.

Required Skills & Qualifications

• 4-7 years of hands-on Java development experience.
• Strong expertise in Apache Spark (Spark Core, Spark SQL, PySpark basics).
• Proficiency in Java 8/11+ with multithreading and collections frameworks.
• Experience with data processing (ETL, data pipelines, big data).
• Familiarity with build tools (Maven/Gradle) and version control (Git).
• Strong problem-solving skills and Bangalore location availability.
• Excellent communication skills for cross-team collaboration.

Good to Have

• Experience with Snowflake for cloud data warehousing.
• Knowledge of DBT (Data Build Tool) for analytics engineering.
• Python scripting for data manipulation and automation.
• Exposure to AWS/GCP/Azure cloud platforms.
• Familiarity with Kafka, Airflow, or containerization (Docker/Kubernetes).

Bachelor’s degree in computer science or other technical/scientific discipline

● Solid experience with cloud environments like Azure, GCP, AWS 

● Proficient with CI/CD tools such as CircleCI, Travis, Jenkins, Ansible, Terraform, Puppet, Chef 

● Strong expertise in Serverless architecture, Kubernetes cluster, and service mesh. 

● Strong hands-on experience with monitoring tools such as Prometheus 

● Ability to program with one or more high-level languages, such as Python, Java, Ruby, and JavaScript 

● Familiar with Git 

● Experience with performance monitoring and optimization. Ideally worked on large scale e-commerce projects 

10+ years of experience in web application design and development

• 10+ years experience with Ruby on Rails

• 5+ years of experience in Jenkins and must have an understanding of CI/CD pipelines

• Analyze, design, develop, and maintain scalable solutions.

• Participate in code review.

• Collaborate with design team to create customer friendly solutions.

• Work with the support team to fix any bugs that arise in code.

• Perform debugging and troubleshooting of existing code base. • Good knowledge of Dockers containers. • Experience with Git/GitHub/AWS DevOps. • Work within a wide range of new and legacy code and technologies in a mature codebase o Experience with React-o Experience with AWS Lambda

Nice to have: Experience with building integrations with 3rd party services/tools such as:o Experience with Sinatra Experience with WordPress, Drupal, Sitecore Experience with MongoDB

Requirements

• 3+ years work experience with production-grade python. Contribution to open source repos is preferred
• Experience writing concurrent and distributed programs, AWS lambda, Kubernetes, Docker, Spark is preferred.
• Experience with one relational & 1 non-relational DB is preferred
• Prior work in the ML domain will be a big boost

What You’ll Do

• Help realize the product vision: Production-ready machine learning models with monitoring within moments, not months.
• Help companies deploy their machine learning models at scale across a wide range of use-cases and sectors.
• Build integrations with other platforms to make it easy for our customers to use our product without changing their workflow.
• Write maintainable, scalable performant python code
• Building gRPC, rest API servers
• Working with Thrift, Protobufs, etc.

Experience:

The candidate should have about 2+ years of experience with design and development in Java/Scala. Experience in algorithm, data-structure, database and distributed System is mandatory.

Required Skills:

Mandatory: -

1. Core Java or Scala
2. Experience in Big Data, Spark
3. Extensive experience in developing spark job. Should possess good Oops knowledge and be aware of enterprise application design patterns.
4. Should have the ability to analyze, design, develop and test complexity of spark job.
5. Working knowledge of Unix/Linux.
6. Hands on experience in Spark, creating RDD, applying operation - transformation-action

Good To have: -

1. Python
2. Spark streaming
3. Py Spark
4. Azure/AWS Cloud Knowledge of Data Storage and Compute side

About Vymo

Vymo is a Sanfrancisco-based next-generation Sales productivity SaaS company with offices in 7 locations. Vymo is funded by top tier VC firms like Emergence Capital and Sequoia Capital. Vymo is a category creator, an intelligent Personal Sales Assistant who captures sales activities automatically, learns from top performers, and predicts ‘next best actions’ contextually. Vymo has 100,000 users in 60+ large enterprises such as AXA, Allianz, Generali.Vymo has seen 3x annual growth over the last few years and aspires to do even better this year by building up the team globally.

What is the Personal Sales Assistant

A game-changer! We thrive in the CRM space where every company is struggling to deliver meaningful engagement to their Sales teams and IT systems. Vymo was engineered with a mobile-first philosophy. The platform through AI/ML detects, predicts, and learns how to make Sales Representatives more productive through nudges and suggestions on a mobile device. Explore Vymo https://getvymo.com/">https://getvymo.com/

What you will do at Vymo

From young open source enthusiasts to experienced Googlers, this team develops products like Lead Management System, Intelligent Allocations & Route mapping, Intelligent Interventions, that help improve the effectiveness of the sales teams manifold. These products power the "Personal Assistant" app that automates the sales force activities, leveraging our cutting edge location based technology and intelligent routing algorithms.

A Day in your Life 

• Design, develop and maintain robust data platforms on top of Kafka, Spark, ES etc.
• Provide leadership to a group of engineers in an innovative and fast-paced environment.
• Manage and drive complex technical projects from the planning stage through execution.
  
  

What you would have done  

• B.E (or equivalent) in Computer Sciences
• 6-9 years of experience building enterprise class products/platforms.
• Knowledge of Big data systems and/or Data pipeline building experience is preferred.
• 2-3 years of relevant work experience as technical lead or technical management experience.
• Excellent coding skills in one of Core Java or NodeJS
• Demonstrated problem solving skills in previous roles.
• Good communication skills.

• Minimum 7 years of relevant work experience in similar roles.
• Hands-on experience developing and delivering scalable multi-tenant SaaS applications on AWS platform.
• In-depth knowledge of Spring, Spring Boot, Java, REST Web Services, SQL databases, microservices, GRAND stack, SQL and NoSQL databases.
• In-depth knowledge and experience developing and delivering scalable data lakes, data ingestion and processing pipelines, data access microservices.
• In-depth knowledge of AWS platform, tools and services, specifically AWS networking and security, Route53, API Gateway, ECS/Fargate, RDS; Java/Spring development; modern database and data processing technologies; DevOps; microservices architecture; container/Docker technology.
• Outstanding collaboration and communication skills. Ability to effectively collaborate with distributed team.
• Understand and practice agile development methodology.
• Prior experience working in a software product company.
• Prior experience with security product development.

Nice to Have:

• AWS Certified Developer certification is highly desired.
• Prior experience with Apache Spark and Scala.