Data Engineer

Must have experience in Java

Must have experience in Spark

Must have experience in ETL coding

Strong expertise in coding

Role & Responsibilities:

We are seeking a Software Developer with 2-10 year’s experience with strong foundations in Python, databases, and AI technologies. The ideal candidate will support the development of AI-powered solutions, focusing on LLM integration, prompt engineering, and database-driven workflows. This is a hands-on role with opportunities to learn and grow into advanced AI engineering responsibilities.

Key Responsibilities

• Develop, test, and maintain Python-based applications and APIs.

• Design and optimize prompts for Large Language Models (LLMs) to improve accuracy and performance.

• Work with JSON-based data structures for request/response handling. • Integrate and manage PostgreSQL (pgSQL) databases, including writing queries and handling data pipelines.

• Collaborate with the product and AI teams to implement new features. • Debug, troubleshoot, and optimize performance of applications and workflows.

• Stay updated on advancements in LLMs, AI frameworks, and generative AI tools.

Required Skills & Qualifications

• Strong knowledge of Python (scripting, APIs, data handling).

• Basic understanding of Large Language Models (LLMs) and prompt engineering techniques.

• Experience with JSON data parsing and transformations.

• Familiarity with PostgreSQL or other relational databases.

• Ability to write clean, maintainable, and well-documented code.

• Strong problem-solving skills and eagerness to learn.

• Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent practical experience).

Nice-to-Have (Preferred)

• Exposure to AI/ML frameworks (e.g., LangChain, Hugging Face, OpenAI APIs).

• Experience working in startups or fast-paced environments.

• Familiarity with version control (Git/GitHub) and cloud platforms (AWS, GCP, or Azure).

What We Offer

• The opportunity to define the future of GovTech through AI-powered solutions.

• A strategic leadership role in a fast-scaling startup with direct impact on product direction and market success.

• Collaborative and innovative environment with cross-functional exposure.

• Growth opportunities backed by a strong leadership team.

• Remote flexibility and work-life balance.

Level of skills and experience:

5 years of hands-on experience in using Python, Spark,Sql.

Experienced in AWS Cloud usage and management.

Experience with Databricks (Lakehouse, ML, Unity Catalog, MLflow).

Experience using various ML models and frameworks such as XGBoost, Lightgbm, Torch.

Experience with orchestrators such as Airflow and Kubeflow.

Familiarity with containerization and orchestration technologies (e.g., Docker, Kubernetes).

Fundamental understanding of Parquet, Delta Lake and other data file formats.

Proficiency on an IaC tool such as Terraform, CDK or CloudFormation.

Strong written and verbal English communication skill and proficient in communication with non-technical stakeholderst

• Bachelor's or Master’s degree in Computer Science or equivalent area
• 10 to 20 years of experience in software development
• Hands-on experience designing and building B2B or B2C products
• 3+ years architecting SaaS/Web based customer facing products, leading engineering teams as software/technical architect
• Experiences of engineering practices such as code refactoring, microservices, design and enterprise integration patterns, test and design-driven development, continuous integration, building highly scalable applications, application and infrastructure security
• Strong cloud infrastructure experience with AWS and/or Azure
• Experience building event driven systems and working with message queues/topics
• Broad working experience across multiple programming languages and frameworks with in-depth experience in one or more of the following: .Net, Java, Scala or Go-lang
• Hands-on experience with relational databases like SQL Server, PostgreSQL and document stores like Elasticsearch or MongoDB
• Hands-on experience with Big Data processing technologies like Hadoop/Spark is a plus
• Hands-on experience with container technologies like Docker, Kubernetes
• Knowledge of Agile software development process

Project Overview: We are looking for expert level Postgres database developer to work on a software application development project for a fortune 500 US based telecom client. The application is web based and used across multiple teams to support their business processes. The developer will be responsible for developing various components of the Postgres database and for light administration of the database.

Key Responsibilities: Collaborate with onshore, offshore and other team members to understand the user stories and develop code. Develop and execute scripts to unit test. Collaborate with onshore developers, product owner and the client team to perform work in an integrated manner.

Professional Attributes: Should have the ability to work independently and seek guidance as and when necessary - Should have good communication skills - Flexible working in different time zones if necessary - Good team player - Mentoring juniors

Experience preferred:

• Extensive experience in Postgres database development (expert level)
• Experience in Postgres administration.
• Must have working experience with GIS data functionality
• Experience handling large datasets (50-100M tables)
• Preferred – exposure to Azure or AWS
• Must have skillsets for database performance tuning
• Familiarity with web applications
• Ability to work independently with minimal oversight
• Experience working cohesively in integrated teams
• Good interpersonal, communication, documentation and presentation skills.
• Prior experience working in agile environments
• Ability to communicate effectively both orally and in writing with clients, Business Analysts and Developers
• Strong analytical, problem-solving and conceptual skills
• Excellent organizational skills; attention to detail
• Ability to resolve project issues effectively and efficiently
• Ability to prioritize workload and consistently meet deadlines
• Experience working with onshore-offshore model

• Bachelor’s or master’s degree in Computer Engineering, Computer Science, Computer Applications, Mathematics, Statistics, or related technical field. Relevant experience of at least 3 years in lieu of above if from a different stream of education.

• Well-versed in and 3+ hands-on demonstrable experience with: ▪ Stream & Batch Big Data Pipeline Processing using Apache Spark and/or Apache Flink.
  ▪ Distributed Cloud Native Computing including Server less Functions
  ▪ Relational, Object Store, Document, Graph, etc. Database Design & Implementation
  ▪ Micro services Architecture, API Modeling, Design, & Programming

• 3+ years of hands-on development experience in Apache Spark using Scala and/or Java.

• Ability to write executable code for Services using Spark RDD, Spark SQL, Structured Streaming, Spark MLLib, etc. with deep technical understanding of Spark Processing Framework.

• In-depth knowledge of standard programming languages such as Scala and/or Java.

• 3+ years of hands-on development experience in one or more libraries & frameworks such as Apache Kafka, Akka, Apache Storm, Apache Nifi, Zookeeper, Hadoop ecosystem (i.e., HDFS, YARN, MapReduce, Oozie & Hive), etc.; extra points if you can demonstrate your knowledge with working examples.

• 3+ years of hands-on development experience in one or more Relational and NoSQL datastores such as PostgreSQL, Cassandra, HBase, MongoDB, DynamoDB, Elastic Search, Neo4J, etc.

• Practical knowledge of distributed systems involving partitioning, bucketing, CAP theorem, replication, horizontal scaling, etc.

• Passion for distilling large volumes of data, analyze performance, scalability, and capacity performance issues in Big Data Platforms.

• Ability to clearly distinguish system and Spark Job performances and perform spark performance tuning and resource optimization.

• Perform benchmarking/stress tests and document the best practices for different applications.

• Proactively work with tenants on improving the overall performance and ensure the system is resilient, and scalable.

• Good understanding of Virtualization & Containerization; must demonstrate experience in technologies such as Kubernetes, Istio, Docker, OpenShift, Anthos, Oracle VirtualBox, Vagrant, etc.

• Well-versed with demonstrable working experience with API Management, API Gateway, Service Mesh, Identity & Access Management, Data Protection & Encryption.

  Hands-on experience with demonstrable working experience with DevOps tools and platforms viz., Jira, GIT, Jenkins, Code Quality & Security Plugins, Maven, Artifactory, Terraform, Ansible/Chef/Puppet, Spinnaker, etc.

• Well-versed in AWS and/or Azure or and/or Google Cloud; must demonstrate experience in at least FIVE (5) services offered under AWS and/or Azure or and/or Google Cloud in any categories: Compute or Storage, Database, Networking & Content Delivery, Management & Governance, Analytics, Security, Identity, & Compliance (or) equivalent demonstrable Cloud Platform experience.

• Good understanding of Storage, Networks and Storage Networking basics which will enable you to work in a Cloud environment.

• Good understanding of Network, Data, and Application Security basics which will enable you to work in a Cloud as well as Business Applications / API services environment.

About Vymo

Vymo is a Sanfrancisco-based next-generation Sales productivity SaaS company with offices in 7 locations. Vymo is funded by top tier VC firms like Emergence Capital and Sequoia Capital. Vymo is a category creator, an intelligent Personal Sales Assistant who captures sales activities automatically, learns from top performers, and predicts ‘next best actions’ contextually. Vymo has 100,000 users in 60+ large enterprises such as AXA, Allianz, Generali.Vymo has seen 3x annual growth over the last few years and aspires to do even better this year by building up the team globally.

What is the Personal Sales Assistant

A game-changer! We thrive in the CRM space where every company is struggling to deliver meaningful engagement to their Sales teams and IT systems. Vymo was engineered with a mobile-first philosophy. The platform through AI/ML detects, predicts, and learns how to make Sales Representatives more productive through nudges and suggestions on a mobile device. Explore Vymo https://getvymo.com/">https://getvymo.com/

What you will do at Vymo

From young open source enthusiasts to experienced Googlers, this team develops products like Lead Management System, Intelligent Allocations & Route mapping, Intelligent Interventions, that help improve the effectiveness of the sales teams manifold. These products power the "Personal Assistant" app that automates the sales force activities, leveraging our cutting edge location based technology and intelligent routing algorithms.

A Day in your Life 

• Design, develop and maintain robust data platforms on top of Kafka, Spark, ES etc.
• Provide leadership to a group of engineers in an innovative and fast-paced environment.
• Manage and drive complex technical projects from the planning stage through execution.
  
  

What you would have done  

• B.E (or equivalent) in Computer Sciences
• 6-9 years of experience building enterprise class products/platforms.
• Knowledge of Big data systems and/or Data pipeline building experience is preferred.
• 2-3 years of relevant work experience as technical lead or technical management experience.
• Excellent coding skills in one of Core Java or NodeJS
• Demonstrated problem solving skills in previous roles.
• Good communication skills.

• Minimum 7 years of relevant work experience in similar roles.
• Hands-on experience developing and delivering scalable multi-tenant SaaS applications on AWS platform.
• In-depth knowledge of Spring, Spring Boot, Java, REST Web Services, SQL databases, microservices, GRAND stack, SQL and NoSQL databases.
• In-depth knowledge and experience developing and delivering scalable data lakes, data ingestion and processing pipelines, data access microservices.
• In-depth knowledge of AWS platform, tools and services, specifically AWS networking and security, Route53, API Gateway, ECS/Fargate, RDS; Java/Spring development; modern database and data processing technologies; DevOps; microservices architecture; container/Docker technology.
• Outstanding collaboration and communication skills. Ability to effectively collaborate with distributed team.
• Understand and practice agile development methodology.
• Prior experience working in a software product company.
• Prior experience with security product development.

Nice to Have:

• AWS Certified Developer certification is highly desired.
• Prior experience with Apache Spark and Scala.