Data Engineer (Pyspark Developer)

📍 Position : Java Architect

📅 Experience : 10 to 15 Years

🧑‍💼 Open Positions : 3+

📍 Work Location : Bangalore, Pune, Chennai

💼 Work Mode : Hybrid

📅 Notice Period : Immediate joiners preferred; up to 1 month maximum

🔧 Core Responsibilities :

• Lead architecture design and development for scalable enterprise-level applications.
• Own and manage all aspects of technical development and delivery.
• Define and enforce best coding practices, architectural guidelines, and development standards.
• Plan and estimate the end-to-end technical scope of projects.
• Conduct code reviews, ensure CI/CD, and implement TDD/BDD methodologies.
• Mentor and lead individual contributors and small development teams.
• Collaborate with cross-functional teams, including DevOps, Product, and QA.
• Engage in high-level and low-level design (HLD/LLD), solutioning, and cloud-native transformations.

🛠️ Required Technical Skills :

• Strong hands-on expertise in Java, Spring Boot, Microservices architecture
• Experience with Kafka or similar messaging/event streaming platforms
• Proficiency in cloud platforms – AWS and Azure (must-have)
• Exposure to frontend technologies (nice-to-have)
• Solid understanding of HLD, system architecture, and design patterns
• Good grasp of DevOps concepts, Docker, Kubernetes, and Infrastructure as Code (IaC)
• Agile/Lean development, Pair Programming, and Continuous Integration practices
• Polyglot mindset is a plus (Scala, Golang, Python, etc.)

🚀 Ideal Candidate Profile :

• Currently working in a product-based environment
• Already functioning as an Architect or Principal Engineer
• Proven track record as an Individual Contributor (IC)
• Strong engineering fundamentals with a passion for scalable software systems
• No compromise on code quality, craftsmanship, and best practices

🧪 Interview Process :

1. Round 1: Technical pairing round
2. Rounds 2 & 3: Technical rounds with panel (code pairing + architecture)
3. Final Round: HR and offer discussion

Job Summary

• Candidate will be responsible for providing full life-cycle development (design, coding, and testing) and maintenance of web-based system on Azure
• Candidate should have experience in GitHub, knowledge of DevOps is a plus
• Experienced in designing and implementing web portals, experience with DNN is must
• Ability to work with multiple languages including C#, ASP.Net, MVC, Javascript and related libraries, HTML, Complex SQL queries, CSS, BootStrap, JSON.
• Experience in Agile project management methodology
• Developing and Delivering Excellent Web based solutions/portals/sites based on customer’s requirement within the stipulated timeline
• The candidate should be flexible to learn new technology and platform and should be creative, innovative for improvement ideas, detail oriented, diligent, and eager to learn and grow

Duties and Responsibilities

• Understand business requirements to apply logic to integrate functionalities
• Identify and understand any technical bugs on the server, site, log files or modules and work on resolving the bugs
• Understand how FTP server is setup for the site
• Understand system/site technical requirements and suggest enhancements if applicable
• Designing, coding, unit Testing, and integration with Database
• Handle site deployment
• Designing, coding, debugging, technical problem solving, and writing Unit Test cases, etc.

Qualifications

Education / Certification

• B.E. / B.Tech. /MSC in Computer Science or IT.
• MCAD/MCSD/MSITP/MCPD

Technical Expertise

• ASP/ASP.NET/VB.NET/MVC/C#/SQL Server 2012+
• HTML, Javascript, Jquery, CSS, Bootstrap
• GitHub/DevOps, Azure
• Web API/ Web Services, Email Services

Skills and Abilities

• Be able to work with diverse global teams and in an individual contributor role as needed
• Excellent English written and verbal communication skills (for local team and global stakeholders/team members)
• Strong task management skills including time management, and ability to manage multiple projects simultaneously
• Flexibility required to attend late evening meetings with global team members
• Attention to detail and delivering quality projects and knowledge assets

We are a tech venture which provides Product Engineering, QA Automation, Infrastructure, Data, and Market Research services.

Technical Proficiency : 
Must have : 

• Strong development experience in Python in the environment of Unix/Linux/Ubuntu

• Strong practical knowledge of Python and its libraries.

• Current working experience with cloud deployment of AWS/Azure/GCP, Microservice architecture, and Docker in Python.

• Good knowledge of CI/CD and DevOps practices

• Good Experience of Python with Django/ Scrapy/ Flask frameworks.

• Good Experience in Jupyter/ Docker/ Elastic Search, etc.

• Solid understanding of software development principles and best practices.

• Strong analytical thinking and problem-solving skills.

• Proven ability to drive large-scale projects with a deep understanding of Agile SDLC, high collaboration, and leadership.
  
  Good to have : 

• Expected to have migration experience from one version to the other, as this project is about migration to the latest version.

• Preferred if had an OpenEdx platform experience or any LMS platform. 

   

About this roleWe are seeking an experienced MongoDB Developer/DBA who will be

responsible for maintaining MongoDB databases while optimizing performance, security, and

the availability of MongoDB clusters. As a key member of our team, you’ll play a crucial role in

ensuring our data infrastructure runs smoothly.

You'll have the following responsibilities

 Maintain and Configure MongoDB Instances - Responsible for build, design, deploy,

maintain, and lead the MongoDB Atlas infrastructure. Keep clear documentation of the

database setup and architecture.

 Ownership of governance, defining and enforcing policies in MongoDB Atlas.Provide

consultancy in drawing the design and infrastructure (MongoDB Atlas) for use case.

 Service and Governance wrap will be in place to restrict over provisioning for server size,

number of clusters per project and scaling through MongoDB Atlas

 Gathering and documenting detailed business requirements applicable to the data

layer.Responsible for designing, configuring and managing MongoDB on Atlas.

 Design, develop, test, document, and deploy high-quality technical solutions on the

MongoDB Atlas platform based on industry best practices to solve business needs.

Resolves technical issues raised by the team and/or customer and manages escalations as

required.

 Migrate data from on-premise MongoDB and RDBMS to MongoDB AtlasCommunicate

and collaborate with other technical resources and customers in providing timely updates

on status of deliverables, shedding light on technical issues, and obtaining buy-in on

creative solutions.

 Write procedures for backup and disaster recovery.

You'll have the following skills & experience

 Excellent analytical, diagnostic skills, and problem-solving skills

 Should understand the Database concept and develop expertise in designing and

developing NoSQL databases such as MongoDB

 MongoDB query operation, import and export operation in database

 Experience in ETL methodology for performing Data Migration, Extraction,

Transformation, Data Profiling and Loading

 Migrating database by ETL, migrating database by manual process and designing,

development, implementation

 General networking skills, especially in the context of a public cloud (e.g. AWS – VPC,

subnets, routing tables, nat / internet gateways, dns, security groups)

 Experience using Terraform as an IaC tool for setting up infrastructure on AWS

CloudPerforming database backups and recovery

 Competence in at least one of the following languages (in no particular order): Java, C++,

C#, Python, Node.js (JavaScript), Ruby, Perl, Scala, Go

 Excellent communication skills, often being able to compromise but draw out risks and

constraints associated with solutions. Be able to work independently and collaborate with

other teams

 Proficiency in configuring schema and MongoDB data modeling.

 Strong understanding of SQL and NoSQL databases.

 Comfortable with MongoDB syntax.

 Experience with database security management.

 Performance Optimization - Ensure databases achieve maximum performance and

availability. Design effective indexing strategies.

Key Responsibilities: 

• Rewrite existing APIs in NodeJS. 
• Remodel the APIs into Micro services-based architecture. 
• Implement a caching layer wherever possible. 
• Optimize the API for high performance and scalability. 
• Write unit tests for API Testing.
• Automate the code testing and deployment process.

Skills Required: 

• At least 3 years of experience developing Backends using NodeJS — should be well versed with its asynchronous nature & event loop, and know its quirks and workarounds. 
• Excellent hands-on experience using MySQL or any other SQL Database. 
• Good knowledge of MongoDB or any other NoSQL Database. 
• Good knowledge of Redis, its data types, and their use cases. 
• Experience with graph-based databases like GraphQL and Neo4j. 
• Experience developing and deploying REST APIs. 
• Good knowledge of Unit Testing and available Test Frameworks. 
• Good understanding of advanced JS libraries and frameworks. 
• Experience with Web sockets, Service Workers, and Web Push Notifications. 
• Familiar with NodeJS profiling tools. 
• Proficient understanding of code versioning tools such as Git. 
• Good knowledge of creating and maintaining DevOps infrastructure on cloud platforms. 
• Should be a fast learner and a go-getter — without any fear of trying out new things Preferences. 
• Experience building a large scale social or location-based app.

Synapsica is a growth stage HealthTech startup founded by alumni from IIT Kharagpur, AIIMS New Delhi, and IIM Ahmedabad. We believe healthcare needs to be transparent and objective, while being affordable. Every patient has the right to know exactly what is happening in their bodies and they don’t have to rely on cryptic 2 liners given to them as diagnosis.

Towards this aim, we are building an artificial intelligence enabled cloud based platform to analyze medical images and create 2.0 of advanced radiologist reporting.

We are backed by YCombinator and other marquee investors from India, US and Japan. We are proud to have GE, AIIMS, the Spinal Kinetics as our partners.

Join us, if you find this as exciting as we do!

Description:

Synapsica is looking for a Node.js/Python developer who is passionate about designing and implementing scalable solutions with highest quality. You will be responsible for creating high performance, responsive, and secure server-side programs to manage Synapsica platform. You will be responsible for designing, managing and supporting cloud platform and scaling our database. This role is ideal for you if you have a background in bakcned development and are looking for the next level of career growth in a fast paced, learning based and merit driven work environment.

Responsibilities:
- Design and development of our new platform modules from scratch. 
- Hands on implementation of our APIs and integrations. 
- Design, scaling and integration of new/existing databases.
- Ensuring the entire stack is designed and built for speed and scalability
- Design and construction of our REST APIs with best secutiry mechanisms.
- Design and implementation of continuous integration and deployment pipelines in tandem with the respective team members.
- Performance tuning and improvements in large scale systems.
- Ensuring responsiveness and cross-platform compatibility of applications.
- Owning and delivering end-to-end products, features, enhancements.

Requirements:
- Degree in Computer Science or related discipline with strong competencies in data structures, algorithms, and software design
- At least 4+ years of experience with writing Python/NodeJS/PHP/Ruby on Rails. 
- Prior experience of database design and management in MongoDB, including being up on the latest practices and associated versions.
- Experience in building highly scalable business applications, which involve implementing large complex business flows and dealing with huge amount of data.
- Familiarity with AWS (or equivalent) ecosystem with end-to-end cloud deployment.
- Experience implementing code level unit tests.
- Proficiency with Git / Version control.
- Appreciation for clean and well documented code
- Excellent verbal communication skills.
- Good problem solving skills.
- Attention to detail.
- Very high sense of ownership.
- Deep interest and passion for technology