Database Administrator - Postgresql

JOB DETAILS:

* Job Title: Specialist I - DevOps Engineering

* Industry: Global Digital Transformation Solutions Provider

* Salary: Best in Industry

* Experience: 7-10 years

* Location: Bengaluru (Bangalore), Chennai, Hyderabad, Kochi (Cochin), Noida, Pune, Thiruvananthapuram

Job Description

Job Summary:

As a DevOps Engineer focused on Perforce to GitHub migration, you will be responsible for executing seamless and large-scale source control migrations. You must be proficient with GitHub Enterprise and Perforce, possess strong scripting skills (Python/Shell), and have a deep understanding of version control concepts.

The ideal candidate is a self-starter, a problem-solver, and thrives on challenges while ensuring smooth transitions with minimal disruption to development workflows.

Key Responsibilities:

• Analyze and prepare Perforce repositories — clean workspaces, merge streams, and remove unnecessary files.
• Handle large files efficiently using Git Large File Storage (LFS) for files exceeding GitHub’s 100MB size limit.
• Use git-p4 fusion (Python-based tool) to clone and migrate Perforce repositories incrementally, ensuring data integrity.
• Define migration scope — determine how much history to migrate and plan the repository structure.
• Manage branch renaming and repository organization for optimized post-migration workflows.
• Collaborate with development teams to determine migration points and finalize migration strategies.
• Troubleshoot issues related to file sizes, Python compatibility, network connectivity, or permissions during migration.

Required Qualifications:

• Strong knowledge of Git/GitHub and preferably Perforce (Helix Core) — understanding of differences, workflows, and integrations.
• Hands-on experience with P4-Fusion.
• Familiarity with cloud platforms (AWS, Azure) and containerization technologies (Docker, Kubernetes).
• Proficiency in migration tools such as git-p4 fusion — installation, configuration, and troubleshooting.
• Ability to identify and manage large files using Git LFS to meet GitHub repository size limits.
• Strong scripting skills in Python and Shell for automating migration and restructuring tasks.
• Experience in planning and executing source control migrations — defining scope, branch mapping, history retention, and permission translation.
• Familiarity with CI/CD pipeline integration to validate workflows post-migration.
• Understanding of source code management (SCM) best practices, including version history and repository organization in GitHub.
• Excellent communication and collaboration skills for cross-team coordination and migration planning.
• Proven practical experience in repository migration, large file management, and history preservation during Perforce to GitHub transitions.

Skills: Github, Kubernetes, Perforce, Perforce (Helix Core), Devops Tools

Must-Haves

Git/GitHub (advanced), Perforce (Helix Core) (advanced), Python/Shell scripting (strong), P4-Fusion (hands-on experience), Git LFS (proficient)

Role: Full-Time, Long-Term Required: Python, SQL Preferred: Experience with financial or crypto data

OVERVIEW

We are seeking a data engineer to join as a core member of our technical team. This is a long-term position for someone who wants to build robust, production-grade data infrastructure and grow with a small, focused team. You will own the data layer that feeds our machine learning pipeline—from ingestion and validation through transformation, storage, and delivery.

The ideal candidate is meticulous about data quality, thinks deeply about failure modes, and builds systems that run reliably without constant attention. You understand that downstream ML models are only as good as the data they consume.

CORE TECHNICAL REQUIREMENTS

Python (Required): Professional-level proficiency. You write clean, maintainable code for data pipelines—not throwaway scripts. Comfortable with Pandas, NumPy, and their performance characteristics. You know when to use Python versus push computation to the database.

SQL (Required): Advanced SQL skills. Complex queries, query optimization, schema design, execution plans. PostgreSQL experience strongly preferred. You think about indexing, partitioning, and query performance as second nature.

Data Pipeline Design (Required): You build pipelines that handle real-world messiness gracefully. You understand idempotency, exactly-once semantics, backfill strategies, and incremental versus full recomputation tradeoffs. You design for failure—what happens when an upstream source is late, returns malformed data, or goes down entirely. Experience with workflow orchestration required: Airflow, Prefect, Dagster, or similar.

Data Quality (Required): You treat data quality as a first-class concern. You implement validation checks, anomaly detection, and monitoring. You know the difference between data that is missing versus data that should not exist. You build systems that catch problems before they propagate downstream.

WHAT YOU WILL BUILD

Data Ingestion: Pipelines pulling from diverse sources—crypto exchanges, traditional market feeds, on-chain data, alternative data. Handling rate limits, API quirks, authentication, and source-specific idiosyncrasies.

Data Validation: Checks ensuring completeness, consistency, and correctness. Schema validation, range checks, freshness monitoring, cross-source reconciliation.

Transformation Layer: Converting raw data into clean, analysis-ready formats. Time series alignment, handling different frequencies and timezones, managing gaps.

Storage and Access: Schema design optimized for both write patterns (ingestion) and read patterns (ML training, feature computation). Data lifecycle and retention management.

Monitoring and Alerting: Observability into pipeline health. Knowing when something breaks before it affects downstream systems.

DOMAIN EXPERIENCE

Preference for candidates with experience in financial or crypto data—understanding market data conventions, exchange-specific quirks, and point-in-time correctness. You know why look-ahead bias is dangerous and how to prevent it.

Time series data at scale—hundreds of symbols with years of history, multiple frequencies, derived features. You understand temporal joins, windowed computations, and time-aligned data challenges.

High-dimensional feature stores—we work with hundreds of thousands of derived features. Experience managing, versioning, and serving large feature sets is valuable.

ENGINEERING STANDARDS

Reliability: Pipelines run unattended. Failures are graceful with clear errors, not silent corruption. Recovery is straightforward.

Reproducibility: Same inputs and code version produce identical outputs. You version schemas, track lineage, and can reconstruct historical states.

Documentation: Schemas, data dictionaries, pipeline dependencies, operational runbooks. Others can understand and maintain your systems.

Testing: You write tests for pipelines—validation logic, transformation correctness, edge cases. Untested pipelines are broken pipelines waiting to happen.

TECHNICAL ENVIRONMENT

PostgreSQL, Python, workflow orchestration (flexible on tool), cloud infrastructure (GCP preferred but flexible), Git.

WHAT WE ARE LOOKING FOR

Attention to Detail: You notice when something is slightly off and investigate rather than ignore.

Defensive Thinking: You assume sources will send bad data, APIs will fail, schemas will change. You build accordingly.

Self-Direction: You identify problems, propose solutions, and execute without waiting to be told.

Long-Term Orientation: You build systems you will maintain for years.

Communication: You document clearly, explain data issues to non-engineers, and surface problems early.

EDUCATION

University degree in a quantitative/technical field preferred: Computer Science, Mathematics, Statistics, Engineering. Equivalent demonstrated expertise also considered.

TO APPLY

Include: (1) CV/resume, (2) Brief description of a data pipeline you built and maintained, (3) Links to relevant work if available, (4) Availability and timezone.

Designation: Principal Data Engineer

Experience: Experienced

Position Type: Full Time Position

Location: Hyderabad

Office Timings: 9AM to 6PM

Compensation: As Per Industry standards

About Monarch:

At Monarch, we’re leading the digital transformation of farming. Monarch Tractor augments both muscle and mind with fully loaded hardware, software, and service machinery that will spur future generations of farming technologies. With our farmer-first mentality, we are building a smart tractor that will enhance (not replace) the existing farm ecosystem, alleviate labor availability, and cost issues, and provide an avenue for competitive organic and beyond farming by providing mechanical solutions to replace harmful chemical solutions. Despite all the cutting-edge technology we will incorporate, our tractor will still plow, till, and haul better than any other tractor in its class. We have all the necessary ingredients to develop, build and scale the Monarch Tractor and digitally transform farming around the world.

Description:

Monarch Tractor likes to invite an experience Python data engineer to lead our internal data engineering team in India. This is a unique opportunity to work on computer vision AI data pipelines for electric tractors. You will be dealing with data from a farm environment like videos, images, tractor logs, GPS coordinates and map polygons. You will be responsible for collecting data for research and development. For example, this includes setting up ETL data pipelines to extract data from tractors, loading these data into the cloud and recording AI training results.

This role includes, but not limited to, the following tasks:

● Lead data engineering team

● Own and contribute to more than 50% of the data engineering code base

● Scope out new project requirements

● Costing data pipeline solutions

● Create data engineering tooling

● Design custom data structures for efficient processing of data

Data engineering skills we are looking for:

● Able to work with large amounts of text log data, image data, and video data

● Fluently use AWS cloud solutions like S3, Lambda, and EC2

● Able to work with data from Robot Operating System

Required Experience:

● 3 to 5 years of experience using Python

● 3 to 5 years of experience using PostgreSQL

● 3 to 5 years of experience using AWS EC2, S3, Lambda

● 3 to 5 years of experience using Ubuntu OS or WSL

Good to have experience:

● Ray

● Robot Operating System

What you will get:

At Monarch Tractor, you’ll play a key role on a capable, dedicated, high-performing team of rock stars. Our compensation package includes a competitive salary, excellent health, dental and vision benefits, and company equity commensurate with the role you’ll play in our success. 

• JEE, WebSphere App Server, Tomcat/jboss, development background
• Oracle DB/MySQL/Sybase/PostgreSQL
• Performance tuning in application connection pool, application server
• Basic Unix command and shell programming
• Thread dump, heap dump analyzing knowledge, tool used in thread dump

and heap dump

• Production issue troubleshooting
• Connection pool, application server configuration, JVM parameter configuration
• Good to have back base/flex cube technology hands on
• Technical Lead, Developer background

• Work towards improving the following 4 verticals - scalability, availability, security, and cost, for company's workflows and products.
• Help in provisioning, managing, optimizing cloud infrastructure in AWS (IAM, EC2, RDS, CloudFront, S3, ECS, Lambda, ELK etc.)
• Work with the development teams to design scalable, robust systems using cloud architecture for both 0-to-1 and 1-to-100 products.
• Drive technical initiatives and architectural service improvements.
• Be able to predict problems and implement solutions that detect and prevent outages.
• Mentor/manage a team of engineers.
• Design solutions with failure scenarios in mind to ensure reliability.
• Document rigorously to keep track of all changes/upgrades to the infrastructure and as well share knowledge with the rest of the team
• Identify vulnerabilities during development with actionable information to empower developers to remediate vulnerabilities
• Automate the build and testing processes to consistently integrate code
• Manage changes to documents, software, images, large web sites, and other collections of code, configuration, and metadata among disparate teams

Responsibilities

Work with dev teams and manage projects.

Plan with security and data protection as a foreword thought.

Build real-time and near real-time web applications with video/audio streaming.

Provide budgets and cost estimations for projects and server/service costs.

Design and develop client and server-side architectures.

Build front-end apps on React, Vue. You should be an expert at React.

Develop and manage database

Plan and write APIs

Test software to ensure responsive and efficiency

Write technical documentation

Requirement

5+ years experience

Front-end - React, Vue, Angular ( Expert in React and Angular)

Backend - Go-lang, Python, nodeJS, ( Must have working knowledge of atleast any of the two

programming languages)Framework: Django, Express JS

Misc - Linux, AWS, Deployment, Docker( Mandatory)

Tech Stack :

ANGULARJS, NODEJS, REQUIREJS, EXPRESSJS, HTML5, CSS3, JAVASCRIPT, AJAX, REST API, JQUERY, POSTGRESQL/MYSQL, MVC FRAMEWORK, MICROSERVICES ARCHITECTURE

Responsibilities:

• Design and build advanced applications
• Work with outside data sources and APIs
• Unit-test code for robustness, including edge cases, usability, and general reliability
• Work on bug fixing and improving application performance
• Continuously discover, evaluate, and implement new technologies to maximize development efficiency
• Building reusable code and libraries for future use
• Optimization of the application for maximum speed and scalability
• Implementation of security and data protection
• Able to understand and create Documentation according to Client requirement.

Requirements:

• Ability to write clean, commented and maintainable code.
• Basic understanding of microservices.
• Basic understanding in designing, architecting, developing enterprise class products and solutions.
• Basic understanding of MVC frameworks.
• Good understanding of front-end technologies and platforms, such as JavaScript, HTML5, and CSS3.
• Understanding accessibility and security compliance.
• User authentication and authorization between multiple systems, servers, and environments.
• Integration of multiple data sources and databases into one system.
• Basic understanding data migration, transformation, and scripting.
• Understanding differences between multiple delivery platforms such as mobile vs desktop, and optimizing output to match the specific platform.
• Basic understanding of a back-end programming concepts.
• Basic understanding of code versioning tools, such as Git.
• Proper understanding of OOPS concepts.
• Creating database schemas that represent and support business processes.
• Understanding of startup culture.
• Good team player, Quick learner.