
🚀 Hiring: Data Engineer ( Azure ) at Deqode
⭐ Experience: 5+ Years
📍 Location: Pune, Bhopal, Jaipur, Gurgaon, Delhi, Banglore,
⭐ Work Mode:- Hybrid
⏱️ Notice Period: Immediate Joiners
(Only immediate joiners & candidates serving notice period)
⭐ Hiring: Databricks Data Engineer – Lakeflow | Streaming | DBSQL | Data Intelligence
We are looking for a Databricks Data Engineer ( Azure ) to build reliable, scalable, and governed data pipelines powering analytics, operational reporting, and the Data Intelligence Layer.
🔹 Key Responsibilities
✅ Build optimized batch pipelines using Delta Lake (partitioning, OPTIMIZE, Z-ORDER, VACUUM)
✅ Implement incremental ingestion using Databricks Autoloader with schema evolution & checkpointing
✅ Develop Structured Streaming pipelines with watermarking, late data handling & restart safety
✅ Implement declarative pipelines using Lakeflow
✅ Design idempotent, replayable pipelines with safe backfills
✅ Optimize Spark workloads (AQE, skew handling, shuffle & join tuning)
✅ Build curated datasets for Databricks SQL (DBSQL), dashboards & downstream applications
✅ Package and deploy using Databricks Repos & Asset Bundles (CI/CD)
Ensure governance using Unity Catalog and embedded data quality checks
✅ Mandatory Skills (Must Have)
👉 Databricks & Delta Lake (Advanced Optimization & Performance Tuning)
👉 Structured Streaming & Autoloader Implementation
👉 Databricks SQL (DBSQL) & Data Modeling for Analytics

Similar jobs
We’re hiring a remote, contract-based Backend & Infrastructure Engineer who can build and run production systems end-to-end.
You will build and scale high-throughput backend services in Golang and Python, operate ClickHouse-powered analytics at scale, manage Linux servers for maximum uptime, scalability, and reliability, and drive cost efficiency as a core engineering discipline across the entire stack.
What You Will Do:
Backend Development (Golang & Python)
- Design and maintain high-throughput RESTful/gRPC APIs — primarily Golang, Python for tooling and supporting services
- Architect for horizontal scalability, fault tolerance, and low-latency at scale
- Implement caching (Redis/Memcached), rate limiting, efficient serialization, and CI/CD pipelines
Scalable Architecture & System Design
- Design and evolve distributed, resilient backend architecture that scales without proportional cost increase
- Make deliberate trade-offs (CAP, cost vs. performance) and design multi-region HA with automated failover
ClickHouse & Analytical Data Infrastructure
- Deploy, tune, and operate ClickHouse clusters for real-time analytics and high-cardinality OLAP workloads
- Design optimal table engines, partition strategies, materialized views, and query patterns
- Manage cluster scaling, replication, schema migrations, and upstream/downstream integrations
Cost Efficiency & Cost Optimization
- Own cost optimization end-to-end: right-sizing, reserved/spot capacity, storage tiering, query optimization, compression, batching
- Build cost dashboards, budgets, and alerts; drive a culture of cost-aware engineering
Linux Server Management & Infrastructure
- Administer and harden Linux servers (Ubuntu, Debian, CentOS/RHEL) — patching, security, SSH, firewalls
- Manage VPS/bare-metal provisioning, capacity planning, and containerized workloads (Docker, Kubernetes/Nomad)
- Implement Infrastructure-as-Code (Terraform/Pulumi); optionally manage AWS/GCP as needed
Data, Storage & Scheduling
- Optimize SQL schemas and queries (PostgreSQL, MySQL); manage data archival, cold storage, and lifecycle policies
- Build and maintain cron jobs, scheduled tasks, and batch processing systems
Uptime, Reliability & Observability
- Own system uptime: zero-downtime deployments, health checks, self-healing infra, SLOs/SLIs
- Build observability stacks (Prometheus, Grafana, Datadog, OpenTelemetry); structured logging, distributed tracing, alerting
- Drive incident response, root cause analysis, and post-mortems
Required Qualifications:
Must-Have (Critical)
- Deep proficiency in Golang (primary) and Python
- Proven ability to design and build scalable, distributed architectures
- Production experience deploying and operating ClickHouse at scale
- Track record of driving measurable cost efficiency and cost optimization
- 5+ years in backend engineering and infrastructure roles
Also Required
- Strong Linux server administration (Ubuntu, Debian, CentOS/RHEL) — comfortable living in the terminal
- Proven uptime and reliability track record across production infrastructure
- Strong SQL (PostgreSQL, MySQL); experience with high-throughput APIs (10K+ RPS)
- VPS/bare-metal provisioning, Docker, Kubernetes/Nomad, IaC (Terraform/Pulumi)
- Observability tooling (Prometheus, Grafana, Datadog, OpenTelemetry)
- Cron jobs, batch processing, data archival, cold storage management
- Networking fundamentals (DNS, TCP/IP, load balancing, TLS)
Nice to Have
- AWS, GCP, or other major cloud provider experience
- Message queues / event streaming (Kafka, RabbitMQ, SQS/SNS)
- Data pipelines (Airflow, dbt); FinOps practices
- Open-source contributions; compliance background (SOC 2, HIPAA, GDPR)
What We Offer
- Remote, contractual role
- Flexible time zones (overlap for standups + incident coverage)
- Competitive contract compensation + equity
- Long-term engagement opportunity based on performance
We seek a highly skilled and experienced Ruby on Rails Development Team Lead/Architect to join our dynamic team at Uphance. The ideal candidate will have proven expertise in leading and architecting RoR projects, focusing on building scalable, high-quality applications. This role requires a combination of technical leadership, mentorship, and a strong commitment to best practices in software development.
Job Type: Contract/Remote/Full-Time/Long-term
Responsibilities:
- Develop and maintain high-quality Ruby on Rails applications that meet our high-quality standards.
- Design, build, and maintain efficient, reusable, and reliable Ruby code.
- Utilise your expertise in Ruby on Rails to enhance the performance and reliability of our platform.
- Set the technical direction for the existing RoR project, including system architecture and technology stack decisions.
- Guide and mentor team members to enhance their technical skills and understanding of RoR best practices.
- Conduct code reviews to maintain high coding standards and ensure adherence to best practices.
- Optimise application performance, focusing on ActiveRecord queries and overall architecture.
- Tackle complex technical challenges and provide efficient solutions, particularly when specifications are unclear or incomplete.
- Establish and enforce testing protocols; write and guide the team in writing effective tests.
- Define and ensure consistent adherence to best practices, particularly in the context of large applications.
- Manage the development process using Agile methodologies, possibly acting as a Scrum Master if required.
- Work closely with product managers, designers, and other stakeholders to meet project requirements and timelines.
Technical Requirements and Qualifications:
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field
- Proven experience with Ruby on Rails, MySQL, HTML, and JavaScript (6+ years)
- Extensive experience with Ruby on Rails and familiarity with its best practices
- Proven track record of technical leadership and team management
- Strong problem-solving skills and the ability to address issues with incomplete specifications
- Proficiency in performance optimisation and software testing
- Experience with Agile development and Scrum practices
- Excellent mentoring and communication skills
- Experience with large-scale application development
- Application performance monitoring/tuning
General Requirements:
- Availability to work during the IST working hours.
- High-speed Internet and the ability to join technical video meetings during business hours.
- Strong analytical and problem-solving skills and ability to work as part of multi-functional teams.
- Ability to collaborate and be a team player.
Why Uphance?
- Engage in Innovative Projects: Immerse yourself in cutting-edge projects that not only test your skills but also encourage the exploration of new design realms.
- AI-Integrated Challenges: Take on projects infused with AI, pushing the boundaries of your abilities and allowing for exploration in uncharted territories of software design and development.
- Flexible Work Environment: Whether you embrace the digital nomad lifestyle or prefer the comfort of your own space, Uphance provides the freedom to design and create from any corner of the globe.
- Inclusive Team Environment: Join a dynamic, international, and inclusive team that values and celebrates diverse ideas.
- Collaborative Team Dynamics: Become a part of a supportive and motivated team that shares in the celebration of collective successes.
- Recognition and Appreciation: Your accomplishments will be acknowledged and applauded regularly in our Recognition Rally.
Compensation:
Salary Range: INR 24 LPA to INR 32 LPA (Salary is not a constraint for the right candidate)
At Uphance, we value innovation, collaboration, and continuous learning. As part of our team, you'll have the opportunity to lead a group of talented RoR developers, contribute to exciting projects, and play a key role in our company's success. If you are passionate about Ruby on Rails and thrive in a leadership role, we would love to hear from you. Apply today and follow us on LinkedIn - https://www.linkedin.com/company/uphance !
Requirements
- 3+ years work experience with production-grade python. Contribution to open source repos is preferred
- Experience writing concurrent and distributed programs, AWS lambda, Kubernetes, Docker, Spark is preferred.
- Experience with one relational & 1 non-relational DB is preferred
- Prior work in the ML domain will be a big boost
What You’ll Do
- Help realize the product vision: Production-ready machine learning models with monitoring within moments, not months.
- Help companies deploy their machine learning models at scale across a wide range of use-cases and sectors.
- Build integrations with other platforms to make it easy for our customers to use our product without changing their workflow.
- Write maintainable, scalable performant python code
- Building gRPC, rest API servers
- Working with Thrift, Protobufs, etc.
Your responsibilities will include:
Designing, implementing and maintaining Java-based applications
Contributing in all phases of the development lifecycle
Writing testable, scalable and efficient code
Test and debug new applications and updates
Maintain up to date code documentation
Participating in code reviews
Key Requirement:
- You have prior experience in Core Java.
- Strong knowledge of Java Application Frameworks
- Hands-on experience working in SQL
As an engineer, you will help with the implementation, and launch of many key product features. You will get an opportunity to work on a wide range of technologies (including Spring, AWS Elastic Search, Lambda, ECS, Redis, Spark, Kafka etc.) and apply new technologies for solving problems. You will have an influence on defining product features, drive operational excellence, and spearhead the best practices that enable a quality product. You will get to work with skilled and motivated engineers who are already contributing to building high-scale and high-available systems.
If you are looking for an opportunity to work on leading technologies and would like to build product technology that can cater millions of customers inclined towards providing them the best experience, and relish large ownership and diverse technologies, join our team today!
What You'll Do:
- Creating detailed design, working on development and performing code reviews.
- Implementing validation and support activities in line with architecture requirements
- Help the team translate the business requirements into R&D tasks and manage the roadmap of the R&D tasks.
- Designing, building, and implementation of the product; participating in requirements elicitation, validation of architecture, creation and review of high and low level design, assigning and reviewing tasks for product implementation.
- Work closely with product managers, UX designers and end users and integrating software components into a fully functional system
- Ownership of product/feature end-to-end for all phases from the development to the production.
- Ensuring the developed features are scalable and highly available with no quality concerns.
- Work closely with senior engineers for refining the and implementation.
- Management and execution against project plans and delivery commitments.
- Assist directly and indirectly in the continual hiring and development of technical talent.
- Create and execute appropriate quality plans, project plans, test strategies and processes for development activities in concert with business and project management efforts.
The ideal candidate is a passionate engineer about delivering experiences that delight customers and creating solutions that are robust. He/she should be able to commit and own the deliveries end-to-end.
What You'll Need:
- A Bachelor's degree in Computer Science or related technical discipline.
- 2-3+ years of Software Development experience with proficiency in Java or equivalent object-oriented languages, coupled with design and SOA
- Fluency with Java, and Spring is good.
- Experience in JEE applications and frameworks like struts, spring, mybatis, maven, gradle
- Strong knowledge of Data Structures, Algorithms and CS fundamentals.
- Experience in at least one shell scripting language, SQL, SQL Server, PostgreSQL and data modeling skills
- Excellent analytical and reasoning skills
- Ability to learn new domains and deliver output
- Hands on Experience with the core AWS services
- Experience working with CI/CD tools (Jenkins, Spinnaker, Nexus, GitLab, TeamCity, GoCD, etc.)
- Expertise in at least one of the following:
- Kafka, ZeroMQ, AWS SNS/SQS, or equivalent streaming technology
- Distributed cache/in memory data grids like Redis, Hazelcast, Ignite, or Memcached
- Distributed column store databases like Snowflake, Cassandra, or HBase
- Spark, Flink, Beam, or equivalent streaming data processing frameworks
- Proficient with writing and reviewing Python and other object-oriented language(s) are a plus
- Experience building automations and CICD pipelines (integration, testing, deployment)
- Experience with Kubernetes would be a plus.
- Good understanding of working with distributed teams using Agile: Scrum, Kanban
- Strong interpersonal skills as well as excellent written and verbal communication skills
• Attention to detail and quality, and the ability to work well in and across teams
JD-Backend Developer
Job Location: Andheri, Mumbai
Job Summary:
As a Python based Backend developer, you shall be responsible for software development of greenfield projects -an platform
for automated testing using Python as a main language. You will work with a team of developers, collaborating on projects to
create efficient and effective software solutions that meet the needs of clients or end-users in the testing domain. You will
need to have a strong understanding of Python & other languages with knowledge of test automation frameworks and tools/
libraries.
Responsibilities:
• Develop and maintain an automated testing platform using Python programming language.
• Design and implement software solutions that automate the testing process.
• Collaborate with other developers and cross-functional teams to deliver high-quality software solutions.
• Participate in code reviews, debugging, and troubleshooting to improve software quality.
• Stay up-to-date with the latest developments in Python and JavaScript programming language and related
testing frameworks and tools.
• Ensure software is delivered on-time and meets or exceeds customer expectations.
• Develop and maintain documentation related to software development processes and projects.
Requirements:
• Bachelor's degree in Computer Science, Software Engineering or a related field.
• Proven experience as a Back-end Developer.
• Strong understanding of Python & other programming language along with its ecosystem (libraries, frameworks,
tools, etc.).
• Excellent written and verbal communication skills.
Preferences:
• Preference shall be given to local candidates
• Preference shall be given to candidates having experience in greenfield software development projects related
to automated testing.
Position : Backend Developer – SDE3 : Java/Nodejs
As part of the engineering team, you would be expected to have deep technology expertise with a passion for building highly scalable products. This is a unique opportunity where you can impact the lives of people across 150+ countries!
Responsibilities
● Own architecture, design, development, and implementation of different modules/features of the services
● Design, develop, deploy and support web applications.
● Bring in industry best practices
● Discover opportunities for performance improvements
● Recommend ways to improve reliability, efficiency and code quality
● Focus on continuous delivery and reducing complexity
● Carry out code reviews and manage pull requests within the mobile application development team
● Build applications based on micro-services architecture
Requirements
● Overall 5+ years of experience in Backend development (Java or Nodejs).
● B.E/B.Tech in CS or equivalent streams from institute of repute (IITs, NITs, BITs, IIITs or equivalent)
● Strong object oriented design skills & knowledge of design patterns
● Experience in working with data platform & data lake pipeline building is preferred.
● Experience designing & developing distributed systems involving multiple web services, databases (both SQL and NoSQL), caches, queues, etc. taking into consideration scalability, availability, fault tolerance, consistency, etc. of the overall system
● Well-aware of and enforces development best practices: Unit Tests, Code Reviews, Integration Tests, CI/CD, Monitoring, Alerting, etc
Skills:
- Experienced in C# MVC ASP.Net, Net
- Should have good knowledge in JavaScript, SQL, RDBMS Concepts and Microsoft .NET
- Framework, practical implementation of Object Oriented Concepts, N-Tier Architecture
- Development and understanding of JSON, XML, SOAP.
- Good hands-on coding skills in Java Script, Ajax, C#, ASP.Net, ADO.Net, jQuery.
- Knowledge of working Android iOS mobile development would be added advantage
- Good communication and analytical skills are must.
- Candidates with experience will be preferred.
Primary Roles and Responsibilities:
- Participate in requirements analysis.
- Collaborate with internal teams to develop software design and architecture.
- Candidate should be able to write clean, scalable code using C#.
- Revise, update, refactor and debug code.
- Test and deploy applications.
- Resourcefulness and troubleshooting.
- Good analytical and problem solving skills.
JOB SUMMARY
|
Job Title: |
Backend Web Application Developer (AWS Cloud) |
|
Team/Department: |
Omnicom Media Group IT (OMG – IT) |
|
Reporting: |
Manager – OMG IT |
|
Location: |
Bangalore |
ABOUT THE ROLE
THE ROLE IN SUMMARY
Omnicom Media Group (OMG) has an immediate opening for a highly motivated and talented backend web application developer, specializing in AWS cloud technologies. In this position you will be joining an in-house development team whose primary responsibility is developing new features and functionality for multiple existing web applications and day to day troubleshooting and issue resolution. The ideal candidate will possess excellent critical thinking and troubleshooting skills and have proven experience using popular AWS services commonly used to build serverless web application architectures. Candidates are expected to have strong knowledge of AWS API Gateway, Lambda, DynamoDB and Python programming. Familiarity with Cloud infrastructure as code frameworks, such as Serverless Framework, Terraform or CloudFormation, etc. is also required. Excellent English communication skills are a must as you will be a part of a team working alongside our primary development team in addition to several business analysis and project managers. 5+ years of prior backend and Cloud web application and software development experience required.
WHAT WILL YOU DO
KEY WORKING PRINCIPLES
- Passionate about modern web application architecture and programming. Hands on backend developer.
- Prior experience with modern RESTful API design and implementation. Microservices and single page web applications.
- Strong AWS knowledge, specifically serverless technologies (S3, API Gateway, Lambda, IAM, DynamoDB) as they relate to web application development.
- Excellent knowledge of web application security fundamentals (identity management, authentication, authorization, SSO).
- Designed several application databases in SQL and at least one non-relational database system, preferably
- Familiarity with DevOps practices including continuous integration and deployment, infrastructure as code in preferably Serverless Framework.
- Excellent verbal and written communication skills.
- 5+ years professional software development experience.
- Bachler’s degree in computer science or related field.
MUST HAVE SKILLS
- Backend Web Application Development
- Python
- AWS Services Including, CloudFront, S3, API Gateway, Lambda, Step Functions, SES, DynamoDB, Serverless Framework
- AWS Identity and Access Management principles (IAM)
- SQL (MS SQL Server, PostgreSQL, AWS Aurora or comparable)
- GIT, JIRA, Agile / Scrum
NICE TO HAVE SKILLS
- AWS Cognito








