ADF Developer

Company name: PulseData labs Pvt Ltd (captive Unit for URUS, USA)

About URUS

We are the URUS family (US), a global leader in products and services for Agritech.

SENIOR DATA ENGINEER

This role is responsible for the design, development, and maintenance of data integration and reporting solutions. The ideal candidate will possess expertise in Databricks and strong skills in SQL Server, SSIS and SSRS, and experience with other modern data engineering tools such as Azure Data Factory. This position requires a proactive and results-oriented individual with a passion for data and a strong understanding of data warehousing principles.

Responsibilities

Data Integration

• Design, develop, and maintain robust and efficient ETL pipelines and processes on Databricks.
• Troubleshoot and resolve Databricks pipeline errors and performance issues.
• Maintain legacy SSIS packages for ETL processes.
• Troubleshoot and resolve SSIS package errors and performance issues.
• Optimize data flow performance and minimize data latency.
• Implement data quality checks and validations within ETL processes.

Databricks Development

• Develop and maintain Databricks pipelines and datasets using Python, Spark and SQL.
• Migrate legacy SSIS packages to Databricks pipelines.
• Optimize Databricks jobs for performance and cost-effectiveness.
• Integrate Databricks with other data sources and systems.
• Participate in the design and implementation of data lake architectures.

Data Warehousing

• Participate in the design and implementation of data warehousing solutions.
• Support data quality initiatives and implement data cleansing procedures.

Reporting and Analytics

• Collaborate with business users to understand data requirements for department driven reporting needs.
• Maintain existing library of complex SSRS reports, dashboards, and visualizations.
• Troubleshoot and resolve SSRS report issues, including performance bottlenecks and data inconsistencies.

Collaboration and Communication

• Comfortable in entrepreneurial, self-starting, and fast-paced environment, working both independently and with our highly skilled teams.
• Collaborate effectively with business users, data analysts, and other IT teams.
• Communicate technical information clearly and concisely, both verbally and in writing.
• Document all development work and procedures thoroughly.

Continuous Growth

• Keep abreast of the latest advancements in data integration, reporting, and data engineering technologies.
• Continuously improve skills and knowledge through training and self-learning.

This job description reflects managements assignment of essential functions; it does not prescribe or restrict the tasks that may be assigned.

Requirements

• Bachelor's degree in computer science, Information Systems, or a related field.
• 7+ years of experience in data integration and reporting.
• Extensive experience with Databricks, including Python, Spark, and Delta Lake.
• Strong proficiency in SQL Server, including T-SQL, stored procedures, and functions.
• Experience with SSIS (SQL Server Integration Services) development and maintenance.
• Experience with SSRS (SQL Server Reporting Services) report design and development.
• Experience with data warehousing concepts and best practices.
• Experience with Microsoft Azure cloud platform and Microsoft Fabric desirable.
• Strong analytical and problem-solving skills.
• Excellent communication and interpersonal skills.
• Ability to work independently and as part of a team.
• Experience with Agile methodologies.

Key Responsibilities

• Backend & API Engineering (60% Focus)
• Design and implement REST APIs and microservices for high-performance AI systems.
• Apply enterprise object-oriented programming best practices for secure, scalable backend services.
• Integrate AI-powered features with cloud-native architectures.
• Generative AI & LLM Development (40% Focus)
• Build LLM-powered features with the OpenAI API or other LLM APIs (reasoning and non-reasoning models, temperature tuning, version control).
• Implement retrieval-augmented generation (RAG).
• Apply advanced prompt engineering and model tuning techniques for optimized results.
• Deploy and manage solutions using Docker and secure integrations (e.g., SSO, Google Drive).

What We’re Looking For

• 10+ years of backend engineering experience (REST APIs, microservices, OO enterprise architecture).
• 3+ years of experience building AI/ML solutions (LLMs, RAG, OpenAI API).
• Strong hands-on Python expertise and object-oriented design patterns.
• Hands-on experience with Langchain, Lambda, Docker, and secure system integrations.
• Proven track record delivering production-ready, scalable applications.

 Extensive (4+ years) knowledge of web technologies and building large scale web applications​

· Strong proficiency in Java Script​

· Expertise in Object-oriented programming​

· Understanding the fully asynchronous behavior of React.js (Redux)

· Solid understanding of user-centered design principles and MVC/MVP/MVVM patterns specific​

to front- end development​

· Good in problem-solving skills​

· Good in English communication (verbal and written)

Responsibilities:

• The candidate will get an opportunity to work on AI/ML technologies using NodeJS for web applications.
• Deliver high-quality code in a fast-paced customer-facing product.
• Specify, design, and implement the functionality and behaviors of the web infrastructure.
• Be involved in the full life-cycle of development from concept through integration, test, and high web traffic deployments.
• Interface with the firmware team as well as clients and end-users of the products.
• API development using REST JSON/XML, and security standards like OAuth.

Requirements:

• BTech or MTech in Computer Engineering, Computer Science, or other similar majors.
• Experience building products with full-stack technologies, and an excellent understanding of computer science fundamentals, data structures, and algorithms.
• Must have experience in version control systems like GIT.
• Strong in NodeJS, MySQL, MongoDB, Kafka, Elasticsearch.

• Leading a team of researchers in certain projects, if and when required by the business
• Understanding the competitive landscape within each market
• Proposing research studies that will lead to impactful business decisions
• Developing and establishing a well-defined roadmap before starting a research project
• Working hand-in-hand with the business in understanding the various market, economic or such questions which are to be answered through relevant research
• Designing the research methodology and also Identifying and locating relevant information related to the particular research
• Identifying various data sources, collecting and analyzing data relevant to the research topic and also supporting in report-writing
• Performing statistical and qualitative analysis of data related to markets and competitors
• Planning and implementing project research processes and methodologies
• Monitoring the project output, analyzing the final conclusion and utility of the same in line with the business needs

• Masters in Economics or Public Policy is a must
• 3 – 5 years of experience in managing research process and outcomes
• Excellent communication skills and exceptional attention to details
• Ability to gather relevant data from various sources
• Strong problem-solving skills
• Strong quantitative and qualitative analysis skills
• Experience in leading a team of researchers is preferred    

• Design AWS data ingestion frameworks and pipelines based on the specific needs driven by the Product Owners and user stories…
• Experience building Data Lake using AWS and Hands-on experience in S3, EKS, ECS, AWS Glue, AWS KMS, AWS Firehose, EMR
• Experience Apache Spark Programming with Databricks
• Experience working on NoSQL Databases such as Cassandra, HBase, and Elastic Search
• Hands on experience with leveraging CI/CD to rapidly build & test application code
• Expertise in Data governance and Data Quality
• Experience working with PCI Data and working with data scientists is a plus
• At least 4+ years of experience in the following Big Data frameworks: File Format (Parquet, AVRO, ORC), Resource Management, Distributed Processing and RDBMS
• 5+ years of experience on designing and developing Data Pipelines for Data Ingestion or Transformation using AWS technologies