Data Engineer

Role & Responsibilities

Responsibilities

• Contribute to the development and optimization of enterprise-wide search systems and models.

• Design and implement algorithms to improve indexing, query relevance, and search accuracy.

• Support taxonomy, ontology, and metadata model creation for better search outcomes.

• Collaborate with business units (Loans, Insurance, Investments) to build AI-enabled search features.

• Conduct analysis of user behavior and system metrics to refine search performance.

• Work with engineers, product managers, and designers to deliver integrated search solutions.

• Develop production-grade ML systems for ranking, personalization, and recommendations.

• Participate in proof-of-concept initiatives with internal and external partners.

• Follow best practices in software engineering including CI/CD, testing, and monitoring.

• Keep abreast of emerging developments in AI/ML to apply them in practical solutions.

Ideal Candidate

Strong Data Scientist / AI Engineer / Machine Learning Engineer profiles.

Mandatory (Experience 1) – Must have minimum 5+ years of hands-on experience in Data Science, Machine Learning, Applied AI, NLP, Deep Learning, or Generative AI solutions.

Mandatory (Experience 2) – Must have strong hands-on experience in Python programming, SQL, data analysis, feature engineering, model development, and production-grade ML applications.

Mandatory (Experience 3) – Must have experience working with Machine Learning and Deep Learning frameworks such as PyTorch, TensorFlow, Keras, Scikit-learn, or equivalent.

Mandatory (Experience 4) – Must have hands-on experience working on NLP, embeddings, semantic search, text classification, document understanding, recommendation systems, or similar AI/ML use cases.

Mandatory (Experience 5) – Must have experience working with Large Language Models (LLMs) such as GPT, Llama, Mistral, Claude, Gemini, Phi, or similar foundation models.

Mandatory (Experience 6) – Must have hands-on experience building or implementing RAG (Retrieval Augmented Generation) systems, vector search, knowledge retrieval, embeddings, chunking, indexing, or semantic retrieval solutions.

Mandatory (Experience 7) – Must have experience working with Git, CI/CD practices, production environments, and scalable AI/ML systems.

Mandatory (CTC) – The CTC breakup offered will be 75% fixed + 25% variable, as per company policy.

Mandatory (Age) - Candidate's Age should be below 30 Years

Preferred (Experience 1) – Experience with MLFlow, Kubeflow, Airflow, Prefect, Feature Stores, Model Registry, or MLOps/LLMOps frameworks.

Preferred (Experience 2) – Experience working with Vector Databases, Spark, PySpark, distributed ML pipelines, large-scale data processing, or real-time ML systems..

Preferred (Experience 3) – Familiarity with Docker, Kubernetes, Azure, AWS, GCP, cloud-native AI deployments, and scalable ML architecture.

Preferred (Company) – Candidates from AI-first startups, Fintech, Banking, Lending, Fraud Analytics, Risk Analytics, Product Companies, SaaS organizations, or data-driven technology companies.

Kindly provide the following details while sending your CV: (Mandatory details)

1) Date of Birth

2) Current Location-

3) Current CTC-

4) Expected CTC-

5) Notice Period-

6) Ready to relocate to Pune?

Regards,

The Supreme Consultancy

Website- https://lnkd.in/eawfxfxU

Description

We’re seeking a highly skilled, execution-focused Senior Data Scientist with a minimum of 5 years of experience. This role demands hands-on expertise in building, deploying, and optimizing machine learning models at scale, while working with big data technologies and modern cloud platforms. You will be responsible for driving data-driven solutions from experimentation to production, leveraging advanced tools and frameworks across Python, SQL, Spark, and AWS. The role requires strong technical depth, problem-solving ability, and ownership in delivering business impact through data science.

Responsibilities

• Design, build, and deploy scalable machine learning models into production systems.
• Develop advanced analytics and predictive models using Python, SQL, and popular ML/DL frameworks (Pandas, Scikit-learn, TensorFlow, PyTorch).
• Leverage Databricks, Apache Spark, and Hadoop for large-scale data processing and model training.
• Implement workflows and pipelines using Airflow and AWS EMR for automation and orchestration.
• Collaborate with engineering teams to integrate models into cloud-based applications on AWS.
• Optimize query performance, storage usage, and data pipelines for efficiency.
• Conduct end-to-end experiments, including data preprocessing, feature engineering, model training, validation, and deployment.
• Drive initiatives independently with high ownership and accountability.
• Stay up to date with industry best practices in machine learning, big data, and cloud-native deployments.

Requirements

• Minimum 5 years of experience in Data Science or Applied Machine Learning.
• Strong proficiency in Python, SQL, and ML libraries (Pandas, Scikit-learn, TensorFlow, PyTorch).
• Proven expertise in deploying ML models into production systems.
• Experience with big data platforms (Hadoop, Spark) and distributed data processing.
• Hands-on experience with Databricks, Airflow, and AWS EMR.
• Strong knowledge of AWS cloud services (S3, Lambda, SageMaker, EC2, etc.).
• Solid understanding of query optimization, storage systems, and data pipelines.
• Excellent problem-solving skills, with the ability to design scalable solutions.
• Strong communication and collaboration skills to work in cross-functional teams.

Benefits

• Best-in-class salary: We hire strong talent and compensate accordingly.
• Proximity Talks: Meet and learn from designers, engineers, product leaders, and AI practitioners.
• Continuous learning: Work with a world-class team and stay close to the latest in AI, engineering, and product development.
• High-impact work: Build AI-first systems and products used at scale by global clients.

About Us

Proximity is the trusted technology, design, and consulting partner for some of the biggest Sports, Media, and Entertainment companies in the world. We’re headquartered in San Francisco and have offices in Palo Alto, Dubai, Mumbai, and Bangalore.

Since 2019, Proximity has built high-impact, scalable products used by millions of users every day. Today, we are a global team of engineers, designers, product managers, and experts solving complex problems and building cutting-edge technology at scale.