Cutshort logo
InfoCepts logo
Big Data Developer
Big Data Developer
InfoCepts's logo

Big Data Developer

Lalsaheb Bepari's profile picture
Posted by Lalsaheb Bepari
7 - 10 yrs
₹5L - ₹15L / yr
Chennai, Pune, Nagpur
Skills
Spark
Hadoop
Big Data
Data engineering
PySpark
ETL
Teradata
Linux/Unix
SQL
Data Warehouse (DWH)

Responsibilities:

 

• Designing Hive/HCatalog data model includes creating table definitions, file formats, compression techniques for Structured & Semi-structured data processing

• Implementing Spark processing based ETL frameworks

• Implementing Big data pipeline for Data Ingestion, Storage, Processing & Consumption

• Modifying the Informatica-Teradata & Unix based data pipeline

• Enhancing the Talend-Hive/Spark & Unix based data pipelines

• Develop and Deploy Scala/Python based Spark Jobs for ETL processing

• Strong SQL & DWH concepts.

 

Preferred Background:

 

• Function as integrator between business needs and technology solutions, helping to create technology solutions to meet clients’ business needs

• Lead project efforts in defining scope, planning, executing, and reporting to stakeholders on strategic initiatives

• Understanding of EDW system of business and creating High level design document and low level implementation document

• Understanding of Big Data Lake system of business and creating High level design document and low level implementation document

• Designing Big data pipeline for Data Ingestion, Storage, Processing & Consumption

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About InfoCepts

Founded :
2004
Type :
Services
Size :
1000-5000
Stage :
Profitable

About

Exclusively Focused on Data & Analytics, InfoCepts Builds Products and Services to Automate, Accelerate and Scale Your Analytics Successes
Read more

Company social profiles

bloglinkedintwitterfacebook

Similar jobs

NeoGenCode Technologies Pvt Ltd
Remote only
3 - 12 yrs
₹1L - ₹6L / yr
Generative AI
Artificial Intelligence (AI)
Large Language Models (LLM)
Natural Language Processing (NLP)
Windows Azure
+2 more

Job Title : AI Engineer / Gen AI Engineer (LLM/NLP)

Location : Remote

Duration : Long-term Contract

Openings : 2

Job Description :

We are looking for two AI Engineers with expertise in Generative AI, LLMs, and NLP. One of them must have a strong Azure background and be well-versed in Azure AI services.

Key Requirements :

  • Experience in Generative AI, LLMs, and NLP
  • Azure AI Expertise (For one of the roles):
  • Azure AI Search
  • Azure AI Document Intelligence
  • Azure AI Foundry
  • Development & deployment of RAG-based chatbots and AI agents using Azure AI
  • Programming : Python (Intermediate to Expert Level)
Read more
Quantiphi
at Quantiphi
3 candid answers
1 video
Nikita Sinha
Posted by Nikita Sinha
Bengaluru (Bangalore)
4 - 8 yrs
Best in industry
Large Language Models (LLM)
Retrieval Augmented Generation (RAG)
Generative AI (GenAI)
MLOps
Google Vertex AI

We are looking for a hands-on Generative AI Engineer to design, build, and deploy enterprise-grade GenAI platform capabilities across multiple business units.

This role focuses on developing scalable, reusable AI components across the full stack—covering RAG systems, agent orchestration, LLM infrastructure, and GenAIOps—on GCP (primary) and Azure.

This is a core engineering role, not a research or client-facing position.


Key Responsibilities

  • Design and build production-ready GenAI systems and platform components
  • Develop and deploy RAG pipelines (data ingestion, embeddings, retrieval, APIs)
  • Implement agent-based architectures (orchestration, routing, memory, workflows)
  • Build and manage LLM infrastructure (model routing, caching, rate limiting, observability)
  • Develop scalable APIs and services for AI capabilities
  • Implement GenAIOps/MLOps practices (prompt management, evaluation, monitoring, deployment)
  • Work with GCP services (Vertex AI, BigQuery, Cloud Run, GKE, Pub/Sub) to deploy solutions
  • Ensure AI safety, governance, and compliance (PII protection, guardrails, auditability)
  • Collaborate with cross-functional teams to deliver reusable, enterprise-grade solutions

Required Skills & Experience

  • Strong hands-on experience in Generative AI and RAG systems (production level)
  • Experience building multi-agent or agentic AI systems
  • Proficiency in Python and backend/API development
  • Hands-on experience with GCP AI/ML ecosystem (Vertex AI, BigQuery, etc.)
  • Solid understanding of LLM infrastructure and orchestration layers
  • Experience with CI/CD pipelines and Infrastructure as Code (Terraform)
  • Knowledge of GenAIOps/MLOps practices and model lifecycle management
  • Understanding of AI safety, governance, and compliance

Nice to Have

  • Experience with LangChain, LlamaIndex, or similar frameworks
  • Familiarity with RAG evaluation tools (RAGAS, DeepEval)
  • Knowledge of Knowledge Graphs with RAG
  • Experience in multi-cloud environments (GCP + Azure)
  • Exposure to BFSI/regulated domains

What We’re Looking For

  • Engineers who have built and deployed real-world GenAI systems at scale
  • Strong backend and systems-thinking mindset
  • Ability to work in fast-paced, enterprise environments

Role Type

  • Individual Contributor (IC)
  • Platform Engineering / Backend-heavy GenAI role
Read more
Egnyte
at Egnyte
4 recruiters
John Vivek
Posted by John Vivek
Remote only
8 - 17 yrs
Best in industry
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJavascript
+7 more

Job Duties and Responsibilities:

  • Technical Leadership:
  • Provide technical leadership by guiding and mentoring software engineers in creating robust and scalable solutions.
  • Lead the recruitment process to identify and onboard top-tier engineering talent.
  • Foster a culture of continuous learning and growth within the technical team.
  • Architectural Vision:
  • Collaborate closely with engineering leadership, senior technical stakeholders, and product managers to shape the architectural vision and ensure alignment with business goals.
  • Actively participate in code reviews and technical design discussions and contribute hands-on expertise to development efforts.
  • Drive the evolution of development processes, establish meaningful metrics, and cultivate a team culture emphasizing technical excellence.
  • Lead POCs and technical evaluations
  • Hands-on Technical Involvement:
  • Demonstrate deep technical involvement through direct contributions to the codebase, technical design discussions, and the development of domain expertise.
  • Utilize your extensive experience to guide the team in developing large-scale distributed systems, employing languages such as Java, Python, C++, Ruby, Go, or JavaScript.
  • Process Evolution and DevOps:
  • Innovate and evolve development processes to enhance efficiency and agility.
  • Leverage a background in DevOps to oversee the operational aspects of widely deployed SaaS products.
  • Implement and optimize CI/CD environments for seamless software delivery.

 

Must-Have:

  • Managerial and Technical Expertise:
  • Possess 3+ years of managerial experience and a solid 10+ years of professional experience in software engineering.
  • Demonstrate prior success in leading and growing cross-functional development teams of 10-20 individual contributors.
  • Software Delivery Excellence:
  • Proven track record of delivering high-quality software within tight deadlines, emphasizing agility in a collaborative and cross-functional environment.
  • Technical Proficiency:
  • Hands-on experience developing and designing large-scale distributed systems using languages like Java, Python, C++, Ruby, Go, or JavaScript.
  • DevOps and SaaS Background:
  • Background in DevOps with experience in the operation of widely deployed SaaS products.
  • Communication and Organization:
  • Exceptional organizational skills and effective interpersonal, verbal, and written communication skills.

 

Nice to Have:

  • CI/CD and Cloud Platform Experience:
  • Previous experience in designing CI/CD environments.
  • Familiarity with Google Cloud Platform, Amazon Web Services, or equivalent cloud platforms.
  • Data-Driven Decision Making:
  • Demonstrated experience using data to measure success, drive improvements, and inform strategic decisions.
  • Global Team Collaboration:
  • Previous experience working on geographically dispersed teams.


Read more
FindingPi Inc
at FindingPi Inc
1 recruiter
Mrinmayee Bandopadhyay
Posted by Mrinmayee Bandopadhyay
ShivajiNager
4 - 6 yrs
₹6L - ₹15L / yr
skill iconDocker
skill iconKubernetes
DevOps
skill iconAmazon Web Services (AWS)
Windows Azure
+1 more

About the role:

 

We are seeking a highly skilled Azure DevOps Engineer with a strong background in backend development to join our rapidly growing team. The ideal candidate will have a minimum of 4 years of experience and has have extensive experience in building and maintaining CI/CD pipelines, automating deployment processes, and optimizing infrastructure on Azure. Additionally, expertise in backend technologies and development frameworks is required to collaborate effectively with the development team in delivering scalable and efficient solutions.

 

Responsibilities

 

  • Collaborate with development and operations teams to implement continuous integration and deployment processes.
  • Automate infrastructure provisioning, configuration management, and application deployment using tools such as Ansible, and Jenkins.
  • Design, implement, and maintain Azure DevOps pipelines for continuous integration and continuous delivery (CI/CD)
  • Develop and maintain build and deployment pipelines, ensuring that they are scalable, secure, and reliable.
  • Monitor and maintain the health of the production infrastructure, including load balancers, databases, and application servers.
  • Automate the software development and delivery lifecycle, including code building, testing, deployment, and release.
  • Familiarity with Azure CLI, Azure REST APIs, Azure Resource Manager template, Azure billing/cost management and the Azure Management Console
  • Must have experience of any one of the programming language (Java, .Net, Python )
  • Ensure high availability of the production environment by implementing disaster recovery and business continuity plans.
  • Build and maintain monitoring, alerting, and trending operational tools (CloudWatch, New Relic, Splunk, ELK, Grafana, Nagios).
  • Stay up to date with new technologies and trends in DevOps and make recommendations for improvements to existing processes and infrastructure.
  • ontribute to backend development projects, ensuring robust and scalable solutions.
  • Work closely with the development team to understand application requirements and provide technical expertise in backend architecture.
  • Design and implement database schemas.
  • Identify and implement opportunities for performance optimization and scalability of backend systems.
  • Participate in code reviews, architectural discussions, and sprint planning sessions.
  • Stay updated with the latest Azure technologies, tools, and best practices to continuously improve our development and deployment processes.
  •  
  • Mentor junior team members and provide guidance and training on best practices in DevOps.

 

 

Required Qualifications

  • BS/MS in Computer Science, Engineering, or a related field
  • 4+ years of experience as an Azure DevOps Engineer (or similar role) with experience in backed development.
  • Strong understanding of CI/CD principles and practices.
  • Expertise in Azure DevOps services, including Azure Pipelines, Azure Repos, and Azure Boards.
  • Experience with infrastructure automation tools like Terraform or Ansible.
  • Proficient in scripting languages like PowerShell or Python.
  • Experience with Linux and Windows server administration.
  • Strong understanding of backend development principles and technologies.
  • Excellent communication and collaboration skills.
  • Ability to work independently and as part of a team.
  • Problem-solving and analytical skills.
  • Experience with industry frameworks and methodologies: ITIL/Agile/Scrum/DevOps
  • Excellent problem-solving, critical thinking, and communication skills.
  • Have worked in a product based company.

 

What we offer:

  • Competitive salary and benefits package
  • Opportunity for growth and advancement within the company
  • Collaborative, dynamic, and fun work environment
  • Possibility to work with cutting-edge technologies and innovative projects


Read more
Nihilent
at Nihilent
1 recruiter
Suwarna Salve
Posted by Suwarna Salve
Pune
4 - 16 yrs
₹4L - ₹28L / yr
skill iconAngular (2+)
skill iconAngularJS (1.x)
skill iconHTML/CSS
User Interface (UI) Development
https://www.linkedin.com/feed/hashtag/?keywords=nihilent&;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A6997793131630878721">#Nihilent is https://www.linkedin.com/feed/hashtag/?keywords=hiring&;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A6997793131630878721">#Hiring!!
We are looking for https://www.linkedin.com/feed/hashtag/?keywords=angular&;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A6997793131630878721">#angular  https://www.linkedin.com/feed/hashtag/?keywords=angulardeveloper&;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A6997793131630878721">#Angulardeveloper https://www.linkedin.com/feed/hashtag/?keywords=frontend&;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A6997793131630878721">#frontend  #frontenddevelopment #angulardevelopment

Location: #VimanNagarPune

Exp: 4=yrs
WFO Mandate
No WFH
Read more
CrioDo
at CrioDo
2 recruiters
Ananya Bhuyan
Posted by Ananya Bhuyan
Bengaluru (Bangalore)
3 - 6 yrs
₹10L - ₹15L / yr
Program Management
IT program management
skill iconJava
skill iconSpring Boot
skill iconHTML/CSS
+7 more

As a Technical Program Manager in this team, you will own one of our Learning Tracks end to end:

1. Backend Developer Track (Java, Springbot, OOP, LLD, HLD)
2. Full Stack Developer Track (HTML, CSS, JS, MERN Stack)
3. QA Automation track (Java, Selenium, TestNG, Cucumber, API Testing) Refer to the Curriculum pages at Crio for the full details of each track - Crio Programs
4. Your goal is to make that track the best learning experience in the world.
5. You will be making a difference in thousands of careers in this role. You will get to experience working at a startup with some of the brightest and most enthusiastic minds.

*In this role, you will work closely with multiple stakeholders and teams across Crio. Crio is on a sharp growth trajectory, having already grown 3x in the past few months. This provides a massive opportunity for new hires to take up challenges and scale quickly with the company.

https://www.linkedin.com/feed/hashtag/?keywords=role&;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7005446995368697856">#Role and Responsibilities:
1. Full ownership of the Learning Track.
2. Make the best possible learning track in the market.
3. Analyze the track metrics and identify areas for improvement, address these and drive/execute the necessary improvements
4. Focus areas include learning outcomes, jobs outcomes and graduation rates.
5. Work closely with the growth team, delivery team, subject matter experts, mentors and external companies.
6. Handle B2B requirements for these courses.
7. Grow and pick up additional skills and responsibilities, including creation and ownership of additional tracks or categories
8. Drive continuous improvement in Session Quality and Mentoring quality
9. Own the processes and tools for the track
10. Learning outcome definitions
11. Interviews/Onboarding and Certification for Mentors, SMEs, Teaching Assistants and Project Engineers
12. Mocks/Revisions/P2P interviews/Interview Preparation for our learners
13. Lead a team of Product Engineers for curriculum work
14. Work with Production team to productionalize/standardize/visualize content
15. Consume feedback from learners, mentors, creators and learner interviews. Address them effectively
16. Do market research and work with SMEs to keep the track relevant to the evolving industry

https://www.linkedin.com/feed/hashtag/?keywords=qualifications&;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7005446995368697856">#Qualifications and Experience
1. 2+ years of coding experience and good familiarity with the tech stack for that track (e.g. HTML, CSS, JS and MERN for our Full Stack Track)
2. Looking to get into Management areas with a background of strong technical knowledge
3. Strong ownership and attention to detail with solid communication skills.
4. 4+ years of software industry experience preferred with experience leading a team Additional Details
5. This is a full-time position
6. Preferred: Candidates who are available to start immediately
7. The office location will be Bangalore

 

Note: *If you are currently looking for a job and want to apply for this position, then you can alos apply through this link below: https://lnkd.in/gk5CxCFA">https://lnkd.in/gk5CxCFA

Read more
Abhidip swastik Private Ltd
Vikas Bhadoria
Posted by Vikas Bhadoria
Remote only
1 - 3 yrs
₹1.8L - ₹2.5L / yr
skill iconAndroid Development
skill iconiOS App Development
skill iconSwift
Cocoa Touch
skill iconKotlin
+5 more
About us

Roles and Responsibilities

  1. Proficiency in Android / Swift with Cocoa Touch
  2. Knowledge of Google Play store Guide lines with Apple Human Interface Guidelines
  3. Familiar with Android Studio with iOS SDK (UIKit, Core Data, Core Location, etc.)
  4. Knowledge of (JSON, XML, SOAP, REST) with Familiarity with RESTful APIs to connect
  5. Android and iOS applications to back-end services.
  6. Knowledge of SQLite, MySQL or similar database management system
  7. Must have sound knowledge in react native.
  8. Familiarity with cloud message APIs and push notifications.
  9. Experience with source control systems (Subversion,Git)
  10. Preference for Mobile App development using React native.
  11. Knowledge of HTML5, JavaScript, jQuery, Ajax is an added advantage.
Read more
Demandshore Solutions Pvt. Ltd.
at Demandshore Solutions Pvt. Ltd.
1 video
1 recruiter
Kartik Narayan
Posted by Kartik Narayan
Pune
2 - 7 yrs
₹2L - ₹6L / yr
skill iconjQuery
Wireframing
prototyping
Adobe Indesign
Adobe Photoshop
MarTech Advisor is the world’s leading source of unbiased news, articles, reviews, research and expert blogs on the forever changing and dynamic MarTech landscape. We are at the threshold of some exciting launches in the digital publication space and are looking for a highly creative and agile UI/UX designer. As the resident designer, you will lead the user experience and interface efforts for the team, ensuring the delivery of a high-quality product for end users. You should be well-versed in new technology, tools and aesthetics with an acute business and creative sense to help deliver on cutting-edge, intuitive and unique user interface designs and experience. Your interfaces and interactions will be critical components which will help users drive business decisions. You will collaborate with internal stakeholders, the development team and Scrum Master to develop, design, build and launch the product. Your responsibilities will include: o Developing conceptual diagrams, creating mock-ups, wireframes and prototypes for both web and mobile pages that the front-end developer can translate into code o Designing the UI architecture, interface, and interaction flow of web and mobile applications o UI design of interactive ads for mobile o Developing and maintaining detailed user-interface specifications o Presenting design work to the product team for review and feedback o Conducting usability studies/user experience research and testing through A/B testing and put together detailed, structured analysis of issues and potential solutions. Qualifications: o Experience in developing UI and UX for desktop and mobile responsive websites o Solid portfolio demonstrating UI/UX design experience o Proficiency with design tools such as Photoshop, Illustrator and In Design o Proficiency with wireframing and prototyping tools (Sketch, Adobe XD, In Vision) o Experience in designing web product interfaces o Experience in Mobile Native App design o Experience in converting user stories / requirements to interface designs o Experience in usability testing and user research o Experience in designing with iOS Human Interface Guidelines and Material Design o Not essential, but weightage will be given to candidates with: - An understanding and ability to prototype - Experience in working with Agile product development environments - Basic HTML/CSS and JavaScript knowledge
Read more
Smart Data Enterprises
at Smart Data Enterprises
3 recruiters
HR smartData Enterprises
Posted by HR smartData Enterprises
Nagpur
3 - 7 yrs
₹3L - ₹7L / yr
NCSS
skill iconPHP
skill iconLaravel
MVC Framework
skill iconJavascript
+1 more
Job opening for the position of Sr. PHP (Laravel) Developer at Dehradun location in smartData Enterprises (I) ltd.Experience : 3+ YearsLocation : Dehradun.Job Description - PHP Developer (Laravel)Roles and responsibilities : 1. Proficient in Laravel development2. Experience as a web developer.3. Understanding of MVC design patterns.4. Proficient in front-end technologies, such as JavaScript, HTML5, and CSS3.5. Knowledge of object oriented PHP programming.6. Understanding accessibility and security compliance.7. Expert in PHP, including MVC Frameworks.8. Experience with Agile product development methodologies.9. Excellent team player with strong communication, interpersonal, and organizational skills.10. Ability to learn new technologies and APIs.11. Strong written and verbal communication skillsDesired candidate profile: - 3 to 8 years of experience in an Internet e-commerce or online content edition company will be an advantage- Excellent knowledge and practice of the following: PHP (Laravel) and Mysql, HTML, CSS, MVC Architecture Framework (Preferably Phalcon/Zend), JavaScript and JavaScript Frameworks - Knowledge of the following would be added advantage: XML, Ajax,Bootstrap- Excellent knowledge on software methodologies- Be committed to the deadlines through following up with team members- Strong organizational and communication skills.Jyoti Sharma Sr. Associate- HR Phone: +91-172-4060079http://www.smartdatainc.com/
Read more
Arque Capital
at Arque Capital
2 recruiters
Hrishabh Sanghvi
Posted by Hrishabh Sanghvi
Mumbai
5 - 11 yrs
₹15L - ₹30L / yr
skill iconC++
Big Data
Technical Architecture
Cloud Computing
skill iconPython
+4 more
ABOUT US: Arque Capital is a FinTech startup working with AI in Finance in domains like Asset Management (Hedge Funds, ETFs and Structured Products), Robo Advisory, Bespoke Research, Alternate Brokerage, and other applications of Technology & Quantitative methods in Big Finance. PROFILE DESCRIPTION: 1. Get the "Tech" in order for the Hedge Fund - Help answer fundamentals of technology blocks to be used, choice of certain platform/tech over other, helping team visualize product with the available resources and assets 2. Build, manage, and validate a Tech Roadmap for our Products 3. Architecture Practices - At startups, the dynamics changes very fast. Making sure that best practices are defined and followed by team is very important. CTO’s may have to garbage guy and clean the code time to time. Making reviews on Code Quality is an important activity that CTO should follow. 4. Build progressive learning culture and establish predictable model of envisioning, designing and developing products 5. Product Innovation through Research and continuous improvement 6. Build out the Technological Infrastructure for the Hedge Fund 7. Hiring and building out the Technology team 8. Setting up and managing the entire IT infrastructure - Hardware as well as Cloud 9. Ensure company-wide security and IP protection REQUIREMENTS: Computer Science Engineer from Tier-I colleges only (IIT, IIIT, NIT, BITS, DHU, Anna University, MU) 5-10 years of relevant Technology experience (no infra or database persons) Expertise in Python and C++ (3+ years minimum) 2+ years experience of building and managing Big Data projects Experience with technical design & architecture (1+ years minimum) Experience with High performance computing - OPTIONAL Experience as a Tech Lead, IT Manager, Director, VP, or CTO 1+ year Experience managing Cloud computing infrastructure (Amazon AWS preferred) - OPTIONAL Ability to work in an unstructured environment Looking to work in a small, start-up type environment based out of Mumbai COMPENSATION: Co-Founder status and Equity partnership
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos