IT Project Manager

Profile - Databricks Developer

Experience- 5+ years

Location- Bangalore (On site)

PF & BGV is Mandatory

Job Description: -

* Design, build, and optimize data pipelines and ETL/ELT workflows using Databricks and Apache Spark (PySpark).

* Develop scalable, high performance data solutions using Spark distributed processing.

* Lead engineering initiatives focused on automation, performance tuning, and platform modernization.

* Implement and manage CI/CD pipelines using Git-based workflows and tools such as GitHub Actions or Jenkins.

* Collaborate with cross-functional teams to translate business needs into technical solutions.

* Ensure data quality, governance, and security across all processes.

* Troubleshoot and optimize Spark jobs, Databricks clusters, and workflows.

* Participate in code reviews and develop reusable engineering frameworks.

* Should have knowledge of utilizing AI tools to improve productivity and support daily engineering activities.

* Strong knowledge and hands-on experience in Databricks Genie, including prompt engineering, workspace usage, and automation

. Required Skills & Experience:

* 5+ years of experience in Data Engineering or related fields.

* Strong hands-on expertise in Databricks (notebooks, Delta Lake, job orchestration).

* Deep knowledge of Apache Spark (PySpark, Spark SQL, optimization techniques).

* Strong proficiency in Python for data processing, automation, and framework development.

* Strong proficiency in SQL, including complex queries, performance tuning, and analytical functions.

* Strong knowledge of Databricks Genie and leveraging it for engineering workflows.

* Strong experience with CI/CD and Git-based development workflows. * Proficiency in data modeling and ETL/ELT pipeline design.

* Experience with automation frameworks and scheduling tools.

* Solid understanding of distributed systems and big data concepts

We are seeking a mature, proactive, and highly capable Senior Java Full Stack Engineer with 4 – 6+ years of mid/senior profile in Java, Full Stack, React, Cloud Services. The ideal candidate can handle multiple challenges independently, think smartly, and build scalable end-to-end applications while also owning architecture and deployment. Passionate about innovation, problem-solving and optimizing system performance.

Must Have Skills

• Java, Spring Boot, Hibernate, REST API, Gradle, Redis
• React JS, Node JS, Vue JS, or TypeScript
• Cloud Services (AWS, VM, Storage, Auth and Auth, Functions, and Deployments) 
• Microservices, Serverless Architecture
• Databases: MySQL, PostgreSQL, MongoDB
• Docker, Container orchestration (Kubernetes)
• API Development & Integration
• Bitbucket or Git-based version control
• Agile/Kanban working model

Good to Have Skills

• Familiarity with AI-powered coding assistants such as GitHub Copilot, Cursor AI, or Lovable AI.
• Basic understanding of Generative AI concepts and prompt engineering.
• Python (Fast API, Django REST Framework, Flask), PY Spark, Pandas
• API Testing Tools (Postman)
• CI/CD Pipelines
• Advanced Cloud Networking & Security
• Automation Testing (Playwright, Selenium) 
• Generative AI (LLMs, RAG Framework, Vector DB, AI Chatbots, Agentic AI)

Preferred Personal Attributes

• Highly proactive and self-driven
• Smart problem solver with strong analytical ability
• Ability to work independently in ambiguous and complex scenarios
• Strong communication & stakeholder management skills
• Ownership mindset and willingness to handle multiple challenges at once

Key Responsibilities

Full Stack Development

• Build and maintain production-grade applications using Java, Microservices, Python, and React/Next.js.
• Develop reusable frontend components and optimized backend services/microservices.
• Ensure clean architecture, maintainability, and code quality.
• Own development across the lifecycle—design, build, testing, deployment.
• Build AI chatbots, automation agents, and intelligent Assistants.
• Apply prompt engineering, fine-tuning, and model evaluation best practices.
• Deploy, manage, and monitor cloud workloads on AWS/Azure/GCP.
• Design and implement serverless architectures, microservices, and event-driven flows.
• Use Docker, CI/CD, and best DevOps practices.
• Ensure scalability, security, cost optimization, and reliability.

Collaboration & Leadership

• Comfortably handle ambiguity, break down problems, and deliver with ownership.
• Lead technical initiatives and mentor junior team members.
• Work closely with cross-functional teams in Agile/Kanban environments.

Job Description

1. Solid technical skills with a proven and successful history working with data at scale and empowering organizations through data
2. Big data processing frameworks: Spark, Scala, Hadoop, Hive, Kafka, EMR with Python
3. Advanced experience and hands-on architecture and administration experience on big data platforms

• Expert level knowledge in Microsoft Active Directory Services (DCS, DNS, and DHCP)
• Expert level knowledge in O365 (Email, OneDrive, SharePoint, and other O365 components)
• Hands-on experience in System Center Configuration Manager (SCCM)
• Experience with Windows Intune as MDM
• Hands-on experience with a hybrid model of exchange environments
• Scripting experience using PowerShell
• Experience building Windows and Mac Imaging
• Experience using VMWare ESX enterprise virtualization platform
• Must have experience with Windows and MAC desktop operating systems
• Must have knowledge of server hardware and operating systems
• Must have knowledge of network connectivity i.e. TCP/IP
• Strong knowledge of server technologies – i.e. Windows 2008 and 2012
• Knowledge of compliance initiatives i.e. SOX, SAS70, PCI, and ITIL
• Experience with JAMF Mac Management system.

• Configures all servers and workstation hardware according to the organization's standards
• Maintains and manages Office365 Platform – including all critical technologies such as email, SharePoint, OneDrive
• Strong knowledge of SCCM including setup, managing, and maintenance of a Global Infrastructure
• Installs upgrades and configures network printing, directory structures, rights, software, and files services
• Group Policy Administration including troubleshooting and management - creation and testing of new policies.
• Provides World Class Customer Service to the company workforce
• Manage IT technical initiatives and coordinate work priorities.
• Mentor other IT team members and provide guidance as necessary.
• Provide strategic guidance and forward-looking solutions with respect to Corporate IT-owned systems and services.
• Provides 24x7 production support to the enterprise via on-call rotation
• Processes requests from internal ticketing systems
• Provides support for compliance initiatives i.e. SOX, SAS70, PCI, and ITIL
• Ensures project documents are complete, current, and stored appropriately
• Prepares and maintains documentation of application and hardware configurations
• Assigns, documents, and maintains computer logins, certificates, passwords, and access profiles for software applications, network access, and telecommunications systems
• Reviews, writes, documents, and tests server and pc hardening policies according to the company Global Security team’s guidelines.
• Diagnoses and repairs servers within both virtual and physical environments
• Installs security identification and apparatus to computer hardware and peripherals
• Assists in troubleshooting servers\desktops within the v-Sphere
• Identifies potential security issues and recommended strategy to ensure site security
• Coordinates third-party maintenance for hardware and software
• Response to needs and questions of users concerning their access to network resources.
• Reviews reports, files, and messages to identify instances of possible security infractions
• Tests computer systems to evaluate the effectiveness of security
• Responds to inquiries regarding data and computer security, policies, and procedures
• Assists in the planning, communication, testing, and implementation of disaster recovery procedures
• Participate in security and application troubleshooting and incident problem resolutions with other infrastructure teams, including storage, messaging, networking, and servers
• User account and Security/Distribution group management

• Provides mentoring and training to other staff members
• Writes process and procedural documentation including requirements
• Researches and evaluates new technologies
• Makes self available to other staff members as a source of information
• Develops and coordinates knowledge transfer
• Interacts with business units to gather, define, and organize the delivery of a business solution

• Works under limited supervision
• Relies on instructions and pre-established guidelines to perform the functions of the job
• Familiar with a variety of the field's concepts, practices, and procedures
• Requires a very high level of technical skill in the field of expertise

• Typically requires 4 to 8 years of related experience
• Preferred certification in Microsoft technologies
• Excellent written and oral communication skills
• Must be able to exchange information with all levels of internal and external customers
• Sets priorities, based on workload, using past experiences as a guideline
• Must have good collaboration skills

What are we looking for:

1. Strong experience in MySQL and writing advanced queries
2. Strong experience in Bash and Python
3. Familiarity with ElasticSearch, Redis, Java, NodeJS, ClickHouse, S3
4. Exposure to cloud services such as AWS, Azure, or GCP
5. 2+ years of experience in the production support
6. Strong experience in log management and performance monitoring like ELK, Prometheus + Grafana, logging services on various cloud platforms
7. Strong understanding of Linux OSes like Ubuntu, CentOS / Redhat Linux
8. Interest in learning new languages / framework as needed
9. Good written and oral communications skills
10. A growth mindset and passionate about building things from the ground up, and most importantly, you should be fun to work with

As a product solutions engineer, you will:

1. Analyze recorded runtime issues, diagnose and do occasional code fixes of low to medium complexity
2. Work with developers to find and correct more complex issues
3. Address urgent issues quickly, work within and measure against customer SLAs
4. Using shell and python scripts, and use scripting to actively automate manual / repetitive activities
5. Build anomaly detectors wherever applicable
6. Pass articulated feedback from customers to the development and product team
7. Maintain ongoing record of the operation of problem analysis and resolution in a on call monitoring system
8. Offer technical support needed in development

• Measure the sales effectiveness efforts using data science/app/digital nudges.
• Should be able to work on the clickstream data
• Should be well versed and willing to work hands-on various Machine Learning techniques

Skills

• Ability to lead a team of 5-6 members.
• Ability to work with large data sets and present conclusions to key stakeholders.
• Develop a clear understanding of the client’s business issue to inform the best approach to the problem.
• Root-cause analysis
• Define data requirements for creating a model and understand the business problem
• Clean, aggregate, analyze, interpret data and carry out quality analysis of it
• Set up data for predictive/prescriptive analysis
• Development of AI/ML models or statistical/econometric models.
• Working along with the team members
• Looking for insight and creating a presentation to demonstrate these insights
• Supporting development and maintenance of proprietary marketing techniques and other knowledge development projects.