Technical Delivery / Project Coordination Intern (Scrum & QA Focus)

Position: Lead / Senior Data Engineer

Location: Chennai

Shift: US Eastern Time ( 5:00 PM – 2:00 AM )

Experience : 8+ years overall

Interviews: Assessment || 2 Interview rounds.

Job Description:

Job title : Lead / Senior Data Engineer

Experience: 8+ years

Location: Chennai(Onsite)

Roles and Responsibilities:

Role Overview

The Lead Data Engineer will be responsible for designing, developing, and delivering high-quality software and data solutions while leading a team of engineers. The role involves hands-on technical work, architectural decision-making, mentoring junior developers, and collaborating with cross-functional teams to ensure successful delivery of scalable data platforms and analytical solutions.

Key Responsibilities

Lead the end-to-end design, development, and delivery of software systems, data pipelines, and components.

Define technical strategy, architecture, and best practices for development and data engineering.

Design and build optimized data pipelines using cutting-edge technologies in a cloud environment.

Construct infrastructure for efficient ETL processes from various sources and storage systems.

Architect, design, and maintain database pipeline architectures, ensuring readiness for AI/ML transformations.

Lead the implementation of algorithms and prototypes to transform raw data into useful information.

Review code for quality, scalability, and performance.

Collaborate with Product Managers, Business Managers, Designers, and QA teams to translate business requirements into technical solutions.

Develop analytical tools, programs, and reporting mechanisms.

Create data validation methods and data analysis tools.

Interpret data trends and patterns to establish operational alerts.

Conduct complex data analysis and present results effectively.

Prepare data for prescriptive and predictive modeling.

Ensure compliance with data governance and security policies.

Troubleshoot, debug, and resolve complex technical issues.

Drive continuous improvement in software and data development processes, tools, and methodologies.

Mentor and guide engineers through code reviews, technical discussions, and training.

Ensure timely delivery of projects while maintaining high engineering standards.

Continuously explore opportunities to enhance data quality and reliability.

Apply strong programming and problem-solving skills to develop scalable solutions.

Demonstrate passion for testing strategy, problem-solving, and continuous learning.

Willingness to acquire new skills and knowledge.

Possess a product/engineering mindset to drive impactful data solutions.

Experience working in distributed environments with global teams.

Stay current with emerging technologies and industry trends to propose innovative solutions.

Technical Skills and Experience Requirements

Minimum 8+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines.

High proficiency in Python, Scala, and Spark for applied large-scale data processing.

Expertise with big data technologies, including Spark, Data Lake, Delta Lake, and Hive.

Solid understanding of batch and streaming data processing techniques.

Proficient knowledge of the Data Lifecycle Management process, including data collection, access, use, storage, transfer, and deletion.

Expert-level ability to write complex, optimized SQL queries across extensive data volumes.

Experience with RDBMS and OLAP databases such as MySQL and Snowflake.

Familiarity with Agile methodologies.

Obsession for service observability, instrumentation, monitoring, and alerting.

Knowledge or experience in architectural best practices for building data lakes.

Qualifications - Bachelor’s degree in computer science, Engineering, Information Systems, or related field.

• Need candidate having 4–7 years of total experience, with a minimum of 4 years in a full-time DevOps role.
• Candidate should have Hands-on experience with major cloud platforms (GCP, AWS, Azure, OCI), more than one will be a plus.
• Candidate should have Scripting skills in Python and shell scripting
• Candidate should have Solid understanding of CI/CD concepts.
• Candidate should be Proficient in Kubernetes

Candidate must have 4–7 years of experience in analytics / business analytics roles.

2. Candidate must have current or recent experience in a fast-growing startup environment.

3. Candidate must have hands-on experience with Python and SQL.

4. Candidate must have experience working with databases/APIs (Mongo, Presto, REST or similar).

5. Candidate must have experience building dashboards/visualizations (Tableau, Metabase or similar).

6. Candidate must be available for face-to-face interviews in Bangalore.

7. Candidate must have experience working closely with business, product, and operations teams.

8. Candidate from large MNCs and Big4 firms will not be considered for this role.

9. . Candidate must be currently based in Bangalore only (no relocation allowed

Must have handled at least one project of medium to high complexity of migrating ETL pipelines and data warehouses to cloud.

Min 3 years of experience with premium consulting companies.

mandatory experience in GCP.

Experience in developing applications using .Net Core Ver. 6/7, ASP.Net MVC (C#), .Net Core Web API & Web App, Web Services, OOPS, SOLID principles.

Experience in software development and system architecture with Microsoft technologies.

Able to integrate the database objects with the Microservices.

Expert working knowledge of Multi-threading.

Solid experience in converting .NET Framework multi-threaded services into .NET Core.

Worked as part of a cross-functional team on code reviews, internal infrastructure, and process enhancement.

Understanding of CI/CD pipeline is mandatory.

Strong hands-on experience with C# and solid principles.

Expertise in entity framework core with code first approach.

Expertise in writing RESTful services.

Knowledge of RDBMS concepts.

Job Description:

Proven experience as a Java Developer with a strong understanding of Java and its ecosystems.

Proficient in Spring Framework (Spring Boot, Spring MVC, Spring Data).

Experience with web application development using technologies such as HTML, CSS, and JavaScript.

Knowledge of relational databases (e.g., MySQL, PostgreSQL) and ORM frameworks (e.g., Hibernate).

Familiarity with build tools such as Maven or Gradle.

Understanding of software development life cycle (SDLC) and agile methodologies.

Excellent problem-solving and debugging skills.

Experience with microservices architecture.

Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes).

Candidate should also have some App development experience in cloud infra. Like familiarity with Docker, Helm Charts, Kubernetes or AWS/Azure k8s infra.

Candidate should have some App development experience in at least one No-SQL Database also (like MongoDB or Cassandra or Redis) apart from RDBMS.

Duties/ Responsibilities

• Performing exhaustive research to gain in-depth knowledge of all customer personas
• Creating specifications and content appropriate for the brand's customer personas
• Planning the editorial calendar and content proposition
• Developing content governance guidelines for tone, style, and voice of all content, and ensuring they are followed
• This role is 50/50 conceptualizing and executing. You must be able to not only ideate and pitch your own create concepts to your peers and management, but also work with a team to execute others’ ideas when needed.
  
  Collaborate as part of a small, agile video team producing original video content for digital platforms from script to shoot to edit and delivery.
  
  Create content for social channels, with a clear understanding of how users engage with social creative across formats and platforms.
  
  Develop best practices and expertise around creating, publishing and distributing videos specific to various digital platforms, and train teammates in those best practices.
  
  Qualifications / Skills :
  
  5+ years of experience in a creative agency, production company, or in-house at a brand pitching and editing video content for social and digital channels.
  
  Should have a proven track record of creating content for a company/ Individual.
  
  Detail-oriented, fast learner, and able to manage your own time.
  
  Can effectively cope with change, shift gears comfortably, decide and act without having the total picture. Cut your own way through ambiguity and engaging management smartly when needed.

Benefits:

• This is a full time position, working from office. Office Address: Lexicon International School, Kalyani nagar, Pune.
• Transportation reimbursement is available.
• Medical Insurance available.
• Leadership & Development training for all manager-level employees
• Salary will be as per the skills and the experience of the applicant.