11+ ETL architecture Jobs in Bangalore (Bengaluru) | ETL architecture Job openings in Bangalore (Bengaluru)

We are seeking a skilled AWS ETL/ELT Data Architect with a specialization in MongoDB to join our team. The ideal candidate will possess comprehensive knowledge and hands-on experience

in designing, implementing, and managing ETL/ELT processes within AWS while also demonstrating proficiency in MongoDB database management.

This role requires expertise in data architecture, AWS services, and MongoDB to optimize data solutions effectively.

Responsibilities:

● Design, architect, and implement ETL/ELT processes within AWS, integrating data from various sources into data lakes or warehouses, and utilising MongoDB as part of the data ecosystem.

● Collaborate cross-functionally to assess data requirements, analyze sources, and strategize effective data integration within AWS environments, considering MongoDB's role in the architecture.

● Construct scalable and high-performance data pipelines within AWS while integrating MongoDB for optimal data storage, retrieval, and manipulation.

● Develop comprehensive documentation covering data architecture, flows, and the interplay between AWS services, MongoDB, and ETL/ELT processes from scratch.

● Perform thorough data profiling, validation, and troubleshooting, ensuring data accuracy, consistency, and integrity in conjunction with MongoDB management.

● Stay updated with AWS and MongoDB best practices, emerging technologies, and industry trends to propose innovative data solutions and implementations.

● Provide mentorship to junior team members and foster collaboration with stakeholders to deliver robust data solutions.

● Analyze data issues, identify and articulate the business impact of data problems

● Perform code reviews and ensure that all solutions are aligned with pre-defined architectural standards, guidelines, and best practices, and meet quality standards

Qualifications:

● Bachelor's or Master’s degree in Computer Science, Information Technology, or related field.

● Minimum 5 years of hands-on experience in ETL/ELT development, data architecture, or similar roles.

● Having implemented more than a minimum of 3-4 live projects in a similar field would be desirable.

● Expertise in designing and implementing AWS-based ETL/ELT processes using tools like AWS Glue, AWS Data Pipeline, etc.

• Act as primary day-to-day contact on analytics to agency-client leads
• Develop bespoke analytics proposals for presentation to agencies & clients, for delivery within the teams
• Ensure delivery of projects and services across the analytics team meets our stakeholder requirements (time, quality, cost)
• Hands on platforms to perform data pre-processing that involves data transformation as well as data cleaning
  
• Ensure data quality and integrity
  
• Interpret and analyse data problems
  
• Build analytic systems and predictive models
  
• Increasing the performance and accuracy of machine learning algorithms through fine-tuning and further
  
• Visualize data and create reports
  
• Experiment with new models and techniques
  
• Align data projects with organizational goals

• Min 6 - 7 years’ experience working in Data Science
• Prior experience as a Data Scientist within a digital media is desirable
• Solid understanding of machine learning
• A degree in a quantitative field (e.g. economics, computer science, mathematics, statistics, engineering, physics, etc.)
• Experience with SQL/ Big Query/GMP tech stack / Clean rooms such as ADH
• A knack for statistical analysis and predictive modelling
• Good knowledge of R, Python
• Experience with SQL, MYSQL, PostgreSQL databases
• Knowledge of data management and visualization techniques
• Hands-on experience on BI/Visual Analytics Tools like PowerBI or Tableau or Data Studio
• Evidence of technical comfort and good understanding of internet functionality desirable
• Analytical pedigree - evidence of having approached problems from a mathematical perspective and working through to a solution in a logical way
• Proactive and results-oriented
• A positive, can-do attitude with a thirst to continually learn new things
• An ability to work independently and collaboratively with a wide range of teams
• Excellent communication skills, both written and oral

We are looking for an exceptionally talented Lead data engineer who has exposure in implementing AWS services to build data pipelines, api integration and designing data warehouse. Candidate with both hands-on and leadership capabilities will be ideal for this position.

Qualification: At least a bachelor’s degree in Science, Engineering, Applied Mathematics. Preferred Masters degree

Job Responsibilities:

• Total 6+ years of experience as a Data Engineer and 2+ years of experience in managing a team

• Have minimum 3 years of AWS Cloud experience.

• Well versed in languages such as Python, PySpark, SQL, NodeJS etc

• Has extensive experience in the real-timeSpark ecosystem and has worked on both real time and batch processing

• Have experience in AWS Glue, EMR, DMS, Lambda, S3, DynamoDB, Step functions, Airflow, RDS, Aurora etc.

• Experience with modern Database systems such as Redshift, Presto, Hive etc.

• Worked on building data lakes in the past on S3 or Apache Hudi

• Solid understanding of Data Warehousing Concepts

• Good to have experience on tools such as Kafka or Kinesis

• Good to have AWS Developer Associate or Solutions Architect Associate Certification

• Have experience in managing a team

About Us

Mindtickle provides a comprehensive, data-driven solution for sales readiness and enablement that fuels revenue growth and brand value for dozens of Fortune 500 and Global 2000 companies and hundreds of the world’s most recognized companies across technology, life sciences, financial services, manufacturing, and service sectors.

With purpose-built applications, proven methodologies, and best practices designed to drive effective sales onboarding and ongoing readiness, mindtickle enables company leaders and sellers to continually assess, diagnose and develop the knowledge, skills, and behaviors required to engage customers and drive growth effectively. We are funded by great investors, like – Softbank, Canaan partners, NEA, Accel Partners, and others.

Job Brief

We are looking for a rockstar researcher at the Center of Excellence for Machine Learning. You are responsible for thinking outside the box, crafting new algorithms, developing end-to-end artificial intelligence-based solutions, and rightly selecting the most appropriate architecture for the system(s), such that it suits the business needs, and achieves the desired results under given constraints.

Credibility:

• You must have a proven track record in research and development with adequate publication/patenting and/or academic credentials in data science.
• You have the ability to directly connect business problems to research problems along with the latest emerging technologies.

Strategic Responsibility:

• To perform the following: understanding problem statements, connecting the dots between high-level business statements and deep technology algorithms, crafting new systems and methods in the space of structured data mining, natural language processing, computer vision, speech technologies, robotics or Internet of things etc. 
• To be responsible for end-to-end production level coding with data science and machine learning algorithms, unit and integration testing, deployment, optimization and fine-tuning of models on cloud, desktop, mobile or edge etc.
• To learn in a continuous mode, upgrade and upskill along with publishing novel articles in journals and conference proceedings and/or filing patents, and be involved in evangelism activities and ecosystem development etc.
• To share knowledge, mentor colleagues, partners, and customers, take sessions on artificial intelligence topics both online or in-person, participate in workshops, conferences, seminars/webinars as a speaker, instructor, demonstrator or jury member etc.
• To design and develop high-volume, low-latency applications for mission-critical systems and deliver high availability and performance.
• To collaborate within the product streams and team to bring best practices and leverage world-class tech stack.
• To set up every essentials (tracking / alerting) to make sure the infrastructure / software built is working as expected.
• To search, collect and clean Data for analysis and setting up efficient storage and retrieval pipelines.

Personality:

• Requires excellent communication skills – written, verbal, and presentation.
• You should be a team player.
• You should be positive towards problem-solving and have a very structured thought process to solve problems.
• You should be agile enough to learn new technology if needed.

Qualifications:

• B Tech / BS / BE / M Tech / MS / ME in CS or equivalent from Tier I / II or Top Tier Engineering Colleges and Universities.
• 6+ years of strong software (application or infrastructure) development experience and software engineering skills (Python, R, C, C++ / Java / Scala / Golang).
• Deep expertise and practical knowledge of operating systems, MySQL and NoSQL databases(Redis/couchbase/mongodb/ES or any graphDB).
• Good understanding of Machine Learning Algorithms, Linear Algebra and Statistics.
• Working knowledge of Amazon Web Services(AWS).
• Experience with Docker and Kubernetes will be a plus.
• Experience with Natural Language Processing, Recommendation Systems, or Search Engines.

Our Culture

As an organization, it’s our priority to create a highly engaging and rewarding workplace. We offer tons of awesome perks, great learning opportunities & growth.

Our culture reflects the globally diverse backgrounds of our employees along with our commitment to our customers, each other, and a passion for excellence.

To know more about us, feel free to go through these videos:

1. Sales Readiness Explained: https://www.youtube.com/watch?v=XyMJj9AlNww&;t=6s

2. What We Do: https://www.youtube.com/watch?v=jv3Q2XgnkBY

3. Ready to Close More Deals, Faster: https://www.youtube.com/watch?v=nB0exreVU-s

To view more videos, please access the below-mentioned link:

https://www.youtube.com/c/mindtickle/videos

Mindtickle is proud to be an Equal Opportunity Employer

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability, protected veteran status, or any other characteristic protected by law.

Your Right to Work - In compliance with applicable laws, all persons hired will be required to verify identity and eligibility to work in the respective work locations and to complete the required employment eligibility verification document form upon hire.

Data Engineer- Senior

Cubera is a data company revolutionizing big data analytics and Adtech through data share value principles wherein the users entrust their data to us. We refine the art of understanding, processing, extracting, and evaluating the data that is entrusted to us. We are a gateway for brands to increase their lead efficiency as the world moves towards web3.

What are you going to do?

Design & Develop high performance and scalable solutions that meet the needs of our customers.

Closely work with the Product Management, Architects and cross functional teams.

Build and deploy large-scale systems in Java/Python.

Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

Create data tools for analytics and data scientist team members that assist them in building and optimizing their algorithms.

Follow best practices that can be adopted in Bigdata stack.

Use your engineering experience and technical skills to drive the features and mentor the engineers.

What are we looking for ( Competencies) :

Bachelor’s degree in computer science, computer engineering, or related technical discipline.

Overall 5 to 8 years of programming experience in Java, Python including object-oriented design.

Data handling frameworks: Should have a working knowledge of one or more data handling frameworks like- Hive, Spark, Storm, Flink, Beam, Airflow, Nifi etc.

Data Infrastructure: Should have experience in building, deploying and maintaining applications on popular cloud infrastructure like AWS, GCP etc.

Data Store: Must have expertise in one of general-purpose No-SQL data stores like Elasticsearch, MongoDB, Redis, RedShift, etc.

Strong sense of ownership, focus on quality, responsiveness, efficiency, and innovation.

Ability to work with distributed teams in a collaborative and productive manner.

Benefits:

Competitive Salary Packages and benefits.

Collaborative, lively and an upbeat work environment with young professionals.

Job Category: Development

Job Type: Full Time

Job Location: Bangalore

You will be responsible for building and maintaining highly scalable data infrastructure for our cloud-hosted SAAS product. You will work closely with the Product Managers and Technical team to define and implement data pipelines for customer-facing and internal reports.

• Design and develop resilient data pipelines.
• Write efficient queries to fetch data from the report database.
• Work closely with application backend engineers on data requirements for their stories.
• Designing and developing report APIs for the front end to consume.
• Focus on building highly available, fault-tolerant report systems.
• Constantly improve the architecture of the application by clearing the technical backlog. 
• Adopt a culture of learning and development to constantly keep pace with and adopt new technolgies.

An enthusiastic individual with the following skills. Please do not hesitate to apply if you do not match all of it. We are open to promising candidates who are passionate about their work and are team players.

• Education - BE/MCA or equivalent
• Overall 8+ years of experience
• Expert level understanding of database concepts and BI.
• Well verse in databases such as MySQL, MongoDB and hands on experience in creating data models. 
• Must have designed and implemented low latency data warehouse systems.
• Must have strong understanding of Kafka and related systems.
• Experience in clickhouse database preferred.
• Must have good knowledge of APIs and should be able to build interfaces for frontend engineers.
• Should be innovative and communicative in approach
• Will be responsible for functional/technical track of a project

You will work with a top-notch tech team, working closely with the CTO and product team.  

A wholesome opportunity in a fast-paced environment that will enable you to juggle between concepts, yet maintain the quality of content, interact, and share your ideas and have loads of learning while at work. Work with a team of highly talented young professionals and enjoy the benefits of being at Xoxoday.

Xoxoday is a rapidly growing fintech SaaS firm that propels business growth while focusing on human motivation. Backed by Giift and Apis Partners Growth Fund II, Xoxoday offers a suite of three products - Plum, Empuls, and Compass. Xoxoday works with more than 2000 clients across 10+ countries and over 2.5 million users. Headquartered in Bengaluru, Xoxoday is a 300+ strong team with four global offices in San Francisco, Dublin, Singapore, New Delhi.

We look forward to connecting with you. As you may take time to review this opportunity, we will wait for a reasonable time of around 3-5 days before we screen the collected applications and start lining up job discussions with the hiring manager. We however assure you that we will attempt to maintain a reasonable time window for successfully closing this requirement. The candidates will be kept informed and updated on the feedback and application status.

‍