Cutshort logo
Affine logo
Big Data Engineer
Big Data Engineer
Affine's logo

Big Data Engineer

Jeeba P's profile picture
Posted by Jeeba P
3 - 8 yrs
Best in industry
Remote only
Skills
skill iconScala
Spark
Apache Kafka
SQL
skill iconAmazon Web Services (AWS)

Role Objective:


Big Data Engineer will be responsible for expanding and optimizing our data and database architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building. The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products


Roles & Responsibilities:

  • Sound knowledge in Spark architecture and distributed computing and Spark streaming.
  • Proficient in Spark – including RDD and Data frames core functions, troubleshooting and performance tuning.
  • Good understanding in object-oriented concepts and hands on experience on Scala with excellent programming logic and technique.
  • Good in functional programming and OOPS concept on Scala
  • Good experience in SQL – should be able to write complex queries.
  • Managing the team of Associates and Senior Associates and ensuring the utilization is maintained across the project.
  • Able to mentor new members for onboarding to the project.
  • Understand the client requirement and able to design, develop from scratch and deliver.
  • AWS cloud experience would be preferable.
  • Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services - DynamoDB, RedShift, Kinesis, Lambda, S3, etc. (preferred)
  • Hands on experience utilizing AWS Management Tools (CloudWatch, CloudTrail) to proactively monitor large and complex deployments (preferred)
  • Experience in analyzing, re-architecting, and re-platforming on-premises data warehouses to data platforms on AWS (preferred)
  • Leading the client calls to flag off any delays, blockers, escalations and collate all the requirements.
  • Managing project timing, client expectations and meeting deadlines.
  • Should have played project and team management roles.
  • Facilitate meetings within the team on regular basis.
  • Understand business requirement and analyze different approaches and plan deliverables and milestones for the project.
  • Optimization, maintenance, and support of pipelines.
  • Strong analytical and logical skills.
  • Ability to comfortably tackling new challenges and learn

External Skills And Expertise

Must have Skills:

  • Scala
  • Spark
  • SQL (Intermediate to advanced level)
  • Spark Streaming
  • AWS preferable/Any cloud
  • Kafka /Kinesis/Any streaming services
  • Object-Oriented Programming
  • Hive, ETL/ELT design experience
  • CICD experience (ETL pipeline deployment)

Good to Have Skills:

  • AWS Certification
  • Git/similar version control tool
  • Knowledge in CI/CD, Microservices


Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Affine

Founded :
2011
Type :
Services
Size :
100-1000
Stage :
Profitable

About

Affine is a pioneering consulting firm that specializes in AI-driven enterprise transformation. With a robust focus on Generative AI, we deliver cutting-edge solutions that redefine industry standards.


Our comprehensive capabilities span the entire analytical value chain, from data to insights and transformation. We provide Cloud Advisory and Assessment, Cloud Migration, Data Lake Design and Development, Big Data Powered Advanced Analytics, AI & Deep Learning Solutions, and Deployment Consulting with Architecture Design.

Read more

Company social profiles

N/A

Similar jobs

vybog
at vybog
2 candid answers
Regina Mary
Posted by Regina Mary
Bengaluru (Bangalore)
3 - 6 yrs
₹3L - ₹9L / yr
Oracle DBA
Installation
cloning

Job Description:-

  • Database Administration, Solution design, Database Migration and manageability for Mission Critical Enterprise Applications in Datacentre and Cloud Deployments
  • Database migration and upgrades using methods/utilities like Datapump, RMAN backup/restore, data guard and auto upgrades.
  • Experience in Oracle Database migrations to cloud (preferably Azure ).
  • Must be willing to troubleshoot issues related to Oracle database migration to Azure Cloud
  • Work experience in Unix Shell scripting & automation.
  • Experience in capacity planning, designing, and implementing enterprise solutions using Oracle Database Technology.
  • Effective communication and presentation skills.
  • Analyzes problems, identifies solutions, and makes decisions.
  • Flexible to work either independently or work in tandem with Cloud Infrastructure team to identify and implement the most efficient cloud-based solutions for the company.
  • Demonstrates a willingness to learn, adapt, and grow professionally

  • Mandatory Technical Skills:
  • Must have experience with Azure Cloud Infrastructure.
  • Experience in End to End Database Migration from On-Prem to Cloud Infrastructure including Virtual Network Design, routing rules, security groups, Instance creation, and database deployment.
  • Oracle DB Architecture experience in Oracle 19c,18c &12c .
  • Experience in implementing multi-tenant architectures.
  • Experience/Exposure in Oracle Enterprise Manager, RMAN, Data guard and Real Application Cluster (RAC)
  • Experience in Installation, Cloning, Maintenance/Support of Production and Development Environment.
  • Oracle DBA should have experience on 19c,18c &12c upgrade, production support, cross platform migration.
  • Experience in Oracle Database upgrade from 11g to 19c,18c &12c on various platforms.
  • Experience in any other database apart from Oracle like MS-SQL.
  • Good written/Verbal Communication, Presentation, Interactive skills with team across geography

 

 

We are seeking a highly skilled PostgreSQL Admin with 3 to 6 years of experience to join our dynamic team. The ideal candidate will have extensive experience in Posgresql or PL/SQL Data Warehousing Concepts Scheduling Basics ETL SQL Data Integration Microsoft SSIS and Unix Shell Scripting. This role involves designing developing and maintaining data integration solutions that support our business objectives.

 

Responsibilities

  • Design and develop robust data integration solutions using postgresql or PL/SQL ETL tools and Microsoft SSIS.
  • Oversee the implementation of data warehousing concepts to ensure efficient data storage and retrieval.
  • Provide expertise in scheduling basics to automate data processing tasks.
  • Collaborate with cross-functional teams to gather requirements and translate them into technical specifications.
  • Lead the development and maintenance of Unix Shell Scripts for data processing and integration.
  • Ensure data quality and integrity by implementing best practices in data integration and ETL processes.
  • Monitor and optimize SQL queries to enhance performance and efficiency.
  • Develop and maintain documentation for all data integration processes and solutions.
  • Troubleshoot and resolve issues related to data integration and ETL processes.
  • Conduct code reviews to ensure adherence to coding standards and best practices.
  • Provide technical guidance and mentorship to junior developers.
  • Stay updated with the latest industry trends and technologies to continuously improve data integration solutions.
  • Collaborate with stakeholders to understand business needs and deliver solutions that drive business value.

Qualifications

  • Possess a strong understanding of PL/SQL and its application in data integration.
  • Demonstrate expertise in data warehousing concepts and their practical implementation.
  • Have experience with scheduling basics to automate and streamline data processes.
  • Show proficiency in ETL tools and techniques for efficient data extraction transformation and loading.
  • Exhibit strong SQL skills for querying and managing databases.
  • Be skilled in Microsoft SSIS for developing and maintaining data integration solutions.
  • Have experience with Unix Shell Scripting for automating data processing tasks.
  • Display excellent problem-solving skills and attention to detail.


Read more
Bengaluru (Bangalore), Hyderabad, Chennai, Mumbai, Pune
3 - 8 yrs
₹13L - ₹14L / yr
Oracle CPQ
RESTful APIs
skill iconJavascript
BOM
JET Ui
· Analyze current business processes, gather complex business requirements, prepare design and provide robust and scalable solutions

· Oracle CPQ Configuration/BML Development knowledge to meet documented business process requirements.

· Develop and support Configuration, Commerce, integrations, reports, workflow, BML and custom development in a CPQ environment.

· Working knowledge on complex product hierarchy and pricing models

· Expertise in BOM, Integrations

· Good knowledge in REST APIs, CSS, Java Script (CPQJS APIs) and XSL.

· Experience in handling CPQ Migrations and release upgrades.

· Better understanding of CPQ best practices and addressing performance related issues.

· Should be able to troubleshoot and resolve the system issues

· Playing a critical role in testing, evaluating and delivering high quality end product.

· Sound knowledge in Quote to Cash process.
Read more
DataMetica
at DataMetica
1 video
7 recruiters
Sayali Kachi
Posted by Sayali Kachi
Pune, Hyderabad
6 - 12 yrs
₹11L - ₹25L / yr
PL/SQL
MySQL
SQL server
SQL
Linux/Unix
+4 more

We at Datametica Solutions Private Limited are looking for an SQL Lead / Architect who has a passion for the cloud with knowledge of different on-premises and cloud Data implementation in the field of Big Data and Analytics including and not limiting to Teradata, Netezza, Exadata, Oracle, Cloudera, Hortonworks and alike.

Ideal candidates should have technical experience in migrations and the ability to help customers get value from Datametica's tools and accelerators.



Job Description :

Experience: 6+ Years

Work Location: Pune / Hyderabad



Technical Skills :

  • Good programming experience as an Oracle PL/SQL, MySQL, and SQL Server Developer
  • Knowledge of database performance tuning techniques
  • Rich experience in a database development
  • Experience in Designing and Implementation Business Applications using the Oracle Relational Database Management System
  • Experience in developing complex database objects like Stored Procedures, Functions, Packages and Triggers using SQL and PL/SQL
  •  

Required Candidate Profile :

  • Excellent communication, interpersonal, analytical skills and strong ability to drive teams
  • Analyzes data requirements and data dictionary for moderate to complex projects • Leads data model related analysis discussions while collaborating with Application Development teams, Business Analysts, and Data Analysts during joint requirements analysis sessions
  • Translate business requirements into technical specifications with an emphasis on highly available and scalable global solutions
  • Stakeholder management and client engagement skills
  • Strong communication skills (written and verbal)

About Us!

A global leader in the Data Warehouse Migration and Modernization to the Cloud, we empower businesses by migrating their Data/Workload/ETL/Analytics to the Cloud by leveraging Automation.

We have expertise in transforming legacy Teradata, Oracle, Hadoop, Netezza, Vertica, Greenplum along with ETLs like Informatica, Datastage, AbInitio & others, to cloud-based data warehousing with other capabilities in data engineering, advanced analytics solutions, data management, data lake and cloud optimization.

Datametica is a key partner of the major cloud service providers - Google, Microsoft, Amazon, Snowflake.

We have our own products!

Eagle Data warehouse Assessment & Migration Planning Product

Raven Automated Workload Conversion Product

Pelican Automated Data Validation Product, which helps automate and accelerate data migration to the cloud.



Why join us!

Datametica is a place to innovate, bring new ideas to live, and learn new things. We believe in building a culture of innovation, growth, and belonging. Our people and their dedication over these years are the key factors in achieving our success.



Benefits we Provide!

Working with Highly Technical and Passionate, mission-driven people

Subsidized Meals & Snacks

Flexible Schedule

Approachable leadership

Access to various learning tools and programs

Pet Friendly

Certification Reimbursement Policy



Check out more about us on our website below!

www.datametica.com

Read more
MirrAR Innovation Technologies Private Limited
MirrAR Innovation Technologies PVT LTD
Posted by MirrAR Innovation Technologies PVT LTD
Chennai
1.5 - 5 yrs
₹3L - ₹5L / yr
skill iconJava
skill iconSpring Boot
skill iconJavascript
J2EE

Description

 

Experience: 1.5 to 3 yrs

* Hands on work experience developing in Java and J2EE

* Hands on work experience developing in JavaScript

* Extensive working experience in Springboot

* Good to have No SQL (Mongo DB) and My SQL Exposure

* Good to have experience in AWS cloud environment

* Designing, developing, troubleshooting and debugging software within a project scope ensuring that work product meets end user acceptance criteria.

* Managing self-directed assignments to resolve software defects or implement features to meet schedule commitments with a high-level of quality.

* Acquiring knowledge of industry and company standards, tools and technology with a focus on pragmatic application to business-focused software solutions through initiative and self-study

Requirements

Primary Skill Java Springboot, Java Script

Good to have Mongo Db (No Sql), My SQL and Exposure to AWS

Benefits

Salary:300000 LPA to 500000 LPA

Read more
Innvoage Technology Private Limited
Innvoage Technology Private Limited
Agency job
Gurgaon, NCR (Delhi | Gurgaon | Noida)
3 - 7 yrs
₹3L - ₹7L / yr
skill iconVue.js
skill iconJavascript
skill iconBootstrap
HTML
CSS
+4 more

About Us

We Innvoage Technology Private Limited, incorporated in the year 2021, with a dream to revolutionise the Fintech industry by our innovative solutions in the field of online transactions. Our Vision is to “Be the most trusted and innovative service provider in the payment industry, with smoothest and most convenient to use interface and to offer unparalleled solutions to our valued customers in all our markets.”

We are looking for a core team to be the lead developers for our Payment Gateway Solution - UPayI.

 

Job Responsibilities

  • Take UI designer's images and transfer it into html + JS + CSS code
  • Use Laravel view template
  • Modify WordPress theme, or plugin's template
  • Other web frontend tasks

Required Skills

  • JavaScript, we use Vue in our project mainly and use jQuery for some projects.
  • Bootstrap 4 and Bootstrap 5.
  • Must be familiar with AJAX and API calling (ITS VERY IMPORTANT)
  • Must be familiar with Laravel View template.
Must have at least 3 years of experience in Frontend Web Development
Read more
TetraSoft
at TetraSoft
1 video
8 recruiters
Chandrika Yaminedu
Posted by Chandrika Yaminedu
Hyderabad
3 - 5 yrs
Best in industry
RESTful APIs
skill iconJava
API
skill iconSpring Boot
Distributed Systems
+4 more
Role: Developer
Experience Level: 3 to 5 Years
Job Location: Hyderabad

Responsibilities

· Excellent knowledge of Core Java and Spring

· Candidate should have a working knowledge of web services

· Should have worked in the distributed agile model and continuous integration

· Should have knowledge of designing and implementation of REST Web services

· Strong experience with REST API and web services

· Should be efficient with Java J2EE and related technologies.

Essential Requirements

· Strong Core Java and spring.

· Strong RESTFUL web service experience

· Strong SQL (preferably Oracle), JQuery, HTML/CSS, Oracle Restful, SOAP web services

· B. Tech/M. Tech from Tier-1 colleges like IIT, NIT, VIT, BIT

Primary Skill: Java, spring & RESTFUL Web services,


Read more
Qualitrix Technologies
at Qualitrix Technologies
1 video
1 recruiter
Sri Charan
Posted by Sri Charan
Bengaluru (Bangalore)
5 - 9 yrs
₹7L - ₹11L / yr
Sales
Business Development
Inside Sales
7 years of experience in sales for India Market, services sales preferred Should have proven track record from reputed organisations, Team player , Smart, spontaneous and presentable, Should be self-motivated, enthusiastic & have Hunter type of attitudeRequirements Sales Manager will be responsible for demonstrating sales strategy, leadership and general management abilities by identifying, prospecting, closing and growing new account business across India among various industry verticals. Sales Manager will be expected to build a healthy and sustainable pipeline to meet aggressive monthly quotas.

Desired Skills & Experience

  1. 5 to 10 years of relevant experience in sales for India Market.
  2. Candidate should have worked in Solution/Services selling in the past.
  3. Testing services sales would be a big plus Should have a good understanding of the India market.
  4. Excellent communication (Written and Verbal) and presentation skills.
  5. Handling meeting with key clients.
  6. Team player , Smart spontaneous and presentable.
    Should be self-motivated, enthusiastic & have Hunter type of attitude Identify, establish and maintain a network of contacts, providing support and ensuring relationships are managed professionally in order to develop profitable and growing business.
    Maintain a detailed knowledge of market and competitive position.
    Should be excellent in identifying new opportunities.
Read more
Godrej Consumer Products
Remote, Mumbai
7 - 13 yrs
₹10L - ₹21L / yr
Research & Development
skill iconData Analytics
Product Management
ABOUT GCPL :Godrej Consumer Products Limited is the largest home-grown home and personal care company in India. We are constantly innovating to delight our consumers with more exciting, superior quality products at affordable prices.We have bold ambitions and are becoming more agile and future-ready. We rank number 1 in hair colour, household insecticides and liquid detergents and number 2 in soaps. In India, you grow up with our brands - Good knight, Cinthol, Godrej Expert, Godrej No. 1 - and we are now on our way to becoming an emerging markets FMCG leader.In line with our 3X3 approach to international expansion, we are building a presence in 3 emerging markets (Asia, Africa, Latin America) across 3 categories (home care, personal wash, hair care). In 2010, we acquired the Indonesia-based Megasari group, a leader in household insecticides, air fresheners and baby care. With the acquisition of Rapidol and Kinky in South Africa, and the Darling Group, a leading pan-Africa hair care company, we have a strong presence in the fast growing African hair care market. We acquired the Issue and Argencos groups in Argentina, leaders in hair colour, in 2010, and expanded our footprint to Chile through the acquisition of a 60% stake in Cosmetica Nacional. The UK-based Keyline Brands, which we acquired in 2005, plays in hair and personal care. We also have a business in the Middle East and a strong presence across SAARC countries.To find out more about GCPL, explore www.godrejcp.com YOUR ROLE SUMMARY :You are expected to contribute actively towards development of products and technologies in Hair/Skin/Household Insecticide/ Air Care categories. The aim is to enhance GCPLs scientific knowledge base which will help us in creating strong product differentiators in market place.YOUR ROLE SPECIFICATIONS :- Thorough understanding on pre-formulations, pro typing and product development of various dosage forms. The candidate should have strong technical and hands on experience in at least couple of above mentioned categories. - Develop and work on relevant projects with academia to build and develop science base within GCPL, and also exploit learning's to our commercial advantage- Participate in pilot plant and plant level scale up activity- Document the product development pathway by means of suitable reports and dossiers- Interact and coordinate with different functions for various activities- Conduct wet and instrumental analysis of relevant product categories.- Utilize measurement techniques to characterize and predict product behavior over time- Understand and follow protocols/test methods used to measure functional and aesthetic performance- Analyze and evaluate competition productsINTERNAL AND EXTERNAL INTERACTIONS :The role requires regular interaction with Innovation/Design Team as well as Marketing functions. The candidate will report to the Product Category Head and shall interact with the Head Personal Care Research to build relevant programmes by interfacing with academia.The candidate is expected to interact with academia/higher institutes of learning in establishing and working on projects which are category relevant.QUALIFICATION :- M Pharm in Pharm Chemistry / Pharmaceutics, MSc Organic Chemistry / Pharmaceutical Chemistry, M.Tech chemical engineering- 7-10 years- experience in the field of formulation development preferably in the field of hair, Skin/House Hold Insecticides / air care will be preferableCHALLENGES IN THIS ROLE: The basic challenge will be to demonstrate strong innovative capability within the category. The candidate is expected to build a vibrant NPD pipeline of projects within R&D on the basis of existing consumer insights/category challenges. The candidate must be a self-starter, and, must display a strong inclination and passion to develop a host of innovative projects which shall feed the NPD pipeline.Candidate must be able to quickly spot product opportunities based on consumer insighting/domain knowledge and define a quick road map for rapid product developmentSKILLS REQUIRED :- Strong Interpersonal skills- Strong communication and presentation skills- An understanding on regulations governing cosmetics - Analytical abilities coupled with an understanding of and ability to use statistical tools- Must possess a sound understanding of product formulations, consumer expectations/insights, as well as, gaps in delivery of existing formats. Some level of consumer interaction to understand consumer needs- An appetite for learning, open mind for innovation, questioning status quo, ability to think out of the box- Ability to work in a team- Ability to demonstrate the practical use of knowledge base in Innovation Projects
Read more
Onco.com
at Onco.com
1 video
1 recruiter
Namrata Arora
Posted by Namrata Arora
Bengaluru (Bangalore)
2 - 4 yrs
₹3L - ₹5L / yr
Inbound Recruitment
Recruitment/Talent Acquisition
Human Resources (HR)
Performance Evaluation
Training and Development
+3 more
Job Description: HR – Recruiter Location: Bangalore Start date: September 2018 onwards Onco.com is a virtual cancer hospital. Through suggestive algorithms, extensive protocols for data collection and a network of world-class medical experts, we are helping cancer patients get an accurate, unbiased diagnosis and consultation. We are changing the status quo by empowering patients with the right information before they decide to undergo a treatment. Our vision is to become a trusted partner for every cancer patient anywhere in the world. We are only missing one thing and that is you. If you have a passion for solving problems in healthcare, this role is for you. This is one of those rare opportunities where your work will help save lives, and truly enrich others. Come join us in our mission of building this virtual cancer hospital for the world. ROLE OVERVIEW: HR Recruiter will be responsible for managing our full cycle recruitment, from identifying potential hires to interviewing and evaluating candidates. The responsibilities include sourcing candidates online, updating job ads and conducting background checks. The role demands hands on experience with various job interview formats, including screenings, phone interviews to help us recruit faster and more effectively. Ultimately, you will play an important part in building a strong employer brand for our company to ensure we attract, hire and retain the most qualified employees. Responsibilities: • Establishes recruiting requirements by studying organization plans and objectives; meeting with managers to discuss needs. • Screening resumes • Provide shortlists of qualified candidates to hiring managers • Performing phone interviews with candidates • Coordinating interviews with the hiring managers • Regular job posting on company’s careers page, social media, job boards and internally screen incoming resumes • Craft recruiting emails to attract passive candidates • Performing reference and background checks • Following up on the interview process status • Work closely with HR Manager in terms of designing of new process & creating a robust Talent acquisition process to create a better stakeholder & candidate experience. • Monitor key HR metrics, including time-to-fill, time-to-hire and source of hire • Promote company’s reputation as “best place to work” What we are looking for: • Well versed with Executive search process with at least 2 years of relevant experience • Excellent search and screening skills using various modes e.g job boards, social media, professional networking, employee referral etc. • Excellent communication and interpersonal skills • Experience with recruiting software
Read more
Dexciss Technology Pvt. Ltd
Dexciss Technology
Posted by Dexciss Technology
Pune
0 - 2 yrs
₹0L - ₹3L / yr
Business Development
Sales
Presales
Telesales
We are a very promising IT Solution Providers in the area of Cloud based ERP systems and have a vision to provide quality ERP systems at very competitive prices.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos