Cutshort logo
Affine logo
Big Data Engineer
Big Data Engineer
Affine's logo

Big Data Engineer

Jeeba P's profile picture
Posted by Jeeba P
3 - 8 yrs
Best in industry
Remote only
Skills
skill iconScala
Spark
Apache Kafka
SQL
skill iconAmazon Web Services (AWS)

Role Objective:


Big Data Engineer will be responsible for expanding and optimizing our data and database architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building. The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products


Roles & Responsibilities:

  • Sound knowledge in Spark architecture and distributed computing and Spark streaming.
  • Proficient in Spark – including RDD and Data frames core functions, troubleshooting and performance tuning.
  • Good understanding in object-oriented concepts and hands on experience on Scala with excellent programming logic and technique.
  • Good in functional programming and OOPS concept on Scala
  • Good experience in SQL – should be able to write complex queries.
  • Managing the team of Associates and Senior Associates and ensuring the utilization is maintained across the project.
  • Able to mentor new members for onboarding to the project.
  • Understand the client requirement and able to design, develop from scratch and deliver.
  • AWS cloud experience would be preferable.
  • Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services - DynamoDB, RedShift, Kinesis, Lambda, S3, etc. (preferred)
  • Hands on experience utilizing AWS Management Tools (CloudWatch, CloudTrail) to proactively monitor large and complex deployments (preferred)
  • Experience in analyzing, re-architecting, and re-platforming on-premises data warehouses to data platforms on AWS (preferred)
  • Leading the client calls to flag off any delays, blockers, escalations and collate all the requirements.
  • Managing project timing, client expectations and meeting deadlines.
  • Should have played project and team management roles.
  • Facilitate meetings within the team on regular basis.
  • Understand business requirement and analyze different approaches and plan deliverables and milestones for the project.
  • Optimization, maintenance, and support of pipelines.
  • Strong analytical and logical skills.
  • Ability to comfortably tackling new challenges and learn

External Skills And Expertise

Must have Skills:

  • Scala
  • Spark
  • SQL (Intermediate to advanced level)
  • Spark Streaming
  • AWS preferable/Any cloud
  • Kafka /Kinesis/Any streaming services
  • Object-Oriented Programming
  • Hive, ETL/ELT design experience
  • CICD experience (ETL pipeline deployment)

Good to Have Skills:

  • AWS Certification
  • Git/similar version control tool
  • Knowledge in CI/CD, Microservices


Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos

About Affine

Founded :
2011
Type :
Services
Size :
100-1000
Stage :
Profitable

About

Affine is a pioneering consulting firm that specializes in AI-driven enterprise transformation. With a robust focus on Generative AI, we deliver cutting-edge solutions that redefine industry standards.


Our comprehensive capabilities span the entire analytical value chain, from data to insights and transformation. We provide Cloud Advisory and Assessment, Cloud Migration, Data Lake Design and Development, Big Data Powered Advanced Analytics, AI & Deep Learning Solutions, and Deployment Consulting with Architecture Design.

Read more

Company social profiles

N/A

Similar jobs

Consulting, Outsourcing, and Technology Services company
Consulting, Outsourcing, and Technology Services company
Agency job
via Jobdost by Saida Jabbar
Mumbai, Thane
4 - 9 yrs
₹5L - ₹6L / yr
skill iconFlutter
skill iconReact Native
skill iconGo Programming (Golang)
Xamarin
skill iconJavascript
+10 more

Requirements / Experience:

  • Min 4 Years of Experience
  • Experience in cross-platform mobile software development (Android/iOS) using technologies such as React Native, Flutter, GO/ Golang, Xamarin, Blazor, JavaScript, TypeScript, Dart, C#
  • Familiarity with API Development (REST, Web API, WCF, SOAP)
  • Experience with full-lifecycle design, development, and testing of critical business applications
  • Good problem-solving skills with attention to detail
  • Strong verbal, written, interpersonal, and organizational skills
  • Ability to work independently and in a team environment
  • Ability to multi-task effectively
  • Reliable, highly motivated, with a positive attitude
  • Experience with MsSQL, MariaDB
Read more
Global Media Agency - A client of Merito
Global Media Agency - A client of Merito
Agency job
via Merito by Merito Talent
Gurugram, Bengaluru (Bangalore), Mumbai
4 - 9 yrs
Best in industry
skill iconMachine Learning (ML)
skill iconData Science
media analytics
SQL
skill iconPython
+4 more

Our client combines Adtech and Martech platform strategy with data science & data engineering expertise, helping our clients make advertising work better for people.

 
Key Role:
  • Act as primary day-to-day contact on analytics to agency-client leads
  • Develop bespoke analytics proposals for presentation to agencies & clients, for delivery within the teams
  • Ensure delivery of projects and services across the analytics team meets our stakeholder requirements (time, quality, cost)
  • Hands on platforms to perform data pre-processing that involves data transformation as well as data cleaning
  • Ensure data quality and integrity
  • Interpret and analyse data problems
  • Build analytic systems and predictive models
  • Increasing the performance and accuracy of machine learning algorithms through fine-tuning and further
  • Visualize data and create reports
  • Experiment with new models and techniques
  • Align data projects with organizational goals


Requirements

  • Min 6 - 7 years’ experience working in Data Science
  • Prior experience as a Data Scientist within a digital media is desirable
  • Solid understanding of machine learning
  • A degree in a quantitative field (e.g. economics, computer science, mathematics, statistics, engineering, physics, etc.)
  • Experience with SQL/ Big Query/GMP tech stack / Clean rooms such as ADH
  • A knack for statistical analysis and predictive modelling
  • Good knowledge of R, Python
  • Experience with SQL, MYSQL, PostgreSQL databases
  • Knowledge of data management and visualization techniques
  • Hands-on experience on BI/Visual Analytics Tools like PowerBI or Tableau or Data Studio
  • Evidence of technical comfort and good understanding of internet functionality desirable
  • Analytical pedigree - evidence of having approached problems from a mathematical perspective and working through to a solution in a logical way
  • Proactive and results-oriented
  • A positive, can-do attitude with a thirst to continually learn new things
  • An ability to work independently and collaboratively with a wide range of teams
  • Excellent communication skills, both written and oral
Read more
Bookxpert Private Limited
Guntur, Tenali
0 - 2 yrs
₹1.8L - ₹3L / yr
Communication Skills
Interpersonal Skills
Accounting
MS-Excel

Job description:

1. Coordinating and Monitoring the Team Members to ensure that all Deliveries are Prepared and delivered to Customers within Stipulated Timelines.

2. Coordinating with Customers for Data & fee collection, Clarification of Suspense, and getting any Missed/Unclear Document Sets.

3. Scheduling Client Visits with DCs/Negotiators for Data Collection per the Pre-Determined Frequency set with Customers.

4. Escalating to Management any Issues they are Facing with Customers/Team Members.


Required Candidate profile:

1. Any Graduate (Preferably B.Com & M.Com)- Married Women mostly preferable.

2. Experience Working in an Accounts/Audit Office is an Added Advantage.

3. Prior Experience in using any Accounting Software is an Added Advantage.


Read more
Certa
at Certa
1 video
9 recruiters
ayushi sethi
Posted by ayushi sethi
Remote only
3 - 5 yrs
₹7L - ₹10L / yr
Software Testing (QA)
Test Automation (QA)
Appium
Selenium
Automation
+7 more

Location: Hires Remotely Everywhere

Job Type: Full Time

Experience: 3+ years

Salary: INR 7-10 LPA

 

Key Responsibilities:

  • Strong automation QA individual, who can finalize, design and build automation framework from scratch
  • Advanced programming skills including automation systems and databases
  • Strong knowledge of software QA methodologies, PM tools, and QA
  • Familiar with programming script languages including HTML, CSS, Python,
  • Hands-on experience with both white box and black box testing
  • Expertise in automation tools like Selenium, Pytest, Behave and Cucumber
  • Familiar with CI/CD tools like- Jenkins, TeamCity
  • Familiar with version control systems like Bitbucket, GitHub
  • Experience working in an agile/scrum development process
  • Experience in writing clear, concise and comprehensive test plans and test cases
  • Detailed knowledge of application functions, bug fixing and testing protocols
  • Good written and verbal communication skills
  • Excellent analytical skills
  • Strong attention to detail

Nice to have:

  • Nice to have someone who has very good knowledge of python programming
Read more
Service based company
Service based company
Agency job
via Office day Innovation by Ripal Raval
Ahmedabad
2 - 6 yrs
₹6L - ₹12L / yr
skill iconReact Native
skill iconAndroid Development
skill iconiOS App Development
skill iconNodeJS (Node.js)
API
+1 more

Responsibilities:

  • Design and build advanced hybrid mobile applications using React Native
  • Lead the application development effort by being the SPOC
  • Build hybrid apps using React Native for Android/iOS
  • Publish apps to corresponding App store/Play store
  • Implement new technologies to maximize application performance and optimize load time
  • Collaborate with the back-end developer to build the RESTful APIs
  • Research on emerging technologies and trends
  • Participate in the planning and design of future software and technical architectures

Qualifications

  • 3+ years of hands on experience in the full life cycle of Hybrid mobile application development including publishing one or more apps to the play store & app store
  • Must have developed Hybrid Mobile application using React. Hands on Working experience of React Native is a must.
  • Experience developing back-end services preferably with NodeJS.
  • Experience in developing apps on native Android/iOS platforms is a plus
  • Experience in designing and working with n-tier architectures (UI, Business Logic Layer, Data Access Layer) along with some experience with service-oriented architectures (SOA)
  • Strong skills in RESTful web services
  • Experience with Agile methodologies would be helpful
Read more
Crisp Analytics
at Crisp Analytics
8 recruiters
Seema Pahwa
Posted by Seema Pahwa
Mumbai
2 - 6 yrs
₹6L - ₹15L / yr
Big Data
Spark
skill iconScala
skill iconAmazon Web Services (AWS)
Apache Kafka

 

The Data Engineering team is one of the core technology teams of Lumiq.ai and is responsible for creating all the Data related products and platforms which scale for any amount of data, users, and processing. The team also interacts with our customers to work out solutions, create technical architectures and deliver the products and solutions.

If you are someone who is always pondering how to make things better, how technologies can interact, how various tools, technologies, and concepts can help a customer or how a customer can use our products, then Lumiq is the place of opportunities.

 

Who are you?

  • Enthusiast is your middle name. You know what’s new in Big Data technologies and how things are moving
  • Apache is your toolbox and you have been a contributor to open source projects or have discussed the problems with the community on several occasions
  • You use cloud for more than just provisioning a Virtual Machine
  • Vim is friendly to you and you know how to exit Nano
  • You check logs before screaming about an error
  • You are a solid engineer who writes modular code and commits in GIT
  • You are a doer who doesn’t say “no” without first understanding
  • You understand the value of documentation of your work
  • You are familiar with Machine Learning Ecosystem and how you can help your fellow Data Scientists to explore data and create production-ready ML pipelines

 

Eligibility

Experience

  • At least 2 years of Data Engineering Experience
  • Have interacted with Customers


Must Have Skills

  • Amazon Web Services (AWS) - EMR, Glue, S3, RDS, EC2, Lambda, SQS, SES
  • Apache Spark
  • Python
  • Scala
  • PostgreSQL
  • Git
  • Linux


Good to have Skills

  • Apache NiFi
  • Apache Kafka
  • Apache Hive
  • Docker
  • Amazon Certification

 

 

Read more
Finplan International Institue
Finplan International Institue
Agency job
via Milestone Hr Consultancy by Haina khan
Mumbai
2 - 6 yrs
₹3L - ₹6L / yr
Sales
Inside Sales
Sales management
Sales Operations

Roles and Responsibilities

1. Ensuring Proper handling of all queries of students & parents by effective counseling.

2. Shall be responsible for achieving the weekly/monthly admission target of the center.

3. Shall be responsible for delivering impactful sales presentations (Webinars / Seminars) to target groups in nearby colleges and institutions

4. Shall be responsible for completing admission process (documentation), batch formation and executing admissions compliance for students

5. Shall execute Institutional tie-ups with the support of the business development head.

6. Shall execute marketing and brand building activities such as festival participation, event conduction in nearby colleges and institutions to develop lead generation with the marketing head.

7. Shall identify and assess gaps to increase sales / enrollments at the center and meet the revenue goals on monthly basis.

Read more
Ridlr
at Ridlr
2 recruiters
Mamta Surve
Posted by Mamta Surve
Mumbai
2 - 3 yrs
₹4L - ₹6L / yr
User Experience (UX) Design
skill iconHTML/CSS
Adobe Photoshop
skill iconAdobe Illustrator
Interaction Design
+2 more
Graphic designer & illustrator Graduate/Post Graduate from a design school 2 - 3 years work experience Good with concepts, ideas and worked on marketing campaigns Knowhow of Photoshop & Illustrator Video making/editing skills are a bonus Key Tasks Leading entire online/offline design portfolio Conceptualization and execution of entire marketing design campaign Scope: Digital banners, ads, social media posts, emailers Offline: ATL and BTL campaign work, storyboards, logos, Mobile App experience is desirable.
Read more
DXMINDS INNOVATION LABS
at DXMINDS INNOVATION LABS
3 recruiters
Deepa J
Posted by Deepa J
Bengaluru (Bangalore)
3 - 8 yrs
₹3L - ₹8L / yr
MEAN stack
skill iconNodeJS (Node.js)
skill iconMongoDB
skill iconAngularJS (1.x)

Relevant Experience: 2-6 yrs

  • Hands on Experience and manage Node js, Mongo DB, Angular and Express js.
  • Architect, Develop, test and deploy robust products that are fast, scalable and highly responsive
  • Design and maintain large and complex databases, both relational and non-relational databases.
  • Establish, refine and integrate development environment tools and software as needed
  • Deploy applications on AWS cloud with ability to quickly debug hosting related issues.
  • Expertise in Complete Mean, Node js, Mongo DB, Angular and Express js
  • Strong analytical and problem solving skills
Read more
Hipower Support Center
at Hipower Support Center
1 recruiter
Sekar Srinivasan
Posted by Sekar Srinivasan
Bengaluru (Bangalore)
0 - 8 yrs
₹2L - ₹3L / yr
Communication Skills
Customer Acquisition
Sales
Company Brief: HiPower Support Centre is a premium English language contact center that has been providing business process outsourcing solutions and services to hi-tech global customers for over 14 years. Our Indian Management Team with guidance from American experts, provide the best support to organizations around the world. We have over 1400 people servicing customers worldwide Role Brief: Handling game based queries for US based customers, through email Comprehend the customer requirement well & suggest apt resolutions Ensuring maximum Customer Satisfaction on every query Candidate Preference: Education – Any Graduate or plus two Desired Experience 0 to 5 yrs Desired Skills : Should be flexible to work in night shifts. Excellent written communication skills Good reasoning and analytical skills Good typing skills Basic computer knowledge Exposure to strategic game(mobile) would be preferable Benefits Salary - 18k to 26k gross Performance based incentives Free Food Free transportation Housing / Conveyance allowance Medical Insurance
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos