Cutshort logo
Affine logo
Big Data Engineer
Big Data Engineer
Affine's logo

Big Data Engineer

Jeeba P's profile picture
Posted by Jeeba P
3 - 8 yrs
Best in industry
Remote only
Skills
skill iconScala
Spark
Apache Kafka
SQL
skill iconAmazon Web Services (AWS)

Role Objective:


Big Data Engineer will be responsible for expanding and optimizing our data and database architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building. The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products


Roles & Responsibilities:

  • Sound knowledge in Spark architecture and distributed computing and Spark streaming.
  • Proficient in Spark – including RDD and Data frames core functions, troubleshooting and performance tuning.
  • Good understanding in object-oriented concepts and hands on experience on Scala with excellent programming logic and technique.
  • Good in functional programming and OOPS concept on Scala
  • Good experience in SQL – should be able to write complex queries.
  • Managing the team of Associates and Senior Associates and ensuring the utilization is maintained across the project.
  • Able to mentor new members for onboarding to the project.
  • Understand the client requirement and able to design, develop from scratch and deliver.
  • AWS cloud experience would be preferable.
  • Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services - DynamoDB, RedShift, Kinesis, Lambda, S3, etc. (preferred)
  • Hands on experience utilizing AWS Management Tools (CloudWatch, CloudTrail) to proactively monitor large and complex deployments (preferred)
  • Experience in analyzing, re-architecting, and re-platforming on-premises data warehouses to data platforms on AWS (preferred)
  • Leading the client calls to flag off any delays, blockers, escalations and collate all the requirements.
  • Managing project timing, client expectations and meeting deadlines.
  • Should have played project and team management roles.
  • Facilitate meetings within the team on regular basis.
  • Understand business requirement and analyze different approaches and plan deliverables and milestones for the project.
  • Optimization, maintenance, and support of pipelines.
  • Strong analytical and logical skills.
  • Ability to comfortably tackling new challenges and learn

External Skills And Expertise

Must have Skills:

  • Scala
  • Spark
  • SQL (Intermediate to advanced level)
  • Spark Streaming
  • AWS preferable/Any cloud
  • Kafka /Kinesis/Any streaming services
  • Object-Oriented Programming
  • Hive, ETL/ELT design experience
  • CICD experience (ETL pipeline deployment)

Good to Have Skills:

  • AWS Certification
  • Git/similar version control tool
  • Knowledge in CI/CD, Microservices


Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Affine

Founded :
2011
Type :
Services
Size :
100-1000
Stage :
Profitable

About

Affine is a pioneering consulting firm that specializes in AI-driven enterprise transformation. With a robust focus on Generative AI, we deliver cutting-edge solutions that redefine industry standards.


Our comprehensive capabilities span the entire analytical value chain, from data to insights and transformation. We provide Cloud Advisory and Assessment, Cloud Migration, Data Lake Design and Development, Big Data Powered Advanced Analytics, AI & Deep Learning Solutions, and Deployment Consulting with Architecture Design.

Read more

Company social profiles

linkedin

Similar jobs

Non-Banking Financial Company
Non-Banking Financial Company
Agency job
via Peak Hire Solutions by Dharati Thakkar
Pune
4 - 8 yrs
₹8L - ₹13L / yr
SQL
databricks
PowerBI
Data engineering
Data architecture
+7 more

ROLES AND RESPONSIBILITIES:

We are seeking a highly experienced Senior Data Engineer with strong architectural capability, excellent optimisation skills, and deep hands-on experience in modern data platforms. The ideal candidate will have advanced SQL skills, strong expertise in Databricks, and practical experience working across cloud environments such as AWS and Azure. This role requires end-to-end ownership of complex data engineering initiatives, including architecture design, data governance implementation, and performance optimisation. You will collaborate with cross-functional teams to build scalable, secure, and high-quality data solutions.


Key Responsibilities-

  • Lead the design and implementation of scalable data architectures, pipelines, and integration frameworks.
  • Develop, optimise, and maintain complex SQL queries, transformations, and Databricks-based data workflows.
  • Architect and deliver high-performance ETL/ELT processes across cloud platforms.
  • Implement and enforce data governance standards, including data quality, lineage, and access control.
  • Partner with analytics, BI (Power BI), and business teams to enable reliable, governed, and high-value data delivery.
  • Optimise large-scale data processing, ensuring efficiency, reliability, and cost-effectiveness.
  • Monitor, troubleshoot, and continuously improve data pipelines and platform performance.
  • Mentor junior engineers and contribute to engineering best practices, standards, and documentation.


IDEAL CANDIDATE:

  • Proven industry experience as a Senior Data Engineer, with ownership of high-complexity projects.
  • Advanced SQL skills with experience handling large, complex datasets.
  • Strong expertise with Databricks for data engineering workloads.
  • Hands-on experience with major cloud platforms — AWS and Azure.
  • Deep understanding of data architecture, data modelling, and optimisation techniques.
  • Familiarity with BI and reporting environments such as Power BI.
  • Strong analytical and problem-solving abilities with a focus on data quality and governance
  • Proficiency in python or another programming language in a plus.


PERKS, BENEFITS AND WORK CULTURE:

Our people define our passion and our audacious, incredibly rewarding achievements. The company is one of India’s most diversified Non-banking financial companies, and among Asia’s top 10 Large workplaces. If you have the drive to get ahead, we can help find you an opportunity at any of the 500+ locations we’re present in India.

Read more
Wissen Technology
at Wissen Technology
4 recruiters
Tony Tom
Posted by Tony Tom
Pune
2 - 4 yrs
Best in industry
Manual testing

Job Description:


We are looking for a skilled Manual Tester / Test Engineer with 2-4 years of experience to join our dynamic team. The ideal candidate should have a strong understanding of testing methodologies and be able to ensure the quality and performance of our software applications. Exposure to Python full-stack applications will be considered a strong advantage.



Key Responsibilities:

· Design, develop, and execute manual test cases to validate product functionality.

· Collaborate with the development team to identify and resolve bugs and performance issues.

· Analyze test results and communicate them effectively to stakeholders.

· Perform regression, integration, system, and UAT testing.

· Ensure the overall quality of the product by identifying gaps and improvement areas.

· Document test processes, test plans, and test case results.

· Knowledge of Python FullStack Application.

· Work closely with developers, business analysts, and project managers to ensure seamless project delivery.



Qualifications:

· Bachelor's degree in Computer Science, Engineering, or a related field.

· 2-4 years of experience in manual software testing.

· Strong knowledge of software testing life cycle (STLC) and defect life cycle.

· Proficient in writing clear and concise test cases, test plans, and bug reports.

· Experience with bug tracking tools (e.g., JIRA, Bugzilla, etc.).

· Familiarity with Agile/Scrum methodologies.

· Basic knowledge of Python and full-stack applications is an advantage.

· Excellent communication and analytical skills.

· Ability to work both independently and in a team environment.

· Preferred Skills:

· Some exposure to Python full-stack applications (Django, Flask, etc.).

· Understanding of RESTful APIs and backend/frontend testing.

· Familiarity with automation tools like Selenium (bonus but not mandatory).

Read more
Delhi, Gurugram, Noida, Ghaziabad, Faridabad
0 - 6 yrs
₹1L - ₹4L / yr
Field Sales
Communication Skills
Lead Generation
Client Management
Presentation Skills

Channel Sales Executive - Field Sales


Company: Manvi International Courier

Location: Dwarka Sec 7, Delhi


Preference: Male 


Age Limit - 20-35 years


Who can Apply? 


Freshers/Experienced both can apply with good communication skills.


Position Overview:


Manvi International Courier is looking for a Channel Sales Executive to generate leads and build client relationships. This is a field-based role with no sales targets, requiring strong communication skills in English and Hindi.


Key Responsibilities:


  • Lead Generation: Identify and generate new business opportunities for courier services.
  • Client Relationships: Build and maintain strong relationships with clients through regular visits.
  • Communication: Effectively communicate the company’s services to clients in both English and Hindi.
  • Field Visits: Travel to various locations to meet clients and assess their needs.


Required Skills:


  • Strong communication skills in English and Hindi.
  • Ability to build relationships and generate leads.
  • Self-motivated with a proactive attitude.
  • Willingness to travel and visit clients as needed.
  • Male candidates only.




Read more
Remote, Noida
3 - 5 yrs
₹8.4L - ₹12L / yr
skill iconReact Native
skill iconRedux/Flux

Are you a seasoned React Native Developer ready to make a significant impact in the world of travel and blockchain technology? 


YatriPay, a leading travel-based blockchain company, is seeking a highly skilled Senior React Native Developer to help us revolutionize the travel industry. In this role, you'll be a key player in creating innovative mobile solutions that enhance the travel experience for users around the globe. If you're a dedicated professional with a passion for travel and tech, we welcome you to join our team and be part of our mission to redefine the future of travel transactions. Your expertise will be the driving force behind our success.

Read more
accolite
at accolite
6 recruiters
Amit Kumar
Posted by Amit Kumar
Bengaluru (Bangalore), Mumbai
3 - 8 yrs
₹0L / yr
Algorithms
Data Structures
Hibernate (Java)
Spring
Accolite is a cutting edge information technology services company headquartered in Dallas, Texas, with three development centers in Hyderabad, Bangalore and Delhi, India
Read more
Casey Group
Priyanka Dash
Posted by Priyanka Dash
Malkangiri
1 - 3 yrs
₹3.5L - ₹3.7L / yr
Communication Skills
Sales
Marketing

Responsibilities:

.Approaching potential leads and closing them within a stipulated time frame.

.Create exclusive distributors, exclusive super stockiest and business associates for the company towards business growth.

.Guide, coordinate and make strategic marketing plans for the sales team working under his jurisdiction.

.Finding and developing new markets and improving sales.

.Keep abreast with stock reports, inventory, product orders, re-order etc.

.Training personnel and helping team members in developing their skills.

Requirements:

.Bachelor's degree in business, marketing or a related field.

.Experience in sales, marketing or related field.

.Strong communication skills.

.Excellent organizational skills.

.Proficient in Word, Excel, Outlook, and Powerpoint.

Read more
TechLadd
Monika Barange
Posted by Monika Barange
Pune
2 - 4 yrs
₹5L - ₹10L / yr
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJavascript
+5 more

Java Full stack developer for Tech ladd company


Learned company standards of application software development, Agile and iterative 

development methodologies

Adept at planning and executing deployment of system features, orchestrating the integration, and maintaining the system throughout its life cycle. Proficient in interacting with key clients, understanding their requirements to complete projects within stipulated time and budget, and ensuring optimum client satisfaction.


Read more
Happy Reliable Surgeries Pvt Ltd (HRS Navigation)
Bengaluru (Bangalore)
0 - 2 yrs
₹2.5L - ₹3.2L / yr
application specialist
Web applications
Clinical Application
Biomedical engineering
CT
+1 more

Biomedical Engineer / Clinical Engineer (0-1 yrs)

 

Job Description

We are looking for candidates with following key requirements

*Quickly understands the technical details for surgical machine.

*Should help the surgeon during surgery with proper handling of the computer assisted surgery machine

*Good communication skills

*Good anatomical knowledge

*CT MR basics should be clear

*Willing to go extra mile

* Open to travel across India/ Abroad.

* Should be open to travel overnight journeys.

*Training in Bangalore and relocation can be anywhere in India


Keyskills
Communication Skills, Application Specialist, Image Guided Surgery

Company Profile
Happy Reliable Surgeries Pvt Ltd(HRS Navigation) started in 2015.

It is India's first and only company to develop high tech surgical navigation system.

Area of Focus: computer assisted surgeries and robotic surgeries(in coming future).

Our R&D center based at Bangalore.

We are aggressively expanding our computer assisted surgery business and further developing the teams of talented professionals. You can be part of this growth while sharing in the excitement and rewards. We are actively seeking out the best and brightest to join our team. If you want to make a difference and join a team that is changing the way surgeries are being done currently then we want to hear from you!

 

Read more
Accion Labs
at Accion Labs
14 recruiters
Kripa Oza
Posted by Kripa Oza
Bengaluru (Bangalore)
4 - 7 yrs
₹5L - ₹15L / yr
Apache Spark
skill iconScala
Apache Hive
Spark
Hadoop

Spark / Scala experience should be more than 2 years.

Combination with Java & Scala is fine or we are even fine with Big Data Developer with strong Core Java Concepts. - Scala / Spark Developer.

Strong proficiency Scala on Spark (Hadoop) - Scala + Java is also preferred

Complete SDLC process and Agile Methodology (Scrum)

Version control / Git

Read more
citrix
at citrix
2 recruiters
Siva Shankar
Posted by Siva Shankar
"Änywhere"
4 - 8 yrs
₹10L - ₹22L / yr
L4
L7
skill iconPython
Perl
Citrix aims to power a world where people, organizations and things are securely connected and accessible to make the extraordinary possible. Its technology makes the world’s apps and data secure and easy to access, empowering people to work anywhere and at any time. Citrix provides a complete and integrated portfolio of Workspace-as-a-Service, application delivery, virtualization, mobility, network delivery and file sharing solutions that enables IT to ensure critical systems are securely available to users via the cloud or on premise and across any device or platform. With annual revenue in 2015 of $3.28 billion, Citrix solutions are in use by more than 400,000 organizations and over 100 million users globally. Learn more at www.citrix.com.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos