Cutshort logo
For Employers
Affine logo
Big Data Engineer
Big Data Engineer
Affine's logo

Big Data Engineer

Jeeba P's profile picture
Posted by Jeeba P
3 - 8 yrs
Best in industry
Remote only
Skills
skill iconScala
Spark
Apache Kafka
SQL
skill iconAmazon Web Services (AWS)

Role Objective:


Big Data Engineer will be responsible for expanding and optimizing our data and database architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building. The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products


Roles & Responsibilities:

  • Sound knowledge in Spark architecture and distributed computing and Spark streaming.
  • Proficient in Spark – including RDD and Data frames core functions, troubleshooting and performance tuning.
  • Good understanding in object-oriented concepts and hands on experience on Scala with excellent programming logic and technique.
  • Good in functional programming and OOPS concept on Scala
  • Good experience in SQL – should be able to write complex queries.
  • Managing the team of Associates and Senior Associates and ensuring the utilization is maintained across the project.
  • Able to mentor new members for onboarding to the project.
  • Understand the client requirement and able to design, develop from scratch and deliver.
  • AWS cloud experience would be preferable.
  • Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services - DynamoDB, RedShift, Kinesis, Lambda, S3, etc. (preferred)
  • Hands on experience utilizing AWS Management Tools (CloudWatch, CloudTrail) to proactively monitor large and complex deployments (preferred)
  • Experience in analyzing, re-architecting, and re-platforming on-premises data warehouses to data platforms on AWS (preferred)
  • Leading the client calls to flag off any delays, blockers, escalations and collate all the requirements.
  • Managing project timing, client expectations and meeting deadlines.
  • Should have played project and team management roles.
  • Facilitate meetings within the team on regular basis.
  • Understand business requirement and analyze different approaches and plan deliverables and milestones for the project.
  • Optimization, maintenance, and support of pipelines.
  • Strong analytical and logical skills.
  • Ability to comfortably tackling new challenges and learn

External Skills And Expertise

Must have Skills:

  • Scala
  • Spark
  • SQL (Intermediate to advanced level)
  • Spark Streaming
  • AWS preferable/Any cloud
  • Kafka /Kinesis/Any streaming services
  • Object-Oriented Programming
  • Hive, ETL/ELT design experience
  • CICD experience (ETL pipeline deployment)

Good to Have Skills:

  • AWS Certification
  • Git/similar version control tool
  • Knowledge in CI/CD, Microservices


Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Affine

Founded :
2011
Type :
Services
Size :
100-1000
Stage :
Profitable

About

Affine is a pioneering consulting firm that specializes in AI-driven enterprise transformation. With a robust focus on Generative AI, we deliver cutting-edge solutions that redefine industry standards.


Our comprehensive capabilities span the entire analytical value chain, from data to insights and transformation. We provide Cloud Advisory and Assessment, Cloud Migration, Data Lake Design and Development, Big Data Powered Advanced Analytics, AI & Deep Learning Solutions, and Deployment Consulting with Architecture Design.

Read more

Company social profiles

linkedin

Similar jobs

Service Co
Service Co
Agency job
via Vikash Technologies by Rishika Teja
Bengaluru (Bangalore), Chennai, Hyderabad
5 - 8 yrs
₹19L - ₹23L / yr
skill icon.NET
.Net Core
skill iconReact.js
RESTful APIs
Entity Framework
+1 more

Hiring for Dot Net Full Stack Developer - React Js


Exp: 5 - 8 yrs

Work Location : Bengaluru , Chennai , Hyd

Hybrid

Shift Timings : 2:00 pm - 10: 30 pm


Skills :


4+ years of experience in .Net Core,


3 years of experience in Rest API, Entity Framework, React JS and Azure.

Read more
Hunarstreet Technologies pvt ltd
Hunarstreet Technologies pvt ltd
Agency job
andheri, Mumbai
5 - 15 yrs
₹8L - ₹15L / yr
Electrical engineering
Design engineering
Engineering Management
detail engineering
EPC
+3 more

Job Description:

We are seeking Electrical Design Engineers with strong experience in detailed engineering and design for EPC projects in the Oil & Gas, Refinery, Pharma, and Chemical sectors.


Key Responsibilities:

 Perform detailed engineering and design of electrical systems in line with project specifications, codes, and standards.

 Develop and review single line diagrams (SLD), load schedules, cable sizing, earthing and lighting layouts.

 Prepare specifications and data sheets for electrical equipment like transformers, switchgears, MCCs, UPS, VFDs, etc.

 Coordinate with other disciplines (Instrumentation, Civil, Mechanical, Process) for integrated design solutions.

 Carry out cable routing, cable tray layouts, lighting, and earthing drawings using CAD tools.

 Interface with vendors for technical evaluation and review of electrical packages.

 Support procurement team in vendor document reviews and approvals.

 Ensure compliance with safety standards, IS/IEC/IEEE/NEC and relevant client specifications.

 Participate in site surveys, FAT/SAT, and provide construction and commissioning support as needed.

Key Skills & Competencies:

 Strong knowledge of electrical system design for hazardous area classification (ATEX/IECEx).

 Hands-on experience in ETAP or similar electrical design software is preferred.

 Familiar with international and Indian standards (IEC, IS, IEEE, NEC).

 Excellent problem-solving, coordination, and communication skills.

 Proficiency in AutoCAD, MS Office, and engineering calculation tools.

Read more
Media and entertainment
Media and entertainment
Agency job
via Jobdost by Saida Pathan
Noida
4 - 6 yrs
₹30L - ₹35L / yr
TypeScript
skill iconExpress
skill iconNextJs (Next.js)
MVC Framework
Microsoft Windows Azure
+2 more

What you will be doing

  • Build and ship features in our Node.js (and now migrating to TypeScript) codebase that directly impact user experience and help move the top and bottom line of the business.
  • Collaborate closely with our product, design and data team to build innovative features to deliver a world class product to our customers. At STAGE, product managers don’t “tell” what to build. In fact, we all collaborate on how to solve a problem for our customers and the business. Engineering plays a big part in it.
  • Design scalable platforms that empower our product and marketing teams to rapidly experiment.
  • Own the quality of our products by writing automated tests, reviewing code, making systems observable and resilient to failures.
  • Drive code quality and pay down architectural debt by continuous analysis of our codebases and systems, and continuous refactoring.
  • Architect our systems for faster iterations, releasability, scalability and high availability using practices like Domain Driven Design, Event Driven Architecture, Cloud Native Architecture and Observability.
  • Set the engineering culture with the rest of the team by defining how we should work as a team, set standards for quality, and improve the speed of engineering execution.

 

The role could be ideal for you if you

  • Experience of 4-6 years of working in backend engineering with at least 2 years of production experience in TypeScript, Express.js (or another popular framework like Nest.js) and MongoDB (or any popular database like MySQL, PostgreSQL, DynamoDB, etc.).
  • Well versed with one or more architectures and design patterns such as MVC, Domain Driven Design, CQRS, Event Driven Architecture, Cloud Native Architecture, etc.
  • Experienced in writing automated tests (especially integration tests) and Continuous Integration. At STAGE, engineers own quality and hence, writing automated tests is crucial to the role.
  • Experience with managing production infrastructure using technologies like public cloud providers (AWS, GCP, Azure, etc.). Bonus: if you have experience in using Kubernetes.
  • Experience in observability techniques like code instrumentation for metrics, tracing and logging.
  • Care deeply about code quality, code reviews, software architecture (think about Object Oriented Programming, Clean Code, etc.), scalability and reliability. Bonus: if you have experience in this from your past roles.
  • Understand the importance of shipping fast in a startup environment and constantly try to find ingenious ways to achieve the same.
  • Collaborate well with everyone on the team. We communicate a lot and don’t hesitate to get quick feedback from other members on the team sooner than later.
  • Can take ownership of goals and deliver them with high accountability.


Read more
Cloud based testing platform- Product based startup
Cloud based testing platform- Product based startup
Agency job
via Qrata by Rayal Rajan
Bengaluru (Bangalore)
4 - 9 yrs
₹40L - ₹60L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)

Role – Senior Developer (Back End)

Location - Bangalore

Experience 5+ Years

Responsibilities

  • Responsible for design & developing products involving Java, JEE, Springboot.
  • Object-oriented analysis and design using common design patterns.
  • Deep insight of Java and JEE internals such as memory management, transaction management, etc.
  • Design and develop features and modules for mission-critical applications.
  • Contribute in all phases of the development lifecycle.
  • Ensure designs are in compliance with specifications.
  • Prepare and produce releases of software components.
  • Mentoring and guiding the team members.
  • An ability to perform well in a fast-paced environment and bring in optimal flow for rapidly changing design/ technology.
  • Implementation of API.

Requirements

  • 5+ years of experience in strong core java & J2EE skill
  •  5+ years of experience in Spring Boot.
  • 5+ years of experience in Spring and REST/SOAP services
  • Strong knowledge in Java web application design and development
  • Strong knowledge of Spring frameworks (Spring Boot, Spring integration, Spring Security, etc.), JPA, RESTful APIs
  • Experience with design and development of highly available, distributed and scalable transactional enterprise systems
  • Results oriented and focused on meeting deliverable timelines.
  • A team player with excellent communication skills.
Read more
EnterpriseMinds
at EnterpriseMinds
2 recruiters
Rani Galipalli
Posted by Rani Galipalli
Bengaluru (Bangalore)
3 - 7 yrs
₹13L - ₹18L / yr
DevOps
skill iconKubernetes
skill iconDocker
Google Cloud Platform (GCP)
Puppet
+2 more
OPERATIONS ENGINEER(DevOps)
Role Description:
● Own, deploy, configure, and manage infrastructure environment and/or applications in
both private and public cloud through cross-technology administration (OS, databases,
virtual networks), scripting, and monitoring automation execution.
● Manage incidents with a focus on service restoration.
● Act as the primary point of contact for all compute, network, storage, security, or
automation incidents/requests.
● Manage rollout of patches and release management schedule and implementation.
Technical experience:
● Strong knowledge of scripting languages such as Bash, Python, and Golang.
● Expertise in using command line tools and shells
● Strong working knowledge of Linux/UNIX and related applications
● Knowledge in implementing DevOps and having an inclination towards automation.
● Sound knowledge in infrastructure-as-a-code approaches with Puppet, Chef, Ansible, or
Terraform, and Helm. (preference towards Terraform, Ansible, and Helm)
● Must have strong experience in technologies such as Docker, Kubernetes, OpenShift,
etc.
● Working with REST/gRPC/GraphQL APIs
● Knowledge in networking, firewalls, network automation
● Experience with Continuous Delivery pipelines - Jenkins/JenkinsX/ArgoCD/Tekton.
● Experience with Git, GitHub, and related tools
● Experience in at least one public cloud provider
Skills/Competencies
● Foundation: OS (Linux/Unix) & N/w concepts and troubleshooting
● Automation: Bash or Python or Golang
● CI/CD & Config Management: Jenkin, Ansible, ArgoCD, Helm, Chef/Puppet, Git/GitHub
● Infra as a Code: Terraform
● Platform: Docker, K8s, VMs
● Databases: MySQL, PostgreSql, DataStore (Mongo, Redis, AeroSpike) good to have
● Security: Vulnerability Management and Golden Image
● Cloud: Deep working knowledge on any public cloud (GCP preferable)
● Monitoring Tools: Prometheus, Grafana, NewRelic
Read more
Venture funded startup
Venture funded startup
Agency job
via Qrata by Mrunal Kokate
Chennai
6 - 10 yrs
₹20L - ₹40L / yr
skill iconJavascript
skill iconReact.js
skill iconReact Native
skill iconHTML/CSS

About the company

Qrata is hiring for a Venture funded startup that is backed by marquee investors. Their product provides a collaborative new way for SaaS companies to onboard their large customers. Our unified workspace aims to help streamline customer onboarding and implementation journeys, and get every customer off to a great start.


Quick Facts

Founded in: 2020

Number of Employees: 11 - 50 employees

Industries: Computer Software / IT / Internet

Location: Chennai

Senior frontend lead

Description

Are you a front-end developer looking to fast-track your learning and growth? Have you

looked at world class products like Asana, Notion, or Airtable, and felt “I wish I were part of

the early team that built these products”?

we’re a team that has previously built and rolled out globally successful SaaS

products used by tens of thousands of customers. We’re laser focused on delivering a world

class new product again, and looking for an ambitious front-end engineer to join our existing

team.

If it excites you to think of a fast paced start-up environment, building something big from

scratch, breaking down new problems, creating well structured UI components, executing on

pixel perfect design, paying great attention to every little interaction detail, and doing demos

of your work every Friday with a happy and passionate team, then this is the right

opportunity for you.

Some of the tech problems you get to work-on as a front-end developer would include

building real-time collaboration experiences across our product, building live document

editing and modern spreadsheet experiences from scratch, creating flexible new

Kanban-style views of work tasks, and crafting cool new UI components and interactions that

we will use across our product.

Tech Requirements

  • Expertise in React
  • Hands-on experience in HTML, CSS, SASS & Object Oriented Javascript
  • Code audits and guidelines
  • SPA Framework patterns
  • Browser features (Caching / Storage / Compatibility etc )
  • Test automation
  • Deployment strategy

 

Nice to have

  • Familiarity with AWS
  • Experience with startups or early stage teams
  • Typescript
  • Knowledge of module bundlers like Webpack
Read more
ibiixo Technologies Pvt Ltd
Deep Karia
Posted by Deep Karia
Rajkot
0 - 2 yrs
₹1L - ₹4L / yr
Content Writing
Blogging
Creative Writing
Content Marketing
Content writer for an IT company to write blogs and web pages
Read more
MintZip
at MintZip
2 recruiters
Shivani Govil
Posted by Shivani Govil
NCR (Delhi | Gurgaon | Noida)
5 - 100 yrs
₹5L - ₹10L / yr
Public Relations
Branding
Account Management
We're looking for a talented and ambitious professional with 5+ years of experience for our office in NCR. We are MintZip, an exciting fin-tech startup (part of the prestigious NASSCOM 10K Startups Program and recognised by Startup India) aiming to disrupt the financial services industry with singular focus on customer-centric innovations. Learn more: www.mintzip.com What's in it for you - A fast paced, challenging environment that gives you an opportunity to build a solid and rewarding career while charting the course for our organization. This position will be responsible for the collaborations, execution and measurement of our PR & Corporate Marketing activities, with the goal of brand building and enhancing a favorable image of MintZip with, clients, customers, Media, and the public. The individual will be part of the Sales and Marketing team, leading corporate relations efforts and driving specific business imperatives. Areas of focus include: brand building, PR, developing risk assessments, implementing crisis management plans, fostering strategic relationships with key corporates and industry bodies, building knowledge of business and market. PROFESSIONAL QUALIFICATIONS: Education: University degree or equivalent; Master's degree in Mass Communications or Journalism preferred Work Experience: 5+ years of experience in corporate Sales and PR roles.
Read more
Sunday Mattresses
at Sunday Mattresses
1 recruiter
Sonam Singh
Posted by Sonam Singh
Bengaluru (Bangalore)
4 - 7 yrs
₹5L - ₹8L / yr
Accounts
Quick books
Bank Reconciliation
AR & AP
Invoicing
+3 more
Sunday (www.sundayrest.com) is a new age mattress brand that sells mattresses online. The company is the leader in the online mattress space and is growing rapidly. The startup one of the few in the country that is profitable but growing fast. The work environment is fun and vibrant. It offers great learning opportunities and enough room to grow professionally. In addition to selling online, the company has just embarked on setting up retail experience centres. The first one has opened in Bangalore and more will come up in other major cities across India. The venture is run by a seasoned team of professionals from the e-commerce and home decor industry. Edit Headline
Read more
Diabeto Medtech India pvt ltd
Shreekant Pawar
Posted by Shreekant Pawar
Mumbai
2 - 3 yrs
₹2L - ₹4L / yr
skill iconJavascript
skill iconHTML/CSS
skill iconjQuery
AJAX
Diabeto is a system which consists of a hardware device that wirelessly transmits Blood Glucose readings from a Glucometer into a smartphone. These readings can then be easily analyzed with the help of a Smartphone application which are pushed to a cloud server and the patient can get feedback from a diabetologist in real time.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos