Cutshort logo
Affine logo
Big Data Engineer
Big Data Engineer
Affine's logo

Big Data Engineer

Jeeba P's profile picture
Posted by Jeeba P
3 - 8 yrs
Best in industry
Remote only
Skills
skill iconScala
Spark
Apache Kafka
SQL
skill iconAmazon Web Services (AWS)

Role Objective:


Big Data Engineer will be responsible for expanding and optimizing our data and database architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building. The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products


Roles & Responsibilities:

  • Sound knowledge in Spark architecture and distributed computing and Spark streaming.
  • Proficient in Spark – including RDD and Data frames core functions, troubleshooting and performance tuning.
  • Good understanding in object-oriented concepts and hands on experience on Scala with excellent programming logic and technique.
  • Good in functional programming and OOPS concept on Scala
  • Good experience in SQL – should be able to write complex queries.
  • Managing the team of Associates and Senior Associates and ensuring the utilization is maintained across the project.
  • Able to mentor new members for onboarding to the project.
  • Understand the client requirement and able to design, develop from scratch and deliver.
  • AWS cloud experience would be preferable.
  • Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services - DynamoDB, RedShift, Kinesis, Lambda, S3, etc. (preferred)
  • Hands on experience utilizing AWS Management Tools (CloudWatch, CloudTrail) to proactively monitor large and complex deployments (preferred)
  • Experience in analyzing, re-architecting, and re-platforming on-premises data warehouses to data platforms on AWS (preferred)
  • Leading the client calls to flag off any delays, blockers, escalations and collate all the requirements.
  • Managing project timing, client expectations and meeting deadlines.
  • Should have played project and team management roles.
  • Facilitate meetings within the team on regular basis.
  • Understand business requirement and analyze different approaches and plan deliverables and milestones for the project.
  • Optimization, maintenance, and support of pipelines.
  • Strong analytical and logical skills.
  • Ability to comfortably tackling new challenges and learn

External Skills And Expertise

Must have Skills:

  • Scala
  • Spark
  • SQL (Intermediate to advanced level)
  • Spark Streaming
  • AWS preferable/Any cloud
  • Kafka /Kinesis/Any streaming services
  • Object-Oriented Programming
  • Hive, ETL/ELT design experience
  • CICD experience (ETL pipeline deployment)

Good to Have Skills:

  • AWS Certification
  • Git/similar version control tool
  • Knowledge in CI/CD, Microservices


Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Affine

Founded :
2011
Type :
Services
Size :
100-1000
Stage :
Profitable

About

Affine is a pioneering consulting firm that specializes in AI-driven enterprise transformation. With a robust focus on Generative AI, we deliver cutting-edge solutions that redefine industry standards.


Our comprehensive capabilities span the entire analytical value chain, from data to insights and transformation. We provide Cloud Advisory and Assessment, Cloud Migration, Data Lake Design and Development, Big Data Powered Advanced Analytics, AI & Deep Learning Solutions, and Deployment Consulting with Architecture Design.

Read more

Company social profiles

N/A

Similar jobs

PGAGI
Javeriya Shaik
Posted by Javeriya Shaik
Remote only
0.6 - 1 yrs
₹8000 - ₹15000 / mo
Artificial Intelligence (AI)
skill iconMachine Learning (ML)
Generative AI
Data Structures
Large Language Models (LLM)


We're at the forefront of creating advanced AI systems, from fully autonomous agents that provide intelligent customer interaction to data analysis tools that offer insightful business solutions. We are seeking enthusiastic interns who are passionate about AI and ready to tackle real-world problems using the latest technologies.


We are looking for a passionate AI/ML Intern with hands-on exposure to Large Language Models (LLMs), fine-tuning techniques like LoRA, and strong fundamentals in Data Structures & Algorithms (DSA). This role is ideal for someone eager to work on real-world AI applications, experiment with open-source models, and contribute to production-ready AI systems.


Duration: 6 months

Perks:

- Hands-on experience with real AI projects.

- Mentoring from industry experts.

- A collaborative, innovative and flexible work environment

After completion of the internship period, there is a chance to get a full-time opportunity as AI/ML engineer (6-8 LPA).

Compensation:

- Stipend: Base is INR 8000/- & can increase up to 20000/- depending upon performance matrix.


Key Responsibilities

  • Work on Large Language Models (LLMs) for real-world AI applications.
  • Implement and experiment with LoRA (Low-Rank Adaptation) and other parameter-efficient fine-tuning techniques.
  • Perform model fine-tuning, evaluation, and optimization.
  • Engage in prompt engineering to improve model outputs and performance.
  • Develop backend services using Python for AI-powered applications.
  • Utilize GitHub for version control, including managing branches, pull requests, and code reviews.
  • Work with AI platforms such as Hugging Face and OpenAI to deploy and test models.
  • Collaborate with the team to build scalable and efficient AI solutions.

Must-Have Skills

  • Strong proficiency in Python.
  • Hands-on experience with LLMs (open-source or API-based).
  • Practical knowledge of LoRA or other parameter-efficient fine-tuning techniques.
  • Solid understanding of Data Structures & Algorithms (DSA).
  • Experience with GitHub and version control workflows.
  • Familiarity with Hugging Face Transformers and/or OpenAI APIs.
  • Basic understanding of Deep Learning and NLP concepts.
Read more
Remote, Ahmedabad
1 - 4 yrs
₹3L - ₹0.0L / yr
Business Development
Client Servicing
Sales
Presales
Salesforce

About MobileFirst : Software Application development studio focusing on great mobile app experiences. We have great exposure working with Startups, Enterprises and Design Studios. MobileFirst has worked with customers from the USA, India, UK, Kenya, and Singapore.

Currently our focus is to build new clients in Sports, Health & Wellness, FinTech & eCommerce line of business. 

 


What are we looking for?

  • Must have proven experience of selling software services in International Markets.
  • If not services we can consider people with experience of selling software products as well.
  • Somebody who has experience of end to end sales cycle
  • Somebody who has worked in a revenue based target environment.
  • Should be mature, empathetic, self-driven and creative.
  • Should be able to take initiatives, learn new things, dependable, co-operative and a team player.
  • Adapative for working as per different timezone. 
  • Should able to take at least 6 to 7 Introduction meetings with clients. 

Benefits:


  • Opportunity to build & scale the Sales team
  • Incentives on achieving the targets
  • Work from home on an approval basis
  • Opportunity to travel & represent organisation on various forums, conferences etc. 
Read more
An international MNC specialized into Hardware & Networking
An international MNC specialized into Hardware & Networking
Agency job
via Tridat Technologies Pvt. Ltd. by Shraddha Kamble
Mumbai, Navi Mumbai, Pune
4 - 10 yrs
₹4L - ₹10L / yr
MS Exchange Server
Office 365
English Proficiency

Hello,

 

Greetings for the day !!!

 

We are hiring "Technical Support L3 - Exchange Server" for one of the international MNC specialized into Hardware & Networking based @ Mumbai/Pune !!!

 

Position: Technical Support L3 - Exchange Server

 

Must Have Skills

Exchange Server, O365

 

Experience Level: 4+ Years

 

Required Skills

  1. Knowledge of Exchange Management & troubleshooting.
  2. Knowledge of Office 365 Management & troubleshooting.
  3. Knowledge of Active Directory management & troubleshooting.
  4. Knowledge of mail routing and client connectivity.
  5. Knowledge of Back up configuration & troubleshooting.
  6. Well versed with Windows event log & analysis.
  7. Enthusiasm for learning new skills.
  8. Good communication skills - both written and verbal.
  9. Passion for providing exceptional service to customers.
  10. Strong sense of ownership and accountability.
  11. Strong work ethics.

 

Roles & Responsibility:

  1. Expert knowledge of Exchange 2010, 2013, 2016, and 2019 its troubleshooting.
  2. Advanced Knowledge of handling Office 365 issues.
  3. Advanced Knowledge of Active Directory Replication, Permission Management, Group Policy, and troubleshooting will be added advantages.
  4. Must have a minimum of 4 years working experience and intimate proficiency with Microsoft Exchange 2010, 2013, 2016, and 2019 administration and troubleshooting in a large-scale multi-site environment.
  5. Must have skills in deploying Exchange in a large enterprise environment.
  6. Knowledge of Exchange Hardening.
  7. Expert knowledge of mail flow and third-party smart host filtering.
  8. Expert knowledge of Outlook and OWA configuration and troubleshooting.
  9. Expert knowledge in Troubleshooting issues by checking Exchange Logs and Windows Event Logs.
  10. Advanced knowledge in a clustered environments (Windows Cluster / DAG).
  11. Expert knowledge in Backup Applications with respect to Active Directory and Microsoft Exchange 2010, 2013, 2016.
  12. Good to have knowledge of Azure.

 

Employment Mode: Permanent Opportunity

 

Work Mode: Work from office

 

Shift: 24*7 Rotational Shift

 

Location: 

Mumbai - Andheri

Pune - Hinjewadi Phase 2

Read more
Wolken Software
at Wolken Software
4 recruiters
Deeksha M
Posted by Deeksha M
Bengaluru (Bangalore)
7 - 10 yrs
₹15L - ₹25L / yr
Business Analysis
skill iconData Analytics
Project Management
About the Company:

Wolken Software provides a suite of AI-enabled, SaaS 2.0 cloud-native applications for Customer Service and Enterprise Solutions namely Wolken Service Desk, Wolken's IT Service Management, and Wolken's HR Case Management. We have replaced incumbents like Salesforce, ServiceNow Zendesk, etc. at various Fortune 500 and Fortune 1000 companies.

Job Description:

We are looking for a Business Analyst with strong organizational and planning skills and a proven ability to multitask in a fast-paced environment. We are seeking a high level of motivation and a self-starting attitude, and the ability to work with minimal direction and supervision. The ideal candidate will have a metrics/data-driven analytical mindset of constantly measuring success and driving continuous improvement in tools, content, and programs.

Business Analyst Qualifications / Skills:

  • Able to exercise independent judgment and take action on it.
  • Excellent analytical, and creative problem-solving skills
  • Excellent listening, interpersonal, written, and oral communication skills
  • Logical and efficient, with keen attention to detail
  • Highly self-motivated and directed.
  • Ability to effectively prioritize and execute tasks while under pressure.
  • Strong customer service orientation
  • Experience working in a team-oriented, collaborative environment.
  • BE, MBA Preferable.

Responsibilities:

  • Data analysis 
  • Business Insights 
  • Leadership 
  • Influence 
  • Strategy 
  • Problem structuring 
  • Project management
Read more
Tech Mahindra
at Tech Mahindra
1 video
2 recruiters
Agency job
via Saiva System by Sunny Kumar
Bengaluru (Bangalore), Hyderabad
5 - 10 yrs
₹10L - ₹15L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)

 

Experience :- 5 +  years

Location :- Bangalore,Hyderabad

 

•       5 + years of experience in Core  Java, , Spring Boot, Microservices   (Mandatory skills) + AWS added advantage

        Experience building scalable backend systems using REST APIs & NoSQL databases

 

•       Computer Science fundamentals in algorithm design, problem solving

 

•       Awareness of Amazon build tools and processes is a big plus

 

 

Read more
Mobile Programming LLC
at Mobile Programming LLC
1 video
34 recruiters
Sindhuja Pasupathi
Posted by Sindhuja Pasupathi
Bengaluru (Bangalore)
2 - 5 yrs
₹7L - ₹9L / yr
skill iconAndroid Development
skill iconKotlin
skill iconJava
skill iconDocker
Hi ,
I need an Android developer (skills: React Native, Kotlin & Dagger)who can join immediately. Or within 7 days max

Location: Bangalore 
Notice Period: Immediate to 7Days(Max)
Budget: upto 14 LPA
Read more
Srijan Technologies
at Srijan Technologies
6 recruiters
Devendra Singh
Posted by Devendra Singh
Remote only
8 - 16 yrs
₹25L - ₹24L / yr
Drupal
skill iconPHP
skill iconAmazon Web Services (AWS)
Microservices

Srijan Technologies is a 18+ year-old technology services firm. For a large part of its life, Srijan has specialised in building content management systems with expertise in PHP-based open-source CMS’, specifically Drupal. In recent years Srijan has diversified into
i) Data Engineering using NodeJS and Python,
ii) Data Science -- Analytics and Machine Learning and
iii) API Management using APIGEE.

Srijan is approx 400 people. Srijan’s development offices in India are located in New Delhi, Gurugram, Goa, Bangalore and Mumbai, Delhi, Gurgaon, and Goa are the largest offices. In addition, a few developers & delivery leads are located in several countries globally -- USA (New York, Charlotte), Singapore, Philippines (Manila), Australia (Sydney, Brisbane, Melbourne), Germany (Berlin), Japan (Tokyo). In each of these countries, Srijan has a functional legal subsidiary.

Srijan works largely with enterprises or mid-large sized global firms and focuses on recurring business from these accounts, thereby bringing much-needed predictability of revenue for high-growth companies. It works with several top brands at the moment.

The firm is beginning to invest in startups and in joint research projects with top institutes. For instance, it recently partnered with IIT-Delhi to invest in an 18-month project for building a solution for ‘Honey traceability using Blockchain’.


The leadership team at Srijan has set itself an audacious goal of reaching $25 million in revenue (while maintaining healthy EBITDA margins) in FY 2020 -- doubling our revenues. This requires significant technology and delivery leadership bandwidth to be created in the firm to ensure our high-quality standards are not compromised.

Each year Srijan donates 7% of its profits to Srijan Foundation Trust a registered non-profit which runs several projects including non-formal schools (directly or via partner organizations) and Indic civilizational projects such as #SrijanTalks.


Responsibilities
:

Srijan’s team of enterprise Drupalists are helping our customers build cutting-edge web experiences, migrate to Drupal, tune and improve their Drupal implementations, and advise on all things Drupal and web architecture.

With the rapid adoption of Drupal as a web platform, and with our growing number of technical development projects supporting our clients and partners, our Technical Architects are in high demand. They consult remotely or travel on-site periodically to work with some of the most talented technologists and some of the hottest web properties on leading-edge web development projects.

Engagements vary by customer and can include anything from custom coding and mentoring of partner and client teams to application design and ongoing guidance on architecture through development and application launch.


Requirements
:

● Prior experience building, leading, and architecting Drupal applications.

  •  Knowledge of Drupal 8, 9 is a plus.
  • Knowledge of at least 1-2 non-PHP frameworks.  Perform complex Drupal development tasks including custom module development using the Drupal API system and hooks from major Drupal core systems

● Ability to guide technical discussions with both technical and non-technical audiences

● Ability to negotiate mutually agreeable outcomes with clients, partners, and Srijan stakeholders.

● Ability to perform complex Drupal development tasks including custom module development using the Drupal API system and hooks from major Drupal core systems

● Experience defining and scope a technical solution for large scale Drupal projects

● Experience working in a consulting or agency environment with direct interaction with enterprise-level clients preferred.

● Excellent ability to partner with both internal and external stakeholders.

● Strong leadership and presentation skills.

● Passion for the web, open-source development.

● Deep experience architecting web solutions.

  • Understanding of HTTP Layers
  • Understanding of API Modeling 
  • Understanding the caching layers 
  • Understanding of Microservice architecture.
  • Understanding of the Event bus system.

● PHP, Drupal, MySQL, SQL administration, and optimization, and Unix/Linux or Windows server.

● 7+ years developing Drupal applications.

● Must be a self-starter that thrives in a fast-paced work environment.

● Knowledge of or experience with other CMS technologies and/or open-source technology is a plus.

● Long-time Drupalists, that are active contributors, are well rewarded, but we’ll also help great developers and consultants become one

● Experience providing technical support or consulting strongly preferred.

● Strong problem-solving abilities, initiative, and the ability to thrive under pressure.

● Excellent interpersonal and English communication skills.

● Bachelor's or Master's degree in Computer Science or related discipline preferred

● Understanding of Virtualisation and containerization.

● Well versed with Build, Bake, and Run process of CI/CD

● Understanding of Debugging, Performance optimization and CI/Cd tools.

● Should have a pulse of the latest technology trend.

Read more
Knot Solutions
Knot Solutions
Agency job
Remote, Hyderabad
2 - 4 yrs
₹1L - ₹5L / yr
skill iconJava
Selenium
Software Testing (QA)
Test Automation (QA)
Selenium Web driver
+1 more
Experience using various automation testing tools for test execution and analysis
Must have Java experience with Selenium Web Driver and expertise in Integration with existing Applications
Experience working in an Agile environment together. Certifications from ISTQB would also be a big plus
Experience in REST/SOAP Web Services
Experience working in Unix, Linux environment
Good to have knowledge in CI/CD using Jenkins
Soft skills: Excellent communication skills, problem solver and self-driven.
Read more
Eight petals
at Eight petals
3 recruiters
Doyal Mallik
Posted by Doyal Mallik
Ahmedabad
2 - 5 yrs
₹4L - ₹4L / yr
skill iconPHP
Wordpress
skill iconJavascript
skill iconPython
skill iconRuby on Rails (ROR)
+4 more
Job Summary
Candidate should have sound experience in PHP/WordPress/Magento.Should be able to work independently as well as in team.Required Skills:WordPress, Magento, Joomla, PrestaShop, jQuery, Bootstrap, PHP, MySQL.
Responsibilities and Duties
• Working on full projects of Wordpress website development, from scratch to finish. 
• Doing the quality checking of psd, layout, css, html, functionality of the website designed. 
• Delivering 100% responsive & perfect cross browser compatibility on projects.
• Communicating with client for changes in website, layout, bugs fixing and delivering the project.
• Designing of landing page, doing PSD to html conversion, taking them live on web server and delivering to client directly.
• Making website SEO friendly & as per the guidelines of Search Engines.
• Doing the website maintenance of existing Wordpress clients & for new ones.
Qualifications and Skills
Skills: Php developer, Web developer, Wordpress Developer, Wordpress CMS, HTML Developer
• Positive attitude
• Willing to learn & work long term
• Self learning ability
• Meets deadlines Key Skills:
• Basic English communication skills
• Knowledge of wordpress, psd to html, css3, bootstrap, html5 psd to wordpress, etc..
• Knowledge in WordPress CMS (Core features).
• knowledge of Wordpress Theme Integration & PSD to Wordpress is a plus.
• Good understanding of accessibility considerations and web standard.
• Knowledge of other PHP CMS like Magento
Read more
Kloh Internet Private Limited
Avnish Gupta
Posted by Avnish Gupta
Bengaluru (Bangalore)
0 - 1 yrs
₹2L - ₹3L / yr
Business Development
Sales
Presales
Client Servicing
Salesforce
We are seeking young, enthusiastic professionals who will expedite the growth of our network of artists and venues. Responsibilities: - Research leads potential artists, venues and builds relationships with them. - Plan approaches and pitches. Work with the team to develop proposals to onboard new artists and venues. - Relationship & Client Management - Strategy & Thought Leadership - Pivotal support to the team in conceptualizing and hosting events. Skills & Qualifications: • Good business sense and budgeting skills. • Strong at communication and negotiation. • Super Enthusiastic
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos