Cutshort logo
Molecular Connections logo
Sr. Spark/AWS Developer
Sr. Spark/AWS Developer
Molecular Connections's logo

Sr. Spark/AWS Developer

Molecular Connections's profile picture
Posted by Molecular Connections
8 - 10 yrs
₹15L - ₹20L / yr
Bengaluru (Bangalore)
Skills
Spark
Hadoop
Big Data
Data engineering
PySpark
Apache Kafka
skill iconScala
skill iconPython
Data modeling
  1. Big data developer with 8+ years of professional IT experience with expertise in Hadoop ecosystem components in ingestion, Data modeling, querying, processing, storage, analysis, Data Integration and Implementing enterprise level systems spanning Big Data.
  2. A skilled developer with strong problem solving, debugging and analytical capabilities, who actively engages in understanding customer requirements.
  3. Expertise in Apache Hadoop ecosystem components like Spark, Hadoop Distributed File Systems(HDFS), HiveMapReduce, Hive, Sqoop, HBase, Zookeeper, YARN, Flume, Pig, Nifi, Scala and Oozie.
  4. Hands on experience in creating real - time data streaming solutions using Apache Spark core, Spark SQL & DataFrames, Kafka, Spark streaming and Apache Storm.
  5. Excellent knowledge of Hadoop architecture and daemons of Hadoop clusters, which include Name node,Data node, Resource manager, Node Manager and Job history server.
  6. Worked on both Cloudera and Horton works in Hadoop Distributions. Experience in managing Hadoop clustersusing Cloudera Manager tool.
  7. Well versed in installation, Configuration, Managing of Big Data and underlying infrastructure of Hadoop Cluster.
  8. Hands on experience in coding MapReduce/Yarn Programs using Java, Scala and Python for analyzing Big Data.
  9. Exposure to Cloudera development environment and management using Cloudera Manager.
  10. Extensively worked on Spark using Scala on cluster for computational (analytics), installed it on top of Hadoop performed advanced analytical application by making use of Spark with Hive and SQL/Oracle .
  11. Implemented Spark using PYTHON and utilizing Data frames and Spark SQL API for faster processing of data and handled importing data from different data sources into HDFS using Sqoop and performing transformations using Hive, MapReduce and then loading data into HDFS.
  12. Used Spark Data Frames API over Cloudera platform to perform analytics on Hive data.
  13. Hands on experience in MLlib from Spark which are used for predictive intelligence, customer segmentation and for smooth maintenance in Spark streaming.
  14. Experience in using Flume to load log files into HDFS and Oozie for workflow design and scheduling.
  15. Experience in optimizing MapReduce jobs to use HDFS efficiently by using various compression mechanisms.
  16. Working on creating data pipeline for different events of ingestion, aggregation, and load consumer response data into Hive external tables in HDFS location to serve as feed for tableau dashboards.
  17. Hands on experience in using Sqoop to import data into HDFS from RDBMS and vice-versa.
  18. In-depth Understanding of Oozie to schedule all Hive/Sqoop/HBase jobs.
  19. Hands on expertise in real time analytics with Apache Spark.
  20. Experience in converting Hive/SQL queries into RDD transformations using Apache Spark, Scala and Python.
  21. Extensive experience in working with different ETL tool environments like SSIS, Informatica and reporting tool environments like SQL Server Reporting Services (SSRS).
  22. Experience in Microsoft cloud and setting cluster in Amazon EC2 & S3 including the automation of setting & extending the clusters in AWS Amazon cloud.
  23. Extensively worked on Spark using Python on cluster for computational (analytics), installed it on top of Hadoop performed advanced analytical application by making use of Spark with Hive and SQL.
  24. Strong experience and knowledge of real time data analytics using Spark Streaming, Kafka and Flume.
  25. Knowledge in installation, configuration, supporting and managing Hadoop Clusters using Apache, Cloudera (CDH3, CDH4) distributions and on Amazon web services (AWS).
  26. Experienced in writing Ad Hoc queries using Cloudera Impala, also used Impala analytical functions.
  27. Experience in creating Data frames using PySpark and performing operation on the Data frames using Python.
  28. In depth understanding/knowledge of Hadoop Architecture and various components such as HDFS and MapReduce Programming Paradigm, High Availability and YARN architecture.
  29. Establishing multiple connections to different Redshift clusters (Bank Prod, Card Prod, SBBDA Cluster) and provide the access for pulling the information we need for analysis. 
  30. Generated various kinds of knowledge reports using Power BI based on Business specification. 
  31. Developed interactive Tableau dashboards to provide a clear understanding of industry specific KPIs using quick filters and parameters to handle them more efficiently.
  32. Well Experience in projects using JIRA, Testing, Maven and Jenkins build tools.
  33. Experienced in designing, built, and deploying and utilizing almost all the AWS stack (Including EC2, S3,), focusing on high-availability, fault tolerance, and auto-scaling.
  34. Good experience with use-case development, with Software methodologies like Agile and Waterfall.
  35. Working knowledge of Amazon's Elastic Cloud Compute( EC2 ) infrastructure for computational tasks and Simple Storage Service ( S3 ) as Storage mechanism.
  36. Good working experience in importing data using Sqoop, SFTP from various sources like RDMS, Teradata, Mainframes, Oracle, Netezza to HDFS and performed transformations on it using Hive, Pig and Spark .
  37. Extensive experience in Text Analytics, developing different Statistical Machine Learning solutions to various business problems and generating data visualizations using Python and R.
  38. Proficient in NoSQL databases including HBase, Cassandra, MongoDB and its integration with Hadoop cluster.
  39. Hands on experience in Hadoop Big data technology working on MapReduce, Pig, Hive as Analysis tool, Sqoop and Flume data import/export tools.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Molecular Connections

Founded :
2001
Type :
Products & Services
Size :
1000-5000
Stage :
Profitable

About

With over two decades of experience in Big Data and Data Science Solutions, Molecular Connections (MC) has been using AI-powered proprietary models to help customers achieve digital transformation. We have been able to successfully build a data-driven decision-making strategy for our customer's digital transformational journey. MC leverages AI, ML and the Linked Data Store to build efficiencies in various verticals and generate new revenue streams for its customers. MC's decades of industry presence and a strong focus on innovation have led us to work with the world's leading pharma and STEM industries to offer end-to-end software development and data insights powered by proprietary workflows and platforms, enabling content engineering across multiple domains. With over 70% of its workforce being women, MC is ranked among the top 15 best companies for women to work for in India. Subsidiary Companies: 1. Molecular Connections Analytics Pvt. Ltd. | URL: https://mcanalytics.co.in/ 2. Molecular Connections Research Pvt. Ltd. | URL: https://mcresearch.co.in/
Read more

Connect with the team

Profile picture
Molecular Connections
Profile picture
Chendil Kumar
Profile picture
Gurminder kaur
Profile picture
Lokanath Khamari

Company social profiles

linkedin

Similar jobs

NeoGenCode Technologies Pvt Ltd
Akshay Patil
Posted by Akshay Patil
Pune
3 - 8 yrs
₹12L - ₹25L / yr
Large Language Models (LLM)
Retrieval Augmented Generation (RAG)
Artificial Intelligence (AI)
skill iconMachine Learning (ML)
Software Testing (QA)
+9 more

Job Title : QA Lead (AI/ML Products)

Employment Type : Full Time

Experience : 4 to 8 Years

Location : On-site

Mandatory Skills : Strong hands-on experience in testing AI/ML (LLM, RAG) applications with deep expertise in API testing, SQL/NoSQL database validation, and advanced backend functional testing.


Role Overview :

We are looking for an experienced QA Lead who can own end-to-end quality for AI-influenced products and backend-heavy systems. This role requires strong expertise in advanced functional testing, API validation, database verification, and AI model behavior testing in non-deterministic environments.


Key Responsibilities :

  • Define and implement comprehensive test strategies aligned with business and regulatory goals.
  • Validate AI/ML and LLM-driven applications, including RAG pipelines, hallucination checks, prompt injection scenarios, and model response validation.
  • Perform deep API testing using Postman/cURL and validate JSON/XML payloads.
  • Execute complex SQL queries (MySQL/PostgreSQL) and work with MongoDB for backend and data integrity validation.
  • Analyze server logs and transactional flows to debug issues and ensure system reliability.
  • Conduct risk analysis and report key QA metrics such as defect leakage and release readiness.
  • Establish and refine QA processes, templates, standards, and agile testing practices.
  • Identify performance bottlenecks and basic security vulnerabilities (e.g., IDOR, data exposure).
  • Collaborate closely with developers, product managers, and domain experts to translate business requirements into testable scenarios.
  • Own feature quality independently from conception to release.

Required Skills & Experience :

  • 4+ years of hands-on experience in software testing and QA.
  • Strong understanding of testing AI/ML products, LLM validation, and non-deterministic behavior testing.
  • Expertise in API Testing, server log analysis, and backend validation.
  • Proficiency in SQL (MySQL/PostgreSQL) and MongoDB.
  • Deep knowledge of SDLC and Bug Life Cycle.
  • Strong problem-solving ability and structured approach to ambiguous scenarios.
  • Awareness of performance testing and basic security testing practices.
  • Excellent communication skills to articulate defects and QA strategies.

What We’re Looking For :

A proactive QA professional who can go beyond UI testing, understands backend systems deeply, and can confidently test modern AI-driven applications while driving quality standards across the team.

Read more
Potentiam
at Potentiam
2 candid answers
karishma raj
Posted by karishma raj
Bengaluru (Bangalore)
3 - 16 yrs
₹15L - ₹25L / yr
Tagetik
SAP

About Potentiam

Potentiam helps SME companies build world-class offshore teams. Our model is our locations and your dedicated staff under your control. Potentiam have offices in Iasi in Romania, Bangalore and Cape Town, home to large liquid pools of offshore talent working for international companies. Potentiam's management team have had over 15 years' experience in building offshore teams, and have specialist functional expertise to support the transition offshore in technology, finance, operations, engineering, digital marketing, technology and analytics. For decades corporations' scale has enabled them to benefit from the cost and skills advantage of offshore operations. Now SME companies can enjoy a similar benefit through Potentiam without any upfront investment.


Location : Bangalore ( Hybrid)


Skills

• Good experience in EPM platform tools, specially in Tagetik.

• Experience implementing CPM/EPM systems.

• Experience in end to end implementation is required.

• Experience in Financial Consolidation and troubleshooting.

• Excellent documentation skills, with the ability to write clear, concise technical and business documents.

• Experience of understanding in report building, setting up dimensions and hierarchy, ETL and UAT


Benefits and Perks

• Health Insurance

• Referral Bonus

• Performance Bonus

• Flexible Working options

Read more
Top 3 Fintech Startup
Top 3 Fintech Startup
Agency job
via Jobdost by Sathish Kumar
Bengaluru (Bangalore)
6 - 9 yrs
₹20L - ₹30L / yr
skill iconAmazon Web Services (AWS)
PySpark
SQL
Apache Spark
skill iconPython

We are looking for an exceptionally talented Lead data engineer who has exposure in implementing AWS services to build data pipelines, api integration and designing data warehouse. Candidate with both hands-on and leadership capabilities will be ideal for this position.

 

Qualification: At least a bachelor’s degree in Science, Engineering, Applied Mathematics. Preferred Masters degree

 

Job Responsibilities:

• Total 6+ years of experience as a Data Engineer and 2+ years of experience in managing a team

• Have minimum 3 years of AWS Cloud experience.

• Well versed in languages such as Python, PySpark, SQL, NodeJS etc

• Has extensive experience in Spark ecosystem and has worked on both real time and batch processing

• Have experience in AWS Glue, EMR, DMS, Lambda, S3, DynamoDB, Step functions, Airflow, RDS, Aurora etc.

• Experience with modern Database systems such as Redshift, Presto, Hive etc.

• Worked on building data lakes in the past on S3 or Apache Hudi

• Solid understanding of Data Warehousing Concepts

• Good to have experience on tools such as Kafka or Kinesis

• Good to have AWS Developer Associate or Solutions Architect Associate Certification

• Have experience in managing a team

Read more
Casey Group
Priyanka Dash
Posted by Priyanka Dash
Sundargarh
2 - 3 yrs
₹3.5L - ₹3.7L / yr
Communication Skills
Sales
Marketing

Responsibilities:


.Create exclusive distributors, exclusive super stockiest and business associates for the company towards business growth.

.Guide, coordinate and make strategic marketing plans for the sales team working under his jurisdiction.

.Finding and developing new markets and improving sales.

.Keep observing stock reports, inventory, product orders, re-order etc.


Requirements:

.Bachelor's degree in business, marketing or a related field.

.Experience in sales, marketing or related field.

.Strong communication skills.

.Proficient in Word, Excel, Outlook, and power point.

Read more
With a global provider of Business Process Management.
With a global provider of Business Process Management.
Agency job
via Jobdost by Mamatha A
Bengaluru (Bangalore), Mumbai, Gurugram, Nashik, Pune, Visakhapatnam, Chennai, Noida
3 - 5 yrs
₹8L - ₹12L / yr
Oracle Analytics
OAS
OAC
Oracle OAS
Oracle
+8 more

Oracle OAS Developer

 

 

Senior OAS/OAC (Oracle analytics) designer and developer having 3+ years of experience. Worked on new Oracle Analytics platform. Used latest features, custom plug ins and design new one using Java. Has good understanding about the various graphs data points and usage for appropriate financial data display. Worked on performance tuning and build complex data security requirements.

Qualifications



Bachelor university degree in Engineering/Computer Science.

Additional information

Have knowledge of Financial and HR dashboard

 

Read more
Semperfi Services and Solutions
Ramarthi Nishitha
Posted by Ramarthi Nishitha
Remote, Bengaluru (Bangalore)
4 - 7 yrs
₹10L - ₹15L / yr
webMethods
JDBC
SAP
ESB
RESTful APIs
- Experience as a Web methods Developer with both MFT and JDBC adapter experience
 
- Experience in webMethods Integration 9.x, 10.x/above.
 
- AS2 transmission with partners.
 
- Working experience in webMethods designer, Integration Server, Web Services (REST, SOAP), pub-sub model, JMS, SAP adapter, SFDC adapter, AS400 adapter, webMethods Test Suit and MQ Adapters.
 
- Hands on building BPM and TN integrations. Must have built process models in deployed them till production.
 
- Hands on CAF. Must have built custom pages on CAF and deployed then till production.
 
- Knowledge on Scrum methodology.
 
- Basic Fundamental understanding, logical reasoning, problem solving approach.
 
- Excellent communication.
 
- Good Problem Solving approach
 
Primary Skills :
 
- Experience as a Web methods Developer with both MFT and JDBC adapter experience
 
- RESTful service development
 
- In-depth ESB knowledge
 
- Experience in SAP adapters
Read more
Flexmoney Technologies Pvt Ltd
Kshipra Patil
Posted by Kshipra Patil
Remote only
2 - 6 yrs
₹5L - ₹25L / yr
User Experience (UX) Design
Product design
User Interface (UI) Design

About Us

Flexmoney’s mission is to “Simplify, Sachet-ize and Democratize Consumer Credit” for the mass-market Indian consumer. Flexmoney enables banks and trusted lending partners to offer lender-branded, instant consumer finance/ EMIs at point of sale. Flexmoney owns and operates InstaCredTM, the largest BNPL network of online merchants and lenders with over 25 M+ pre-approved user credit lines from multiple lending partners and over 3000+ top marquee online merchants.. We provide the technology infrastructure and point-of-sale merchant network distribution as a “plug and play” proposition to banks and NBFCs.

Lending partners can offer lender-branded, frictionless, point of sale purchase credit to any consumer via a “plug and play” integration. Merchants enable our payment mode to provide shoppers with an instant, “cardless” credit payment option at checkout

Job Role & Responsibilities

  • Create/iterate/collaborate design concepts, user flows, sitemaps, interfaces, and visual design systems with the Product Managers and rest of the team members

  • Conduct User and Market Research to understand customer behaviour and related products in the market. Tie that understanding with business objectives to design an intuitive user experience

  • Collaborate with product and engineering teams to define, implement and launch innovative user products across multiple form factors

  • Perform data-driven design iterations to keep improving the business metrics

What we look for

  • 3-6 years of experience in the field of UX

  • Experience in working with fidelity based software including Balsamiq, Sketch, and Invision Studio, Marvel App, Figma, Adobe XD, and similar tools.

  • Good understanding of how front-end technologies, patterns for mobile apps &

    responsive websites work in the actual scenario

  • Strong communication skills with ability to clearly articulate complex ideas

  • Versatile team player with the ability to work iteratively in a highly agile, lean UX, and scrum environment

  • Understanding of basic front-end languages: HTML5, CSS3 Javascript for rapid prototyping

  • Prior experience in working with tech product companies/ startup is a plus

  • Portfolio of work covering products and services on the web, mobile and desktop

Read more
IMPACTREE DATA TECHNOLOGIES
Rajashri sai
Posted by Rajashri sai
Remote, Chennai, Mumbai, Bengaluru (Bangalore)
2 - 7 yrs
₹2.4L - ₹3.6L / yr
skill iconJava
Software Development
Data Structures
Algorithms
skill iconScala
+14 more
Impactree Data Technologies is a young social enterprise working to support social organisations scale development programmes using technology of data monitoring and analytics on a real time basis. Impactree specifically works at building data intellegence for two specific sectors - rural livelihoods and education. Our team consists of members qualified from London Business School, IIM Khozikode, ICAI, Anna University etc.

We are an upcoming profitable social enterprise and as a a part of the team we are looking for a candidate who can work with our team to build better analytics and intellegence into our platform Prabhaav. 

We are looking for a Software Developer to build and implement functional programs. You will work with other Developers and https://resources.workable.com/product-manager-job-description">Product Managers throughout the software development life cycle.


In this role, you should be a team player with a keen eye for detail and problem-solving skills. If you also have experience in Agile frameworks and popular coding languages (e.g. JavaScript).


Your goal will be to build efficient programs and systems that serve user needs. 

Technical Skills we are looking for are:

 

  • Producing clean, efficient code based on specifications
  • Coding Abilities in HTML , PHP , JS , JSP – Server let , JAVA , DevOps(basic Knowledge).
  • Additional Skills (preferred) : NodeJS , Python , Angular JS .
  • System Administrator Experience : Linux (Ubuntu/RedHat) , Windows CE-Embedded.
  • Data Base Experience : MySQL , Posgres , Mongo DB.
  • Data Format Experience : JSON , XML , AJAX , JQuery.
  • Should have Depth in software Architecture Design especially for Stand-Alone Software As Product , or SaaS Platform Experience.
  • Should have Basic Experience/knowledge in Micro-Services , Rest API’s and SOAP methodologies.
  • Should have built some backend architecture for Long Standing Applications.
  • Good HTML Design Sense.
  • Experience with AWS Services like EC2 and LightSail is Preferred.
  • Testing and deploying programs and systems
  • Fixing and improving existing software
  • Good Understanding of OOP’s and Similar Concepts.
  • Research on New JS Methodologies like React Js and Angular Js

 

Experience areas we are looking for: 
  • Proven experience as a Software Developer, https://resources.workable.com/software-engineer-job-description">Software Engineeror similar role
  • Familiarity with Agile development methodologies
  • Experience with software design and development in a test-driven environment
  • Knowledge of coding languages (e.g. Java, JavaScript) and frameworks/systems (e.g. AngularJS, Git)
  • Experience with databases and Object-Relational Mapping (ORM) frameworks (e.g. Hibernate)
  • Ability to learn new languages and technologies
  • Excellent communication skills
  • Resourcefulness and troubleshooting aptitude
  • Attention to detail

 

Read more
ONN Bikes
Pune
1 - 2 yrs
₹1.8L - ₹2.4L / yr
Customer Success
Customer Support
At ONN, we believe in "doing stuff never done before" and provide opportunities for professionals to become successful risk-taking entrepreneurs. With an attitude of fearless innovation, our employees are enabled to take charge of future business opportunities and leadership roles.

You will be a thought leader and the go to person for the staff and drive engagement & affiliation. Move and inspire people with innovative ideas; help turn ideas into reality, and set values, thought and culture to replicate excellence in each field.

The Interesting Challenge :

- Creating value through innovation and reinventing service delivery benchmarks.

- Ensuring "Customer first" always in all the situations.

- Ensure that service is fully operational and processes are running smoothly.

What you'll offer us :

- Ability to monitor, manage escalations, and provide resolutions with a sense of urgency while ensuring zero issue-based churns.

- Advocate and manage user relationships and engagement

What you will need :

- The individual should be a go-getter, self-starter, articulate, and detail-oriented, with an ability to engage with stakeholders across all levels - both internal and external.

- Exposure/experience with Auto dealerships will be an added advantage

- Excellent interpersonal, verbal, and written communication skills with a proven ability to take initiative and build strong productive relationships

- A proven track record of simultaneously managing multiple projects. Motivated and driven to take on additional responsibilities with a sense of urgency.
Read more
DROR LABS
at DROR LABS
2 recruiters
Siddika banu
Posted by Siddika banu
Gurugram, NCR (Delhi | Gurgaon | Noida)
3 - 7 yrs
₹3L - ₹5L / yr
User Interface (UI) Design
User Experience (UX) Design
Visual Designing
Adobe Photoshop
skill iconAdobe Illustrator

What you’ll be doing:

  • You’ll collaborate in perfect synergy with other designers and product managers on India’s top community safety app, and design in a fast-paced environment.
  • You’ll understand the user experience strategy for a productand drive the overall design solutions based on usability, consistency, business goals, time to market and customer experience.
  • You’ll create wireframes, storyboards, user flows and process flows to effectively communicate interaction and design ideas.
  • You’ll apply user-focused design processes to create high quality user experiences on our app.

What you’ll bring to the team:

  • You’ll bring an in-depth understanding of design patterns across web and mobile platforms.
  • You’ll bring critical experience and skills in visual design, UX design, research, micro-interactions
  • You’ll bring a demonstrated ability to be a self-starter who will drive progress.
  • An expertise in Photoshop, Illustrator, Sketch, Invision, Pixate, Framer or other visual design and wire-framing tools.

Interview Process & Prep Notes:

Portfolio Review
Design Approach, Experience, Project overview. Be ready to deep dive and effectively articulate your experience in the UX Field by showing us your portfolio, showcasing past experience, sharing your understanding of design approach, design thinking and your wizardry with tools, processes or unique skill-sets.

Design Assignment
Solution Approach, Task Flows, Mind Maps, Prototyping, Visual skills. The moment is finally here where you walk the talk and demonstrate your ability in UX Designing by acing a short challenging assignment shared by our designers.

Team Fitment
Behavioural Assessment, Culture Fit, Project Knowledge, Role OperationBe yourself. It works out better for everyone if we are genuine and can see if we are a cultural fit for each other.
Everyone here is focused on our mission and hope we can align.

Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos