Cutshort logo
Molecular Connections logo
Sr. Spark/AWS Developer
Sr. Spark/AWS Developer
Molecular Connections's logo

Sr. Spark/AWS Developer

Molecular Connections's profile picture
Posted by Molecular Connections
8 - 10 yrs
₹15L - ₹20L / yr
Bengaluru (Bangalore)
Skills
Spark
Hadoop
Big Data
Data engineering
PySpark
Apache Kafka
skill iconScala
skill iconPython
Data modeling
  1. Big data developer with 8+ years of professional IT experience with expertise in Hadoop ecosystem components in ingestion, Data modeling, querying, processing, storage, analysis, Data Integration and Implementing enterprise level systems spanning Big Data.
  2. A skilled developer with strong problem solving, debugging and analytical capabilities, who actively engages in understanding customer requirements.
  3. Expertise in Apache Hadoop ecosystem components like Spark, Hadoop Distributed File Systems(HDFS), HiveMapReduce, Hive, Sqoop, HBase, Zookeeper, YARN, Flume, Pig, Nifi, Scala and Oozie.
  4. Hands on experience in creating real - time data streaming solutions using Apache Spark core, Spark SQL & DataFrames, Kafka, Spark streaming and Apache Storm.
  5. Excellent knowledge of Hadoop architecture and daemons of Hadoop clusters, which include Name node,Data node, Resource manager, Node Manager and Job history server.
  6. Worked on both Cloudera and Horton works in Hadoop Distributions. Experience in managing Hadoop clustersusing Cloudera Manager tool.
  7. Well versed in installation, Configuration, Managing of Big Data and underlying infrastructure of Hadoop Cluster.
  8. Hands on experience in coding MapReduce/Yarn Programs using Java, Scala and Python for analyzing Big Data.
  9. Exposure to Cloudera development environment and management using Cloudera Manager.
  10. Extensively worked on Spark using Scala on cluster for computational (analytics), installed it on top of Hadoop performed advanced analytical application by making use of Spark with Hive and SQL/Oracle .
  11. Implemented Spark using PYTHON and utilizing Data frames and Spark SQL API for faster processing of data and handled importing data from different data sources into HDFS using Sqoop and performing transformations using Hive, MapReduce and then loading data into HDFS.
  12. Used Spark Data Frames API over Cloudera platform to perform analytics on Hive data.
  13. Hands on experience in MLlib from Spark which are used for predictive intelligence, customer segmentation and for smooth maintenance in Spark streaming.
  14. Experience in using Flume to load log files into HDFS and Oozie for workflow design and scheduling.
  15. Experience in optimizing MapReduce jobs to use HDFS efficiently by using various compression mechanisms.
  16. Working on creating data pipeline for different events of ingestion, aggregation, and load consumer response data into Hive external tables in HDFS location to serve as feed for tableau dashboards.
  17. Hands on experience in using Sqoop to import data into HDFS from RDBMS and vice-versa.
  18. In-depth Understanding of Oozie to schedule all Hive/Sqoop/HBase jobs.
  19. Hands on expertise in real time analytics with Apache Spark.
  20. Experience in converting Hive/SQL queries into RDD transformations using Apache Spark, Scala and Python.
  21. Extensive experience in working with different ETL tool environments like SSIS, Informatica and reporting tool environments like SQL Server Reporting Services (SSRS).
  22. Experience in Microsoft cloud and setting cluster in Amazon EC2 & S3 including the automation of setting & extending the clusters in AWS Amazon cloud.
  23. Extensively worked on Spark using Python on cluster for computational (analytics), installed it on top of Hadoop performed advanced analytical application by making use of Spark with Hive and SQL.
  24. Strong experience and knowledge of real time data analytics using Spark Streaming, Kafka and Flume.
  25. Knowledge in installation, configuration, supporting and managing Hadoop Clusters using Apache, Cloudera (CDH3, CDH4) distributions and on Amazon web services (AWS).
  26. Experienced in writing Ad Hoc queries using Cloudera Impala, also used Impala analytical functions.
  27. Experience in creating Data frames using PySpark and performing operation on the Data frames using Python.
  28. In depth understanding/knowledge of Hadoop Architecture and various components such as HDFS and MapReduce Programming Paradigm, High Availability and YARN architecture.
  29. Establishing multiple connections to different Redshift clusters (Bank Prod, Card Prod, SBBDA Cluster) and provide the access for pulling the information we need for analysis. 
  30. Generated various kinds of knowledge reports using Power BI based on Business specification. 
  31. Developed interactive Tableau dashboards to provide a clear understanding of industry specific KPIs using quick filters and parameters to handle them more efficiently.
  32. Well Experience in projects using JIRA, Testing, Maven and Jenkins build tools.
  33. Experienced in designing, built, and deploying and utilizing almost all the AWS stack (Including EC2, S3,), focusing on high-availability, fault tolerance, and auto-scaling.
  34. Good experience with use-case development, with Software methodologies like Agile and Waterfall.
  35. Working knowledge of Amazon's Elastic Cloud Compute( EC2 ) infrastructure for computational tasks and Simple Storage Service ( S3 ) as Storage mechanism.
  36. Good working experience in importing data using Sqoop, SFTP from various sources like RDMS, Teradata, Mainframes, Oracle, Netezza to HDFS and performed transformations on it using Hive, Pig and Spark .
  37. Extensive experience in Text Analytics, developing different Statistical Machine Learning solutions to various business problems and generating data visualizations using Python and R.
  38. Proficient in NoSQL databases including HBase, Cassandra, MongoDB and its integration with Hadoop cluster.
  39. Hands on experience in Hadoop Big data technology working on MapReduce, Pig, Hive as Analysis tool, Sqoop and Flume data import/export tools.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Molecular Connections

Founded :
2001
Type :
Products & Services
Size :
1000-5000
Stage :
Profitable

About

With over two decades of experience in Big Data and Data Science Solutions, Molecular Connections (MC) has been using AI-powered proprietary models to help customers achieve digital transformation. We have been able to successfully build a data-driven decision-making strategy for our customer's digital transformational journey. MC leverages AI, ML and the Linked Data Store to build efficiencies in various verticals and generate new revenue streams for its customers. MC's decades of industry presence and a strong focus on innovation have led us to work with the world's leading pharma and STEM industries to offer end-to-end software development and data insights powered by proprietary workflows and platforms, enabling content engineering across multiple domains. With over 70% of its workforce being women, MC is ranked among the top 15 best companies for women to work for in India. Subsidiary Companies: 1. Molecular Connections Analytics Pvt. Ltd. | URL: https://mcanalytics.co.in/ 2. Molecular Connections Research Pvt. Ltd. | URL: https://mcresearch.co.in/
Read more

Connect with the team

Profile picture
Molecular Connections
Profile picture
Chendil Kumar
Profile picture
Gurminder kaur
Profile picture
Lokanath Khamari

Company social profiles

linkedin

Similar jobs

Talent Pro
Gurugram
3 - 6 yrs
₹20L - ₹35L / yr
User Experience (UX) Design
Top b2c product company only

Strong UX / Product Designer profile

Mandatory (Experience 1) - Must have 3+ YOE in UX / Product Design, with a focus towards B2C Products

Mandatory (Experience 2) - Must have recent 2+ YOE in a Good Product Company

Mandatory (Experience 3) - Must have worked on both UX and UI / Visual Designs (some UI / Visual Design experience is required)

Mandatory (Experience 4) - Strong collaboration experience with Product Managers, Researchers, and other Product stakeholders

Mandatory (Portfolio) - Strong portfolio of UX Design and UI/Visual Designs (both are Mandatory) for B2C Products

Mandatory (Company) - Product Company only

Read more
Deqode
at Deqode
1 recruiter
Roshni Maji
Posted by Roshni Maji
Pune, Bengaluru (Bangalore), Gurugram, Chennai, Mumbai
5 - 7 yrs
₹6L - ₹20L / yr
skill iconAmazon Web Services (AWS)
Amazon Redshift
AWS Glue
skill iconPython
PySpark

Position: AWS Data Engineer

Experience: 5 to 7 Years

Location: Bengaluru, Pune, Chennai, Mumbai, Gurugram

Work Mode: Hybrid (3 days work from office per week)

Employment Type: Full-time

About the Role:

We are seeking a highly skilled and motivated AWS Data Engineer with 5–7 years of experience in building and optimizing data pipelines, architectures, and data sets. The ideal candidate will have strong experience with AWS services including Glue, Athena, Redshift, Lambda, DMS, RDS, and CloudFormation. You will be responsible for managing the full data lifecycle from ingestion to transformation and storage, ensuring efficiency and performance.

Key Responsibilities:

  • Design, develop, and optimize scalable ETL pipelines using AWS Glue, Python/PySpark, and SQL.
  • Work extensively with AWS services such as Glue, Athena, Lambda, DMS, RDS, Redshift, CloudFormation, and other serverless technologies.
  • Implement and manage data lake and warehouse solutions using AWS Redshift and S3.
  • Optimize data models and storage for cost-efficiency and performance.
  • Write advanced SQL queries to support complex data analysis and reporting requirements.
  • Collaborate with stakeholders to understand data requirements and translate them into scalable solutions.
  • Ensure high data quality and integrity across platforms and processes.
  • Implement CI/CD pipelines and best practices for infrastructure as code using CloudFormation or similar tools.

Required Skills & Experience:

  • Strong hands-on experience with Python or PySpark for data processing.
  • Deep knowledge of AWS Glue, Athena, Lambda, Redshift, RDS, DMS, and CloudFormation.
  • Proficiency in writing complex SQL queries and optimizing them for performance.
  • Familiarity with serverless architectures and AWS best practices.
  • Experience in designing and maintaining robust data architectures and data lakes.
  • Ability to troubleshoot and resolve data pipeline issues efficiently.
  • Strong communication and stakeholder management skills.


Read more
VAYUZ Technologies
at VAYUZ Technologies
1 video
4 recruiters
Pooja Chauhan
Posted by Pooja Chauhan
Remote, NCR (Delhi | Gurgaon | Noida), Bengaluru (Bangalore), Chennai, Mumbai, Hyderabad, Kolkata, Lucknow, Chandigarh
4 - 7 yrs
₹5L - ₹8L / yr
skill iconReact.js
skill icon.NET
ASP.NET
skill iconJavascript
SQL
+5 more

JOB PURPOSE

-------------

  • Develop .NET Core applications using React JS reusable components as per need / client specifications
  • This is a hands-on role which involves writing code, testing, and deploying finished web applications and libraries

MAJOR ACCOUNTABILITY

----------------------

  • Design, rapid prototype, and implement a scalable, reliable and maintainable node based web application
  • Enforce code quality through test driven development
  • Enhance, refactor, and continuously improve the existing codebase
  • Collaborate closely with team to define product requirements
  • Aggressively collect, analyse, and act on data about product performance
  • Communicate effectively with technical and non-technical people
  • Proactive in keeping your skills updated

ESSENTIAL SKILLS & EXPERIENCE

-------------------------------

  • Excellent working knowledge of .NET Core, React JS, JavaScript.
  • 4-6 year's overall .NET development experience (At least 2 years of experience in React JS)
  • Experience in working with databases - SQL and Non-SQL Databases
  • Experience in any visualization JS libraries like D3 JS / Charts JS / Sync Fusion / Fusion Charts will be an added advantage.
  • GraphQL
  • Hooks 
  • Redux / Flux 
  • TypeScript 

EDUCATION

-----------

  • Minimum education: Any Graduate BE / B.Tech would be desirable
  • Languages: Excellent English written & spoken
Read more
MInebeamitsumi
Manu Sharma
Posted by Manu Sharma
Bengaluru (Bangalore)
4 - 6 yrs
₹10L - ₹14L / yr
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJavascript
+5 more

• Software Design and Development: Lead and contribute to the design, architecture, and development of software applications within the "I" domain. Collaborate with cross-functional teams, including software developers, hardware engineers, and product managers, to define requirements and specifications for software projects. • Technical Leadership: Provide technical leadership and mentorship to junior engineers, guiding them in best practices, code reviews, and troubleshooting complex technical issues. Act as a subject matter expert in software design principles, programming languages, and development methodologies. • System Integration: Collaborate with other engineering teams to integrate software components with hardware systems or existing software infrastructure. Ensure seamless integration and compatibility of software modules. • Code Review and Quality Assurance: Review code written by other team members to ensure adherence to coding standards, performance optimization, and maintainability. Perform thorough testing and debugging to identify and resolve software defects. • Documentation: Create and maintain technical documentation, including design documents, architecture diagrams, and user manuals. • Research and Innovation: Stay abreast of the latest industry trends, emerging technologies, and best practices related to the "I" domain. Evaluate and recommend new tools, frameworks, and technologies that can enhance the software development process and product performance. • Project Management: Collaborate with project managers to define project scope, estimate effort, and plan development timelines. Ensure projects are delivered on time and within budget, meeting the specified quality standards.

Read more
Softobiz Technologies Private limited
at Softobiz Technologies Private limited
2 candid answers
1 recruiter
Adlin Asha
Posted by Adlin Asha
Hyderabad
8 - 18 yrs
₹15L - ₹30L / yr
ETL
Informatica
Data Warehouse (DWH)
Amazon Redshift
skill iconPostgreSQL
+2 more

Experience: 8+ Years

Work Location: Hyderabad

Mode of work: Work from Office


Senior Data Engineer / Architect

 

Summary of the Role

 

The Senior Data Engineer / Architect will be a key role within the data and technology team, responsible for engineering and building data solutions that enable seamless use of data within the organization. 

 

Core Activities

-         Work closely with the business teams and business analysts to understand and document data usage requirements

-         Develop designs relating to data engineering solutions including data pipelines, ETL, data warehouse, data mart and data lake solutions

-         Develop data designs for reporting and other data use requirements

-         Develop data governance solutions that provide data governance services including data security, data quality, data lineage etc.

-         Lead implementation of data use and data quality solutions

-         Provide operational support for users for the implemented data solutions

-         Support development of solutions that automate reporting and business intelligence requirements

-         Support development of machine learning and AI solution using large scale internal and external datasets

 

Other activities

-         Work on and manage technology projects as and when required

-         Provide user and technical training on data solutions

 

Skills and Experience

-         At least 5-8 years of experience in a senior data engineer / architect role

-         Strong experience with AWS based data solutions including AWS Redshift, analytics and data governance solutions

-         Strong experience with industry standard data governance / data quality solutions  

-         Strong experience with managing a Postgres SQL data environment

-         Background as a software developer working in AWS / Python will be beneficial

-         Experience with BI tools like Power BI and Tableau

Strong written and oral communication skills

 

Read more
MIDAS FINTECH SOLUTIONS PVT LTD
Midas Fintech Solutions Private Limited
Posted by Midas Fintech Solutions Private Limited
Mumbai
2 - 6 yrs
₹4L - ₹9L / yr
skill iconFlutter
DART

Job Description:

We are seeking an experienced Flutter Developer with a passion for creating high-quality mobile applications in the Trading industry. The ideal candidate will have experience working on trading products and will possess a strong understanding of financial markets, trading platforms, and tools. Additionally, the candidate should have experience with the Flutter framework and will possess a range of relevant skills to help them succeed in this role.


Responsibilities:

  • Design, develop and deploy high-quality mobile applications for trading products using the Flutter framework.
  • Collaborate with product managers, designers, and other stakeholders to define product requirements and specifications.
  • Write high-quality, maintainable code that adheres to industry standards and best practices.
  • Develop and maintain automated testing frameworks to ensure the quality of the application.
  • Optimize application performance for mobile devices and ensure a smooth user experience.
  • Stay up-to-date with industry trends and developments to ensure that our products are competitive and innovative.
  • Collaborate with the development team to ensure that applications are deployed and maintained according to established processes and procedures.


Requirements:

  • Bachelor's or Master's degree in Computer Science, Software Engineering, or related field.
  • 3+ years of experience in mobile application development, with a focus on trading products.
  • Strong experience with the Flutter framework and related technologies.
  • Experience with reactive programming using streams and bloc patterns.
  • Familiarity with financial markets, trading platforms, and tools.
  • Knowledge of API integration and RESTful web services.
  • Experience with version control systems such as Git.
  • Familiarity with agile methodologies and practices.
  • Strong problem-solving and analytical skills.
  • Excellent communication and collaboration skills to work effectively with cross-functional teams.


Required Skills:

  • Strong experience in developing mobile applications with Flutter
  • Experience in developing Trading products
  • Strong understanding of Dart programming language
  • Experience with RESTful APIs and JSON
  • Experience with state management libraries like BLoC, Provider, and Riverpod
  • Knowledge of Material Design Guidelines and Human Interface Guidelines
  • Familiarity with Agile methodologies and development practices
  • Excellent problem-solving skills and ability to troubleshoot complex issues
  • Ability to work independently and as part of a team


Preferred Skills:

  • Experience with Firebase and Firestore
  • Experience with integrating third-party APIs
  • Knowledge of GraphQL
  • Familiarity with charting libraries like MPAndroidChart and Fl_chart
  • Experience with automated testing frameworks like Flutter Driver and Mockito

If you are a skilled Flutter Developer who has worked on Trading products and is passionate about building robust and scalable mobile applications, we would love to hear from you!





Read more
TestVagrant
at TestVagrant
1 recruiter
Pallavi Garg
Posted by Pallavi Garg
Bengaluru (Bangalore)
3 - 6 yrs
₹3L - ₹15L / yr
Selenium
Appium
Test Automation (QA)
Software Testing (QA)

Location: Bangalore(Hybrid mode)


●3 to 6 years of experience in Testing software applications

●Thorough Understanding of - Test life cycle & Defect life cycle

●Ability to understand requirements thoroughly, design, develop, execute tests and ensure test coverage

●Strong command in any one of the programming languages

●Experience with any of 2 Open Source testing tools like Selenium , RestAssured, Appium.

●Ability to understand the test automation framework concepts, Contribute to the development of automation frameworks and authoring automated tests

●Ability to quickly learn new technologies in a dynamic environment

●Understanding of GIT or equivalent


Mandatory Requirements:


●Bachelors and/or master’s in computer science or equivalent

●Excellent computer fundamentals, analytical and problem-solving skills

●Exceptional testing skills. Provide good attention to details

●Strong communication and collaboration skills


About the Company


TestVagrant is a software test consulting company with the goal to help companies accelerate the time-to-market of a product/service by using intelligent test solutions. TestVagrant specializes in strategising QA by using frameworks and solutions which are innovative and next-generation thereby helping companies deliver high-quality software at a fast-track speed.

Read more
Orios Venture Partners
at Orios Venture Partners
1 recruiter
Deepak Sukhija
Posted by Deepak Sukhija
Mumbai
4 - 7 yrs
₹5L - ₹10L / yr
Tally
Accounting
Financial accounting
Finance
Audit

Orios Venture Partners is an Indian Seed Stage Venture Capital firm. Currently investing from our Fund II, with a focus on tech investments across consumer and B2B for the Indian market. We are 3 partners and a VP who leads investments.

Some of our well-known investments are Pharmeasy, Country Delight, LetsMD, BeatO, GoMechanic, Zupee.

 

The fund’s founding team are experienced investors since 2008, and pre Orios investments include OlaCabs, Druva, Faballey, Box8, Unbxd and Jigsee.

 

We are well known for trend spotting and our maxim is #BackingMisfits

 

Our strategy is invest in selected companies and work closely with them. As a consequence each investment lead works with no more than 4 to 6 companies at a time.

 

Responsibilities:

We are looking for a Senior Executive - Accounts & Finance responsible for-

 

The Role

+ Improvise and maintenance of accounts.

+ Owning and preparing matters related to working and compliance - Income Tax, GST and other Fund related matters

+ Supporting seniors in tax planning opportunities, new tax laws and structuring.

+ Maintaining of unitholder, investment register and undertaking routine Fund industry related calculations.

+ Update Tally on a regular basis.

+ Coordination and support in Finalization, Auditing, Valuation, etc of Fund, Fund Manager, as applicable.

+ MIS management in a timely manner for financial and business performance.

+Coordination and support team with auditors for half yearly audits, tax regulators, valuers, accounting regulators and regulatory bodies. Provide information to auditors, trustee, shareholders, bankers and other stakeholders on a timely basis.

+ Perform tests to check financial information and systems.

+ Work closely to improvise functioning of department and/or entities.

+ Ownership of documents in terms of maintaining files– physical and digital

+ Any additional, yet to be determined, responsibility shall be assigned.

 

Requirements: Attributes, Experience

+ CA inter cleared - with 4 to 6 Yrs experience.

+ Understanding of operational and strategic aspects of Tax, Compliance, Governance Framework and Accounting software preferably in a multi entity scenario.   

+ Functional Area:Primarily Accounts, Finance, Income Tax, GST, Compliance. Computations, etc.

+ Detail-oriented, proactive and self-motivated.

+ Team player with ability to work effectively in small groups.

+ Seeking a long and stable stint. This should ideally be their last stop as VC is a long reward industry.

Read more
AM Infoweb
at AM Infoweb
1 recruiter
Sushmita Gaikwad
Posted by Sushmita Gaikwad
Remote, Pune
3 - 8 yrs
₹3L - ₹7L / yr
Sales
Business Development
Cold calling
BDE
 REQUIREMENT:
*3+ years of US Sales experience is mandatory (Product/Service)
*Min Graduation 
*Extraordinarily fluent in English
*Confident & should have convincing skills.
*To go "Extra Mile" to meet the sales target.
*Target driven with a positive attitude.
*Standard hike on last drawn Salary + Deal Based Incentive
*Work from Office.
*Immedidate Joiner

AM Infoweb is looking to add bright, focused, resourceful, and highly goal-oriented Sales & Business Development Executive. You will be responsible for supporting sales success by ensuring customers have the products, services, and support to meet their technology and business needs. You will utilize your potentials to build strong relationships with customers over the phone, to sell AM Infoweb's offerings
Read more
Wishfin
Noida, NCR (Delhi | Gurgaon | Noida)
2 - 7 yrs
₹2L - ₹7L / yr
Sales
Financial analysis
Investment management
Portfolio management
Investment banking
+2 more
Senior Investment Advisor/ Group Team Leader- Mutual FundsWe are immediately hiring a Group Team Leader for Mutual Funds.JOB PROFILE : Group Team Leader - Mutual FundsAbout the Company:Wishfin is Indias premier fin-tech company. Being the largest digital marketplace for loans in India, responsible for more than $600 million in annual disbursal, we are always trying to build industry-changing products. Wishfin has recently launched the Insurance Marketplace and we are onboarding bright & passionate candidates in the Sales team.KEY RESPONSIBILITIES : - To achieve mutual fund sales targets assigned- Motivate, train & lead the team towards successful outcomes- Increase lead conversions from all team members - Organize & participate in investor programs/camps for fresh lead generation & conversion - Managing & monitoring client portfolios and advising them on a regular basis - Ensure no losses or errors occurred while assisting customers - Work towards ensuring zero cases of mis-selling / fraud in the processes - Responding in a timely and effective manner to all internal communication- Adheres to and supports company policies and practices. KEY EXPERIENCES REQUIRED : - 2+ years of experience in Sales of Investment- Preferably for online customers- High-energy, positive attitude & passion for Sales- Excellent Communication Skills- NISM Certified
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos