Cutshort logo
Molecular Connections logo
Sr. Spark/AWS Developer
Sr. Spark/AWS Developer
Molecular Connections's logo

Sr. Spark/AWS Developer

Molecular Connections's profile picture
Posted by Molecular Connections
8 - 10 yrs
₹15L - ₹20L / yr
Bengaluru (Bangalore)
Skills
PySpark
Data engineering
Big Data
Hadoop
Spark
Apache Kafka
skill iconScala
skill iconPython
Data modeling
  1. Big data developer with 8+ years of professional IT experience with expertise in Hadoop ecosystem components in ingestion, Data modeling, querying, processing, storage, analysis, Data Integration and Implementing enterprise level systems spanning Big Data.
  2. A skilled developer with strong problem solving, debugging and analytical capabilities, who actively engages in understanding customer requirements.
  3. Expertise in Apache Hadoop ecosystem components like Spark, Hadoop Distributed File Systems(HDFS), HiveMapReduce, Hive, Sqoop, HBase, Zookeeper, YARN, Flume, Pig, Nifi, Scala and Oozie.
  4. Hands on experience in creating real - time data streaming solutions using Apache Spark core, Spark SQL & DataFrames, Kafka, Spark streaming and Apache Storm.
  5. Excellent knowledge of Hadoop architecture and daemons of Hadoop clusters, which include Name node,Data node, Resource manager, Node Manager and Job history server.
  6. Worked on both Cloudera and Horton works in Hadoop Distributions. Experience in managing Hadoop clustersusing Cloudera Manager tool.
  7. Well versed in installation, Configuration, Managing of Big Data and underlying infrastructure of Hadoop Cluster.
  8. Hands on experience in coding MapReduce/Yarn Programs using Java, Scala and Python for analyzing Big Data.
  9. Exposure to Cloudera development environment and management using Cloudera Manager.
  10. Extensively worked on Spark using Scala on cluster for computational (analytics), installed it on top of Hadoop performed advanced analytical application by making use of Spark with Hive and SQL/Oracle .
  11. Implemented Spark using PYTHON and utilizing Data frames and Spark SQL API for faster processing of data and handled importing data from different data sources into HDFS using Sqoop and performing transformations using Hive, MapReduce and then loading data into HDFS.
  12. Used Spark Data Frames API over Cloudera platform to perform analytics on Hive data.
  13. Hands on experience in MLlib from Spark which are used for predictive intelligence, customer segmentation and for smooth maintenance in Spark streaming.
  14. Experience in using Flume to load log files into HDFS and Oozie for workflow design and scheduling.
  15. Experience in optimizing MapReduce jobs to use HDFS efficiently by using various compression mechanisms.
  16. Working on creating data pipeline for different events of ingestion, aggregation, and load consumer response data into Hive external tables in HDFS location to serve as feed for tableau dashboards.
  17. Hands on experience in using Sqoop to import data into HDFS from RDBMS and vice-versa.
  18. In-depth Understanding of Oozie to schedule all Hive/Sqoop/HBase jobs.
  19. Hands on expertise in real time analytics with Apache Spark.
  20. Experience in converting Hive/SQL queries into RDD transformations using Apache Spark, Scala and Python.
  21. Extensive experience in working with different ETL tool environments like SSIS, Informatica and reporting tool environments like SQL Server Reporting Services (SSRS).
  22. Experience in Microsoft cloud and setting cluster in Amazon EC2 & S3 including the automation of setting & extending the clusters in AWS Amazon cloud.
  23. Extensively worked on Spark using Python on cluster for computational (analytics), installed it on top of Hadoop performed advanced analytical application by making use of Spark with Hive and SQL.
  24. Strong experience and knowledge of real time data analytics using Spark Streaming, Kafka and Flume.
  25. Knowledge in installation, configuration, supporting and managing Hadoop Clusters using Apache, Cloudera (CDH3, CDH4) distributions and on Amazon web services (AWS).
  26. Experienced in writing Ad Hoc queries using Cloudera Impala, also used Impala analytical functions.
  27. Experience in creating Data frames using PySpark and performing operation on the Data frames using Python.
  28. In depth understanding/knowledge of Hadoop Architecture and various components such as HDFS and MapReduce Programming Paradigm, High Availability and YARN architecture.
  29. Establishing multiple connections to different Redshift clusters (Bank Prod, Card Prod, SBBDA Cluster) and provide the access for pulling the information we need for analysis. 
  30. Generated various kinds of knowledge reports using Power BI based on Business specification. 
  31. Developed interactive Tableau dashboards to provide a clear understanding of industry specific KPIs using quick filters and parameters to handle them more efficiently.
  32. Well Experience in projects using JIRA, Testing, Maven and Jenkins build tools.
  33. Experienced in designing, built, and deploying and utilizing almost all the AWS stack (Including EC2, S3,), focusing on high-availability, fault tolerance, and auto-scaling.
  34. Good experience with use-case development, with Software methodologies like Agile and Waterfall.
  35. Working knowledge of Amazon's Elastic Cloud Compute( EC2 ) infrastructure for computational tasks and Simple Storage Service ( S3 ) as Storage mechanism.
  36. Good working experience in importing data using Sqoop, SFTP from various sources like RDMS, Teradata, Mainframes, Oracle, Netezza to HDFS and performed transformations on it using Hive, Pig and Spark .
  37. Extensive experience in Text Analytics, developing different Statistical Machine Learning solutions to various business problems and generating data visualizations using Python and R.
  38. Proficient in NoSQL databases including HBase, Cassandra, MongoDB and its integration with Hadoop cluster.
  39. Hands on experience in Hadoop Big data technology working on MapReduce, Pig, Hive as Analysis tool, Sqoop and Flume data import/export tools.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos

About Molecular Connections

Founded :
2001
Type :
Products & Services
Size :
1000-5000
Stage :
Profitable
About
With over two decades of experience in Big Data and Data Science Solutions, Molecular Connections (MC) has been using AI-powered proprietary models to help customers achieve digital transformation. We have been able to successfully build a data-driven decision-making strategy for our customer's digital transformational journey. MC leverages AI, ML and the Linked Data Store to build efficiencies in various verticals and generate new revenue streams for its customers. MC's decades of industry presence and a strong focus on innovation have led us to work with the world's leading pharma and STEM industries to offer end-to-end software development and data insights powered by proprietary workflows and platforms, enabling content engineering across multiple domains. With over 70% of its workforce being women, MC is ranked among the top 15 best companies for women to work for in India. Subsidiary Companies: 1. Molecular Connections Analytics Pvt. Ltd. | URL: https://mcanalytics.co.in/ 2. Molecular Connections Research Pvt. Ltd. | URL: https://mcresearch.co.in/
Read more
Connect with the team
Profile picture
Molecular Connections
Profile picture
Chendil Kumar
Profile picture
Gurminder kaur
Profile picture
Lokanath Khamari
Company social profiles
linkedin

Similar jobs

uFaber Edutech
at uFaber Edutech
6 recruiters
Nibedita Dawn
Posted by Nibedita Dawn
Noida, Kolkata, Pune, Mumbai
0 - 1 yrs
₹3L - ₹4L / yr
Sales
Business Development
Communication Skills
Effective communication

Company Name- uFaber Edutech Pvt Ltd.

Shift Timing/ Day- 10:30AM-7:30PM/11AM-8PM

Location-Pune,Kolkata,Mumbai,Noida

Website: www.ufaber.com


Who are we-

uFaber is a well-funded Edutech startup, founded by serial entrepreneurs from IIT Bombay to change the way we learn. We sell high-quality online courses on a variety of topics, from exam preparation to certifications. 


Role and Responsibilities-

  • Dialing 50-80+ calls and counseling students who have enquired about the product/ services.
  • Scheduling free demo lectures for the students.
  • Doing post demo calls and closing sales.
  • Maintaining a pipeline of all sales administration using CRM software.
  • Work on targets and under pressure as this is a hardcore sales profile.
  • Flexible to work on additional days and hours.

What we offer you-


Fixed Pay- 2.9 to 3LPA

Performance based incentives-2 to 3LPA

Total Pay- 4.9 to 6LPA

Read more
An All-In-One Enterprise Security Management Platform, equip
An All-In-One Enterprise Security Management Platform, equip
Agency job
Malaysia
2 - 4 yrs
S$4K - S$5K / yr
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJavascript
+4 more

#javascript #javascriptdevelopers #nodejs #nodejsdeveloper #mongodb #expressjs #angularjs #angularjsdeveloper #javadeveloper #phyton #phpdeveloper #backenddevelopers #fullstackdevelopers #urgentrequirement DSS Software Solutions Sdn. Bhd.




Outstanding career growth & development opportunities

Competitive salary & work benefit package

Passionate, energetic & innovative work culture

Experience building high-performance, large-scale, distributed server applications.

Experience with any of the back-end programming languages such as JavaScript (NodeJS), Java, C#, Python, PHP, etc.

Commitment to developing clean code that is easy to maintain and enhance strong logical thinking, analytical and problem-solving skills

Candidate must possess at least Diploma/Advanced/Higher/Graduate Diploma, Bachelor's Degree/Post-Graduate Diploma/Professional Degree in Computer Science/Information Technology or equivalent.

Required language(s): English, Mandarin

Preferably Junior Executive specialized in IT/Computer - Software or equivalent.

Preferably candidate with at least 2-year experience in IT/Computer - Software or equivalent.

Read more
Ineffable Communications
Anuj Prajapati
Posted by Anuj Prajapati
Ahmedabad
2 - 4 yrs
₹3L - ₹6L / yr
Graphic Designing
Advertising
Branding
Packaging design
Illustration
+3 more

Ineffable Communications is a new-generation full-range marketing agency for emerging technologies, ideas, and lifestyles. Passionate about building better futures, we tailor our client's Branding, Creative, Advertising, and Marketing solutions. We are a marketing firm focusing on enhancing brand value using different marketing techniques. We have extensive experience in the field of Marketing.


Note:

  • This is an on-site opportunity, kindly don't apply if you are looking for a work-from-home position.
  • Lucrative incentives to be provided.


Responsibilities

  • Create visually appealing designs for print and digital marketing materials that align with brand standards and project goals
  • Collaborate with cross-functional teams to understand project objectives, target audience, and messaging
  • Manage multiple design projects simultaneously and deliver work on time
  • Provide guidance and mentorship to junior designers to help them develop their skills and knowledge
  • Stay up-to-date with industry trends, new design techniques, and software to continually improve skills
  • Participate in brainstorming sessions to contribute to the creative direction of the company


Requirements

  • 2-4 years of experience in graphic design with a strong portfolio showcasing design skills
  • Bachelor's degree in graphic design or a related field
  • Proficiency in Adobe Creative Suite and other design software
  • Strong understanding of branding and design strategy
  • Excellent communication skills, both written and verbal
  • Ability to work in a fast-paced environment and deliver high-quality work on time
  • Strong attention to detail and the ability to provide and receive constructive feedback
Read more
Vedantu
at Vedantu
8 recruiters
Gaurav Singhal
Posted by Gaurav Singhal
Bengaluru (Bangalore)
1 - 4 yrs
₹8L - ₹16L / yr
skill iconData Science
skill iconMachine Learning (ML)
skill iconR Programming
skill iconPython
Decision Science
+1 more
About Vedantu --------------------------- If you have ever dreamed about being in the driver’s seat of a revolution, THIS is the place for you. Vedantu is an Ed-Tech startup which is into Live Online Tutoring. Recently raised Series B funding of $11M Job Description We are looking for a Data Scientist who will support our product, sales, leadership and marketing teams with insights gained from analyzing company data. The ideal candidate is adept at using large data sets to find opportunities for product, sales and process optimization and using models to test the effectiveness of different courses of action. They must have strong experience using a variety of data analysis methods, building and implementing models and using/creating appropriate algorithms. Desired Skills 1. Experience using statistical computer languages (R, Python,etc.) to manipulate data and draw insights from large data sets. 2. Process, cleanse, and verify the integrity of data used for analysis. 3. Comfortable manipulating and analyzing complex, high-volume, high-dimensionality data from varying, heterogeneous sources 4. Experience with messy real-world data -- handling missing/incomplete/inaccurate data 5. Understanding of a broad set of Algorithms and Applied Math. 6. Good at problem solving, probability and statistics and knowledge of advanced statistical techniques and concepts (regression, properties of distributions, statistical tests and proper usage) and experience with applications. 7. Knowledge of data scraping is preferable 8. Knowledge of a variety of machine learning techniques (clustering, decision tree learning, artificial neural networks) and their real-world advantages/drawbacks. 9. Experience with big data tools (Hadoop, Hive, MapReduce) a plus.
Read more
Bengaluru (Bangalore)
2 - 9 yrs
₹6L - ₹15L / yr
skill iconJava
Spring
Webservices
skill iconXML
Linux/Unix
+2 more

LogiCoy Software Technologies Pvt. Ltd - Bangalore Location   

 

Years of Experience: In an approximate range of 2 to 6 years.

Key Skills:

Java, Spring, Web services, XML, XSD, working knowledge of database and UNIX, Angular.

Good verbal and written communication.

Good team player, flexible and entrepreneurial.

Quick learner.

Candidates will get an opportunity to build skills in various technologies and domains.

Compensation would be better than industry standard.

 

With Kind Regards,

Vijayarani T

Assistant Manager - HR,

LogiCoy Software Technologies Pvt. Ltd, Bangalore, 560043.

Read more
BluetickVR
at BluetickVR
4 recruiters
Anshul Padyal
Posted by Anshul Padyal
NCR (Delhi | Gurgaon | Noida)
1 - 2 yrs
₹6L - ₹8L / yr
skill iconPHP
MySQL
To work on an already developed php product. Major work would involve making the desired changes in the php based app
Read more
Carbynetech
at Carbynetech
3 recruiters
Aravind Ch
Posted by Aravind Ch
Hyderabad
4 - 12 yrs
₹8L - ₹10L / yr
SAP ABAP
SAP
Web Dynpro
Workflow
Solid knowledge and experience of SAP programming language (ABAP Object-Oriented programming) is a must,
In-depth knowledge of OData and SAP NetWeaver Gateway,
Excellent knowledge of RFC, BAPI, BADI, BDC, User Exits, and enhancement points,
Strong exposure to system integration via EDI/ALE/IDOC.
Experience in legacy ERP migration and data migration processes (eg. upload, validation, tools: LSMW, eCATT),
Experience in SAP version ECC 6.0, ABAP Programming, Data Dictionary, ADOBE Form, SMARTFORMS, SAPScript, Module Pool Programming, ALV, Web Dynpro and SAP Workflow,
Good understanding of FI, CO, MM, PP, SD, QM, IM and WM objects and functional areas,
Be comfortable in working under the pressure of tight project deadlines,
Strong communication with varying levels of audiences both written and verbal,
Ability to make evaluations & recommendations of alternatives (options, pros/cons & recommendations),
Perform production support activities
Read more
Winklix Internet
at Winklix Internet
1 recruiter
rahul singh
Posted by rahul singh
Noida, NCR (Delhi | Gurgaon | Noida)
3 - 7 yrs
₹6L - ₹12L / yr
skill iconNodeJS (Node.js)
skill iconJavascript
skill iconMongoDB
skill iconExpress
We are looking for senior node.JS developer with minimum of 3+ years of experience in handling backend admin and should be also familiar with MongoDB . He should be capable of handling AWS as well as Front end part
Read more
IntellectFaces Technology Solutions Pvt Ltd
Meena Meenakshinathan
Posted by Meena Meenakshinathan
Chennai
1 - 3 yrs
₹1L - ₹3L / yr
Inbound Recruitment
Recruitment/Talent Acquisition
Human Resources (HR)
We are looking for candidates who worked mostly on W2 (Green card & Citizens), Sound knowledge on IT concepts,Excellent knowledge of Internet based recruiting tools (Monster, DICE, LinkedIn,Hot Jobs, etc.) The ideal candidate must have At least 6+ month of experience as a US IT Recruiter for US Staffing, Should have good experience working with Direct clients most of the time,Need target oriented candidates with a history of achieving targets. Mandatory Skills: Must have strong of end-to-end US IT recruitment /Technicalstaffing experience is required. (Preferably on W2) Must have experience on full Life Cycle of Recruiting (screening resumes, interviewing,technicalqueries & interviews, closing of candidates and responsibilities till joining of candidates.) Must have good understanding and experience on end 2 end US IT recruitment. Must be willing to work in night shifts (EST - Eastern Time Zone). Must be highly motivated, dedicated and results-driven to attain growth goals. Interested candidates submit your resume to meena[at]intellectfaces[dot]com
Read more
Joveo
at Joveo
1 recruiter
suvarchala vsn
Posted by suvarchala vsn
Hyderabad
3 - 7 yrs
₹15L - ₹30L / yr
skill iconScala
skill iconJava
Microservices
Distributed Systems
We are Joveo Joveo is an exciting programmatic media start-up with grand ambitions; ‘a job for everyone’. Harnessing machine learning and big data, our platform connects our clients with the right candidates for the right roles, faster and more efficiently than ever before. Through brilliant people and innovative technology, we are driving next generation recruitment technology solutions. We have a unique culture which embodies the core values of the company - transparency, teamwork, integrity and ownership. We believe in faster iterations, deploying code into production on a daily basis, heavy focus on customer delight, flat hierarchy, and fun environment. Responsibilities: You will be part of a small team, with a large amount of ownership and responsibility for managing things directly. You will ship high-quality solutions with a sense of urgency and speed. You will work closely with product managers, other teams, and both internal and external stakeholders, owning a large part of the process from problem understanding to shipping the solution. You will have the freedom to suggest and drive organization-wide initiatives. Requirements: 4+ Years of Experience as a Development Engineer with a Bachelor’s degree in Computer Science, computer engineering, electrical engineering or equivalent work experience. Experience with at least one the following languages: Scala, Java, and/or any functional language. We code primarily in Scala, so you’ll be excited to either ramp up on that or continue building awesome things with it. Experience with software engineering best practices (e.g. unit testing, code reviews, design documentation). A blend of product, system, and people knowledge that lets you jump into a fast paced environment and contribute from day one An ability to balance a sense of urgency with shipping high quality and programmatic solutions Extensive experience working with a large codebase and cross-functional team Self-motivation and an enjoyment for a startup environment Competitive benefits: At Joveo, we are passionate about creating a stimulating and supportive work environment for you. We strive to keep you healthy, happy and productive. We offer market competitive salary, Stock options and many more. We offer flexible work hours and work from home options. Everyday free lunch and snacks and we do have team outings, parties and unlimited fun. We are an exciting and dynamic startup company with unique benefits.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos