Cutshort logo
Molecular Connections logo
Sr. Spark/AWS Developer
Sr. Spark/AWS Developer
Molecular Connections's logo

Sr. Spark/AWS Developer

Molecular Connections's profile picture
Posted by Molecular Connections
8 - 10 yrs
₹15L - ₹20L / yr
Bengaluru (Bangalore)
Skills
Spark
Hadoop
Big Data
Data engineering
PySpark
Apache Kafka
skill iconScala
skill iconPython
Data modeling
  1. Big data developer with 8+ years of professional IT experience with expertise in Hadoop ecosystem components in ingestion, Data modeling, querying, processing, storage, analysis, Data Integration and Implementing enterprise level systems spanning Big Data.
  2. A skilled developer with strong problem solving, debugging and analytical capabilities, who actively engages in understanding customer requirements.
  3. Expertise in Apache Hadoop ecosystem components like Spark, Hadoop Distributed File Systems(HDFS), HiveMapReduce, Hive, Sqoop, HBase, Zookeeper, YARN, Flume, Pig, Nifi, Scala and Oozie.
  4. Hands on experience in creating real - time data streaming solutions using Apache Spark core, Spark SQL & DataFrames, Kafka, Spark streaming and Apache Storm.
  5. Excellent knowledge of Hadoop architecture and daemons of Hadoop clusters, which include Name node,Data node, Resource manager, Node Manager and Job history server.
  6. Worked on both Cloudera and Horton works in Hadoop Distributions. Experience in managing Hadoop clustersusing Cloudera Manager tool.
  7. Well versed in installation, Configuration, Managing of Big Data and underlying infrastructure of Hadoop Cluster.
  8. Hands on experience in coding MapReduce/Yarn Programs using Java, Scala and Python for analyzing Big Data.
  9. Exposure to Cloudera development environment and management using Cloudera Manager.
  10. Extensively worked on Spark using Scala on cluster for computational (analytics), installed it on top of Hadoop performed advanced analytical application by making use of Spark with Hive and SQL/Oracle .
  11. Implemented Spark using PYTHON and utilizing Data frames and Spark SQL API for faster processing of data and handled importing data from different data sources into HDFS using Sqoop and performing transformations using Hive, MapReduce and then loading data into HDFS.
  12. Used Spark Data Frames API over Cloudera platform to perform analytics on Hive data.
  13. Hands on experience in MLlib from Spark which are used for predictive intelligence, customer segmentation and for smooth maintenance in Spark streaming.
  14. Experience in using Flume to load log files into HDFS and Oozie for workflow design and scheduling.
  15. Experience in optimizing MapReduce jobs to use HDFS efficiently by using various compression mechanisms.
  16. Working on creating data pipeline for different events of ingestion, aggregation, and load consumer response data into Hive external tables in HDFS location to serve as feed for tableau dashboards.
  17. Hands on experience in using Sqoop to import data into HDFS from RDBMS and vice-versa.
  18. In-depth Understanding of Oozie to schedule all Hive/Sqoop/HBase jobs.
  19. Hands on expertise in real time analytics with Apache Spark.
  20. Experience in converting Hive/SQL queries into RDD transformations using Apache Spark, Scala and Python.
  21. Extensive experience in working with different ETL tool environments like SSIS, Informatica and reporting tool environments like SQL Server Reporting Services (SSRS).
  22. Experience in Microsoft cloud and setting cluster in Amazon EC2 & S3 including the automation of setting & extending the clusters in AWS Amazon cloud.
  23. Extensively worked on Spark using Python on cluster for computational (analytics), installed it on top of Hadoop performed advanced analytical application by making use of Spark with Hive and SQL.
  24. Strong experience and knowledge of real time data analytics using Spark Streaming, Kafka and Flume.
  25. Knowledge in installation, configuration, supporting and managing Hadoop Clusters using Apache, Cloudera (CDH3, CDH4) distributions and on Amazon web services (AWS).
  26. Experienced in writing Ad Hoc queries using Cloudera Impala, also used Impala analytical functions.
  27. Experience in creating Data frames using PySpark and performing operation on the Data frames using Python.
  28. In depth understanding/knowledge of Hadoop Architecture and various components such as HDFS and MapReduce Programming Paradigm, High Availability and YARN architecture.
  29. Establishing multiple connections to different Redshift clusters (Bank Prod, Card Prod, SBBDA Cluster) and provide the access for pulling the information we need for analysis. 
  30. Generated various kinds of knowledge reports using Power BI based on Business specification. 
  31. Developed interactive Tableau dashboards to provide a clear understanding of industry specific KPIs using quick filters and parameters to handle them more efficiently.
  32. Well Experience in projects using JIRA, Testing, Maven and Jenkins build tools.
  33. Experienced in designing, built, and deploying and utilizing almost all the AWS stack (Including EC2, S3,), focusing on high-availability, fault tolerance, and auto-scaling.
  34. Good experience with use-case development, with Software methodologies like Agile and Waterfall.
  35. Working knowledge of Amazon's Elastic Cloud Compute( EC2 ) infrastructure for computational tasks and Simple Storage Service ( S3 ) as Storage mechanism.
  36. Good working experience in importing data using Sqoop, SFTP from various sources like RDMS, Teradata, Mainframes, Oracle, Netezza to HDFS and performed transformations on it using Hive, Pig and Spark .
  37. Extensive experience in Text Analytics, developing different Statistical Machine Learning solutions to various business problems and generating data visualizations using Python and R.
  38. Proficient in NoSQL databases including HBase, Cassandra, MongoDB and its integration with Hadoop cluster.
  39. Hands on experience in Hadoop Big data technology working on MapReduce, Pig, Hive as Analysis tool, Sqoop and Flume data import/export tools.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Molecular Connections

Founded :
2001
Type :
Products & Services
Size :
1000-5000
Stage :
Profitable

About

With over two decades of experience in Big Data and Data Science Solutions, Molecular Connections (MC) has been using AI-powered proprietary models to help customers achieve digital transformation. We have been able to successfully build a data-driven decision-making strategy for our customer's digital transformational journey. MC leverages AI, ML and the Linked Data Store to build efficiencies in various verticals and generate new revenue streams for its customers. MC's decades of industry presence and a strong focus on innovation have led us to work with the world's leading pharma and STEM industries to offer end-to-end software development and data insights powered by proprietary workflows and platforms, enabling content engineering across multiple domains. With over 70% of its workforce being women, MC is ranked among the top 15 best companies for women to work for in India. Subsidiary Companies: 1. Molecular Connections Analytics Pvt. Ltd. | URL: https://mcanalytics.co.in/ 2. Molecular Connections Research Pvt. Ltd. | URL: https://mcresearch.co.in/
Read more

Connect with the team

Profile picture
Molecular Connections
Profile picture
Chendil Kumar
Profile picture
Gurminder kaur
Profile picture
Lokanath Khamari

Company social profiles

linkedin

Similar jobs

We're hiring for a new-age B-School based in Gurugram
We're hiring for a new-age B-School based in Gurugram
Agency job
via PinnacleU HR by Tanuj Kataria
Gurugram
0 - 2 yrs
₹1L - ₹8L / yr
Project Management
Business operations
Process improvement
Teamwork
collaboration
+3 more

Job description

💻 Position: Program Associate

📍Location: Gurgaon

🗓️ Working Days: Monday- Friday

⏰ Work Timings: 10am -7pm

📌 Experience Required: 0-1 years

🤝 Client: Leading Business School

💸 Salary: Competitive Salary Package

👉🏻Looking for candidates with prior experience of working at early-stage educational startups.


About the organisation:

Our client is a new-age business school offering industry-immersive business education where the classes are led by top industry leaders and practitioners. It is a first-of-its-kind institute where distinguished leaders from different walks of life have re-imagined business education in order to create effective business professionals for the ever-changing economy.


Role and Responsibilities:

The role requires one to lead major initiatives associated with the growth of the program among the high school students. These include

● Executing Projects End to End

● Working with diverse stakeholders such as marketing, operations for end to end execution.

● Work on B2B partnerships that can bring business synergies

● Design experiences for students that can lead to lifelong learning


Eligibility:

· 0-1 years of experience in the startups or high school domain

· Experience in project management or execution

. If fresher than internship experience or leadership position in college societies and clubs


Read more
Creating the Data observability space.
Creating the Data observability space.
Agency job
via Qrata by Rayal Rajan
Bengaluru (Bangalore)
8 - 20 yrs
₹40L - ₹70L / yr
skill iconAmazon Web Services (AWS)
Snow flake schema
Google Cloud Platform (GCP)
Microsoft Windows Azure
Architect and build cloud environments with a focus on AWS including the design of production,
staging, QA, and development of cloud infrastructures running in 24×7 environments.
● Most of our deployments are in K8s, You will work with the team to run and manage multiple K8s
environments 24/7
● Implement and oversee all aspects of the cloud environment including provisioning, scale,
monitoring, and security.
● Nurture cloud computing expertise internally and externally to drive cloud adoption.
● Implement systems solutions, and processes needed to manage cloud cost, monitoring, scalability,
and redundancy.
● Ensure all cloud solutions adhere to security and compliance best practices.
● Collaborate with Enterprise Architecture, Data Platform, DevOps, and Integration Teams to ensure
cloud adoption follows standard best practices.
Responsibilities :
● Bachelor’s degree in Computer Science, Computer Engineering or Information Technology or
equivalent experience.
● Experience with Kubernetes on cloud and deployment technologies such as Helm is a major plus
● Expert level hands on experience with AWS (Azure and GCP experience are a big plus)
● 10 or more years of experience.
● Minimum of 5 years’ experience building and supporting cloud solutions
Read more
We are a cutting-edge retail-technology company.
We are a cutting-edge retail-technology company.
Agency job
via wrackle by Naveen Taalanki
Bengaluru (Bangalore)
3 - 8 yrs
₹10L - ₹20L / yr
SDET
Test Automation (QA)
TestNG
Selenium
skill iconPython
+12 more
Must Have :
● Hands-on coding on Java/ GoLang, primarily for testing.
● Hands-on experience on more of TestNG, JUnit, Spring Test, GoLang testing, etc. OR
If you are a motivated developer who wants to move to testing.
● Ability to find bottlenecks & thresholds in existing code with the help of automation
tools.
● Understanding of Object Oriented Design.
● Crisp understanding of various testing methodologies and categories.
● Ability to come up with, document and code test scenarios & test cases.
● Experience of working on ‘Agile + DevOps’ process management methodology.
● Experience in using one or more of RestAssured, SuperTest, Postman, Swagger.

Good To Have :
● Knowledge of other programming languages, like Javascript, Python etc
● Experience in using mocking frameworks
● Experience in using API testing frameworks
● Experience in Performance testing frameworks and the ability to design performance
tests
● Experience in some scripting languages, like Shell, Python etc.
● Good communication skills in English, both written and verbal
● Valid US Business visa

Roles & Responsibilities :

● Perform Test Automations, including creation & management of test scenarios,
documentation and coding tests.
● Environment set up for testing applications across channels like Web, Mobile and
Desktop as well as backend applications involving large scale data migration
● Create & manage automation reports and regularly communicate the same to the
team.
● Work with deployments teams and resolve any level issues for the system.
Read more
deep-tech firm, based out of Bengaluru
deep-tech firm, based out of Bengaluru
Agency job
via wrackle by Naveen Taalanki
Bengaluru (Bangalore)
3 - 10 yrs
₹5L - ₹20L / yr
DevOps
skill iconKubernetes
skill iconDocker
Ansible
Linux/Unix
+5 more
Designation: DevOps

Required Skills

• Automation is a part of your daily functions, so thorough familiarity with Unix Bourne shell scripting and Python is a critical survival skill.
• Integration and maintenance of automated tools
• Strong analytical and problem-solving skills
• Working experience in source control tools such as GIT/Github/Gitlab/TFS
• Have experience with modern virtualization technologies (Docker, KVM, AWS, OpenStack, or any orchestration platforms)
• Automation of deployment, customization, upgrades, and monitoring through modern DevOps tools (Ansible, Kubernetes, OpenShift, etc) • Advanced Linux admin experience
• Using Jenkins or similar tools
• Deep understanding of Container orchestration(Preferably Kubernetes )
• Strong knowledge of Object Storage(Preferably Cept on Rook)
• Experience in installing, managing & tuning microservices environments using Kubernetes & Docker both on-premise and on the cloud.
• Experience in deploying and managing spring boot applications.
• Experience in deploying and managing Python applications using Django, FastAPI, Flask.
• Experience in deploying machine learning pipelines/data pipelines using Airflow/Kubeflow /Mlflow.
• Experience in web server and reverse Proxy like Nginx, Apache Server, HAproxy
• Experience in monitoring tools like Prometheus, Grafana.
• Experience in provisioning & maintaining SQL/NoSQL databases.

Desired Skills

• Configuration software: Ansible
• Excellent communication and collaboration skills
• Good experience on Networking Technologies like a Load balancer, ACL, Firewall, VIP, DNS
• Programmatic experience with AWS, DO, or GCP storage & machine images
• Experience on various Linux distributions
• Knowledge of Azure DevOps Server
• Docker management and troubleshooting
• Familiarity with micro-services and RESTful systems
• AWS / GCP / Azure certification
• Interact with the Engineering for supporting/maintaining/designing backend infrastructure for product support
• Create fully automated global cloud infrastructure that spans multiple regions.
• Great learning attitude to the newest technology and a Team player
Read more
Delhi, Gurugram, Noida, Ghaziabad, Faridabad
1 - 3 yrs
₹2L - ₹4L / yr
Communication Skills
Sales presentations

Title: Education Counsellor

Company: Soft Crayons Tech Solutions

Locations: Noida Sector-2, Uttar Pradesh


Experience: Minimum 1 year in training



About Us:

Soft Crayons Tech Solutions is a leading technology training institute dedicated to providing high-quality education in various design and IT domains, Noida Sector-2,


Key Responsibilities:

Your primary role is to provide guidance and support to students in their academic and career endeavors. . Your responsibilities include assessing students' interests, skills, and goals, and then offering advice on course selection like, SOFTWARE TESTING,DIGITAL MARKETING,GRAPHIC DESIGNING,SECURITY,APP DESIGN, AUTOCAD , DATA SCIENCE Additionally, you will stay updated on admission requirements to provide accurate information to clients. Excellent communication skills, empathy, and a deep understanding of various educational pathways are essential for success in this role. Your guidance will empower students to make well-informed decisions that shape their future educational and career achievements.



Minimum 1 year of experience

Excellent communication and presentation skills.

Ability to adapt training methods to accommodate various learning styles.

Patience, empathy, and a passion for teaching and mentoring

Read more
Nimble IT Consulting
at Nimble IT Consulting
1 recruiter
Mohammad Shareef
Posted by Mohammad Shareef
London
5 - 20 yrs
₹6L - ₹10L / yr
skill iconDocker
skill iconKubernetes
DevOps
skill iconAmazon Web Services (AWS)
Windows Azure
+1 more
About us
We are global expert in cloud consulting and service management, focusing exclusively on the Cloud DevOps Space. In short, we strive to be at the forefront in this era of digital disruption by being dynamic, agile and cohesive in providing businesses the solutions needed to leverage it to the next level. Our expert team of Engineers, Programmers, Designers and Business development professionals are the foundations of our firm with the fusion of cutting-edge technology.Nimble IT Consulting is vested in Research and Analysis of Current and Upcoming trends, be it Technology, Business Values and User Experience, we dedicate our efforts tirelessly to be at the pinnacle of the Quality Standards. Devising solutions that are just not only being approved or followed by industry leaders in fact they depend on it. Read more about us: https://nimbleitconsulting.com/" target="_blank">https://nimbleitconsulting.com

What we are looking for
A DevOps Engineer to join our team and provide consulting services to our clients, below is the technology stack we are interested in 

Technical skills
  •  Expertise in implementing and managing Devops CI/CD pipeline. ( either using Jenkins or Azure DevOps ) 
  • At least one AWS or Azure Certification
  • Terraform Scripting
  •  Hands-on experience with git and source code management and release management.
  • Experience in DevOps automation tools. And Very well versed with DevOps principles and the Agile Frameworks.
  • Working knowledge of scripting using shell, Python, Gradle, Yaml, Ansible or puppet or chef.
  • Working knowledge of build systems for various technologies like npm, maven etc. 
  • Experience and good understanding in any of Cloud platforms like AWS, Azure or Google cloud.
  • Hands on Knowledge of Docker and Kubernetes is required.
  • Proficient in troubleshooting skills with proven abilities in resolving complex technical issues. Experience with working with ticketing tools (Jira & Service now)
  • A programming language like Java, Go , NodeJS is a nice to have.
What you’ll get in return
  • Work Permit for United Kingdom ( tier 2 visa ) total duration of visa will be 5 years ( first 2 years and then 3 year extension) 
  • At the end of the 5 years you will be eligible for British Citizenship by applying for Indefinite leave to remain in the UK
  • Learn new technologies - We won’t ever expect you to do the same thing day in day out; we want to
  • give you the chance to explore the latest techniques to solve challenging technical problems and help
  • you become the best developer you can be.
  • Join a growing agile team that are consistently delivering.
  • Technical Development Program
Diversity Statement
We are an equal opportunity employer and value diversity at our company. We do not discriminate on the
basis of race, religion, colour, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
Read more
SimplyFI Softech India Pvt Ltd
vidisha pant
Posted by vidisha pant
Remote, NCR (Delhi | Gurgaon | Noida)
3 - 4 yrs
₹4.5L - ₹6L / yr
skill iconJavascript
User Interface (UI) Design
skill iconHTML/CSS
skill iconBootstrap
Web Development
  1. Experience in Website Development.

  2. To create web pages through HTML and CSS in alignment with PSD design and themify them. In other words, combine interface design concepts with digital design.

  3. The candidate should have hands-on experience in Adobe Photoshop and Adobe creative suite. And should be proficient enough in designing the UI of websites with great user experience.

  4. Ability to translate business requirements into system design and perform as per the needs.Capable enough to analyze the user’s choice over graphics and animation needs.

  5. Conduct testing of completed applications to assess user experience.

  6. Use coding to develop the aesthetics implemented within a website, from the layout menus and drop-down options to colours and fonts.

  7. Ensuring all interactions are intuitive and convenient for the audience.

  8. Collaborate with back-end web developers and programmers to improve usability.

  9. Ensure that the website is optimized for various devices.

  10. Coordinate with the testing team and work closely with them and implement the changes as asked by them.

  11. The candidate must be ready to take responsibility, ownership of code, be independent, and at the same time is open to learning something new.

  12. Basic knowledge of PHP.

Read more
TRADEJINI
Bengaluru (Bangalore)
0 - 4 yrs
₹2.5L - ₹3.6L / yr
User Interface (UI) Design
Adobe After Effects
Graphics
Motion graphics
Adobe Photoshop
+2 more
Looking for Individual to create New

2D Motion Graphic(Product launch, Demo & Explainer Videos)
Newsletters
Ad Banners
Website UI
Print Designs

Have software skills
Illustrator
Photoshop
AfterEffects
Audition
CorelDraw
Basics of HTML & CSS is plus
Read more
MOURI Tech, a global enterprise solutions provider is commit
MOURI Tech, a global enterprise solutions provider is commit
Agency job
via Siyaton Global Solutions Inc. by Kothuru Divya
Hyderabad, Visakhapatnam, Kolhapur
6 - 12 yrs
₹6L - ₹15L / yr
skill iconJava
skill iconJavascript
skill iconNodeJS (Node.js)
LAMP Stack
skill iconjQuery
+1 more
Must have strong communication skills Must have experience with J2EE/Core Java/Advance Java Should be proficient with HTML5, CSS3, Bootstrap, JavaScript and jQuery Experience with AngularJS/2/4/6 and React/ Node Experience into Microservices/Spring MVC will be an added advantage
Read more
Kuliza
at Kuliza
6 recruiters
Mohammed Matheen Pasha
Posted by Mohammed Matheen Pasha
Bengaluru (Bangalore)
5 - 8 yrs
₹10L - ₹17L / yr
skill iconJava
Microservices
Design patterns
J2EE
Role: Technical Lead- Java Responsibilities : - Design, develop, test and implement high-quality software, as a member of an agile development team. - Participating in code reviews, design reviews, architecture discussions. - Proactively identify architectural weaknesses and recommending appropriate solutions. - Proactively share technical knowledge and best practices with team members. - Engage in continuous learning and adoption of new concepts, technologies, and functionality. Requirements : - Solid web developer with at least 6-12 years of Core Java experience. - 5+ years of Java/J2ee experience, - Strong hands-on experience in Spring boot, Spring MVC, etc. - Proficiency with back and front end caching strategies (Memcached, Redis). - Hands-on experience developing, releasing, and maintaining large-scale software applications. - Must be a self-starter and enjoy working in a team. - High Energy levels and passionate to try new technology stacks. - Understanding the requirement and design/develop sustainable and agile application architecture. What To Expect From Kuliza : - Competitive compensation - Lunch and snacks on us every day - An incredible team of smart and supportive colleagues - An awesome office environment and culture for growth.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos