Sr. Spark/AWS Developer at Molecular Connections · Bengaluru (Bangalore) · 8 - 10 years · ₹15L - ₹20L / yr · Profitable · Posted 2 Aug 2023
- Big data developer with 8+ years of professional IT experience with expertise in Hadoop ecosystem components in ingestion, Data modeling, querying, processing, storage, analysis, Data Integration and Implementing enterprise level systems spanning Big Data.
- A skilled developer with strong problem solving, debugging and analytical capabilities, who actively engages in understanding customer requirements.
- Expertise in Apache Hadoop ecosystem components like Spark, Hadoop Distributed File Systems(HDFS), HiveMapReduce, Hive, Sqoop, HBase, Zookeeper, YARN, Flume, Pig, Nifi, Scala and Oozie.
- Hands on experience in creating real - time data streaming solutions using Apache Spark core, Spark SQL & DataFrames, Kafka, Spark streaming and Apache Storm.
- Excellent knowledge of Hadoop architecture and daemons of Hadoop clusters, which include Name node,Data node, Resource manager, Node Manager and Job history server.
- Worked on both Cloudera and Horton works in Hadoop Distributions. Experience in managing Hadoop clustersusing Cloudera Manager tool.
- Well versed in installation, Configuration, Managing of Big Data and underlying infrastructure of Hadoop Cluster.
- Hands on experience in coding MapReduce/Yarn Programs using Java, Scala and Python for analyzing Big Data.
- Exposure to Cloudera development environment and management using Cloudera Manager.
- Extensively worked on Spark using Scala on cluster for computational (analytics), installed it on top of Hadoop performed advanced analytical application by making use of Spark with Hive and SQL/Oracle .
- Implemented Spark using PYTHON and utilizing Data frames and Spark SQL API for faster processing of data and handled importing data from different data sources into HDFS using Sqoop and performing transformations using Hive, MapReduce and then loading data into HDFS.
- Used Spark Data Frames API over Cloudera platform to perform analytics on Hive data.
- Hands on experience in MLlib from Spark which are used for predictive intelligence, customer segmentation and for smooth maintenance in Spark streaming.
- Experience in using Flume to load log files into HDFS and Oozie for workflow design and scheduling.
- Experience in optimizing MapReduce jobs to use HDFS efficiently by using various compression mechanisms.
- Working on creating data pipeline for different events of ingestion, aggregation, and load consumer response data into Hive external tables in HDFS location to serve as feed for tableau dashboards.
- Hands on experience in using Sqoop to import data into HDFS from RDBMS and vice-versa.
- In-depth Understanding of Oozie to schedule all Hive/Sqoop/HBase jobs.
- Hands on expertise in real time analytics with Apache Spark.
- Experience in converting Hive/SQL queries into RDD transformations using Apache Spark, Scala and Python.
- Extensive experience in working with different ETL tool environments like SSIS, Informatica and reporting tool environments like SQL Server Reporting Services (SSRS).
- Experience in Microsoft cloud and setting cluster in Amazon EC2 & S3 including the automation of setting & extending the clusters in AWS Amazon cloud.
- Extensively worked on Spark using Python on cluster for computational (analytics), installed it on top of Hadoop performed advanced analytical application by making use of Spark with Hive and SQL.
- Strong experience and knowledge of real time data analytics using Spark Streaming, Kafka and Flume.
- Knowledge in installation, configuration, supporting and managing Hadoop Clusters using Apache, Cloudera (CDH3, CDH4) distributions and on Amazon web services (AWS).
- Experienced in writing Ad Hoc queries using Cloudera Impala, also used Impala analytical functions.
- Experience in creating Data frames using PySpark and performing operation on the Data frames using Python.
- In depth understanding/knowledge of Hadoop Architecture and various components such as HDFS and MapReduce Programming Paradigm, High Availability and YARN architecture.
- Establishing multiple connections to different Redshift clusters (Bank Prod, Card Prod, SBBDA Cluster) and provide the access for pulling the information we need for analysis.
- Generated various kinds of knowledge reports using Power BI based on Business specification.
- Developed interactive Tableau dashboards to provide a clear understanding of industry specific KPIs using quick filters and parameters to handle them more efficiently.
- Well Experience in projects using JIRA, Testing, Maven and Jenkins build tools.
- Experienced in designing, built, and deploying and utilizing almost all the AWS stack (Including EC2, S3,), focusing on high-availability, fault tolerance, and auto-scaling.
- Good experience with use-case development, with Software methodologies like Agile and Waterfall.
- Working knowledge of Amazon's Elastic Cloud Compute( EC2 ) infrastructure for computational tasks and Simple Storage Service ( S3 ) as Storage mechanism.
- Good working experience in importing data using Sqoop, SFTP from various sources like RDMS, Teradata, Mainframes, Oracle, Netezza to HDFS and performed transformations on it using Hive, Pig and Spark .
- Extensive experience in Text Analytics, developing different Statistical Machine Learning solutions to various business problems and generating data visualizations using Python and R.
- Proficient in NoSQL databases including HBase, Cassandra, MongoDB and its integration with Hadoop cluster.
- Hands on experience in Hadoop Big data technology working on MapReduce, Pig, Hive as Analysis tool, Sqoop and Flume data import/export tools.

About Molecular Connections
About
Connect with the team
Similar jobs (10)
Company Description
intalk.io is an Omnichannel Customer Interaction Platform by Agami Tech, empowering businesses with advanced CRM, Customer Application Development, and End-to-End Unified Customer Interaction Management. Our boutique solutions integrate voice, email, chat, WhatsApp, and social media across environments—helping clients accelerate business outcomes, boost productivity, and streamline multi-vertical enterprise operations through seamless, AI-driven communication and robust reporting
Role Description
- Collaborate with sales teams to identify and analyse customer requirements, translating them into viable software solutions.
- Assist in qualifying leads by leveraging technical knowledge to address business challenges and deliver value.
- Develop and deliver tailored presentations, demos, and proposals showcasing product capabilities and fit.
- Provide technical support throughout the sales cycle, addressing queries and concerns for prospective clients.
- Prepare and manage technical/functional documentation for RFPs/RFIs and act as a bridge between sales and development teams.
- Conduct business analysis to ensure solutions align with client objectives and integrate smoothly.
- Stay up-to-date with industry trends and new technologies, proactively identifying client opportunities
Qualifications
- 1–3 years’ presales experience in the Technology industry and/or hands-on working experience in SAAS products.
- Strong analytical problem-solving skills and service-oriented mindset.
- Excellent communication and presentation skills, confident delivering live product demos.
- Experience with CRM tools and business documentation.
- Proven ability in customer needs assessment and relationship management.
- Bachelor’s degree in Computer Science, IT, Engineering, or a related field (preferred).
- Relevant certifications are a plus.
About UpSolve
Working on new tech solutions around Image, Video and NLP. At UpSolve we focus on making AI available and affordable for all at scale.
Job Description:
The selected candidate will be responsible for the ideation, development, and execution of mobile and web apps.
Freshers, please DO NOT apply.
Job Responsibilities:
- Advise on the design of iOS, Android and Web apps
- Develop entire applications using Flutter, Android Studio or other platforms.
- Build Web apps in python backend using Flask or Django.
- Communicate and collaborate with different teams regularly.
Job Requirements:
- Experienced in publishing iOS and Android applications
- Experience in building futter applications and compiling using Xcode
- Bachelor's/Master's degree in Engineering, Computer Science (or equivalent experience)
- 3+ years of experience in full-stack development
- Should possess a portfolio of code or apps for review
- Must be a critical thinker and provide effective and efficient solutions
Location: Mumbai
Work Mode: Work from Office
Job Description:
- Conducting market research to understand user needs
- Defining product features and requirements
- Creating and managing a product roadmap and timeline
- Developing competitive analysis and product positioning strategies
- Defining metrics for product’s success
- Incorporating customers’ feedback
- Knowledge of product development methodologies
- Strong project management skills
- Ability to conduct market research and understand trends
- Experience in the relevant industry
- Excellent communication and interpersonal skills
- Ability to make data-driven decisions
1. Core Responsibilities
· Leading solutions for data engineering
· Maintain the integrity of both the design and the data that is held within the architecture
· Champion and educate people in the development and use of data engineering best practises
· Support the Head of Data Engineering and lead by example
· Contribute to the development of database management services and associated processes relating to the delivery of data solutions
· Provide requirements analysis, documentation, development, delivery and maintenance of data platforms.
· Develop database requirements in a structured and logical manner ensuring delivery is aligned with business prioritisation and best practise
· Design and deliver performance enhancements, application migration processes and version upgrades across a pipeline of BI environments.
· Provide support for the scoping and delivery of BI capability to internal users.
· Identify risks and issues and escalate to Line / Project manager.
· Work with clients, existing asset owners & their service providers and non BI development staff to clarify and deliver work stream objectives in timescales that deliver to the overall project expectations.
· Develop and maintain documentation in support of all BI processes.
· Proactively identify cost-justifiable improvements to data manipulation processes.
· Research and promote relevant BI tools and processes that contribute to increased efficiency and capability in support of corporate objectives.
· Promote a culture that embraces change, continuous improvement and a ‘can do’ attitude.
· Demonstrate enthusiasm and self-motivation at all times.
· Establish effective working relationships with other internal teams to drive improved efficiency and effective processes.
· Be a champion for high quality data and use of strategic data repositories, associated relational model, and Data Warehouse for optimising the delivery of accurate, consistent and reliable business intelligence
· Ensure that you fully understand and comply with the organisation’s Risk Management Policies as they relate to your area of responsibility and demonstrate in your day to day work that you put customers at the heart of everything you do.
· Ensure that you fully understand and comply with the organisation’s Data Governance Policies as they relate to your area of responsibility and demonstrate in your day to day work that you treat data as an important corporate asset which must be protected and managed.
· Maintain the company’s compliance standards and ensure timely completion of all mandatory on-line training modules and attestations.
2. Experience Requirements
· 5 years Data Engineering / ETL development experience is essential
· 5 years data design experience in an MI / BI / Analytics environment (Kimball, lake house, data lake) is essential
· 5 years experience of working in a structured Change Management project lifecycle is essential
· Experience of working in a financial services environment is desirable
· Experience of dealing with senior management within a large organisation is desirable
· 5 years experience of developing in conjunction with large complex projects and programmes is desirable
· Experience mentoring other members of the team on best practise and internal standards is essential
· Experience with cloud data platforms desirable (Microsoft Azure) is desirable
3. Knowledge Requirements
· A strong knowledge of business intelligence solutions and an ability to translate this into data solutions for the broader business is essential
· Strong demonstrable knowledge of data warehouse methodologies
· Robust understanding of high level business processes is essential
· Understanding of data migration, including reconciliation, data cleanse and cutover is desirable
Advantal Technologies Pvt. Ltd. is searching for experienced candidates for the position of Senior Java Developer to join our growing team.
Professionals with Highly skilled experience building web applications in Java. Senior Java Developers are responsible for analyzing user requirements and business objectives, determining application features and functionality, and recommending changes to existing Java-based applications, among other duties.
Responsibilities:
- Identify and analyze user requirements
- Prioritize, assign and execute tasks throughout the software development life cycle
- Develop Java EE applications
- Write well-designed, efficient code
- Review, test and debug team members’ code
- Design database architecture
- Schedule product releases with internal teams
- Document development phases
- Ensure our applications are secure and up-to-date
Requirements:
- 3+ years work experience as a Senior Java Developer
- Experience designing, building and testing Java EE applications
- In-depth knowledge of popular Java frameworks like JSF and Spring MVC
- Experience with Object-Oriented Design (OOD)
- Good delegation and time management skills
- Problem-solving abilities
Skills and Technology:
- Microservices with Spring Cloud and Spring Boot
- Dev-ops tools (Jenkins, Docker and Kubernates)
- Mongodb, Mysql
- Spring Framework (Spring boot)
- JUnitMockito
- Learn APIs and Libraries
- JVM Internals
- Windows and Linux server setup and configuration
- SSL Configuration with multi-port routing
Experience: 3+ Years
Location: Indore / Gurugram
Job Type: Full-time
As a Associate - HR, you will be responsible for handling a wide range of human resource activities across the organization.
What you will do:
- Handling entire recruitment cycle from sourcing, screening, joining formalities, documentation, exit formalities
- Planning and organizing training programs for employees
- Assisting with the payroll process, benefits, compensation and employee performance appraisals
- Resolving employees’ queries on compensation and labour regulations
- Tracking and accounting for all deductions like PF, Professional Tax etc.
- Processing and maintaining HR documents as per statutory requirements and employment laws
- Ensuring timely updating of HRMS software
- Developing and implementing HR policies and procedures
- Compiling and analysing data for HR Metrics
- Handling Grievances and Employee counselling
- Handling all HR related Audits for the organisation
- Evaluating and improvising the current HR policies in line with the business and organization requirements
Desired Candidate Profile
What you need to have:- Graduation / MBA in HR
- Proven experience as an HR Generalist
- Understanding of general human resources policies and procedures
- Outstanding knowledge of MS Office
- Excellent communication and people skills
- Aptitude in problem-solving
- Ability to work comfortably under pressure and meet tight deadlines
- Desire to work as a team with a result-driven approach
- Additional HR training will be a plus
What do we do?
About MobileFirst: Mobile design & development studio focusing on great mobile app experiences. We have great exposure working with Startups, Enterprises and Design Studios. MobileFirst has worked with customers from the USA, India, UK, Kenya, and Israel.
We have catered to clients in Automobiles, Paints, Fashion, Sports, Transportation, Food, Music, Coupons, Smart Parking, Uber for X, etc.
What are we looking for?
- 1+ yr experience with React JS & React Web UI
- MEAN Stack or MERN Stack Experience is required
- MongoDB, Express JS, Angular JS & NodeJS
- Understanding of React & Redux is required
- Experience with MongoDB, Postgresql, MySQL database
- Comfortable in a work environment that requires strong problem-solving skills and independent self-direction coupled with team collaboration and open communication
- Understanding of RESTful web services
- Work in a fast-paced, creative atmosphere to develop new ideas that adapt to evolving user needs
- Experience using Git / GitHub
What should you have?
- Amazing debugging skills and problem-solving abilities
- Knowledge of Opensource Libraries & frameworks
- Command over algorithms, design trends & knowledge about popular applications on App
Who are we looking for?
Tech Savvy. Fast learner. Leader.
We don't see your college degree or we don't care if you are a dropout.
Job Perks
- Great Fun Learning exposure
- Training and Seminars on new Technologies
- Startup Experience
- Flexible timings and "work from home" options
This position requires the ability to interact closely with our external and
internal stakeholders and contribute to the design efforts for our IoT cloud
platform. You will partner with business and product development teams
throughout the product lifecycle producing top-quality design deliverables and
innovating user experiences for our customers.
The ideal candidate will demonstrate the necessary skills to design elegant,
intuitive and integrated experiences for our customers. Passion and capacity to
interact with and advocate on behalf of our customers is an absolute must..
Responsibilities:
- Design the interface, and interaction flow of web applications
- Develop conceptual diagrams, wireframes, detailed visual mockups and
prototypes.
- Fluency in best practices for information architecture and interaction design
- Develop and maintain detailed user-interface specifications
- Develop process flows, wire frames, and mockups to effectively conceptualize
and communicate high-level design strategies and detailed interaction
behaviors
- Create user-centric designs by considering customer feedback, and usability
findings.
- Use business requirements and customer research to assist in developing use
cases, high-level requirements
- Conduct usability studies and put together detailed, structured analysis of
issues and potential solutions.
- Present design work to the user experience team, product team, and senior
leadership for review and feedback
Basic qualifications:
- 2-5 years of experience as a user experience designer, interaction designer or
similar role
- A portfolio or samples of work demonstrating experience creating user-centric
design solutions
- Experience in designing for the web, preferably for Enterprise products.
- Bachelor’s degree in design, human-computer interaction (HCI), or equivalent
professional experience,
- Experience with a variety of design tools such as Illustrator, Photoshop, Sketch, Adobe XD and Framer
## Technical Background
* 1-2+ year of development experience with Android.
* Some experience with HTML, SVG and CSS.
* Experience with Test Driven Development and creating automated unit test using JUnit.
* Able to create a rich UI with thoughtful inputs in UX.
* Fluent in Object-Oriented programming.
* Aware of Component-Based design and Dependency Injection pattern.
* Should know how to publish and maintain an app (or little bit of DevOps).
## Soft Skills
* Able to work with multiple responsibilities.
* Take ownership in the work.
* Willing to work long hours or walk the extra mile.
* Getting to the source of the problem is more important, than putting a band-aid on.
* Code should be easy to read and be its own documentation.
* Shouldn't have an "it works, it's fine" attitude.












