- Big data developer with 8+ years of professional IT experience with expertise in Hadoop ecosystem components in ingestion, Data modeling, querying, processing, storage, analysis, Data Integration and Implementing enterprise level systems spanning Big Data.
- A skilled developer with strong problem solving, debugging and analytical capabilities, who actively engages in understanding customer requirements.
- Expertise in Apache Hadoop ecosystem components like Spark, Hadoop Distributed File Systems(HDFS), HiveMapReduce, Hive, Sqoop, HBase, Zookeeper, YARN, Flume, Pig, Nifi, Scala and Oozie.
- Hands on experience in creating real - time data streaming solutions using Apache Spark core, Spark SQL & DataFrames, Kafka, Spark streaming and Apache Storm.
- Excellent knowledge of Hadoop architecture and daemons of Hadoop clusters, which include Name node,Data node, Resource manager, Node Manager and Job history server.
- Worked on both Cloudera and Horton works in Hadoop Distributions. Experience in managing Hadoop clustersusing Cloudera Manager tool.
- Well versed in installation, Configuration, Managing of Big Data and underlying infrastructure of Hadoop Cluster.
- Hands on experience in coding MapReduce/Yarn Programs using Java, Scala and Python for analyzing Big Data.
- Exposure to Cloudera development environment and management using Cloudera Manager.
- Extensively worked on Spark using Scala on cluster for computational (analytics), installed it on top of Hadoop performed advanced analytical application by making use of Spark with Hive and SQL/Oracle .
- Implemented Spark using PYTHON and utilizing Data frames and Spark SQL API for faster processing of data and handled importing data from different data sources into HDFS using Sqoop and performing transformations using Hive, MapReduce and then loading data into HDFS.
- Used Spark Data Frames API over Cloudera platform to perform analytics on Hive data.
- Hands on experience in MLlib from Spark which are used for predictive intelligence, customer segmentation and for smooth maintenance in Spark streaming.
- Experience in using Flume to load log files into HDFS and Oozie for workflow design and scheduling.
- Experience in optimizing MapReduce jobs to use HDFS efficiently by using various compression mechanisms.
- Working on creating data pipeline for different events of ingestion, aggregation, and load consumer response data into Hive external tables in HDFS location to serve as feed for tableau dashboards.
- Hands on experience in using Sqoop to import data into HDFS from RDBMS and vice-versa.
- In-depth Understanding of Oozie to schedule all Hive/Sqoop/HBase jobs.
- Hands on expertise in real time analytics with Apache Spark.
- Experience in converting Hive/SQL queries into RDD transformations using Apache Spark, Scala and Python.
- Extensive experience in working with different ETL tool environments like SSIS, Informatica and reporting tool environments like SQL Server Reporting Services (SSRS).
- Experience in Microsoft cloud and setting cluster in Amazon EC2 & S3 including the automation of setting & extending the clusters in AWS Amazon cloud.
- Extensively worked on Spark using Python on cluster for computational (analytics), installed it on top of Hadoop performed advanced analytical application by making use of Spark with Hive and SQL.
- Strong experience and knowledge of real time data analytics using Spark Streaming, Kafka and Flume.
- Knowledge in installation, configuration, supporting and managing Hadoop Clusters using Apache, Cloudera (CDH3, CDH4) distributions and on Amazon web services (AWS).
- Experienced in writing Ad Hoc queries using Cloudera Impala, also used Impala analytical functions.
- Experience in creating Data frames using PySpark and performing operation on the Data frames using Python.
- In depth understanding/knowledge of Hadoop Architecture and various components such as HDFS and MapReduce Programming Paradigm, High Availability and YARN architecture.
- Establishing multiple connections to different Redshift clusters (Bank Prod, Card Prod, SBBDA Cluster) and provide the access for pulling the information we need for analysis.
- Generated various kinds of knowledge reports using Power BI based on Business specification.
- Developed interactive Tableau dashboards to provide a clear understanding of industry specific KPIs using quick filters and parameters to handle them more efficiently.
- Well Experience in projects using JIRA, Testing, Maven and Jenkins build tools.
- Experienced in designing, built, and deploying and utilizing almost all the AWS stack (Including EC2, S3,), focusing on high-availability, fault tolerance, and auto-scaling.
- Good experience with use-case development, with Software methodologies like Agile and Waterfall.
- Working knowledge of Amazon's Elastic Cloud Compute( EC2 ) infrastructure for computational tasks and Simple Storage Service ( S3 ) as Storage mechanism.
- Good working experience in importing data using Sqoop, SFTP from various sources like RDMS, Teradata, Mainframes, Oracle, Netezza to HDFS and performed transformations on it using Hive, Pig and Spark .
- Extensive experience in Text Analytics, developing different Statistical Machine Learning solutions to various business problems and generating data visualizations using Python and R.
- Proficient in NoSQL databases including HBase, Cassandra, MongoDB and its integration with Hadoop cluster.
- Hands on experience in Hadoop Big data technology working on MapReduce, Pig, Hive as Analysis tool, Sqoop and Flume data import/export tools.
About Molecular Connections
Similar jobs
Description:
We are looking for a highly motivated Full Stack Backend Software Intern to join our team. The ideal candidate should have a strong interest in AI, LLM (Large Language Models), and related technologies, along with the ability to work independently and complete tasks with minimal supervision.
Responsibilities:
- Research and gather requirements for backend software projects.
- Develop, test, and maintain backend components of web applications.
- Collaborate with front-end developers to integrate user-facing elements with server-side logic.
- Optimize applications for maximum speed and scalability.
- Implement security and data protection measures.
- Stay up-to-date with emerging technologies and industry trends.
- Complete tasks with minimal hand-holding and supervision.
- Assist with frontend tasks using JavaScript and React if required.
Requirements:
- Proficiency in backend development languages such as Python or Node.js
- Familiarity with frontend technologies like HTML, CSS, JavaScript, and React.
- Experience with relational and non-relational databases.
- Understanding of RESTful APIs and microservices architecture.
- Knowledge of AI, LLM, and related technologies is a plus.
- Ability to work independently and complete tasks with minimal supervision.
- Strong problem-solving skills and attention to detail.
- Excellent communication and teamwork skills.
- Currently pursuing or recently completed a degree in Computer Science or related field.
Benefits:
- Opportunity to work on cutting-edge technologies in AI and LLM.
- Hands-on experience in developing backend systems for web applications.
- Mentorship from experienced developers and engineers.
- Flexible working hours and a supportive work environment.
- Possibility of a full-time position based on performance.
If you are passionate about backend development, AI, and LLM, and are eager to learn and grow in a dynamic environment, we would love to hear from you. Apply now to join our team as a Full Stack Backend Software Intern.
Strong analytical and Problem solving skills.
Strong knowledge of .NET web framework includes ASP.NET, ASP.NET MVC, .NET Core (Nice to have) , Web API, LINQ , HTML, JavaScript, jQuery, AJAX and CSS
Experience designing, developing, and deploying Web Services and Web apps on IIS.
Comprehensive understanding of object-oriented and service-oriented application development techniques and theories
Experience with debugging, performance profiling and optimization.
Experience with git source control
Familiarity with writing unit tests
Familiarity with micro services.
Ability to take a project from start to finish with or without supervision
Strong communication skills with both internal team members and external stakeholders
Good to have team handling experience
Roles and Responsibilities :
Developing front end website architecture.
Designing user interactions on web pages.
Developing back end website applications.
Creating servers and databases for functionality.
Ensuring cross-platform optimization for mobile phones.
Ensuring responsiveness of applications.
Working alongside graphic designers for web design features.
Seeing through a project from conception to finished product.
Designing and developing APIs.
Meeting both technical and consumer needs.
Staying abreast of developments in web applications and programming languages.
Desired Candidate Profile :
HTML/CSS. While HTML stands for Hypertext Markup Language, CSS stands for Cascading Style Sheets. ...
JavaScript. ...
Git and GitHub. ...
Backend languages. ...
Web architecture. ...
HTTP and REST. ...
Database storage. ...
Basic design skills.
Familiar with nodejs, reactjs, angularjs, expressjs etc......
Requirements :
- A good portfolio of past design and creative projects. ( High Priority )
- Fluency in English ( High Priority )
- Degree / Diploma in visual communication or any other design related field.
Software / Skill requirements :
- Adobe Illustrator ( High Priority )
- Adobe Photoshop
- Adobe After Effects
Responsibilities :
- Conceptualise original and unique designs and illustrations for digital marketing
- Ensure designs from junior designers hold brand consistency
2. Automate the manual test cases to the most achievable level to reduce manual efforts and increase product stability.
3. Preparation of test strategy, test plan, and test execution to ensure feature testing is completed well within the committed timelines.
4. Work on customer-reported issues by support teams to reproduce in the development environment and perform debugging to identify the root cause of the issue.
5. Use test-driven methodologies and automation in the design and development phase to ensure quality before hand-off to Quality Assurance.
6. Work closely with other developers and product management to evaluate testing efforts for new feature requests.
7. Contribute to the development and achievement of organizational goals and objectives. Accountable for delivery of subsystems anticipate issues, and addresses proactively
8. Demonstrate good judgment in making test strategies. Ability to work on a diverse set of problems and provide input that influences technical decisions.
Job Summary
We are looking for an iOS developer responsible for the development and maintenance of applications aimed at a range of iOS devices including mobile phones and tablet computers. Your primary focus will be development of iOS applications and their integration with back-end services. You will be working alongside other engineers and developers working on different layers of the infrastructure. Therefore, a commitment to collaborative problem solving, sophisticated design, and the creation of quality products is essential.
Roles & Responsibilities
- Design and build applications for the iOS platform.
- Ensure the performance, quality, and responsiveness of applications.
- Collaborate with a team to define, design, and ship new features.
- Identify and correct bottlenecks and fix bugs.
- Help maintain code quality, organization, and automatization
Skills Required
- Proficient with Objective-C or Swift and Cocoa Touch
- Experience with iOS frameworks such as Core Data, Core Animation, etc.
- Experience with offline storage, threading, and performance tuning
- Familiarity with RESTful APIs to connect iOS applications to back-end services
- Knowledge of other web technologies and UI/UX standards
- Understanding of Apple’s design principles and interface guidelines
- Knowledge of low-level C-based libraries is preferred
- Experience with performance and memory tuning with tools (such as Instruments and Shark)
- Familiarity with cloud message APIs and push notifications
- Knack for benchmarking and optimization
- Proficient understanding of code versioning tools (such as Git, Mercurial or SVN)
- Familiarity with continuous integration.
- Experience working with storyboard, cocoa touch and auto layout.
- Working knowledge of the general mobile orientation, architecture, trends and emerging technologies.
- Must have good analytical, debugging and problem-solving skills.
Openings for GEP Client.
Job Description : .Net with AngularJs Experience Mandate.
Experience : 2-7 years
CTC : Open
Location: Airoli, Mumbai
Interested please drop a mail to my inbox
MomentSnap is US based mature startup founded in 2015 by serial entrepreneurs of Indian Origin. We are looking for exciting young talent like yourself to join our Noida Development Centre and work on cutting edge tech. At MomentSnap we believe in making amazing things happen while having fun, and the work is challenging yet exciting and salary and perks are really cool.
Below are the requirements in brief :
General Requirement :
1. Help with defining product requirements, analysis, designing.
2. Research & Development on new requirements.
3. Help create and maintain product documentation.
4. Mentor and provide regular feedback/updates across the TEAM.
5. Be aware and plan for potential pitfalls, solve production/ customer issues quickly, and help roadmap a feature-rich solution.
6. Team player with strong listening, good communication and soft-skills
7. Experience working with agile methodologies (Design Sprints, Scrum, Lean Startup, Kanban, XP) and cross-functional teams (Product Owners, Scrum Masters, Developers, Designers, Test Engineers)
8. Ideally familiar with Design Thinking, Behaviour and Test-Driven Development
9. Awareness and exposure to tools - GIT, JIRA, Confluence, Hangout etc
10. Looking for a long term opportunity to work with the one of the fastest growing and mature US based startup -
Technology Requirement :
- NodeJS (mandatory), NoSQL DynamoDB/MongoDB/Cassandra etc. (mandatory), AWS serverless experience with API GW/Lambda (great to have), Microservices/Serverless computing exposure (preferred to have), Responsive design with HTML5/CSS3 exposure (good to have)
- Software developer with 2-4 years of experience in developing cloud-hosted, backend applications using NodeJS, API Gateway+AWS Lambda
- High proficiency with server side frameworks (preferably NodeJS), experience with NoSQL databases (preferably DynamoDB)
- Able to integrate with and manage APIs exposed via microservices/serverless (REST, Serverless framework etc.) including development and support of NodeJS
- Exposure to NodeJS backend libraries - aws-sdk, jsonwebtoken, bluebird, loadash, moment etc.
- Active usage of optimizing CI/CD process and tools, testing frameworks and practices (preferably GitHub, Jenkins/Bamboo, Mocha/Karma, etc)
- Exposure to AWS (or any cloud) services Interested to explore? If yes please contact me or apply for this profile and I shall be happy to introduce you to our great team and product.