Hadoop Developer

at MNC

Agency job
icon
Bengaluru (Bangalore)
icon
3 - 6 yrs
icon
₹6L - ₹15L / yr
icon
Full time
Skills
Apache Hadoop
Hadoop
HDFS
Apache Sqoop
Apache Flume
Apache HBase
Hibernate (Java)
J2EE
Scala
Linux/Unix
1. Design and development of data ingestion pipelines.
2. Perform data migration and conversion activities.
3. Develop and integrate software applications using suitable development
methodologies and standards, applying standard architectural patterns, taking
into account critical performance characteristics and security measures.
4. Collaborate with Business Analysts, Architects and Senior Developers to
establish the physical application framework (e.g. libraries, modules, execution
environments).
5. Perform end to end automation of ETL process for various datasets that are
being ingested into the big data platform.
Read more
Why apply to jobs via Cutshort
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
2101133
Matches delivered
3712187
Network size
15000
Companies hiring

Similar jobs

Reputed MNC client of people first consultant
Agency job
icon
Chennai
icon
3 - 6 yrs
icon
₹3L - ₹8L / yr
Adobe Experience Manager (AEM)
Java
Jenkins
DevOps
Apache
+1 more
Designation: AEm Developer
Experience: 3-6 years
Location: chennai

Job summary  

AEM, Java, Jenkins, DevOps

"Experience on Agile methodology.

  • Hands on experience on AEM, JCR, Apache Sling, Apache Felix
  • Develop AEM templates, components, fragments and experiences
  • Work extensively in Core Java 1.8, JEE, AEM 6.2, AEM 6.1, AEM 6.0, CQ5.5, Apache CXF
  • Translates business requirements into AEM specific implementation, specifications, designs, Authors content, etc.
  • Make changes to AEM site content, assets, pages, workflow, etc.
  • Design and build components, templates, dialogs, and workflows using the AEM architecture (Sling, CRX, OSGI, JCR)
  • Diagnoses and solve technical problems related to content management such as search result accuracy, dynamic content linking, formatting, image scaling, internationalization, and personalization
  • Need to work in J2EE Web Technologies using Servlets, JSP, spring, Hibernate, Java Beans, Collections, JDBC, JavaScript, XML, HTML, DHTML, and CSS.
  • To work on agile methodology, rapid development and prototyping environment"

Techincal Skills

Good to have JDBC, ANSI SQL, Jenkins, Core Java, DevOps, Adobe AEM

Read more
Hiring for a leading client
Agency job
via Jobaaj.com by Saksham Agarwal
icon
New Delhi
icon
3 - 5 yrs
icon
₹10L - ₹15L / yr
Big Data
Apache Kafka
Business Intelligence (BI)
Data Warehouse (DWH)
Coding
+15 more
Job Description:
Senior Software Engineer - Data Team

We are seeking a highly motivated Senior Software Engineer with hands-on experience and build scalable, extensible data solutions, identifying and addressing performance bottlenecks, collaborating with other team members, and implementing best practices for data engineering. Our engineering process is fully agile, and has a really fast release cycle - which keeps our environment very energetic and fun.

What you'll do:

Design and development of scalable applications.
Work with Product Management teams to get maximum value out of existing data.
Contribute to continual improvement by suggesting improvements to the software system.
Ensure high scalability and performance
You will advocate for good, clean, well documented and performing code; follow standards and best practices.
We'd love for you to have:

Education: Bachelor/Master Degree in Computer Science.
Experience: 3-5 years of relevant experience in BI/DW with hands-on coding experience.

Mandatory Skills

Strong in problem-solving
Strong experience with Big Data technologies, Hive, Hadoop, Impala, Hbase, Kafka, Spark
Strong experience with orchestration framework like Apache oozie, Airflow
Strong experience of Data Engineering
Strong experience with Database and Data Warehousing technologies and ability to understand complex design, system architecture
Experience with the full software development lifecycle, design, develop, review, debug, document, and deliver (especially in a multi-location organization)
Good knowledge of Java
Desired Skills

Experience with Python
Experience with reporting tools like Tableau, QlikView
Experience of Git and CI-CD pipeline
Awareness of cloud platform ex:- AWS
Excellent communication skills with team members, Business owners, across teams
Be able to work in a challenging, dynamic environment and meet tight deadlines
Read more
icon
Mumbai
icon
1 - 3 yrs
icon
Best in industry
RHCSA
Linux/Unix
Cloud Computing
VMWare
Firewall
+5 more

Location : Mumbai


Big Picture (The Opportunity) :

Are you looking for an opportunity to advance your Career? & If you are able to maintain a positive attitude even when everything goes wrong, if you are detail oriented and self motivated with a passion to learn and improve your skills and knowledge, we have a perfect job for you !

What do we want from you ? (Our Expectations) :

  • Zero to 2 years experience in Linux Operating System.
  • Flexible working hours - able to support occasional nights, weekends, and call-ins, able to quickly adapt to a constantly changing faced paced environment. Open to travel to sites.
  • An ideal person who is excited and motivated about running and supporting a production - grade critical infrastructure and looks for opportunities to improve processes with automation.


What are you required to do ? (Your Responsibilities) :

  • Proactively maintain and develop all linux infrastructure technology to maintain a 24*7*365 uptime service.
  • Engineering of systems administration-related various solutions for our various SAAS products and projects as well as operational needs.
  • Proactively monitoring system performance and capacity planning.
  • Providing technical support to customers for Applications, Operating systems, and networking.
  • Will also be the first point of contact for our clients, where installations are placed on a permanent basis, for basic troubleshooting and problem solving.
  • Fault finding, analysis and logging information for reporting of performance exceptions.
  • Maintain best practices on managing systems and services across all environments.

 

 

Skills & Qualification Required (Add Value) :

  • Graduate - Preferred to have Bachelor‘s Degree in Engineering, Computer Science or related field.
  • He / She should be familiar with the installation and configuration of Linux operating systems and setup and operation of TCP/IP networking on Linux systems also familiar with Internet concepts including SMTP, IMAP, POP, HTTP, DNS, LDAP and related protocols.
  • You should possess excellent communication skills .
  • Knowledge of Email concepts, Helpdesk Concept , VoIP Concept , Cloud computing will be an added advantage.
Read more
icon
Chennai
icon
8 - 10 yrs
icon
₹10L - ₹15L / yr
Java
Agile/Scrum
J2EE
RESTful APIs
Amazon Web Services (AWS)
As Technical Manager exceptionally ambitious and communicative, hands-on individual,
who excels working as part of an interdisciplinary team. Utilizing Agile project management
platforms and a servant-leader style, the Manager supports one or more Agile Engineering scrum
teams on its journey of continuous improvement and value driven product development.
The Technical Manager facilitates all aspects of the team's planning and prioritization process.
Through coaching and support of the individual team members & foster an environment where
individuals recognize and value the importance of team success.
The Manager will work closely with the Cross Functional team / Product Owner to ensure high
quality software deliverables and assists in developing a roll out strategy.
Key responsibilities:
• Strong hands-on experience in Java or any other programming language and Web Services
(REST-API) Integration technologies.
• Assisting / Troubleshooting design flaws and system bottlenecks against software technical
designs with application integration
• Monitors and supports a team through continuous improvement of agile execution.
• Guiding the team on self-organizing to fill in the intentional gaps left in the Agile
framework
• Facilitate backlog grooming, sprint planning, retrospectives, daily scrum, and sprint
reviews.
• Effectively cooperate with the cross functional team and Technical Leader to create an
environment in which the team can increase productivity, quality, and predictability.
• Tracking and communicating KPIs / metrics including team velocity and sprint/release
progress.
• Facilitates the Definition of Done criteria for all stories.
• Develops and maintains relationships with internal and external customers.
• Manages personal time effectively and can quickly sense what will help or hinder
accomplishing a goal.
• Managing scope creep and change within Agile framework.
• Ensuring the development teams are practicing the core agile principles of collaboration,
prioritization, team accountability, and visibility.
You must have:
• Bachelor’s degree in software engineering or computer science and 5+ years of technical
project management experience with at least 3 years in an Agile software development
environment leading Scrum teams.
• Java, J2EE ,Web Services / REST API, Cloud, SaaS, UI/UX etc or Any other programming
languages
• Certified Scrum Master certification is preferred.
• Demonstrable success at project delivery.
• Demonstrated experience leading new product software development.
• Able to understand the technology concepts used on projects in enough depth to challenge
assumptions, estimates, approaches, and risks.
• Excellent knowledge and proven, multi-year experience in agile development methods
preferably as a Scrum Master/Agile Project Manager.
• Excellent communication skills, both written and spoken with the ability to facilitate
discussions across a team.
• Excellent interpersonal skills, ability to work with diverse personality types.
• Conflict management. Ability to defuse tension among project team, should it arise.
• Ability to elicit cooperation from a wide variety of sources, including upper management,
clients, and other departments.
• Ability to handle a number of simultaneous tasks and must demonstrate a sense of urgency
and ownership to drive issues to completion.
• Ability to work with minimal supervision in a very dynamic, and timeline sensitive work
environment.
• Strong analytical and problem-solving skills with a high attention to detail.
• Demonstrated ability to apply organizational best practices.
• Experience with Jira or similar Agile execution and reporting tools is highly desirable.
It will be very good if you have:
• Experience facilitating and championing the Agile framework with technical project
management experience preferred.
• Previous Advertising (Video/ Cable/ OTT) experience a plus
Read more
Mphasis
Agency job
via Asvatthah by Surendhar D
icon
Pune, Chennai, Bengaluru (Bangalore), Noida
icon
4 - 15 yrs
icon
₹7L - ₹30L / yr
Java
J2EE
Microservices
application support
PL/SQL
+5 more
  • 4-15 year experience in Application Support
  • Must have good knowledge in Java/J2EE, Microservices, PL/SQL, Unix
  • Good to have knowledge in Agile, JIRA, Splunk, Service Now
  • Good understanding and hands-on experience in Incident, Problem and Change Management
  • Provide technical leadership to the team & contribute in the skill development within team
    Interact with internal teams and client stakeholders to trouble shoot the tickets/incident and manage other support activities
  • Good communications skills are necessary, must be team player and inquisitive.
  • Strong customer service and support focus with a desire to deliver a high-quality service
  • Ability to multi-task, work under pressure and to tight deadlines
  • Flexible in working outside of office business hours at short notice (as required)
  • Should be able to examine the system and identify the areas for Service Improvements & Value adds.
Read more
icon
Remote, Bengaluru (Bangalore)
icon
4 - 10 yrs
icon
₹5L - ₹18L / yr
Technical support
Tech Support
Linux/Unix
Databases
Troubleshooting
+1 more

Technical Specialist – Associate - UNIX and DB

Bengaluru, India

Full-time

Company Description

Commvault is the world's most powerful backup and recovery software in the cloud and on any infrastructure, helping companies transform their data into a powerful strategic asset. Commvault data protection and information management solutions enable companies and organizations of all sizes, in all industries, to protect, access and share all of their data—anywhere and anytime.

 

As an organization, we are committed to a great work culture that embraces our values and promotes professional growth. Our Vaulters are passionate innovators who work together to uncover new challenges that can be solved. We are proud that the focus of every vaulter is to drive our customers' businesses forward. We're all about getting the job done, and having FUN doing it. As vaulters we pride ourselves on transparency, integrity, and respect in everything that we do.

 

NOW is the time to join a growing company with strong roots, where you can take on your next challenge.

 

Job Description

The Customer Support Associate - UNIX and DB works within a team of technical support professionals aimed at delivering technical solutions for Commvault’s customer base. This customer base has a wide range of technical ability and this role has no ceiling, you will own an issue from initial pick-up all the way to working with the development team on identifying a possible solution.  This position is part of our UNIX and DB group in our Customer Support Center. This is an excellent opportunity for innovative and collaborative technologists to join a global team that has led the industry in satisfaction seven years in a row. We offer innovative training, interesting colleagues, and the opportunity to grow with us. Our UNIX and DB Group is focused around but not limited to backups of Unix and Linux platforms and databases within the Commvault suite, this includes networking, troubleshooting, connectivity, name resolution and performance based issues on an OS and or hardware. We are a source of expertise for not just our customer base but also our partners and consultants on site.

Why Commvault?

You get the “Freedom to make an impact, together”. We thrive upon collaboration by designing our offices and cafes to spark conversation about work and fun. Although we hail from all walks of life and speak dozens of languages, we’re passionate about equality and integrity. We “go beyond” each and every day.

We are looking for a Customer Support Associate with a genuine passion for all things tech to join our expert and super-friendly UNIX and DB team.

 

Position Responsibilities include:

Troubleshoot and resolve complex support problems

Troubleshoot customer issues using remote desktop software

Successfully interact through phone and email with customers as you solve their problems

Dedication to the success and satisfaction of our customers

Recreation of problems in house

Root Cause Analysis and / or provision of examples of software bug

Working independently and as a team to come up with the best solutions to a customer problem.

Providing best-in-class phone based support for a variety of complex, time critical issues.

Using and sharing your knowledge of a wide range of technologies

Working remotely on enterprise level customers and dark sites

Having the opportunity to build labs and simulators

Ability to be involved in product BETA testing

Contributing to our Solutions Engine and online forums

Position Requirements include:

 

At least 5+ years of technical/customer support experience

Expert level knowledge of Unix-flavoured operating systems and its components.

Strong understanding of Oracle , HANA and SAP databases,

Good understanding of Unix/Linux clusters, with installing and configuring software.

Solid understanding of Unix device management (tape and disk)

Networking and troubleshooting connectivity, name resolution and performance based issues with Linux OS and/or hardware.

Desirable to have exposure to storage arrays like NetApp, HDS

Understanding backup theory and design.  Backup and data management fundamentals

Previous experience with Commvault technologies is highly desirable as is other backup software such as Veritas, Symantec, Backup Exec, ShadowProtect, NetBackup, NetWorker, Avamar, VEEAM, or TSM is a plus

Previous experience troubleshooting enterprise environments

Strong customer relations skills.

Strong multi-tasking and prioritization skills.

Strong written and verbal communication skills.

Excellent team player.

Qualifications

We value knowledge and curiosity, no matter whether you learnt it at university, through courses or by learning from others.

 

Ideally a Bachelors Degree

Preferred - OCP/OCA/OCM, Red Hat – RHCSA, RHCE

Additional Information

Recognized as a leader in the Gartner Magic Quadrant for Data Center Backup and Recovery Software, our industry's definitive independent ranking. For the seventh straight year, Commvault has been named a leader. And this year we're furthest on the "completeness of vision" and highest on the "ability to execute."

Commvault offers its products through a broad array of distribution partners globally, while building upon its strong portfolio of strategic partnerships with leading technology companies including Microsoft, Amazon Web Services, Cisco, Oracle, SAP, Nutanix, Pure, HP, Hitachi, NetApp and many others. Commvault's global headquarters is located in Tinton Falls NJ, with additional offices that support customers globally across the Americas, EMEA, and APAC.

 

Read more
icon
Pune
icon
2 - 7 yrs
icon
₹3L - ₹12L / yr
Windows Azure
Amazon Web Services (AWS)
Google Cloud Platform (GCP)
Microsoft Windows Azure
Microsoft Windows
+3 more
You will work on:

You will be working on our client’s massive scale Infrastructure and CloudOps requirements. You will be directly working on the customer's cloud environment and managing their product infra life cycle.

What you will do (Responsibilities):

Understand how the product works and how it is used by the customers
Day-to-day operational support of product infrastructure on all three major public cloud services
Interact with customers on/off-site to troubleshoot issues, provide workarounds by leveraging your troubleshooting skills
Create and manage processes for the secure operation of customer cloud environments
System (Windows, Linux, and SQL Databases) and Network administrations
Use incident management tools used in incident analysis and troubleshooting. Identify, escalate, and communicate issues in a timely manner.
Contribute to building a knowledge base centered on known incidents/defects, Frequently Asked Questions, resolved issues, applying lessons learned and previous resolutions to new incidents.
Build hosting environments for clients all over the world
Collaborate with product managers and engineers to ensure that critical and time-sensitive projects run smoothly and achieve the business outcome
On-call responsibilities to respond to emergency situations and scheduled maintenance
Contribute to and maintain documentation for systems, processes, procedures, and infrastructure configuration.

What you bring (Skills):

Minimum 2 years of relevant experience in cloudops (mainly into MS Azure), infrastructure management, and support
Strong Windows Systems, SQL Database, and Network administration skills
Strong understanding of cloud applications, concepts, and the storage, compute, and networking components
Readiness to work in 24x7 rotational shift model
Scripting in PowerShell, Linux shell, Python or C#
Proactive and self-motivated, committed to achieving deadlines, meeting SLAs, and producing results
Excellent customer service and people skills. Excellent analytical, written, and oral communication and relationship building skills
Ability to be a good listener, and to understand customer issues. Ability to provide innovative workarounds or design a solution to fix a customer’s problem

Great if you know (Skills):

AzureOps:
Comfortable using TFS (Team Foundation Server) and Azure DevOps workflows
Comfortable with Visual Studio and SQL Server Data Tools
Exposure to deployment using Azure cloud console and ARM templates
Experience in handling Azure AD & RBAC related activities will be a plus
Comfortable with basic DevOps concepts like CI/CD, and Infra-automation

Advantage Cognologix:

A higher degree of autonomy, startup culture & small teams
Opportunities to become an expert in emerging technologies
Remote working options for the right maturity level
Competitive salary & family benefits
Performance-based career advancement

About Cognologix:

Cognologix helps companies disrupt by reimagining their business models and innovate like a Startup. We are at the forefront of digital disruption and take a business-first approach to help meet our client’s strategic goals.

We are DevOps focused organization helping our clients focus on their core product activities by handling all aspects of their infrastructure, integration and delivery.

Benefits Working With Us:

  • Health & Wellbeing
  • Learn & Grow
  • Evangelize 
  • Celebrate Achievements
  • Financial Wellbeing
  • Medical and Accidental cover.
  • Flexible Working Hours.
  • Sports Club & much more.
Read more
icon
Bengaluru (Bangalore), Hyderabad, Chennai, Pune
icon
5 - 10 yrs
icon
₹4L - ₹11L / yr
VMWare
Windows Administrator
Microsoft Windows
Linux/Unix
Blade servers
+3 more
Key Responsibilities:

• Provides remote planning (design), implementation and/or administrative support on Dell server and storage products involving software. • Performs initial installation, implementation, customization, integration and outline orientation for the customer. • Works closely with other Dell teams, account team and Customer.

Essential Skill Requirements: • Understanding of compute environment eco system • Dell PowerEdge Servers & modular server – planning, implementation and/or administrative • Dell Power Vault – MD / ME4 series storage planning, implementation and/or administrative • Dell Storage – NX, SC Series storage planning, implementation • Experience with basic network switch technologies (Ethernet, Fibre Channel) IP networking and L2 switches. • Operating system installation and configuration: o Windows Server (inclusive of Hyper-V clustering) o VMWare ESXi and virtualization o Red hat Linux • Possesses file, P2V and/or V2V migration experience will have an added advantage.

Desirable Requirements: • Customer Service skill. • Stakeholder management. • Possess excellent problem solving, communication and organizational skills • Flexibility, dependability and have excellent time management skills • Good presentation skills • Analytical, articulate, results-oriented and able to provide excellent follow-ups. • Strong technical aptitude. • Ability to multi-task and influence others to achieve results. • Possesses Professional certification from Cisco/VMWare/Microsoft/Red Hat/Cloud will have an added advantage.
Read more
icon
Remote only
icon
3 - 10 yrs
icon
₹3.6L - ₹25L / yr
C++
SIP
SaaS
Platform as a Service (PaaS)
Python
+2 more

Desired Candidate Profile

 

    • Minimum 3 years of hands-on development experience
    • Experience with VoIP based technologies based on SIP protocol.
    • Solid C, C++ experience, Python
    • Experience in developing multi-threaded and client server application
    • Experience in Linux/Unix environment
    • Experience/Knowledge in at least three of the following technical areas is also required:
      • Object oriented design and methodologies
      • Experience developing cloud-based services (e.g. SaaS, PaaS)
      • Knowledge and development background in web services, or web based technologies using REST.
      • Experience with highly available/redundant softwer.
    • Strong communication skills required.
    • Strong writing skills required.
    • Ability to multi-task and handle changing priorities.
    • Knowledge of software development methodology, build tools and product life cycle; experience in agile development is a plus.
    • Excellent team skill, can-do attitude, focus on quality.
Read more
DP
Posted by Aishwarya Hire
icon
Mumbai
icon
3 - 9 yrs
icon
₹5L - ₹12L / yr
Apache Hive
Hadoop
Scala
Spark
Amazon Web Services (AWS)
+2 more
Job Overview :

Your mission is to help lead team towards creating solutions that improve the way our business is run. Your knowledge of design, development, coding, testing and application programming will help your team raise their game, meeting your standards, as well as satisfying both business and functional requirements. Your expertise in various technology domains will be counted on to set strategic direction and solve complex and mission critical problems, internally and externally. Your quest to embracing leading-edge technologies and methodologies inspires your team to follow suit.

Responsibilities and Duties :

- As a Data Engineer you will be responsible for the development of data pipelines for numerous applications handling all kinds of data like structured, semi-structured &
unstructured. Having big data knowledge specially in Spark & Hive is highly preferred.

- Work in team and provide proactive technical oversight, advice development teams fostering re-use, design for scale, stability, and operational efficiency of data/analytical solutions

Education level :

- Bachelor's degree in Computer Science or equivalent

Experience :

- Minimum 3+ years relevant experience working on production grade projects experience in hands on, end to end software development

- Expertise in application, data and infrastructure architecture disciplines

- Expert designing data integrations using ETL and other data integration patterns

- Advanced knowledge of architecture, design and business processes

Proficiency in :

- Modern programming languages like Java, Python, Scala

- Big Data technologies Hadoop, Spark, HIVE, Kafka

- Writing decently optimized SQL queries

- Orchestration and deployment tools like Airflow & Jenkins for CI/CD (Optional)

- Responsible for design and development of integration solutions with Hadoop/HDFS, Real-Time Systems, Data Warehouses, and Analytics solutions

- Knowledge of system development lifecycle methodologies, such as waterfall and AGILE.

- An understanding of data architecture and modeling practices and concepts including entity-relationship diagrams, normalization, abstraction, denormalization, dimensional
modeling, and Meta data modeling practices.

- Experience generating physical data models and the associated DDL from logical data models.

- Experience developing data models for operational, transactional, and operational reporting, including the development of or interfacing with data analysis, data mapping,
and data rationalization artifacts.

- Experience enforcing data modeling standards and procedures.

- Knowledge of web technologies, application programming languages, OLTP/OLAP technologies, data strategy disciplines, relational databases, data warehouse development and Big Data solutions.

- Ability to work collaboratively in teams and develop meaningful relationships to achieve common goals

Skills :

Must Know :

- Core big-data concepts

- Spark - PySpark/Scala

- Data integration tool like Pentaho, Nifi, SSIS, etc (at least 1)

- Handling of various file formats

- Cloud platform - AWS/Azure/GCP

- Orchestration tool - Airflow
Read more
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
Get to hear about interesting companies hiring right now
iconFollow Cutshort
Want to apply to this role at MNC?
Why apply via Cutshort?
Connect with actual hiring teams and get their fast response. No spam.
Learn more
Get to hear about interesting companies hiring right now
iconFollow Cutshort