
Hadoop Senior Developer / Data Engineering Developer
at one of the leading payments bank
Requirements:
- Proficiency in shell scripting.
- Proficiency in automation of tasks.
- Proficiency in Pyspark/Python.
- Proficiency in writing and understanding of sqoop.
- Understanding of Cloud Era manager.
- Good understanding of RDBMS.
- Good understanding of Excel.
- Familiarity with Hadoop ecosystem and its components.
- Understanding of data loading tools such as Flume, Sqoop etc.
- Ability to write reliable, manageable, and high-performance code.
- Good knowledge of database principles, practices, structures, and theories.

Similar jobs
1. GCP - GCS, PubSub, Dataflow or DataProc, Bigquery, BQ optimization, Airflow/Composer, Python(preferred)/Java
2. ETL on GCP Cloud - Build pipelines (Python/Java) + Scripting, Best Practices, Challenges
3. Knowledge of Batch and Streaming data ingestion, build End to Data pipelines on GCP
4. Knowledge of Databases (SQL, NoSQL), On-Premise and On-Cloud, SQL vs No SQL, Types of No-SQL DB (At Least 2 databases)
5. Data Warehouse concepts - Beginner to Intermediate level
6.Data Modeling, GCP Databases, DB Schema(or similar)
7.Hands-on data modelling for OLTP and OLAP systems
8.In-depth knowledge of Conceptual, Logical and Physical data modelling
9.Strong understanding of Indexing, partitioning, data sharding, with practical experience of having done the same
10.Strong understanding of variables impacting database performance for near-real-time reporting and application interaction.
11.Should have working experience on at least one data modelling tool,
preferably DBSchema, Erwin
12Good understanding of GCP databases like AlloyDB, CloudSQL, and
BigQuery.
13.People with functional knowledge of the mutual fund industry will be a plus Should be willing to work from Chennai, office presence is mandatory
Role & Responsibilities:
● Work with business users and other stakeholders to understand business processes.
● Ability to design and implement Dimensional and Fact tables
● Identify and implement data transformation/cleansing requirements
● Develop a highly scalable, reliable, and high-performance data processing pipeline to extract, transform and load data from various systems to the Enterprise Data Warehouse
● Develop conceptual, logical, and physical data models with associated metadata including data lineage and technical data definitions
● Design, develop and maintain ETL workflows and mappings using the appropriate data load technique
● Provide research, high-level design, and estimates for data transformation and data integration from source applications to end-user BI solutions.
● Provide production support of ETL processes to ensure timely completion and availability of data in the data warehouse for reporting use.
● Analyze and resolve problems and provide technical assistance as necessary. Partner with the BI team to evaluate, design, develop BI reports and dashboards according to functional specifications while maintaining data integrity and data quality.
● Work collaboratively with key stakeholders to translate business information needs into well-defined data requirements to implement the BI solutions.
● Leverage transactional information, data from ERP, CRM, HRIS applications to model, extract and transform into reporting & analytics.
● Define and document the use of BI through user experience/use cases, prototypes, test, and deploy BI solutions.
● Develop and support data governance processes, analyze data to identify and articulate trends, patterns, outliers, quality issues, and continuously validate reports, dashboards and suggest improvements.
● Train business end-users, IT analysts, and developers.
At least 4 years' experience as a Node.js developer.
Experience in Microservices
Extensive knowledge of JavaScript, web stacks, libraries, and frameworks.
Mandatory experience in Postgres and MySql.
Knowledge of front-end technologies such as HTML5 and CSS3.
Superb interpersonal, communication, and collaboration skills.
Exceptional analytical and problem-solving aptitude.


Job Description :
9 to 12 years' experience in software engineering
Bachelor's degree in computer science or engineering discipline
- Strong coding and debugging skills with experience in web technologies including one or more of the following: React, Angular, Node, D3 (Java API's Javascript etc.), AJAX, CSS
- Worked with authentication technologies like SAML, OAuth, SSL etc.
- Hands on experience with one or more web and application server technologies such as Apache Tomcat, Nginx, Jersey server, OSGi and other relevant frameworks
- Hands on experience with code control and code review tools like Git, Gerrit
- Good exposure to databases, SQL queries
- Fast executor with a track record of delivering complex projects on time; responds under pressures of time and uncertainty
- Strong written, editing, proofreading and oral communication
- Strong inter-personal communication and collaboration skills.
- The candidate must be able to work independently & must possess strong communication skills.
- A good team player, high level of personal commitment & 'can do' attitude.
- Strong communication skill to communicate at all levels, which includes interaction within the team & with senior management.
- The candidate should have proactive approach towards problem solving.
- Good analysis skills in order to troubleshoot and resolve the problems.

Who are we?
Whatfix is the #1 Digital Adoption Platform (DAP) for Enterprises. We are disrupting the way Learning, Training and Application Support content is consumed. We provide large enterprises with a SaaS platform that helps accelerate product adoption and reduce support & training efforts by providing contextual and step by step guidance inside any web application at the exact time a task is being performed. The product has redefined the way companies onboard, train, and provide support to users.
What sets us apart from the rest?
With over 100 of the Fortune 500 companies already onboard as customers, Whatfix has been named among the top 20 B2B tech companies alongside the likes of Adobe, PayPal, and Cisco.
With a YoY growth of 300%, we have also been recognized among the top 50 fastest growing SaaS companies worldwide in the SaaS 1000 list and as a Market Leader by Gartner in the Digital Adoption space.
We are pleased to have an Employee rating of 4.6 on Glassdoor and our Customer obsession can be seen in our reviews on platforms like G2 Crowd & Gartner Peer Insights.
The employees are happy, the customers are happy, but what about the investors? Take a look for yourself - Sequoia Capital || Stellaris || Cisco || Eight Roads || Helion Ventures
“Hustle Mode ON” is something we live by.
Our Team:
The Engineering team at Whatfix provides end to end engineering throughput that forms part of core platforms and services that drive Whatfix business.
Our team is responsible for creating the Customer Platform and everything around it be it Analytics, Infrastructure or Core Algorithms. The team owns and is responsible for all pieces that we design, build and support end to end for Whatfix product/ business.
Your Opportunity:
As part of the Core Engineering Team @Whatfix, you’ll have the opportunity to make a difference by being a part of the development team that builds future forward products. At Whatfix it’s all about scale. One of the key attributes of this job is that you are required to continuously innovate and apply technology to provide business 360 views of Whatfix customers.
Your Responsibility:
- Define architecture blueprints & take complete technical ownership of high-level design, tech stack, non-functional attributes of one or more components of various platforms
- Design, build, test and deploy cutting edge solutions at scale, impacting millions of customers worldwide
- Work closely with other architects in the team and ensure architectural consistency and technical excellence of the products and platforms
- Work with engineering teams in building high-quality and highly resilient scalable products and platforms at Whatfix
- Work with cross-functional teams to address all technical dependencies
- Drive some of the company-wide tech initiatives striving towards continuous technical excellence of our platforms
- Actively participate in technical innovations, external presentations, technical publications etc.
- Identify right open source tools to deliver product features by performing research, POC/Pilot and/or interacting with various open-source forums
- Deploy and monitor products on Cloud platforms
Our Ideal Candidate:
You have a deep interest and passion for technology. You love writing and owning code and enjoy working with people who will keep challenging you at every stage. You have strong problem solving, analytic, decision-making and excellent communication with interpersonal skills. You are self-driven and motivated with the desire to work in a fast-paced, results-driven agile environment with varied responsibilities.
Your Qualifications:
- 11+ years of experience as an Engineer
- Ability to work with teams in a collaborative and productive manner
- Strong computer science fundamentals in data structures and algorithms
- A self-motivated learner and builder with strong customer focus and obsession with quality
Must-Have:
- Strong Expertise in Backend Technologies- Java, Spring Boot, etc
- Expertise in working with AWS or other cloud infrastructures like Azure or Google Cloud, and using Infrastructure-as-Code tools
- Analyze Functional & Non-Functional requirements with effort estimation and deployment strategies
- Hands-on in Architecting and developing large scale applications
- Hands-on debugging skills
- Design for performance, scalability, fault tolerance and high availability
Good to have:
- Experience in Client-side technologies such as jQuery
- Experience in Front End Technologies is good to have (Javascript, React)
- Experience with Storage systems - NoSQL (Cassandra/MongoDB)
- Leveraging cutting edge technologies like Kubernetes, Docker, etc. to design and build new infrastructure features
Behavioural traits:
- Excellent communication and technical leadership skills
- Can-do attitude to take BIG problems by their horns and solve them
- Ability to inspire others & be a role model and mentor for upcoming engineers in the organization
- Entrepreneurial spirit to conceive ideas, turn challenges into opportunities and build products
We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status
Full Job Description
Decathlon is one of the world’s leading Sports goods retailers with the Motto of making sports accessible to over a Billion Indians!
To achieve this, we need a team of energetic, sporty team players we call,
SPORT LEADERS.
Sport Leader is an essential position to Decathlon that acts as a point of connection between Decathlon and its customers.
LOVE SPORT? CUSTOMER-FOCUSED? LOOKING FOR A RETAIL CAREER WITH A DIFFERENCE? IF YES, THIS COULD BE THE PERFECT ROLE FOR YOU!
As a Sports Advisor, your role is to ensure all customers leave our stores ‘satisfied or satisfied’. From a friendly and professional welcome through to a quick and easy payment process, your role is to always deliver a 5-star shopping experience. Decathlon heavily invests in the development of teammates so that those who want to build careers within the business are able to flourish within their roles. Whether you’re a student looking for a part-time role, or perhaps someone looking for a complete career change, Decathlon can cater to all.
OUR MISSION
To spread to wonders of sports to many
YOUR RESPONSIBILITIES
Customer Service: Through your own passion for sport, you’ll share your tips and experiences with users and through our hands-on product training, you will be able to give the best technical advice for the sports you are responsible for. Decathlon has shifted over the last year into an omnichannel business so it’s essential that our sports advisors are able to assist customers in all aspects of retail shopping, whether that’s in-store or online!
Merchandising: Whether full-time or part-time, every Omni Sports Leader is encouraged to take responsibility to autonomously manage stock levels and pricing and to provide a high level of merchandising so that each customer can easily find the right product for their sporting practice.
Team Player: You will be part of a shop floor team of like-minded Omni Sports Leaders, practicing sport and celebrating victories together, so it’s important that you are able to work well within a team environment as well as independently.
WHO YOU ARE?
Your passion drives you to create value for people, the planet, and commerce
I share the values of Decathlon on Vitality, Responsibility, Authenticity, Generosity Someone looking to combine a passion for sport with work.
A people person who is prepared to go the extra mile.
Someone looking for a retail career with a difference
Problem solver with good communication skills.
Able to play as part of the team during the busiest times (weekends and holidays)
Additional Information:
As a Sales Assistant, you will be required to work usual retail hours including evenings and weekends. The role will be shop-floor based with full Covid-19 safety regulations and precautions in place. The safety of our teammates and customers is our main priority during these times.
You will be autonomous in your work and will get to make the sport you love accessible to the many!
SPORT FOR ALL | ALL FOR SPORT.
Job Types: Full-time, Part-time, Regular / Permanent, Fresher
Part-time hours: 45 per week
Salary: ₹22,000.00 - ₹30,000.00 per month
Benefits:
- Health insurance
- Provident Fund
Schedule:
- Flexible shift
- Rotational shift
- Weekend availability
Supplemental pay types:
- Performance bonus
- Yearly bonus


* Explore
As an engineer, you will have multiple ways, tools & technologies to solve a particular problem. We want you to take things in your own hands and figure out the best way to solve it.
* PDCT
Plan, design, code & write test cases for problems you are solving
* Tuning
Help to tune performance, including reviewing system and application logs
* Security
Work on code-level application security
Technologies :
* React
* Python (Some knowledge or past work-ex)
* Typescript (Optional)
The challenges are great (as are the rewards). If you are looking to take these backend challenges head on & wish to learn a great deal out of it and contribute to the company along the way, this is the role for you.
Company & team :
Until now companies across the world, manage their analytical workflow through a number of data tools, for each use case adding one more tool to the stack leading to high maintenance cost and difficulties with respect to scaling. Research shows, companies only spend about 11% of time on extracting value out of their data and the other 89% of their time goes on just maintaining the “Frankenstein” data infrastructure.
Here enters Datazip Software-as-a-service, which is a no-code, scalable, all-in-one, data stack (Data Ops) for organisations to ingest, store, transform and visualise data, resulting in fast data-driven decision making, all without the need for expensive data teams. We are providing Ingestion with 150+ sources, Data Warehousing, Data analytics (BI tool), Data transformation solutions as a whole managed stack.
Companies have more data than ever to activate and extract value. But they’re also approached by a plethora of data tools and service providers for different steps in the process.
Our mission is to provide the quickest, trustworthy and most reliable end-to-end way for a company to extract the value of their data covering all steps.
What sets us apart : Product and our character
* We have accepted the challenge of solving the problem of data infrastructure end-to-end, not just the part of it and you will not find us resting till we solve this. ( yeah, we are Tireless! )
* An incredibly consistent culture based on 5 distinguishing characteristics: Persistence, Impact, Passion, Integrity & Fun (of course !!)
And it’s working! Within 3 months of incorporation Datazip shipped out its V0, secured funding and was also entrusted by multiple startups for their data infrastructure needs.
Given the Core deep tech nature of our product, we are on the lookout of Rockstar Founding Team engineers. Your main job will be to get already present best in class open source tools, and modify them to fit the use cases in scalable, secure & observable manner. These tools should work well together as well.
Founding team
Shubham Baldava
Shubham CTO, 7 years industry experience with 3 unicorns, solving data. NIT Jamshedpur alumn
Rohan Khameshra
Rohan was a data scientist at Khatabook. He loves data and is helping with product and sales at Datazip. IIT Kharagpur alumn
Sandeep Devarapalli
Sandeep was a space scientist at ISRO, loves to build Tech products and he is currently contributing to Datazip to help anyone work with data at scale, mainly handling growth and marketing. IIM Calcutta alumn


About The Team
We are striving to create the best productivity tools which will help small businesses to go online and scale their growth consistently with the bleeding edge of technology. Our backend team is looking for a solid Rockstar engineer who can hack around multiple technologies and build highly scalable, low latency, distributed systems. You will work closely with our product team to build new and compelling experiences for our customers!
We place special emphasis on the continuous growth of each team member - and we do this with regular 1-1s and open communication. As Software Engineer - Backend, you will be part of self-starters who thrive on teamwork and constructive feedback.
About The Role
As a Software Engineer - Backend, you will solve real-life complex problems and create compelling experiences for our users. In this role, you will ensure that the solutions and processes that we create are of the highest quality. And in doing so, you will champion a seamless app experience for all our users. You will also collaborate with your fellow engineers to create scalable solutions that are pertinent to Product IO's overall growth.
If you are confident about solving hard, interesting and UNIQUE problems, and creating an impact within an entrepreneurial environment, then you might just be our next Software Engineer - Backend
What You'll Do:
- Lead, build, test, and release mobile application features using cross-platform tools.
- Collaborate with the front-end team to expose weaknesses and problems
- Build out our APIs and tools using Python & Firebase libraries on the backend.
- Experience with NodeJS and deployment in Serverless
- Experience with NoSql(MongoDB) and SQL(PostregSQL)
- Work closely with Product, Design, Platform, and other cross-functional groups to drive product vision.
- Previous experience helping shape API structures and building REST APIs.
- Understanding of accessibility and server compliance (GCP)
Required Qualifications:
- 2+ years professional software development experience, preferably mobile apps with a cloud backend. Example projects in (Python, Firebase)
- 6 months experience in Google Cloud Platform
- Excellent communication skills are a must, and experience with estimating and managing project tasks is important, too
- Highly driven, naturally curious, and comfortable working in a fast-paced environment
Bonus points:
- 1+ years of experience in developing Firebase apps.
- Experience in developing or designing APIs and web applications.
- Deployment in Cloud Environment.
- Familiarity with Flutter.
Why join us:
- 👫 A fast-moving, fun, growth-oriented company made up of skillful team players
- 💬 Transparent, open, and collaborative work environment
- 🌟 An opportunity to work closely with a proven executive team, board, and serial entrepreneurs

- 2-5 experience of working with SPA
- Highly skilled at front-end engineering using Object-Oriented JavaScript (ES5, ES6), various JavaScript libraries and frameworks (ReactJS), HTML and CSS
- Experience with Asynchronous and Futures (Promises) Design Patterns
- Proficient understanding of code versioning tools, such as Git
- Experience in developing Large-scale, Single-Page Applications (SPAs) and Unit Testing
- Good understanding of browser rendering behavior and performance
- Proficient understanding of cross-browser compatibility issues and ways to work around such issues
Good to have: Optional
- Working with Secure APIs using JWT/OAUTH
Apply only if you have
- 4 - 7 years of total experience
- Minimum 2 years experience in a leadership role in a consumer product based startup
- Ensured that the Product's technical aspects aligned with the business, vision & mission
- Communicated technology strategy to colleagues and investors
- An understanding of budgets and business planning
- Scaled yourself to become a tech leader
- An ex-entrepreneur will be preferred

Have experience using and writing REST Apis.
Someone who can provide technical leadership across UI engineering, and help guide the overall engineering vision.

