Ganit Business Solutions

Job Description:

We are looking for a Big Data Engineer who have worked across the entire ETL stack. Someone who has ingested data in a batch and live stream format, transformed large volumes of daily and built Data-warehouse to store the transformed data and has integrated different visualization dashboards and applications with the data stores.    The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them.

Responsibilities:

• Develop, test, and implement data solutions based on functional / non-functional business requirements.
• You would be required to code in Scala and PySpark daily on Cloud as well as on-prem infrastructure
• Build Data Models to store the data in a most optimized manner
• Identify, design, and implement process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Implementing the ETL process and optimal data pipeline architecture
• Monitoring performance and advising any necessary infrastructure changes.
• Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
• Work with data and analytics experts to strive for greater functionality in our data systems.
• Proactively identify potential production issues and recommend and implement solutions
• Must be able to write quality code and build secure, highly available systems.
• Create design documents that describe the functionality, capacity, architecture, and process.
• Review peer-codes and pipelines before deploying to Production for optimization issues and code standards

Skill Sets:

• Good understanding of optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and ‘big data’ technologies.
• Proficient understanding of distributed computing principles
• Experience in working with batch processing/ real-time systems using various open-source technologies like NoSQL, Spark, Pig, Hive, Apache Airflow.
• Implemented complex projects dealing with the considerable data size (PB).
• Optimization techniques (performance, scalability, monitoring, etc.)
• Experience with integration of data from multiple data sources
• Experience with NoSQL databases, such as HBase, Cassandra, MongoDB, etc.,
• Knowledge of various ETL techniques and frameworks, such as Flume
• Experience with various messaging systems, such as Kafka or RabbitMQ
• Creation of DAGs for data engineering
• Expert at Python /Scala programming, especially for data engineering/ ETL purposes

Technologies & Languages

• Azure
  • Databricks
  • SQL Sever
  • ADF
• Snowflake
  • Data Cleaning
  • ETL
• Azure Devops
• Intermediate Python/Pyspark
• Intermediate SQL
• Beginners' knowledge/willingness to learn Spotfire
• Data Ingestion
• Familiarity with CI/CD or Agile

Must have:

• Azure – VM, Data Lake, Data Bricks, Data Factory, Azure DevOps
• Python/Spark (PySpark) 
• SQL

Good to have:

• Docker
• Kubernetes
• Scala

He/she should have a good understanding in:

• How to build pipelines – ETL and Injection
• Data Warehousing
• Monitoring

Responsibilities:

Must be able to write quality code and build secure, highly available systems.

Assemble large, complex data sets that meet functional / non-functional business requirements.

Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc with the guidance.

Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.

Monitoring performance and advising any necessary infrastructure changes.

Defining data retention policies.

Implementing the ETL process and optimal data pipeline architecture

Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.

Create design documents that describe the functionality, capacity, architecture, and process.

Develop, test, and implement data solutions based on finalized design documents.

Work with data and analytics experts to strive for greater functionality in our data systems.

Proactively identify potential production issues and recommend and implement solutions

Responsibilities:

• Work with development teams and product managers to ideate scalable software solutions
• Design client-side and server-side architecture
• Design, develop and manage well-functioning databases and applications
• Develop web applications implementing MVT architecture using Django web application frameworks
• Write effective APIs using industry standard design patterns
• Manage the complete software development process from conception to deployment
• Maintaining and upgrading the software following deployment
• Should be able to visualize a proposed system and be able to build it
• Development of applications leveraging Django/Flask based REST APIs

• Work with server-side technologies including databases and MVC/MVT patterns
• Maintain version control system such as GIT
• Should know all the phases of SDLC from requirement gathering to support and maintenance.

Requirements:

• 3-7 years provable experience as a Back End Developer
• Familiarity with common solution stacks 
• Strong understanding of algorithms, data structures and system design, for scale, performance and security
• Ability to develop back-end website applications
• Knowledge of middleware languages (Python – Flask/Django) and/or JavaScript framework like Node.js
• Familiarity with databases (RDBMS – MySQL/PostgreSQL, optionally NoSQL DBs like MongoDB), web servers (Apache) and UI/UX design
• Great attention to detail
• Organizational skills
• An analytical mind
• Degree in Computer Science or relevant field

Technical Skills & Competencies: Mandatory:

Web Development – HTML, CSS, JavaScript

Frameworks – ReactJS/AngularJS

Server-side development – Python/Django/Node.js

Database: SQL or NoSQL Databases (SQL Server/ MongoDB)

API Design concepts and Development of RESTful web services

Preferable:

• Familiarity with the Development of reusable frameworks, libraries to be used by multiple development teams
• Familiarity with cloud-native application architecture patterns
• Hands-on experience on project management tools like Jira
• Experience using DevOps Tools for CI/CD
• Conversant with agile methodologies

Roles & Responsibilities

• Work independently or in a small team setup
• Manage a team of highly skilled Frontend/Full Stack and Backend developers
• Creating, executing, and maintaining project plans including activity definition, sequence, dependencies, work effort, duration, and resource requirements
• Work with the technical team, communicating requirements and ensuring all product development meets the goals of the project and overall business and strategic goals
• Project management including release management, add-on compatibility reporting, updating documentations
• Assist in other ad-hoc or administrative tasks as part of daily/routine business activities
• Work with product technical architects to design new products or enhancements. Take part in system development including analysis, coding, and testing
• Performs design and code reviews with senior technical staff
• Act like the person everyone turns to resolve tough technical problems
• Work closely with other teams/vendors to connect front-end components with the other (often third-party) web and data services and support the back-end developers by integrating their work with the application
• Mentors team on proper standards/techniques to improve their accuracy and efficiency
• Performs the unit testing, system integration testing and assist with user acceptance testing
• Articulates business requirements in sufficient detail such that a technical solution can be designed and engineered
• Develops technical understanding of how the data flows from various source
• Provide ongoing support to applications used within the organization

Requirement

• 5+ years of experience in product development, with 2+ years of experience in a leadership role in current organization
• Reliable, self-motivated, and self-disciplined individual capable of planning and executing multiple projects simultaneously within a fast-paced environment
• Exceptional debugging skills and strong experience with performance tuning
• Excellent technical, analytical, and organizational skills
• Good range of hands-on technical experience
• Expert knowledge in Systems Development Life Cycle (SDLC)
• Expert understanding of Node.js and JavaScript
• Familiarity with code revisioning and repo maintenance on Git, code profiling and auditing

Job Brief

We are looking for a Full Stack Developer to produce scalable software solutions. You will be part of a cross-functional team that is responsible for the full software development life cycle, from conception to deployment.

Responsibilities:

• Work with development teams and product managers to ideate scalable software solutions
• Design client-side and server-side architecture
• Build the front-end of applications through appealing visual design
• Design, develop and manage well-functioning databases and applications
• Develop web applications implementing MVT architecture using Django web application frameworks
• Write effective APIs
• Manage the complete software development process from conception to deployment
• Maintaining and upgrading the software following deployment
• Should be able to visualize a proposed system and be able to build it
• Experience with Django, Flask, rest frameworks

• Work with server-side technologies including databases and MVC and MVT patterns
• Maintain version control system such as GIT
• Should know all the phases of SDLC from requirement gathering to support and maintenance.
•  

Requirements:

• 3-5 years proven experience as a Full Stack Developer
• Familiarity with common stacks
• Strong understanding of algorithms, data structures and system design
• Knowledge of LAMP and MEAN solution stacks
• Ability to develop front end website architecture and back-end website applications
• Knowledge of multiple front-end languages and libraries (HTML/ CSS, JavaScript, React, Angular, Vue, XML, jQuery and LESS)
• Knowledge of multiple back-end languages (C#, Java, Python) and JavaScript framework like Node.js
• Familiarity with databases (MySQL, SQL, MongoDB), web servers (Apache) and UI/UX design
• Excellent communication and teamwork skills
• Great attention to detail
• Organizational skills
• An analytical mind
• Degree in Computer Science or relevant field

Responsibilities:

• Must be able to write quality code and build secure, highly available systems.
• Assemble large, complex datasets that meet functional / non-functional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing datadelivery, re-designing infrastructure for greater scalability, etc with the guidance.
• Create datatools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
• Monitoring performance and advising any necessary infrastructure changes.
• Defining dataretention policies.
• Implementing the ETL process and optimal data pipeline architecture
• Build analytics tools that utilize the datapipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
• Create design documents that describe the functionality, capacity, architecture, and process.
• Develop, test, and implement datasolutions based on finalized design documents.
• Work with dataand analytics experts to strive for greater functionality in our data
• Proactively identify potential production issues and recommend and implement solutions

Skillsets:

• Good understanding of optimal extraction, transformation, and loading of datafrom a wide variety of data sources using SQL and AWS ‘big data’ technologies.
• Proficient understanding of distributed computing principles
• Experience in working with batch processing/ real-time systems using various open-source technologies like NoSQL, Spark, Pig, Hive, Apache Airflow.
• Implemented complex projects dealing with the considerable datasize (PB).
• Optimization techniques (performance, scalability, monitoring, etc.)
• Experience with integration of datafrom multiple data sources
• Experience with NoSQL databases, such as HBase, Cassandra, MongoDB, etc.,
• Knowledge of various ETL techniques and frameworks, such as Flume
• Experience with various messaging systems, such as Kafka or RabbitMQ
• Good understanding of Lambda Architecture, along with its advantages and drawbacks
• Creation of DAGs for dataengineering
• Expert at Python /Scala programming, especially for dataengineering/ ETL purposes

Ganit has flipped the data science value chain as we do not start with a technique but for us, consumption comes first. With this philosophy, we have successfully scaled from being a small start-up to a 200 resource company with clients in the US, Singapore, Africa, UAE, and India. 

We are looking for experienced data enthusiasts who can make the data talk to them. 

You will: 

• Understand business problems and translate business requirements into technical requirements. 
• Conduct complex data analysis to ensure data quality & reliability i.e., make the data talk by extracting, preparing, and transforming it. 
• Identify, develop and implement statistical techniques and algorithms to address business challenges and add value to the organization. 
• Gather requirements and communicate findings in the form of a meaningful story with the stakeholders  
• Build & implement data models using predictive modelling techniques. Interact with clients and provide support for queries and delivery adoption. 
• Lead and mentor data analysts. 

We are looking for someone who has: 

• Apart from your love for data and ability to code even while sleeping you would need the following. 
• Minimum of 02 years of experience in designing and delivery of data science solutions. 
• You should have successful projects of retail/BFSI/FMCG/Manufacturing/QSR in your kitty to show-off. 
• Deep understanding of various statistical techniques, mathematical models, and algorithms to start the conversation with the data in hand. 
• Ability to choose the right model for the data and translate that into a code using R, Python, VBA, SQL, etc. 
• Bachelors/Masters degree in Engineering/Technology or MBA from Tier-1 B School or MSc. in Statistics or Mathematics 

Skillset Required:

• Regression
• Classification
• Predictive Modelling
• Prescriptive Modelling
• Python
• R
• Descriptive Modelling
• Time Series
• Clustering
•  

What is in it for you: 

• Be a part of building the biggest brand in Data science. 
• An opportunity to be a part of a young and energetic team with a strong pedigree. 
• Work on awesome projects across industries and learn from the best in the industry, while growing at a hyper rate. 

Please Note:  

At Ganit, we are looking for people who love problem solving. You are encouraged to apply even if your experience does not precisely match the job description above. Your passion and skills will stand out and set you apart—especially if your career has taken some extraordinary twists and turns over the years. We welcome diverse perspectives, people who think rigorously and are not afraid to challenge assumptions in a problem. Join us and punch above your weight! 

Ganit is an equal opportunity employer and is committed to providing a work environment that is free from harassment and discrimination. 

All recruitment, selection procedures and decisions will reflect Ganit’s commitment to providing equal opportunity. All potential candidates will be assessed according to their skills, knowledge, qualifications, and capabilities. No regard will be given to factors such as age, gender, marital status, race, religion, physical impairment, or political opinions.