Sr. Data Engineer

What you will do:

• Understand the process of CaaStle business teams, KPIs, and pain points
• Build scalable data products, self-service tools, data cubes to analyze and present data associated with acquisition, retention, product performance, operations, client services, etc.
• Closely partner with data engineering, product, and business teams and participate in requirements capture, research design, data collection, dashboard generation, and translation of results into actionable insights that can add value for business stakeholders
• Leverage advanced analytics to drive key success metrics for business and revenue generation
• Operationalize, implement, and automate changes to drive data-driven decisions
• Attend and play an active role in answering questions from the executive and/or business teams through data mining and analysis

We would love for you to have:

• Education: Advanced degree in Computer Science, Statistics, Mathematics, Engineering, Economics, Business Analytics or related field is required
• Experience: 2-4 years of professional experience
• Proficiency in data visualization/reporting tools (i.e. Tableau, Qlikview, etc.)
• Experience in A/B testing and measure performance of experiments
• Strong proficiency with SQL-based languages. Experience with large scale data analytics technologies (i.e., Hadoop and Spark)
• Strong analytical skills and business mindset with the ability to translate complex concepts and analysis into clear and concise takeaways to drive insights and strategies
• Excellent communication, social, and presentation skills with meticulous attention to detail
• Programming experience in Python, R, or other languages
• Knowledge of Data mining, statistical modeling approaches, and techniques

CaaStle is committed to equality of opportunity in employment. It has been and will continue to be the policy of CaaStle to provide full and equal employment opportunities to all employees and candidates for employment without regard to race, color, religion, national or ethnic origin, veteran status, age, sexual orientation, gender identity, or physical or mental disability. This policy applies to all terms, conditions and privileges of employment, such as those pertaining to training, transfer, promotion, compensation and recreational programs.

• Should have good hands-on experience in Informatica MDM Customer 360, Data Integration(ETL) using PowerCenter, Data Quality.
• Must have strong skills in Data Analysis, Data Mapping for ETL processes, and Data Modeling.
• Experience with the SIF framework including real-time integration
• Should have experience in building C360 Insights using Informatica
• Should have good experience in creating performant design using Mapplets, Mappings, Workflows for Data Quality(cleansing), ETL.
• Should have experience in building different data warehouse architecture like Enterprise,
• Federated, and Multi-Tier architecture.
• Should have experience in configuring Informatica Data Director in reference to the Data
• Governance of users, IT Managers, and Data Stewards.
• Should have good knowledge in developing complex PL/SQL queries.
• Should have working experience on UNIX and shell scripting to run the Informatica workflows and to control the ETL flow.
• Should know about Informatica Server installation and knowledge on the Administration console.
• Working experience with Developer with Administration is added knowledge.
• Working experience in Amazon Web Services (AWS) is an added advantage. Particularly on AWS S3, Data pipeline, Lambda, Kinesis, DynamoDB, and EMR.
• Should be responsible for the creation of automated BI solutions, including requirements, design,development, testing, and deployment

Role Summary/Purpose:

We are looking for a Developer/Senior Developers to be a part of building advanced analytical platform leveraging Big Data technologies and transform the legacy systems. This role is an exciting, fast-paced, constantly changing and challenging work environment, and will play an important role in resolving and influencing high-level decisions.

Requirements:

• The candidate must be a self-starter, who can work under general guidelines in a fast-spaced environment.
• Overall minimum of 4 to 8 year of software development experience and 2 years in Data Warehousing domain knowledge
• Must have 3 years of hands-on working knowledge on Big Data technologies such as Hadoop, Hive, Hbase, Spark, Kafka, Spark Streaming, SCALA etc…
• Excellent knowledge in SQL & Linux Shell scripting
• Bachelors/Master’s/Engineering Degree from a well-reputed university.
• Strong communication, Interpersonal, Learning and organizing skills matched with the ability to manage stress, Time, and People effectively
• Proven experience in co-ordination of many dependencies and multiple demanding stakeholders in a complex, large-scale deployment environment
• Ability to manage a diverse and challenging stakeholder community
• Diverse knowledge and experience of working on Agile Deliveries and Scrum teams.

Responsibilities

• Should works as a senior developer/individual contributor based on situations
• Should be part of SCRUM discussions and to take requirements
• Adhere to SCRUM timeline and deliver accordingly
• Participate in a team environment for the design, development and implementation
• Should take L3 activities on need basis
• Prepare Unit/SIT/UAT testcase and log the results
• Co-ordinate SIT and UAT Testing. Take feedbacks and provide necessary remediation/recommendation in time.
• Quality delivery and automation should be a top priority
• Co-ordinate change and deployment in time
• Should create healthy harmony within the team
• Owns interaction points with members of core team (e.g.BA team, Testing and business team) and any other relevant stakeholders

• Required to work individually or as part of a team on data science projects and work closely with lines of business to understand business problems and translate them into identifiable machine learning problems which can be delivered as technical solutions.
• Build quick prototypes to check feasibility and value to the business.
• Design, training, and deploying neural networks for computer vision and machine learning-related problems.
• Perform various complex activities related to statistical/machine learning.
• Coordinate with business teams to provide analytical support for developing, evaluating, implementing, monitoring, and executing models.
• Collaborate with technology teams to deploy the models to production.

Key Criteria:

• 2+ years of experience in solving complex business problems using machine learning.
• Understanding and modeling experience in supervised, unsupervised, and deep learning models; hands-on knowledge of data wrangling, data cleaning/ preparation, dimensionality reduction is required.
• Experience in Computer Vision/Image Processing/Pattern Recognition, Machine Learning, Deep Learning, or Artificial Intelligence.
• Understanding of Deep Learning Architectures like InceptionNet, VGGNet, FaceNet, YOLO, SSD, RCNN, MASK Rcnn, ResNet.
• Experience with one or more deep learning frameworks e.g., TensorFlow, PyTorch.
• Knowledge of vector algebra, statistical and probabilistic modeling is desirable.
• Proficiency in programming skills involving Python, C/C++, and Python Data Science Stack (NumPy, SciPy, Pandas, Scikit-learn, Jupyter, IPython).
• Experience working with Amazon SageMaker or Azure ML Studio for deployments is a plus.
• Experience in data visualization software such as Tableau, ELK, etc is a plus.
• Strong analytical, critical thinking, and problem-solving skills.

• B.E/ B.Tech./ M. E/ M. Tech in Computer Science, Applied Mathematics, Statistics, Data Science, or related Engineering field.
• Minimum 60% in Graduation or Post-Graduation
• Great interpersonal and communication skills

Job Overview

                         We are looking for a ML Architect to help us discover the information hidden in vast amounts of data, and help us make smarter decisions to deliver even better products. Your primary focus will be in applying data mining techniques, doing statistical analysis, and building high quality prediction systems integrated with our products. They must have strong experience using variety of data mining and data analysis methods, building and implementing models, using/creating algorithm’s and creating/running simulations.  They must be comfortable working with a wide range of stakeholders and functional teams. The right candidate will have a passion for discovering solutions hidden in large data sets and working with stakeholders to improve business outcomes. Automating to identify the textual data with their properties and structure form various type of document.

Responsibilities

• Selecting features, building and optimizing classifiers using machine learning techniques
• Data mining using state-of-the-art methods
• Enhancing data collection procedures to include information that is relevant for building analytic systems
• Processing, cleansing, and verifying the integrity of data used for analysis
• Creating automated anomaly detection systems and constant tracking of its performance
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Secure and manage when needed GPU cluster resources for events
• Write comprehensive internal feedback reports and find opportunities for improvements
• Manage GPU instances/machines to increase the performance and efficiency of the ML/DL model.

Skills and Qualifications

• Strong Hands-on experience in Python Programming
• Working experience with Computer Vision models - Object Detection Model, Image Classification
• Good experience in feature extraction, feature selection techniques and transfer learning
• Working Experience in building deep learning NLP Models for text classification, image analytics-CNN,RNN,LSTM.
• Working Experience in any of the AWS/GCP cloud platforms, exposure in fetching data from various sources.
• Good experience in exploratory data analysis, data visualisation, and other data preprocessing techniques.
• Knowledge in any one of the DL frameworks like Tensorflow, Pytorch, Keras, Caffe
• Good knowledge in statistics,distribution of data and in supervised and unsupervised machine learning algorithms.
• Exposure to OpenCV Familiarity with GPUs + CUDA
• Experience with NVIDIA software for cluster management and provisioning such as nvsm, dcgm and DeepOps.
• We are looking for a candidate with 14+ years of experience, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. They should also have experience using the following software/tools:
• Experience with big data tools: Hadoop, Spark, Kafka, etc.
• Experience with AWS cloud services: EC2, RDS, AWS-Sagemaker(Added advantage)
• Experience with object-oriented/object function scripting languages in any: Python, Java, C++, Scala, etc.