Data Engineer

Primary Skills

DynamoDB, Java, Kafka, Spark, Amazon Redshift, AWS Lake Formation, AWS Glue, Python

Skills:

Good work experience showing growth as a Data Engineer.

Hands On programming experience

Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS Lake Formation.

Excellent knowledge in: Python, Scala/Java, Spark, AWS (Lambda, Step Functions, Dynamodb, EMR), Terraform, UI (Angular), Git, Mavena

Experience of performance optimization in Batch and Real time processing applications

Expertise in Data Governance and Data Security Implementation

Good hands-on design and programming skills building reusable tools and products Experience developing in AWS or similar cloud platforms. Preferred:, ECS, EKS, S3, EMR, DynamoDB, Aurora, Redshift, Quick Sight or similar.

Familiarity with systems with very high volume of transactions, micro service design, or data processing pipelines (Spark).

Knowledge and hands-on experience with server less technologies such as Lambda, MSK, MWAA, Kinesis Analytics a plus.

Expertise in practices like Agile, Peer reviews, Continuous Integration

Roles and responsibilities:

Determining project requirements and developing work schedules for the team.

Delegating tasks and achieving daily, weekly, and monthly goals.

Responsible for designing, building, testing, and deploying the software releases.

Salary: 25LPA-40LPA

The role is with a Fintech Credit Card company based in Pune within the Decision Science team. (OneCard )

About

Credit cards haven't changed much for over half a century so our team of seasoned bankers, technologists, and designers set out to redefine the credit card for you - the consumer. The result is OneCard - a credit card reimagined for the mobile generation. OneCard is India's best metal credit card built with full-stack tech. It is backed by the principles of simplicity, transparency, and giving back control to the user.

The Engineering Challenge

“Re-imaging credit and payments from First Principles”

Payments is an interesting engineering challenge in itself with requirements of low latency, transactional guarantees, security, and high scalability. When we add credit and engagement into the mix, the challenge becomes even more interesting with underwriting and recommendation algorithms working on large data sets. We have eliminated the current call center, sales agent, and SMS-based processes with a mobile app that puts the customers in complete control. To stay agile, the entire stack is built on the cloud with modern technologies.

Purpose of Role :

- Develop and implement the collection analytics and strategy function for the credit cards. Use analysis and customer insights to develop optimum strategy.

CANDIDATE PROFILE :

- Successful candidates will have in-depth knowledge of statistical modelling/data analysis tools (Python, R etc.), techniques. They will be an adept communicator with good interpersonal skills to work with senior stake holders in India to grow revenue primarily through identifying / delivering / creating new, profitable analytics solutions.

We are looking for someone who:

- Proven track record in collection and risk analytics preferably in Indian BFSI industry. This is a must.

- Identify & deliver appropriate analytics solutions

- Experienced in Analytics team management

Essential Duties and Responsibilities :

- Responsible for delivering high quality analytical and value added services

- Responsible for automating insights and proactive actions on them to mitigate collection Risk.

- Work closely with the internal team members to deliver the solution

- Engage Business/Technical Consultants and delivery teams appropriately so that there is a shared understanding and agreement as to deliver proposed solution

- Use analysis and customer insights to develop value propositions for customers

- Maintain and enhance the suite of suitable analytics products.

- Actively seek to share knowledge within the team

- Share findings with peers from other teams and management where required

- Actively contribute to setting best practice processes.

Knowledge, Experience and Qualifications :

Knowledge :

- Good understanding of collection analytics preferably in Retail lending industry.

- Knowledge of statistical modelling/data analysis tools (Python, R etc.), techniques and market trends

- Knowledge of different modelling frameworks like Linear Regression, Logistic Regression, Multiple Regression, LOGIT, PROBIT, time- series modelling, CHAID, CART etc.

- Knowledge of Machine learning & AI algorithms such as Gradient Boost, KNN, etc.

- Understanding of decisioning and portfolio management in banking and financial services would be added advantage

- Understanding of credit bureau would be an added advantage

Experience :

- 4 to 8 years of work experience in core analytics function of a large bank / consulting firm.

- Experience on working on Collection analytics is must

- Experience on handling large data volumes using data analysis tools and generating good data insights

- Demonstrated ability to communicate ideas and analysis results effectively both verbally and in writing to technical and non-technical audiences

- Excellent communication, presentation and writing skills Strong interpersonal skills

- Motivated to meet and exceed stretch targets

- Ability to make the right judgments in the face of complexity and uncertainty

- Excellent relationship and networking skills across our different business and geographies

Qualifications :

- Masters degree in Statistics, Mathematics, Economics, Business Management or Engineering from a reputed college

Role - Senior Analytics Executive

Experience - 1-2 years

Location - Open (Remote working option available)

About Company :-

Our team is made up of best in class digital, offline, and integrated media experts who work together to enhance media's contribution to Google's business. Our team operates in a seamlessly integrated way across strategy, planning, investment, creative, business sciences and analytics, data and technology. The profile of people who work are world class, committed to establishing a new high water mark in the media industry.

About the role/ Some of the things we'd like you to do:

- Support the Analytics team and other stakeholders with analytics agendas impacting campaigns, measurement frameworks, and campaign optimization.

- Conduct thorough data analysis using various tools and software within MFG to provide insights and recommendations that align with client needs.

- Collaborate with internal stakeholders across disciplines and countries to understand client objectives, providing support and expertise in data and analytics while identifying opportunities for advanced analytics solutions.

- Formulate strategic recommendations with the team based on gathered insights, and support the delivery of reporting for clients.

- Continuously improve project performance and processes by collaborating with the team to develop new tools and solutions.

About yourself/ Requirements:

- Bachelor's degree in a related quantitative field (e.g. Statistics, Business Analytics, Economics, Computer Science, etc.)

- 1-2 years of relevant work experience in data analysis; digital media experience desired

- Strong knowledge of various data analysis tools and software (e.g., Excel, SQL, R, Python, Tableau).

- Is proficient in statistical principles and how they apply to tasks/work items.

- Excellent problem-solving skills and the ability to analyze complex data sets.

- Strong communication and interpersonal skills, with the ability to present data-driven insights to both technical and non-technical audiences.

- Ability to work independently and as part of a team, with strong collaboration skills.

- Demonstrated ability to manage multiple projects and prioritize tasks effectively.

- Passion tor continuous learning and staying current with industry trends and best practices in analytics.

About Us:

We are a VC-funded startup solving one of the biggest transportation problems India faces. Most passengers in India travel long distance by IRCTC trains. At time of booking, approx 1 out of every 2 passengers end up with a Waitlisted or RAC ticket. This creates a lot of anxiety for passengers, as Railway only announces only 4 hour before departure if they have a confirmed seat. We solve this problem through our Waitlist & RAC Protection. Protection can be bought against each IRCTC ticket at time of booking. If train ticket is not confirmed, we fly the passenger to the destination. Our team consists of 3 Founders from IIT, IIM and ISB.

Functional Experience:

• Computer Science or IT Engineering background with solid understanding of basics of Data Structures and Algorithms
• 2+ years of data science experience working with large datasets
• Expertise in Python packages like pandas, numPy, sklearn, matplotlib, seaborn, keras and tensorflow
• Expertise in Big Data technologies like Hadoop, Cassandra and PostgreSQL
• Expertise in Cloud computing on AWS with EC2, AutoML, Lambda and RDS
• Good knowledge of Machine Learning and Statistical time series analysis (optional)
• Unparalleled logical ability making you the go to guy for all things related to data
• You love coding like a hobby and are up for a challenge!

Cultural:

• Assume a strong sense of ownership of analytics : Design, develop & deploy
• Collaborate with senior management, operations & business team
• Ensure Quality & sustainability of the architecture
• Motivation to join an early stage startup should go beyond compensation

• 4+ yrs of experience having strong fundamentals on Windchill Customization & Configurations, Reporting Framework Customization, Workflow Customization , Customer handling
• Strong Customization background around Form Processors, Validator, data utilities, Form Controllers etc.
• Strong Programming skills in Java/J2EE technologies – JavaScript, GWT, JQuerry, XMLs, JSPs, SQL etc.
• Deep Knowledge in Windchill architecture

• Experience in atleast one full lifecycle PLM implementation with Windchill.
• Should have strong coding skills in Windchill development and Customization, ThingWorx Navigate Development (Mandatory), Thing Worx Architecture Configurations Mashup creation, ThingWorx and Windchill Upgrade

• Should have Build and Configuration management (Mandatory) - HPQC \JIRA\Azure\SVN\GITHUB \ Ant
• Knowledge & Experience in Build and Release process
• Having worked on custom upgrade will be a plus.
• Understanding of application s development environment, Database, data management and infrastructure capabilities and constraints. Understanding of Database administration, Database design and performance Tuning
• Follow Quality processes for tasks with appropriate reviews. Participate in sharing knowledge within the team.

• 5+ years of experience in a Data Engineering role on cloud environment

• Must have good experience in Scala/PySpark (preferably on data-bricks environment)

• Extensive experience with Transact-SQL.
• Experience in Data-bricks/Spark.

• Strong experience in Dataware house projects
• Expertise in database development projects with ETL processes.
• Manage and maintain data engineering pipelines

• Develop batch processing, streaming and integration solutions
• Experienced in building and operationalizing large-scale enterprise data solutions and applications

• Using one or more of Azure data and analytics services in combination with custom solutions
• Azure Data Lake, Azure SQL DW (Synapse), and SQL Database products or equivalent products from other cloud services providers

• In-depth understanding of data management (e. g. permissions, security, and monitoring).
• Cloud repositories for e.g. Azure GitHub, Git
• Experience in an agile environment (Prefer Azure DevOps).

Good to have

• Manage source data access security
• Automate Azure Data Factory pipelines
• Continuous Integration/Continuous deployment (CICD) pipelines, Source Repositories
• Experience in implementing and maintaining CICD pipelines
• Power BI understanding, Delta Lake house architecture
• Knowledge of software development best practices.
• Excellent analytical and organization skills.
• Effective working in a team as well as working independently.
• Strong written and verbal communication skills.
• Expertise in database development projects and ETL processes.

We are looking for an outstanding ML Architect (Deployments) with expertise in deploying Machine Learning solutions/models into production and scaling them to serve millions of customers. A candidate with an adaptable and productive working style which fits in a fast-moving environment.

Skills:

- 5+ years deploying Machine Learning pipelines in large enterprise production systems.

- Experience developing end to end ML solutions from business hypothesis to deployment / understanding the entirety of the ML development life cycle.
- Expert in modern software development practices; solid experience using source control management (CI/CD).
- Proficient in designing relevant architecture / microservices to fulfil application integration, model monitoring, training / re-training, model management, model deployment, model experimentation/development, alert mechanisms.
- Experience with public cloud platforms (Azure, AWS, GCP).
- Serverless services like lambda, azure functions, and/or cloud functions.
- Orchestration services like data factory, data pipeline, and/or data flow.
- Data science workbench/managed services like azure machine learning, sagemaker, and/or AI platform.
- Data warehouse services like snowflake, redshift, bigquery, azure sql dw, AWS Redshift.
- Distributed computing services like Pyspark, EMR, Databricks.
- Data storage services like cloud storage, S3, blob, S3 Glacier.
- Data visualization tools like Power BI, Tableau, Quicksight, and/or Qlik.
- Proven experience serving up predictive algorithms and analytics through batch and real-time APIs.
- Solid working experience with software engineers, data scientists, product owners, business analysts, project managers, and business stakeholders to design the holistic solution.
- Strong technical acumen around automated testing.
- Extensive background in statistical analysis and modeling (distributions, hypothesis testing, probability theory, etc.)
- Strong hands-on experience with statistical packages and ML libraries (e.g., Python scikit learn, Spark MLlib, etc.)
- Experience in effective data exploration and visualization (e.g., Excel, Power BI, Tableau, Qlik, etc.)
- Experience in developing and debugging in one or more of the languages Java, Python.
- Ability to work in cross functional teams.
- Apply Machine Learning techniques in production including, but not limited to, neuralnets, regression, decision trees, random forests, ensembles, SVM, Bayesian models, K-Means, etc.

Roles and Responsibilities:

Deploying ML models into production, and scaling them to serve millions of customers.

Technical solutioning skills with deep understanding of technical API integrations, AI / Data Science, BigData and public cloud architectures / deployments in a SaaS environment.

Strong stakeholder relationship management skills - able to influence and manage the expectations of senior executives.
Strong networking skills with the ability to build and maintain strong relationships with both business, operations and technology teams internally and externally.

Provide software design and programming support to projects.

 Qualifications & Experience:

Engineering and post graduate candidates, preferably in Computer Science, from premier institutions with proven work experience as a Machine Learning Architect (Deployments) or a similar role for 5-7 years.