Data Engineer

Hiring alert 🚨

Calling all #PythonDevelopers looking for an #ExcitingJobOpportunity 🚀 with one of our #Insurtech clients.

Are you a Junior Python Developer eager to grow your skills in #BackEnd development?

Our company is looking for someone like you to join our dynamic team. If you're passionate about Python and ready to learn from seasoned developers, this role is for you!

📣 About the company

The client is a fast-growing consultancy firm, helping P&C Insurance companies on their digital journey. With offices in Mumbai and New York, they're at the forefront of insurance tech. Plus, they offer a hybrid work culture with flexible timings, typically between 9 to 5, to accommodate your work-life balance.

💡 What you’ll do

📌 Work with other developers.

📌 Implement Python code with assistance from senior developers.

📌 Write effective test cases such as unit tests to ensure it is meeting the software design requirements.

📌 Ensure Python code when executed is efficient and well written.

📌 Refactor old Python code to ensure it follows modern principles.

📌 Liaise with stakeholders to understand the requirements.

📌 Ensure integration can take place with front end systems.

📌 Identify and fix code where bugs have been identified.

🔎 What you’ll need

📌 Minimum 3 years of experience writing AWS Lambda using Python

📌 Knowledge of other AWS services like CloudWatch and API Gateway

📌 Fundamental understanding of Python and its frameworks.

📌 Ability to write simple SQL queries

📌 Familiarity with AWS Lambda deployment

📌 The ability to problem-solve.

📌 Fast learner with an ability to adapt techniques based on requirements.

📌 Knowledge of how to effectively test Python code.

📌 Great communication and collaboration skills.

This profile will include the following responsibilities:

- Develop Parsers for XML and JSON Data sources/feeds

- Write Automation Scripts for product development

- Build API Integrations for 3^rd Party product integration

- Perform Data Analysis

- Research on Machine learning algorithms

- Understand AWS cloud architecture and work with 3 party vendors for deployments

Responsibilities

1. Create data funnels to feed into models via web, structured and unstructured data
2. Maintain coding standards using  SDLC, Git, AWS deployments etc
3. Keep abreast of developments in the field
4. Deploy models in production and monitor them
5. Documentations of processes and logic
6. Take ownership of the solution from code to deployment and performance

Operates in over 25 countries across six continents and is part of Publicis Media, one of four solution hubs within Publicis Groupe, which is present in over 100 countries and employs nearly 80,000 professionals.

We  believe there are better ways for brands to connect with people. And we’re on a mission to guide brands to better connections -- across consumers, channels and partners. These are just some of the services we offer our clients in our quest to deliver ambitious outcomes.

Skills Required:

• Servlet and JSP development
• CSS, JavaScript, HTML
• AJAX, jQuery, EXTJS
• OSGi/FELIX
• Web services creation and consumption
• CMS development experience
• Java Content Repository (JCR)/CRX
• Eclipse IDE
• Maven
• SVN
• Jenkins
• Artifactory
• Apache Sling
• Lucene
• Tomcat/JBoss
• Apache Web Server

Role Description:

• You will be part of the data delivery team and will have the opportunity to develop a deep understanding of the domain/function.
• You will design and drive the work plan for the optimization/automation and standardization of the processes incorporating best practices to achieve efficiency gains.
• You will run data engineering pipelines, link raw client data with data model, conduct data assessment, perform data quality checks, and transform data using ETL tools.
• You will perform data transformations, modeling, and validation activities, as well as configure applications to the client context. You will also develop scripts to validate, transform, and load raw data using programming languages such as Python and / or PySpark.
• In this role, you will determine database structural requirements by analyzing client operations, applications, and programming.
• You will develop cross-site relationships to enhance idea generation, and manage stakeholders.
• Lastly, you will collaborate with the team to support ongoing business processes by delivering high-quality end products on-time and perform quality checks wherever required.

1. Proven experience with deploying and tuning Open Source components into enterprise ready production tooling Experience with datacentre (Metal as a Service – MAAS) and cloud deployment technologies (AWS or GCP Architect certificates required)
2. Deep understanding of Linux from kernel mechanisms through user space management
3. Experience on CI/CD (Continuous Integrations and Deployment) system solutions (Jenkins).
4. Using Monitoring tools (local and on public cloud platforms) Nagios, Prometheus, Sensu, ELK, Cloud Watch, Splunk, New Relic etc. to trigger instant alerts, reports and dashboards.  Work closely with the development and infrastructure teams to analyze and design solutions with four nines (99.99%) up-time, globally distributed, clustered, production and non-production virtualized infrastructure. 
5. Wide understanding of IP networking as well as data centre infrastructure

1. Expert with software development tools and sourcecode management, understanding, managing issues, code changes and grouping them into deployment releases in a stable and measurable way to maximize production Must be expert at developing and using ansible roles and configuring deployment templates with jinja2.
2. Solid understanding of data collection tools like Flume, Filebeat, Metricbeat, JMX Exporter agents.
3. Extensive experience operating and tuning the kafka streaming data platform, specifically as a message queue for big data processing
4. Strong understanding and must have experience:
5. Apache spark framework, specifically spark core and spark streaming, 
6. Orchestration platforms, mesos and kubernetes, 
7. Data storage platforms, elasticstack, carbon, clickhouse, cassandra, ceph, hdfs
8. Core presentation technologies kibana, and grafana.
9. Excellent scripting and programming skills (bash, python, java, go, rust). Must have previous experience with “rust” in order to support, improve in house developed products

Red Hat Certified Architect certificate or equivalent required CCNA certificate required 3-5 years of experience running open source big data platforms

• Research and test novel machine learning approaches for analysing large-scale distributed computing applications.
• Develop production-ready implementations of proposed solutions across different models AI and ML algorithms, including testing on live customer data to improve accuracy,  efficacy, and robustness
• Work closely with other functional teams to integrate implemented systems into the SaaS platform
• Suggest innovative and creative concepts and ideas that would improve the overall platform

‍

The ideal candidate must have the following qualifications:

• 5 + years experience in practical implementation and deployment of large customer-facing ML based systems.
• MS or M Tech (preferred) in applied mathematics/statistics;  CS or Engineering disciplines are acceptable but must have with strong quantitative and applied mathematical skills
• In-depth working, beyond coursework, familiarity with classical and current ML techniques, both supervised and unsupervised learning techniques and algorithms
• Implementation experiences and deep knowledge of Classification, Time Series Analysis, Pattern Recognition, Reinforcement Learning, Deep Learning, Dynamic Programming and Optimization
• Experience in working on modeling graph structures related to spatiotemporal systems
• Programming skills in Python is a must
• Experience in developing and deploying on cloud (AWS or Google or Azure)
• Good verbal and written communication skills
• Familiarity with well-known ML frameworks such as Pandas, Keras, TensorFlow

Most importantly, you should be someone who is passionate about building new and innovative products that solve tough real-world problems.

Chennai, India