Data Engineer- Pyspark+SQL (Onsite opportunity- UAE Abu Dhabi/Dubai)

Position: DevOps Engineer / Senior DevOps Engineer

Experience: 3 to 6 Years

Key Skills: AWS, Terraform, Docker, Kubernetes, DevSecOps pipeline

Job Description:

• AWS Infrastructure: Architect, deploy, and manage AWS services like EC2, S3, RDS, Lambda, SageMaker, API Gateway, and VPC.
• Networking: Proficient in subnetting, endpoints, NACL, security groups, VPC flow logs, and routing.
• API Management: Design and manage secure, scalable APIs using AWS API Gateway.
• CI/CD Pipelines: Build and maintain CI/CD pipelines with AWS CodePipeline, CodeBuild, and CodeDeploy.
• Automation & IaC: Use Terraform and CloudFormation for automating infrastructure management.
• Containerization & Kubernetes: Expertise in Docker, Kubernetes, and managing containerized deployments.
• Monitoring & Logging: Implement monitoring with AWS CloudWatch, CloudTrail, and other tools.
• Security: Apply AWS security best practices using IAM, KMS, Secrets Manager, and GuardDuty.
• Cost Management: Monitor and optimize AWS usage and costs.
• Collaboration: Partner with development, QA, and operations teams to enhance productivity and system reliability.

Job Title: Full stack Developer

Location: Coimbatore

Job Type: Full Time

Experience Level: 5-8 Years

Key Skills required

1. Understanding of the entire Mobile Application Development lifecycle

2. Solid experience of 2 years + in building Native Swift based iOS applications

3. Excellent knowledge of iOS specific user interfaces, user experiences and guidelines

4. Working experience with MVC and MVVM architectures

5. In depth knowledge of iOS specific user experiences and human interface guidelines

6. In depth experience in implementing user interfaces for iOS - Auto Layout

7. Hands on experience working with API integration within iOS applications

8. Hands on experience working with 3rd party SDKs, Libraries and APIs

9. Experience with media streaming & playback using AV Player, AV Foundation & AV Capture

10. Experience working with analytical SDKs like Firebase Crashlytics, Branch.io etc

11. Experience with Push Messaging, Local Notifications, Background services

12. Experience in debugging errors and crashes using tools such as Crashlytics or Sentry

13. Experience with Marketing and Attribution SDKs such as Clevertap, Branch and/or Appsflyer

14. Experience in releasing applications to the Apple App Store

15. Ability to work in an Agile environment

16. An inclination towards cross platform technologies such as React Native

Position Description

We are looking for a highly motivated, hands-on Sr. Database/Data Warehouse Data Analytics developer to work at our Bangalore, India location. Ideal candidate will have solid software technology background with capability in the making and supporting of robust, secure, and multi-platform financial applications to contribute to Fully Paid Lending (FPL) project. The successful candidate will be a proficient and productive developer, a team leader, have good communication skills, and demonstrate ownership.

Responsibilities

• Produce service metrics, analyze trends, and identify opportunities to improve the level of service and reduce cost as appropriate.
• Responsible for design, development and maintenance of database schema and objects throughout the lifecycle of the applications.
• Supporting implemented solutions by monitoring and tuning queries and data loads, addressing user questions concerning data integrity, monitoring performance, and communicating functional and technical issues.
• Helping the team by taking care of production releases.
• Troubleshoot data issues and work with data providers for resolution.
• Closely work with business and applications teams in implementing the right design and solution for the business applications.
• Build reporting solutions for WM Risk Applications.
• Work as part of a banking Agile Squad / Fleet.
• Perform proof of concepts in new areas of development.
• Support continuous improvement of automated systems.
• Participate in all aspects of SDLC (analysis, design, coding, testing and implementation).

Required Skill

• 5 to 7 Years of strong database (SQL) Knowledge, ETL (Informatica PowerCenter), Unix Shell Scripting.
• Database (preferably Teradata) knowledge, database design, performance tuning, writing complex DB programs etc.
• Demonstrate proficient skills in analysis and resolution of application performance problems.
• Database fundamentals; relational and Datawarehouse concepts.
• Should be able to lead a team of 2-3 members and guide them in their day to work technically and functionally.
• Ensure designs, code and processes are optimized for performance, scalability, security, reliability, and maintainability.
• Understanding of requirements of large enterprise applications (security, entitlements, etc.)
• Provide technical leadership throughout the design process and guidance with regards to practices, procedures, and techniques. Serve as a guide and mentor for junior level Software Development Engineers
• Exposure to JIRA or other ALM tools to create a productive, high-quality development environment.
• Proven experience in working within an Agile framework.
• Strong problem-solving skills and the ability to produce high quality work independently and work well in a team.
• Excellent communication skills (written, interpersonal, presentation), with the ability to easily and effectively interact and negotiate with business stakeholders.
• Ability and strong desire to learn new languages, frameworks, tools, and platforms quickly.
• Growth mindset, personal excellence, collaborative spirit
• 
  

Good to have skills.

• Prior work experience with Azure or other cloud platforms such as Google Cloud, AWS, etc.
• Exposure to programming languages python/R/ java and experience with implementing Data analytics projects.
• Experience in Git and development workflows.
• Prior experience in Banking and Financial domain.
• Exposure to security-based lending is a plus.
• Experience with Reporting/BI Tools is a plus.

• NLP 

• ML programming
• Spark
• Model Deployment
• Experience processing unstructured data and building NLP models
• Experience with big data tools pyspark
• Pipeline orchestration using Airflow and model deployment experience is preferred

• KSQL
• Data Engineering spectrum (Java/Spark)
• Spark Scala / Kafka Streaming
• Confluent Kafka components
• Basic understanding of Hadoop

Essential Duties and Responsibilities:

• Execute full lifecycle software development
• Develop, designed well efficient code
• Integrate software components into a fully functional software system
• Fully adaptive to the technology needed for the current project

Requirements:

• Minimum 8 year of strong demonstrated knowledge in PHP, Mysql, Mongodb, Jquery, SASS
• Algorithms, data structure.
• Object-oriented programming.
• AWS/Server experience to handle production machines is a plus.
• Team Management mandatory
• Experience on PHP, PHP Frameworks, Ajax, Knowledge on CMS platform like Opencart, payment gateway integration, experience working on portals.
• Familiarity with software development methodology and release processes.
• Strong problem-solving skills and excellent communication skills
• Product based company preferable
• Startup experience preferable