Scala Developer

Role: DevOps Engineer

Exp: 4 - 7 Years

CTC: up to 28 LPA

Key Responsibilities

•   Design, build, and manage scalable infrastructure on cloud platforms (GCP, AWS, Azure, or OCI)

•   Administer and optimize Kubernetes clusters and container runtimes (Docker, containerd)

•   Develop and maintain CI/CD pipelines for multiple services and environments

•   Manage infrastructure as code using tools like Terraform and/or Pulumi

•   Automate operations with Python and shell scripting for deployment, monitoring, and maintenance

•   Ensure high availability and performance of production systems and troubleshoot incidents effectively

•   Monitor system metrics and implement observability best practices using tools like Prometheus, Grafana, ELK, etc.

•   Collaborate with development, security, and product teams to align infrastructure with business needs

•   Apply best practices in cloud networking, Linux administration, and configuration management

•   Support compliance and security audits; assist with implementation of cloud security measures (e.g., firewalls, IDS/IPS, IAM hardening)

•   Participate in on-call rotations and incident response activities

The Sr. Analytics Engineer would provide technical expertise in needs identification, data modeling, data movement, and transformation mapping (source to target), automation and testing strategies, translating business needs into technical solutions with adherence to established data guidelines and approaches from a business unit or project perspective.

Understands and leverages best-fit technologies (e.g., traditional star schema structures, cloud, Hadoop, NoSQL, etc.) and approaches to address business and environmental challenges.

Provides data understanding and coordinates data-related activities with other data management groups such as master data management, data governance, and metadata management.

Actively participates with other consultants in problem-solving and approach development.

Responsibilities :

Provide a consultative approach with business users, asking questions to understand the business need and deriving the data flow, conceptual, logical, and physical data models based on those needs.

Perform data analysis to validate data models and to confirm the ability to meet business needs.

Assist with and support setting the data architecture direction, ensuring data architecture deliverables are developed, ensuring compliance to standards and guidelines, implementing the data architecture, and supporting technical developers at a project or business unit level.

Coordinate and consult with the Data Architect, project manager, client business staff, client technical staff and project developers in data architecture best practices and anything else that is data related at the project or business unit levels.

Work closely with Business Analysts and Solution Architects to design the data model satisfying the business needs and adhering to Enterprise Architecture.

Coordinate with Data Architects, Program Managers and participate in recurring meetings.

Help and mentor team members to understand the data model and subject areas.

Ensure that the team adheres to best practices and guidelines.

Requirements :

- Strong working knowledge of at least 3 years of Spark, Java/Scala/Pyspark, Kafka, Git, Unix / Linux, and ETL pipeline designing.

- Experience with Spark optimization/tuning/resource allocations

- Excellent understanding of IN memory distributed computing frameworks like Spark and its parameter tuning, writing optimized workflow sequences.

- Experience of relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., Redshift, Bigquery, Cassandra, etc).

- Familiarity with Docker, Kubernetes, Azure Data Lake/Blob storage, AWS S3, Google Cloud storage, etc.

- Have a deep understanding of the various stacks and components of the Big Data ecosystem.

- Hands-on experience with Python is a huge plus

Roles & Responsibilities:

• Build a high-quality web application from scratch.
• Responsive and adaptive web page implementation.
• Identify and communicate best practices for back-end engineering.
• Design, build and maintain efficient, reusable, and reliable code to ensure the applications' best possible performance, quality, and responsiveness.
• Implement automated testing platforms and unit tests.
• Prepare and maintain all applications utilizing standard development tools.
• Keep abreast of new trends and best practices in web development.
• Learn new Software/frameworks/ languages/ technology with ease.
• Must be able to apply innovative thinking at work.

Desired Skills:

• Good working knowledge of PHP-based MVC framework Laravel.
• Good knowledge of PHP, HTML, CSS & Javascript and understanding of Database concepts & working knowledge of MySQL.
• A clear understanding of RESTful API development standards.
• Excellent problem-solving skills.
• Software testing (PHPUnit, PHPSpec)

EXP-Developer-4 to 12 years

         Must have low-level design and development skills.  Should able to design a solution for given use cases. 

• Agile delivery-  Person must able to show design and code on a daily basis
• Must be an experienced PySpark developer and  Scala coding.   Primary skill is PySpark
• Must have experience in designing job orchestration, sequence, metadata design, Audit trail, dynamic parameter passing and error/exception handling
• Good experience with unit, integration and UAT support
• Able to design and code reusable components and functions
• Should able to review design, code & provide review comments with justification
• Zeal to learn new tool/technologies and adoption
• Good to have experience with Devops and CICD

Basic Qualifications

• Solid knowledge of algorithms/data structures is a must
• Strong Java software development experience – with a focus on Java 8 & 9
• Experience with NoSql databases – ideally with MongoDB
• Experience implementing REST apis – ideally with JAX-RS
• Experience with Reactive Programming – ideally with RxJava
• Experience implementing unit tests

Preferred Qualifications

• Experience developing applications in fintech or established financial institutions
• Experience with microservice architectures
• Experience developing systems that can scale to large amounts of data
• Experience working in Agile Scrum
• Experience working on a globally distributed team

- Working on Architecture and Standards team to validate designs and standards.

- Perform coding, bug verification, unit testing, and integration testing.