Backend Developer

Profile: AWS Data Engineer

Mode- Hybrid

Experience- 5+7 years

Locations - Bengaluru, Pune, Chennai, Mumbai, Gurugram

Roles and Responsibilities

• Design and maintain ETL pipelines using AWS Glue and Python/PySpark
• Optimize SQL queries for Redshift and Athena
• Develop Lambda functions for serverless data processing
• Configure AWS DMS for database migration and replication
• Implement infrastructure as code with CloudFormation
• Build optimized data models for performance
• Manage RDS databases and AWS service integrations
• Troubleshoot and improve data processing efficiency
• Gather requirements from business stakeholders
• Implement data quality checks and validation
• Document data pipelines and architecture
• Monitor workflows and implement alerting
• Keep current with AWS services and best practices

Required Technical Expertise:

• Python/PySpark for data processing
• AWS Glue for ETL operations
• Redshift and Athena for data querying
• AWS Lambda and serverless architecture
• AWS DMS and RDS management
• CloudFormation for infrastructure
• SQL optimization and performance tuning

As an engineer, you will help with the implementation, and launch of many key product features. You will get an opportunity to work on a wide range of technologies (including Spring, AWS Elastic Search, Lambda, ECS, Redis, Spark, Kafka etc.) and apply new technologies for solving problems. You will have an influence on defining product features, drive operational excellence, and spearhead the best practices that enable a quality product. You will get to work with skilled and motivated engineers who are already contributing to building high-scale and high-available systems.

If you are looking for an opportunity to work on leading technologies and would like to build product technology that can cater millions of customers inclined towards providing them the best experience, and relish large ownership and diverse technologies, join our team today!

What You'll Do:

• Creating detailed design, working on development and performing code reviews.
• Implementing validation and support activities in line with architecture requirements
• Help the team translate the business requirements into R&D tasks and manage the roadmap of the R&D tasks.
• Designing, building, and implementation of the product; participating in requirements elicitation, validation of architecture, creation and review of high and low level design, assigning and reviewing tasks for product implementation.
• Work closely with product managers, UX designers and end users and integrating software components into a fully functional system
• Ownership of product/feature end-to-end for all phases from the development to the production.
• Ensuring the developed features are scalable and highly available with no quality concerns.
• Work closely with senior engineers for refining the and implementation.
• Management and execution against project plans and delivery commitments.
• Assist directly and indirectly in the continual hiring and development of technical talent.
• Create and execute appropriate quality plans, project plans, test strategies and processes for development activities in concert with business and project management efforts.

The ideal candidate is a passionate engineer about delivering experiences that delight customers and creating solutions that are robust. He/she should be able to commit and own the deliveries end-to-end.

What You'll Need:

• A Bachelor's degree in Computer Science or related technical discipline.
• 2-3+ years of Software Development experience with proficiency in Java or equivalent object-oriented languages, coupled with design and SOA
• Fluency with Java, and Spring is good.
• Experience in JEE applications and frameworks like struts, spring, mybatis, maven, gradle
• Strong knowledge of Data Structures, Algorithms and CS fundamentals.
• Experience in at least one shell scripting language, SQL, SQL Server, PostgreSQL and data modeling skills
• Excellent analytical and reasoning skills
• Ability to learn new domains and deliver output
• Hands on Experience with the core AWS services
• Experience working with CI/CD tools (Jenkins, Spinnaker, Nexus, GitLab, TeamCity, GoCD, etc.)

• Expertise in at least one of the following:

    - Kafka, ZeroMQ, AWS SNS/SQS, or equivalent streaming technology

    - Distributed cache/in memory data grids like Redis, Hazelcast, Ignite, or Memcached

    - Distributed column store databases like Snowflake, Cassandra, or HBase

    - Spark, Flink, Beam, or equivalent streaming data processing frameworks

• Proficient with writing and reviewing Python and other object-oriented language(s) are a plus
• Experience building automations and CICD pipelines (integration, testing, deployment)
• Experience with Kubernetes would be a plus.
• Good understanding of working with distributed teams using Agile: Scrum, Kanban
• Strong interpersonal skills as well as excellent written and verbal communication skills

• Attention to detail and quality, and the ability to work well in and across teams

Role & Responsibilities :

- Individuals are responsible for all traditional development activities analysis, design, coding, testing, and documentation.

- Add new features to existing Windows and Web-based applications in Visual Studio 2019. Interacting with internal team.

- Transform business and design needs into innovative products.

- Drive all projects to completion within deadlines.

- Perform thorough testing to find issues ahead of time.

- Engineering software needs more precise analysis & coding skillset.

- Enhance skillset by working with fortune 500 clients.

- Interacting with internal team.

Qualifications :

- B.E in computer science or related fields.

- Excellent programming & communication skills Strong problem solving, judgmental, and decision-making skills.

- Ability to work at the tactical and strategic levels of IT initiatives.

- Impressive hands-on experience in Java, database(Oracle), OOPS, Java Swing, Javafx

- Self-Motivated, flexible & Innovative.

Required Skills:

• 3+ year of experience in Development in JAVA technology.
• Strong Java Basics
• SpringBoot or Spring MVC
• Hands on experience on Relational Databases (SQL query or Hibernate) + Mongo (JSON parsing)
• Proficient in REST API development
• Messaging Queue (RabitMQ or Kafka)
• Microservices
• Any Caching Mechanism
• Good at problem solving

Good to Have Skills:

• 4+ years of experience in using Java/J2EE tech stacks
• Good understanding of data structures and algorithms.
• Excellent analytical and problem solving skills.
• Ability to work in a fast paced internet start-up environment.
• Experience in technical mentorship/coaching is highly desirable.
• Understanding of AI/ML algorithms is a plus.

Responsibilities for Staff Engineer role:

• Having experience in Java/Python/Golang along with Springboot, Micorservices, RDBMS
• Experience required: 10yrs to 15 yrs.

Here a video that explains our product journey:

https://www.loom.com/share/ccd0ed9e7bc349d7bba851d762253c21">https://www.loom.com/share/ccd0ed9e7bc349d7bba851d762253c21

This is fully a remote role, but the employer needs to fly down to the office in Kolkata for 5–6 days every month. Plane tickets and accommodation will be reimbursed by the company.