Spark Scala Developer

Location: Pune

Required Skills : Scala, Python, Data Engineering, AWS, Cassandra/AstraDB, Athena, EMR, Spark/Snowflake

The Sr. Analytics Engineer would provide technical expertise in needs identification, data modeling, data movement, and transformation mapping (source to target), automation and testing strategies, translating business needs into technical solutions with adherence to established data guidelines and approaches from a business unit or project perspective.

Understands and leverages best-fit technologies (e.g., traditional star schema structures, cloud, Hadoop, NoSQL, etc.) and approaches to address business and environmental challenges.

Provides data understanding and coordinates data-related activities with other data management groups such as master data management, data governance, and metadata management.

Actively participates with other consultants in problem-solving and approach development.

Responsibilities :

Provide a consultative approach with business users, asking questions to understand the business need and deriving the data flow, conceptual, logical, and physical data models based on those needs.

Perform data analysis to validate data models and to confirm the ability to meet business needs.

Assist with and support setting the data architecture direction, ensuring data architecture deliverables are developed, ensuring compliance to standards and guidelines, implementing the data architecture, and supporting technical developers at a project or business unit level.

Coordinate and consult with the Data Architect, project manager, client business staff, client technical staff and project developers in data architecture best practices and anything else that is data related at the project or business unit levels.

Work closely with Business Analysts and Solution Architects to design the data model satisfying the business needs and adhering to Enterprise Architecture.

Coordinate with Data Architects, Program Managers and participate in recurring meetings.

Help and mentor team members to understand the data model and subject areas.

Ensure that the team adheres to best practices and guidelines.

Requirements :

- Strong working knowledge of at least 3 years of Spark, Java/Scala/Pyspark, Kafka, Git, Unix / Linux, and ETL pipeline designing.

- Experience with Spark optimization/tuning/resource allocations

- Excellent understanding of IN memory distributed computing frameworks like Spark and its parameter tuning, writing optimized workflow sequences.

- Experience of relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., Redshift, Bigquery, Cassandra, etc).

- Familiarity with Docker, Kubernetes, Azure Data Lake/Blob storage, AWS S3, Google Cloud storage, etc.

- Have a deep understanding of the various stacks and components of the Big Data ecosystem.

- Hands-on experience with Python is a huge plus

• As a polyglot developer Ideally, you should have:
• 1.5+ years of development experience using any of technology java, scala, python or any similar exciting technologies.
• Hands-on experience in coding, and implementation of complex, custom-built applications Working knowledge of build tool like maven/sbt and code versioning systems like git/bitbucket/cvs/svn
• Familiarity with few databases, like MySQL, Oracle, PostgreSQL, SQL Server, NoSQL etc Great OO skills, including strong design patterns knowledge
• Good communication and ability to work in a consulting environment is essential

• Think through hard problems in a consultancy environment, and work with amazing people to make the solutions a reality Work in a dynamic, collaborative, non-hierarchical environment where your talent is valued over your job title or years of experience
• Build custom software using the latest technologies and tools Craft your own career path

• Providing solution to real problems in Bigdata world.
• RnD on using the latest tools,techniques and cloud services.
• Automating the manual-timetaking tasks.
• Hands-on coding, usually in a pair programming environment.
• Working in highly collaborative teams and building quality code
• Working in lots of different domains and client environments
• Understanding the business domain deeply

We are on a quest to find a Senior Software Developer - Scala with several years of experience who will help us in extending and maintaining our platform

 You will join a cross functional team with different nationalities, backgrounds and experience levels. The agile team is co-located including the Product Managers

You will collaborate with all team members in order to deliver the best solutions that enhance our platform

About Springer Nature India Pvt. Ltd:

 Springer Nature opens the doors to discovery for researchers, educators, clinicians and other professionals. Every day, around the globe, our imprints, books, journals, platforms and technology solutions reach millions of people. For over 175 years our brands and imprints have been a trusted source of knowledge to these communities and today, more than ever, we see it as our responsibility to ensure that fundamental knowledge can be found, verified, understood and used by our communities – enabling them to improve outcomes, make progress, and benefit the generations that follow.

Visit: http://group.springernature.com">group.springernature.com and follow @SpringerNature

If you are still wondering, why should you work with us. Here are 5 reasons why?

1. Springer Nature is one of the world's largest publishing company. Nobel laureates publish their research at Springer.
2. We are truly a digital organization and Springer Nature Pune is at the helm of this digitization.
3. We not only believe but preach providing good work life balance to our employees.
4. We are investing in building our products using machine learning and NLP.
5. We work in latest technologies like AWS and Scala.

About the team:

Backend - Adis – PV is a scientific analysis platform being built for extracting content from scientific articles and providing meaningful insights

Insights are then published in a structured way, so that they can be made accessible to end users, via feeds delivery or through the platform

Backend - Adis – PV will be a production system for all databases under one IT landscape and under one umbrella.

Job Type: Permanent    
                                   

Job Location: Magarpatta City, Pune - India  (Work from home until further notice)

Years of Experience 6 to 10 years

What we are looking for

Educational Qualification:

B.Sc., BCA, BCS, B.E., B.Tech, M.Tech, MCA and M.Sc.

Skill Matrix:

Primary Language Skills: Java 8, Scala

Framework: Play Framework

Messaging: Rabbit MQ

Ideologies: TDD / ATDD, Pair Programming

Database: SQL and NoSQL

Challenges

• You will help us continuously improving our platform
• Together we will create best in class services that support the needs of our customers
• Taking part of team ceremonies like grooming, planning and retrospective
• Develop new features
• Improve code quality by doing pair programming or code reviews
• Continuously improve and monitor our product
  
  

Key Responsibilities

• Own and consistently deliver high quality end-to-end product features keeping in view technical & business expectations
• Add meaty features to the product which will deliver substantial business value
• Pioneer clean coding and continuous code refactoring
• Understands and appreciates existing design and architecture of the product
• Understands pros and cons of various technology options available
• Takes technical ownership of some of sub-systems of the product
• Makes changes in the product designs to achieve required business value / mileage
• Identify and addresses technical debts
• Understands technical vision and road-map of the product and expectations
• Understands purview of key pieces of deliverables and own few of these pieces

Day at work

• Pioneer proof of concepts of new technologies keeping in view product road-map and business priorities
• Self-study and share his / her learning within the team and across teams
• Provide required help to other team-members
• Pioneer in various team events and work towards objectives of these events
• Make meaningful suggestions to make ceremonies more effective
  
  

About You

• You have several years of experience with Software Development
• You have worked successfully with product teams in the past and ideally have some experience with mentoring junior developers
• You like working in a collaborative environment where there is collective ownership of the code
• You work in a Continuous Integration and always strive for Continuous Delivery
• You like to share and enable others to increase your whole team's performance