Spark Scala Developer

Job Description

We are seeking a highly skilled and experienced Backend Engineer to join our dynamic and fast-paced development team in Bangalore. The ideal candidate will have expertise in Java development, particularly in Java 8 or above, and extensive hands-on experience with Apache Spark, Spark Streaming, and Spring Boot for developing scalable and high-performance microservices. The candidate must also have strong problem-solving skills, a deep understanding of distributed computing, and experience with cloud technologies (Azure).

Key Responsibilities

• Design, develop, and maintain highly scalable microservices and optimized RESTful APIs using Spring Boot in Java 8 or above.
• Write efficient and maintainable Spark and Spark Streaming code for processing large-scale data in real-time.
• Implement Java 8 advanced features such as Functional Interfaces, Lambda Expressions, Streams, Parallel Streams, Completable Futures, and Concurrency API improvements.
• Work with relational (SQL) and non-relational (Cosmos DB) databases for data modeling and optimization.
• Utilize Maven for building and deploying artifacts to the snapshot repository.
• Collaborate with cross-functional teams, including Product, Business, Automation, and other stakeholders, to define, design, and deliver new features.
• Follow Agile SCRUM methodologies for software development and actively participate in sprint planning and retrospective meetings.
• Maintain version control using Git and ensure best practices for code collaboration and peer code reviews.
• Implement CI/CD pipelines using tools such as Jenkins and GitHub Actions to automate build and deployment processes.
• Work with Azure Cloud Technologies to build and deploy cloud-based applications.
• Apply software design patterns and best practices in backend development to enhance system architecture and scalability.
• Troubleshoot and debug applications, ensuring high performance, security, and scalability.
• Keep up to date with the latest industry trends, tools, and technologies to continuously improve development processes.

Minimum Qualifications

• BS/MS in Computer Science or equivalent.
• 4+ years of industry experience in developing highly scalable microservices and optimized RESTful APIs using Spring Boot in Java 8 or above.
• 3+ years of experience in version control tools like Git.
• 3+ years of experience working in an Agile SCRUM environment.
• Strong understanding of software design patterns and distributed computing concepts.
• Solid experience in relational and non-relational databases (SQL and Cosmos DB).
• Experience with Maven for building and managing dependencies.
• Knowledge of CI/CD workflows and experience with Jenkins and GitHub Actions.
• Prior enterprise experience in working with Azure Cloud Technologies.
• Proven ability to work collaboratively with cross-functional teams to deliver high-quality product features.
• Strong problem-solving skills, debugging techniques, and ability to troubleshoot complex issues efficiently.

Preferred Qualifications

• Experience with Kafka or other messaging queues for real-time data processing.
• Exposure to Docker, Kubernetes, and container orchestration tools.
• Hands-on experience with NoSQL databases like MongoDB, Cassandra, or DynamoDB.
• Experience with performance optimization techniques for backend applications.
• Knowledge of test-driven development (TDD) and unit testing frameworks like JUnit.

Roles & Responsibilities:

• 6+ Yrs. of development experience on Scala, Elastic Search and Mongo DB

• Should have experience of working on Responsive and high availability web platforms

• Knowledge on some of the key tech stack like Elastic Search, MongoDB, Play framework, Akka Framework and Java is a must.

• Deep insight into Rest API development • Should be up to date with industry best practices for API development using Scala

• Good team handling skills

• Good development and logical skills • Hands-on experience + Guiding Junior Scala Developers

• Good analytical skills

• Able to learn new technologies on the fly based on requirement

• Able to help the team members as and when needed to improve team capability 

• Bachelor's or Master’s degree in Computer Science or equivalent area
• 10 to 20 years of experience in software development
• Hands-on experience designing and building B2B or B2C products
• 3+ years architecting SaaS/Web based customer facing products, leading engineering teams as software/technical architect
• Experiences of engineering practices such as code refactoring, microservices, design and enterprise integration patterns, test and design-driven development, continuous integration, building highly scalable applications, application and infrastructure security
• Strong cloud infrastructure experience with AWS and/or Azure
• Experience building event driven systems and working with message queues/topics
• Broad working experience across multiple programming languages and frameworks with in-depth experience in one or more of the following: .Net, Java, Scala or Go-lang
• Hands-on experience with relational databases like SQL Server, PostgreSQL and document stores like Elasticsearch or MongoDB
• Hands-on experience with Big Data processing technologies like Hadoop/Spark is a plus
• Hands-on experience with container technologies like Docker, Kubernetes
• Knowledge of Agile software development process

Role- Software Development Engineer-2

As a Software Development Engineer at Amazon, you have industry-leading technical abilities and demonstrate breadth and depth of knowledge. You build software to deliver business impact, making smart technology choices. You work in a team and drive things forward.

Top Skills

You write high quality, maintainable, and robust code, often in Java or C++ or C#

You recognize and adopt best practices in software engineering: design, testing, version control, documentation, build, deployment, and operations.

You have experience building scalable software systems that are high-performance, highly-available, highly transactional, low latency and massively distributed.

Roles & Responsibilities

You solve problems at their root, stepping back to understand the broader context.

You develop pragmatic solutions and build flexible systems that balance engineering complexity and timely delivery, creating business impact.

You understand a broad range of data structures and algorithms and apply them to deliver high-performing applications.

You recognize and use design patterns to solve business problems.

You understand how operating systems work, perform and scale.

You continually align your work with Amazon’s business objectives and seek to deliver business value.

You collaborate to ensure that decisions are based on the merit of the proposal, not the proposer.

You proactively support knowledge-sharing and build good working relationships within the team and with others in Amazon.

You communicate clearly with your team and with other groups and listen effectively.

Skills & Experience

Bachelors or Masters in Computer Science or relevant technical field.

Experience in software development and full product life-cycle.

Excellent programming skills in any object-oriented programming languages - preferably Java, C/C++/C#, Perl, Python, or Ruby.

Strong knowledge of data structures, algorithms, and designing for performance, scalability, and availability.

Proficiency in SQL and data modeling.

Roles and responsibilities

• • Develop well-designed, performant and scalable microservices
  • Write reusable, testable, and efficient code that follow software development best practices
  • Integrate data storage solutions including databases, key-value stores, blob stores, etc.
  • Expose business functionality to frontend/mobile applications and partner systems through secure and scalable APIs.
  • Build integrations with 3rd party applications through apis’ to ingest and process data
  • Ensure security and data protection aspects within the applications
  • Contribute to devops by building CD/CI pipelines to automate releases
  • Ensure high performance and availability of distributed systems and applications
  • Interact directly with client project team members and operational staff to support live customer deployments and production issues.

• 4+ years of experience in developing applications using Scala and related technologies.
• Thorough understanding of multithreading concepts and async execution using Actor model.
• Thorough understanding of Play framework, GraphQL and GRPC technologies.
• Experience in using DAL and ORM (Object Relational Mapper) libraries for data access.
• Experiencing in developing and hosting APIs and integration with external applications.
• Experience in building data models and repositories using relational and NoSql databases.
• Knowledge of JIRA, Bitbucket and agile methodologies.
• Good to have knowledge of AWS services like Lambda, dynamodb, kinesis and others.
• Understanding of fundamental design principles behind a scalable application.
• Familiarity with event-driven programming and distributed architectures.
• Strong unit test and debugging skills
• Affinity for learning and applying new technologies and solving new problems
• Effective organizational skills with strong attention to detail
• Experience in working with docker is a plus
• Comfortable in working with Unix/Linux environment
• Strong communication skills — both written and verbal

JD:

Your role will include:

• Writing and testing your code, innovating and contributing towards increasing the value delivered by your team.
• Setting a high bar through your design, development, analysis and deployment activities
• Understanding and participating in evolving the architecture of our products.
• Keeping up-to-date with new technologies, best practices, and work on optimizing the tooling and automation.
• Understanding the latest development and engineering paradigms like Scrum/Agile/TDD/BDD/DDD etc.

You have experience with the following:

• Strong experience of leading and being part of technical teams preferably following agile methodology.
• Strong technical background with ability to provide technical guidance to other team members.
• Knowledge of microservices and must have experience of implementing a few microservices by the least.
• Knowledge of API driven platform development & Software Integration.
• You have hands-on experience in building secure, high-performing and scalable systems in Java.
• Exposure to JVM based languages like Java, Scala, Clojure.

Data Platform engineering at Uber is looking for a strong Technical Lead (Level 5a Engineer) who has built high quality platforms and services that can operate at scale. 5a Engineer at Uber exhibits following qualities: 

• Demonstrate tech expertise › Demonstrate technical skills to go very deep or broad in solving classes of problems or creating broadly leverageable solutions. 
• Execute large scale projects › Define, plan and execute complex and impactful projects. You communicate the vision to peers and stakeholders.
• Collaborate across teams › Domain resource to engineers outside your team and help them leverage the right solutions. Facilitate technical discussions and drive to a consensus.
• Coach engineers › Coach and mentor less experienced engineers and deeply invest in their learning and success. You give and solicit feedback, both positive and negative, to others you work with to help improve the entire team.
• Tech leadership › Lead the effort to define the best practices in your immediate team, and help the broader organization establish better technical or business processes.

What You’ll Do

• Build a scalable, reliable, operable and performant data analytics platform for Uber’s engineers, data scientists, products and operations teams.
• Work alongside the pioneers of big data systems such as Hive, Yarn, Spark, Presto, Kafka, Flink to build out a highly reliable, performant, easy to use software system for Uber’s planet scale of data. 
• Become proficient of multi-tenancy, resource isolation, abuse prevention, self-serve debuggability aspects of a high performant, large scale, service while building these capabilities for Uber's engineers and operation folks.

What You’ll Need

• 7+ years experience in building large scale products, distributed systems in a high caliber environment.
• Architecture: Identify and solve major architectural problems by going deep in your field or broad across different teams. Extend, improve, or, when needed, build solutions to address architectural gaps or technical debt.
• Software Engineering/Programming: Create frameworks and abstractions that are reliable and reusable. advanced knowledge of at least one programming language, and are happy to learn more. Our core languages are Java, Python, Go, and Scala.
• Platform Engineering: Solid understanding of distributed systems and operating systems fundamentals such as concurrency, multithreading, file systems, locking etc.
• Execution & Results: You tackle large technical projects/problems that are not clearly defined. You anticipate roadblocks and have strategies to de-risk timelines. You orchestrate work that spans multiple teams and keep your stakeholders informed.
• A team player: You believe that you can achieve more on a team that the whole is greater than the sum of its parts. You rely on others’ candid feedback for continuous improvement.
• Business acumen: You understand requirements beyond the written word. Whether you’re working on an API used by other developers, an internal tool consumed by our operation teams, or a feature used by millions of customers, your attention to details leads to a delightful user experience.