Spark Scala Developer

Key Responsibilities

• Provide technical leadership in the design, development, and delivery of scalable, high-performance software systems.
• Partner with product managers, architects, and cross-functional teams to define technical strategy and ensure alignment with business objectives.
• Lead by example in writing high-quality, testable, and maintainable code.
• Drive best practices in software engineering, including code reviews, system design, and performance optimization.
• Mentor and guide engineers across teams, fostering a culture of technical excellence and continuous learning.
• Evaluate and introduce new technologies, tools, and frameworks to improve productivity, scale and system robustness.

Required Skills & Qualifications

• Strong foundation in computer science fundamentals: data structures, algorithms, and functional programming techniques.
• Expertise in Scala, with strong preference for functional programming.
• Solid experience in software design, implementation, and debugging, including inter-process communication and multi-threading.
• Hands-on experience with distributed systems and event-driven architectures.
• Familiarity with databases (Postgres preferred).
• Proficiency with Apache Kafka for messaging and persistence.
• Working knowledge of Python for unit and integration testing.
• Basic to intermediate experience with Ansible for automation.
• Strong problem-solving, analytical, and communication skills.

Nice-to-Have / Bonus Skills

• Experience with modeling in YANG.
• Experience with Scala libraries such as Cats Effect (2/3), Monix, and Akka.
• Experience working in Agile/Scrum environments.

What We Offer

• Opportunity to work on cutting-edge technologies in a collaborative environment.
• A role with strong ownership, technical influence, and visibility across teams.
• Competitive compensation and benefits.

• Augmenting, improving, redesigning, and/or re-implementing Dolat's low-latency/high-throughput production trading environment, which collects data from and disseminates orders to exchanges around the world
• Optimizing this platform by using network and systems programming, as well as other advanced techniques
• Developing systems that provide easy access to historical market data and trading simulations
• Building risk-management and performance-tracking tools
• Shaping the future of Dolat through regular interviewing and infrequent campus recruiting trips
• Implementing domain-optimized data structures
• Learn and internalize the theories behind current trading system
• Participate in the design, architecture and implementation of automated trading systems
• Take ownership of system from design through implementation

Experience:

The candidate should have about 1+ years of experience with design and development in Java/Scala. Experience in algorithm, data-structure, database is mandatory.

Required Skills:

1. Java or Scala
2. Extensive experience in developing web applications. Should possess good Oops knowledge and be aware of enterprise application design patterns.
3. Should have the ability to analyze, design, develop and test complexity of spark job.
4. Basic working knowledge of Unix/Linux.

Good To have: -

1. Python
2. Distributed Computing

Cloudera Data Warehouse Hive team looking for a passionate senior developer to join our growing engineering team. This group is targeting the biggest enterprises wanting to utilize Cloudera’s services in a private and public cloud environment. Our product is built on open source technologies like Hive, Impala, Hadoop, Kudu, Spark and so many more providing unlimited learning opportunities. 

A Day in the Life

Over the past 10+ years, Cloudera has experienced tremendous growth making us the leading contributor to Big Data platforms and ecosystems and a leading provider for enterprise solutions based on Apache Hadoop. You will work with some of the best engineers in the industry who are tackling challenges that will continue to shape the Big Data revolution.  We foster an engaging, supportive, and productive work environment where you can do your best work. The team culture values engineering excellence, technical depth, grassroots innovation, teamwork, and collaboration.

You will manage product development for our CDP components, develop engineering tools and scalable services to enable efficient development, testing, and release operations.  You will be immersed in many exciting, cutting-edge technologies and projects, including collaboration with developers, testers, product, field engineers, and our external partners, both software and hardware vendors.

Opportunity:

Cloudera is a leader in the fast-growing big data platforms market. This is a rare chance to make a name for yourself in the industry and in the Open Source world. The candidate will responsible for Apache Hive and CDW projects. We are looking for a candidate who would like to work on these projects upstream and downstream. If you are curious about the project and code quality you can check the project and the code at the following link. You can start the development before you join. This is one of the beauties of the OSS world. 

https://hive.apache.org/" target="_blank">Apache Hive

Responsibilities:

• Build robust and scalable data infrastructure software

• Design and create services and system architecture for your projects 

• Improve code quality through writing unit tests, automation, and code reviews

• The candidate would write Java code and/or build several services in the Cloudera Data Warehouse. 

• Worked with a team of engineers who reviewed each other's code/designs and held each other to an extremely high bar for the quality of code/designs

• The candidate has to understand the basics of Kubernetes.

• Build out the production and test infrastructure. 

• Develop automation frameworks to reproduce issues and prevent regressions.

• Work closely with other developers providing services to our system.

• Help to analyze and to understand how customers use the product and improve it where necessary.  

Qualifications:

• Deep familiarity with Java programming language.

• Hands-on experience with distributed systems. 

• Knowledge of database concepts, RDBMS internals.

• Knowledge of the Hadoop stack, containers, or Kubernetes is a strong plus.  

• Has experience working in a distributed team. 

• Has 3+ years of experience in software development.

1. Should be very strong Scala development(Coding)
2. With Any combination of Java/Python/Spark/Bigdata
3. 3+ years experience in Core Java/Scala with good understanding of multithreading
4. The candidate must be good with Computer Science fundamentals
5. Exposure to python/perl and Unix / K-Shell scripting
6. Code management tools such as Git/Perforce.
7. Experience with large batch-oriented systems 
8. DB2/Sybase or any RDBMS
9. Prior experience with financial products, particularly OTC Derivatives
10. Exposure to counterparty risk, margining, collateral or confirmation systems

JD:

Your role will include:

• Writing and testing your code, innovating and contributing towards increasing the value delivered by your team.
• Setting a high bar through your design, development, analysis and deployment activities
• Understanding and participating in evolving the architecture of our products.
• Keeping up-to-date with new technologies, best practices, and work on optimizing the tooling and automation.
• Understanding the latest development and engineering paradigms like Scrum/Agile/TDD/BDD/DDD etc.

You have experience with the following:

• Strong experience of leading and being part of technical teams preferably following agile methodology.
• Strong technical background with ability to provide technical guidance to other team members.
• Knowledge of microservices and must have experience of implementing a few microservices by the least.
• Knowledge of API driven platform development & Software Integration.
• You have hands-on experience in building secure, high-performing and scalable systems in Java.
• Exposure to JVM based languages like Java, Scala, Clojure.