Spark Scala Developer

• Augmenting, improving, redesigning, and/or re-implementing Dolat's low-latency/high-throughput production trading environment, which collects data from and disseminates orders to exchanges around the world
• Optimizing this platform by using network and systems programming, as well as other advanced techniques
• Developing systems that provide easy access to historical market data and trading simulations
• Building risk-management and performance-tracking tools
• Shaping the future of Dolat through regular interviewing and infrequent campus recruiting trips
• Implementing domain-optimized data structures
• Learn and internalize the theories behind current trading system
• Participate in the design, architecture and implementation of automated trading systems
• Take ownership of system from design through implementation

• Bachelor’s or master’s degree in Computer Engineering, Computer Science, Computer Applications, Mathematics, Statistics, or related technical field. Relevant experience of at least 3 years in lieu of above if from a different stream of education.

• Well-versed in and 3+ hands-on demonstrable experience with: ▪ Stream & Batch Big Data Pipeline Processing using Apache Spark and/or Apache Flink.
  ▪ Distributed Cloud Native Computing including Server less Functions
  ▪ Relational, Object Store, Document, Graph, etc. Database Design & Implementation
  ▪ Micro services Architecture, API Modeling, Design, & Programming

• 3+ years of hands-on development experience in Apache Spark using Scala and/or Java.

• Ability to write executable code for Services using Spark RDD, Spark SQL, Structured Streaming, Spark MLLib, etc. with deep technical understanding of Spark Processing Framework.

• In-depth knowledge of standard programming languages such as Scala and/or Java.

• 3+ years of hands-on development experience in one or more libraries & frameworks such as Apache Kafka, Akka, Apache Storm, Apache Nifi, Zookeeper, Hadoop ecosystem (i.e., HDFS, YARN, MapReduce, Oozie & Hive), etc.; extra points if you can demonstrate your knowledge with working examples.

• 3+ years of hands-on development experience in one or more Relational and NoSQL datastores such as PostgreSQL, Cassandra, HBase, MongoDB, DynamoDB, Elastic Search, Neo4J, etc.

• Practical knowledge of distributed systems involving partitioning, bucketing, CAP theorem, replication, horizontal scaling, etc.

• Passion for distilling large volumes of data, analyze performance, scalability, and capacity performance issues in Big Data Platforms.

• Ability to clearly distinguish system and Spark Job performances and perform spark performance tuning and resource optimization.

• Perform benchmarking/stress tests and document the best practices for different applications.

• Proactively work with tenants on improving the overall performance and ensure the system is resilient, and scalable.

• Good understanding of Virtualization & Containerization; must demonstrate experience in technologies such as Kubernetes, Istio, Docker, OpenShift, Anthos, Oracle VirtualBox, Vagrant, etc.

• Well-versed with demonstrable working experience with API Management, API Gateway, Service Mesh, Identity & Access Management, Data Protection & Encryption.

  Hands-on experience with demonstrable working experience with DevOps tools and platforms viz., Jira, GIT, Jenkins, Code Quality & Security Plugins, Maven, Artifactory, Terraform, Ansible/Chef/Puppet, Spinnaker, etc.

• Well-versed in AWS and/or Azure or and/or Google Cloud; must demonstrate experience in at least FIVE (5) services offered under AWS and/or Azure or and/or Google Cloud in any categories: Compute or Storage, Database, Networking & Content Delivery, Management & Governance, Analytics, Security, Identity, & Compliance (or) equivalent demonstrable Cloud Platform experience.

• Good understanding of Storage, Networks and Storage Networking basics which will enable you to work in a Cloud environment.

• Good understanding of Network, Data, and Application Security basics which will enable you to work in a Cloud as well as Business Applications / API services environment.

DeepSource is working on building tools that help developers ship good code. There are over 40 million developers in the world, and all of them write and review code in some form. There’s a massive opportunity to impact how software is built right from where the code is written using automation and intelligence, that not only improves developer productivity but also increases software’s robustness.

The Language Engineering team works on the source code analyzers, including both programming languages and configuration-as-code systems. As a member of the Language Engineering team, you will work on building the best, most comprehensive, Scala analyzer in the world. You will add new rules and Autofixes for finding more issues with code and automatically fixing them. You will be involved with the community to understand the problems with static analysis tools in the Scala ecosystem.

• Identify bad code practices in Scala and write new analyzers to detect them.

• Improve the coverage of automatically fixable issues.

• Ensure fewer false-positives are reported by the analyzer.

• Work on the internal tools that support analysis runtimes.

• Contribute to open-source static analysis tools.

• Strong foundational knowledge in Computer Science.

• At least 3 years of professional software development experience in Scala and Java.

• Understanding of the nuances of execution of the source code (AST, data flow graphs, etc).

• Familiarity with Scala best practices followed in the industry.

• Native experience with Linux/Unix environment.

• A focus on delivering high-quality code through strong testing practices.

We offer competitive compensation with meaningful stock options, a generous vacation policy, and a workstation of your choice, to name a few of the perks.

Roles and responsibilities

• • Develop well-designed, performant and scalable microservices
  • Write reusable, testable, and efficient code that follow software development best practices
  • Integrate data storage solutions including databases, key-value stores, blob stores, etc.
  • Expose business functionality to frontend/mobile applications and partner systems through secure and scalable APIs.
  • Build integrations with 3rd party applications through apis’ to ingest and process data
  • Ensure security and data protection aspects within the applications
  • Contribute to devops by building CD/CI pipelines to automate releases
  • Ensure high performance and availability of distributed systems and applications
  • Interact directly with client project team members and operational staff to support live customer deployments and production issues.

• 4+ years of experience in developing applications using Scala and related technologies.
• Thorough understanding of multithreading concepts and async execution using Actor model.
• Thorough understanding of Play framework, GraphQL and GRPC technologies.
• Experience in using DAL and ORM (Object Relational Mapper) libraries for data access.
• Experiencing in developing and hosting APIs and integration with external applications.
• Experience in building data models and repositories using relational and NoSql databases.
• Knowledge of JIRA, Bitbucket and agile methodologies.
• Good to have knowledge of AWS services like Lambda, dynamodb, kinesis and others.
• Understanding of fundamental design principles behind a scalable application.
• Familiarity with event-driven programming and distributed architectures.
• Strong unit test and debugging skills
• Affinity for learning and applying new technologies and solving new problems
• Effective organizational skills with strong attention to detail
• Experience in working with docker is a plus
• Comfortable in working with Unix/Linux environment
• Strong communication skills — both written and verbal