Spark Scala Developer

Requirements

• 3+ years work experience with production-grade python. Contribution to open source repos is preferred
• Experience writing concurrent and distributed programs, AWS lambda, Kubernetes, Docker, Spark is preferred.
• Experience with one relational & 1 non-relational DB is preferred
• Prior work in the ML domain will be a big boost

What You’ll Do

• Help realize the product vision: Production-ready machine learning models with monitoring within moments, not months.
• Help companies deploy their machine learning models at scale across a wide range of use-cases and sectors.
• Build integrations with other platforms to make it easy for our customers to use our product without changing their workflow.
• Write maintainable, scalable performant python code
• Building gRPC, rest API servers
• Working with Thrift, Protobufs, etc.

Roles and Responsibilities

• Build campaign generation services which can send app notifications at a speed of 10 million a minute
• Dashboards to show Real time key performance indicators to clients
• Develop complex user segmentation engines which creates segments on Terabytes of data within few seconds
• Building highly available & horizontally scalable platform services for ever growing data
• Use cloud based services like AWS Lambda for blazing fast throughput & auto scalability
• Work on complex analytics on terabytes of data like building Cohorts, Funnels, User path analysis, Recency Frequency & Monetary analysis at blazing speed
• You will build backend services and APIs to create scalable engineering systems.
• As an individual contributor, you will tackle some of our broadest technical challenges that requires deep technical knowledge, hands-on software development and seamless collaboration with all functions.
• You will envision and develop features that are highly reliable and fault tolerant to deliver a superior customer experience.
• Collaborating various highly-functional teams in the company to meet deliverables throughout the software development lifecycle.
• Identify and improvise areas of improvement through data insights and research.

• 2-5 years of experience in backend development and must have worked on Java/shell/Perl/python scripting.
• Solid understanding of engineering best practices, continuous integration, and incremental delivery.
• Strong analytical skills, debugging and troubleshooting skills, product line analysis.
• Follower of agile methodology (Sprint planning, working on JIRA, retrospective etc).
• Proficiency in usage of tools like Docker, Maven, Jenkins and knowledge on frameworks in Java like spring, spring boot, hibernate, JPA.
• Ability to design application modules using various concepts like object oriented, multi-threading, synchronization, caching, fault tolerance, sockets, various IPCs, database interfaces etc.
• Hands on experience on Redis, MySQL and streaming technologies like Kafka producer consumers and NoSQL databases like mongo dB/Cassandra.
• Knowledge about versioning like Git and deployment processes like CICD.

• Bachelor's or Master’s degree in Computer Science or equivalent area
• 10 to 20 years of experience in software development
• Hands-on experience designing and building B2B or B2C products
• 3+ years architecting SaaS/Web based customer facing products, leading engineering teams as software/technical architect
• Experiences of engineering practices such as code refactoring, microservices, design and enterprise integration patterns, test and design-driven development, continuous integration, building highly scalable applications, application and infrastructure security
• Strong cloud infrastructure experience with AWS and/or Azure
• Experience building event driven systems and working with message queues/topics
• Broad working experience across multiple programming languages and frameworks with in-depth experience in one or more of the following: .Net, Java, Scala or Go-lang
• Hands-on experience with relational databases like SQL Server, PostgreSQL and document stores like Elasticsearch or MongoDB
• Hands-on experience with Big Data processing technologies like Hadoop/Spark is a plus
• Hands-on experience with container technologies like Docker, Kubernetes
• Knowledge of Agile software development process

Required Skills/Qualifications: 

∙         B.Tech/MCA in Comput

Required Skills/Qualifications: 

Any Backend Technology is acceptable

∙         B.Tech/MCA in Computer Science or equivalent with 1-3 years’ experience with server-side web application development.

∙         Extensive development experience using LAMP or MEAN stack, RESTful web services or Node.js, HTML and CSS.

∙         Good understanding of Data structures and Relational Databases like MySQL or NoSQL Databases like MongoDB.

∙         Experience working with services in AWS such as EC2, RDS, and ELBs and have knowledge of VPCs.

∙         Experience with server side and client side MVC frameworks, Kafka Ansilble,Jenkins.

∙         Exposure to Continuous Integration (CI) and Continuous Deployment (CD), automated testing and agile development methods.

∙         Understanding of Version Management Tools like GitHub.

er Science or equivalent with 1-3 years’ experience with server-side web application development.

∙         Extensive development experience using LAMP or MEAN stack, RESTful web services or Node.js, HTML and CSS.

∙         Good understanding of Data structures and Relational Databases like MySQL or NoSQL Databases like MongoDB.

∙         Experience working with services in AWS such as EC2, RDS, and ELBs and have knowledge of VPCs.

∙         Experience with server side and client side MVC frameworks, Kafka Ansilble,Jenkins.

∙         Exposure to Continuous Integration (CI) and Continuous Deployment (CD), automated testing and agile development methods.

∙         Understanding of Version Management Tools like GitHub.

• Augmenting, improving, redesigning, and/or re-implementing Dolat's low-latency/high-throughput production trading environment, which collects data from and disseminates orders to exchanges around the world
• Optimizing this platform by using network and systems programming, as well as other advanced techniques
• Developing systems that provide easy access to historical market data and trading simulations
• Building risk-management and performance-tracking tools
• Shaping the future of Dolat through regular interviewing and infrequent campus recruiting trips
• Implementing domain-optimized data structures
• Learn and internalize the theories behind current trading system
• Participate in the design, architecture and implementation of automated trading systems
• Take ownership of system from design through implementation

• As a polyglot developer Ideally, you should have:
• 1.5+ years of development experience using any of technology java, scala, python or any similar exciting technologies.
• Hands-on experience in coding, and implementation of complex, custom-built applications Working knowledge of build tool like maven/sbt and code versioning systems like git/bitbucket/cvs/svn
• Familiarity with few databases, like MySQL, Oracle, PostgreSQL, SQL Server, NoSQL etc Great OO skills, including strong design patterns knowledge
• Good communication and ability to work in a consulting environment is essential

• Think through hard problems in a consultancy environment, and work with amazing people to make the solutions a reality Work in a dynamic, collaborative, non-hierarchical environment where your talent is valued over your job title or years of experience
• Build custom software using the latest technologies and tools Craft your own career path

• Providing solution to real problems in Bigdata world.
• RnD on using the latest tools,techniques and cloud services.
• Automating the manual-timetaking tasks.
• Hands-on coding, usually in a pair programming environment.
• Working in highly collaborative teams and building quality code
• Working in lots of different domains and client environments
• Understanding the business domain deeply

• Own and drive business features into tech requirements
• Design & develop large scale real time server side systems
• Quickly create quality prototypes
• Staying updated on emerging technologies
• Ensuring that all deliverables adhere to our world class standards
• Promote coding best practices
• Mentor and develop junior developers in the team

• 4+ years of relevant experience as described below
• Excellent grasp of Core Java, Multi Threading and OO design patterns 
• Experience with Scala, functional, reactive programming and Akka/Play is a plus
• Excellent understanding of data structures and algorithms
• Solid grasp of large scale distributed real time systems

• Prior experience on building a scalable and resilient micro service

• Solid understanding of relational databases, NoSQL databases and Caching systems
• Good understanding of Big Data technologies such as Spark, Hadoop is a plus
• Experience on one of AWS, Azure or GCP 

• You have excellent and effective communication and collaborative skills
• You love problem solving
• You stay up to date with the latest technologies and then apply them in real life
• You love paying attention to detail
• You thrive in meeting tight deadlines and prioritising workloads
• Ability to collaborate across multiple functions

Bachelor’s degree in Engineering or equivalent experience within the field