Spark Scala Developer

The Sr. Analytics Engineer would provide technical expertise in needs identification, data modeling, data movement, and transformation mapping (source to target), automation and testing strategies, translating business needs into technical solutions with adherence to established data guidelines and approaches from a business unit or project perspective.

Understands and leverages best-fit technologies (e.g., traditional star schema structures, cloud, Hadoop, NoSQL, etc.) and approaches to address business and environmental challenges.

Provides data understanding and coordinates data-related activities with other data management groups such as master data management, data governance, and metadata management.

Actively participates with other consultants in problem-solving and approach development.

Responsibilities :

Provide a consultative approach with business users, asking questions to understand the business need and deriving the data flow, conceptual, logical, and physical data models based on those needs.

Perform data analysis to validate data models and to confirm the ability to meet business needs.

Assist with and support setting the data architecture direction, ensuring data architecture deliverables are developed, ensuring compliance to standards and guidelines, implementing the data architecture, and supporting technical developers at a project or business unit level.

Coordinate and consult with the Data Architect, project manager, client business staff, client technical staff and project developers in data architecture best practices and anything else that is data related at the project or business unit levels.

Work closely with Business Analysts and Solution Architects to design the data model satisfying the business needs and adhering to Enterprise Architecture.

Coordinate with Data Architects, Program Managers and participate in recurring meetings.

Help and mentor team members to understand the data model and subject areas.

Ensure that the team adheres to best practices and guidelines.

Requirements :

- Strong working knowledge of at least 3 years of Spark, Java/Scala/Pyspark, Kafka, Git, Unix / Linux, and ETL pipeline designing.

- Experience with Spark optimization/tuning/resource allocations

- Excellent understanding of IN memory distributed computing frameworks like Spark and its parameter tuning, writing optimized workflow sequences.

- Experience of relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., Redshift, Bigquery, Cassandra, etc).

- Familiarity with Docker, Kubernetes, Azure Data Lake/Blob storage, AWS S3, Google Cloud storage, etc.

- Have a deep understanding of the various stacks and components of the Big Data ecosystem.

- Hands-on experience with Python is a huge plus

• Own and drive business features into tech requirements
• Design & develop large scale real time server side systems
• Quickly create quality prototypes
• Staying updated on emerging technologies
• Ensuring that all deliverables adhere to our world class standards
• Promote coding best practices
• Mentor and develop junior developers in the team

• 4+ years of relevant experience as described below
• Excellent grasp of Core Java, Multi Threading and OO design patterns 
• Experience with Scala, functional, reactive programming and Akka/Play is a plus
• Excellent understanding of data structures and algorithms
• Solid grasp of large scale distributed real time systems

• Prior experience on building a scalable and resilient micro service

• Solid understanding of relational databases, NoSQL databases and Caching systems
• Good understanding of Big Data technologies such as Spark, Hadoop is a plus
• Experience on one of AWS, Azure or GCP 

• You have excellent and effective communication and collaborative skills
• You love problem solving
• You stay up to date with the latest technologies and then apply them in real life
• You love paying attention to detail
• You thrive in meeting tight deadlines and prioritising workloads
• Ability to collaborate across multiple functions

Bachelor’s degree in Engineering or equivalent experience within the field

Roles and responsibilities

• • Develop well-designed, performant and scalable microservices
  • Write reusable, testable, and efficient code that follow software development best practices
  • Integrate data storage solutions including databases, key-value stores, blob stores, etc.
  • Expose business functionality to frontend/mobile applications and partner systems through secure and scalable APIs.
  • Build integrations with 3rd party applications through apis’ to ingest and process data
  • Ensure security and data protection aspects within the applications
  • Contribute to devops by building CD/CI pipelines to automate releases
  • Ensure high performance and availability of distributed systems and applications
  • Interact directly with client project team members and operational staff to support live customer deployments and production issues.

• 4+ years of experience in developing applications using Scala and related technologies.
• Thorough understanding of multithreading concepts and async execution using Actor model.
• Thorough understanding of Play framework, GraphQL and GRPC technologies.
• Experience in using DAL and ORM (Object Relational Mapper) libraries for data access.
• Experiencing in developing and hosting APIs and integration with external applications.
• Experience in building data models and repositories using relational and NoSql databases.
• Knowledge of JIRA, Bitbucket and agile methodologies.
• Good to have knowledge of AWS services like Lambda, dynamodb, kinesis and others.
• Understanding of fundamental design principles behind a scalable application.
• Familiarity with event-driven programming and distributed architectures.
• Strong unit test and debugging skills
• Affinity for learning and applying new technologies and solving new problems
• Effective organizational skills with strong attention to detail
• Experience in working with docker is a plus
• Comfortable in working with Unix/Linux environment
• Strong communication skills — both written and verbal

• In-depth knowledge of at least one programming language such as Clojure, Go, Python, Java, Javascript (Node), Ruby, Erlang/Elixir
• Thorough understanding of PostgreSQL. Experience working with views, common table expressions (CTE), window functions, joins, different kinds of indexes, etc.
• Practical knowledge of Linux server management
• Understanding of functional programming concepts
• Knowledge of Chef, Puppet, Salt, etc. is a plus
• Experience in distributed systems is a plus

• Plan future implementations by working closely with the product team
• Deliver an amazing user experience by working with the front-end developers
• Write test suites and deploy code into production
• Setup monitoring and alerts for in-production services
• Automate deployments

• You want to build a world-class Saas B2B communication product, using the latest tools, from scratch
• You love to code 8+ hours a day and solve hard problems by building software you are proud of
• You enjoy working with directly with amazing entrepreneurs
• You are driven by the desire to learn
• You like the pressure to perform because it makes you a better person
• You are passionate about getting stuff done
• You are passionate about making a tangible difference in the world
• Passionate about writing elegant, functional efficient code

1. Resume Screen
2. Phone screen
3. Technical interview and take-home assignment
4. Interview with founders
5. Offer

• The co-founders have been running companies in at least five countries over the past fifteen years, including deep experience in technology, operations and sales in engineering/manufacturing businesses.
• We are part of Techstars first India batch, and part of Target and Airbus Accelerators
• Attended universities that are consistently ranked in the Top 10 in the world.
• We have a track record of raising capital and strong existing relationships with the finance community in both India, the US and the UK. We have funding for at least the next 24 months.
• We have strong domain expertise in the industry they are trying to disrupt. However, we still followed the discipline of spending six months doing rigorous customer development spanning six countries before defining their product or writing a single line of code. We have already identified and are working with ten customers.
• We have very high expectations from the candidates that we do select, especially in terms of first-principles thinking, communication and accountability. We will not select average candidates, and we want to encourage our employees to see Unifize as a learning ground for possibly starting their own technology businesses in the future.
• We strongly believe in evidence-based decisions, transparency, corporate governance, meritocracy, and an open forum for discussion.
• We explicitly want to build a team from different backgrounds and with a wide range of interests and experiences. We are committed to building a gender-balanced organization.

• Unifize helps teams that manage repeatable processes reduce wasted time by up to 95% by organizing their emails and other conversations around objectives.
• We build a cloud-based chat application that helps these companies measure and reduce time and errors in their communication processes, so their teams can focus on selling better products to happier customers.