Big Data Engineer- SCALA

DATA ENGINEERING CONSULTANT

About NutaNXT: NutaNXT is a next-gen Software Product Engineering services provider building ground-breaking products using AI/ML, Data Analytics, IOT, Cloud & new emerging technologies disrupting the global markets. Our mission is to help clients leverage our specialized Digital Product Engineering capabilities on Data Engineering, AI Automations, Software Full stack solutions and services to build best-in-class products and stay ahead of the curve. You will get a chance to work on multiple projects critical to NutaNXT needs with opportunities to learn, develop new skills,switch teams and projects as you and our fast-paced business grow and evolve. Location: Pune Experience: 6 to 8 years

Job Description: NutaNXT is looking for supporting the planning and implementation of data design services, providing sizing and configuration assistance and performing needs assessments. Delivery of architectures for transformations and modernizations of enterprise data solutions using Azure cloud data technologies. As a Data Engineering Consultant, you will collect, aggregate, store, and reconcile data in support of Customer's business decisions. You will design and build data pipelines, data streams, data service APIs, data generators and other end-user information portals and insight tools.

Mandatory Skills: -

1. Demonstrable experience in enterprise level data platforms involving implementation of end-to-end data pipelines with Python or Scala - Hands-on experience with at least one of the leading public cloud data platforms (Ideally Azure)
2. - Experience with different Databases (like column-oriented database, NoSQL database, RDBMS)
3. - Experience in architecting data pipelines and solutions for both streaming and batch integrations using tools/frameworks like Azure Databricks, Azure Data Factory, Spark, Spark Streaming, etc
4. . - Understanding of data modeling, warehouse design and fact/dimension concepts - Good Communication

Good To Have:

Certifications for any of the cloud services (Ideally Azure)

• Experience working with code repositories and continuous integration • Understanding of development and project methodologies

Why Join Us?

We offer Innovative work in AI & Data Engineering Space, with a unique, diverse workplace environment having a Continuous learning and development opportunities. These are just some of the reasons we're consistently being recognized as one of the best companies to work for, and why our people choose to grow careers at NutaNXT. We also offer a highly flexible, self-driven, remote work culture which fosters the best of innovation, creativity and work-life balance, market industry-leading compensation which we believe help us consistently deliver to our clients and grow in the highly competitive, fast evolving Digital Engineering space with a strong focus on building advanced software products for clients in the US, Europe and APAC regions.

• 15+ years of Hands-on technical application architecture experience and Application build/ modernization experience

• 15+ years of experience as a technical specialist in Customer-facing roles.

• Ability to travel to client locations as needed (25-50%)

• Extensive experience architecting, designing and programming applications in an AWS Cloud environment

• Experience with designing and building applications using AWS services such as EC2, AWS Elastic Beanstalk, AWS OpsWorks

• Experience architecting highly available systems that utilize load balancing, horizontal scalability and high availability

• Hands-on programming skills in any of the following: Python, Java, Node.js, Ruby, .NET or Scala

• Agile software development expert
• Experience with continuous integration tools (e.g. Jenkins)

• Hands-on familiarity with CloudFormation

• Experience with configuration management platforms (e.g. Chef, Puppet, Salt, or Ansible)

• Strong scripting skills (e.g. Powershell, Python, Bash, Ruby, Perl, etc.)

• Strong practical application development experience on Linux and Windows-based systems

• Extra curricula software development passion (e.g. active open source contributor)

As a Director Engineering, your role & responsibility will include the following.  

• Define the product roadmap and delivery planning. 
• Provides technical leadership in design, delivery, and support of product software and platforms. 
• Participate in driving technical architectural decisions for the product.  
• Prioritization of the features and deliverable artifacts 
• Augmentation of the product development staff.  
• Mentor managers to implement best practices to motivate and organize their  teams. 
• Prepare schedules, report status as well as make hiring decisions. 
• Ensure to provide proven ability to evaluate and improve software development  best practices. 
• Provide DevOps and other processes to assure consistency, quality and  timeliness. 
• Participate in interviewing as well as hiring final decisions. 
• Guide and provide input to all strategic as well as technical planning for entire  products. 
• Monitor and provide input for evaluation and prioritize change requests.
• Create and monitor the set of policies that establish standard development  languages, tools, and methodology; documentation practices; and examination  procedures for developed systems to ensure alignment with overall architecture.' 
• Participate in project scope, schedule, and cost reviews. 
• Understand and socialize product capabilities and limitations. 
• Identify and implement ways to improve and promote quality and demonstrate  accuracy and thoroughness. 
• Establish working relationships with external technology vendors. 
• Integrate customer requirements through the engineering effort for championing  next generation products. 
• Quickly gain an understanding of the company's technology and markets,  establish yourself as a credible leader. 
• Release scheduling. 
• Keeps abreast of new technologies and has demonstrated knowledge and  experience in various technologies. 
• Manage 3rd party consulting partners/vendors implementing products. 
• Prepare and submit weekly project status reports; prepare monthly reports  outlining team assignments and/or changes, project status changes, and  forecasts project timelines.
• Provide leadership to individuals or team(s) through coaching, feedback,  development goals, and performance management. 

• Prioritize employee career development to grow the internal pipeline of leadership  talent. 
• Prioritize, assign, and manage department activities and projects in accordance  with the department's goals and objectives. Adjust hours of work, priorities, and  staff assignments to ensure efficient operation, based on workload. 

Qualification & Experience  

• Master’s or bachelor’s degree in Computer Science, Business Information  Systems or related field or equivalent work experience required. 
• Relevant certifications also preferred among other indications of someone who  values continuing education. 
• 15+ years’ experience "living" with various operating systems, development tools  and development methodologies including Java, data structures, Scala, Python,  NodeJS 
• 8+ years of individual contributor software development experience.
• 6+ years management experience in a fast-growing product software  environment with proven ability to lead and engage development, QA and  implementation teams working on multiple projects. 
• Idea generation and creativity in this position are a must, as are the ability to  work with deadlines, manage and complete projects on time and within budget. 
• Proven ability to establish and drive processes and procedures with quantifiable  metrics to measure the success and effectiveness of the development  organization. 
• Proven history of delivering on deadlines/releases without compromising quality. 
• Mastery of engineering concepts and core technologies: development models,  programming languages, databases, testing, and documentation. 
• Development experience with compilers, web Services, database engines and  related technologies. 
• Experience with Agile software development and SCRUM methodologies. 
• Proven track record of delivering high quality software products. 
• A solid engineering foundation indicated by a demonstrated understanding of  
• product design, life cycle, software development practices, and support services.  Understanding of standard engineering processes and software development  methodologies. 
• Experience coordinating the work and competences of software staff within  functional project groups. 
• Ability to work cross functionally and as a team with other executive committee  members. 
• Strong verbal and written communication skills. 
• Communicate effectively with different business units about technology and  processes using lay terms and descriptions.  
•  
• Experience Preferred: 
• Experience building horizontally scalable solutions leveraging containers,  microservices, Big Data technologies among other related technologies. 
• Experience working with graphical user experience and user interface design. 
• Experience working with object-oriented software development, web services,  web development or other similar technical products. 
• Experience with database engines, languages, and compilers  
• Experience with user acceptance testing, regression testing and integration  testing. 
• Experience working on open-source software projects for Apache and other great  open-source software organizations. 
• Demonstrable experience training and leading teams as a great people leader.
•  

• Take the microservices architecture to the next level of scalability, efficiency, observability, and availability. 
• Build, deploy & run multi-homed systems that work in multiple regions and cloud providers. 
• Build (and open source) data processing, storage and fetch systems at the petabyte scale with the lowest cost/GB while still responding in milliseconds at the 99th percentile. 
• Optimize algorithms which influence personalization, fulfillment/allocation, pricing, maps & routing, fleet positioning, payments, fraud prevention etc 
• Create platforms, reusable libraries, and utilities wherever applicable 
• Write high-quality code that is modular, functional and testable; Establish the best coding practices 
• Formally mentor junior engineers on design, coding, and troubleshooting 
• Troubleshoot issues effectively in a distributed architecture 
• Communicate, collaborate and work effectively in a global environment 
• Operationalize releases by partnering with Tech operations on capacity planning and operability of the product

Experience:

• of years  - 10+ years
• Type of experience - software design, development & architecture
• Experience in Product companies working on Internet-scale applications is preferred 
• Contribution to open-source software, tech blogs, talking at tech conferences, etc. 

Educational Qualifications:

○  Must have - Bachelor’s or Master’s degree in Engineering from premier institutes preferred  

Key competencies:

•  Deep understanding of one or more of Java/Go/Scala/C++. Ability to understand and critique the core library/language constructs. 
• Knowledge of processor, memory, network and storage internals. 
• Deep understanding of distributed systems including fault modeling, concurrency, isolation, consensus etc. 
• Internals of a RDBMS like MySQL 
• Conversant with the internals of systems like Kafka, Cassandra/Scylla, Redis, RocksDB, etc 
• Working knowledge of hosting and network infrastructure (K8s, Envoy, etc) 
• Familiarity with binary serialization protocols like thrift/protobuf/flatbuffers etc 
• Familiar with gRPC, HTTP/2, QUIC, etc. 
• Troubleshooting memory issues, GC tuning, resource leaks etc. 
• Strong problem-solving skills, algorithmic skills and data structures. 
• Productionizing machine learning pipelines using Spark/Flink/TensorFlow etc