Engineering Manager (frontend &Backend)

The Sr. Analytics Engineer would provide technical expertise in needs identification, data modeling, data movement, and transformation mapping (source to target), automation and testing strategies, translating business needs into technical solutions with adherence to established data guidelines and approaches from a business unit or project perspective.

Understands and leverages best-fit technologies (e.g., traditional star schema structures, cloud, Hadoop, NoSQL, etc.) and approaches to address business and environmental challenges.

Provides data understanding and coordinates data-related activities with other data management groups such as master data management, data governance, and metadata management.

Actively participates with other consultants in problem-solving and approach development.

Responsibilities :

Provide a consultative approach with business users, asking questions to understand the business need and deriving the data flow, conceptual, logical, and physical data models based on those needs.

Perform data analysis to validate data models and to confirm the ability to meet business needs.

Assist with and support setting the data architecture direction, ensuring data architecture deliverables are developed, ensuring compliance to standards and guidelines, implementing the data architecture, and supporting technical developers at a project or business unit level.

Coordinate and consult with the Data Architect, project manager, client business staff, client technical staff and project developers in data architecture best practices and anything else that is data related at the project or business unit levels.

Work closely with Business Analysts and Solution Architects to design the data model satisfying the business needs and adhering to Enterprise Architecture.

Coordinate with Data Architects, Program Managers and participate in recurring meetings.

Help and mentor team members to understand the data model and subject areas.

Ensure that the team adheres to best practices and guidelines.

Requirements :

- Strong working knowledge of at least 3 years of Spark, Java/Scala/Pyspark, Kafka, Git, Unix / Linux, and ETL pipeline designing.

- Experience with Spark optimization/tuning/resource allocations

- Excellent understanding of IN memory distributed computing frameworks like Spark and its parameter tuning, writing optimized workflow sequences.

- Experience of relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., Redshift, Bigquery, Cassandra, etc).

- Familiarity with Docker, Kubernetes, Azure Data Lake/Blob storage, AWS S3, Google Cloud storage, etc.

- Have a deep understanding of the various stacks and components of the Big Data ecosystem.

- Hands-on experience with Python is a huge plus

• Working directly with clients to understand requirements for a green field development
• Designing the technology and cloud infrastructure architecture to achieve the functional and nonfunctional requirements
• The product you will be working on needs to scale up to support millions of users an efficient micro service distributed architecture
• Solution needs to be easy to deploy and manage on multiple cloud providers (AWS, GCP or Azure)
• Mentoring, guiding and training the team on various technology, quality and security aspects
• Guiding the team to implement automated CI/CD processes
• Strong analytical, problem solving and data analysis
• Excellent communication, presentation and interpersonal skills are a must
• Micro service frameworks such as Java SpringBoot
• Design and implement automated unit and integration tests
• Writing scalable, robust, testable, efficient, and easily maintainable code
• Familiarity with most AWS Services - EC2, ECS, RDS, ECR, S3, SNS, SQS, and more
• Experience with Docker and Kubernetes
• Deploying and Scaling microservices to AWS
• Hands-on experience with AWS cloud platform in evaluation and cost estimation

What you need to have:

Senior / Python Developer

We are looking for a Senior / Python Developers to join our engineering team and help us develop and maintain various software products. Your responsibilities include understanding the product very well, and lead the integration of this product into architecture.

To be successful in this role, you should have strong technical knowledge and solid experience of all steps of the software engineering process and the tools associated with those. You should be a go-getter, a clear communicator and a strong collaborator who works well in a team as well as the customer. You should want to do high quality work and produce output that you are proud of.  

• Good understanding of Python especially should have used file/directory access, data persistence, compression and archiving, cryptographic services, concurrent operations, networking and IPC, developmental tools etc.
• Good understanding of key differences in Python 2 vs 3
• Knowledge of lib2to3, six, python-future libraries. Compatibility idioms provided by these libs and their limitations, issues in using them as is.
• Knowledge of Python3 changes in data types especially str, bytes in Py3 vs str, unicode in Py2. Should be able to gauge, understand impact of this on data in transit/data at rest in a large project.
• Knowledge of using C extensions in Python code, modifying to run with Python3, Python 2-3 compatibility.
• Experience working with large python codebase.
• Working knowledge of mysql, Python ORM like sqlobject.
• Working knowledge of Common third party modules like cherrypy, falcon, gunicorn, etc.
• Good experience with basic python, no django/flask needed 
• Some code needs to run in Python 2, some in Python 3 and some in compatibility mode
• Issues for Druva are in ORM, marshalling, networking
• Need candidates having Understanding of basic data types, extensions of python 
• Data type conversion and networking is important 
• Internals of Python are important