Data Engineer-Python AWS Spark Scala (Python is must)

What you’ll be doing

 Weare much more than our job descriptions, but here is where you will begin:

 As a Senior Software Engineer Data & ML You’ll Be:

 ● Architect, design, test, implement, deploy, monitor and maintain end-to-end backend

 services. You build it, you own it.

 ● Work with people from other teams and departments on a day to day basis to ensure

 efficient project execution with a focus on delivering value to our members.

 ● Regularly aligning your team’s vision and roadmap with the target architecture within your

 domain and to ensure the success of complex multi domain initiatives.

 ● Integrate already trained ML and GenAI models (preferably GCP in services.

ROLE:

 Whatyou’ll need,

 Like us, you’ll be deeply committed to delivering impactful outcomes for customers.

 What Makes You a Great Fit

 ● 5 years of proven work experience as a Backend Python Engineer

 ● Understanding of software engineering fundamentals OOPS, SOLID, etc.)

 ● Hands-on experience with Python libraries like Pandas, NumPy, Scikit-learn,

 Lang chain/LLamaIndex etc.

 ● Experience with machine learning frameworks such as PyTorch or TensorFlow, Keras, being

 proficient in Python

 ● Hands-on Experience with frameworks such as Django or FastAPI or Flask

 ● Hands-on experience with MySQL, MongoDB, Redis and BigQuery (or equivalents)

 ● Extensive experience integrating with or creating REST APIs

 ● Experience with creating and maintaining CI/CD pipelines- we use GitHub Actions.

 ● Experience with event-driven architectures like Kafka, RabbitMq or equivalents.

 ● Knowledge about:

 o LLMs

 o Vector stores/databases

 o PromptEngineering

 o Embeddings and their implementations

 ● Somehands-onexperience in implementations of the above ML/AI will be preferred

 ● Experience with GCP/AWS services.

 ● You are curious about and motivated by the future trends in data, AI/ML, analytics

Roles and Responsibilities

• Ability to create solution prototype and conduct proof of concept of new tools.

• Work in research and understanding of new tools and areas.

• Clearly articulate pros and cons of various technologies/platforms and perform

detailed analysis of business problems and technical environments to derive a

solution.

• Optimisation of the application for maximum speed and scalability.

• Work on feature development and bug fixing.

Technical skills

• Must have knowledge of the networking in Linux, and basics of computer networks in

general.

• Must have intermediate/advanced knowledge of one programming language,

preferably Python.

• Must have experience of writing shell scripts and configuration files.

• Should be proficient in bash.

• Should have excellent Linux administration capabilities.

• Working experience of SCM. Git is preferred.

• Knowledge of build and CI-CD tools, like Jenkins, Bamboo etc is a plus.

• Understanding of Architecture of OpenStack/Kubernetes is a plus.

• Code contributed to OpenStack/Kubernetes community will be a plus.

• Data Center network troubleshooting will be a plus.

• Understanding of NFV and SDN domain will be a plus.

Soft skills

• Excellent verbal and written communications skills.

• Highly driven, positive attitude, team player, self-learning, self motivating and flexibility

• Strong customer focus - Decent Networking and relationship management

• Flair for creativity and innovation

• Strategic thinking This is an individual contributor role and will need client interaction on technical side.

Must have Skill - Linux, Networking, Python, Cloud

Additional Skills-OpenStack, Kubernetes, Shell, Java, Development

• Python developer with Django experience
• 6-8 yrs of total experience
• Strong communication is a MUST

• Manage and improve the engineering process continuously and make sure the team delivers the quality code with zero-waste.
• Should provide technical leadership to major projects, but also build and manage a team of 5-8 top-notch engineers.
• Should do sprint planning and run daily stand-ups and deliver 100% hit rate.
• Maintain the legacy code base and reduce tech debt on a continuous basis.
• Able to handle multiple projects and deliver with stringent timelines without compromising the code quality.
• Work with the product team for roadmap planning and delivery as per the plan.
• Conduct sprint planning & sizing, engineering grooming, daily stand-ups, and deliver with zero spillovers.
• Prepare & publish sprint reports to the leadership team and provide visibility to stakeholders.
• Hire and mentor junior/ senior team and make them engineering champions.
• Mentor the engineering team with your technical skills to write scalable, generic, reusable code.
• Develop and Coach engineers on the team, share engineering pointers, conduct regular 1-1s with the team, and help them advance in their careers.

Requirements

• Having work experience in a Product organization with 7 -10 yrs also in leading a cross-functional engineering team that includes API Development and Backend & Middleware development.
• Should have experience in the continuous delivery process. Ship new features and improvising the code base continuously.
• Should have involved in setting up engineering process.
• Must have experience in microservices and distributed patterns.
• Must have worked on high traffic and throughput application.
• Must have prior experience in handling mid to large-size projects.
• Must have worked on high traffic and throughput application.
• Should have managed and lead the engineering team of Web App and Backend development teams.
• Must-Have Experience in Python programming & Postgressql/ Nosql (MongoDB as a data store.
• Must have experience in modern back-end tech stacks (Django, Postgress, NoSQL) and cloud design & deployment patterns.
• Must be conversant with AWS, Docker/Kubernetes
• Should be good with design patterns and integration patterns.
• Should have knowledge/ experience in concurrent programming & distributed locks.
• Requires solid understanding of technologies and architecture in a highly scalable and available set-up.
• Should have handled multiple epics, themes, and experience of delivering high-quality projects on time.
• Should have managed end to end development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations

• Total of 3-5 years of experience building cutting-edge products.
• Must have a degree in Computer Science or a related field. Strong understanding of object-oriented programming, concurrency, and fundamentals of computer science.

• Technically Hands-on, prior experience with scalable Architecture.
• Bring 3-5 years of software engineering and product delivery experience, with a strong background in algorithms.
• Excellent command over Data Structures and Algorithm Proficiency in implementation of algorithms and use of advanced data structures to solve problems in computing
• Exceptional coding skills in an Object-Oriented programming language (Python preferred with Django framework).
• Strong problem-solving and analytical skills.
• Experience with web technologies Java/Python, Linux, Apache, MySQL, solr, memcache, redis.
• Experience in architecting & building real-time, large-scale e-commerce applications.
• Experience with high-performance websites catering to millions of daily traffic is a plus.

• Java/ Python, MySQL, Redis, ElasticSearch, Problem Solving, Scalability, Design Patterns, Distributed System

• Develop complex software products that include scale, algorithmic complexity, and a huge amount of data.
• Build cutting-edge scalable systems by writing simple and efficient code.
• Code, develop, design, and architect features related to the existing application. We expect you to own modules end to end and take pride in the work products you ship
• Contribute to all aspects of an agile software development lifecycle including design, architecture, development, documentation, testing, and operations.
• Design, implement, and maintain highly scalable, multi-tier, distributed server software applications
• Deliver across the entire app life cycle, design, build, deploy, test, release to app stores, and support
• Working directly with developers and product managers to conceptualize, build, test, and release products
• Take responsibility for performance and stability for all server functions
• Continuously discover, evaluate, and implement new technologies to maximize development efficiency

Mentor To Go is an android and web based platform to help students improve their work readiness through self-learning sessions, personalised mentorship provided by mentor professionals from a range of careers, and work experience opportunities.

The technology platform implements  functionalities such as: screening surveys of mentors and mentees, training content for mentors, matching through an algorithm, and mentorship through the delivery of structured activities. 

The application technology architecture comprises of the following:

o   a Python Django web application with NGinx and Gunicorn

o   PostgreSQL database

o   A React Android and Web app

o   Rest APIs which interact between the Android app and the Django webserver

Our vision at Mentor To Go is to provide career mentorship to young people anywhere, anytime across the length and breadth of India.

We are looking for a backend software developer who is passionate about using web technologies to solve social problems and creating experiences that are elegant and effective. You will own the back end development of features of the Mentor To Go platform from conceptualisation through design and testing, working closely with other developers, the technical project manager, and the program operations team. You are user-centric, continuously demonstrate strategic & analytical abilities, and are laser focused on executing at speed. You must have the ability to succeed in a fast paced environment, where success is dependent on your ability to collaborate with cross-functional team members in a positive, productive, and transparent way.

Minimum requirements 

• Bachelor’s degree in engineering preferably  CS  or related discipline  
• 3+ years experience working in Unix/Linux environments building web and mobile applications
• Proficiency in developing and deploying cloud based Python/Postgresql applications preferably using frameworks such as Django
• Experience with design and development of moderately complex software projects
• Strong written and oral communication skills
• Familiarity with version control software such as Git

Desired  requirements 

• 5+ years of overall relevant work experience
• Experience building apps using React/React-Native
• Basic understanding of AWS cloud
• Ability to participate in technical discussions and help make technical trade-offs

About Mentor Together

https://mentortogether.org/">Mentor Together is India’s first and largest youth mentoring  non-profit organization with a mission to facilitate empowering mentoring relationships and networks that help young people break the inequalities of opportunity and actualise their potential.

http://bit.ly/mentortogo">Mentor To Go is the world’s first mobile mentoring platform created by Mentor Together with the support of Cisco India, LinkedIn Social Impact, British Telecom and Sterlite Technologies.