Python Developer

Job Title: Data Engineer

Location: Pune, India

Experience: 5 to 9 years

Job Description:

We are seeking a talented and experienced Data Engineer to join our team in Pune. The ideal candidate will have a strong background in data engineering with expertise in Python, AWS, Spark, and Scala. This role is critical to our data infrastructure, ensuring that our data pipelines are robust, efficient, and scalable.

Required Skills:

• Python: Advanced proficiency with extensive experience in building data pipelines.
• AWS: Hands-on experience with AWS services such as S3, Lambda, Redshift, Glue, and EMR.
• Spark: Proficient in using Apache Spark for large-scale data processing.
• Scala: Working knowledge of Scala for Spark programming.
• Strong understanding of data warehousing concepts and ETL processes.
• Experience with SQL and relational databases.
• Familiarity with data governance and security best practices.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.

Technical skills required:

Skills: Java 8 and above, Rest Web services, MySQL.

Strong background in Core Java and good knowledge of collection Framework.

Proficient in developing high-performance, less memory-intensive micro-services applications using the Java framework.

Should have deep knowledge of Micro-service development.

YOUR ROLES AND RESPONSIBILITIES:

As a back end engineer you will be responsible for developing and delivering best in class digital neobanking API platform using the latest technologies and solutions. We believe that technology should not be a barrier when it comes to providing the best-in-class banking services to our customers and we echo that when you as an engineer present your designs and thoughts to improve the app constantly to ensure we are leading the innovation in the neobanking domain. Your role will be (but not limited) to

1. Work in most challenging and complex use cases within Banking and Finances sector.
2. Build domain led scalable banking and payments microservices using JAVA + SpringBoot.
3. Work on processing large (and we mean LARGE) amounts of data across the muvin platform.
4. Work in a cross-platform team where you integrate with 3 rd party platforms and APIs along with muvin’s APIs to ensure consistent and smooth user experience.
5. Develop software using latest tools and technologies in an agile led environment.
6. Own and deliver high quality solutions from start to end.
7. Participate in muvin’s feature development and planning.
8. Learn and get mentored from the veterans in the industry and help the team around you.

WHAT YOU HAVE:

1. E/BTech in Computer Science or similar degree.
2. 1-5+ years of relevant work experience.
3. Strong foundations in Java or other high level programming language.
4. Experience working on Spring framework.
5. Experience developing, debugging, and resolving performance problems in complex multi-service systems.
6. Extensive knowledge on OOP and software architecture.
7. Sheer willingness to write performant well designed code adhering to best practices in data structures and algorithms.
8. Ability and urge to write meaningful test cases and documentation.
9. Good aptitude in analytical and problem-solving skills.
10. Experience working with relational databases and NOSQL databases.
11. Knowledge or experience working on concurrent and event driven development.
12. Dogged desire to become a SME (Subject Matter Expert) in one of the areas outside coding (automation, scalability, performance, architecture, optimization, algorithms etc.,).
13. Good communication skills.

WE’LL BE EXCITED IF YOU BRING:

1. DevOps and CI/CD experience on AWS or similar cloud services platforms
2. Experience working with payments, wallets, and any other banking services.
3. Experience working with Docker and Kubernetes.
4. Experience with any of the reporting and analytics platforms.

• Discussing project aims with the client and development team.
• Designing and building web applications using Laravel.
• Troubleshooting issues in the implementation and debug builds.
• Working with front-end and back-end developers on projects.
• Testing functionality for users and the backend.
• Ensuring that integrations run smoothly.
• Scaling projects based on client feedback.
• Recording and reporting on work done in Laravel.
• Maintaining web-based applications.
• Presenting work in meetings with clients and management.

• A degree in programming, computer science, or a related field.
• Experience working with PHP, performing unit testing, and managing APIs such as REST.
• A solid understanding of application design using Laravel.
• Knowledge of database design and querying using SQL.
• Proficiency in HTML and JavaScript.
• Practical experience using the MVC architecture.
• A portfolio of applications and programs to your name.
• Problem-solving skills and critical mindset.
• Great communication skills.
• The desire and ability to learn.

Cloudera Data Warehouse Hive team looking for a passionate senior developer to join our growing engineering team. This group is targeting the biggest enterprises wanting to utilize Cloudera’s services in a private and public cloud environment. Our product is built on open source technologies like Hive, Impala, Hadoop, Kudu, Spark and so many more providing unlimited learning opportunities. 

A Day in the Life

Over the past 10+ years, Cloudera has experienced tremendous growth making us the leading contributor to Big Data platforms and ecosystems and a leading provider for enterprise solutions based on Apache Hadoop. You will work with some of the best engineers in the industry who are tackling challenges that will continue to shape the Big Data revolution.  We foster an engaging, supportive, and productive work environment where you can do your best work. The team culture values engineering excellence, technical depth, grassroots innovation, teamwork, and collaboration.

You will manage product development for our CDP components, develop engineering tools and scalable services to enable efficient development, testing, and release operations.  You will be immersed in many exciting, cutting-edge technologies and projects, including collaboration with developers, testers, product, field engineers, and our external partners, both software and hardware vendors.

Opportunity:

Cloudera is a leader in the fast-growing big data platforms market. This is a rare chance to make a name for yourself in the industry and in the Open Source world. The candidate will responsible for Apache Hive and CDW projects. We are looking for a candidate who would like to work on these projects upstream and downstream. If you are curious about the project and code quality you can check the project and the code at the following link. You can start the development before you join. This is one of the beauties of the OSS world. 

https://hive.apache.org/" target="_blank">Apache Hive

Responsibilities:

• Build robust and scalable data infrastructure software

• Design and create services and system architecture for your projects 

• Improve code quality through writing unit tests, automation, and code reviews

• The candidate would write Java code and/or build several services in the Cloudera Data Warehouse. 

• Worked with a team of engineers who reviewed each other's code/designs and held each other to an extremely high bar for the quality of code/designs

• The candidate has to understand the basics of Kubernetes.

• Build out the production and test infrastructure. 

• Develop automation frameworks to reproduce issues and prevent regressions.

• Work closely with other developers providing services to our system.

• Help to analyze and to understand how customers use the product and improve it where necessary.  

Qualifications:

• Deep familiarity with Java programming language.

• Hands-on experience with distributed systems. 

• Knowledge of database concepts, RDBMS internals.

• Knowledge of the Hadoop stack, containers, or Kubernetes is a strong plus.  

• Has experience working in a distributed team. 

• Has 3+ years of experience in software development.

Job Description:

Candidate must have 2 to 5-years of experience in various phase of development of a python-based application or API development.

Requirements:

Must Have:  Strong expertise in PYTHON and its built-in data structures, developing API using flask or fastapi, data wrangling using standard python frameworks like pandas, NumPy etc., integration of various applications (third party or inhouse) with python.

Good to Have: Deployment using Nginx, GUnicorn, IIS, docker and Kubernetes etc. Good understanding of optimization solutions like differential evolution. Hands on experience with python packages like Scipy.  Tkinter to make python-based applications.

Roles and Responsibilities:

• Understanding/gathering the requirements from stakeholder, formulating the problem, and leveraging AI/ML to solve the business problems.
• Integration of third party or in house application with python solution.
• Working on Deployment and optimization of various engineering problems using Numerical/Constraint optimization frameworks such as Differential Evolution and deploy a web-based API using Flask and Nginx/IIS.
• Unit testing of various python modules developed and testing of the API.

The ideal candidate is a highly resourceful and innovative developer with extensive experience in the Node Js . You must also possess a strong knowledge of Mongo DB

Responsibilities

• Perform a mix of maintenance, enhancements, and new development as required
• Work in a data analyst role and with business intelligence applications
• Document features, technical specifications & infrastructure Responsibilities
• Work cross-functionally to convert business needs into technical specifications

Qualifications

Back-end technologies& Front-end (HTML, JavaScript, CSS), Node js,Mongo Database, MySQL databases

• 1+ years' of experience in web development and software design
• Expertise in Strapi will be a plus point
• should be able to create the APIs
• Payment Gateway Integration( Stripe)

We’re looking for a Senior Backend Engineer to help us build the tools, services, and applications that will enable us to be the planet’s most patient-focused pharmacy. You will work on projects ranging from greenfield initiatives to matured products with an active user base. 

• Collaborate with engineering team to design and implement products using event driven micro-services architecture.
• Interact with Product Managers and key stake-holders on regular basis to understand and execute Product vision.
• Take charge of end-to-end feature development, right from proof-of-concept to production deployment and support
• Brainstorm and lead continuous improvement projects for product
• Providing feedback to peer developers on code quality and development standards.
• Mentoring team on strong coding and design standards.
• Setting the bar high for development practises while striking the right balance between pragmatism and perfection for code and processes.
• Effectively document API's and services using Swagger/OpenAPI, visualize flow and dependencies using diagrams, and create technical documents on engineering wikis.
• Present crisp and clear feature demos to stakeholders.

Some of our opensource projects- https://meet.google.com/linkredirect?authuser=0&;dest=https%3A%2F%2Fgithub.com%2Fmedly">https://github.com/medly

We don’t expect anybody to be an expert on all of these, but you should be deeply familiar with some, and a self-starting learner who isn’t afraid to ask for help:

• Polyglot Development (at least 1 more lang apart from Java and JavaScript)
• At least one JVM language
• Functional Programming, 
• OO Design, Clean Code, SOLID principles
• Solid grasp on HTTP, and REST
• Web based SaaS product development
• Deployment to AWS or any cloud
• Test Driven Development, 
• Security Compliance like HIPAA, PCI-DSS, SOC2
• Git, Linux, CI/CD, Gradle, IDEA
• Security based on OAuth2 / OIDC
• SQL and NoSQL DBs like PostgreSQL, DynamoDB, ElasticSearch
• Docker
• SQL Migration tools like Liquibase, Flyway
• Semantic Versioning, Feature Toggles, PR, Feature Branches

• 3+ Years of experience mainly on Backend Development using any two languages (Java, Kotlin, NodeJS, Ruby etc.)
• Minimum a bachelor degree in Computer Science, Engineering or any related field.

• Develop service/APIs using Kotlin/Micronaut Node/Serverless
• Aurora Serverless PostgreSQL DB
• AWS, Lambda, API Gateway, Amplify, Cognito, Okta
• Github, Github Actions, SonarCloud
• Database versioning using tools like Liquibase
• Terraform to manage infra
• Cloudwatch/AWS X-Ray to monitor the infra
• Opportunity to make Open Source Contribution