


We have urgent requirement of Data Engineer/Sr Data Engineer for reputed MNC company.
Exp: 4-9yrs
Location: Pune/Bangalore/Hyderabad
Skills: We need candidate either Python AWS or Pyspark AWS or Spark Scala

Similar jobs
• Design, develop, code and test the solution
• Experience working with large datasets and NoSQL database technologies (e.g. Cassandra, ES)
• 5-10 yrs of industry experience
• Energetic self-starter, with a desire to work in a startup environment
• Proficient in advanced Java programming skills
• Expert in Application development cloud/on premise end to end. Middle layer, DB layer.
• Nice to have understanding on MQ (e.g. Kafka)
• Good hands on in Complex Event Processing systems
• Solved scale and performance issues while dealing with huge sets of data. Pre compute or data aggregation frameworks to achieve good response time
• Experience working with large datasets and NoSQL database technologies (e.g. Cassandra, ES)
• Experience of debugging applications running on Unix like systems (e.g. Ubuntu, CentOS)
• Experience developing RESTful APIs for complex data sets
• Knowledge of container based development & deployment (e.g. Dockers, K8s)
• Expertise in software security domain, a plus


Primary Skills: Database Systems (SQL), Python Flask/Fast API/Django frameworks specifically
Requirements:
- Highly proficient in fundamentals of Python web development frameworks like Flask, Django and Fast API
- Demonstrated experience in developing APIs using Python frameworks
- Should have deep knowledge in PostgreSQL, MS SQL Server and other SQL based Databases


● Designing, code reviews, POCs on latest cutting-edge technologies building,
deploying highly scalable and robust cloud based intelligent solutions.
● Architect & Design, code high performance and scalable solutions that meet the needs of millions of customers.
● Implement cutting-edge models and algorithms that operate on massive amounts of data.
● Working on the REST framework
● Working on session-based and token-based authentication, Working on Celery
● Handling the payment gateway
● Work with Multi-threading, Data Structures, Algorithm, Design Patterns and develop robust high-performance and scalable applications.
● Writing scalable code using Python programming language.
● Developing back-end components.
Job Description
We are looking for a Back-End Web Developer responsible for managing the interchange of data between the server and the users. Your primary focus will be development of all server-side logic, definition and maintenance of the central database, and ensuring high performance and responsiveness to requests from the front-end.
Responsibilities
- Integration of user-facing elements developed by a front-end developers with server side logic
- Building reusable code and libraries for future use
- Optimization of the application for maximum speed and scalability
- Implementation of security and data protection
Skills And Qualifications
- Basic understanding of front-end technologies and platforms, such as JavaScript, HTML5, and CSS3
- User authentication and authorization between multiple systems, servers, and environments
- Integration of multiple data sources and databases into one system
- Management of hosting environment, including database administration and scaling an application to support load changes
- Data migration, transformation, and scripting
- Setup and administration of backups
- Creating database schemas that represent and support business processes
- Implementing automated testing platforms and unit tests
- Experience with Kafka / RabbitMQ
- Proficient knowledge of NodeJS
- Working knowledge of databases like PostgreSQL and MongoDB
- Experience with AWS Cloud services like S3 and EC2
- Proficient understanding of code versioning tools, such as Git



- Must have experience with Amazon Web Services (AWS)
- Experience with Python/Node.JS/Typescript
- At least 2+ years as back-end software developer
- A deep understanding of the benefits of the Microservice and serverless paradigms
- Prepared technical documentation, and understand why it’s important
- Understanding of database principals: SQL and NoSQL
- Collaboration and communication skills (you’ll be working with clients and internal teams)
- An understanding of programming fundamentals (OOP, data structures, algorithms)
- Familiarity and comfort with REST API, Postman
- The ability to work independently or within a team structure.
- A “lead by example” attitude, and motivation to deliver work you’re proud of


Role- Software Development Engineer-2
As a Software Development Engineer at Amazon, you have industry-leading technical abilities and demonstrate breadth and depth of knowledge. You build software to deliver business impact, making smart technology choices. You work in a team and drive things forward.
Top Skills
- You write high quality, maintainable, and robust code, often in Java or C++ or C#
- You recognize and adopt best practices in software engineering: design, testing, version control, documentation, build, deployment, and operations.
- You have experience building scalable software systems that are high-performance, highly-available, highly transactional, low latency and massively distributed.
- Roles & Responsibilities
- You solve problems at their root, stepping back to understand the broader context.
- You develop pragmatic solutions and build flexible systems that balance engineering complexity and timely delivery, creating business impact.
- You understand a broad range of data structures and algorithms and apply them to deliver high-performing applications.
- You recognize and use design patterns to solve business problems.
- You understand how operating systems work, perform and scale.
- You continually align your work with Amazon’s business objectives and seek to deliver business value.
- You collaborate to ensure that decisions are based on the merit of the proposal, not the proposer.
- You proactively support knowledge-sharing and build good working relationships within the team and with others in Amazon.
- You communicate clearly with your team and with other groups and listen effectively.
Skills & Experience
- Bachelors or Masters in Computer Science or relevant technical field.
- Experience in software development and full product life-cycle.
- Excellent programming skills in any object-oriented programming languages - preferably Java, C/C++/C#, Perl, Python, or Ruby.
- Strong knowledge of data structures, algorithms, and designing for performance, scalability, and availability.
- Proficiency in SQL and data modeling.
About Amazon.com
“Many of the problems we face have no textbook solution, and so we-happily-invent new ones.” – Jeff Bezos
Amazon.com – a place where builders can build. We hire the world's brightest minds and offer them an environment in which they can invent and innovate to improve the experience for our customers. A Fortune 100 company based in Seattle, Washington, Amazon is the global leader in e-commerce. Amazon offers everything from books and electronics to apparel and diamond jewelry. We operate sites in Australia, Brazil, Canada, China, France, Germany, India, Italy, Japan, Mexico, Netherlands, Spain, United Kingdom and United States, and maintain dozens of fulfillment centers around the world which encompass more than 26 million square feet.
Technological innovation drives the growth of Amazon, offering our customers more selection, convenient shopping, and low prices. Amazon Web Services provides developers and small to large businesses access to the horizontally scalable state of the art cloud infrastructure like S3, EC2, AMI, CloudFront and SimpleDB, that powers Amazon.com. Developers can build any type of business on Amazon Web Services and scale their application with growing business needs.
We want you to help share and shape our mission to be Earth's most customer-centric company. Amazon's evolution from Web site to e-commerce partner to development platform is driven by the spirit of invention that is part of our DNA. We do this every day by inventing elegant and simple solutions to complex technical and business problems. We're making history and the good news is that we've only just begun.



• 2+ years experience in application development
• experience with Python and Javascript is required.
• good knowledge of operating systems and networking concepts
• experience in using and understanding code from Open Source
• Strong command of NoSQL and ability to design schemas.
• Knowledge of front-end technologies such as React Native, React.js, or Javascript
• Experience with cloud infrastructure tools in AWS and Google Cloud
• experience with implementing best software engineering practices like version control with git, code reviews, writing unit-tests, writing readable code
• inclination towards researching new technologies and adapt them to solve challenges we face.
• Address all tech challenges and continue with tech innovation in order to improve business operations
• Experience with Live video stream a plus.
• Experience with AI preferred.








