
Profile: AWS Data Engineer
Mode- Hybrid
Experience- 5+7 years
Locations - Bengaluru, Pune, Chennai, Mumbai, Gurugram
Roles and Responsibilities
- Design and maintain ETL pipelines using AWS Glue and Python/PySpark
- Optimize SQL queries for Redshift and Athena
- Develop Lambda functions for serverless data processing
- Configure AWS DMS for database migration and replication
- Implement infrastructure as code with CloudFormation
- Build optimized data models for performance
- Manage RDS databases and AWS service integrations
- Troubleshoot and improve data processing efficiency
- Gather requirements from business stakeholders
- Implement data quality checks and validation
- Document data pipelines and architecture
- Monitor workflows and implement alerting
- Keep current with AWS services and best practices
Required Technical Expertise:
- Python/PySpark for data processing
- AWS Glue for ETL operations
- Redshift and Athena for data querying
- AWS Lambda and serverless architecture
- AWS DMS and RDS management
- CloudFormation for infrastructure
- SQL optimization and performance tuning

Similar jobs

Position: Python Developer – Flask
Experience: 3+ Years
Location: Bangalore
Joining: Immediate Joiner Preferred
Employment Type: Full-Time
About the Role
We are looking for a skilled and passionate Python Developer with strong experience in Flask framework to join our growing development team. The ideal candidate should have hands-on experience in developing scalable backend applications, REST APIs, and integrating databases/services in a fast-paced environment.
Key Responsibilities
- Develop, test, and maintain backend applications using Python and Flask.
- Design and build RESTful APIs for web and mobile applications.
- Collaborate with frontend developers, QA teams, and product stakeholders.
- Write reusable, scalable, and efficient code.
- Integrate third-party APIs and services.
- Optimize application performance and troubleshoot issues.
- Work with databases and ensure data security and integrity.
- Participate in code reviews and technical discussions.
- Maintain proper documentation for development activities.
Required Skills
- 3+ years of experience in Python development.
- Strong hands-on experience with Flask framework.
- Good understanding of REST API development.
- Experience with MySQL/PostgreSQL/MongoDB databases.
- Familiarity with ORM libraries such as SQLAlchemy.
- Knowledge of Git/version control systems.
- Understanding of software development lifecycle and agile methodologies.
- Basic understanding of Docker and deployment processes is an added advantage.
- Good debugging and problem-solving skills.
Preferred Skills
- Experience with AWS/Azure or cloud platforms.
- Exposure to microservices architecture.
- Familiarity with CI/CD pipelines.
- Knowledge of frontend technologies like React or Angular is a plus.
Educational Qualification
- Bachelor’s degree in Computer Science, Information Technology, or related field.
What We’re Looking For
- Immediate joiner or candidates with short notice period.
- Strong communication and teamwork skills.
- Self-driven and proactive mindset.
Job Description:
We are looking for a Lead Java Developer – Backend with a strong foundation in software engineering and hands-on experience in designing and building scalable, high-performance backend systems. You’ll be working within our Digital Engineering Studios on impactful and transformative projects in a fast-paced environment.
Key Responsibilities:
- Lead and mentor backend development teams.
- Design and develop scalable backend applications using Java and Spring Boot.
- Ensure high standards of code quality through best practices such as SOLID principles and clean code.
- Participate in pair programming, code reviews, and continuous integration processes.
- Drive Agile, Lean, and Continuous Delivery practices like TDD, BDD, and CI/CD.
- Collaborate with cross-functional teams and clients for successful delivery.
Required Skills & Experience:
- 9–12+ years of experience in backend development (Up to 17 years may be considered).
- Strong programming skills in Java and backend frameworks such as Spring Boot.
- Experience in designing and building large-scale, custom-built, scalable applications.
- Sound understanding of Object-Oriented Design (OOD) and SOLID principles.
- Hands-on experience with Agile methodologies, TDD/BDD, CI/CD pipelines.
- Familiarity with DevOps practices, Docker, Kubernetes, and Infrastructure as Code.
- Good understanding of cloud technologies – especially AWS, and exposure to GCP or Azure.
- Experience working in a product engineering environment is a plus.
- Startup experience or working in fast-paced, high-impact teams is highly desirable.
- Job Description
We are looking for a talented Platform Engineer with a strong background in Python programming and AWS services to join our growing team.
Responsibilities:
- Contribute to the development and maintenance of our cloud management platform
- Collaborate with cross-functional teams to define, design, and deliver new features and functionality.
- Provide technical support and guidance to internal and external stakeholders.
- Stay up-to-date with the latest industry trends and technologies.
Requirements:
- A total of 2-4 years of professional experience in developing applications/platforms using Python programming
- Strong understanding of Object-Oriented Programming, SOLID principles and RDBMS.
- Demonstrated experience in utilizing AWS services, including Lambda, RDS, and DynamoDB.
- Strong understanding of cloud computing concepts, infrastructure, and architectural best practices.
- Experience in using source control systems, such as Git.
- Excellent problem-solving skills and the ability to debug complex systems.
- Strong communication skills, both written and verbal, with the ability to work effectively with team members and stakeholders.
- A constant hunger for learning and staying up-to-date with the latest industry advancements.
- Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent work experience.
Nice to have:
- AWS Certified Developer – Associate or other relevant AWS certifications.
- Experience with the AWS Boto3 SDK for Python.
- Experience with other cloud platforms (Azure, GCP, etc.).
- Familiarity with containerization and orchestration technologies, such as Docker and Kubernetes.

- Experience building and managing large scale data/analytics systems.
- Have a strong grasp of CS fundamentals and excellent problem solving abilities. Have a good
understanding of software design principles and architectural best practices.
- Be passionate about writing code and have experience coding in multiple languages, including at least
one scripting language, preferably Python.
- Be able to argue convincingly why feature X of language Y rocks/sucks, or why a certain design decision
is right/wrong, and so on.
- Be a self-starter—someone who thrives in fast paced environments with minimal ‘management’.
- Have exposure and working knowledge in AI environment with Machine learning experience
- Have experience working with multiple storage and indexing technologies such as MySQL, Redis,
MongoDB, Cassandra, Elastic.
- Good knowledge (including internals) of messaging systems such as Kafka and RabbitMQ.
- Use the command line like a pro. Be proficient in Git and other essential software development tools.
- Working knowledge of large-scale computational models such as MapReduce and Spark is a bonus.
- Exposure to one or more centralized logging, monitoring, and instrumentation tools, such as Kibana,
Graylog, StatsD, Datadog etc
Stealth Fintech startup looking for Software Engineer with 2+ year of experience.
We are looking to hire few engineers for this position ASAP.
Well funded !
Permanent Remote Position !
Competitive Salary !
You will be a part of the founding engeering team. We are working cutting edge technology stack such as Cassandra, Terraform, Kubernetes, Redis, MongoDB, InfluxDB, Graphana, GoLang, AWS.
You will get the opportunity to work on a massive scale project, crawling 100+ Million pages per day, and very complex problems which will help you grow as an engineer.
Requirements:
- Past work experience with crawler / scraper is a MUST
- Self starter mentality who can pick up new skills & can work independently
- Experience with programming languages like Java, C#, Go, Python, PHP
- Understanding of concepts like HTTP, Sessions / Cookies, IP rotation
- Expereince with AWS or Google Cloud
- Familiar with multithreading architecture
- Understanding the business requirement and providing good scalable solution
- Integrating user-facing elements developed by a front-end developers with server side logic
- Building reusable code and libraries for future use
- Optimizing the application for maximum speed and scalability
- Understanding differences between multiple delivery platforms such as mobile vs desktop, and optimizing output to match the specific platform
- Creating database schemas that represent and support business processes
- Implementing automated testing platforms and unit tests
What you need to have:
- Engineers from Tier 1 colleges, B.Tech/ B.E from only from Tier 1 colleges
- Extensive and expert programming experience in anyone programming language (Golang/ C/ Java).
- A solid foundation in computer science, with strong competencies in data structures, algorithms, software design and distributed system applications
- Experience with building and scaling apps with RDBMS as well as NoSQLs.
- Experience creating scalable Web APIs for mobile and browser consumption
- Have a penchant for solving complex and interesting problems
- Worked in start-up culture with high levels of ownership and commitment
- Excellent coding skills – should be able to convert design into code fluently
- Working knowledge of - ReactJS, React Native, Golang, MySQL, NoSQL and hosting environment is AWS
As a Software Development Engineer at Amazon, you have industry-leading technical abilities and demonstrate breadth and depth of knowledge. You build software to deliver business impact, making smart technology choices. You work in a team and drive things forward.
Top Skills
- You write high quality, maintainable, and robust code, often in Java or C++/C/Python/ROR/C#
- You recognize and adopt best practices in software engineering: design, testing, version control, documentation, build, deployment, and operations.
- You have experience building scalable software systems that are high-performance, highly-available, highly transactional, low latency and massively distributed.
Roles & Responsibilities
- You solve problems at their root, stepping back to understand the broader context.
- You develop pragmatic solutions and build flexible systems that balance engineering complexity and timely delivery, creating business impact.
- You understand a broad range of data structures and algorithms and apply them to deliver high-performing applications.
- You recognize and use design patterns to solve business problems.
- You understand how operating systems work, perform and scale.
- You continually align your work with Amazon’s business objectives and seek to deliver business value.
- You collaborate to ensure that decisions are based on the merit of the proposal, not the proposer.
- You proactively support knowledge-sharing and build good working relationships within the team and with others in Amazon.
- You communicate clearly with your team and with other groups and listen effectively.
Skills & Experience
- Bachelors or Masters in Computer Science or relevant technical field.
- Experience in software development and full product life-cycle.
- Excellent programming skills in any object oriented programming languages - preferably Java, C/C++/C#, Perl, Python, or Ruby.
- Strong knowledge of data structures, algorithms, and designing for performance, scalability, and availability.
- Proficiency in SQL and data modeling.
Responsibilities Include
You will break down business opportunities and problems into software solutions. You will work closely with the CTO to help product and marketing stakeholders distill the product vision and roadmap, into a technology vision. You will be responsible for the evolution of an already bleeding-edge highly distributed systems at the back-end, and would need to work with front-end architects to come up with the best user experience for the gaming platform. You will be required to make decisions quickly, and work under strict timelines. You would lead technology strategy through analysis of market trends and product requirements. You would help set coding guidelines and help bring the most modern tools to keep engineering processes most efficient.
Requirements
- B.E/MS in Computer Science or equivalent.
- 10+ years or more of progressive software technology experience with at least 3 years in an architectural role.
- Completely hands on with technology and architecture. Start-up experience is a huge plus.
- Ability to quickly prototype and demonstrate technology value adds and educate + drive adoption within the extended technology team
- Excellent and robust understanding of scalable product system architecture(s), platforms and core technologies
- Demonstrated problem-solving and leadership skills to pursue correct engineering process in adverse conditions. Ability to embrace and demonstrate leadership beyond ownership
- Work with engineering leadership to setup and manage processes.
- Track record of thought leadership and out of the box thinking in the technology arena.
- Ability to work efficiently in an entrepreneurial and in a start-up environment
- A Java/Spring/Akka, Javascript or Golang rockstar.
- Deep and hands on knowledge of some of these technologies - MySQL, NodeJS, message brokers such as Kafka/RabbitMQ, NoSQL datastore such as Mongo, Cassandra, Arango, distributed caches such as Redis/memcached, container technology such as Docker and Kubernetes etc.
- Great proficiency in distributed systems design, with an ability to make the right trade-offs for creating future-proof solutions.
- Building quick PoCs and full-fledged solutions with various AWS managed services would be a big plus.







