

Profile: AWS Data Engineer
Mode- Hybrid
Experience- 5+7 years
Locations - Bengaluru, Pune, Chennai, Mumbai, Gurugram
Roles and Responsibilities
- Design and maintain ETL pipelines using AWS Glue and Python/PySpark
- Optimize SQL queries for Redshift and Athena
- Develop Lambda functions for serverless data processing
- Configure AWS DMS for database migration and replication
- Implement infrastructure as code with CloudFormation
- Build optimized data models for performance
- Manage RDS databases and AWS service integrations
- Troubleshoot and improve data processing efficiency
- Gather requirements from business stakeholders
- Implement data quality checks and validation
- Document data pipelines and architecture
- Monitor workflows and implement alerting
- Keep current with AWS services and best practices
Required Technical Expertise:
- Python/PySpark for data processing
- AWS Glue for ETL operations
- Redshift and Athena for data querying
- AWS Lambda and serverless architecture
- AWS DMS and RDS management
- CloudFormation for infrastructure
- SQL optimization and performance tuning

Similar jobs

About Shopalyst:
Shopalyst offers a Discovery Commerce platform for digital marketers. Combining data, AI and deep integrations with digital media and e-commerce platforms, Shopalyst connects people with products they love. More than 500 marquee brands leverage our SaaS platform for data driven marketing and sales in 30 countries across Asia, Europe and Americas. We have offices in Fremont CA, Bangalore, and Trivandrum. Our company is backed by Kalaari Capital.
About the Role: Software Engineer (Python)
We are currently looking for people to join our Engineering team where internet scale, reliability, security, high performance and self-management drives almost every design decision that we take. This role will be based out of Thiruvananthapuram, Kerala.
We are looking for Software Engineers to help us build functional products and applications. Software Engineers responsibilities include participating in software design, writing clean and efficient code adhering to coding standards, guidelines & best practices for various applications, running tests to improve system functionality, performance & security and documenting design and code.
Responsibilities
- Collaborate with cross-functional teams to design and develop robust and scalable server-side applications using Node.js.
- Utilize Python to write batch jobs and scripts for various automation tasks, ensuring efficiency and reliability.
- Write clean, efficient, and well-documented code to deliver high-quality software solutions.
- Troubleshoot and resolve bugs and other performance issues to maintain system stability.
- Participate in code reviews to ensure code quality and compliance with coding standards.
- Collaborate with front-end developers to integrate user-facing elements with server-side logic.
- Mentor junior developers and share knowledge to foster a collaborative learning environment.
Must Have requirements
- Strong understanding of Node.js and its core concepts, such as event-driven. architecture, asynchronous programming, and callbacks.
- Proficiency in Python, with a strong understanding of its ecosystem, libraries, and frameworks.
- Proven 1-5 years of experience working as a Node.js/Python Developer or in a similar role.
- Strong communication and collaboration skills, with the ability to work effectively in a team-oriented environment.
- Excellent problem-solving and analytical skills, with the ability to troubleshoot complex technical issues.
- Strong working knowledge in any NoSQL (preferable)or relational databases
- Good exposure to working on Linux/Unix systems.
- Proficient understanding of code versioning tools (such as Git)
Nice to have requirements
- Proficiency in TypeScript to write scalable and maintainable code.
- Familiarity with cloud platforms like AWS.
- Basic understanding of GoLang/Java as a coding language

Design, test, and build scalable backend python services
Closely collaborate with marketing and product teams to build innovative, robust and
easy-to-use features that serve.
Developing high quality code based on detailed designs that cater to the product
requirements.
Responsible for troubleshooting, testing and maintaining the core product software and
databases to ensure strong optimisation and functionality
Required Skills:
Degree in Computer Science, Software Engineering or equivalent.
Minimum 3+ years experience in software development.
Expertise in Python 3.7, Django 2.2+ and REST APIs.
Willingness to learn and ability to flourish in a dynamic, high-growth, entrepreneurial
environment
Hands-on, self-starter, capable of working independently


1. Proficiency in Python 3.x based web and backend development
2. Solid understanding of Python concepts
3. Experience with some form of Machine Learning (ML)
4. Experience in using libraries such as Numpy and Pandas
5. Some form of experience with NLP and Deep Learning using any of Pytorch, Tensorflow, Keras, Scikit-learn or similar
6. Hands on experience with RDBMS such as Postgres or MySQL
7. Experience building REST APIs using DRF or Flask
8. Comfort with Git repositories, branching and deployment using Git
9. Working experience with Docker
10. Basic working knowledge of ReactJs
11. Experience in deploying Django applications to AWS,Digital Ocean or Heroku

We are seeking a talented and motivated Backend Developer to join our dynamic team. As a senior Backend Developer, you will play a crucial role in enhancing and expanding our AI productivity tool, working on the intersection of natural language understanding (NLU), event-condition-action (ECA) frameworks.
Key Responsibilities:
- Collaborate with cross-functional teams to design and implement advanced features for our AI productivity tool.
- Innovate and propose creative solutions to enhance the functionality and user experience of the platform.
- Develop back-end components of the AI productivity tool, ensuring performance and scalability.
- Design and implement robust backend services and APIs using Python- Django.
Requirements:
- Bachelor's/Master's degree in Computer Science or a related field.
- Proven experience (3-4 years) as a Software Development Engineer, with a focus on Python- Django
- Strong problem-solving skills and the ability to think creatively.
- Ability to take up different tech stacks.
- Mathematical experience preferred.
- Proficiency in Backend Technologies as well as a basic understanding of Frontend technologies.
Nice-to-Haves:
- Experience with cloud platforms and services.
- Experience with Frontend Technologies.
- Track record of contributing to open-source projects.
- Passion for staying updated on the latest trends in AI and technology.
- Analyze highly complex business requirements;
- generate technical specifications to design or redesign complex software components and applications;
- Acts as an expert technical resource for modeling, simulation and analysis efforts;
- Adapt to change quickly and adjust work accordingly in a positive manner;
- Be flexible and thrive in an evolving environment;
- Individual contributor to build the application for e-commerce platform;
- Assures quality, security and compliance requirements are met for supported areas;
- Working in cloud data stores to include S3, DynamoDB and/or Amazon RDS;
- Perform test automation in a test-driven development environment;
- Implement DevOps concepts, tools and continuous delivery pipelines - Bamboo, Jenkins, Maven, Bitbucket, Jira, etc;
- Implement instrumentation to gather business-specific metrics around consumer usage patterns;
Infrastructure
Pocket Gems wants to build the greatest games and interactive entertainment in the world.
That’s the mission our founders began within an apartment above a pizza shop back in 2009
and we continue it today.
Pocket Gems has grown to over 250 people in San Francisco. With $155 million in backing from
Sequoia Capital and Tencent, we’re constantly breaking new ground with graphically rich mobile
games, fun new genres of mobile entertainment, and innovative technologies like our mobilefirst Mantis Engine.
Our products have been downloaded over 325 million times by players around the world. We
have several flagship products including the most recent - Adventure Chef Merge Explorer, a
casual merge and explore game. Some of our other ongoing hits include Episode, a mobile
storytelling network and platform, and War Dragons, a visually stunning 3D real-time strategy
game.
Pocket Gems is home to some of the most massive and delightful mobile-first games, like War
Dragons and Episode. Those games need a solid backend platform, to function critical tasks to
delight our players, and is supported and optimized by our Central Engineering team. As a Sr.
Software Engineer on the Central Infrastructure Team, you will build microservices that acts as
the core of all our games, facilitate the processing and recording of billions of events per day,
support critical systems for marketing, finance. You will be responsible for some of our biggest
projects as you build APIs and infrastructure that scales to millions of players in real-time
games.
What You’ll Do:
• Implement flexible, reusable, and scalable solutions to improve our data pipeline
• Develop microservices for critical infrastructure like A/B tests, Offer recommendation, etc
that is mission-critical to the business
• Develop microservices for our games such as real-time communication platforms,
leaderboard, etc
• Build and maintain integrations with third-party APIs that you suggest or write yourself
• Build scalable web tools (including open source tools) to support data analysis and
visualization for the company and influence what we build for our games’ players
What You Bring to the Central Infrastructure Engineering team:
• Minimum of 7 years of professional experience (including 3+ years backend experience)
• A degree in computer science, engineering, or relevant field
• Experience leading complex projects, preferably involving distributed systems
• Deep experience with AWS, GCP, or Hadoop, and related backend technologies is a
plus
• Strong skills in data structures, algorithms, software design, and OOP
• A love for delighting users, both internal and external, with reliable tools, data, and
creative and highly technical solutions to their problems
Extra Gems for:
• Experience in working with microservices



- B Tech/BE or M.Tech/ME in Computer Science or equivalent from a reputed college.
- Experience level of 7+ years in building large scale applications.
- Strong problem solving skills, data structures and algorithms.
- Experience with distributed systems handling large amount of data.
- Excellent coding skills in Java / Python / Node / Go.
- Very good understanding of Web Technologies.
- Very good understanding of any RDBMS and/or messaging.

What we are looking for:
Strong Coding and design skills
Good command over Data Structures & Algorithms
The ability to produce bug-free and production-grade code
Skills we consider: MYSQL, Python, Django, MongoDB, React.JS, Angular.JS, D3.Js, Node.js, Express.JS, InfluxDb, Redis, Kafka, Garafana, Elastic Search, Docker, AWS, Java, Spring Boot, C++
Key Deliverables:-
1. Develop a very high sense of ownership, the zeal to build scalable applications
2. Develop a deep understanding of the start-up ecosystem
Work with a performance-oriented team driven by ownership and open to experiments
3. Build a customer-facing technology product for global customers
Design and develop end to end applications with very high quality
What we have to offer:-
1. Work with a performance-oriented team driven by ownership and open to experiments
2. Learn to design systems for high accuracy, efficiency, and scalability
Focus on delivering quality work within deadlines.
3. Candid culture. No politics.
4. As a team, we value ownership, continuous learning, consistency, and discipline.




