

Profile: AWS Data Engineer
Mode- Hybrid
Experience- 5+7 years
Locations - Bengaluru, Pune, Chennai, Mumbai, Gurugram
Roles and Responsibilities
- Design and maintain ETL pipelines using AWS Glue and Python/PySpark
- Optimize SQL queries for Redshift and Athena
- Develop Lambda functions for serverless data processing
- Configure AWS DMS for database migration and replication
- Implement infrastructure as code with CloudFormation
- Build optimized data models for performance
- Manage RDS databases and AWS service integrations
- Troubleshoot and improve data processing efficiency
- Gather requirements from business stakeholders
- Implement data quality checks and validation
- Document data pipelines and architecture
- Monitor workflows and implement alerting
- Keep current with AWS services and best practices
Required Technical Expertise:
- Python/PySpark for data processing
- AWS Glue for ETL operations
- Redshift and Athena for data querying
- AWS Lambda and serverless architecture
- AWS DMS and RDS management
- CloudFormation for infrastructure
- SQL optimization and performance tuning

Similar jobs

Need Immediate Joiners only (4-5 days)
Overall experience 6+ years and relevant at least 2+ years in Golang with Java
● Strong design and architectural experience in building various highly-scalable and
highly-available products
● Strong understanding of the SDLC Activities which include Analysis, Design, Development,
Testing, Deployment and Post-Production Support etc.
● Proficiency in at least one server side framework for languages preferably Go Lang
● Experience working on NoSQL & SQL Databases such as MySQL, PostgreSQL, MongoDB,
Redis etc
● Deep Dive, problem-solving, RCA and systematic thinking to reach the cause of issues
● Able to work independently and multi-task effectively
● Program at a system level and able to manage service stability
● Excellent experience maintaining, scalable, extensible code
● Methodical in maintaining up to date documentation
● Metric-driven mindset and obsessive about ensuring clean coding practices
● Preferred experience in product development
● Preferred working experience on microservices platforms
● Proficiency in at least one modern web front-end development framework such as React JS
will be a bonus
Good to Have Skills:
● Preferred experience in Elasticsearch and Kibana (ELK Stack)
● Preferred experience with messaging systems like RabbitMQ


Role Responsibilities:
- Development and Maintenance of REST APIs: Lead the creation and management of our RESTful APIs, ensuring top-notch performance and alignment with evolving requirements.
- Proficiency in Coding: We're in search of expertise in Python or equivalent programming languages. Your coding skills will play a pivotal role in delivering high-quality (efficient, reusable, testable, and scalable) solutions.
- Unit and Integration Testing: Apply your expertise to craft unit and integration tests, upholding code quality and reliability.
- Version Control Systems: Proficiency in Distributed Version Control Systems is vital for seamless collaboration during development.
- Elasticsearch Expertise: Having valuable experience with Elasticsearch is a plus, given its critical role in data retrieval and search functionalities.
- NOSQL Database Familiarity: Knowledge of NOSQL databases like Cassandra and MongoDB will be advantageous.
- Message Broker Knowledge: Understanding message brokers, especially RabbitMQ, is beneficial for effective communication within our systems.
Desired Qualifications:
- Experience: 1-2 years of hands-on experience as a Python developer.
- AWS: Proficiency in AWS cloud management and architecting enterprise data solutions.
- Pragmatic Problem-Solving: Recognize when a solution should be streamlined and when creating the right abstraction will lead to long-term efficiency gains.
- Passion for Quality: Demonstrate dedication to producing work of the highest quality and following best practices.
- Agile/Lean Process: Familiarity with Agile/Lean methodologies is a plus, reflecting your adaptability and collaborative spirit.
- Startup Mindset: Embrace the challenges and opportunities of a startup environment, contributing your skills and insights to our growth.
- Debugging and Optimization: Showcase excellent debugging and optimization capabilities to enhance system performance.
- Tech Awareness: Stay updated on emerging technologies and possess a solid understanding of the full product development life cycle.
- UX and Information Architecture: Exhibit excellent knowledge of mobile user experience, information architecture, and industry trends.

- Experience - 6-10 years
- Key Skills for Software Developer C++, Linux with SQL:
- - Looking only for candidates who can join immediately or max 10 day
- - should be able to work independently with no handholding
- - the ability to work with C/C++ code on Windows/Linux platforms
- - Database knowledge of MSSQL, Oracle, MySQL/MariaDB, ideally other ones too: Saphana, Teradata, Postgres.
- - Ability to work on their own fixing defects
- - should be able to understand secure coding practices
- - should have the Ability to work independently and with the team across different time zones


Company Description
SteelEye is a fast growing FinTech company based in London and has offices in Bangalore and Paris, that offers a data platform to help financial institutions such as Investment Banks, Hedge Funds, Brokerage Firms, Asset Management Firms to comply with financial regulations in the European Union. Our clients can aggregate, search, surveillance and report on trade, communications and market data. SteelEye also enables customers to gain powerful insights from their data, helping them to trade with greater efficiency and profitability.
The company has a highly experienced management team and a strong board, who have decades of technology and management experience and worked in senior positions at many leading international financial businesses.
We are looking to hire a seasoned Sr API Developer to join us as we start on our next phase of growth. We have a culture of openness, collaboration, and the passion to get things done whilst appreciating the importance of a good work life balance.
Being part of a start-up can be equally exciting as it is challenging. You will be part of the SteelEye team not just because of your talent but also because of your entrepreneurial flare which we thrive on at SteelEye. This means we want you to be curious, contribute, ask questions and share ideas. We encourage you to get involved in helping shape our business.
SteelEye is a fast growing FinTech company based in London and has offices in Bangalore and Paris, that offers a data platform to help financial institutions such as Investment Banks, Hedge Funds, Brokerage Firms, Asset Management Firms to comply with financial regulations in the European Union. Our clients can aggregate, search, surveillance and report on trade, communications and market data. SteelEye also enables customers to gain powerful insights from their data, helping them to trade with greater efficiency and profitability.
The company has a highly experienced management team and a strong board, who have decades of technology and management experience and worked in senior positions at many leading international financial businesses.
We are looking to hire a seasoned Sr API Developer to join us as we start on our next phase of growth. We have a culture of openness, collaboration, and the passion to get things done whilst appreciating the importance of a good work life balance.
Being part of a start-up can be equally exciting as it is challenging. You will be part of the SteelEye team not just because of your talent but also because of your entrepreneurial flare which we thrive on at SteelEye. This means we want you to be curious, contribute, ask questions and share ideas. We encourage you to get involved in helping shape our business.
Job Description
What you’ll do
- Develop new features and functionality in SteelEye's best breed SaaS application
- Work on setup API Developer for our growing SaaS product
- Ensure the software is up-to-date with latest technologies
- Triage issues and enhance core features of our existing API's for rapidly growing client base
- Design and architech our API layer solving problems around scale and performance
- Be part of great team building a fantastic product!
What we’re looking for
- You are experienced Python Developer, with minimum 5 years in commercial Python experience
- You have experience building REST-based API's using Flask, Django or FastAPI in a production environment
- You have excellent knowledge of data structures, software design patterns and software architecture
- You are comfortable working in a fast-paced environment and can adapt to changing requirements
- You have experience with code versioning (Git) and CI/CD (Jenkins, Circle, etc..) tools
- Familiarity/Experience with Elasticsearch is a huge plus
- Familiarity/Experience with FastAPI nice to have
- You are experienced Python Developer, with minimum 5 years in commercial Python experience
- You have experience building REST-based API's using Flask, Django or FastAPI in a production environment
- You have excellent knowledge of data structures, software design patterns and software architecture
- You are comfortable working in a fast-paced environment and can adapt to changing requirements
- You have experience with code versioning (Git) and CI/CD (Jenkins, Circle, etc..) tools
- Familiarity/Experience with Elasticsearch is a huge plus
- Familiarity/Experience with FastAPI nice to have


Responsibilities:
Drives technology stack choices for treebo tech teams.
Comfortable working in fuzzy environments and changing requirements.
Act as a technical mentor to your team.
Requirements:
Effective problem solving skills in complex & large scale environment.
Exposure in Distributed systems and micro services.
Exposure to a wide variety of problem spaces, technologies.
Very Strong System design, separation of concerns and OO design skills
with ability to craft crisp interfaces and communicate at the right
levels of abstraction.
His / her code should be model code for the rest of the engineering
organisation.
Experience working with web-scale / user path systems.
Experience working with large scale persistent systems including NoSQL
databases.
3 - 6 years of overall experience.
B Tech or higher in Computer Science or equivalent required.
What you'll do
Technology is at the heart of our organization. We have a strong engineering team and we're looking for an experienced engineer to lead our backend engineering team. As part of the tech team, you will Understand product requirements and brainstorm ways to address them
- Lead large initiatives and be responsible for it
- Mentor teammates
- Set and enforce standards for writing and maintaining efficient code
- Influence team decisions in the overall architecture and practices of the company
- Contribute to company growth by participating in hiring activities
What you'll need
Must-haves
- At least 4 years experience in a product based company
- Experience working with distributed environments at scale
- Strong command on at least one Object Oriented Programming language
- Experience leading developers for large scale products
- Demonstrated capability to design and architect products built for scale
- Deep knowledge of multiple AWS services
- Experience with Docker and Kubernetes
Good to have
- Experience with at least one among C++, Java
- Experience with Linux file systems
- Familiarity with agile development methodologies
Why us
We're hiring a set of highly skilled, enthusiastic, and passionate people who thrive in a high-growth environment. We believe the best way to grow is to give everyone the opportunity to pursue their interests. At Lucidity, you have complete freedom to work on projects that interest you. Plus, with benefits like flexible hours, company offsites, unlimited leaves, we ensure you enjoy the journey as much as we do. We are also offering healthy founding team ESOP's.

About MoEngage
MoEngage is a fast-paced startup that’s helping companies run smart marketing efforts in their effort to reach the customer. We are a leading Marketing Technology Stack provider that is helping brands redefine their customer engagement in the mobile era. Brands use MoEngage to drive long-term, personalised and context-based engagement across channels to help achieve increased customer retention as well as customer LTV. Sitting at a conflux of diverse technologies like Artificial Intelligence, Big Data, Web & Mobile platforms, MoEngage technology analyses billions of data points generated by customers and their devices, to predict customer behavior and build marketing campaigns that proactively engage users.
In just four years since inception, MoEngage is working with leading brands across e-commerce, entertainment, travel, publishing and banking domains among others. With marquee clients like Vodafone, Oyo, Airtel, McAfee, MoEngage has over 125+ paying Customers in the Enterprise & Internet companies space in India, US, South East Asia & EU. With a global presence spanning 35 countries, MoEngage has offices in San Francisco, Berlin, Jakarta, and Bengaluru.
Today, MoEngage is an industry pioneer in the space and engages more than 350M devices. This includes approximately 40B events tracked per month, 30B+ messages sent, to millions of users across the globe.
As part of the Engineering team at MoEngage, here are some things you can expect:
- Take ownership and be responsible for what you build - no micro management
- Work with A players (some of the best talent in the country), and expedite your learning curve and career growth
- Make in India and build for the world at scale of 350M active users, which no other internet company in the country has seen
- Learn together from different teams on how they scale to millions of users and billions of messages.
- Explore the latest in topics like Data Pipeline, MongoDB, ElasticSearch, Kafka, Spark, Samza and share with the team
and more importantly have fun while you work on scaling MoEngage.
About Push team,
Push team is one of the core teams at MoEngage, responsible for sending close to a billion notifications everyday to help clients engage their users better. As a member of the Push team, you will be working on developing high performance solutions to deliver personalised and context-based notifications across various channels to help achieve increased customer retention as well as customer LTV. You will also be working on designing and building features to help clients to provide customised experience for end users allowing them to have a more personalised experience at scale. Here you will have a chance to own systems and develop features end to end i.e right from inception to deployment. Though we work at scale, reliability is of utmost importance for us and we build in house solutions like Campaign Watcher & AutoBatchRunner to ensure 100% transparency and delivery of notifications
- Scaling campaign sending system to ensure industry leading delivery times (40 Million notifications under 2 minutes)
- Rich campaign content delivery and templating support
- Build and develop features to have appealing and consistent experiences across channels which touch 200+ customers and 200+ million users!
Skill Requirements
- Proven experience in handling large infrastructure and distributed systems
- Familiarity with Python related technologies and frameworks like Django or Pyramid.
- Familiarity with at least one of the cloud computing infrastructure - GCP / Azure / AWS
- Familiarity with task queue frameworks like Celery or Pika is a plus.
- Tech Stack - Python, Falcon, Elastic Search, MongoDB, AWS (SQS S3), Linux, Map Reduce









