Python Developer

Profile: AWS Data Engineer

Mode- Hybrid

Experience- 5+7 years

Locations - Bengaluru, Pune, Chennai, Mumbai, Gurugram

Roles and Responsibilities

• Design and maintain ETL pipelines using AWS Glue and Python/PySpark
• Optimize SQL queries for Redshift and Athena
• Develop Lambda functions for serverless data processing
• Configure AWS DMS for database migration and replication
• Implement infrastructure as code with CloudFormation
• Build optimized data models for performance
• Manage RDS databases and AWS service integrations
• Troubleshoot and improve data processing efficiency
• Gather requirements from business stakeholders
• Implement data quality checks and validation
• Document data pipelines and architecture
• Monitor workflows and implement alerting
• Keep current with AWS services and best practices

Required Technical Expertise:

• Python/PySpark for data processing
• AWS Glue for ETL operations
• Redshift and Athena for data querying
• AWS Lambda and serverless architecture
• AWS DMS and RDS management
• CloudFormation for infrastructure
• SQL optimization and performance tuning

Bidgely is seeking an outstanding and deeply technical Principal Engineer / Sr. Principal Engineer / Architect to lead the architecture and evolution of our next-generation data and platform infrastructure. This is a senior IC role for someone who loves solving complex problems at scale, thrives in high-ownership environments, and influences engineering direction across teams.

You will be instrumental in designing scalable and resilient platform components that can handle trillions of data points, integrate machine learning pipelines, and support advanced energy analytics. As we evolve our systems for the future of clean energy, you will play a critical role in shaping the platform that powers all Bidgely products.

Responsibilities

• Architect & Design: Lead the end-to-end architecture of core platform components – from ingestion pipelines to ML orchestration and serving layers. Architect for scale (200Bn+ daily data points), performance, and flexibility.
• Technical Leadership: Act as a thought leader and trusted advisor for engineering teams. Review designs, guide critical decisions, and set high standards for software engineering excellence.
• Platform Evolution: Define and evolve the platform’s vision, making key choices in data processing, storage, orchestration, and cloud-native patterns.
• Mentorship: Coach senior engineers and staff on architecture, engineering best practices, and system thinking. Foster a culture of engineering excellence and continuous improvement.
• Innovation & Research: Evaluate and experiment with emerging technologies (e.g., event-driven architectures, AI infrastructure, new cloud-native tools) to stay ahead of the curve.
• Cross-functional Collaboration: Partner with Engineering Managers, Product Managers, and Data Scientists to align platform capabilities with product needs.
• Non-functional Leadership: Ensure systems are secure, observable, resilient, performant, and cost-efficient. Drive excellence in areas like compliance, DevSecOps, and cloud cost optimization.
• GenAI Integration: Explore and drive adoption of Generative AI to enhance developer productivity, platform intelligence, and automation of repetitive engineering tasks.

Requirements:

• 8+ years of experience in backend/platform architecture roles, ideally with experience at scale.
• Deep expertise in distributed systems, data engineering stacks (Kafka, Spark, HDFS, NoSQL DBs like Cassandra/ElasticSearch), and cloud-native infrastructure (AWS, GCP, or Azure).
• Proven ability to architect high-throughput, low-latency systems with batch + real-time processing.
• Experience designing and implementing DAG-based data processing and orchestration systems.
• Proficient in Java (Spring Boot, REST), and comfortable with infrastructure-as-code and CI/CD practices.
• Strong understanding of non-functional areas: security, scalability, observability, and
• compliance.
• Exceptional problem-solving skills and a data-driven approach to decision-making.
• Excellent communication and collaboration skills with the ability to influence at all levels.
• Prior experience working in a SaaS environment is a strong plus.
• Experience with GenAI tools or frameworks (e.g., LLMs, embedding models, prompt engineering, RAG, Copilot-like integrations) to accelerate engineering workflows or enhance platform intelligence is highly desirable.

• You have 3+ years of experience using Golang/ Go Programming development language.
• You can write clean, high-quality code in a variety of languages and are also able to spot (and improve) bad code
• You have experience with Agile, Lean and/or Continuous Delivery approaches such as Continuous Integration, TDD, Infrastructure as Code, etc.
• Bonus points if you have knowledge of cloud technology such as AWS, Docker or Kubernetes

Looking to hire a single backend engineer who will become a part of the core team, with the track to become a part of the leadership at our company.

Candidate should have worked in startups, possess strong programming skills in Python, displays a sense of ownership and is highly energetic and eager to learn state-of-the-art tech and ML.

A minimum of 2 years of relevant experience is preferred.

2022 or later year pass outs - please apply only if you have relevant full-time and at least 2 prior internships experience

Representative (not exhaustive) responsibilities:

• Assess the current design and infrastructure of the backend server, and continuously implement enhancements to make the systems more robust, reliable and responsive
• Design, implement, test, and deploy APIs with Python on Linux servers
• Enhance back-end functionality and integrate with the front end to deliver a fully functional product
• Implement and set up automated tests to periodically test backend infrastructure for reliability, security and performance
• Design new data pipelines to enable the production deployment of new models
• Mentor junior employees and interns in the company
• Additionally, interest and ability to contribute to the continuous enhancement of our state-of-the-art NLP model pipeline and Inferencing engine is a big plus
• Be ready to roll up your sleeves and participate in customer calls, understand our ICP well, do research around product features, etc.

Fast Track Your Application

Think about the ICP for ContractKen. Sign up for a trial plan, experience the product and provide feedback on how to improve the current experience of the product to add immediate value to the ICP. We don't need you to fully code any feature in its entirety and are not looking for free work. The idea is to identify folks who get** what we are trying to do with ContractKen and find faster alignment with the right candidate.

Do not apply if

You're looking for your first, real-world model building, ML/AI role. We believe that deploying existing models (open source and proprietary) in production and delivering real business value to our customers is 10x more important than hyperparameter tuning or the latest algorithm implementation. While we'd love to entertain experienced ML data scientists, the emphasis on MLOps is as much as it is on experimentation.

• 3+ years of experience in Ruby / RoR
  • Experience with data files processing (xls, csv, json, xls, text: 834, NACHA, segments)
  • Experience working with relational databases (PostgreSQL)
  • Experience with Git
  • Good written and spoken English (Intermediate and higher)
  • Experience deploying Rails applications
  • RESTful API, JSON API

Will be a plus:
• Experience working with Unit and Integration Testing (Rspec, Capybara)
• Experience of integration with 3rd party systems and services and cloud technologies ( AWS stack: EC2, RDS, S3, etc.)
• Experience with RuboCop, JSHint/JSLint
• Experience with Microservice Architecture
• Knowledge of HTML5, CSS3
• Experience working with modern JavaScript frameworks — Ember.js, Vue.js

Intro

EAGLE Power Holdings aims to launch a portfolio of new energy retail brands, all of which enjoy the efficiency of a single technology platform. We want to do more than offer cheap "green" tariffs, and believe that our range of engaging brands can identify with shifts in consumer preferences (e.g. growth of EV usage), with the value of local communities, and with proactive support of broader ESG causes.

Our long-term strategy is technology-driven, and involves unlocking value through the digitalisation of processes around customer acquisition, engagement, and retention.
Developers at EAGLE flourish in an agile process where collaboration and ego-free communication is valued. We believe in developing working software throughout the entire product development process. We engage in product thinking as a team and cross-functionality among product managers, designers, and domain experts is promoted.

How you fit in

Engineering is the executional function of EAGLE's software delivery wing. As a server-side developer at Eagle, you will take the lead on implementing various software services of our core energy retail infrastructure. Not only are you expected to write clean, tested, and maintainable code, you will also be a central part of a product team that iterates constantly, ships regularly, and learns continuously. You will have the creative freedom for learning, experimenting, and responsible risk-taking in a startup environment.

What your role consists of:

• Develop enterprise-scale backend services using Golang

• Collaborate with engineers, UI/UX designers, and product owners to build & ship new features and maintain/enhance existing ones

• Independently come up with extensible low-level software design. Write modular, tested, readable and performant code

• Debug production issues across services and multiple levels of the stack

• Help inform product prioritisation and scoping decisions by evaluating technical complexity and risk

• Improve engineering standards, tooling, and processes

• Maintain technical documentation

What you bring to this role:

• At least 1-3 years of demonstrated ability to rely on an iterative process to maintain momentum on projects in a distributed, collaborative, agile environment
• An ownership mindset: you should look not only at what you’re asked to do, but ask why you’re doing it and how it impacts on the rest of the product, our customers, and whether it makes sense
• Comfort with low-level engineering and ability to write efficient, performant and tested code
• Think deeply about systems and services and write high-quality code. We work mostly in Golang, with AWS Cloudformation. However, languages can be learned: we care much more about your general engineering skill than - knowledge of a particular language or framework.
• Excellent communication skills and ability to give and receive constructive feedback
• Passion for the whole product process. You will have your specific areas of focus, but we find those that are passionate about the bigger picture collaborate best with cross-functional teams

Where we are

While the company is registered in the UK, the software delivery wing is built to be remote-first. Whether you prefer to be in situ or a digital nomad (or anything in between), you are welcome. We are not inclined to support relocation to London for candidates that are not already based there, as we are a remote-first company. 

What’s in it for you

We offer competitive salaries based on prevailing rates in your local employment market, but there is further room to negotiate if you are the right candidate. In addition to your basic package, you can expect to receive the following benefits:

• Flexible working hours
• Unlimited annual leave
• On-the-job coaching, and access to mentorship by industry and domain thought leaders
• Full or partial sponsorship for professional/skill development courses, certifications, and other learning opportunities (evaluated on a case-by-case basis)
• Monthly allowance package for remote working (coworking membership or cash allowance)

About EAGLE Power Holdings

In a nutshell: Transforming energy retail and supply through cutting-edge software and AI technology

The venture is in ‘stealth mode’ as we lay the foundations for blast-off. It has been launched by a team with a history of entrepreneurial successes. These include one in the climate change space which services the Californian and North America carbon markets, and another which provides highly refined machine learning software to the energy arena in Asia. Both companies were acquired last year. 

This start-up was launched in London at the end of 2020, and will focus on the deregulated energy market in GB. The mission is to discover, or invent, a viable business and operational model for energy retail within the near-zero-cost energy ecosystem that the world is moving towards. This transformation is driven by the ever-decreasing prices of renewables/alternative generation, and by the exponentially growing volumes of national energy system data. We believe these factors have yet to truly disrupt the market, and intend to accelerate the sharing of value back to consumers.

Responsibilities:

• Your primary responsibility as a senior backend engineer will be to architect and develop a scalable and robust micro-services backend with strong Java, Spring(Boot), SQL, AWS/GCP.
• Experience being part of a software development team in an Agile/Lean/Continuous Delivery environment
• Be a key performer in a high-performance product engineering team

Qualifications:

• 2 to 4 years of overall IT experience. Most of this experience in Java (Core Java, Spring boot, Java collections, Java Multithreading)
• Should have experience designing database schemas - SQL and NoSQL.
• Exposure to frameworks like Spring, Hibernate, Play would be a plus
• Experience with microservices architecture would be beneficial.
• Working knowledge of any public cloud (AWS, GCP or Azure)
• Broad understanding and experience of real-time analytics, NoSQL data stores, data modeling and data management, analytical tools, languages, or libraries
• Knowledge of container tech like Docker, Kubernetes would be a plus.
• Bachelor's Degree in Computer Science or Engineering.