BackEnd Engineer - Python

We are looking for a skilled and motivated Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data pipelines. The role involves working with various GCP services, implementing data ingestion and transformation logic, and ensuring data quality and consistency across systems.

Key Responsibilities:

• Design, develop, test, and maintain scalable ETL data pipelines using Python.
• Work extensively on Google Cloud Platform (GCP) services such as:
• Dataflow for real-time and batch data processing
• Cloud Functions for lightweight serverless compute
• BigQuery for data warehousing and analytics
• Cloud Composer for orchestration of data workflows (based on Apache Airflow)
• Google Cloud Storage (GCS) for managing data at scale
• IAM for access control and security
• Cloud Run for containerized applications
• Perform data ingestion from various sources and apply transformation and cleansing logic to ensure high-quality data delivery.
• Implement and enforce data quality checks, validation rules, and monitoring.
• Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver efficient data solutions.
• Manage version control using GitHub and participate in CI/CD pipeline deployments for data projects.
• Write complex SQL queries for data extraction and validation from relational databases such as SQL Server, Oracle, or PostgreSQL.
• Document pipeline designs, data flow diagrams, and operational support procedures.
• 
  

Required Skills:

• 4–8 years of hands-on experience in Python for backend or data engineering projects.
• Strong understanding and working experience with GCP cloud services (especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.).
• Solid understanding of data pipeline architecture, data integration, and transformation techniques.
• Experience in working with version control systems like GitHub and knowledge of CI/CD practices.
• Strong experience in SQL with at least one enterprise database (SQL Server, Oracle, PostgreSQL, etc.).

Requirements:

• Proficient in fundamental Software Design Principles, Data Structures, Algorithms, Problem Solving and Complexity Analysis.
• Proficient in programming languages like Python/Java/Javascript/Golang or similar.
• Strong understanding of professional software engineering practices & best practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations.
• Hands-on Experience with SQL/NoSQL databases such as Postgres, Mysql, MongoDB.
• Hands-on experience with GIT, CI/CD, REST APIs and Cloud ( AWS/ GCP/ Azure) will be preferred.
• Understanding of Microservice Architecture and System Design Principles is a plus.
• Self-driven, detail-oriented and Strong sense of ownership, urgency, and ability to deliver great work.
• Demonstrated expertise in developing, releasing and maintaining large scale software applications.

Must Have:

• Thorough experience (Sr. Developer: 3+ years) in core python as well as the Django framework.
• Deep understanding of designing and implementing REST web services/APIs.
• Ability to address authentication and security constraints efficiently.
• Knowledge about Amazon web services and ability to integrate it.
• Ability to write complex python utility scripts.
• Ability to deliver design documentations whenever needed.
• Knowledge of Version Control using SVN/GIT.
• Ability to analyse, debug and resolve basic to complex problems on-demand (independently).

Nice To Have:

• Knowledge with microservice architecture is a BIG plus.
• Knowledge of the docker platform to serve the applications in docker containers and being able to use docker compose will be a plus.
• Leadership and Time Management skills.

Required Skills:

● Expert in Python, with knowledge of at least Django (More web frameworks are a plus)

● Familiarity with some ORM (Object Relational Mapper) libraries

● Able to integrate multiple data sources and databases into one system

● Understanding of the threading limitations of Python, and multi-process architecture

● Good understanding of server-side templating languages (such as Jinja 2, Mako, etc depending on your technology stack)

● Basic understanding of front-end technologies, such as JavaScript, HTML5, and CSS3 (is a plus)

● Understanding of accessibility and security compliance

● Knowledge of user authentication and authorization between multiple systems, servers, and environments

● Understanding of fundamental design principles behind a scalable application

● Familiarity with event-driven programming in Python

● Understanding of the differences between multiple delivery platforms, such as mobile vs desktop, and optimizing output to match the specific platform

● Able to create database schemas that represent and support business processes

● Strong unit test and debugging skills

● Proficient understanding of code versioning tools

● Knowledge of application deployment process and server set up

● Integration of data storage solutions

Responsibilities:

● Owning one or more of the web services; adding new features, resolving bugs, and refactoring/ improving code base.

● Design and implementation of low-latency, high-availability, and performant applications

● Translating product requirements into functional, maintainable, extensible software that is in-line with company objectives.

● Good knowledge of software engineering best practices, including unit testing, code reviews, design documentation, debugging, troubleshooting, & agile development.

● Work on cutting-edge web technologies to make a powerful impact on 1M+ enterprise users

● Be part of a growing team that will design, develop, and test software and cross-product applications which span across different Planview products

● Work in an agile engineering team writing maintainable and scalable code for software components and influencing team decisions

● Contribute to the product’s architecture vision and execution, working closely with cross-product teams and other leaders within the R&D department

● Collaborate with stakeholders to imagine, design, develop, test, and launch software that impacts our customers and inspires your peers

● Drive continuous improvement of software quality, CX and maintainability of features

● Continuous learning of technology trends, tools, and approaches, including sharing this knowledge with your team

CoreStack, an AI-powered multi-cloud governance solution, empowers enterprises to rapidly achieve Continuous and Autonomous Cloud Governance at Scale. CoreStack enables enterprises to realize outcomes such as 40% decrease in cloud costs and 50% increase in operational efficiencies by governing operations, security, cost, access, and resources. CoreStack also assures 100% compliance with standards such as ISO, FedRAMP, NIST, HIPAA, PCI-DSS, AWS CIS & Well Architected Framework (WAF). We work with many large global customers across multiple industries including Financial Services, Healthcare, Retail, Education, Telecommunications, Technology and Government.

CoreStack closed a $8.5 million Series A financing recently. CoreStack was recognized as IDC Innovator in Cloud Management Solutions and in the Gartner Magic quadrant for Cloud Management Platforms in 2020. Earlier in 2019, Gartner named CoreStack as a Cool Vendor in Cloud Computing. CoreStack is a Microsoft Azure Gold & Co-Sell Partner and Amazon AWS Advanced Technology Partner.

CoreStack Offers

• Competitive salary
• Competitive benefit package with appreciable equity
• Exciting, fast-paced and entrepreneurial culture
• Health insurance and other company benefits

• Lead a full product development lifecycle from ideation, design, development, to roll out and support
• Own the delivery of multiple features of the product end to end while hands-on in development as well
• Advocate best development practices such as continuous integration/continuous delivery, automation (testing and infrastructure)

1. 7+ Years’ of experience, managing teams of 5+ people
2. Must have excellent programming, debugging and scripting skills with a solid understanding of Object Oriented Design principles.
3. Proficiency in at least two of the following: Java, NodeJS, Go, JavaScript, Python programming stacks, and passion for software engineering and craftsman-like coding prowess
4. Knowledge of software practices like refactoring, clean code, domain driven design, Encapsulation etc
5. Hands on experience managing databases like MongoDB, Cassandra, Redis.
6. Exposure to event driven systems and event streaming engines like Kafka
7. Good knowledge of DevOps tooling like docker, kubernetes, ansible/chef, AWS.