PythonWe are looking for a skilled and motivated Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data pipelines. The role involves working with various GCP services, implementing data ingestion and transformation logic, and ensuring data quality and consistency across systems.
Key Responsibilities:
- Design, develop, test, and maintain scalable ETL data pipelines using Python.
- Work extensively on Google Cloud Platform (GCP) services such as:
- Dataflow for real-time and batch data processing
- Cloud Functions for lightweight serverless compute
- BigQuery for data warehousing and analytics
- Cloud Composer for orchestration of data workflows (based on Apache Airflow)
- Google Cloud Storage (GCS) for managing data at scale
- IAM for access control and security
- Cloud Run for containerized applications
- Perform data ingestion from various sources and apply transformation and cleansing logic to ensure high-quality data delivery.
- Implement and enforce data quality checks, validation rules, and monitoring.
- Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver efficient data solutions.
- Manage version control using GitHub and participate in CI/CD pipeline deployments for data projects.
- Write complex SQL queries for data extraction and validation from relational databases such as SQL Server, Oracle, or PostgreSQL.
- Document pipeline designs, data flow diagrams, and operational support procedures.
Required Skills:
- 4–8 years of hands-on experience in Python for backend or data engineering projects.
- Strong understanding and working experience with GCP cloud services (especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.).
- Solid understanding of data pipeline architecture, data integration, and transformation techniques.
- Experience in working with version control systems like GitHub and knowledge of CI/CD practices.
- Strong experience in SQL with at least one enterprise database (SQL Server, Oracle, PostgreSQL, etc.).
Shubham Vishwakarma
Full Stack Developer - Averlon
About Egen Solutions
About
Company social profiles
Similar jobs
PythonJOB DESCRIPTION:
Location: Pune, Mumbai, Bangalore
Mode of Work : 3 days from Office
* Python : Strong expertise in data workflows and automation
* Pandas: For detailed data analysis and validation
* SQL: Querying and performing operations on Delta tables
* AWS Cloud: Compute and storage services
* OOPS concepts
PythonWhat We’re Looking For:
- Strong experience in Python (5+ years).
- Hands-on experience with any database (SQL or NoSQL).
- Experience with frameworks like Flask, FastAPI, or Django.
- Knowledge of ORMs, API development, and unit testing.
- Familiarity with Git and Agile methodologies.
- Familiarity with the Kafka tool (Added Advantage)
Python
DjangoKognitos is a cutting-edge automation platform that combines the power of Generative AI and Natural
Language Processing (NLP) to provide a conversational and intuitive experience for business users. As a
fully serverless, SaaS automation platform, Kognitos enables users to build, manage, and execute
automations in natural language, with the ability to process and understand domain-specific language.
Kognitos provides a detailed auditable view of its runs, allowing users to gain insights into why an action
happened or what might have gone wrong in case of an exceptional situation. Additionally, Kognitos's
conversational exception handling, powered by Generative AI, allows for quick and easy resolution of
unexpected system errors or business exceptions.
Responsibilities:
- Develop and maintain the backend infrastructure for our applications using Python and AWS Serverless
technologies.
- Collaborate with cross-functional teams to design and implement scalable and robust systems, including
microservices and cloud-based architectures.
- Ensure the reliability, scalability, and performance of the backend systems through monitoring and
optimization.
- Create and maintain database schema and queries to support the application features.
- Write unit and integration tests for the backend code and ensure code quality through code reviews.
- Continuously improve the software development process by incorporating best practices and modern
software development methodologies, such as Agile, DevOps, and CI/CD.
- Investigate and troubleshoot production issues and provide timely solutions to minimize downtime and
ensure smooth operations.
- Participate in architectural discussions and contribute to the development of technical solutions and best
practices.
- Stay up to date with the latest technologies and trends in software development and recommend
improvements to the technology stack to increase efficiency and scalability.
- Work in a fast-paced, collaborative environment with a focus on delivering high-quality software that
meets customer needs.
Required Experience/Skills:
- B.S. or higher degree in Computer Science/Engineering or similar field or equivalent work experience
- 4-20 years of industry experience (or equivalent)
- Proficient in Python programming language
- Experience with modern software development practices and methodologies, including Agile, DevOps,
and Continuous Integration/Continuous Delivery (CI/CD).
- Experience with large-scale distributed systems, microservices, and cloud-based architectures.
- Strong understanding of software design patterns, algorithms, data structures, and database technologies.
- A natural problem solver, with the ability to identify problems and lead the development of a solution.
PythonDjango
Flask- Implement security and data protection solutions
DjangoPython
PostgreSQLAs an Associate Software Engineer, you will have the opportunity to collaborate on the creation and maintenance of scalable, high-quality software as we grow. You'll work closely with the CTO and quickly gain skills and responsibilities as the team and the technical requirements grow.
Primary Responsibilities
- Develop RESTful APIs leveraging Django classes, ORM and Postgres Database
- Develop solutions that meet business objectives while leveraging industry best practices
- Write high-quality source code to program complete applications within deadlines
- Troubleshoot and debug applications
Technical Competencies
- Expertise with Python language
- Experience with Django: maintaining APIs
- Familiarity using Git, code repositories, branching and merging strategies
- Ability to break down complex concepts, tasks, or problems into more simple, understandable language and action plans
- Excellent communication skills, and attention to detail
- Good Documentation skills
Perks
- Work from home
- Flexible work schedule
- Flexible standup meetings
Interview Process
- Two technical rounds with Senior Developer and CTO
- Cultural Fit interview with Project Manager
Please do not apply if you don't have professional Django work experience.
PythonDjangoWe are looking for a Senior Python Developer to build functional and efficient server-side applications.
Senior Python Developer responsibilities include participating in all phases of the software development lifecycle. If you’re a seasoned developer with a love for back-end technologies, we’d like to meet you.
Your ultimate goal is to create high-quality products that meet customer needs.
Responsibilities
- Writing clean, high-quality, high-performance, maintainable code
- Develop and support software including applications, database integration, interfaces, and new functionality enhancements
- Coordinate cross-functionally to insure the project meets business objectives and compliance standards
- Support test and deployment of new products and features
- Participate in code reviews
- Manage testing and bug fixes
- Prepare technical documentation
- Collaborate with UX/UI designers to implement design into the code
- Implement software enhancements and suggest improvements
Qualifications
- Bachelor's degree in Computer Science (or related field)
- 3+ years of work experience as a Python Developer
- Experience with Python frameworks (e.g. Django, Flask, Bottle)
- Expertise in Object-Oriented Design, Database Design, and XML Schema
- Experience with Agile or Scrum software development methodologies
- Ability to multi-task, organize, and prioritize work
- Familiarity with Amazon Web Services (AWS) and REST API
- Understanding of databases and SQL
- Knowledge of machine learning is a plus
- Attention to detail
- Leadership skills
PythonDjangoFlaskPostgreSQLWe are looking for developers who are passionate about Python and know what are the benefits of python well.
Responsibilities:
- Design & implement new software modules based on the product requirements
- Debug existing software components, fix issues, and avoid regressions
- Be proactive, take ownership, and be accountable
- Familiar with Test Drive Development.
- Participate in software architecture, design discussions, and code reviews
Technologies we’re hiring for:
- Developed HTTP based REST APIs and implemented Authentication, Caching
- Worked with relational and NoSQL databases and aware of concepts like ORM, Migrations
- Languages & Frameworks: Python Django/Flask
- Database: Postgres/ Mongo
- Must have worked in a Unix/Linux based environment
- Advanced middleware like RabbitMQ, Celery Beat is definitely a plus.
Minimum 3+ year hands-on experience in Python needed
Java
C++
C#· 4+ years in a software engineering role
· You want to work in a highly collaborative environment: we believe a team can be stronger than its individual parts
· Are independent and curious
· Are comfortable owning features from design through delivery to production
· Have experience with one or more modern programming languages
· Are willing to dive into a large code base and contribute immediately
· Enjoy writing code that is understandable, maintainable, and testable
· Collaborative and Communicative - you love being part of a diverse team, building consensus, and establishing credibility.
You are a Class-A communicator: curious, thoughtful, clear, and (mostly) correct.
· BA/BS degree from top institution; MBA or CompSci degree preferred but not required.
PythonDjango
DockerWe are hiring for Python Developer for one of the leading company in Cloud & Blockchain communication
Job Description
• Develop new API features and maintain existing features
• Write reusable microservices and libraries for future use
• Optimize backend services for scalability
• Build products for our customers on top of our APIs
• Build internal tools and automate repetitive operations
Desired Profile
Education: B.tech/ B.E./ MCA
Exp- 2-5 Years (preferably in Product based company)
• Good understanding of various backend components and microservice architecture
• Good understanding of at least one SQL and Non-SQL datastore
• Strong understanding of data structures and algorithms
• Basic understanding of frontend web technologies like ajax
• Proficient understanding of Git and version control
• Familiarity with a Unix-like operating system is a must
• Being fluent with either Go or Python would be a plus
• Familiarity with docker and kubernetes would be a plus
• Contribution to opensource projects would
DjangoPython
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon