PythonWe are looking for a skilled and motivated Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data pipelines. The role involves working with various GCP services, implementing data ingestion and transformation logic, and ensuring data quality and consistency across systems.
Key Responsibilities:
- Design, develop, test, and maintain scalable ETL data pipelines using Python.
- Work extensively on Google Cloud Platform (GCP) services such as:
- Dataflow for real-time and batch data processing
- Cloud Functions for lightweight serverless compute
- BigQuery for data warehousing and analytics
- Cloud Composer for orchestration of data workflows (based on Apache Airflow)
- Google Cloud Storage (GCS) for managing data at scale
- IAM for access control and security
- Cloud Run for containerized applications
- Perform data ingestion from various sources and apply transformation and cleansing logic to ensure high-quality data delivery.
- Implement and enforce data quality checks, validation rules, and monitoring.
- Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver efficient data solutions.
- Manage version control using GitHub and participate in CI/CD pipeline deployments for data projects.
- Write complex SQL queries for data extraction and validation from relational databases such as SQL Server, Oracle, or PostgreSQL.
- Document pipeline designs, data flow diagrams, and operational support procedures.
Required Skills:
- 4–8 years of hands-on experience in Python for backend or data engineering projects.
- Strong understanding and working experience with GCP cloud services (especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.).
- Solid understanding of data pipeline architecture, data integration, and transformation techniques.
- Experience in working with version control systems like GitHub and knowledge of CI/CD practices.
- Strong experience in SQL with at least one enterprise database (SQL Server, Oracle, PostgreSQL, etc.).
Shubham Vishwakarma
Full Stack Developer - Averlon
About Egen Solutions
About
Company social profiles
Similar jobs
Java
Spring Boot
Amazon Web Services (AWS)JOB DESCRIPTION:
Location: Pune, Mumbai
Mode of Work : 3 days from Office
DSA(Collections, Hash maps, trees, Linkedlist and Arrays, etc), Core Oops concepts(Multithreading, Multi Processing, Polymorphism, Inheritance etc) Annotations in Spring and Spring boot, Java 8 Vital features, database Optimization, Microsevices and Rest API
- Design, develop, and maintain low-latency, high-performance enterprise applications using Core Java (Java 5.0 and above).
- Implement and integrate APIs using Spring Framework and Apache CXF.
- Build microservices-based architecture for scalable and distributed systems.
- Collaborate with cross-functional teams for high/low-level design, development, and deployment of software solutions.
- Optimize performance through efficient multithreading, memory management, and algorithm design.
- Ensure best coding practices, conduct code reviews, and perform unit/integration testing.
- Work with RDBMS (preferably Sybase) for backend data integration.
- Analyze complex business problems and deliver innovative technology solutions in the financial/trading domain.
- Work in Unix/Linux environments for deployment and troubleshooting.
Machine Learning (ML)
Azure Chatbot Developer
Location :Bangalore / Mumbai / Pune
Job Description
Build and maintain bots on Azure platform. Integration with Active directory, WEB API based integration with external systems. Training and Integrate bots as per users’ requirements. Work in line with design guidelines, best practices and standards of bot deliverable. Creative approach to the conversation flow design, human aspects in the bot responses and sentiments
Qualifications
a) 5 years of experience in software development with clear understanding of the project life cycle
b) Min 2-3 years of hands-on experience in Microsoft Azure Bot Framework, LUIS and other Cognitive services offered by Azure
c) Hands on experience with Machine Learning based chat bots
d) Experience with Azure bot services like Text Analytics etc.
e)Strong database skills and hands-on experience on databases like SQL Server/Oracle
f) Strong experience on Azure Active directory and adaptive cards integration in Chat bot.
g) Strong experience designing and working with
with service-oriented architectures (SOA) and WebAPIs.
h) A strong experience on Microsoft Azure, ASPNET / MVC and programming languages such as C#/VBNET
i) Knowledge of Python and NodeJS is a plus
j) Ability to design and optimize SQL Server 2008 stored procedures.
k) Experience with JQuery, CSS3, HTML5 or similar technologies.
l) Ability to adapt quickly to an existing, complex environment.
Python
DjangoAmazon Web Services (AWS)Job Overview:
We are looking for a seasoned Senior Backend Engineer (SDE II) with over 3 years of experience to grow a high-performing engineering team. The ideal candidate will have extensive hands-on experience in software development, deep technical expertise, and a proven track record of successfully leading large-scale engineering teams and projects. This role requires strategic leadership, the ability to manage complex technical challenges, and the ability to drive innovation while ensuring operational excellence. As a Backend SDE-2, you will collaborate with key stakeholders across the business, product management, and operations to ensure alignment with the organization’s goals and play a critical role in shaping the technology roadmap and engineering culture.
Key Responsibilities:
- Strategic Planning: Work closely with senior leadership to develop and implement engineering strategies that support business objectives. Define technology roadmaps and ensure alignment with organizational goals.
- Technical Excellence: Guide the team in designing and implementing scalable, robust software systems. Drive the adoption of best practices in architecture, coding standards, and software testing to ensure high-quality product delivery.
- Project and Program Management: Oversee the successful delivery of engineering projects, ensuring deadlines, quality standards, and budget constraints are met. Use agile methodologies to manage the development process and resolve bottlenecks.
- Cross-functional collaboration: Collaborate with Product Management, Design, Business, and Operations teams to define project requirements and deliverables. Ensure the smooth integration of engineering efforts across the organization.
- Risk Management: Anticipate and mitigate technical risks and roadblocks. Proactively identify areas of technical debt and drive initiatives to reduce it.
Required Qualifications:
- Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
- 3+ years of experience in software engineering
- Proven track record of successfully delivering large-scale, high-impact software projects.
- Strong understanding of software architecture, design patterns, and scalable system design.
- Expertise in multiple programming languages and modern development frameworks For this role we require expertise in Python/Django and API Development
- Experience with cloud infrastructure (AWS), microservices, and distributed systems.
- Good experience with MySQL and ElasticSearch. Slight experience with other NoSQL and SQL databases.
- Experience in DevOps, CI/CD pipelines, and infrastructure automation.
- Experience in delivering full-stack B2B/SaaS applications including mobile applications, web frontend, and a scalable backend.
- Excellent problem-solving skills, with the ability to diagnose and resolve complex technical challenges.
- Strong communication and interpersonal skills, with the ability to influence and inspire teams and stakeholders at all levels.
PythonDjango
MongoDB
PostgreSQLPosition: Python Developer
Location: Andheri East, Mumbai
Work Mode: 5 Days WFO
Availability: Immediate joiners only (or notice period completed)
What We're Looking For:
✅ 2+ years of solid Python development experience
✅ Django framework expertise - must have!
✅ FastAPI framework knowledge - essential!
✅ Database skills in MongoDB OR PostgreSQL
✅ Ready to work from office 5 days a week
JavaJava Developer with GCP
Skills : Java and Spring Boot, GCP, Cloud Storage, BigQuery, RESTful API,
EXP : SA(6-10 Years)
Loc : Bangalore, Mangalore, Chennai, Coimbatore, Pune, Mumbai, Kolkata
Np : Immediate to 60 Days.
Kindly share your updated resume via WA - 91five000260seven
Python
Go Programming (Golang)JavaBasic Qualifications:
- 3+ years of non-internship professional software development experience
- Programming experience with at least one modern language such as Java, C++, or C# including object-oriented design
- 1+ years of experience contributing to the architecture and design (architecture, design patterns, reliability and scaling) of new and current systems.
Additional Job requirements
- BS/MS/PhD in Computer Science/Math or equivalent
- BS in computer science or related field.
- 2+ years of relevant professional software development experience: designing, developing, and delivering software written in Java, C#, or C++, web development.
- Knowledgeable in object-oriented design patterns.
- Experience building highly scalable and distributed systems
Preferred Qualifications
- Experience with service-oriented architecture and application/services development
- Passion for performance debugging and benchmarking
Ability to clearly and concisely communicate with technical and non-technical stakeholders across all levels of the organization
PythonAmazon Web Services (AWS)Strong expertise in AWS architecture, deployment and coding using Python and AWS Lambda functions. She/ he should also have experience with NOSQL database like MongoDB/ DynamoDB and exposure to Machine Learning. She/ he should be familiar with Ajax calls, interaction with API using JSON files and xml.
Knowledge of testing tools like JMeter and Selenium and programming languages like Javascript and Dot Net will be a big advantage.
The person should be able to guide junior resources, perform code reviews and solve performance issues as required.
PythonDjangoWe will be willing to offer ESOPs in the future.
Roles and Responsibilities- Will be sole responsibility for all tech realted issues.
We have already built a web application.
-The candidate will be responsible for the backend needs of the company and solely responsible for the project
- The backend languages is Python-Django Framework
-The candidate should have worked on big scalable projects before and shall be able to execute.
- Should be able to complete work on time.-Developer should be willing to learn as the project is multi-functional and dynamic.
1. Installing APIs
2. Design, develop and test features from inception to rollout
3. Write high quality code that is scalable, testable, maintainable and reliable
DjangoPythonThis includes working on:
a) The main Django application, a large, modern, Django app built using Python 3.8 and the latest Python and Django libraries;
b) The API, built using Django Rest Framework (DRF) that is used both by our web-app and client libraries to build and run data analyses;
c) Backend code that integrates our web server with the rest of our cloud architecture, including our PaaS, data science code, general integrations such as payments, devops code, and more.
Ideally, you should have experience working on Django codebases which serve both server-side rendered pages and APIs via DRF. Frontend/full-stack knowledge is a an advantage but not essential. Familiarity with modern development practices, such as CI/CD, testing, DevOps, Docker, Linux and git would be a big plus. You must have very strong familiarity with Python development, and be excited to pick up the new technologies and skills - for instance we use Python type-hints across our codebase extensively.
You should like the idea of releasing to real customers regularly, and prioritise getting a great product into users’ hands for feedback and iteration. You will have extensive scope to build and architect the backend, and to help grow the team in the future.
PythonDjango
React.js- At least 4 years of experience programming in Python.
- Develop application code and modules for business and technical requirements.
- Tune up design for maintainability, scalability and efficiency.
- Resolve and troubleshoot problems and complex issues.
- Perform unit tests and fix bugs.
- Integrate best qualitative practices in design and development aspects of programs.
- Ability to mentor subordinates.
- Excellent communication skills.
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon