PythonWe are looking for a skilled and motivated Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data pipelines. The role involves working with various GCP services, implementing data ingestion and transformation logic, and ensuring data quality and consistency across systems.
Key Responsibilities:
- Design, develop, test, and maintain scalable ETL data pipelines using Python.
- Work extensively on Google Cloud Platform (GCP) services such as:
- Dataflow for real-time and batch data processing
- Cloud Functions for lightweight serverless compute
- BigQuery for data warehousing and analytics
- Cloud Composer for orchestration of data workflows (based on Apache Airflow)
- Google Cloud Storage (GCS) for managing data at scale
- IAM for access control and security
- Cloud Run for containerized applications
- Perform data ingestion from various sources and apply transformation and cleansing logic to ensure high-quality data delivery.
- Implement and enforce data quality checks, validation rules, and monitoring.
- Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver efficient data solutions.
- Manage version control using GitHub and participate in CI/CD pipeline deployments for data projects.
- Write complex SQL queries for data extraction and validation from relational databases such as SQL Server, Oracle, or PostgreSQL.
- Document pipeline designs, data flow diagrams, and operational support procedures.
Required Skills:
- 4–8 years of hands-on experience in Python for backend or data engineering projects.
- Strong understanding and working experience with GCP cloud services (especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.).
- Solid understanding of data pipeline architecture, data integration, and transformation techniques.
- Experience in working with version control systems like GitHub and knowledge of CI/CD practices.
- Strong experience in SQL with at least one enterprise database (SQL Server, Oracle, PostgreSQL, etc.).
Shubham Vishwakarma
Full Stack Developer - Averlon
About Egen Solutions
About
Company social profiles
Similar jobs
PythonStrong Software Engineering Profile
Mandatory (Experience 1): Must have 7+ years of experience using Python to design software solutions.
Mandatory (Skills 1): Strong working experience with Python (with Django framework experience) and Microservices architecture is a must.
Mandatory (Skills 2): Must have experience with event-driven architectures using Kafka
Mandatory (Skills 3): Must have Experience in DevOps practices and container orchestration using Kubernetes, along with cloud platforms like AWS, GCP, or Azure
Mandatory (Company): Product companies, Experience working in fintech, banking, or product companies is a plus.
Mandatory (Education): From IIT (Candidate should have done bachelor degree Btech or Dual degree Btech+Mtech or Intergrated Msc), From other premium institutes NIT, MNNIT, VITS, BITS (Candidates should have done B.E/B.Tech)
Preferred
Preferred (Skills 1): Experience in Task Queues like Celery and RabbitMQ is preferred.
Preferred (Skills 2): Experience with RDBMS/SQL is also preferrable.
Preferred (Education): Computer science
Go Programming (Golang)
NodeJS (Node.js)
JavascriptJob Title: Golang Developer
Location: Kolkata
Job Type: Full-time
Working Days: 5 Days (Rotational off)
About the Role:
We are seeking a skilled Golang Developer with experience in Golang, Node.js, WebSocket
communication, and API development. In this role, you will work closely with our development
team to design, develop, and maintain high-performance backend systems and real-time
applications.
Key Responsibilities:
Design, build, and maintain efficient, reusable, and reliable Golang code.
Develop scalable APIs and microservices.
Integrate and build real-time communication using WebSocket protocols.
Collaborate with frontend developers and other team members to establish objectives
and design more functional, cohesive systems.
Write clean, maintainable, and well-documented code.
Optimize applications for maximum performance, scalability, and security.
Participate in code reviews, contribute to team knowledge, and continuously improve
development processes.
Troubleshoot, debug, and upgrade existing systems.
Occasionally work with Node.js services and modules when needed.
Required Skills and Qualifications:
Min 3+ years of experience in backend development with Golang.
Solid understanding of Node.js and JavaScript/TypeScript.
Hands-on experience with WebSocket integration and real-time applications.
Strong knowledge of RESTful APIs, API design principles, and API documentation. Experience with relational and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB).
Good understanding of concurrent programming and microservices architecture.
Familiarity with cloud platforms (AWS, GCP, Azure) is a plus.
Knowledge of containerization tools like Docker and Kubernetes is a plus.
Strong problem-solving skills, attention to detail, and a proactive attitude.
PythonWhat We’re Looking For:
- Strong experience in Python (5+ years).
- Hands-on experience with any database (SQL or NoSQL).
- Experience with frameworks like Flask, FastAPI, or Django.
- Knowledge of ORMs, API development, and unit testing
Python
Django
FlaskPrimary Skills: Database Systems (SQL), Python Flask/Fast API/Django frameworks specifically
Requirements:
- Highly proficient in fundamentals of Python web development frameworks like Flask, Django and Fast API
- Demonstrated experience in developing APIs using Python frameworks
- Should have deep knowledge in PostgreSQL, MS SQL Server and other SQL based Databases
- Knowledge and proficiency in NoSQL is a bonus
Elastic Search
MongoDB1. Need to have an understanding of Elastic Search, Kafka, mongo DB, etc.
2. Should have experience of Jupter noobooks, data bricks
3. Java, Pythons
4. Senior level, 5-10 years of experience
5. It is important they have those skills so that they can take over current work. There are codes written in both Java as well as Python. (Java is legacy but that is the main search engine code). So it will be counter-productive if engineers hired have experience in both.
6. Excellent communication, analytical, research, grasping skills
PythonDjangoFlaskMongoDB- Optimizing components for maximum performance across a vast array of web-capable devices and browsers
- Ability to understand business requirements and translate them into technical requirements
- You will ensure that these components and the overall application are robust and easy to maintain.
- Have a good understanding of design and user experience principles.
- Open-minded, flexible, and willing to adapt to changing situations
- Ability to work independently as well as on a team and learn from colleagues
- High adaptability in a dynamic start-up environment
- Ensuring technologies are used efficiently, profitably, and securely. Evaluating and implementing new systems and infrastructure.
- Excellent troubleshooting, analytical and problem-solving abilities with a tenacious commitment to finding the root cause of issues.
Qualifications :
- B. Tech/ B.E. /M. Tech/ BCA / MCA or a related technical discipline from reputed universities
Skills Required :
- Minimum 1+ years of experience in REST API development using python.
- Must have experience with anyone popular python frameworks like Django, Flask, and FastAPI Framework.
- Experience in designing and developing Restful Web services and Remote procedure calls.
- Able to integrate multiple data sources and databases into one system
- Knowledge of load testing and optimizing code for performance, security, and scalability
- Experience with Unit testing frameworks in Python
- Knowledge of modern authorization & authentication mechanisms.
- Able to create database schemes that represent and support business processes
- Knowledge of Version Control System & basics of CI/CD
- Write and maintain technical documentation
- Solid foundation in OOPS, Data structures, and Algorithms
- Knowledge of SDLC phases of project development.
- Experience in one or more No SQL Databases such as MongoDB, and Cassandra.
- Experience with event-based databases and programming
- Good experience in synchronous programming and thread-based programming.
- Experience with schedulers.
- Good to have knowledge of Linux shell commands.
- Good to have experience in Kubernetes & Docker
- Knowledge of any Cloud Service like GCP or AWS would be an added advantage
- Cares deeply about writing Quality, Testable & Modular code
- Good to have an understanding of NLP.
PythonDjangoFlaskWorked in Python Flask framework / or similarhttps://anuntatech.turbohire.co/jobdescription/3a6dd0d3-75f4-49b7-9378-0b2b336cec36?utm_source=CareerPage">Django building REST APIs.
Worked in Linux Environment.
Would be an advantage if they have Domain knowledge in Virtualization Or Cloud platformshttps://anuntatech.turbohire.co/jobdescription/3a6dd0d3-75f4-49b7-9378-0b2b336cec36?utm_source=CareerPage">Azure, AWS, or Computer networking.
It is added advantage to have C++ Application programming.
PythonDjangoFlaskFor this role we expect you to have 3+ years of experience in Backend development. You should have strong command
of Python, REST and Flask/Django along with some experience in GIT is nice to have. If you have knowledge about client
side languages like JS, ReactJS and experience in API design and development, it is a huge plus.
You should be knowledgeable about programming languages, operating systems, networks, databases and SQL,
algorithms, architecture, code design and design patterns
JavaPythonJavascript
Amazon Web Services (AWS)DjangoPython
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon