Job Title: Senior Data Engineer
Experience: 8Yrs to 11Yrs
Location: Remote
Notice: Immediate or Max 1Month
Role: Permanent Role
Skill set: Google Cloud Platform, Big Query, Java, Python Programming Language, Airflow, Data flow, Apache Beam.
Experience required:
5 years of experience in software design and development with 4 years of experience in the data engineering field is preferred.
2 years of Hands-on experience in GCP cloud data implementation suites such as Big Query, Pub Sub, Data Flow/Apache Beam, Airflow/Composer, Cloud Storage, etc.
Strong experience and understanding of very large-scale data architecture, solutions, and operationalization of data warehouses, data lakes, and analytics platforms.
Mandatory 1 year of software development skills using Java or Python.
Extensive hands-on experience working with data using SQL and Python.
Must Have: GCP, Big Query, Airflow, Data flow, Python, Java.
GCP knowledge must
Java as programming language(preferred)
Big Query, Pub-Sub, Data Flow/Apache Beam, Airflow/Composer, Cloud Storage,
Python
Communication should be good.

Similar jobs
Software Engineer
The Role
We are looking for a full stack engineer to join our team. We ideally hire engineers who are comfortable across the full stack, but
we know you will have a preference about being on the front-end or back-end. As long as you're happy to work on both sets of
tasks – you should carry on reading!
Our Technology
• Back-end: C#, ASP.NET, Web API, MVC, Entity Framework
• Database: SQL Server. Knowledge of non-SQL databases is a plus
• Cloud: Microsoft Azure, AWS
Responsibilities
• Design of the overall architecture of the web application
• Implementation of a robust set of services and APIs to power the web application
• Building reusable code and libraries for future use
• Optimization of the application for maximum speed and scalability
• Implementation of security and data protection
• Translation of UI/UX wireframesto visual elements
• Integration of the front-end and back-end aspects of the web application
Additiontionalresponsibilitiesfor Project Lead
• Active participation in design\build cycle of the software engineering life cycle (prototyping, architecture, detailed design,
development, testing and deployment).
• Providing expertise in technical analysis and solving technical issues during project delivery.
• Code reviews, test case reviews and ensure code developed meets the requirements.
• Collaborate with product management and engineering to define and implement innovative solutions for the product
direction, visuals and experience.
• Requirement gathering and understanding, analyze and convert functional requirements into concrete technical tasks and able
to provide reasonable effort estimates
• Mentor and develop skills of junior software engineers in the team.
Tech Skills and Qualifications
• Contract Length : 1 year
• Software Engineering Degree with 3-5 years of experience.
• Expert knowledge of JavaScript and Node.js, good understanding of Angular and JavaScript testing frameworks (such as Jest,
Mocha etc.)
• Good understanding of Cloud Native architecture, containerisation, Docker, Microsoft Azure/AWS, CI/CD, and DevOps
culture.
• Knowledge of cloud-based SaaS applications/architecture.
• Practical experience in the use of leading engineering practices and principles.
• Practical experience of building robust solutions at large scale.
• Appreciation for functions of Product and Design, experience working in cross-functional teams.
• Understanding differences between multiple delivery platforms (such as mobile vs. desktop), and optimizing output to
match the specific platform.
We have openings for Fullstack / Backend / Frontend Developers who can write reliable, scalable, testable and maintainable code.
At Everest, we innovate at the intersection of design and engineering to produce outstanding products. The work we do is meaningful and challenging - which makes it interesting. Imagine each line of your code, making the world a better place. We work on five workdays weeks, and overtime is a rarity. If clean architecture, TDD, DDD, DevOps, Microservices, Micro-frontends, scalable systems resonate with you, please apply.
To see the quality of our code, you can checkout some of our open source projects: https://github.com/everest-engineering
If you want to know more about our culture:
https://github.com/everest-engineering/manifesto
Some videos that can help:
https://www.youtube.com/watch?v=A7y9RpqXAdA;
https://youtu.be/PPjyP1WPOn8" target="_blank">https://youtu.be/PPjyP1WPOn8
- Passion to own and create amazing product.
- Should be able to clearly understand the customer's problem.
- Should be a collaborative problem solver.
- Should be able a team player.
- Should be open to learn from others and teach others.
- Should be a good problem solver.
- Should be able to take feedback and improve continuously.
- Should commit to inclusion, equity & diversity.
- Should maintain integrity at work
-
Familiarity with Agile methodologies and clean code.
-
Design and/or contribute to client-side and server-side architecture.
-
Well versed with fundamentals of REST.
-
Build the front-end of applications through appealing visual design.
-
Knowledge of one or more front-end languages and libraries (e.g. HTML / CSS, JavaScript, XML, jQuery, Typescript) JavaScript frameworks (e.g. Angular, React, Redux, Vue.js)
-
Knowledge of one or more back-end languages (e.g. C#, Java, Python, Go, Node.js and frameworks like SpringBoot, .NET Core)
-
Well versed with fundamentals of database design.
-
Familiarity with databases - RDBMS like MySQL, Postgres & NoSQL like MongoDB, DynamoDB.
-
Well versed with one or more cloud platforms like - AWS, Azure, GCP.
-
Familiar with Infrastructure as Code - CloudFormation & Terraform & deployment tools like Docker, Kubernetes.
-
Familiarity with CI/CD tools like Jenkins, CircleCI, Github Actions..
-
Unit testing tools like Junit, Mockito, Chai, Mocha, Jest
Focussed on delivering scalable performant database platforms that underpin our customer data services in a dynamic and fast-moving agile engineering environment.
· Experience with different types of enterprise application databases (PostgreSQL a must)
· Familiar with developing in a Cloud environment (AWS RDS, DMS & DevOps highly desirable).
· Proficient in using SQL to interrogate, analyze and report on customer data and interactions on live systems and in testing environments.
· Proficient in using PostgreSQL PL/pgSQL
· Experienced in delivering deployments and infrastructure as code with automation tools such as Jenkins, Terraform, Ansible, etc.
· Comfortable using code hosting platforms for version control and collaboration. (git, github, etc)
· Exposed to and have an opportunity to master automation and learn to use technologies and tools like Oracle, PostgreSQL, AWS, Terraform, GitHub, Nexus, Jenkins, Packer, Bash Scripting, Python, Groovy, and Ansible
· Comfortable leading complex investigations into service failures and data abnormalities that touch your applications.
· Experience with Batch and ETL methodologies.
· Confident in making technical decisions and acting on them (within reason) when under pressure.
· Calm dealing with stakeholders and easily be able to translate complex technical scenarios to non-technical individuals.
· Managing incidents, problems, and change in line with best practice
· Expected to lead and inspire others in your team and department, drive engineering best practice and compliance, strategic direction, and encourage collaboration and transparency.
Experience with SQL & NO SQL
In-depth knowledge and experience in developing web applications with service-oriented frameworks.
Desired Profile:
- Excellent communication and problem-solving skills,
- Strong analytical skills Ability to turn business requirements into technical concepts and code,
- Minimum 3 - 6 years experience in software development in general with 3 years in complex web applications using SAP UI5,
- Software architecture knowledge of enterprise applications is a must
- Experience with Web - Technologies (SAP UI5, HTML5, CSS3, JS, REST - WS) is a must
- Experience with SAP Mobile Platform as well as SAP Web IDE is a plus
- Knowledge and experience with user experience and design concepts is a plus
Key Result Areas –
- Deliver projects/ Products with a world-class user interface and experience
- Delivering as per the plan following the deadline, quality & process.
- Adhering to the company productivity & quality matrix
- Keep the focus on automation and reuse of the component
- Project documentation
- Effective communication
- Following the company defined coding standards
- Contribution to common code
- Should be able to work in agile development methodology.
Skills Required-
- Strong Experience in ExpressJS, Node.JS, HTML, CSS, JavaScript
- Experience in Angular 1 / 4 / 5 will be a big plus
- Comfortable with source code repositories Git
- Worked with build tools like Gulp, Bower, npm
- Experience in developing REST APIs using Node.js
- Strong Experience in MongoDB
- Should be able to understand existing code and able to enhance it further as required.
- Knowledge of agile development methodology.
As a Mobile developer, you’ll collaborate with internal teams to develop functional mobile applications, while working in a fast-paced environment.
Ultimately, you should be able to design and build the next generation of our mobile applications.
Responsibilities
-Support the entire application lifecycle (concept, design, test, release and support)
-Produce fully functional mobile applications writing clean code
-Gather specific requirements and suggest solutions
-Write unit and UI tests to identify malfunctions
-Troubleshoot and debug to optimize performance
-Design interfaces to improve user experience
-Liaise with Product development team to plan new features
-Stay up-to-date with new technology trends
Requirements
-Proven work experience as a Mobile developer
-Demonstrable portfolio of released applications on the App store or the Android market
-In-depth knowledge of at least one programming language like Swift and Java & flutter
-Experience with third-party libraries and APIs
-Familiarity with OOP design principles
-Excellent analytical skills with a good problem-solving attitude
-Ability to perform in a team environment
-Any Graduate
Understanding PowerApps formulas and development methods. Ability to develop
POWER BI Min 2+ years of hand on experience in POWER BI Reports and dashboard development, MS SSAS, MS SSAS & POWER BI Candidate
Should have hands on experience on writing complex SQL queriesworkflows using PowerApps and Microsoft PowerAutomate.
Customizing SharePoint lists and disparate systems with PowerApps Knowledge of PowerApps and PowerAutomate licensing Automating business processes with Microsoft PowerAutomate.
Automating business processes with Microsoft PowerAutomate.
Ability to create custom connectors for Microsoft PowerAutomate.
Experience with API or rest services integrations.
Understanding of how to implement solutions with multiple data source Understanding PowerApps formulas and development methods







