Description:
As a Data Engineering Lead at Company, you will be at the forefront of shaping and managing our data infrastructure with a primary focus on Google Cloud Platform (GCP). You will lead a team of data engineers to design, develop, and maintain our data pipelines, ensuring data quality, scalability, and availability for critical business insights.
Key Responsibilities:
1. Team Leadership:
a. Lead and mentor a team of data engineers, providing guidance, coaching, and performance management.
b. Foster a culture of innovation, collaboration, and continuous learning within the team.
2. Data Pipeline Development (Google Cloud Focus):
a. Design, develop, and maintain scalable data pipelines on Google Cloud Platform (GCP) using services such as BigQuery, Dataflow, and Dataprep.
b. Implement best practices for data extraction, transformation, and loading (ETL) processes on GCP.
3. Data Architecture and Optimization:
a. Define and enforce data architecture standards, ensuring data is structured and organized efficiently.
b. Optimize data storage, processing, and retrieval for maximum
performance and cost-effectiveness on GCP.
4. Data Governance and Quality:
a. Establish data governance frameworks and policies to maintain data quality, consistency, and compliance with regulatory requirements. b. Implement data monitoring and alerting systems to proactively address data quality issues.
5. Cross-functional Collaboration:
a. Collaborate with data scientists, analysts, and other cross-functional teams to understand data requirements and deliver data solutions that drive business insights.
b. Participate in discussions regarding data strategy and provide technical expertise.
6. Documentation and Best Practices:
a. Create and maintain documentation for data engineering processes, standards, and best practices.
b. Stay up-to-date with industry trends and emerging technologies, making recommendations for improvements as needed.
Qualifications
● Bachelor's or Master's degree in Computer Science, Data Engineering, or related field.
● 5+ years of experience in data engineering, with a strong emphasis on Google Cloud Platform.
● Proficiency in Google Cloud services, including BigQuery, Dataflow, Dataprep, and Cloud Storage.
● Experience with data modeling, ETL processes, and data integration. ● Strong programming skills in languages like Python or Java.
● Excellent problem-solving and communication skills.
● Leadership experience and the ability to manage and mentor a team.
Shubham Vishwakarma
Full Stack Developer - Averlon
Similar jobs
Python
Django
FlaskWe are looking to expand our existing Python team across our offices in Surat. This position is for - Senior Software Engineer.
The requirements are as follows:
1) Familiar with the the Django REST API Framework.
2) Experience with the FAST API framework will be a plus
3) Strong grasp of basic python programming concepts ( We do ask a lot of questions on this on our interviews :) )
4) Experience with databases like MongoDB , Postgres , Elasticsearch , REDIS will be a plus
5) Experience with any ML library will be a plus.
6) Familiarity with using git , writing unit test cases for all code written and CI/CD concepts will be a plus as well.
7) Familiar with basic code patterns like MVC.
8) Grasp on basic data structures.
Overview
Adesso India specialises in optimization of core business processes for organizations. Our focus is on providing state-of-the-art solutions that streamline operations and elevate productivity to new heights.
Comprised of a team of industry experts and experienced technology professionals, we ensure that our software development and implementations are reliable, robust, and seamlessly integrated with the latest technologies. By leveraging our extensive knowledge and skills, we empower businesses to achieve their objectives efficiently and effectively.
Job Description
The current application landscape features multiple Java web services running on JEE application servers, primarily hosted on AWS, and integrated with various systems such as SAP, other services, and external partners. DPS is committed to delivering the best digital work experience for the customers employees and customers alike.
Responsibilities:
Independent front- and backend implementation of business functionalities, defined as user stories by the customer, considering the cost-value ratio and maintenance effort for the customer
Implementation of user stories and incidents, including concept, implementation (including automated unit tests), and communication with the customer within the agile development process.
Database activities such as creation or modification of database schema as well as implementation of database access, queries, and data modification
Interface realization based on standard principles like REST or SOAP
Implementation of given Identity and Access Management Patterns for securing the application
Analysis and resolution of issues (3rd Level Support).
Documentation of the implementation.
Consultancy in technical and business topics within the applications.
Usage of selected tools for implementation, testing, rollout, and support.
Participation in regular meetings with the client to track the status of assigned tasks.
Requirements:
Experience with JEE technologies such as JPA, EJB, CDI, JAAS, and SAML.
Experience in technology related to JEE, like Maven.
Proficiency in HTML5, CSS, Angular, and Bootstrap.
Strong knowledge of SQL.
Experience with web services (SOAP, REST, JSON).
Skills & Requirements
JEE, JPA, EJB, CDI, JAAS, SAML, Maven, HTML5, CSS, Angular, Bootstrap, SQL, SOAP, REST, JSON, Database schema design, Unit testing, Agile development, Identity and Access Management (IAM), Troubleshooting, Documentation, Third-level support.
Python
HTML/CSS· Perl as a Developer.
· Python
· Strong knowledge of MS SQL Server (or any database like Sybase/Oracle/MySQL etc),
· Good understanding of RHEL Linux,
· Good understanding and hands-on with HTML and web technologies.
Secondary Skills (Good to have)
DevOps, Ansible, Git/S
AngularJS (1.x)
Angular (2+)
React.js
NodeJS (Node.js)
MongoDB- Lead, Design, develop, and maintain full-stack, web-based applications, and toolchains.
- Design and develop internal and external business systems/applications, systems interfaces, databases,
- reporting, or business functionality
- Work with development and BA teams and project manager to ideate software solutions
- Participate in client communication & effort estimations for new projects/feature development.
- Translate business and functional requirements into documented technical specifications
- Utilize development skills to build (code) new systems functionality per technical specifications, with deliverables to include code builds and automated unit tests
- Perform Code Reviews for all code written by the other developers, review code for team and industry standards compliance, and provide feedback to developers.
- Collaborating with other developers using version control (git).
- Facilitate/lead reviews of technical specifications and program code with other members of the technical team, and communicate design, requirements, feature set, functionality and limitations of systems/applications to the team
- Guide and mentor junior full-stack developers.
Do you know the secret to Becoming a Great Product (UI/UX) Designer?
We have a great opportunity for you work as a Product (UI/UX) Designer with a growing company University Living that offers great benefits with opportunity to explore new things of your domain.
What you will be working on:
- Apply strategic thinking to design and deliver aesthetically pleasing innovative user-centric design and experiences across web and mobile platforms and devices
- Produce user flows, wireframes, prototypes (for stakeholder discussions/approvals), user interface specifications, and final graphics with a strong visual design element
- Drive the development and communication of design guidelines, patterns, and libraries- Keep a keen eye for detail and a passion for - pixel-perfect- fit and finish
What makes a great Product Designer for University Living?
- 3-6 years of experience in Product (UI/UX) Design
- At least BTech degree with a background in consumer internet products
- Proficiency in Adobe XD, Sketch, Photoshop, CorelDraw, Illustrator, OmniGraffle, or other visual design and wire-framing tools
- Demonstrable UI design skills with a strong portfolio
- Strong believer in mobile-first and responsive design
- Understands the latest in visual and interaction design trends.
- Understanding of HTML5, CSS4, JavaScript, Bootstrap 4
- Familiarity with development frameworks such as Angular, React
Why should you join us?
- Compensation is better than Market Standards
- ESOPs (for exceptional candidate)
- Exposure with advanced technology
- Free Healthcare
- Provident Fund Allowance
- Monthly Rewards & recognition Program
- Competitive Annual Appraisals & Internal Promotions
- Sitecore developer with experience in
- Should have headless sitecore experience.
- Should know Sitecore APIs
- Preferably has experience working with modern JavasScript frameworks such as ReactJS/Angular/NextJS
.NETAngularJS (1.x)
C#
NodeJS (Node.js)React.js
Java
Java
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon