
Senior Data Engineering Role - Google Cloud Platform with Spark
at A LEADING US BASED MNC
Data Engineering : Senior Engineer / Manager
As Senior Engineer/ Manager in Data Engineering, you will translate client requirements into technical design, and implement components for a data engineering solutions. Utilize a deep understanding of data integration and big data design principles in creating custom solutions or implementing package solutions. You will independently drive design discussions to insure the necessary health of the overall solution.
Must Have skills :
1. GCP
2. Spark streaming : Live data streaming experience is desired.
3. Any 1 coding language: Java/Pyhton /Scala
Skills & Experience :
- Overall experience of MINIMUM 5+ years with Minimum 4 years of relevant experience in Big Data technologies
- Hands-on experience with the Hadoop stack - HDFS, sqoop, kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, hive, oozie, airflow and other components required in building end to end data pipeline. Working knowledge on real-time data pipelines is added advantage.
- Strong experience in at least of the programming language Java, Scala, Python. Java preferable
- Hands-on working knowledge of NoSQL and MPP data platforms like Hbase, MongoDb, Cassandra, AWS Redshift, Azure SQLDW, GCP BigQuery etc.
- Well-versed and working knowledge with data platform related services on GCP
- Bachelor's degree and year of work experience of 6 to 12 years or any combination of education, training and/or experience that demonstrates the ability to perform the duties of the position
Your Impact :
- Data Ingestion, Integration and Transformation
- Data Storage and Computation Frameworks, Performance Optimizations
- Analytics & Visualizations
- Infrastructure & Cloud Computing
- Data Management Platforms
- Build functionality for data ingestion from multiple heterogeneous sources in batch & real-time
- Build functionality for data analytics, search and aggregation

Similar jobs
We are looking for an experienced and creative UI/UX Designer to join our team!
As a UI-UX Designer, you will be responsible for delivering the best online user experience, which makes your role extremely important for our success and ensuring customer satisfaction and loyalty.
You will be designing ideas using various methods and the latest technology. You will be designing graphic user interface elements, like menus, tabs, forms, and widgets.
Roles and Responsibility:
- Plan and implement new designs
- Optimize existing user interface designs
- Communicate with clients to understand their business goals and objectives
- Develop technical and business requirements and always strive to deliver intuitive and user-centered solutions
- Combine creativity with an awareness of the design elements
- Create prototypes for new product ideas
- Test new ideas before implementing
- Conduct ongoing user research
Qualifications:
- Bachelor's Degree in any field.
- Excellent interpersonal and communication skills
- Knowledge of Adobe range of products including Photoshop, Illustrator, InDesign, Acrobat, and Dreamweaver



Exp. Level: 5+ Yrs
Proven experience as a. NET Developer
Familiarity with the ASP. NET core framework, SQL Server, Web API, and Microservices
Understanding of Agile methodologies
Excellent troubleshooting and communication skills
Required Skills: ASP. Net Core Web API, and React Js
Kindly Share the Profile through LinkedIn
ID: linkedin.com/in/ranjini-c-n-36b674131

Responsibility
- Designing and building the website front-end.
- Creating the website architecture.
- Designing and managing the website back-end including database and server integration.
- Generating WordPress themes and plugins.
- Conducting website performance tests.
- Troubleshooting content issues.
- Conducting WordPress training with the client.
- Monitoring the performance of the live website.
Eligibility
- Bachelor’s degree in computer science or a similar field.
- Proven work experience as a WordPress developer.
- Knowledge of front-end technologies including CSS3, JavaScript, HTML5, and jQuery.
- Knowledge of code versioning tools including Git, Mercurial, and SVN.
- Experience working with debugging tools such as Chrome Inspector and Firebug.
- Good understanding of website architecture and aesthetics.
- Ability to manage projects.
- Good communication skills.


Job Description
We are looking for an experienced engineer with superb technical skills. Primarily be responsible for architecting and building large scale data pipelines that delivers AI and Analytical solutions to our customers. The right candidate will enthusiastically take ownership in developing and managing a continuously improving, robust, scalable software solutions.
Although your primary responsibilities will be around back-end work, we prize individuals who are willing to step in and contribute to other areas including automation, tooling, and management applications. Experience with or desire to learn Machine Learning a plus.
Skills
- Bachelors/Masters/Phd in CS or equivalent industry experience
- Demonstrated expertise of building and shipping cloud native applications
- 5+ years of industry experience in administering (including setting up, managing, monitoring) data processing pipelines (both streaming and batch) using frameworks such as Kafka Streams, Py Spark, and streaming databases like druid or equivalent like Hive
- Strong industry expertise with containerization technologies including kubernetes (EKS/AKS), Kubeflow
- Experience with cloud platform services such as AWS, Azure or GCP especially with EKS, Managed Kafka
- 5+ Industry experience in python
- Experience with popular modern web frameworks such as Spring boot, Play framework, or Django
- Experience with scripting languages. Python experience highly desirable. Experience in API development using Swagger
- Implementing automated testing platforms and unit tests
- Proficient understanding of code versioning tools, such as Git
- Familiarity with continuous integration, Jenkins
Responsibilities
- Architect, Design and Implement Large scale data processing pipelines using Kafka Streams, PySpark, Fluentd and Druid
- Create custom Operators for Kubernetes, Kubeflow
- Develop data ingestion processes and ETLs
- Assist in dev ops operations
- Design and Implement APIs
- Identify performance bottlenecks and bugs, and devise solutions to these problems
- Help maintain code quality, organization, and documentation
- Communicate with stakeholders regarding various aspects of solution.
- Mentor team members on best practices
Job Description
- Understanding of product landscaping, product benchmarking, product feature prioritization and product development processes are a must in order to be able to create a roadmap and deliver on the same;
- Direct interaction with end customers, OEMs, Channel Partners and Sales Teams in order to understand the business needs and document the voice of the customer for new product features or offerings;
- Improving the product development planning process as and when required in order to boost the product portfolio of the company;
- Create consistent and continuous engagement through the product in order to ensure complete satisfaction;
- Grow customers internally and externally by identifying other areas where the company can add value in a scalable manner;
- Identify new customer needs, create product strategies around the new needs and build scalable product offerings;
- Be able to say “no” to certain feature requests and explain to the stakeholders and help them
understand the reason behind it;
- Create transparent, scalable and easy-to-understand prioritization processes so that the business scales;
- Ensure customers are engaged and develop key product features to measure customer engagement and success which can be monitored and tracked;
- Provide frequent progress reports, both casually and in written format;
- Document decisions, strategy implementation and outputs;
- Present methods and results to peers’ management and customers as necessary
Required qualifications:
We are looking for a smart, adaptable individual with a healthy mix of software product management experience, enterprise software products, product landscaping, great presentation/communication skills, and strong leadership/people management skills and the following qualifications:
- At least 5-6 years of continuous experience in product management at a software product company , IIT and NIT will be a special consideration
- Good understanding of B2B product development and its life cycle.
- Previous experience working in a team and leadership skills;
- Experience in setting targets and milestones and achieving them;
- A problem-solving attitude;
- Ability to communicate effectively and concisely, whether verbally, in writing, or through drawings, presentations and schematics;
- Knowledge of core engineering concepts that will allow road-mapping an enterprise technology product efficiently;
- Ability to innovate, outdo expectations and persevere to benefit the team as a whole;
Individuals who are creative, enterprising and attentive to detail will fit right in with our small, passionate team. We always run-on high energy and enthusiasm and are looking for that fire in the belly! We look forward to meeting you!


Technical Lead's Role:
- The availability, security, scalability and interoperability of our platform
- Delivering our product roadmap
- Planning for the future
- Generating enthusiasm and a sense of both technical and product pride
Essential for this position :
- At least 2 years of experience in leading a team of software developers
- At least 4 years of commercial experience with C# and .NET
- At least 2 years of commercial experience with HTML/CSS and one of Javascript frameworks
- At least 2 years of experience with Microsoft Azure
- Designing and developing APIs for both high availability and scalability
- Performance profiling and tuning of .NET code
- Writing automated tests (both unit and integration tests)
- Experience with CI/CD pipelines (ideally Azure DevOps)
- Applying problem-solving skills to technical issues
Mandatory requirement:-
1. Educational background from B.Tech/B.E./MCA
2. Comfortable to work from Noida Office.
3. Able to join in next 30 days max.
Application process is to submit the details on https://pclhealth.talentlyft.com/jobs/net-tech-lead-me8" target="_blank">https://pclhealth.talentlyft.com/jobs/net-tech-lead-me8 and our team member will get in touch with you soon

JOB DESCRIPTION
Full Stack Developer Responsibilities:
- Developing front-end website architecture.
- Designing user interactions on web pages.
- Developing back-end website applications.
- Creating servers and databases for functionality.
- Ensuring cross-platform optimization for mobile phones.
- Ensuring responsiveness of applications.
- Seeing through a project from conception to finished product
- Meeting both technical and consumer needs.
- Staying abreast of developments in web applications and programming languages.
Requirements:
- Degree in computer science, I.T
- Strong organizational and project management skills.
- Proficiency with fundamental front-end languages such as HTML, CSS, JavaScript, WordPress
- Proficiency with PHP
- Familiarity with database technology such as MySQL, Oracle, and MongoDB.
- Excellent verbal communication skills.
- Good problem-solving skills.
- Attention to detail.
About Company:
ESDA is a Software Development firm with a mission of providing innovative services and a vision of serving clients across the globe. It is a customer-centric Information Technology Company that specializes in Business Application Development. ESDA’s offerings are highly customizable and scalable. It also provides Web Development services and believes in providing 360-degree support to its clients. ESDA provides Web Development services like Web Designing, App Development, Digital Marketing, Graphic Designing, Hosting, Time and Material, and Gap Analysis Consultancy apart from these services, it is also working towards launching applications/software for the online market as its products.

We are looking for a Python Web Developer responsible for managing the interchange of data between the server and the users. Your primary focus will be the development of all server-side logic, ensuring high performance and responsiveness to requests from the front-end. You will also be responsible for integrating the front-end elements built by your co-workers into the application; therefore, a basic understanding of front-end technologies is necessary as well.
- Writing reusable, testable, and efficient code
- Design and implementation of low-latency, high-availability, and performant applications
- Integration of user-facing elements developed by front-end developers with server side logic
- Implementation of security and data protection
- Integration of data storage solutions

About the Role
Dremio’s user experience is one of its key differentiators and makes all your data easily accessible and shareable by your data consumers. UI Engineers at Dremio are responsible for the development of the user interface and user experience on Dremio’s Data Lake Engine.
Responsibilities and ownership
- Own the full cycle of development of our modern single page web application from inception, design, development, testing, and production.
- Care deeply about modular design patterns and frameworks to deliver an architecture that’s rooted in simplicity, that’s easy to iterate on and constantly evolve.
- Passionate about ease of use, experience and quality of the product.
Requirements
- 5+ years of experience working with JavaScript frameworks such as React, Angular.js, Angular, or Vue.js.
- 2 years minimum experience with React is highly preferred and currently utilizing React in their current job.
- Strong coding experience in JavaScript (or TypeScript), HTML, and CSS.
- Passion about UI development and UX design
- Shown proven success in delivering high-quality front end applications
- Fluency in the understanding of SQL and databases (relational or non-relational)
- B.S. or M.S in Computer Science in a relevant technical field or equivalent professional experience

