Senior Data Engineering Role - Google Cloud Platform with Spark
at A LEADING US BASED MNC
Data Engineering : Senior Engineer / Manager
As Senior Engineer/ Manager in Data Engineering, you will translate client requirements into technical design, and implement components for a data engineering solutions. Utilize a deep understanding of data integration and big data design principles in creating custom solutions or implementing package solutions. You will independently drive design discussions to insure the necessary health of the overall solution.
Must Have skills :
1. GCP
2. Spark streaming : Live data streaming experience is desired.
3. Any 1 coding language: Java/Pyhton /Scala
Skills & Experience :
- Overall experience of MINIMUM 5+ years with Minimum 4 years of relevant experience in Big Data technologies
- Hands-on experience with the Hadoop stack - HDFS, sqoop, kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, hive, oozie, airflow and other components required in building end to end data pipeline. Working knowledge on real-time data pipelines is added advantage.
- Strong experience in at least of the programming language Java, Scala, Python. Java preferable
- Hands-on working knowledge of NoSQL and MPP data platforms like Hbase, MongoDb, Cassandra, AWS Redshift, Azure SQLDW, GCP BigQuery etc.
- Well-versed and working knowledge with data platform related services on GCP
- Bachelor's degree and year of work experience of 6 to 12 years or any combination of education, training and/or experience that demonstrates the ability to perform the duties of the position
Your Impact :
- Data Ingestion, Integration and Transformation
- Data Storage and Computation Frameworks, Performance Optimizations
- Analytics & Visualizations
- Infrastructure & Cloud Computing
- Data Management Platforms
- Build functionality for data ingestion from multiple heterogeneous sources in batch & real-time
- Build functionality for data analytics, search and aggregation
Subodh Popalwar
Software Engineer, Memorres
Similar jobs
We are currently hiring an IT Product Manager to join our team and be responsible for the product strategy & roadmap.
If interested Share your updated Cv with the below details
Company's Name: - WeAssemble
Weblink: - www.weassemble.team
Location:- Prabhadevi, Mumbai
Designation: - Product Manager
Experience: - Minimum 2 year
Salary up to 6 LPA
Responsibilities
- Analysing product performance and redesigning as required
- Designing, developing, and managing activities from product definition & planning to production and release
- Developing the product strategy and roadmap
- Managing prioritization and trade-offs between customer experience, business impact, performance, and post-launch support
- Working cross-functionally with design and technology teams to ensure the timely and quality release of product/ enhancements
Requirements
- You possess a Degree in Computer Science, Engineering or a related field
- You have a strong background in software engineering as well as prior experience in product management
- You have prior experience in managing a product throughout its lifecycle
- You possess strong problem-solving and prioritization skills
- You have excellent interpersonal and communication skills
- You can work effectively with cross-functional teams
- The ideal candidate must have 1 - 4 years of product management experience.
| Meghal Majithia |
| HR Recruiter - WeAssemble (Vimontera Consultancy LLP) |
React.js
NodeJS (Node.js)
AngularJS (1.x)
Angular (2+)● You will be a key member in building modern web application platforms.
● Building user interfaces for management products
● Creating wireframes, prototypes based on the requirements.
● Building api for UI backend.
● Provide assistance in the up-gradation and maintenance of web applications.
Job Requirements
● 3 to 5 years of web development experience is required.
● Hands-on experience with api and microservice development.
● Proficiency with fundamental front-end languages such as JavaScript, HTML, CSS.
● Proficiency with JavaScript frameworks such as ReactJs.
● Proficiency with server-side languages such as NodeJs, Java, GoLang, etc.
● Exposure to wireframing and prototyping.
● Familiarity with database technology such as MongoDB.
● Good to have:
1. Experience in UX design.
2. Working experience on Linux environments.
3. Working experience on Docker and Kubernetes.
4. Working experience in microservices.
5. Knowledge of the networking domain
Machine Learning (ML)
Data ScienceJob Description-
Responsibilities:
* Work on real-world computer vision problems
* Write robust industry-grade algorithms
* Leverage OpenCV, Python and deep learning frameworks to train models.
* Use Deep Learning technologies such as Keras, Tensorflow, PyTorch etc.
* Develop integrations with various in-house or external microservices.
* Must have experience in deployment practices (Kubernetes, Docker, containerization, etc.) and model compression practices
* Research latest technologies and develop proof of concepts (POCs).
* Build and train state-of-the-art deep learning models to solve Computer Vision related problems, including, but not limited to:
* Segmentation
* Object Detection
* Classification
* Objects Tracking
* Visual Style Transfer
* Generative Adversarial Networks
* Work alongside other researchers and engineers to develop and deploy solutions for challenging real-world problems in the area of Computer Vision
* Develop and plan Computer Vision research projects, in the terms of scope of work including formal definition of research objectives and outcomes
* Provide specialized technical / scientific research to support the organization on different projects for existing and new technologies
Skills:
* Object Detection
* Computer Science
* Image Processing
* Computer Vision
* Deep Learning
* Artificial Intelligence (AI)
* Pattern Recognition
* Machine Learning
* Data Science
* Generative Adversarial Networks (GANs)
* Flask
* SQL
Java
Spring Boot- Work experience as a Java Developer.
- Experience designing, building and testing Java EE applications.
- In-depth knowledge of popular Java frameworks like JSF and Spring MVC.
- Very good understanding of design patterns Hands on experience on ORM framework
- Design and develop reusable libraries and APIs.
- Experience with Object-Oriented Design (OOD).
- Experience on handling exceptions Experience on handling transaction
- Excellent knowledge of Relational Databases, SQL and ORM technologies ( JPA2, Hibernate)
- 4 - 5 years of system engineering experience on any programming language such as Java / .net / Python / angular
- Must have delivered 5 to 6 real time integration engagements for Archer
- Must have experience in developing Custom Objects on Archer to call deployed APIs or Archer’s internal APIs
- Must have strong expertise in developing multi-threaded, scalable applications to support heavy data transactions
- Must have strong expertise in designing applications with architectural patterns such as MVC
- Great to have exposure to DevOps or DevSecOps
- Great to have exposure to source code review or secure coding practices
- Working in an agile environment by keeping in mind the titbits of startup
- Liaising with cross functional teams to get the errands done.
- Formulating monthly social media calendar and devise content accordingly by knowing the fact of time and fraction of brand equity.
- Adhering SEO and other guidelines while formulating the content.
- Devising SEO friendly content such as Meta Title, Meta Description, Blogs & website content like Footer Pages, Product Description.
- Conducting in-depth and regular audits of rivals content.
- Devising niche, crisp, catchy and compelling content across all touch points.
- Doing plagiarism check and proofreading of landing pages, ad copies etc.
- Making sure the content is plagiarism free and inclined with the brand guidelines.
- Making sure the content is precise before prevalence anywhere.
What you need to have:
- Bachelor's degree required, preferably in English, Communications or a related field. Masters degree a plus
- Familiarity with software like Microsoft Office, Google Docs and other tools which are inclined to content like plagiarism checker etc.
- Strong presentation skills and excellent interpersonal skills - comfortable directing projects and taking on new tasks.
- Proven ability to follow style guidelines
- Impeccable spelling and grammar skills.
- Proven work experience as a Content Writer, Copywriter or similar role.
- Possess a thorough, up-to-date knowledge of B2B Fintech consortium.
- Have knack to thrive in a fast-paced environment and to work independently and within a team as well.
- Should be pretty much acquainted with copywriting.
- Be adept in ad copies for the entire gamut of digital media like Google Ads, Social Media, SMS Marketing Campaigns, E-mail Marketing, Newsletter & as well as website content like Footer Pages, Product description etc.
PHPSkills required:
- knowledge of Linux administration and Bash,
- great overall coding experience, knowledge of algorithms, etc,
- experience with Git,
- experience with Docker.
Typical tasks would consist of writing scripts for:
- server automation,
- container deployment,
- user data migration,
- backup management.
Adobe Illustrator
HTML/CSS
Follow CutshortSubodh Popalwar
Software Engineer, Memorres