Senior Data Engineering Role - Google Cloud Platform with Spark
at A LEADING US BASED MNC
Data Engineering : Senior Engineer / Manager
As Senior Engineer/ Manager in Data Engineering, you will translate client requirements into technical design, and implement components for a data engineering solutions. Utilize a deep understanding of data integration and big data design principles in creating custom solutions or implementing package solutions. You will independently drive design discussions to insure the necessary health of the overall solution.
Must Have skills :
1. GCP
2. Spark streaming : Live data streaming experience is desired.
3. Any 1 coding language: Java/Pyhton /Scala
Skills & Experience :
- Overall experience of MINIMUM 5+ years with Minimum 4 years of relevant experience in Big Data technologies
- Hands-on experience with the Hadoop stack - HDFS, sqoop, kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, hive, oozie, airflow and other components required in building end to end data pipeline. Working knowledge on real-time data pipelines is added advantage.
- Strong experience in at least of the programming language Java, Scala, Python. Java preferable
- Hands-on working knowledge of NoSQL and MPP data platforms like Hbase, MongoDb, Cassandra, AWS Redshift, Azure SQLDW, GCP BigQuery etc.
- Well-versed and working knowledge with data platform related services on GCP
- Bachelor's degree and year of work experience of 6 to 12 years or any combination of education, training and/or experience that demonstrates the ability to perform the duties of the position
Your Impact :
- Data Ingestion, Integration and Transformation
- Data Storage and Computation Frameworks, Performance Optimizations
- Analytics & Visualizations
- Infrastructure & Cloud Computing
- Data Management Platforms
- Build functionality for data ingestion from multiple heterogeneous sources in batch & real-time
- Build functionality for data analytics, search and aggregation
Subodh Popalwar
Software Engineer, Memorres
Similar jobs
AngularJS (1.x)
Angular (2+)
React.js
NodeJS (Node.js)
MongoDB Should have an aggregate of 60% in the academics till date.
Any Graduate/Post Graduate.
Frontend Developer (React JS & Next JS)
Primary Skills: Next JS, Angular JS 8, MERN Stack, HTML 5, CSS3, Bootstrap 5, Java, Relational and Non
Preparing drafts
Submitting for approval
Working with fellow team members on writing new content.
Job description
- Hiring for Email Marketing Executive
Responsibilities:
- Work closely with sales and marketing teams to identify our target email audience and grow our email list, using particularly placed sign up forms and gated content throughout the larger website
- Design and implement direct email marketing campaigns. This includes (but is not limited to) developing copy and subject lines, designing email templates, building email lists, and more.
- Manage and report on email marketing campaigns and results; use results to determine ROI, make suggestions for improvements, and establish best practices
- Ensure prompt, accurate, and error-free communication with customers to build loyal relationships and minimize unsubscribes
- Work with leadership to determine goals; report on sales revenue generated from email marketing efforts
- Maintain email database
NodeJS (Node.js)
Redis- Providing technical guidance as well hands on management for all product development within the company.
- Identifying frameworks/ technologies/ languages/ libraries to be used to achieve desired goals.
- Underscores pros and cons of various technologies available and presenting arguments to management and technical team.
- Taking responsibility for refactoring existing code.
- Leading, managing and mentoring a team of 5+ engineers.
- Serving as a key member of the management team that sets the company's strategic direction.
- Defining standards & best practices to support agile development processes.
- Planning, tracking and estimating product development activities.
- Ensuring the optimal application of technology and engineering resources to meet product development and/ or customer requirements as per the product and/ or marketing requirements document.
- Ensuring that the product quality is world class at all times.
- Growing the internal information technology development organisation; managing and recruiting a multidisciplinary high-performance technology team.
- Developing RESTful backend services if needed
- Ensuring implementation of formal processes to support the product development process.
- Passionate about automated testing: Managing / driving testing - unit tests, system tests, regression.
- Performance Tuning/ Profiling: In-depth understanding of popular architectures SOA, RESTful, Microservices, Messaging Bus.
What you need to have:
- B.E / B.Tech or similar qualification from a premier institute.
- Good communication skills.
- Self-starter, Highly motivated.
- People Management skills.
- Go-getter attitude.
- 3 - 7 years of hands-on development experience in backend development with a track record of solid technical accomplishments. Node.js experience will be preferred.
- Knowledge of multiple programming languages will be preferred.
- Knowledge of Caching solutions Redis, Memcache
- Databases experience - MySQL/NoSQL, RabbitMQ, Kafka.
- Capability to present different architecture for the same problem.
- Knowledge of popular front end MVC technologies.
- Understanding of production level problems and their possible solutions
PythonLocation: Remote
Roles and Responsibilities
- Effectively contribute to FileSpin with the development of new and innovative features
- Work on our core API services
- Write tested and maintainable code following coding standards and best practices
- Contribute to the improvement of integration and internal tools
- Maintain existing features
Desired Candidate Profile
We are looking for a Senior Software Engineer (Backend) to join us and be on our ambitious growth journey. In this role, you will help build FileSpin into the most innovative Digital Asset Management platform in the world. You will have ample opportunities to work in areas solving awesome technical challenges and learning along the way.
Our 2022 roadmap focuses on: creating an amazing API and UI, scaling our cloud infrastructure to deal with an order of magnitude higher media processing volume, implementing more ML pipelines and tuning the stack for high-performance.
Perks and Benefits
- Fully Remote
- Equity options
- Holidays
- Flexible working hours
- Budget for your remote work setup
- Life Insurance
The intangibles:
- A culture that values your contribution and gives you autonomy
- Startup ethos, no useless meetings
- Continuous Learning Budget
- In an entrepreneurial workplace, we value creativity and innovation
Our Mission:
FileSpin's mission is to bring excellence and joy to the enterprise. We are a fully remote team spread across the UK and Europe. We bootstrapped in a garage (true story) and have been profitable from day one.
We value innovation and uncompromising professional excellence. Work at FileSpin is challenging, fun and highly rewarding. Come and be part of a unique company that is redefining what work is.
We are setting up a team in India and looking for senior hires. We are a remote-first company.
Are you looking for a long-term and full-time remote role where you can work with US-based companies? Read on!
What is Wishup?
Wishup is India's leading remote employee platform helping US-based businesses in building highly efficient remote teams. It was founded in 2015 by IITM & IIMA alumni and has got the support of marquee investors like Orios Venture Partners, Inflection Point Ventures, Tracxn capital, and Mato Peric in its journey to be the biggest all remote company in the world.
In short, we pioneered remote working when very few believed in the concept and now we are leading the way for the entire world to see!
Job Profile:
- An Online Business Manager at Wishup is a remote full-time employee that works for and is trained by Wishup, and is deployed to engage with one or more US-based clients. - The role is remote and full-time (not a freelancing assignment)
- The role would require working in the US time zone
What’s in it for you?
- International exposure: You’ll get to interact and build relationships with the smartest global founders and CXOs working on cutting-edge ideas
- No hassle of US visa application; since it’s remote working
- Constant upskilling to maintain market relevance: We provide up to 2 weeks of training during onboarding in all the latest industry tools and practices
- Stable full-time remote job in a company that has been fully remote for over 5 years: work from home (or anywhere), forever!
- Scope of rapid growth based on bi-annual appraisals
- A healthy work-life balance
Roles & Responsibilities:
As an Online Business Manager, you will work closely with one or more clients on either one or all of the following tasks:
- Project Management
- Ecommerce Assistance (Amazon Seller/Shopify)
- Advanced Excel and MIS Reporting
- CRM and Lead Management
- Online Research
- Lead Generation
- Executive Assistance (Itinerary Planning, Calendar Management, Inbox Management, etc.)
You're a great fit if you have:
- At least 2 years of full-time employment experience
- A stable career employment track record
- Impeccable written and spoken English
- An aptitude for mathematics and logic
- A solid experience in resolving work-conflict situations
The commitment to a long-term association is highly expected from the candidate. Also, since this is a remote position, you must be self-driven and organized
Job Prerequisites:
- High-speed internet connection
- Laptop with an integrated camera and a pair of headphones
- Distraction-free workspace with zero external interference
- Ability to work in US time zones
Work Shift (either of the following may be allocated):
Mon-Fri, 6:30 p.m. - 3:30 a.m. IST
Mon-Fri, 9:30 p.m. - 6:30 a.m. IST
Company Reviews:
https://www.glassdoor.co.in/Reviews/Wishup-Reviews-E1511572.htm?filter.iso3Language=e Ng
Social Media Links:
LinkedIn - https://www.linkedin.com/company/wishup-services/" target="_blank">https://www.linkedin.com/company/wishup-services/
Facebook - https://www.facebook.com/wishupnow/" target="_blank">https://www.facebook.com/wishupnow/
Twitter - https://twitter.com/wishupnow" target="_blank">https://twitter.com/wishupnow
Instagram - https://www.instagram.com/wishupnow/" target="_blank">https://www.instagram.com/wishupnow/
Training at Wishup:
https://www.youtube.com/watch?v=6Uolgas0Uj4" target="_blank">https://www.youtube.com/watch?v=6Uolgas0Uj4
Life at Wishup:
https://www.youtube.com/watch?v=qHPMod_jzmA" target="_blank">https://www.youtube.com/watch?v=qHPMod_jzmA
React.js
Javascript
Redux/FluxAs an Architect within a web development team, you’ll be responsible for the architecture, design, and implementation of modern JavaScript-based in-browser.
On the daily basis, you’ll actively collaborate with geographically dispersed, cross-functional teams to deliver high performant complex end-to-end software solutions that support a high-traffic web application.
More precisely you will:
- Communicate with UI/UX, business, analyze and suggest efficient solutions based on their requirements
- Define and maintain architecture roadmap, technical solutions for new and existing functionality for each part of the projects
- Take ownership over architecture qualities of front-end applications (e.g.: usability, accessibility, performance, etc.)
- Good active listener, being able to hear and include propositions from engineers in the final solution
- Deliver architectural services, including guidance and conceptual design as well as technical and process innovations
- Bring a passion to remain up to date with the latest trend of ever-changing web front-end development.
- Investigate the latest technology and build quick Proof of Concept functionalities to address future business needs
- Preparing, improving, and introducing new approaches/methodologies/tools and techniques within the department
- Work to meet delivery commitments of feature content throughout the whole Software Delivery Lifecycle (SDLC).
- Preparing of technical documentation
Daily 50 to 80 calls to customer for Software service sales.
Good Communication
Basic Computer Skills
REady to work on Targets
NodeJS (Node.js)JavascriptMongoDB
Express
JavascriptReact.js
jQuery
Follow CutshortSubodh Popalwar
Software Engineer, Memorres