Senior Data Engineering Role - Google Cloud Platform with Spark
at A LEADING US BASED MNC
Data Engineering : Senior Engineer / Manager
As Senior Engineer/ Manager in Data Engineering, you will translate client requirements into technical design, and implement components for a data engineering solutions. Utilize a deep understanding of data integration and big data design principles in creating custom solutions or implementing package solutions. You will independently drive design discussions to insure the necessary health of the overall solution.
Must Have skills :
1. GCP
2. Spark streaming : Live data streaming experience is desired.
3. Any 1 coding language: Java/Pyhton /Scala
Skills & Experience :
- Overall experience of MINIMUM 5+ years with Minimum 4 years of relevant experience in Big Data technologies
- Hands-on experience with the Hadoop stack - HDFS, sqoop, kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, hive, oozie, airflow and other components required in building end to end data pipeline. Working knowledge on real-time data pipelines is added advantage.
- Strong experience in at least of the programming language Java, Scala, Python. Java preferable
- Hands-on working knowledge of NoSQL and MPP data platforms like Hbase, MongoDb, Cassandra, AWS Redshift, Azure SQLDW, GCP BigQuery etc.
- Well-versed and working knowledge with data platform related services on GCP
- Bachelor's degree and year of work experience of 6 to 12 years or any combination of education, training and/or experience that demonstrates the ability to perform the duties of the position
Your Impact :
- Data Ingestion, Integration and Transformation
- Data Storage and Computation Frameworks, Performance Optimizations
- Analytics & Visualizations
- Infrastructure & Cloud Computing
- Data Management Platforms
- Build functionality for data ingestion from multiple heterogeneous sources in batch & real-time
- Build functionality for data analytics, search and aggregation
Shubham Vishwakarma
Full Stack Developer - Averlon
Similar jobs
Java
Spring Boot- 1-5 years of experience in Java Development.
- Very good with DSA - Java programming.
- Hands-on experience in working with REST APIs & Web Services.
- Good Database design skills - SQL
- Write well-designed, testable, efficient code.
- Contribute to all phases of the development lifecycle.
Work Location : Bangalore
Work mode : Work from office.
Vue.js
AngularJS (1.x)
Angular (2+)
React.js
JavascriptPOSITION: JAVA
EXPERIENCE: 3YRS-10YRS
LOCATION: BANGALORE
NOTICE PERIOD: IMMEDIATE JOINER/15 DAYS
WORK FROM OFFICE
JOB DESCRIPTION:
EXPERIENCE : 3 -10 YEARS EXPERIENCE IN JAVA
TECHNOLOGY/SKILLS : JAVA , HIBERNATE , MYSQL , MICROSERVICES, REST API
QUALIFICATION – B.E, B.TECH
2-5 yrs of proven experience in ML, DL, and preferably NLP.
Preferred Educational Background - B.E/B.Tech, M.S./M.Tech, Ph.D.
𝐖𝐡𝐚𝐭 𝐰𝐢𝐥𝐥 𝐲𝐨𝐮 𝐰𝐨𝐫𝐤 𝐨𝐧?
𝟏) Problem formulation and solution designing of ML/NLP applications across complex well-defined as well as open-ended healthcare problems.
2) Cutting-edge machine learning, data mining, and statistical techniques to analyse and utilise large-scale structured and unstructured clinical data.
3) End-to-end development of company proprietary AI engines - data collection, cleaning, data modelling, model training / testing, monitoring, and deployment.
4) Research and innovate novel ML algorithms and their applications suited to the problem at hand.
𝐖𝐡𝐚𝐭 𝐚𝐫𝐞 𝐰𝐞 𝐥𝐨𝐨𝐤𝐢𝐧𝐠 𝐟𝐨𝐫?
𝟏) Deeper understanding of business objectives and ability to formulate the problem as a Data Science problem.
𝟐) Solid expertise in knowledge graphs, graph neural nets, clustering, classification.
𝟑) Strong understanding of data normalization techniques, SVM, Random forest, data visualization techniques.
𝟒) Expertise in RNN, LSTM, and other neural network architectures.
𝟓) DL frameworks: Tensorflow, Pytorch, Keras
𝟔) High proficiency with standard database skills (e.g., SQL, MongoDB, Graph DB), data preparation, cleaning, and wrangling/munging.
𝟕) Comfortable with web scraping, extracting, manipulating, and analyzing complex, high-volume, high-dimensionality data from varying sources.
𝟖) Experience with deploying ML models on cloud platforms like AWS or Azure.
9) Familiarity with version control with GIT, BitBucket, SVN, or similar.
𝐖𝐡𝐲 𝐜𝐡𝐨𝐨𝐬𝐞 𝐮𝐬?
𝟏) We offer Competitive remuneration.
𝟐) We give opportunities to work on exciting and cutting-edge machine learning problems so you contribute towards transforming the healthcare industry.
𝟑) We offer flexibility to choose your tools, methods, and ways to collaborate.
𝟒) We always value and believe in new ideas and encourage creative thinking.
𝟓) We offer open culture where you will work closely with the founding team and have the chance to influence the product design and execution.
𝟔) And, of course, the thrill of being part of an early-stage startup, launching a product, and seeing it in the hands of the users.
mission is to make brands more valuable to the world. Clients include Google, Flipkart, NBCUniversal, L'Oral, and the Financial Times. The agency is more than 2,000 people strong, manages $4B in annualized media spend and deploys campaigns in 121 markets via 21 offices
in APAC, EMEA and North America.
- We'd like you to be a trusted resource and partner to our clients, especially their product marketing and innovation leads, not afraid to have the tough conversations, when necessary, but also willing to adapt to their needs.
- We emphasize behaviours. We value emotional intelligence, curiosity, and collaboration above all else. We are looking for a person that is comfortable doing their own research, as well as pulling out and presenting the key insights and ideas. Someone who Ensures strategy stays a common thread throughout tactical planning and idea presentations holding the entire product together.
- Evangelize the practice and its value proposition by working closely with Internal Leads of our client business teams and cross-functional teams like Content, Analytics etc.
- Identify key audiences - sizing and profile using data points, to determine whether the given audience can achieve the clients business objective
Within the aligned audience(s), identify key human truth (insight) using data (quantitative/ qualitative) that leads to a communication platform (one-liner) that demonstrates what a brand should be saying to them and how it should be behaving in media to drive the change in perception/behaviour (from/to)
- Build activation platforms/ideas stemming from data-backed cultural or behavioural insights
- Set budget allocation - topline between online/ offline & key channels identified for each in order to hit the objective
- Consult on learning agendas & implications for all campaigns/projects - take the learning and apply to the next project
- Bringing the best from the outside in - Be the in-agency/ external expert on category and consumer trends (especially media-related but not limited to), and apply that knowledge to strategy
- Write/develop agency POVs based on the latest trends and developments that matter to our industry/clients
- Work on non-campaign projects such as brand portfolio, brand positioning, and GTM strategy as necessary
A bit about yourself:
- At least 12 years of relevant experience (strategy, media, consulting, research)
- Prior experience working on a global brand, with a proven track record of driving media and campaign strategies (along with presenting them to senior stakeholders)
- Ability to navigate both the digital ecosystem not limited to Facebook, Google, Twitter, LinkedIn, OTTs, and also Linear TV, other offline media
- Understanding of brand and DR objectives
- Succinct in understanding client business should be able to translate business objectives to Media and close the loop with measurable metrics.
- Deep understanding of planning, audience research and measurement tools; with the ability to land on media solutions
- A Passion to help and developing people making yourself readily available to answer questions and offer support to the wider business team, and the ability to motivate people to succeed
- Vision for where communications strategy and the wider marketing industry is going
- More analytical than creative, yet strong in both
- An MBA is a plus but not a must.
PHP
We are looking for Test Engineer: 4+years (2+ years of Test Automation)
Role: Automation Testing
Location: India
No. of Positions: 2
Work Type: Permanent
Location: Remote (within India)
NOTE: WE'RE LOOKING FOR IMMEDIATE JOINERS ONLY!
Responsibilities of a test automation developer include:
Designing and writing test automation scripts
Using test automation frameworks
Working with QA analysts and software developers to find solutions
Work with the Release Engineering team to create and maintain an automated nightly build verification (“smoke”) test.
Additional Skills:
Applicants must have experience with software testing tools Selenium with Eclipse IDE.
Programming languages: Java
We are Financial services, so Mathematical aptitude and strong problem-solving skills will be an advantage.
.NETDesignation: Team Lead ( Dot Net Development)
Experience: 5 to 8 years
Required Skills:
- Project Management skills.
- Previous experience leading development teams is a plus.
- Application of agile development processes in a leadership capacity.
- Proven experience with Microsoft .NET technologies including, ASP.NET, MVC, Entity Framework.
- Proven Skills with C#, SQL, JavaScript/DHTML, HTML-CSS, AJAX, jQuery, Web Services, etc.
- Ability to complete all phases of software development life cycle including analysis, design, functionality, testing and support.
- Ability to manage large scale web/database application.
- Should have working knowledge of using a latest development tools and techniques.
- Must have good problem solving and analysis skills.
- Team-player with strong communication & collaboration skills.
- Previous experience with ecommerce website development is preferred.
Java
Amazon Web Services (AWS)CommerceIQ is a well funded fast growing enterprise SaaS platform that is helping brands grow and sell more on e-commerce channels through its machine learning technology. Are you excited about building distributed crawling engine at global scale that will crawl and parse 1000’s of websites with 10+ million crawls on a daily basis? Would you enjoy building something as ambitious as “Google/Facebook Ad platform” for Amazon (and other e-commerce retailers)? Does building a CI/CD and containerisation framework that will allow our products to be released and deployed every week across dozens of geographies and data centers seamlessly excite you? Do you find building machine learning models that will optimize billions of dollars in ad and promotions spend exhilarating? Do you find it super exciting to build a plug and play product UI platform where leaders of brands will spend hours daily (almost as much as an email inbox) to optimize their business? We can keep writing, but you will get the idea.
In our journey of building and scaling CommerceIQ, Engineers and data scientists in our team tackle these and many more problems daily. If you are as excited as we are after reading this, we would love to talk to you! 30+ global brands including Kellogg, Unilever, Johnson & Johnson, MARS, Nestle, Logitech and many more trust our product to manage their growth on Amazon. If you are excited about building product that will write the script for how brands sell and grow on e-commerce channels please reach out to us.
Are you ready to power intelligent commerce? @CommerceIQ, you will :
• You will be responsible for developing, testing and releasing features within time and with high quality that will drive revenue and margin impact to top brands.
• You will be designing your own features keeping in mind the scale and high availability of the systems. • You will be working with the team and expected to perform code reviews, conduct design discussions and mentor other developers.
•You will be the owner of your feature and work directly with product teams to drive customer impact.
• You will be expected to participate in all phases of the software development cycle as part of a Scrum team.
Experience : 3+ Years in developing in designing and developing complex and scalable software modules..
Skillset : • The ideal candidate will be an experienced Java developer with exceptional software system design, problem solving, and object-oriented coding skills
• Experience with distributed transaction-processing systems or asynchronous messaging technology is required.
• Good understanding of system performance trade-offs, load balancing, and engineering for high availability.
• Obsessed about building quality software and owning end to end responsibility for the developed features.
• Understanding of enterprise information systems, service oriented architectures, and operational data stores is a plus
• BS or MS in Computer Science/Engineering, Mathematics, Statistics or similar degree from a top tier institution
Java
NodeJS (Node.js)
Go Programming (Golang)-Should be strong in complex problem solving, Data
Structure & Algorithms.
-Should be proficient in more than one Programming
language i.e Java, Node, Golang, etc.( Oops Languages & Concepts) and related frameworks.
-Should be comfortable with SQL, NOSQL databases.
-Should have comfortable writing Unit tests.
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon