
Senior Data Engineering Role - Google Cloud Platform with Spark
at A LEADING US BASED MNC
Data Engineering : Senior Engineer / Manager
As Senior Engineer/ Manager in Data Engineering, you will translate client requirements into technical design, and implement components for a data engineering solutions. Utilize a deep understanding of data integration and big data design principles in creating custom solutions or implementing package solutions. You will independently drive design discussions to insure the necessary health of the overall solution.
Must Have skills :
1. GCP
2. Spark streaming : Live data streaming experience is desired.
3. Any 1 coding language: Java/Pyhton /Scala
Skills & Experience :
- Overall experience of MINIMUM 5+ years with Minimum 4 years of relevant experience in Big Data technologies
- Hands-on experience with the Hadoop stack - HDFS, sqoop, kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, hive, oozie, airflow and other components required in building end to end data pipeline. Working knowledge on real-time data pipelines is added advantage.
- Strong experience in at least of the programming language Java, Scala, Python. Java preferable
- Hands-on working knowledge of NoSQL and MPP data platforms like Hbase, MongoDb, Cassandra, AWS Redshift, Azure SQLDW, GCP BigQuery etc.
- Well-versed and working knowledge with data platform related services on GCP
- Bachelor's degree and year of work experience of 6 to 12 years or any combination of education, training and/or experience that demonstrates the ability to perform the duties of the position
Your Impact :
- Data Ingestion, Integration and Transformation
- Data Storage and Computation Frameworks, Performance Optimizations
- Analytics & Visualizations
- Infrastructure & Cloud Computing
- Data Management Platforms
- Build functionality for data ingestion from multiple heterogeneous sources in batch & real-time
- Build functionality for data analytics, search and aggregation

Similar jobs
Assistant Manager / Manager – Sales & Barter Deals
Location: Mumbai | Delhi | Bangalore
About the Role
Join BXI – Barter Exchange of India to drive B2B barter transactions with leading brands. This role focuses on onboarding clients, structuring barter solutions, and generating revenue through agency & platform fees.
Key Responsibilities
• Onboard corporate clients and brands to the BXI Barter Marketplace.
• Facilitate barter deals in Media, Hotels, Gift Vouchers, and Electronics.
• Build & service long-term client relationships.
• Attend industry events and networking forums to create opportunities.
• Structure tailored barter solutions and ensure smooth execution.
• Travel across India for client meetings and deal closures.
Requirements
• Education: MBA preferred.
• Experience: 3–6 years in Sales / Business Development / Client Servicing.
• Strong sales & networking skills with proven revenue generation.
• Excellent communication, presentation & client management abilities.
• Digital savvy and proactive in building opportunities.
Manual QA Requirement: Manual QA Testers – Mobile Application Testing 2–3 Manual QA Testers to support an ongoing mobile application project. Key Requirements: ● 3–5 years of experience in software testing, with a strong focus on mobile application testing (mandatory). ● Hands-on experience testing applications built on React Native. ● Basic understanding of Java-based microservices on the backend. ● Working knowledge of Detox (React Native testing framework) is preferred. ● Good to have: ○ Exposure to fintech, particularly with an understanding of trading or investment platforms. ○ Experience with Playwright (not mandatory).
Position: AWS Data Engineer
Experience: 5 to 7 Years
Location: Bengaluru, Pune, Chennai, Mumbai, Gurugram
Work Mode: Hybrid (3 days work from office per week)
Employment Type: Full-time
About the Role:
We are seeking a highly skilled and motivated AWS Data Engineer with 5–7 years of experience in building and optimizing data pipelines, architectures, and data sets. The ideal candidate will have strong experience with AWS services including Glue, Athena, Redshift, Lambda, DMS, RDS, and CloudFormation. You will be responsible for managing the full data lifecycle from ingestion to transformation and storage, ensuring efficiency and performance.
Key Responsibilities:
- Design, develop, and optimize scalable ETL pipelines using AWS Glue, Python/PySpark, and SQL.
- Work extensively with AWS services such as Glue, Athena, Lambda, DMS, RDS, Redshift, CloudFormation, and other serverless technologies.
- Implement and manage data lake and warehouse solutions using AWS Redshift and S3.
- Optimize data models and storage for cost-efficiency and performance.
- Write advanced SQL queries to support complex data analysis and reporting requirements.
- Collaborate with stakeholders to understand data requirements and translate them into scalable solutions.
- Ensure high data quality and integrity across platforms and processes.
- Implement CI/CD pipelines and best practices for infrastructure as code using CloudFormation or similar tools.
Required Skills & Experience:
- Strong hands-on experience with Python or PySpark for data processing.
- Deep knowledge of AWS Glue, Athena, Lambda, Redshift, RDS, DMS, and CloudFormation.
- Proficiency in writing complex SQL queries and optimizing them for performance.
- Familiarity with serverless architectures and AWS best practices.
- Experience in designing and maintaining robust data architectures and data lakes.
- Ability to troubleshoot and resolve data pipeline issues efficiently.
- Strong communication and stakeholder management skills.
Responsibilities include:
Leading with the marketing team to understand design requirements and objectives.
Creating visually appealing graphics for various platforms, including social media, website, presentations, and print materials.
Developing unique design concepts that convey our brand's personality and value proposition.
Designing graphics for B2B campaigns that effectively communicate key messages.
Maintaining brand consistency across all visual assets.
Creating motion graphics and video content, if experienced, to enhance storytelling and engagement.
Managing multiple design projects simultaneously and delivering high-quality designs within deadlines. Staying updated with design trends, industry best practices, and incorporating innovative ideas into your work.
Qualifications and Experience:
2-4 years of proven experience in graphic design roles.
Strong portfolio showcasing a diverse range of design projects for both B2B and B2C brands.
Proficiency in Adobe Creative Suite (Photoshop, Illustrator, InDesign) Microsoft Powerpoint and other relevant design tools.
Excellent understanding of design principles, typography, color theory, and layout.
Good communication skills to effectively interpret design briefs and collaborate with cross-functional teams.
Experience in motion graphics or video editing is a plus.
Knowledge of UI/UX design principles is beneficial but not mandatory.
Attributes and Skills:
Creative mindset with a keen eye for detail.
Ability to think conceptually and translate ideas into visually appealing designs.
Strong organizational and time management skills to handle multiple projects and meet deadlines.
Adaptability to work in a fast-paced environment with evolving design requirements.
Collaborative approach, open to feedback, and willing to iterate on designs based on input.
WHY JOIN QRATA
- Work with the best: Learn from leaders who have built Qrata from the ground up. Work with down-to-earth, highly experienced, and insanely ambitious colleagues.
- As the business grows, you grow: We want Qrata to be built from within. We look at you as a business leader with the potential to make an impact in the talent space for the Indian startup.
- Great Culture and Work life Balance: Wins are celebrated: We have clear and frequent processes in place for recognizing the achievements of their employees. Leadership and management style that encourages teamwork, frequent engagement, fun activities and transparent communication which is vital to creating a positive feeling in the workplace.
WHAT WE DO AND WHO WE ARE
- We started Qrata in 2016. We are a 40+ person team based out of Mumbai and Bangalore.
- We have our own platform and framework that includes pre vetting talent for accelerated hiring as well as building a composite talent profile including community references to create predictable hiring outcomes/structured learning for our talent community.
- We are building an ecosystem that connects untapped talent in India irrespective of location to realize their full potential through careers in the fastest growing start-ups around the globe from India.
WHAT WILL BE YOUR MISSION AT QRATA?
This staff member will join our diverse and passionate team, whose primary role is to ensure the digital traction needed to fuel our organization, build fierce momentum around our product through creative and effective branding, and build win-win partnerships with multiple aligned organizations. Within this team, the Content and Marketing Partner will primarily own the Communications and Digital Marketing work, while also collaborating actively on other team projects. We are looking for a passionate storyteller who can identify, curate, and amplify our impact, through stories and statistics, across various mediums.
WHAT ARE YOU GOING TO DO AT QRATA?
- Design approaches to establish and amplify Qrata’s brand presence on social channels
- Develop metrics to measure the Content and Marketing team’s reach and depth of impact
- Collaborate with design and writing teams to produce high quality content
- Provide engaging text, image and video content for social media accounts
- Be the voice between Qrata & the community, able to relay Qrata’s POV forward as well as collect actionable information from the community (+ social listening) for the organization
- Establish meaningful relationships across our communities; leverage selected influencers within the community or community leaders to trigger conversations
- Edit, proofread, and improve the content.
- Optimize content considering SEO and Google Analytics.
- Analyze web traffic metrics.
- Ensure a strong web presence on various channels.
- Generate ideas to increase customer engagement from 0 - 100.
- Drive growth in our talent community via our product.
- Respond to comments and client queries in a timely manner
MUST HAVE’S
- Bachelor's degree in Media or Communications or Journalism or Humanities, or a related field.
- Project management skills and attention to detail
- Excellent communication and writing skills in English
- Proficiency in LinkedIn,Instagram, and other social media platforms.
GOOD TO HAVE’S
- 1-2 years of relevant experience in startups or Media Houses(Digital)
- Previous experience working in early stage start-ups.
LOCATION
402 Pharma Search House, -, BG Kher Rd, Vasi Naka, Siddharth Nagar, Worli, Mumbai, Maharashtra 400018
About Company:
The company is a global leader in secure payments and trusted transactions. They are at the forefront of the digital revolution that is shaping new ways of paying, living, doing business and building relationships that pass on trust along the entire payments value chain, enabling sustainable economic growth. Their innovative solutions, rooted in a rock-solid technological base, are environmentally friendly, widely accessible and support social transformation.
Requirements:
- Angular and Angular JS, Able to work Architecture, Design and Development ofComplex UI Screens
- OOP fundamentals (Encapsulation, Abstraction, Inheritance, Polymorphism), MVC architecture
- UML (Class/Sequence diagrams)
- Design Patterns (Should be able to explain some common design patterns)
- Versioning (CVS, VSS, Git etc. – why is it used?, check-in/check-out, merging, how to resolve conflicts?, etc.)
- JDBC (Statement types, Obtaining connection, ResultSet, Drivers)
- Hibernate/JPA , DB (PK, FK, Normalization), SQL (Insert/Update/Delete/select queries)
- CSS (Styles, Classes)
- SDLC (What is it?, benefits, etc.)
- Robust Programming, Debugging (Common IDE features and their use)
- Analytical skills – ability to look at a problem with different perspectives: define solutions understanding the pros and cons of each
- Hands on with Continuous Integration, Maven
- Estimation, Planning and Tracking, Timely Issue Escalation and Resolutions
- Exposure to Performance tools, Jprofiler, Dynatrace etc.
You will be part of a talented software team that works on mission critical applications. Candidates should be willing to increase his/her circle of competence by researching for solutions in handover mannual and online resources. Ability to work independently is highly appreciated.
Requirements :-
- Graduate in Computer Science, Engineering or a related subject.
- 2+ years proven hands-on Software Development experience in JAVA.
- Perseverent in solving coding problems.
- Understanding of concepts related to .xml and .xsd files like targetNamespace, schema, xml datatypes, linkbases, arcs etc.
- Strong knowledge and hands-on experience of Java OOPs concepts, inheritance, abstract classes, interfaces, generics, exception handling and multithreading.
Good to have :-
- Experience with XML parsers like SAX.
- Experience with JSON file processing libraries like GSON.
- Dependency and build management using Maven scripts.
- Familiarity with Tomcat deployment.
- Familiarity with Spring Boot.
- Familiarity with Git/SVN for version control.
Responsibilities :-
- Developing features for validation engine.
- Attending client queries and assisting the clients in product integration.
- Catchup with the XBRL domain asap.
- Debugging and fixing bugs in the codebase. Testing changes for impact using available test harnesses.
About IRIS:
IRIS Business Services Limited (IRIS), is India's only listed SaaS Company that provides technology solutions/services in the regulatory technology space in across 42 countries globally. We are a pioneer and provide XBRL/iXBRL solutions for compliance, data and analytics. We are a global company headquartered in Navi Mumbai, India with subsidiaries in USA, Singapore and Italy and an affiliate firm in the UAE.
We are a company where technology expertise and domain knowledge come together to create cutting edge compliance solutions covering data and content management and information dissemination for issuers/ enterprises, regulators, governments, institutional clients etc. Our deep hands-on expertise in the XBRL space has been built over 17 years.
We are members of XBRL International, XBRL US, XBRL Europe and XBRL South Africa. In each of these jurisdictions, we contribute significantly to the development and adoption of the standard. IRIS is an ISO 27001:2013 certified organization.
IRIS has a flat organization structure which facilitates growth, opportunities, direction-setting, decision making and ownership at various levels.
To read more about IRIS visit our website: http://www.irisbusiness.com/">www.irisbusiness.com
KeepTruckin is on a mission to modernize the trucking industry. With the leading fleet management platform, we are bringing trucks online and fundamentally changing the way freight is moved on our roads.We see our hard work rewarded in tangible ways every day and we believe that intelligence is most powerful when paired with humility. We're motivated by the opportunity to impact and improve every facet of a trillion-dollar industry that touches everyone's lives. KeepTruckin is proud to be a Forbes Cloud 100 company, a 2020 Career-Launching Company by Wealthfront and named a Forbes Best Startup Employer 2020.
About the Role:
As a Senior Frontend Engineer, you will play an integral part in designing components and platforms for new services within KeepTruckin's Freight product line. You will implement complex features using modern frameworks and work on a fast-growing team eager to make a significant impact by connecting the world's trucks.We are looking for senior engineers who are driven by impacting and revolutionizing a space where the last major technical innovation was the invention of the diesel engine. We are seeking team players who have strong problem solving skills, and thrive on innovation and continuous improvement. We pride ourselves on our culture and the ability to work effectively across a highly diversified team.
What You'll Do:
Work alongside product and other cross-functional counterparts including designers, back end, and QA on features that power freight productsCreate the best possible user experience in our web applications, and come up with creative, outside-the-box solutions for complex problemsWrite modular and maintainable front-end code, and actively participate in writing unit tests, improving quality, and performing code reviewsParticipate in full SDLC process in a CI/CD centered development, and actively work on our AWS cloud infrastructureResearch new technology and design patterns in collaboration with fellow engineers; propose changes that bring both short term and long term benefits
What We're Looking For:
BTech/MTech in Computer Science or related fields and 5+ years of experience building front-end software that is shipped in productionExperience with modern front-end frameworks, patterns, and browser technologies, and experience building single-page frontend applicationsExpert in HTML, CSS, JavaScript, and other display-centric web technologies, and in at least one modern JS framework (ReactJS, AngularJS, VueJS, etc)Proficient knowledge of asynchronous request handlingExperience working with REST APIs, GraphQL, -or- similar APIs, and experience with automated testing, Agile/Scrum, and SaaS, as well as B2B Enterprise applications and AWS infrastructureCreating a diverse and inclusive workplace is one of KeepTruckin's core values.
We are an equal opportunity employer and welcome people of different backgrounds, experiences, abilities and perspectives.Please review our Candidate Privacy Notice here. ( https://drive.google.com/file/d/1Xs7GivrHCj05XC6-mn6MsRGG3V5AcgZ5/view?usp=sharing )










