PythonSenior Data Engineer
Responsibilities:
● Clean, prepare and optimize data at scale for ingestion and consumption by machine learning models
● Drive the implementation of new data management projects and re-structure of the current data architecture
● Implement complex automated workflows and routines using workflow scheduling tools
● Build continuous integration, test-driven development and production deployment frameworks
● Drive collaborative reviews of design, code, test plans and dataset implementation performed by other data engineers in support of maintaining data engineering standards
● Anticipate, identify and solve issues concerning data management to improve data quality
● Design and build reusable components, frameworks and libraries at scale to support machine learning products
● Design and implement product features in collaboration with business and Technology stakeholders
● Analyze and profile data for the purpose of designing scalable solutions
● Troubleshoot complex data issues and perform root cause analysis to proactively resolve product and operational issues
● Mentor and develop other data engineers in adopting best practices
● Able to influence and communicate effectively, both verbally and written, with team members and business stakeholders
Qualifications:
● 8+ years of experience developing scalable Big Data applications or solutions on distributed platforms
● Experience in Google Cloud Platform (GCP) and good to have other cloud platform tools
● Experience working with Data warehousing tools, including DynamoDB, SQL, and Snowflake
● Experience architecting data products in Streaming, Serverless and Microservices Architecture and platform.
● Experience with Spark (Scala/Python/Java) and Kafka
● Work experience with using Databricks (Data Engineering and Delta Lake components)
● Experience working with Big Data platforms, including Dataproc, Data Bricks etc
● Experience working with distributed technology tools including Spark, Presto, Databricks, Airflow
● Working knowledge of Data warehousing, Data modeling
● Experience working in Agile and Scrum development process
● Bachelor's degree in Computer Science, Information Systems, Business, or other relevant subject area
Role:
Senior Data Engineer
Total No. of Years:
8+ years of relevant experience
To be onboarded by:
Immediate
Notice Period:
Skills
Mandatory / Desirable
Min years (Project Exp)
Max years (Project Exp)
GCP Exposure
Mandatory Min 3 to 7
BigQuery, Dataflow, Dataproc, AI Building Blocks, Looker, Cloud Data Fusion, Dataprep .Spark and PySpark
Mandatory Min 5 to 9
Relational SQL
Mandatory Min 4 to 8
Shell scripting language
Mandatory Min 4 to 8
Python /scala language
Mandatory Min 4 to 8
Airflow/Kubeflow workflow scheduling tool
Mandatory Min 3 to 7
Kubernetes
Desirable 1 to 6
Scala
Mandatory Min 2 to 6
Databricks
Desirable Min 1 to 6
Google Cloud Functions
Mandatory Min 2 to 6
GitHub source control tool
Mandatory Min 4 to 8
Machine Learning
Desirable 1 to 6
Deep Learning
Desirable Min 1to 6
Data structures and algorithms
Mandatory Min 4 to 8
Shubham Vishwakarma
Full Stack Developer - Averlon
About Kloud9 Technologies
About
Kloud9 was founded with the vision of enabling our customers to transform into an intelligent enterprise with our “AI-First” approach. We help our customers in their data transformation and insights transformation journeys and enable them to make smart business decisions.
At Kloud9, we know AI & ML is one of the key technologies that can help organizations to significantly improve their customer experiences and transform their business operations to enable them to survive & thrive in this global competitive market.
Photos
Company social profiles
Similar jobs
Strong Lead Product Designer/ Sr product designer/ Product design manager Profile
Mandatory (Experience 1): Must have a minimum 6+ years of hands-on Product Design experience with product companies
Mandatory (Experience 2): Must have experience leading a team or mentoring junior designers (not a pure people manager)
Mandatory (Design Craft): Strong design craft with deep expertise in UX, interaction design, design systems, prototyping, problem-solving, and user-centered workflows. Should be able to individually assess and elevate design quality.
Mandatory (Collaboration): Proven ability to collaborate closely with Product, Engineering, Research, and cross-functional teams. Must have driven design-led projects, influenced product roadmap, and balanced short-term and long-term design priorities.
Mandatory (Portfolio): Portfolio or team-led work showing shipped, real-world product impact, improved user journeys, solved UX breakage, and scaled design quality across multiple products/features.
Mandatory (Company) - Well funded / Top Product Companies
Mandatory (Note): CTC is not flexible, ESOP can be based on candidate current compensation structure
Mandatory (Role): This is mix role (Team management + Hands-on)\
Preferred
JavaJob Description
CANDIDATES WITH MINIMUM 7 YEARS OF EXPERIENCE IN QC Automation NEED APPLY.
We are looking for immediate joiners
No work from home option.
Position Title: QC Automation Lead/Manager
Position Type: Full Time, Permanent
Department: Research and Development
Reports to: Manager, Indian Development Centre.
Company Background:
-CGLIA is a software development company building highly available, highly secure, cloud-based enterprise software products that helps speed the research process resulting in new drugs, new devices, and new treatments to improve the health and wellbeing of world population.
- At CGLIA, our work shows our dedication and passion for innovative quality software products that are intuitive and easy to use and exceeds every aspect of customer expectations.
- CGLIA, is the place that develops world-class professionals who would like to be innovative, creative, learn continuously, and build a solid foundation to build products that are special and delight the customer. .
Job Summary:
The QC Manager is a seasoned technologically savvy leader with passion for quality delivery of new products and help us grow. Managing multiple product testing teams and works closely with the Product Management teams, US team, Sales and Marketing and customer support teams in understanding the quality delivery needs.
In this role, you will be hiring the new development staff, mentoring, coaching and building development plans, oversee each aspect of the quality assurance process, and act as a liaison between development team and upper management.
In this role, You will lead and coordinate Test Automation team in all aspects of automation and take ownership of the current automation, recommends new technology, policies or processes to benefit the organization and improve deficiencies.
A demanding job that challenges your intellectual abilities in recommending, defining and implementing the best practices on TDD and BDD in automation testing.
Responsibilities:
· Develop Automation Process, Procedures, Metrics and Analysis.
· Design and maintain Automation frameworks.
· Make sure the rest of the teams have the tools to create automated tests in a structured way.
· Explain and teach basic coding standards for more junior members of the team.
· Perform manual testing to understand features and architecture of our products.
· Review and regulate progress (schedule, cost, quality etc.) and meet performance objectives as per the
project plans.
· Prepare and circulate important test metrics to stakeholders.
· You will also be required to carry out any other duties which may reasonably be required of you.
Qualifications & Skills required:
· Experience of 7-10 years and should be able to define test goals & objectives (Test Strategy & Test Planning)
· Should have good programming skills in Java
· Should have very good knowledge in both Selenium and Java
· Good knowledge in Maven & TestNG
· Good knowledge in TDD, BDD
· Expert in automating tests and building frameworks from the scratch
· Experienced in Manual Testing (Performance, regression, API, database, security and sanity testing.)
· Good OS knowledge (Windows, Linux, OSX)
Machine Learning (ML)
Deep Learning
Data ScienceBasic Qualifications:
- Five+ years experience working in a Big Data Software Development role
- Experience managing and deploying ML models in real world environments
- Bachelor's degree in Computer Science, Mathematics, Statistics, or other analytical fields
- Experience working with Python, Scala, Spark or other open-source software with data science libraries
- Experience in advanced math and statistics
- Excellent familiarity with command line linux environment
- Able to understand various data structures and common methods in data transformation
- Experience deploying machine learning models
NodeJS (Node.js)
Express- Full stack development on cutting edge technology in Fintech domain.
- Ownership of complete backend code.
You should Have :
- Server Side languages knowledge: Node.js and express.js is the first choice, Python, Java
- Server-side programming experience. We prefer ability over experience
- Solid experience working with databases, especially relational DB.
- Solid experience with version control (Git or Bitbucket or SVN).
- B.E. in Computer Science or Graduate/PG degree in Computer Science (this is optional, as we are more interested in your abilities and experience over a paper degree).
- Any experience working with real-time projects in backend with node.js and express.js
Established in the year 1994, PRASA Infocom & Power Solutions has gained vast experience in the ever-changing environment of data centers and mission critical infrastructure. Partnering with the leading brands for indoor and outdoor equipment installed for data centers, Prasa has portrayed itself as the leading solution provider for mission critical infrastructure.
Responsibilities:
- Searching new tenders, screening tender documents and analyzing the eligibility to participate for the tender.
- Understanding tender documents, preparing synopsis and sharing it with management.
- Uploading the tender documents online & final submission of tender or bid.
- Responsible for drafting proposals for various projects in coordination with other departments.
- Preparation of pre-bid queries and regular follow up with the concerned departments.
- Making quotations, checklist for all type of tenders
- Preparing bid documents and getting it validated by the management.
- Submitting tender documents online (and physically if required).
- Maintaining records in the system
Requirements:
- Completed BE/BTech in Electrical
- 3-5 years experience
- Must be in Pune and comfortable to work from office in Kothrud
- Knowledge about datacenter industry (preferred)
- Experience with SAP system (preferred)
C#
.NET
HTML/CSSJob Description
• Manage all traditional and digital marketing efforts to explore different markets across the world.
• Manage content development for website, blogs, social media and other marketing artifacts.
• Willing to take up target and responsibilities.
Should be able to understand manage and interpret customer requirements
• Work with team to develop proposals that speaks to the client’s needs, concerns, and objectives
• To meet prospect clients and give presentations on company’s product and services to clients
• Screen potential business deals by analyzing market strategies, deal requirements, potential, and commercials
• Executing sales plans devised by the management / contributing towards the growth of business revenue
• Establish good relationship with prospective clients, closures of sales for revenue generation
• Sending daily reports regarding the outcome of the meeting with clients
• Developing and implementing comprehensive digital marketing programs in line with brand plans and business priorities
• Working with content marketing and design teams to create suitable content for each stage of a customer’s digital journey
• Reviewing and optimizing the design and content of all online assets including the company website and social media pages
• Planning and control of the digital marketing budget and spend by allocating budgets to different channels
• Analyzing the results and effectiveness of campaigns to deliver actionable insights and recommendations and generating monthly reports on the digital marketing portfolio.
JavaJava
PHP
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon