PythonSenior Data Engineer
Responsibilities:
● Clean, prepare and optimize data at scale for ingestion and consumption by machine learning models
● Drive the implementation of new data management projects and re-structure of the current data architecture
● Implement complex automated workflows and routines using workflow scheduling tools
● Build continuous integration, test-driven development and production deployment frameworks
● Drive collaborative reviews of design, code, test plans and dataset implementation performed by other data engineers in support of maintaining data engineering standards
● Anticipate, identify and solve issues concerning data management to improve data quality
● Design and build reusable components, frameworks and libraries at scale to support machine learning products
● Design and implement product features in collaboration with business and Technology stakeholders
● Analyze and profile data for the purpose of designing scalable solutions
● Troubleshoot complex data issues and perform root cause analysis to proactively resolve product and operational issues
● Mentor and develop other data engineers in adopting best practices
● Able to influence and communicate effectively, both verbally and written, with team members and business stakeholders
Qualifications:
● 8+ years of experience developing scalable Big Data applications or solutions on distributed platforms
● Experience in Google Cloud Platform (GCP) and good to have other cloud platform tools
● Experience working with Data warehousing tools, including DynamoDB, SQL, and Snowflake
● Experience architecting data products in Streaming, Serverless and Microservices Architecture and platform.
● Experience with Spark (Scala/Python/Java) and Kafka
● Work experience with using Databricks (Data Engineering and Delta Lake components)
● Experience working with Big Data platforms, including Dataproc, Data Bricks etc
● Experience working with distributed technology tools including Spark, Presto, Databricks, Airflow
● Working knowledge of Data warehousing, Data modeling
● Experience working in Agile and Scrum development process
● Bachelor's degree in Computer Science, Information Systems, Business, or other relevant subject area
Role:
Senior Data Engineer
Total No. of Years:
8+ years of relevant experience
To be onboarded by:
Immediate
Notice Period:
Skills
Mandatory / Desirable
Min years (Project Exp)
Max years (Project Exp)
GCP Exposure
Mandatory Min 3 to 7
BigQuery, Dataflow, Dataproc, AI Building Blocks, Looker, Cloud Data Fusion, Dataprep .Spark and PySpark
Mandatory Min 5 to 9
Relational SQL
Mandatory Min 4 to 8
Shell scripting language
Mandatory Min 4 to 8
Python /scala language
Mandatory Min 4 to 8
Airflow/Kubeflow workflow scheduling tool
Mandatory Min 3 to 7
Kubernetes
Desirable 1 to 6
Scala
Mandatory Min 2 to 6
Databricks
Desirable Min 1 to 6
Google Cloud Functions
Mandatory Min 2 to 6
GitHub source control tool
Mandatory Min 4 to 8
Machine Learning
Desirable 1 to 6
Deep Learning
Desirable Min 1to 6
Data structures and algorithms
Mandatory Min 4 to 8
Shubham Vishwakarma
Full Stack Developer - Averlon
About Kloud9 Technologies
About
Kloud9 was founded with the vision of enabling our customers to transform into an intelligent enterprise with our “AI-First” approach. We help our customers in their data transformation and insights transformation journeys and enable them to make smart business decisions.
At Kloud9, we know AI & ML is one of the key technologies that can help organizations to significantly improve their customer experiences and transform their business operations to enable them to survive & thrive in this global competitive market.
Photos
Company social profiles
Similar jobs
Flutter
iOS App Development
Android DevelopmentJob Title: Flutter Mobile App Developer
Department: Engineering
Summary:
We are looking for a talented Flutter Mobile App Developer to join our team. The ideal
candidate will have a strong understanding of Flutter and Dart, as well as experience
developing mobile apps for Android and iOS. The successful candidate will be
responsible for designing, developing, testing, and deploying high-quality mobile apps
that meet the needs of our users.
Responsibilities:
● Design, develop, test, and deploy mobile apps using Flutter and Dart
● Work with product managers and designers to gather requirements and translate
them into technical specifications
● Work with other engineers to build and maintain our mobile app codebase
● Stay up-to-date on the latest Flutter and Dart developments
● Participate in code reviews and provide feedback on code quality
● Mentor and train junior engineers
Qualifications:
● Bachelor's degree in Computer Science or a related field
● 4+ years of experience developing mobile apps using Flutter and Dart
● 1+ years of experience with commonly used 3rd party libraries and services,
push notifications and app analytics
● Experience with building video streaming and messaging apps is a huge plus
● Strong problem-solving and debugging skills
● Excellent written and verbal communication skills
Benefits:
● Competitive salary and benefits package
● Opportunity to work on challenging and interesting projects
● Collaborative and supportive work environment
● Chance to make a real impact on the lives of our users
Introducing Ineffable Communications, a visionary and avant-garde agency that transcends the ordinary, specializing in the art of amplifying emerging technologies, ideas, and lifestyles. With an unwavering commitment to crafting extraordinary futures, we orchestrate bespoke, captivating journeys for our esteemed clients through the realms of Branding, Creative Brilliance, Advertising Ingenuity, and Cutting-edge Marketing Strategies. Embracing the essence of innovation, we seamlessly blend our profound expertise with boundless creativity to unlock the untapped potential of brands.
Location: Ahmedabad, Gujarat
Responsibilities:
- Create visually appealing designs for print and digital marketing materials that align with brand standards and project goals
- Collaborate with cross-functional teams to understand project objectives, target audience, and messaging
- Manage multiple design projects simultaneously and deliver work on time
- Provide guidance and mentorship to junior designers to help them develop their skills and knowledge
- Stay up-to-date with industry trends, new design techniques, and software to continually improve skills
- Participate in brainstorming sessions to contribute to the creative direction of the company
Requirements:
- Bachelor's degree in Graphic Design, Visual Communication, or a related field
- 0-2 years of experience in graphic design with a strong portfolio showcasing design skills
- Proficiency in Adobe Creative Suite and other design software
- Strong understanding of branding and design strategy
- Excellent communication skills, both written and verbal
- Ability to work in a fast-paced environment and deliver high-quality work on time
- Strong attention to detail and the ability to provide and receive constructive feedback
We are looking for a Senior Quality Assurance (QA) engineer to develop and execute exploratory and automated tests to ensure product quality.
QA engineer responsibilities include:
Designing and implementing tests, debugging and defining corrective actions. You will also review system requirements and track quality assurance metrics (e.g. defect densities and open defect counts.)
The QA technician role plays an important part in our company’s product development process. Our ideal candidate will be responsible for conducting tests before product launches to ensure software runs smoothly and meets client needs, while being cost-effective. If you hold an engineering background and enjoy providing end-to-end solutions to software quality problems, we would like to meet you.
Ultimately, you should monitor all stages of software development to identify and resolve system malfunctions to meet quality standards.
Responsibilities
- Review requirements, specifications and technical design documents to provide timely and meaningful feedback
- Create detailed, comprehensive and well-structured test plans and test cases
- Estimate, prioritize, plan and coordinate testing activities
- Design, develop and execute automation scripts using open source tools
- Identify, record, document thoroughly and track bugs
- Perform thorough regression testing when bugs are resolved
- Develop and apply testing processes for new and existing products to meet client needs
- Liaise with internal teams (e.g. developers and product managers) to identify system requirements
- Monitor debugging process results
- Investigate the causes of non-conforming software and train users to implement solutions
- Track quality assurance metrics, like defect densities and open defect counts
- Stay up-to-date with new testing tools and test strategies
Requirements
- Proven work experience in software development
- Proven work experience in software quality assurance
- Strong knowledge of software QA methodologies, tools and processes
- knowledge of Selenium/Appium for web and app automation in android and IOS
- Experience in writing clear, concise and comprehensive test plans and test cases
- Hands-on experience with both white box and black box testing
- Hands-on experience with manual and automated testing tools
- Solid knowledge of SQL and scripting
- Experience of 3 years to 8 years
- Experience working in an Agile/Scrum development process
- Experience with performance and/or security testing is a plus.
- Accurately recording details of customers’ purchase orders.
- Processing all customer purchases accordingly.
- Generating promising leads to pursue.
- Managing customer accounts by ensuring that existing customers remain satisfied with the company's services.
- Developing and sustaining solid relationships with customers to encourage repeat business.
- Understanding in-depth knowledge to make suitable recommendations based on customers' needs and preferences.
- Continually meeting or exceeding daily and monthly targets with respect to call volume and sales.
We are a Fintech Start up (in stealth mode) targeting to capture $ 900 BN consumer lending opportunity. We are building platform of the future in which the offline / online merchants would be able to expand their consumer base. We also empower merchants to collect payment digitally and help build their identity through our offerings. Consumers would be able to make their purchase decisions and would get the options to convert their purchases in to easy EMIs The founders brings over 3 decade of banking & financial services experience with strong market connect to bring required resources (like Customer, Capital, relevant business team etc.). Detailed business model can discussed during the meeting process.
About you : As our new mobile designer, you will work closely with the mobile product team. Your primary goals will be to design the next generation of mobile websites, apps and other mobile interfaces across multiple platforms such as iOS, Android, Windows, and mobile web.
Responsibilities :
- Collaborate with cross-functional product teams to implement an enterprise-wide Frontend design strategy
- Execute all visual designs, from initial concept through development hand-off - Synthesize complex, abstract business requirements into meaningful and usable designs
- Bring the customer and product owners visions to life by conducting research, wireframing, sketching, prototyping, and designing user interfaces
- Establish and promote design guidelines, best practices and standards.
- Help maintain a design library and style guide to ensure a consistent look and feel across various products.
-Develop intuitive, usable, and engaging interactions and visual designs for mobile.
-Research and track advancements in mobile application design patterns.
-Break any design problem down into viable actionable chunks and solve them with clarity and precision.
-Staying in the loop and on top of the latest standards, changes, trends in the mobile design field.
- Use storytelling and visualization skills to present and defend your design decisions to team members and stakeholders
Requirement:
-4+ years of Mobile App Design or related experience
- Experience across all phases of product design from research to ideation, design iteration, prototyping, and delivering high-fidelity UI designs.
- Excellent visual design skills and proficiency in design tools, such as Adobe InDesign, Dreamweaver, Illustrator, and Photoshop
- Ability to solve problems creatively and clearly articulate design solutions to stakeholders - Bachelors degree in Graphic Design, User Experience Design, or related field
- Strong portfolio demonstrating experience creating user-centered design solutions across multiple interfaces and screen sizes
- Comfortable designing for web and mobile devices
-Strong graphic design skills, with a good understanding of typography, intuitive layouts and palate development.
Location: Delhi- Okhla
Compensation :
- In line with Industry best practices /- We have an energetic workplace environment where we welcome innovative ideas and offers growth opportunities and positive environment for accomplishing goals. Our purpose is to create abundance for everyone we touch.
Opportunity to work with a Silicon Valley based security and governance
startup.
About Privacera:
Privacera, Inc is a California based start-up company that is looking for Software Engineers to work out of our
Mumbai based office. Privacera is a cloud-based product, which uses Cloud native services in AWS, Azure and
GCP. Privacera is a fast-growing start-up and provides many opportunities work on all Cloud services like AWS
S3, DynamoDB, Kinesis, RedShift, EMR, Azure ADLS, HDInsight, GCP GCS, GCP PubSub and other services.
https://www.privacera.com" target="_blank">https://www.privacera.com
About our company
Freestone Infotech is a global IT solutions company providing innovative best-in-class turnkey solutions to
enterprises worldwide and is a partner to Privacera in Mumbai.
http://www.freestoneinfotech.com" target="_blank"> http://www.freestoneinfotech.com
We are looking for motivated individuals who have worked on Cloud and Big Data or keen on working on Cloud
or Big Data services. If you want to work in a start-up culture and are ready for the challenge, then join us on
our exciting journey.
Job Description:
We are looking for a “QA Automation Engineer” to join our engineering team and help us develop and maintain
various test suites.
As a “QA Automation Engineer”, the responsibilities include developing automated scripts to verify the various
project functionalities, debugging programs and integrating applications with third-party web services. To be
successful in this role, you should have experience using API implementations and work well in a team.
Job Responsibilities:
Improve the quality of the product by creating scalable and optimized test cases.
Develop scripts to verify the overall product functionalities.
Test and debug various modules of the product.
Assess and prioritize feature requests of Test Suites / Framework.
Work closely with QA and development teams to improve test automation strategies for faster iteration.
Design and develop test cases/test suites at both API level and system levels.
Actively participate in test planning discussions to improve automation coverage
Job Requirement:
Good exposure to Test Automation, API Automation, Devops, SQL technologies and tools with
TDD/BDD.
Hands on experience with building and maintaining test automation frameworks.
Experience with Python programming language and various I/O libraries.
Knowledge of frameworks such as unit test, doctest and PyTest.
Knowledge of unit testing frameworks, mock objects etc.
Experience in Linux is a must.
Knowledge of Jupyter notebook and Jupyter ecosystem.
Good grasp of data structures such as sets, lists, dictionaries.
Good to have experience in DevOps using python scripts / framework.
Good to have experience in Ansible and Docker.
Understanding of Scrum/Agile & DevOps Process.
Working experience with tools/systems like Jira, GitHub, Confluence, CI/CD Pipeline using Jenkins,
Cloud Watch, Cloud Formation templates.
SQL knowledge will be a plus.
Good problem-solving skills.
Job Type: Full time (Permanent)
Domain: Security
Education and Experience:
Bachelors / Master’s degree in Computer Science or Information Technology or a related field.
Experience Required between 3 to 8 Years
PHP
HTML/CSS
Javascript
AngularJS (1.x)
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon