Pyspark Developer

Role - AI Architect

Location - Noida/Remote

Mode - Hybrid - 2 days WFO

As an AI Architect at CLOUDSUFI, you will play a key role in driving our AI strategy for customers in the Oil & Gas, Energy, Manufacturing, Retail, Healthcare, and Fintech sectors. You will be responsible for delivering large-scale AI transformation programs for multinational organizations, preferably Fortune 500 companies. You will also lead a team of 10-25 Data Scientists to ensure successful project execution.

Required Experience

● Minimum 12+ years of experience in Data & Analytics domain and minimum 3 years as AI Architect

● Master’s or Ph.D. in a discipline such as Computer Science, Statistics or Applied Mathematics with an emphasis or thesis work on one or more of the following: deep learning, machine learning, Generative AI and optimization.

● Must have experience of articulating and presenting business transformation journey using AI / Gen AI technology to C-Level Executives

● Proven experience in delivering large-scale AI and GenAI transformation programs for multinational organizations

● Strong understanding of AI and GenAI algorithms and techniques

● Must have hands-on experience in open-source software development and cloud native technologies especially on GCP tech stack

● Proficiency in python and prominent ML packages Proficiency in Neural Networks is desirable, though not essential

● Experience leading and managing teams of Data Scientists, Data Engineers and Data Analysts

● Ability to work independently and as part of a team Additional Skills

(Preferred):

● Experience in the Oil & Gas, Energy, Manufacturing, Retail, Healthcare, or Fintech sectors

● Knowledge of cloud platforms (AWS, Azure, GCP)

● GCP Professional Cloud Architect and GCP Professional Machine Learning Engineer Certification

● Experience with AI frameworks and tools (TensorFlow, PyTorch, Keras)

A developer is responsible for several Java-related duties throughout the software development lifecycle, from concept and design to testing. The developer is required to create user information solutions through the development, implementation, and maintenance of Java-based components and interfaces.

Key Responsibilities:

• Rewrite existing APIs in NodeJS.
• Remodel the APIs into Micro services-based architecture.
• Implement a caching layer wherever possible.
• Optimize the API for high performance and scalability.
• Write unit tests for API Testing.
• Automate the code testing and deployment process.

Skills Required:

1. At least 3 years of experience developing Backends using NodeJS — should be well versed with its asynchronous nature & event loop, and know its quirks and workarounds.
2. Excellent hands-on experience using MySQL or any other SQL Database.
3. Good knowledge of MongoDB or any other NoSQL Database.
4. Good knowledge of Redis, its data types, and their use cases.
5. Experience with graph-based databases like GraphQL and Neo4j.
6. Experience developing and deploying REST APIs.
7. Good knowledge of Unit Testing and available Test Frameworks.
8. Good understanding of advanced JS libraries and frameworks.
9. Experience with Web sockets, Service Workers, and Web Push Notifications.
10. Familiar with NodeJS profiling tools.
11. Proficient understanding of code versioning tools such as Git.
12. Good knowledge of creating and maintaining DevOps infrastructure on cloud platforms.
13. Should be a fast learner and a go-getter — without any fear of trying out new things Preferences.
14. Experience building a large scale social or location-based app.

Job Responsibilities:-

• Develop robust, scalable and maintainable machine learning models to answer business problems against large data sets.
• Build methods for document clustering, topic modeling, text classification, named entity recognition, sentiment analysis, and POS tagging.
• Perform elements of data cleaning, feature selection and feature engineering and organize experiments in conjunction with best practices.
• Benchmark, apply, and test algorithms against success metrics. Interpret the results in terms of relating those metrics to the business process.
• Work with development teams to ensure models can be implemented as part of a delivered solution replicable across many clients.
• Knowledge of Machine Learning, NLP, Document Classification, Topic Modeling and Information Extraction with a proven track record of applying them to real problems.
• Experience working with big data systems and big data concepts.
• Ability to provide clear and concise communication both with other technical teams and non-technical domain specialists.
• Strong team player; ability to provide both a strong individual contribution but also work as a team and contribute to wider goals is a must in this dynamic environment.
• Experience with noisy and/or unstructured textual data.

knowledge graph and NLP including summarization, topic modelling etc

• Strong coding ability with statistical analysis tools in Python or R, and general software development skills (source code management, debugging, testing, deployment, etc.)
• Working knowledge of various text mining algorithms and their use-cases such as keyword extraction, PLSA, LDA, HMM, CRF, deep learning & recurrent ANN, word2vec/doc2vec, Bayesian modeling.
• Strong understanding of text pre-processing and normalization techniques, such as tokenization,
• POS tagging and parsing and how they work at a low level.
• Excellent problem solving skills.
• Strong verbal and written communication skills
• Masters or higher in data mining or machine learning; or equivalent practical analytics / modelling experience
• Practical experience in using NLP related techniques and algorithms
• Experience in open source coding and communities desirable.

Able to containerize Models and associated modules and work in a Microservices environment

GCP  Data Analyst profile must have below skills sets :

• Knowledge of programming languages like https://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.simplilearn.com%2Ftutorials%2Fsql-tutorial%2Fhow-to-become-sql-developer&;data=05%7C01%7Ca_anjali%40hcl.com%7C4ae720b3f3cc45c3e04608da3346b335%7C189de737c93a4f5a8b686f4ca9941912%7C0%7C0%7C637878675987971859%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=EImfaJAD1KHOyrBQ7FkbaPl1STtfnf4QdQlbjw72%2BmE%3D&reserved=0" target="_blank">SQL, Oracle, R, MATLAB, Java and https://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.simplilearn.com%2Fwhy-learn-python-a-guide-to-unlock-your-python-career-article&;data=05%7C01%7Ca_anjali%40hcl.com%7C4ae720b3f3cc45c3e04608da3346b335%7C189de737c93a4f5a8b686f4ca9941912%7C0%7C0%7C637878675987971859%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Z2n1Xy%2F3YN6nQqSweU5T7EfUTa1kPAAjbCMTWxDCh%2FY%3D&reserved=0" target="_blank">Python
• Data cleansing, data visualization, data wrangling
• Data modeling , data warehouse concepts
• Adapt to Big data platform like Hadoop, Spark for stream & batch processing
• GCP (Cloud Dataproc, Cloud Dataflow, Cloud Datalab, Cloud Dataprep, BigQuery, Cloud Datastore, Cloud Datafusion, Auto ML etc)

Role and Responsibilities:

1. Designing and developing test automation scripts for a web application (Angular) using test automation guidelines.
2. Performance, Security, Penetration, Vulnerability testing.
3. Build tools and frameworks to aid continuous delivery, deployment, and debugging.
4. Supporting the development team and software engineers during the development and testing phase.
5. Prepare defect reports and report test progress.

Qualifications and Requirements:

1. Experience in Automation Testing with Cypress, JavaScript, Typescript, or similar end-to-end testing tools.
2. Experience with Regression, Smoke testing, API, and Backend testing.
3. Experience with non-functional testing, performance, vulnerability testing.
4. Excellent knowledge in testing skills (design test plan and test strategy, writing and executing test cases, opening bugs, verifying bugs, etc).
5. A team player, fast learner with good interpersonal, verbal, and written communication skills.

Job Summary
3-4 years of PHP, MySQL development experience
Minimum 1 year of Drupal 8 development experience
Experience in developing custom module and themes in Drupal 8
Good to have experience in panel-based theme development
Basic knowledge of Git
Basic knowledge of HTML5, JS and CSS
Basic knowledge of Linux system to deploy code on the test server