11+ Data-flow analysis Jobs in Chennai | Data-flow analysis Job openings in Chennai

Roles & Responsibilities

• Data Engineering Excellence: Design and implement data pipelines using formats like JSON, Parquet, CSV, and ORC, utilizing batch and streaming ingestion.
• Cloud Data Migration Leadership: Lead cloud migration projects, developing scalable Spark pipelines.
• Medallion Architecture: Implement Bronze, Silver, and gold tables for scalable data systems.
• Spark Code Optimization: Optimize Spark code to ensure efficient cloud migration.
• Data Modeling: Develop and maintain data models with strong governance practices.
• Data Cataloging & Quality: Implement cataloging strategies with Unity Catalog to maintain high-quality data.
• Delta Live Table Leadership: Lead the design and implementation of Delta Live Tables (DLT) pipelines for secure, tamper-resistant data management.
• Customer Collaboration: Collaborate with clients to optimize cloud migrations and ensure best practices in design and governance.

Educational Qualifications

• Experience: Minimum 5 years of hands-on experience in data engineering, with a proven track record in complex pipeline development and cloud-based data migration projects.
• Education: Bachelor’s or higher degree in Computer Science, Data Engineering, or a related field.
• Skills
• Must-have: Proficiency in Spark, SQL, Python, and other relevant data processing technologies. Strong knowledge of Databricks and its components, including Delta Live Table (DLT) pipeline implementations. Expertise in on-premises to cloud Spark code optimization and Medallion Architecture.

Good to Have

• Familiarity with AWS services (experience with additional cloud platforms like GCP or Azure is a plus).

Soft Skills

• Excellent communication and collaboration skills, with the ability to work effectively with clients and internal teams.
• Certifications
• AWS/GCP/Azure Data Engineer Certification.

https://www.ynos.in/" target="_blank">YNOS is a next-generation funded startup founded by IIT Madras faculty and incubated at IIT Madras Incubation Cell. It is a digital platform for Entrepreneurs, Investors, Innovators and Eco-system enablers, providing actionable insights on the startup and investment landscape in India. We are passionate about solving tough problems using technology and data, making a difference

The Opening
We are presently seeking for our next enthusiastic, talented, and driven Python Backend Engineer to start right away. We'd want you to

• Be excited about building a next-generation intelligence platform
• Possess a can-do attitude and be open to new challenges
• Value working with a great team - self-assured, creative, and insightful individuals who work together to achieve amazing things
• Be willing to explore, learn, and contribute new ideas to the platform, thereby improving it
• Be high on self-belief and enthusiasm to work in a startup culture - small team, fast-paced work environment

As the Python Backend Engineer in https://www.ynos.in/" target="_blank">YNOS, you will

• Create reusable optimised code and libraries
• Deploy task management systems and automate routine tasks
• Build performant apps that adhere to the best practices, therefore increasing latency, performance, and scalability
• Improve the existing codebase while reducing technical debt
• Take charge of all elements of the application, including architecture, quality, and efficiency

• Proficient understanding of Python language
• Expertise in developing web apps and APIs using Python frameworks like Flask with an overall grasp of client-server interactions
• Familiarity with task management systems and process automation
• Comfortable with using Command Line and Linux systems
• Experience and understanding of version control systems like git, svn, etc
• Knowledge of NoSQL databases such as MongoDB

Good to have

• Expertise in other backend frameworks viz. Django, NodeJS, Go, Rust etc
• Knowledge of data-modelling, data-wrangling & data-mining techniques
• Experience with data visualisation tools & libraries such as Plotly, Seaborn etc
• Exposure to Statistical and Machine Learning (ML) techniques, particularly in the field of Natural Language Processing (NLP)
• Familiarity with front-end tools & frameworks such as HTML, CSS, JS, React, Vue, and others

Work location, Job type & Salary

• Our office is located at https://respark.iitm.ac.in/" target="_blank">IIT Madras Research Park, Chennai, Tamil Nadu, surrounded by the beautiful IITM Campus!
• This is a full-time position and we’d like you to relocate to Chennai
• Expected salary range ₹6L - ₹8L per annum

Roles and Responsibilities

1. Ability to work on diverse backend stack such as Node JS, Java, Express JS
2. Ability to work on diverse frontend stack such as React JS, Angular 6/7/8/9, HTML5, CSS3
3. Ability to deliver quick POC’s using cutting edge technologies.
4. Preparing reports, manuals and other documentation on the status, operation and maintenance of software.
5. Design, develop, and unit test applications in accordance with established standards
6. Developing, refining, and tuning integrations between applications. Analysing and resolving technical and application problems.
7. Ability to debug application.
8. Should have complete knowledge on developing RESTful Services.
9. Should be able to also work in agile development methodology.

Competency Requirements

1. Experience in NodeJS, Java and development using AngularJS / ReactJS
2. Experience in front end frameworks such as Angular.js, React.js, Bootstrap, Foundation etc
3. Experience in client/server application development
4. Knowledge of agile development methodologies
5. Knowledge of unit testing theory
6. Knowledge of AWS cloud
7. Experience in Java, Python and Go will be added advantage

Roles & Responsibilities

As a member of our fast-growing engineering team, your responsibility will be to get involved in day-to-day development operations and solve complex problems of digitization to meet the demands of business.

To be successful, you must have a self-driven mindset, go getter attitude.

The responsibilities include:

• Writing the clean quality code & Understanding functional requirements thoroughly and analyzing the requirements in the context of the product
• Envisioning the overall solution for defined functional and non-functional requirements, and being able to define technologies, patterns and frameworks
• Determining and implementing design methodologies and tool sets
• Enabling application development by coordinating requirements, schedules, and activities
• Being able to lead/support UAT and production roll outs
• Creating, understanding and validating estimated effort for given module/task, and being able to justify it
• Addressing issues promptly, responding positively to setbacks and challenges with a mindset of continuous improvement
• Giving constructive feedback to the team members and setting clear expectations
• Helping the team in troubleshooting and resolving complex bugs
• Coming up with solutions to any issue that is raised during code/design review and being able to justify the decision taken
• Carrying out POCs to make sure that suggested design/technologies meet the requirements
• Carrying out DevOps activities which includes creating Jenkins pipeline

Key Skills

Should possess hands-on full life-cycle development experience (architect, design, code, test, release) be comfortable around both front-end and back-end coding languages, client/server-side development frameworks and third-party libraries.

• Should be strong in data structures and algorithms. Solid understanding of object-oriented programming
• Work with cutting edge technologies like Java 8, Scala, React, Akka, Docker, Puppet, and Salt
• Hands-on knowledge of Spring core, MVC, JPA. Working knowledge of Spring Boot
• Should have strong hands-on on one of the JavaScript frameworks: jQuery, AngularJS, ReactJS, and Vue.js.
• Willing to working with latest Cloud and Container technologies like AWS
• Experience with both external and embedded databases. NoSQL DB experience is good to have
• Implementing unit testing using frameworks like JUnit, Mockito, etc.
• Proficient understanding of code versioning tools, such as Git
• Familiarity with Maven (Other building tools Ant and Gradle are good to have)
• Familiarity with continuous integration
• Good understanding of Agile practices

• MSSQL, SSIS, Performance Tuning, Data modeling.
• Experience in No SQL tools is must
• Candidate should have exposure to write scripts in Python/Node JS/MongoDB or any other tool
• Maria DB/MYSQL, Mongo DB, Github, Jira
• Understand Requirements from client and on-site team.
• Participate in preparing design and data modelling.
• Comfortable with SQL Stored procedures and queries development.
• Comfortable with SQL Stored procedures and queries development.
• Manage SQL Server through multiple product lifecycle / environments, from development to critical production systems.
• Apply best in industry standard techniques for data modeling to ensure performance, integrate and requirement.
• Ability to analyze independently problems and resolve them on time.