11+ AWS Simple Queuing Service (SQS) Jobs in Chennai | AWS Simple Queuing Service (SQS) Job openings in Chennai

Role Summary

As a Data Engineer, you will be an integral part of our Data Engineering team supporting an event-driven server less data engineering pipeline on AWS cloud, responsible for assisting in the end-to-end analysis, development & maintenance of data pipelines and systems (DataOps). You will work closely with fellow data engineers & production support to ensure the availability and reliability of data for analytics and business intelligence purposes.

Requirements:

·      Around 4 years of working experience in data warehousing / BI system.

·      Strong hands-on experience with Snowflake AND strong programming skills in Python

·      Strong hands-on SQL skills

·      Knowledge with any of the cloud databases such as Snowflake,Redshift,Google BigQuery,RDS,etc.

·      Knowledge on debt for cloud databases

·      AWS Services such as SNS, SQS, ECS, Docker, Kinesis & Lambda functions

·      Solid understanding of ETL processes, and data warehousing concepts

·      Familiarity with version control systems (e.g., Git/bit bucket, etc.) and collaborative development practices in an agile framework

·      Experience with scrum methodologies

·      Infrastructure build tools such as CFT / Terraform is a plus.

·      Knowledge on Denodo, data cataloguing tools & data quality mechanisms is a plus.

·      Strong team player with good communication skills.

Overview Optisol Business Solutions

OptiSol was named on this year's Best Companies to Work for list by Great place to work. We are a team of about 500+ Agile employees with a development center in India and global offices in the US, UK (United Kingdom), Australia, Ireland, Sweden, and Dubai. 16+ years of joyful journey and we have built about 500+ digital solutions. We have 200+ happy and satisfied clients across 24 countries.

Benefits, working with Optisol

·      Great Learning & Development program

·      Flextime, Work-at-Home & Hybrid Options

·      A knowledgeable, high-achieving, experienced & fun team.

·      Spot Awards & Recognition.

·      The chance to be a part of next success story.

·      A competitive base salary.

More Than Just a Job, We Offer an Opportunity To Grow. Are you the one, who looks out to Build your Future & Build your Dream? We have the Job for you, to make your dream comes true.

• 3+ years experience in practical implementation and deployment of ML based systems preferred.
• BE/B Tech or M Tech (preferred) in CS/Engineering with strong mathematical/statistical background
• Strong mathematical and analytical skills, especially statistical and ML techniques, with familiarity with different supervised and unsupervised learning algorithms
• Implementation experiences and deep knowledge of Classification, Time Series Analysis, Pattern Recognition, Reinforcement Learning, Deep Learning, Dynamic Programming and Optimisation
• Experience in working on modeling graph structures related to spatiotemporal systems
• Programming skills in Python
• Experience in developing and deploying on cloud (AWS or Google or Azure)
• Good verbal and written communication skills
• Familiarity with well-known ML frameworks such as Pandas, Keras, TensorFlow

Roles & Responsibilities:

-Adopt novel and breakthrough Deep Learning/Machine Learning technology to fully solve real world problems for different industries. -Develop prototypes of machine learning models based on existing research papers.

-Utilize published/existing models to meet business requirements. Tweak existing implementations to improve efficiencies and adapt for use-case variations.

-Optimize machine learning model training and inference time. -Work closely with development and QA teams in transitioning prototypes to commercial products

-Independently work end-to-end from data collection, preparation/annotation to validation of outcomes.

-Define and develop ML infrastructure to improve efficiency of ML development workflows.

Must Have:

- Experience in productizing and deployment of ML solutions.

- AI/ML expertise areas: Computer Vision with Deep Learning. Experience with object detection, classification, recognition; document layout and understanding tasks, OCR/ICR

. - Thorough understanding of full ML pipeline, starting from data collection to model building to inference.

- Experience with Python, OpenCV and at least a few framework/libraries (TensorFlow / Keras / PyTorch / spaCy / fastText / Scikit-learn etc.)

- Years with relevant experience:

5+ -Experience or Knowledge in ML OPS.

Good to Have: NLP: Text classification, entity extraction, content summarization. AWS, Docker.

About the company:

VakilSearch is a technology-driven platform, offering services that cover the legal needs of startups and established businesses. Some of our services include incorporation, government registrations & filings, accounting, documentation and annual compliances. In addition, we offer a wide range of services to individuals, such as property agreements and tax filings. Our mission is to provide one-click access to individuals and businesses for all their legal and professional needs.

You can learn more about us at https://vakilsearch.com/">vakilsearch.com.

About the role:

A successful data analyst needs to have a combination of technical as well leadership skills. A background in Mathematics, Statistics, Computer Science, Information Management can serve as a solid foundation to build your career as a data analyst at VakilSearch.

Why to join Vakilsearch:

• Unlimited opportunities to grow
• Flat hierarchy
• Encouraging environment to unleash your out of box thinking skills

Responsibilities:

• Preparing reports for the stakeholders and the management, enabling them to take important decisions based on various facts and trends.
• Using automated tools to extract data from primary and secondary sources
• Identify and recommend the right product metrics to be analysed and tracked for every feature/problem statement.
• Using statistical tools to identify, analyze, and interpret patterns and trends in complex data sets that could be helpful for the diagnosis and prediction
• Working with programmers, engineers, and management heads to identify process improvement opportunities, propose system modifications, and devise data governance strategies.

Required skills:

• Bachelor’s degree from an accredited university or college in computer science or graduate from data science related program
• Minimum of 0 - 2 years experience in analysing

Responsibilities:

• Designing Hive/HCatalog data model includes creating table definitions, file formats, compression techniques for Structured & Semi-structured data processing

• Implementing Spark processing based ETL frameworks

• Implementing Big data pipeline for Data Ingestion, Storage, Processing & Consumption

• Modifying the Informatica-Teradata & Unix based data pipeline

• Enhancing the Talend-Hive/Spark & Unix based data pipelines

• Develop and Deploy Scala/Python based Spark Jobs for ETL processing

• Strong SQL & DWH concepts.

Preferred Background:

• Function as integrator between business needs and technology solutions, helping to create technology solutions to meet clients’ business needs

• Lead project efforts in defining scope, planning, executing, and reporting to stakeholders on strategic initiatives

• Understanding of EDW system of business and creating High level design document and low level implementation document

• Understanding of Big Data Lake system of business and creating High level design document and low level implementation document

• Designing Big data pipeline for Data Ingestion, Storage, Processing & Consumption

• HIL testing with dSPACE, Software in loop validations
• Vector tools (CANape & CANalyzer)
• Service tools like ET, EST, EDT, and other tools including CADetWIN, CAT ET, Forcast, ESP.
• Knowledge and experience in protocols including J1939, CAN, CDL (Internal) and Ethernet
• Understanding and Hands-on experience with HIL hardware/harness
• Automation logics, Python, CCAT scripting, Simulators, Control and Automation desk

Experience, responsibilities, expectations from role:

• 3-4 years of Validation or Automation Experience.
• Ability to work in a product development organization with strong focus on Quality and delivery as per commitment to customers.
• Passion to delve into complex existing code, product modules and come up with the optimal solution for the problem at hand.
• Willingness to be flexible and stretch when there are critical needs within the organization.
• Excellent communication and team working skills which is expected among a global team set up.
• Develop the Test plans, validate the Features.
• Perform Regression, Mandatory & Change specific validation.
• Investigate and Support DSN team on the issues reported from the customers in the field.
• Able write the Python Scripts by looking into the Test plans.
• Acquaintance of CANape, CANalyzer Tools, MRET test setup’s

Key Responsibilities:

• Partnering with clients and internal business owners (product, marketing, edit, etc.) to understand needs and develop models and products for Kaleidofin business line.
• Good understanding of the underlying business and workings of cross functional teams for successful execution
• Design and develop analyses based on business requirement needs and challenges.
• Leveraging statistical analysis on consumer research and data mining projects, including segmentation, clustering, factor analysis, multivariate regression, predictive modeling, hyperparameter tuning, ensembling etc.
• Providing statistical analysis on custom research projects and consult on A/B testing and other statistical analysis as needed. Other reports and custom analysis as required.
• Identify and use appropriate investigative and analytical technologies to interpret and verify results.
• Apply and learn a wide variety of tools and languages to achieve results
• Use best practices to develop statistical and/ or machine learning techniques to build models that address business needs.
• Collaborate with the team to improve the effectiveness of business decisions using data and machine learning/predictive modeling.
• Innovate on projects by using new modeling techniques or tools.
• Utilize effective project planning techniques to break down complex projects into tasks and ensure deadlines are kept.
• Communicate findings to team and leadership to ensure models are well understood and incorporated into business processes.

Skills:

• 2+ year experience in advanced analytics, model building, statistical modeling, optimization, and machine learning algorithms.
• Machine Learning Algorithms: Crystal clear understanding, coding, implementation, error analysis, model tuning knowledge on Linear Regression, Logistic Regression, SVM, shallow Neural Networks, clustering, Decision Trees, Random forest, Boosting trees, Recommender Systems, ARIMA and Anomaly Detection. Feature selection, hyper parameters tuning, model selection and error analysis, ensemble methods.
• Strong with programming languages like Python and data processing using SQL or equivalent and ability to experiment with newer open source tools
• Experience in normalizing data to ensure it is homogeneous and consistently formatted to enable sorting, query and analysis.
• Experience designing, developing, implementing and maintaining a database and programs to manage data analysis efforts.
• Experience with big data and cloud computing viz. Spark, Hadoop (MapReduce, PIG, HIVE)
• Experience in risk and credit scoring domains preferred