Data Engineer

Senior Software Engineer - Data 

Job Description:

We are looking for a tech savvy Data Engineer to join our growing data team. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will support our software developers, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. The hire must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. 

Data Engineer Job Responsibilities:

• Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity.
• Implement processes and systems to monitor data accuracy, ensuring 100% data availability for key stakeholders and business processes that depend on it.
• Write unit/integration tests and document work.
• Perform data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
• Design data integrations and reporting framework.
• Work with stakeholders including the Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs
• Design and evaluate open source and vendor tools for data lineage.
• Work closely with all business units and engineering teams to develop strategy for long term data platform architecture.

Data Engineer Qualifications / Skills:

• 3+ years of Java development experience
• Experience with or knowledge of Agile Software Development methodologies
• Excellent problem solving and troubleshooting skills
• Process oriented with great documentation skills
• Experience with big data technologies like Kafka, BigQuery, etc
• Experience with AWS cloud services: EC2, RDS, etc
• Experience with message queuing, stream-processing systems

Education, Experience and Licensing Requirements:

• Degree in Computer Science, IT, or similar field; a Master’s is a plus
• 3+ years of hands on development experience
• 3+ years of SQL experience (No-SQL experience is a plus)
• 3+ years of experience with schema design and dimensional data modeling
• Experience designing, building and maintaining data processing systems

Hiring - Python Developer Freelance Consultant (WFH-Remote)

Greetings from Deltacubes Technology!!

Skillset Required:

Python

Pyspark

AWS

Scala

Experience:

5+ years

Thanks

Bavithra

Greetings !!!

Looking Urgently !!!

Exp-Min 10 Years

Location-Delhi

Sal-nego

Role

AWS Data Migration Consultant

Provide Data Migration strategy, expert review and guidance on Data Migration from onprem to AWS infrastructure that includes AWS Fargate, PostgreSQL, DynamoDB. This includes review and SME inputs on:

·       Data migration plan, architecture, policies, procedures

·       Migration testing methodologies

·       Data integrity, consistency, resiliency.

·       Performance and Scalability

·       Capacity planning

·       Security, access control, encryption

·       DB replication and clustering techniques

·       Migration risk mitigation approaches

·       Verification and integrity testing, reporting (Record and field level verifications)

·       Schema consistency and mapping

·       Logging, error recovery

·       Dev-test, staging and production artifact promotions and deployment pipelines

·       Change management

·       Backup, DR approaches and best practices.

Qualifications

• Worked on mid to large scale data migration projects, specifically from on-prem to AWS, preferably in BFSI domain
• Deep expertise in AWS Redshift, PostgreSQL, DynamoDB from data management, performance, scalability and consistency standpoint
• Strong knowledge of AWS Cloud architecture and components, solutions, well architected frameworks
• Expertise in SQL and DB performance related aspects
• Solution Architecture work for enterprise grade BFSI applications
• Successful track record of defining and implementing data migration strategies
• Excellent communication and problem solving skills
• 10+ Yrs experience in Technology, at least 4+yrs in AWS and DBA/DB Management/Migration related work
• Bachelors degree or higher in Engineering or related field

• Experience with Cloud native Data tools/Services such as AWS Athena, AWS Glue, Redshift Spectrum, AWS EMR, AWS Aurora, Big Query, Big Table, S3, etc.

• Strong programming skills in at least one of the following languages: Java, Scala, C++.

• Familiarity with a scripting language like Python as well as Unix/Linux shells.

• Comfortable with multiple AWS components including RDS, AWS Lambda, AWS Glue, AWS Athena, EMR. Equivalent tools in the GCP stack will also suffice.

• Strong analytical skills and advanced SQL knowledge, indexing, query optimization techniques.

• Experience implementing software around data processing, metadata management, and ETL pipeline tools like Airflow.

Experience with the following software/tools is highly desired:

• Apache Spark, Kafka, Hive, etc.

• SQL and NoSQL databases like MySQL, Postgres, DynamoDB.

• Workflow management tools like Airflow.

• AWS cloud services: RDS, AWS Lambda, AWS Glue, AWS Athena, EMR.

• Familiarity with Spark programming paradigms (batch and stream-processing).

• RESTful API services.

Who Are We

A research-oriented company with expertise in computer vision and artificial intelligence, at its core, Orbo is a comprehensive platform of AI-based visual enhancement stack. This way, companies can find a suitable product as per their need where deep learning powered technology can automatically improve their Imagery.

ORBO's solutions are helping BFSI, beauty and personal care digital transformation and Ecommerce image retouching industries in multiple ways.

WHY US

• Join top AI company
• Grow with your best companions
• Continuous pursuit of excellence, equality, respect
• Competitive compensation and benefits

You'll be a part of the core team and will be working directly with the founders in building and iterating upon the core products that make cameras intelligent and images more informative.

To learn more about how we work, please check out

https://www.orbo.ai/.

Description:

We are looking for a computer vision engineer to lead our team in developing a factory floor analytics SaaS product. This would be a fast-paced role and the person will get an opportunity to develop an industrial grade solution from concept to deployment.

Responsibilities:

• Research and develop computer vision solutions for industries (BFSI, Beauty and personal care, E-commerce, Defence etc.)
• Lead a team of ML engineers in developing an industrial AI product from scratch
• Setup end-end Deep Learning pipeline for data ingestion, preparation, model training, validation and deployment
• Tune the models to achieve high accuracy rates and minimum latency
• Deploying developed computer vision models on edge devices after optimization to meet customer requirements

Requirements:

• Bachelor’s degree
• Understanding about depth and breadth of computer vision and deep learning algorithms.
• 4+ years of industrial experience in computer vision and/or deep learning
• Experience in taking an AI product from scratch to commercial deployment.
• Experience in Image enhancement, object detection, image segmentation, image classification algorithms
• Experience in deployment with OpenVINO, ONNXruntime and TensorRT
• Experience in deploying computer vision solutions on edge devices such as Intel Movidius and Nvidia Jetson
• Experience with any machine/deep learning frameworks like Tensorflow, and PyTorch.
• Proficient understanding of code versioning tools, such as Git

Our perfect candidate is someone that:

• is proactive and an independent problem solver
• is a constant learner. We are a fast growing start-up. We want you to grow with us!
• is a team player and good communicator

What We Offer:

• You will have fun working with a fast-paced team on a product that can impact the business model of E-commerce and BFSI industries. As the team is small, you will easily be able to see a direct impact of what you build on our customers (Trust us - it is extremely fulfilling!)
• You will be in charge of what you build and be an integral part of the product development process
• Technical and financial growth!