11+ Spark Jobs in Coimbatore | Spark Job openings in Coimbatore
Apply to 11+ Spark Jobs in Coimbatore on CutShort.io. Explore the latest Spark Job opportunities across top companies like Google, Amazon & Adobe.
We are hiring for Tier 1 MNC for the software developer with good knowledge in Spark,Hadoop and Scala
at Optisol Business Solutions Pvt Ltd
Role Summary
As a Data Engineer, you will be an integral part of our Data Engineering team supporting an event-driven server less data engineering pipeline on AWS cloud, responsible for assisting in the end-to-end analysis, development & maintenance of data pipelines and systems (DataOps). You will work closely with fellow data engineers & production support to ensure the availability and reliability of data for analytics and business intelligence purposes.
Requirements:
· Around 4 years of working experience in data warehousing / BI system.
· Strong hands-on experience with Snowflake AND strong programming skills in Python
· Strong hands-on SQL skills
· Knowledge with any of the cloud databases such as Snowflake,Redshift,Google BigQuery,RDS,etc.
· Knowledge on debt for cloud databases
· AWS Services such as SNS, SQS, ECS, Docker, Kinesis & Lambda functions
· Solid understanding of ETL processes, and data warehousing concepts
· Familiarity with version control systems (e.g., Git/bit bucket, etc.) and collaborative development practices in an agile framework
· Experience with scrum methodologies
· Infrastructure build tools such as CFT / Terraform is a plus.
· Knowledge on Denodo, data cataloguing tools & data quality mechanisms is a plus.
· Strong team player with good communication skills.
Overview Optisol Business Solutions
OptiSol was named on this year's Best Companies to Work for list by Great place to work. We are a team of about 500+ Agile employees with a development center in India and global offices in the US, UK (United Kingdom), Australia, Ireland, Sweden, and Dubai. 16+ years of joyful journey and we have built about 500+ digital solutions. We have 200+ happy and satisfied clients across 24 countries.
Benefits, working with Optisol
· Great Learning & Development program
· Flextime, Work-at-Home & Hybrid Options
· A knowledgeable, high-achieving, experienced & fun team.
· Spot Awards & Recognition.
· The chance to be a part of next success story.
· A competitive base salary.
More Than Just a Job, We Offer an Opportunity To Grow. Are you the one, who looks out to Build your Future & Build your Dream? We have the Job for you, to make your dream comes true.
Responsibilities
Data associates play a critical role and work on various data or content-focused projects across the organisation. The role is work from home, with a monthly in-person meet up with other team members in local region.
- Analyze large set of unstructured data, extract insights and store in data management systems.
- Research, gather, write informational news articles and stories
- Categorize entities based on a set of rules and gained knowledge and experience, dashboard information, and validation with proprietary algorithms and data-driven heuristics.
- Analyze the market (including competitors) and ensure a rich level of data quality across all products and platforms across.
- Complete ad hoc data retrieval and analysis using relational databases, Excel and other data management systems.
- Monitor existing metrics as well as develop and propose new metrics to make actionable intelligence available to business stakeholders.
- Support cross-functional teams on the day-to-day execution of projects and initiatives.
- Communicate insights to key stakeholders.
Requirements
- Preferred: Bachelors in Engineering or Science.
- GPA of 8+ or an overall score of 80%+.
- Location: Coimbatore / Remote
- Strong analytical and problem solving skills with focus on quality and detail orientation.
- Strong proficiency in English reading, written, communication.
- Strong work ethic and personal initiative, reliable self-starter that is capable of working with a high degree of autonomy.
- Ability to work across global cross-office teams and in a team environment.
- Excellent organizational and task management skills.
- Strong verbal and written communication skills with the ability to articulate results and issues to internal and client teams.
- Process management, improvement focus, and willingness to learn cutting edge tool and technology.
Job Description:
- Understanding about depth and breadth of computer vision and deep learning algorithms.
- At least 2 years of experience in computer vision and or deep learning for object detection and tracking along with semantic or instance segmentation either in the academic or industrial domain.
- Experience with any machine deep learning frameworks like Tensorflow, Keras, Scikit-Learn and PyTorch.
- Experience in training models through GPU computing using NVIDIA CUDA or on the cloud.
- Ability to transform research articles into working solutions to solve real-world problems.
- Strong experience in using both basic and advanced image processing algorithms for feature engineering.
- Proficiency in Python and related packages like numpy, scikit-image, PIL, opencv, matplotlib, seaborn, etc.
- Excellent written and verbal communication skills for effectively communicating with the team and ability to present information to a varied technical and non-technical audiences.
- Must be able to produce solutions independently in an organized manner and also be able to work in a team when required.
- Must have good Object-Oriented Programing & logical analysis skills in Python.
- Must have the experience of leading teams and drive customer interactions
- Must have multiple successful deployments user stories
- Extensive hands on experience in Apache Spark along with HiveQL
- Sound knowledge in Amazon Web Services or any other Cloud environment.
- Experienced in data flow orchestration using Apache Airflow
- JSON, XML, CSV, Parquet file formats with snappy compression.
- File movements between HDFS and AWS S3
- Experience in shell scripting and scripting to automate report generation and migration of reports to AWS S3
- Worked in building a data pipeline using Pandas and Flask FrameworkGood Familiarity with Anaconda and Jupyternotebook
We are looking for ETL Developer for Reputed Client @ Coimbatore Permanent role
Work Location : Coimbatore
Experience : 4+ Years
Skills ;
- Talend (or)Strong experience in any of the ETL Tools like (Informatica/Datastage/Talend)
- DB preference (Teradata /Oracle /Sql server )
- Supporting Tools (JIRA/SVN)
Role : Talend developer
Location : Coimbatore
Experience : 4+Years
Skills : Talend, any DB
Notice period : Immediate to 15 Days
We are looking for a Data Scientist to analyze large amounts of raw information to find patterns that will help improve our company.
We will rely on you to build data products to extract valuable business insights.
In this role, you should be highly analytical with a knack for analysis, math and statistics.
Critical thinking and problem-solving skills are essential for interpreting data.
We also want to see a passion for machine-learning and research.
Your goal will be to help our company analyze trends to make better decisions.
Responsibilities:
- Identify valuable data sources and automate collection processes
- Undertake preprocessing of structured and unstructured data
- Analyze large amounts of information to discover trends and patterns
- Build predictive models and machine-learning algorithms
- Combine models through ensemble modeling
- Present information using data visualization techniques
- Propose solutions and strategies to business challenges
- Collaborate with engineering and product development teams
Requirements:
- Proven experience as a Data Scientist or Data Analyst
- Experience in data mining
- Understanding of machine-learning and operations research
- Knowledge of SQL,Python,R,ggplot2, matplotlib, seaborn, Shiny, Dash; familiarity with Scala, Java or C++ is an asset
- Experience using business intelligence tools (e.g. Tableau) and data frameworks
- Analytical mind and business acumen
- Strong math skills in statistics, algebra
- Problem-solving aptitude
- Excellent communication and presentation skills
- BSc/BE in Computer Science, Engineering or relevant field;
- graduate degree in Data Science or other quantitative field is preferred