Loading...

{{notif_text}}

Let the best companies discover your talent - Check out Cutshort Discovered

Apache Spark Jobs in Bangalore (Bengaluru)

Explore top Apache Spark Job opportunities in Bangalore (Bengaluru) for Top Companies & Startups. All jobs are added by verified employees who can be contacted directly below.

Data Engineer
Data Engineer

Founded 2017
Products and services{{j_company_types[3 - 1]}}
{{j_company_sizes[2 - 1]}} employees
{{j_company_stages[2 - 1]}}
{{rendered_skills_map[skill] || skill}}
Location icon
Bengaluru (Bangalore)
Experience icon
2 - 5 years
Experience icon
Best in industry5 - 20 lacs/annum

Who are we and Why Yulu for you?Yulu's vision is to reduce traffic congestion by providing a scalable, affordable, efficient and clean solution for the first mile, last mile and short distance commute. We strongly believe that short commute mode can be made more Efficient, Affordable and GREEN, thereby ensuring that future generations will have a healthy environment to live. We want to replace big personal vehicles with a smaller form factor that does not require fossil fuel. Yulu uses IoT technology to create a vast network of shared bikes that can be rented easily by user-friendly app in pay per use business model.We are a mission driven company based out of Bangalore with a solid founding team and big ambitions. At Yulu we believe that every day is a mission and success is exciting when its attained with fun and as a team. If you want to solve the problem of traffic congestion, reduce pollution, positively impact the society and be part of an international dynamic team, join us in our journey to shape better India for our future generations.Responsibility Working with Big Data tools and frameworks to provide requested capabilities Identify development needs in order to improve and streamline operations Develop and manage BI solutions Implementing ETL process and Data Warehousing Monitoring performance and managing infrastructure Skills required 2+ years of experience in relevent field Proficient understanding of distributed computing principles Proficiency with Hadoop and Spark Experience with building stream-processing systems, using solutions such as Kafka and Spark-Streaming Good knowledge of Data querying tools SQL and Hive Experience with integration of data from multiple data sources Knowledge of various ETL techniques and frameworks Experience with Python/Java/Scala (at least one) Experience with cloud services such as AWS or GCP Experience with NoSQL databases, such as DynamoDB,MongoDB will be an advantage

Job posted by
apply for job
apply for job
Abhisek Prasad picture
Abhisek Prasad
Job posted by
Abhisek Prasad picture
Abhisek Prasad
Apply for job
apply for job

Data Scientist
Data Scientist

Founded 2017
Products and services{{j_company_types[3 - 1]}}
{{j_company_sizes[2 - 1]}} employees
{{j_company_stages[2 - 1]}}
{{rendered_skills_map[skill] || skill}}
Location icon
Bengaluru (Bangalore)
Experience icon
3 - 10 years
Experience icon
Best in industry6 - 25 lacs/annum

Who are we and Why Yulu for you?Yulu's vision is to reduce traffic congestion by providing a scalable, affordable, efficient and clean solution for the first mile, last mile and short distance commute. We strongly believe that short commute mode can be made more Efficient, Affordable and GREEN, thereby ensuring that future generations will have a healthy environment to live. We want to replace big personal vehicles with a smaller form factor that does not require fossil fuel. Yulu uses IoT technology to create a vast network of shared bikes that can be rented easily by user-friendly app in pay per use business model.We are a mission driven company based out of Bangalore with a solid founding team and big ambitions. At Yulu we believe that every day is a mission and success is exciting when its attained with fun and as a team. If you want to solve the problem of traffic congestion, reduce pollution, positively impact the society and be part of an international dynamic team, join us in our journey to shape better India for our future generations.Responsibility Collaborate with members from a variety of teams to improve decision making and boost performance across the company Evaluate, adapt new and improved data storage and analytics approaches with the vision of creating innovative data driven insights at the quickest pace possible Develop new ways for modeling and predicting commute patterns as well as summarize, visualize and present key findings with all stakeholders. Skills required  Problem solving using Supervised & Unsupervised algorithms in scikit-learn and TensorFlow Experience programming in Python and data-wrangling using Excel, SQL, Pandas and Jupyter notebook Experience using Apache Spark, Apache Kafka and relevant Big Data tools Experience working with Timeseries and Geospatial datasets would be wonderful Good understanding of statistics to help make decisions and design/evaluate experiments Experience & Qualification 2+ years of real-world Data Science experience Bachelor's in Computer Science or in a relevant field

Job posted by
apply for job
apply for job
Abhisek Prasad picture
Abhisek Prasad
Job posted by
Abhisek Prasad picture
Abhisek Prasad
Apply for job
apply for job

Data Engineer
Data Engineer

Founded 2018
Products and services{{j_company_types[2 - 1]}}
{{j_company_sizes[2 - 1]}} employees
{{j_company_stages[1 - 1]}}
{{rendered_skills_map[skill] || skill}}
Location icon
Bengaluru (Bangalore)
Experience icon
0 - 1 years
Experience icon
Best in industry2 - 3 lacs/annum

We are looking for BE/BTech graduates (2018/2019 pass out) who want to build their career as Data Engineer covering technologies like Hadoop, NoSQL, RDBMS, Spark, Kafka, Hive, ETL, MDM & Data Quality. You should be willing to learn, explore, experiment, develop POCs/Solutions using these technologies with guidance and support from highly experienced Industry Leaders. You should be passionate about your work and willing to go extra mile to achieve results. We are looking for candidates who believe in commitment and in building strong relationships. We need people who are passionate about solving problems through software and are flexible. Required Experience, Skills and Qualifications Passionate to learn and explore new technologies Any RDBMS experience (SQL Server/Oracle/MySQL) Any ETL tool experience (Informatica/Talend/Kettle/SSIS) Understanding of Big Data technologies Good Communication Skills Excellent Mathematical / Logical / Reasoning Skills

Job posted by
apply for job
apply for job
Kamal Prithiani picture
Kamal Prithiani
Job posted by
Kamal Prithiani picture
Kamal Prithiani
Apply for job
apply for job

Lead Data Engineer
Lead Data Engineer

via Lymbyc
Founded 2012
Products and services{{j_company_types[1 - 1]}}
{{j_company_sizes[3 - 1]}} employees
{{j_company_stages[3 - 1]}}
{{rendered_skills_map[skill] || skill}}
Location icon
Bengaluru (Bangalore), Chennai
Experience icon
4 - 8 years
Experience icon
Best in industry9 - 14 lacs/annum

Key skill set : Apache NiFi, Kafka Connect (Confluent), Sqoop, Kylo, Spark, Druid, Presto, RESTful services, Lambda / Kappa architectures Responsibilities : - Build a scalable, reliable, operable and performant big data platform for both streaming and batch analytics - Design and implement data aggregation, cleansing and transformation layers Skills : - Around 4+ years of hands-on experience designing and operating large data platforms - Experience in Big data Ingestion, Transformation and stream/batch processing technologies using Apache NiFi, Apache Kafka, Kafka Connect (Confluent), Sqoop, Spark, Storm, Hive etc; - Experience in designing and building streaming data platforms in Lambda, Kappa architectures - Should have working experience in one of NoSQL, OLAP data stores like Druid, Cassandra, Elasticsearch, Pinot etc; - Experience in one of data warehousing tools like RedShift, BigQuery, Azure SQL Data Warehouse - Exposure to other Data Ingestion, Data Lake and querying frameworks like Marmaray, Kylo, Drill, Presto - Experience in designing and consuming microservices - Exposure to security and governance tools like Apache Ranger, Apache Atlas - Any contributions to open source projects a plus - Experience in performance benchmarks will be a plus