Loading...

{{notif_text}}

Let the best companies discover your talent - Check out Cutshort Discovered

Spark Jobs in Bangalore (Bengaluru)

Explore top Spark Job opportunities in Bangalore (Bengaluru) for Top Companies & Startups. All jobs are added by verified employees who can be contacted directly below.

Data Engineer
Data Engineer

Founded 2017
Products and services{{j_company_types[3 - 1]}}
{{j_company_sizes[2 - 1]}} employees
{{j_company_stages[2 - 1]}}
{{rendered_skills_map[skill] || skill}}
Location icon
Bengaluru (Bangalore)
Experience icon
2 - 5 years
Experience icon
Best in industry5 - 20 lacs/annum

Who are we and Why Yulu for you?Yulu's vision is to reduce traffic congestion by providing a scalable, affordable, efficient and clean solution for the first mile, last mile and short distance commute. We strongly believe that short commute mode can be made more Efficient, Affordable and GREEN, thereby ensuring that future generations will have a healthy environment to live. We want to replace big personal vehicles with a smaller form factor that does not require fossil fuel. Yulu uses IoT technology to create a vast network of shared bikes that can be rented easily by user-friendly app in pay per use business model.We are a mission driven company based out of Bangalore with a solid founding team and big ambitions. At Yulu we believe that every day is a mission and success is exciting when its attained with fun and as a team. If you want to solve the problem of traffic congestion, reduce pollution, positively impact the society and be part of an international dynamic team, join us in our journey to shape better India for our future generations.Responsibility Working with Big Data tools and frameworks to provide requested capabilities Identify development needs in order to improve and streamline operations Develop and manage BI solutions Implementing ETL process and Data Warehousing Monitoring performance and managing infrastructure Skills required 2+ years of experience in relevent field Proficient understanding of distributed computing principles Proficiency with Hadoop and Spark Experience with building stream-processing systems, using solutions such as Kafka and Spark-Streaming Good knowledge of Data querying tools SQL and Hive Experience with integration of data from multiple data sources Knowledge of various ETL techniques and frameworks Experience with Python/Java/Scala (at least one) Experience with cloud services such as AWS or GCP Experience with NoSQL databases, such as DynamoDB,MongoDB will be an advantage

Job posted by
apply for job
apply for job
Abhisek Prasad picture
Abhisek Prasad
Job posted by
Abhisek Prasad picture
Abhisek Prasad
Apply for job
apply for job

Data Scientist
Data Scientist

Founded 2017
Products and services{{j_company_types[3 - 1]}}
{{j_company_sizes[2 - 1]}} employees
{{j_company_stages[2 - 1]}}
{{rendered_skills_map[skill] || skill}}
Location icon
Bengaluru (Bangalore)
Experience icon
3 - 10 years
Experience icon
Best in industry6 - 25 lacs/annum

Who are we and Why Yulu for you?Yulu's vision is to reduce traffic congestion by providing a scalable, affordable, efficient and clean solution for the first mile, last mile and short distance commute. We strongly believe that short commute mode can be made more Efficient, Affordable and GREEN, thereby ensuring that future generations will have a healthy environment to live. We want to replace big personal vehicles with a smaller form factor that does not require fossil fuel. Yulu uses IoT technology to create a vast network of shared bikes that can be rented easily by user-friendly app in pay per use business model.We are a mission driven company based out of Bangalore with a solid founding team and big ambitions. At Yulu we believe that every day is a mission and success is exciting when its attained with fun and as a team. If you want to solve the problem of traffic congestion, reduce pollution, positively impact the society and be part of an international dynamic team, join us in our journey to shape better India for our future generations.Responsibility Collaborate with members from a variety of teams to improve decision making and boost performance across the company Evaluate, adapt new and improved data storage and analytics approaches with the vision of creating innovative data driven insights at the quickest pace possible Develop new ways for modeling and predicting commute patterns as well as summarize, visualize and present key findings with all stakeholders. Skills required  Problem solving using Supervised & Unsupervised algorithms in scikit-learn and TensorFlow Experience programming in Python and data-wrangling using Excel, SQL, Pandas and Jupyter notebook Experience using Apache Spark, Apache Kafka and relevant Big Data tools Experience working with Timeseries and Geospatial datasets would be wonderful Good understanding of statistics to help make decisions and design/evaluate experiments Experience & Qualification 2+ years of real-world Data Science experience Bachelor's in Computer Science or in a relevant field

Job posted by
apply for job
apply for job
Abhisek Prasad picture
Abhisek Prasad
Job posted by
Abhisek Prasad picture
Abhisek Prasad
Apply for job
apply for job

Data Engineer
Data Engineer
at Rely

via Rely
Founded 2018
Products and services{{j_company_types[1 - 1]}}
{{j_company_sizes[2 - 1]}} employees
{{j_company_stages[2 - 1]}}
{{rendered_skills_map[skill] || skill}}
Location icon
Bengaluru (Bangalore)
Experience icon
2 - 10 years
Experience icon
Best in industry8 - 35 lacs/annum

Intro Our data and risk team is the core pillar of our business that harnesses alternative data sources to guide the decisions we make at Rely. The team designs, architects, as well as develop and maintain a scalable data platform the powers our machine learning models. Be part of a team that will help millions of consumers across Asia, to be effortlessly in control of their spending and make better decisions. What will you doThe data engineer is focused on making data correct and accessible, and building scalable systems to access/process it. Another major responsibility is helping AI/ML Engineers write better code.• Optimize and automate ingestion processes for a variety of data sources such as: click stream, transactional and many other sources. Create and maintain optimal data pipeline architecture and ETL processes Assemble large, complex data sets that meet functional / non-functional business requirements. Develop data pipeline and infrastructure to support real-time decisions Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS big data' technologies. Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics. Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs. What will you need• 2+ hands-on experience building and implementation of large scale production pipeline and Data Warehouse• Experience dealing with large scale Proficiency in writing and debugging complex SQLs Experience working with AWS big data tools• Ability to lead the project and implement best data practises and technology Data Pipelining Strong command in building & optimizing data pipelines, architectures and data sets Strong command on relational SQL & noSQL databases including Postgres Data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc. Big Data: Strong experience in big data tools & applications Tools: Hadoop, Spark, HDFS etc AWS cloud services: EC2, EMR, RDS, Redshift Stream-processing systems: Storm, Spark-Streaming, Flink etc. Message queuing: RabbitMQ, Spark etc Software Development & Debugging Strong experience in object-oriented programming/object function scripting languages: Python, Java, C++, Scala, etc Strong hold on data structures & algorithms What would be a bonus Prior experience working in a fast-growth Startup Prior experience in the payments, fraud, lending, advertising companies dealing with large scale data

Job posted by
apply for job
apply for job
Hizam Ismail picture
Hizam Ismail
Job posted by
Hizam Ismail picture
Hizam Ismail
Apply for job
apply for job