Senior Software Engineer (Architect), Data

at Uber

DP
Posted by Suvidha Chib
icon
Bengaluru (Bangalore)
icon
7 - 15 yrs
icon
₹0L / yr (ESOP available)
icon
Full time
Skills
Big Data
Hadoop
kafka
Spark
Apache Hive
Java
Python
Scala
Apache Hadoop
Apache Impala
Apache Drill
Apache Spark
tez
presto

Data Platform engineering at Uber is looking for a strong Technical Lead (Level 5a Engineer) who has built high quality platforms and services that can operate at scale. 5a Engineer at Uber exhibits following qualities: 

 

  • Demonstrate tech expertise Demonstrate technical skills to go very deep or broad in solving classes of problems or creating broadly leverageable solutions. 
  • Execute large scale projects Define, plan and execute complex and impactful projects. You communicate the vision to peers and stakeholders.
  • Collaborate across teams Domain resource to engineers outside your team and help them leverage the right solutions. Facilitate technical discussions and drive to a consensus.
  • Coach engineers Coach and mentor less experienced engineers and deeply invest in their learning and success. You give and solicit feedback, both positive and negative, to others you work with to help improve the entire team.
  • Tech leadership Lead the effort to define the best practices in your immediate team, and help the broader organization establish better technical or business processes.


What You’ll Do

  • Build a scalable, reliable, operable and performant data analytics platform for Uber’s engineers, data scientists, products and operations teams.
  • Work alongside the pioneers of big data systems such as Hive, Yarn, Spark, Presto, Kafka, Flink to build out a highly reliable, performant, easy to use software system for Uber’s planet scale of data. 
  • Become proficient of multi-tenancy, resource isolation, abuse prevention, self-serve debuggability aspects of a high performant, large scale, service while building these capabilities for Uber's engineers and operation folks.

 

What You’ll Need

  • 7+ years experience in building large scale products, data platforms, distributed systems in a high caliber environment.
  • Architecture: Identify and solve major architectural problems by going deep in your field or broad across different teams. Extend, improve, or, when needed, build solutions to address architectural gaps or technical debt.
  • Software Engineering/Programming: Create frameworks and abstractions that are reliable and reusable. advanced knowledge of at least one programming language, and are happy to learn more. Our core languages are Java, Python, Go, and Scala.
  • Data Engineering: Expertise in one of the big data analytics technologies we currently use such as Apache Hadoop (HDFS and YARN), Apache Hive, Impala, Drill, Spark, Tez, Presto, Calcite, Parquet, Arrow etc. Under the hood experience with similar systems such as Vertica, Apache Impala, Drill, Google Borg, Google BigQuery, Amazon EMR, Amazon RedShift, Docker, Kubernetes, Mesos etc.
  • Execution & Results: You tackle large technical projects/problems that are not clearly defined. You anticipate roadblocks and have strategies to de-risk timelines. You orchestrate work that spans multiple teams and keep your stakeholders informed.
  • A team player: You believe that you can achieve more on a team that the whole is greater than the sum of its parts. You rely on others’ candid feedback for continuous improvement.
  • Business acumen: You understand requirements beyond the written word. Whether you’re working on an API used by other developers, an internal tool consumed by our operation teams, or a feature used by millions of customers, your attention to details leads to a delightful user experience.
Read more

About Uber

We’re finding better ways for cities to move, work, and thrive. Download the app and get a ride in minutes. Or become a driver and earn money on your schedule.
Read more
Founded
2012
Type
Product
Size
500-1000 employees
Stage
Raised funding
View full company details
Why apply to jobs via Cutshort
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
2101133
Matches delivered
3712187
Network size
15000
Companies hiring

Similar jobs

Senior Software Engineer - 221141

at Cloudera

Founded 2008  •  Product  •  500-1000 employees  •  Profitable
ETL
Informatica
Data Warehouse (DWH)
Relational Database (RDBMS)
Data Structures
Algorithms
Java
Kubernetes
Hadoop
Databases
Data Analytics
DevOps
icon
Bengaluru (Bangalore)
icon
3 - 20 yrs
icon
₹1L - ₹44L / yr

 

Cloudera Data Warehouse Hive team looking for a passionate senior developer to join our growing engineering team. This group is targeting the biggest enterprises wanting to utilize Cloudera’s services in a private and public cloud environment. Our product is built on open source technologies like Hive, Impala, Hadoop, Kudu, Spark and so many more providing unlimited learning opportunities.A Day in the LifeOver the past 10+ years, Cloudera has experienced tremendous growth making us the leading contributor to Big Data platforms and ecosystems and a leading provider for enterprise solutions based on Apache Hadoop. You will work with some of the best engineers in the industry who are tackling challenges that will continue to shape the Big Data revolution.  We foster an engaging, supportive, and productive work environment where you can do your best work. The team culture values engineering excellence, technical depth, grassroots innovation, teamwork, and collaboration.
You will manage product development for our CDP components, develop engineering tools and scalable services to enable efficient development, testing, and release operations.  You will be immersed in many exciting, cutting-edge technologies and projects, including collaboration with developers, testers, product, field engineers, and our external partners, both software and hardware vendors.Opportunity:Cloudera is a leader in the fast-growing big data platforms market. This is a rare chance to make a name for yourself in the industry and in the Open Source world. The candidate will responsible for Apache Hive and CDW projects. We are looking for a candidate who would like to work on these projects upstream and downstream. If you are curious about the project and code quality you can check the project and the code at the following link. You can start the development before you join. This is one of the beauties of the OSS world.Apache Hive

 

Responsibilities:

•Build robust and scalable data infrastructure software

•Design and create services and system architecture for your projects

•Improve code quality through writing unit tests, automation, and code reviews

•The candidate would write Java code and/or build several services in the Cloudera Data Warehouse.

•Worked with a team of engineers who reviewed each other's code/designs and held each other to an extremely high bar for the quality of code/designs

•The candidate has to understand the basics of Kubernetes.

•Build out the production and test infrastructure.

•Develop automation frameworks to reproduce issues and prevent regressions.

•Work closely with other developers providing services to our system.

•Help to analyze and to understand how customers use the product and improve it where necessary. 

Qualifications:

•Deep familiarity with Java programming language.

•Hands-on experience with distributed systems.

•Knowledge of database concepts, RDBMS internals.

•Knowledge of the Hadoop stack, containers, or Kubernetes is a strong plus. 

•Has experience working in a distributed team.

•Has 3+ years of experience in software development.

 

Read more
Job posted by
Sushmitha Rengarajan

Senior Data Engineer

at Klubworks

Founded 2019  •  Product  •  20-100 employees  •  Raised funding
Spark
Hadoop
Big Data
Data engineering
PySpark
Python
C++
icon
Bengaluru (Bangalore)
icon
4 - 8 yrs
icon
Best in industry

We are searching for an accountable, multitalented data engineer to facilitate the operations of our data scientists. The data engineer will be responsible for employing machine learning techniques to create and sustain structures that allow for the analysis of data while remaining familiar with dominant programming and deployment strategies in the field. During various aspects of this process, you should collaborate with coworkers to ensure that your approach meets the needs of each project.

To ensure success as a data engineer, you should demonstrate flexibility, creativity, and the capacity to receive and utilize constructive criticism. A formidable data engineer will demonstrate unsatiated curiosity and outstanding interpersonal skills.

Responsibilities:

  • Liaising with coworkers and clients to elucidate the requirements for each task.
  • Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed.
  • Reformulating existing frameworks to optimize their functioning.
  • Testing such structures to ensure that they are fit for use.
  • Preparing raw data for manipulation by data scientists.
  • Detecting and correcting errors in your work.
  • Ensuring that your work remains backed up and readily accessible to relevant coworkers.
  • Remaining up-to-date with industry standards and technological advancements that will improve the quality of your outputs.


Requirements:

  • Bachelor's degree in data engineering, big data analytics, computer engineering, or related field.
  • Master's degree in a relevant field is advantageous.
  • Proven experience as a data engineer, software developer, or similar.
  • Expert proficiency in Python, C++, Java, R, and SQL.
  • Familiarity with Hadoop or suitable equivalent.
  • Excellent analytical and problem-solving skills.
  • A knack for independence and group work.
  • Scrupulous approach to duties.
  • Capacity to successfully manage a pipeline of duties with minimal supervision.
Read more
Job posted by
Anupam Arya

Data Engineer

at numadic

Founded 2016  •  Products & Services  •  20-100 employees  •  Raised funding
ETL
Informatica
Data Warehouse (DWH)
Python
SQL
icon
Remote only
icon
1 - 3 yrs
icon
₹7L - ₹15L / yr
Numadic is hiring a Data Engineer
We are hiring a Data Engineer to join our team in undisrupting movement. Your role will include working with development teams and product managers to ideate software solutions. To succeed in this role you must have an analytical mind with a keen interest in problem solving and communication.

 

 

About the role:
  1. Apply advanced predictive modeling and statistical techniques to design, build, maintain, and improve upon multiple real-time decision systems.
  2. Visualize and show complex data-sets via multidimensional visualization tools.
  3. Perform data cleansing, transformation & feature engineering.
  4. Design scalable automated data mining, modelling and validation processes.
  5. Produce scalable, reusable, efficient feature code to be implemented on clusters and standalone data servers.
  6. Contribute to the development/ deployment of machine learning algorithms, operational research, semantic analysis, and statistical methods for finding structure in large data sets.

 

 

Role requirements:
  1. An absolute minimum of 1-3 years of relevant data science experience.
  2. Have an Engineering or comparable math / physics degree.
  3. Knowledge & working proficiency in Excel, Python, R
  4. Expert proficiency in at least 2 structured programming languages.
  5. Deep understanding about statistical and analytical models.
  6. Bias for action - Ability to move quickly while taking time out to review the details.
  7. Clear communicator - Ability to synthesise and clearly articulate complex information, highlighting key takeaways and actionable insights.
  8. Team player - Working mostly autonomously, yet being a team player keeping your crews looped-in.
  9. Mindset - Ability to take responsibility for your life and that of your people and projects.
  10. Mindfulness - Ability to maintain practices that keep you grounded.

 

 

This is not a typical 9 to 5 job. This is startup life.
Working at a startup is about being a self-starter and pushing not just for output, but for outcomes too. We are judged by the outcomes we generate in the market and you are measured by the outcomes you generate for your team and for the company. Therefore, just showing up at work on time and leaving on time is not sufficient; actually delivering results is the minimum required performance. We routinely work long hours and it isn't uncommon for this and other roles at Numadic to push the limits. Do not apply if you aren't comfortable with the startup life.

 

 

Numadic operates at the intersection of finance and logistics.
From number one rated mobile apps to industry leading approaches to API finance and transactions, our team does what it takes to simplify movement of goods and people. But what matters even more, is that our customers love the way we do what we do and our end users have uncluttered and uncomplicated experiences.

 

 

Join Numadic
From the founders to our investors and advisors, what we share is a common respect for the value of human life and of meaningful relationships. We are full-stack humans, who work with full-stack humans and seek to do business with full-stack humans. We have turned down projects, when we found misalignment of values at the other end of the table. We do not believe that the customer is always right. We believe that all humans are equal and that the direction of the flow of money should not define the way people are treated. This is life at Numadic.
Read more
Job posted by
Enrich Braz

Data Engineer

at Amagi Media Labs

Founded 2008  •  Product  •  500-1000 employees  •  Profitable
Data engineering
Spark
Scala
Hadoop
Apache Hadoop
Apache Spark
icon
Bengaluru (Bangalore), Noida
icon
5 - 9 yrs
icon
₹10L - ₹17L / yr
  • We are looking for : Data engineer
  • Sprak
  • Scala
  • Hadoop
Exp - 5 to 9 years
N.p - 15 days to 30 Days
Location : Bangalore / Noida
Read more
Job posted by
Rajesh C

Data Scientist

at Ezeiatech Systems Pvt Ltd

Founded 2011  •  Products & Services  •  20-100 employees  •  Profitable
Data Science
R Programming
Python
icon
Gurugram
icon
0 - 6 yrs
icon
₹2L - ₹15L / yr
● Responsible for developing new features and models as part of our core product through
applied research.
● Understand, apply and extend state-of-the-art NLP research to better serve our customers.
● Work closely with engineering, product, and customers to scientifically frame the business problems and come up with the underlying AI models.
● Design, implement, test, deploy, and maintain innovative data and machine learning solutions to accelerate our business.
● Think creatively to identify new opportunities and contribute to high-quality publications or patents.
Desired Qualifications and Experience

● At Least 1 year of professional experience.
● Bachelors in Computer Science or related fields from the top colleges.
● Extensive knowledge and practical experience in one or more of the following areas: machine learning, deep learning, NLP, recommendation systems, information retrieval.
● Experience applying ML to solve complex business problems from scratch.
● Experience with Python and a deep learning framework like Pytorch/Tensorflow.
● Awareness of the state of the art research in the NLP community.
● Excellent verbal and written communication and presentation skills.
Read more
Job posted by
Preeti Rai

Data Scientist

at Material Depot

Founded 2020  •  Product  •  0-20 employees  •  Raised funding
Data Science
Machine Learning (ML)
Deep Learning
R Programming
Python
Computer Vision
icon
Hyderabad, Bengaluru (Bangalore)
icon
2 - 6 yrs
icon
₹12L - ₹20L / yr

Job Description

Do you have a passion for computer vision and deep learning problems? We are looking for someone who thrives on collaboration and wants to push the boundaries of what is possible today! Material Depot (materialdepot.in) is on a mission to be India’s largest tech company in the Architecture, Engineering and Construction space by democratizing the construction ecosystem and bringing stakeholders onto a common digital platform. Our engineering team is responsible for developing Computer Vision and Machine Learning tools to enable digitization across the construction ecosystem. The founding team includes people from top management consulting firms and top colleges in India (like BCG, IITB), and have worked extensively in the construction space globally and is funded by top Indian VCs.

Our team empowers Architectural and Design Businesses to effectively manage their day to day operations. We are seeking an experienced, talented Data Scientist to join our team. You’ll be bringing your talents and expertise to continue building and evolving our highly available and distributed platform.

Our solutions need complex problem solving in computer vision that require robust, efficient, well tested, and clean solutions. The ideal candidate will possess the self-motivation, curiosity, and initiative to achieve those goals. Analogously, the candidate is a lifelong learner who passionately seeks to improve themselves and the quality of their work. You will work together with similar minds in a unique team where your skills and expertise can be used to influence future user experiences that will be used by millions.

In this role, you will:

  • Extensive knowledge in machine learning and deep learning techniques
  • Solid background in image processing/computer vision
  • Experience in building datasets for computer vision tasks
  • Experience working with and creating data structures / architectures
  • Proficiency in at least one major machine learning framework
  • Experience visualizing data to stakeholders
  • Ability to analyze and debug complex algorithms
  • Good understanding and applied experience in classic 2D image processing and segmentation
  • Robust semantic object detection under different lighting conditions
  • Segmentation of non-rigid contours in challenging/low contrast scenarios
  • Sub-pixel accurate refinement of contours and features
  • Experience in image quality assessment
  • Experience with in depth failure analysis of algorithms
  • Highly skilled in at least one scripting language such as Python or Matlab and solid experience in C++
  • Creativity and curiosity for solving highly complex problems
  • Excellent communication and collaboration skills
  • Mentor and support other technical team members in the organization
  • Create, improve, and refine workflows and processes for delivering quality software on time and with carefully calculated debt
  • Work closely with product managers, customer support representatives, and account executives to help the business move fast and efficiently through relentless automation.

How you will do this:

  • You’re part of an agile, multidisciplinary team.
  • You bring your own unique skill set to the table and collaborate with others to accomplish your team’s goals.
  • You prioritize your work with the team and its product owner, weighing both the business and technical value of each task.
  • You experiment, test, try, fail, and learn continuously.
  • You don’t do things just because they were always done that way, you bring your experience and expertise with you and help the team make the best decisions.

For this role, you must have:

  • Strong knowledge of and experience with the functional programming paradigm.
  • Experience conducting code reviews, providing feedback to other engineers.
  • Great communication skills and a proven ability to work as part of a tight-knit team.
Read more
Job posted by
Sarthak Agrawal

Applied Scientist

at Ziroh Labs Pvt. Ltd

Founded 2016  •  Product  •  20-100 employees  •  Raised funding
Data Science
Artificial Intelligence (AI)
Machine Learning (ML)
Python
TensorFlow
Keras
PyTorch
OpenCV
Natural Language Toolkit (NLTK)
Java
GenSim
icon
Bengaluru (Bangalore)
icon
1 - 3 yrs
icon
₹10L - ₹20L / yr
Ziroh Labs is a Data Security and Privacy Technology startup based in the Bay Area (California), Bangalore, Singapore and Canberra. We focus on cutting edge encryption techniques which include Fully Homomorphic Encryption. The scientific and technical research team at ZirohLabs includes award-winning computer scientists, cryptographers, PhDs and developers in distributed computing, large-scale distributed storage systems, and algorithms.

Job Profile:
As an Applied Scientist, you will be responsible for implementing cutting edge AI/ML algorithms in Computer Vision and Natural Language Processing problems. You need to collaborate with engineers and researchers to critically analyze, provide insights and visualizations for solving complex problems in Ziroh Labs. You will train AI/ML models in Python and often integrate and deploy in Java, C++, C# etc.

Preferred Qualifications:
  • Masters in Data Science, AI/ML or quantitative fields like Mathematics, Statistics, Computer Science, Physics, etc.
  • Experience with Python, Tensorflow, Keras and Pytorch
  • Experience in OpenCV, NLTK, GenSim, spaCy, etc.
  • Mathematical understanding of AI/ML algorithms
  • Contribution to Open-source projects will have higher chances
Read more
Job posted by
Shawn Crasta

Revenue Analyst

at Lendingkart

Founded 2014  •  Services  •  100-1000 employees  •  Raised funding
Python
Data Science
SQL
icon
Bengaluru (Bangalore), Ahmedabad
icon
2 - 5 yrs
icon
₹2L - ₹13L / yr
Roles and Responsibilities:
 Mining large volumes of credit behavior data to generate insights around product holdings and monetization opportunities for cross sell
 Use data science to size opportunity and product potential for launch of any new product/pilots
 Build propensity models using heuristics and campaign performance to maximize efficiency.
 Conduct portfolio analysis and establish key metrics for cross sell partnership

Desired profile/Skills:
 2-5 years of experience with a degree in any quantitative discipline such as Engineering, Computer Science, Economics, Statistics or Mathematics
 Excellent problem solving and comprehensive analytical skills – ability to structure ambiguous problem statements, perform detailed analysis and derive crisp insights.
 Solid experience in using python and SQL
 Prior work experience in a financial services space would be highly valued

Location: Bangalore/ Ahmedabad
Read more
Job posted by
Mohammed Nayeem

Machine Learning Engineer

at UnFound

Founded 2017  •  Product  •  20-100 employees  •  Bootstrapped
Machine Learning (ML)
Deep Learning
Natural Language Processing (NLP)
Python
Microservices
Cloud Computing
Java
MongoDB
icon
Mumbai
icon
1 - 40 yrs
icon
₹5L - ₹5L / yr
Does the current state of media frustrate you? Do you want to change the way we consume news? Are you a kickass machine learning practitioner and aspiring entrepreneur, who has opinions on world affairs as well? If so, continue reading! We at UnFound are developing a product which simplifies complex and cluttered news into simple themes, removes bias by showing all (& often unheard of) perspectives, and produce crisp summaries- all with minimal human intervention! We are looking for passionate and experienced machine learning ENGINEER/INTERN, *preferably* with experience in NLP. We want someone who can take initiatives. If you need to be micro-managed, this is NOT the role for you. 1. Demonstrable background in machine learning, especially NLP, information retrieval, etc. 2. Hands on with popular data science frameworks- Python, Jupyter, TensorFlow, PyTorch. 3. Implementation ready background in deep learning techniques like word embeddings, CNN, RNN/LSTM, etc. 4. Experience with productionizing machine learning solutions, especially ML powered mobile/ web-apps/ BOTs. 5. Hands on experience on AWS, and other cloud platforms. GPU experience is strongly preferred. 6. Thorough understanding of back-end concepts, and databases (SQL, Postgres, NoSQL, etc.) 7. Good Kaggle (or similar) scores, MOOC (Udacity, Coursera, fast.ai, etc.) preferred.
Read more
Job posted by
Ankur Pandey

Senior Software Engineer

at zeotap

Founded 2014  •  Product  •  20-100 employees  •  Raised funding
Python
Big Data
Hadoop
Scala
Spark
icon
Bengaluru (Bangalore)
icon
6 - 10 yrs
icon
₹5L - ₹40L / yr
Job posted by
Projjol Banerjea
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
Get to hear about interesting companies hiring right now
iconFollow Cutshort
Want to apply to this role at Uber?
Why apply via Cutshort?
Connect with actual hiring teams and get their fast response. No spam.
Learn more
Get to hear about interesting companies hiring right now
iconFollow Cutshort