Loading...

{{notif_text}}

Let the best companies discover your talent - Check out Cutshort Discovered

Lead Data Engineer
Posted by Venky Thiriveedhi

apply to this job
Bengaluru (Bangalore), Chennai
4 - 8 years
{{900000 / ('' == 'MONTH' ? 12 : 100000) | number}} - {{1400000 / ('' == 'MONTH' ? 12 : 100000) | number}} {{'' == 'MONTH' ? '/mo' : 'lpa'}}

Skills

Apache Spark
Druid Database
Big Data
Apache Kafka
Apache Sqoop
RESTful APIs
Elasticsearch
Apache Ranger
Apache Atlas
kappa

Job description

Key skill set : Apache NiFi, Kafka Connect (Confluent), Sqoop, Kylo, Spark, Druid, Presto, RESTful services, Lambda / Kappa architectures Responsibilities : - Build a scalable, reliable, operable and performant big data platform for both streaming and batch analytics - Design and implement data aggregation, cleansing and transformation layers Skills : - Around 4+ years of hands-on experience designing and operating large data platforms - Experience in Big data Ingestion, Transformation and stream/batch processing technologies using Apache NiFi, Apache Kafka, Kafka Connect (Confluent), Sqoop, Spark, Storm, Hive etc; - Experience in designing and building streaming data platforms in Lambda, Kappa architectures - Should have working experience in one of NoSQL, OLAP data stores like Druid, Cassandra, Elasticsearch, Pinot etc; - Experience in one of data warehousing tools like RedShift, BigQuery, Azure SQL Data Warehouse - Exposure to other Data Ingestion, Data Lake and querying frameworks like Marmaray, Kylo, Drill, Presto - Experience in designing and consuming microservices - Exposure to security and governance tools like Apache Ranger, Apache Atlas - Any contributions to open source projects a plus - Experience in performance benchmarks will be a plus

About Lymbyc

LYMBYC - the world’s first “virtual analyst” is designed to empower business leaders with contextual insights at the point of decision making . It curates embedded intelligence across all data sources and provides predictive insights driven by its adaptive ML engine.

Founded

2012

Type

Product

Size

51-250 employees

Stage

Profitable
View company

Why apply to jobs via CutShort

No long forms
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
Discover employers in your network
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
Make your network count
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
{{2101133 | number}}
Matches delivered
{{3712187 | number}}
Network size
{{6212 | number}}
Companies hiring

Similar jobs

{{job.headline}}
{{job.headline}}
{{job.clientDescription}}

Founded {{job.companyid.founded}}
Products and services{{j_company_types[job.companyid.type - 1]}}
{{j_company_sizes[job.companyid.size - 1]}} employees
{{j_company_stages[job.companyid.funding - 1]}}
{{rendered_skills_map[skill] || skill}}
Location icon
{{job.remoteRole ? "Remote, " : ""}}{{job.locations.joinWithGrammar()}}
Experience icon
{{job.expRange.min}} - {{job.expRange.max}} years
Experience icon
Best in industry{{job.salaryRange.min/(job.salaryRange.duration == "MONTH" ? 12 : 100000)}} - {{job.salaryRange.max/(job.salaryRange.duration == "MONTH" ? 12 : 100000)}} {{(job.salaryRange.duration == "MONTH" ? "/month" : "lacs/annum")}}

{{job.comment}}

Job posted by
apply for job
apply for job
{{job.createdBy.name}} picture
{{job.createdBy.name}}
Job posted by
{{job.createdBy.name}} picture
{{job.createdBy.name}}
Apply for job
apply for job
Did not find a job you were looking for?
Search for relevant jobs from 7000+ companies such as Google, Amazon & Uber actively hiring on CutShort.
Want to apply for this role at Lymbyc?
Hiring team responds within a day
apply for this job
Why apply via CutShort?
Connect with actual hiring teams and get their fast response. No spam.