You are viewing this page in an unsupported browser. Please open this link in a browser such as Chrome, Firefox, Safari or Android browser.

Work at top Indian companies and global startups in 2020 - Check it out

Lead Data Engineer
at Lymbyc
Posted by Venky Thiriveedhi

apply to this job

Bengaluru (Bangalore), Chennai

4 - 8 years

{{900000 / ('' == 'MONTH' ? 12 : 100000) | number}} - {{1400000 / ('' == 'MONTH' ? 12 : 100000) | number}} {{'' == 'MONTH' ? '/mo' : 'lpa'}}

Skills

Apache Spark

Druid Database

Big Data

Apache Kafka

Apache Sqoop

RESTful APIs

Elasticsearch

Apache Ranger

Apache Atlas

kappa

Job description

Key skill set : Apache NiFi, Kafka Connect (Confluent), Sqoop, Kylo, Spark, Druid, Presto, RESTful services, Lambda / Kappa architectures Responsibilities : - Build a scalable, reliable, operable and performant big data platform for both streaming and batch analytics - Design and implement data aggregation, cleansing and transformation layers Skills : - Around 4+ years of hands-on experience designing and operating large data platforms - Experience in Big data Ingestion, Transformation and stream/batch processing technologies using Apache NiFi, Apache Kafka, Kafka Connect (Confluent), Sqoop, Spark, Storm, Hive etc; - Experience in designing and building streaming data platforms in Lambda, Kappa architectures - Should have working experience in one of NoSQL, OLAP data stores like Druid, Cassandra, Elasticsearch, Pinot etc; - Experience in one of data warehousing tools like RedShift, BigQuery, Azure SQL Data Warehouse - Exposure to other Data Ingestion, Data Lake and querying frameworks like Marmaray, Kylo, Drill, Presto - Experience in designing and consuming microservices - Exposure to security and governance tools like Apache Ranger, Apache Atlas - Any contributions to open source projects a plus - Experience in performance benchmarks will be a plus

About Lymbyc

LYMBYC - the world’s first “virtual analyst” is designed to empower business leaders with contextual insights at the point of decision making . It curates embedded intelligence across all data sources and provides predictive insights driven by its adaptive ML engine.

Founded

2012

Type

Product

Size

51-250 employees

Stage

Profitable

View company

Why apply to jobs via CutShort

Personalized job matches

Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.

Verified hiring teams

See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.

Move faster with AI

We use AI to get you faster responses, recommendations and unmatched user experience.

Matches delivered

Network size

Companies hiring

Similar jobs

{{job.headline}}
{{job.headline}}
{{job.clientDescription}}
at {{job.companyid.name}}

via {{job.companyid.name}}

Founded {{job.companyid.founded}}

•

Products and services{{j_company_types[job.companyid.type - 1]}}

•

{{j_company_sizes[job.companyid.size - 1]}} employees

•

{{job.expRange.min}} - {{job.expRange.max}} years

Best in industry{{job.salaryRange.min/(job.salaryRange.duration == "MONTH" ? 12 : 100000)}} - {{job.salaryRange.max/(job.salaryRange.duration == "MONTH" ? 12 : 100000)}} {{(job.salaryRange.duration == "MONTH" ? "/month" : "lacs/annum")}}

Expand full descriptionCollapse full description

Job posted by

apply for job