Responsibilities

● Able contribute to the gathering of functional requirements, developing technical
specifications, and project & test planning
● Demonstrating technical expertise, and solving challenging programming and design
problems
● Roughly 80% hands-on coding
● Generate technical documentation and PowerPoint presentations to communicate
architectural and design options, and educate development teams and business users
● Resolve defects/bugs during QA testing, pre-production, production, and post-release
patches
● Work cross-functionally with various bidgely teams including: product management,
QA/QE, various product lines, and/or business units to drive forward results

Requirements
● BS/MS in computer science or equivalent work experience
● 2-4 years’ experience designing and developing applications in Data Engineering
● Hands-on experience with Big data Eco Systems.
● Hadoop,Hdfs,Map Reduce,YARN,AWS Cloud, EMR, S3, Spark, Cassandra, Kafka,
Zookeeper
● Expertise with any of the following Object-Oriented Languages (OOD): Java/J2EE,Scala,
Python
● Strong leadership experience: Leading meetings, presenting if required
● Excellent communication skills: Demonstrated ability to explain complex technical
issues to both technical and non-technical audiences
● Expertise in the Software design/architecture process
● Expertise with unit testing & Test-Driven Development (TDD)
● Experience on Cloud or AWS is preferable
● Have a good understanding and ability to develop software, prototypes, or proofs of
concepts (POC's) for various Data Engineering requirements.

Backend Data Engineer

at India's best Short Video App

Agency job

via wrackle by Naveen Taalanki

Bengaluru (Bangalore)

4 - 12 yrs

₹25L - ₹50L / yr

Data engineering

Big Data

Spark

Apache Kafka

Apache Hive

+26 more

What Makes You a Great Fit for The Role?

You’re awesome at and will be responsible for

Extensive programming experience with cross-platform development of one of the following Java/SpringBoot, Javascript/Node.js, Express.js or Python

3-4 years of experience in big data analytics technologies like Storm, Spark/Spark streaming, Flink, AWS Kinesis, Kafka streaming, Hive, Druid, Presto, Elasticsearch, Airflow, etc.

3-4 years of experience in building high performance RPC services using different high performance paradigms: multi-threading, multi-processing, asynchronous programming (nonblocking IO), reactive programming,

3-4 years of experience working high throughput low latency databases and cache layers like MongoDB, Hbase, Cassandra, DynamoDB,, Elasticache ( Redis + Memcache )

Experience with designing and building high scale app backends and micro-services leveraging cloud native services on AWS like proxies, caches, CDNs, messaging systems, Serverless compute(e.g. lambda), monitoring and telemetry.

Strong understanding of distributed systems fundamentals around scalability, elasticity, availability, fault-tolerance.

Experience in analysing and improving the efficiency, scalability, and stability of distributed systems and backend micro services.

5-7 years of strong design/development experience in building massively large scale, high throughput low latency distributed internet systems and products.

Good experience in working with Hadoop and Big Data technologies like HDFS, Pig, Hive, Storm, HBase, Scribe, Zookeeper and NoSQL systems etc.

Agile methodologies, Sprint management, Roadmap, Mentoring, Documenting, Software architecture.

Liaison with Product Management, DevOps, QA, Client and other teams

Your Experience Across The Years in the Roles You’ve Played

Have total or more 5 - 7 years of experience with 2-3 years in a startup.

Have B.Tech or M.Tech or equivalent academic qualification from premier institute.

Experience in Product companies working on Internet-scale applications is preferred

Thoroughly aware of cloud computing infrastructure on AWS leveraging cloud native service and infrastructure services to design solutions.

Follow Cloud Native Computing Foundation leveraging mature open source projects including understanding of containerisation/Kubernetes.

You are passionate about learning or growing your expertise in some or all of the following

Data Pipelines

Data Warehousing

Statistics

Metrics Development

We Value Engineers Who Are

Customer-focused: We believe that doing what’s right for the creator is ultimately what will drive our business forward.

Obsessed with Quality: Your Production code just works & scales linearly

Team players. You believe that more can be achieved together. You listen to feedback and also provide supportive feedback to help others grow/improve.

Pragmatic: We do things quickly to learn what our creators desire. You know when it’s appropriate to take shortcuts that don’t sacrifice quality or maintainability.

Owners: Engineers at Chingari know how to positively impact the business.