Apache Camel Consultant

Role Objective:

Big Data Engineer will be responsible for expanding and optimizing our data and database architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building. The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products

Roles & Responsibilities:

• Sound knowledge in Spark architecture and distributed computing and Spark streaming.
• Proficient in Spark – including RDD and Data frames core functions, troubleshooting and performance tuning.
• Good understanding in object-oriented concepts and hands on experience on Scala with excellent programming logic and technique.
• Good in functional programming and OOPS concept on Scala
• Good experience in SQL – should be able to write complex queries.
• Managing the team of Associates and Senior Associates and ensuring the utilization is maintained across the project.
• Able to mentor new members for onboarding to the project.
• Understand the client requirement and able to design, develop from scratch and deliver.
• AWS cloud experience would be preferable.
• Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services - DynamoDB, RedShift, Kinesis, Lambda, S3, etc. (preferred)
• Hands on experience utilizing AWS Management Tools (CloudWatch, CloudTrail) to proactively monitor large and complex deployments (preferred)
• Experience in analyzing, re-architecting, and re-platforming on-premises data warehouses to data platforms on AWS (preferred)
• Leading the client calls to flag off any delays, blockers, escalations and collate all the requirements.
• Managing project timing, client expectations and meeting deadlines.
• Should have played project and team management roles.
• Facilitate meetings within the team on regular basis.
• Understand business requirement and analyze different approaches and plan deliverables and milestones for the project.
• Optimization, maintenance, and support of pipelines.
• Strong analytical and logical skills.
• Ability to comfortably tackling new challenges and learn

External Skills And Expertise

Must have Skills:

• Scala
• Spark
• SQL (Intermediate to advanced level)
• Spark Streaming
• AWS preferable/Any cloud
• Kafka /Kinesis/Any streaming services
• Object-Oriented Programming
• Hive, ETL/ELT design experience
• CICD experience (ETL pipeline deployment)

Good to Have Skills:

• AWS Certification
• Git/similar version control tool
• Knowledge in CI/CD, Microservices

Designation – Deputy Manager - TS

Job Description

1. Total of  8/9 years of development experience Data Engineering . B1/BII role
2. Minimum of 4/5 years in AWS Data Integrations and should be very good on Data modelling skills.
3. Should be very proficient in end to end AWS Data solution design, that not only includes strong data ingestion, integrations (both Data @ rest and Data in Motion) skills but also complete DevOps knowledge.
4. Should have experience in delivering at least 4 Data Warehouse or Data Lake Solutions on AWS.
5. Should be very strong experience on Glue, Lambda, Data Pipeline, Step functions, RDS, CloudFormation etc.
6. Strong Python skill .
7. Should be an expert in Cloud design principles, Performance tuning and cost modelling. AWS certifications will have an added advantage
8. Should be a team player with Excellent communication and should be able to manage his work independently with minimal or no supervision.
9. Life Science & Healthcare domain background will be a plus

Qualifications

BE/Btect/ME/MTech

Skills

•  The Analyst will work with our Quant Research team and will assist in projects to improve stock selection, portfolio construction or implementation.
•  Main goals for the candidate would be around developing smart beta index portfolios.
•  Research on topics specific to quant trading, including AI/ML, statistical arbitrage, momentum, mean-reversion, factor investing and applications of statistics and econometrics models.

We are looking for an experienced engineer with superb technical skills. You will primarily be responsible for architecting and building large scale data pipelines that delivers AI and Analytical solutions to our customers. The right candidate will enthusiastically take ownership in developing and managing a continuously improving, robust, scalable software solutions. The successful candidate will be curious, creative, ambitious, self motivated, flexible, and have a bias towards taking action. As part of the early engineering team, you will have a chance to make a measurable impact in future of Thinkdeeply as well as having a significant amount of responsibility.

Although your primary responsibilities will be around back-end work, we prize individuals who are willing to step in and contribute to other areas including automation, tooling, and management applications. Experience with or desire to learn Machine Learning a plus.

Experience

12+ Years

Location

Hyderabad

Skills

Bachelors/Masters/Phd in CS or equivalent industry experience

10+ years of industry experience in java related frameworks such as Spring and/or Typesafe

Experience with scripting languages. Python experience highly desirable. 5+ Industry experience in python

Experience with popular modern web frameworks such as Spring boot, Play framework, or Django

Demonstrated expertise of building and shipping cloud native applications

Experience in administering (including setting up, managing, monitoring) data processing pipelines (both streaming and batch) using frameworks such as Kafka, ELK Stack, Fluentd

Experience in API development using Swagger

Strong expertise with containerization technologies including kubernetes, docker-compose

Experience with cloud platform services such as AWS, Azure or GCP.

Implementing automated testing platforms and unit tests

Proficient understanding of code versioning tools, such as Git

Familiarity with continuous integration, Jenkins

Responsibilities

Architect, Design and Implement Large scale data processing pipelines

Design and Implement APIs

Assist in dev ops operations

Identify performance bottlenecks and bugs, and devise solutions to these problems

Help maintain code quality, organization, and documentation

Communicate with stakeholders regarding various aspects of solution.

Mentor team members on best practices

Looking for a go-getter, an ideal candidate with an entrepreneurial mindset, happy to wear multiple hats and jiggle between tasks.

Responsibilities:

• Day to day activities will include sales pitches, customer onboardings, Whatsapp Bot management, understanding customer pain points & devise quick hacks to resolve, be highly data-centric.
• Establish/Discover b2b strategic partnerships, carry out experiments, and do an analysis of conversions WoW, Customer acquisition cost, and so on.
• Definitely an interesting role to work on, opportunity to collaborate and learn multiple areas of operations and extensive knowledge capital.