Hadoop Developer

Roles and Responsibilities

Level of skills and experience:

5 years of hands-on experience in using Python, Spark,Sql.

Experienced in AWS Cloud usage and management.

Experience with Databricks (Lakehouse, ML, Unity Catalog, MLflow).

Experience using various ML models and frameworks such as XGBoost, Lightgbm, Torch.

Experience with orchestrators such as Airflow and Kubeflow.

Familiarity with containerization and orchestration technologies (e.g., Docker, Kubernetes).

Fundamental understanding of Parquet, Delta Lake and other data file formats.

Proficiency on an IaC tool such as Terraform, CDK or CloudFormation.

Strong written and verbal English communication skill and proficient in communication with non-technical stakeholderst

About the Role-

Thinking big and executing beyond what is expected. The challenges cut across algorithmic problem solving, systems engineering, machine learning and infrastructure at a massive scale.

Reason to Join-

An opportunity for innovators, problem solvers & learners.  Working will be Innovative, empowering, rewarding & fun. Amazing Office, competitive pay along with excellent benefits package.

Requiremets and Responsibilities- (please read carefully before applying)

• The overall experience of 3-6 years in Java/Python Framework and Machine Learning.
• Develop Web Services, REST, XSD, XML technologies, Java, Python, AWS, API.
• Experience on Elastic Search or SOLR or Lucene -Search Engine, Text Mining, Indexing.
• Experience in highly scalable tools like Kafka, Spark, Aerospike, etc.
• Hands on experience in Design, Architecture, Implementation, Performance & Scalability, and Distributed Systems.
• Design, implement, and deploy highly scalable and reliable systems.
• Troubleshoot Solr indexing process and querying engine.
• Bachelors or Masters in Computer Science from Tier 1 Institutions

Your Opportunity

• Own and drive business features into tech requirements
• Design & develop large scale real time server side systems
• Quickly create quality prototypes
• Staying updated on emerging technologies
• Ensuring that all deliverables adhere to our world class standards
• Promote coding best practices
• Mentor and develop junior developers in the team

Required Experience:

• 4+ years of relevant experience as described below
• Excellent grasp of Core Java, Multi Threading and OO design patterns
• Experience with Scala, functional, reactive programming and Akka/Play is a plus
• Excellent understanding of data structures and algorithms
• Solid grasp of large scale distributed real time systems
• Prior experience on building a scalable and resilient micro service
• Solid understanding of relational databases, NoSQL databases and Caching systems
• Good understanding of Big Data technologies such as Spark, Hadoop is a plus
• Experience on one of AWS, Azure or GCP

Who you are :

• You have excellent and effective communication and collaborative skills
• You love problem solving
• You stay up to date with the latest technologies and then apply them in real life
• You love paying attention to detail
• You thrive in meeting tight deadlines and prioritising workloads
• Ability to collaborate across multiple functions

Education:

Bachelor’s degree in Engineering or equivalent experience within the field