Data Engineer

Job Description - 221135

Cloudera is looking for a highly experienced software engineer with strong expertise in Java development and a specialty in platform architecture to join the Cloudera Lens team.

Cloudera Lens is a high-fidelity, context-rich, and fully correlated self-service observability & optimization tool that analyzes the state and wellness of a customer’s environments and empowers them to proactively discover and address unknown unknowns in their data, scale operations without compromising on performance or costs, and expedite remediation of issues.

As a Java engineer, you will be working in a team of engineers led by an Engineering Manager, collaborating with other engineers and stakeholders in India, United States, and other countries around the globe.

Responsibilities:

• Lead, architecture, design, and implementation of key aspects of the Cloudera Lens data collection, data analytics, data correlations, and recommendations.

• Work with product management, engineering, UX, and documentation teams to deliver high-quality products.
• Interact with partners and customers to help define roadmap and shape the technology.
• Empower team members to deliver high-quality software at a fast pace.

Requirements:

• Proven track record of performance.
• Passionate about software engineering. Clean coding habits, attention to detail, and focus on quality and testability.

• Strong software engineering skills: object-oriented design, data structures, algorithms.
• Experience with containerization orchestration technologies: Kubernetes, Docker.
• Deep knowledge of system architecture, including process, memory, storage, and network management is highly desired.
• Experience with the following: Java, concurrent programming, and related areas.
• Experience with Java memory management, performance tuning and scaling
• Experience in building horizontally scalable products handling multi-terabyte datasets is desirable.
• Experience with relational and non-relational databases: PostgreSQL, Amazon S3.
• Strong oral and written communication skills in English.

Advantageous To Have:

• Experience in building enterprise-grade cloud products.
• Experience with building/using cross-functional observability products.
• BS or MS in computer science.
• Cloud experience: AWS, Azure, GCP.
• Python, Linux, Micro Services experience.

The ideal candidate is a self-motivated, multi-tasker, and demonstrated team player. You will be a lead developer responsible for the development of new software products and enhancements to existing products. You should excel in working with large-scale applications and frameworks and have outstanding communication and leadership skills.

 
            RESPONSIBILITIES:

• Writing clean, high-quality, high-performance, maintainable code.
• Develop and support software including applications, database integration, interfaces, and new functionality enhancements.
• Coordinate cross-functionally to ensure the project meets business objectives and compliance standards.
• Support test and deployment of new products and features.
• Participate in code reviews.
  
  KEY SKILLS AND QUALIFICATIONS REQUIRED:
  
  
• A minimum of 3+ years of relevant work experience in the development of scalable scale web applications.
• Proven experience in Full stack web development using Typescript, Angular1,2,4+, HTML5 and CSS3, Microservice API development, and experience in PHP/Python/Laravel and MVC frameworks is a must.
• Exposure to CI/CD tools, Code Analysis, and Test automation is preferred.
• Expertise in Object-Oriented Design, Database Design, and XML Schema.
• Experience with Agile or Scrum software development methodologies.
• Ability to multi-task, organize, and prioritize work.
• Knowledge of advanced PHP concepts, MySQL, JSON, XML & ability to work in a LAMP/WAMP environment.
• Strong Knowledge of DB & code security along with basic server operations like Curl, Crud, cPanel.

Full-stack Developer 

We are looking  for 2-3 Year experienced person for our IoT Division based out of Bangalore. Option for Work from Home is also available.  


Responsibilities

• Design and implementation of the overall web architecture
• Design and deployment of our database, associated areas such as database design /management and DevOps.
• Ensuring the entire stack is designed and built for speed and scalability
• Design and construction of our API-Fast, REST.
• Integrating our front-end UI with the constructed API.
• Design and implementation of continuous integration and deployment
• Knowledge of JSON and PostgreSQL support for JSON.
• Creating a DB instance running PostgreSQL with the AWS Management Console.
• Knowledge of Redis cache.

Skills

• Writing HTML, CSS, and JavaScript/jQuery
• A relevant back-end programming language e.g., Python or JavaScript.
• Server management and deployment for the relevant environment
• Experience implementing testing platforms and unit tests
• Proficiency with Git.
• Appreciation for clean and well documented code.

Keywords: #AWS #EC2 #Python #Psql #Django #Docker #Redis #Kafka.

Job Description :

You're going to be at the core of our development team. You'll mainly be coding in Node.js. You'll be doing a little bit of everything from writing backend code that communicates with other internal services, to working with APIs, to writing code that controls EC2 instances and so on.

Requirements :

• Strong understanding of object-oriented programming and functional programming  and design concepts like - dependency injection, abstract classes, interfaces, data, providers, factories, middlewares, interceptors, orm
• Strong understanding of database architecture and design principles MySQL, mongo-DB. Understanding of MongoDB’s aggregation framework is a bonus.
• Excellent knowledge of Node.js frameworks (NestJs preferred) and experience in integrating libraries, authentication, queues, jobs, logger services. Past experience in working on multi-tenant SAAS product is a bonus.
• Experience with AWS, Architecture Design, and Web development. 
• 1+ years of relevant experience
• Passionate about working in a startup and creating a great product
• Must be able to show us projects and or websites that you have created. Bonus points if you’ve created these projects/websites outside of your work (we love seeing proof of how much you love technology and coding).
• Must love to program, must be willing to learn, and must be creative. If you are the type of person who finds learning a new technology or language an exhilarating experience, this is the place for you.

Responsibilities : 

• Working alongside front end developers, designers, and other backend developers creating cutting edge applications
• Delivering programming solutions for a variety of challenging and exciting projects
• Testing applications to ensure they meet users' expectations
• Integrating third-party APIs
• Deliver outstanding projects within tight deadlines

Role 

We are looking for an experienced DevOps engineer that will help our team establish DevOps practice. You will work closely with the technical lead to identify and establish DevOps practices in the company.

You will also help us build scalable, efficient cloud infrastructure. You’ll implement monitoring for automated system health checks. Lastly, you’ll build our CI pipeline, and train and guide the team in DevOps practices.

This would be a hybrid role and the person would be expected to also do some application level programming in their downtime.

Responsibilities

• Deployment, automation, management, and maintenance of production systems.
• Ensuring availability, performance, security, and scalability of production systems.
• Evaluation of new technology alternatives and vendor products.
• System troubleshooting and problem resolution across various application domains and platforms.
• Providing recommendations for architecture and process improvements.
• Definition and deployment of systems for metrics, logging, and monitoring on AWS platform.
• Manage the establishment and configuration of SaaS infrastructure in an agile way by storing infrastructure as code and employing automated configuration management tools with a goal to be able to re-provision environments at any point in time.
• Be accountable for proper backup and disaster recovery procedures.
• Drive operational cost reductions through service optimizations and demand based auto scaling.
• Have on call responsibilities.
• Perform root cause analysis for production errors
• Uses open source technologies and tools to accomplish specific use cases encountered within the project.
• Uses coding languages or scripting methodologies to solve a problem with a custom workflow.

Requirements

• Systematic problem-solving approach, coupled with strong communication skills and a sense of ownership and drive.

• Prior experience as a software developer in a couple of high level programming languages.

• Extensive experience in any Javascript based framework since we will be deploying services to NodeJS on AWS Lambda (Serverless)

• Extensive experience with web servers such as Nginx/Apache

• Strong Linux system administration background.
• Ability to present and communicate the architecture in a visual form.
• Strong knowledge of AWS (e.g. IAM, EC2, VPC, ELB, ALB, Autoscaling, Lambda, NAT gateway, DynamoDB)
• Experience maintaining and deploying highly-available, fault-tolerant systems at scale (~ 1 Lakh users a day)
• A drive towards automating repetitive tasks (e.g. scripting via Bash, Python, Ruby, etc)
• Expertise with Git
• Experience implementing CI/CD (e.g. Jenkins, TravisCI)
• Strong experience with databases such as MySQL, NoSQL, Elasticsearch, Redis and/or Mongo.
• Stellar troubleshooting skills with the ability to spot issues before they become problems.
• Current with industry trends, IT ops and industry best practices, and able to identify the ones we should implement.
• Time and project management skills, with the capability to prioritize and multitask as needed.

• Must have 5-8 years of experience in handling data
• Must have the ability to interpret large amounts of data and to multi-task
• Must have strong knowledge of and experience with programming (Python), Linux/Bash scripting, databases(SQL, etc)
• Must have strong analytical and critical thinking to resolve business problems using data and tech
•  Must have domain familiarity and interest of – Cloud technologies (GCP/Azure Microsoft/ AWS Amazon), open-source technologies, Enterprise technologies
• Must have the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy.
• Must have good communication skills
• Working knowledge/exposure to ElasticSearch, PostgreSQL, Athena, PrestoDB, Jupyter Notebook