Data Engineer at Data & Cloud Technology serviced based company. · Chennai, Coimbatore, Madurai · 5 - 10 years · ₹12L - ₹19L / yr · Posted 12 Feb 2021

- Must have the experience of leading teams and drive customer interactions
- Must have multiple successful deployments user stories
- Extensive hands on experience in Apache Spark along with HiveQL
- Sound knowledge in Amazon Web Services or any other Cloud environment.
- Experienced in data flow orchestration using Apache Airflow
- JSON, XML, CSV, Parquet file formats with snappy compression.
- File movements between HDFS and AWS S3
- Experience in shell scripting and scripting to automate report generation and migration of reports to AWS S3
- Worked in building a data pipeline using Pandas and Flask FrameworkGood Familiarity with Anaconda and Jupyternotebook

Similar jobs (10)
- Coding Complex Modules
- Code review and enforcing best practices
- Improve application architecture
- Constantly improve his/her own skill set
- Customisation to existing open souce and custom built applications
- Building a knowledge base of the latest programming trends, best practices and methodologies.
Education & Experience:
- B.Tech/BCA/MCA or M.Tech
- Experience into Javascript (Node.js, Angular.js/React.js)
- Experience representing work to a broader product team and other leaders, clearly and succintly articulating the goals and concepts
Job Location: Yeswanthpur, Bengaluru
Job Description:
∙Estate Management
∙Central Purchasing activity
∙Management and supervision of front office.
∙Detailed Planning of Travel and Hotel arrangements for employees and Senior Management when they
travel outside India or within India.
∙Prepare Itinerary for employees and senior delegates
∙Coordination in Visa Processing, travel formalities for employees and visitors.
∙Organizing Complete Domestic Air/Train/Overseas travel (Ticketing through Travel agent, Hotel Booking, Vehicle Arrangement).
∙Planning, Organizing and controlling all administrative functions.
∙Maintain rate contract with Vendors for Supply of Office Stationery, travel, hotel, cab services etc. ∙Maintain and manage company car fleet , including repair, maintenance, insurance claims, insurance renewals.
∙Supervision of Housekeeping Staff & Maintenance of office equipment’s /premises.
∙Taking care of Day to Day admin activates of the organization like stationery, pantry items, office equipment’s etc.
∙Paying Monthly utility bills and other vendor payments (like cab, courier etc.)
∙Verify and approve the invoices of vendors for payment processing.
Hands-on experience with RESTful services, API design are must.
Knowledge of microservices architecture is must.
Knowledge of design patterns is a must.
Strong knowledge of Exception handling and logging mechanism is a must.
Agile scrum participation experience. Work experience with several agile teams on an application built
with microservices and event-based architectures to be deployed on hybrid (on-prem/cloud)
environments.
Good knowledge of Spring framework (MVC, Cloud, Data and Security. Etc) and ORM frameworks like JPA/Hibernate.
Experience in managing the Source Code Base through Version Control tools like SVN, GitHub,
Bitbucket, etc.
Experience in using and configuration of Continuous Integration tools Jenkins, Travis, GitLab, etc.
Experience in the design and development of SaaS/PaaS-based architecture and tenancy models.
Experience in SaaS/PaaS-based application development used by a high volume of
subscribers/customers.
Awareness and understanding of data security and privacy.
Experience in performing Java Code Reviews using review tools like SonarQube, etc.
Good understanding of end-to-end software development lifecycle. Ability to read and understand
requirements and design documents.
Good Analytical skills and should be self-driven.
Good communication with interpersonal skills.
Open to learning new technologies and domains.
A good team player and ready to take up new challenges. Active communication and coordination with
Clients and Internal stakeholders
Requirements: Skills and Qualifications
6-8 years of experience in developing Java/J2EE-based Enterprise Web Applications
Languages: Java, J2EE, and Python
Databases: MySQL, Oracle, SQL Server, PostgreSQL, Redshift, MongoDB
DB Script: SQL and PL/SQL
Frameworks: Spring, Spring Boot, Jersey, Hibernate and JPA
OS: Windows, Linux/Unix.
Cloud Services: AWS and Azure
Version Controls/ DevOps tools: Git, Bitbucket and Jenkins.
Message brokers: RabbitMQ, and Kafka
Deployment Servers: Tomcat, Docker, and Kubernetes
Build Tools: Gradle/Maven
Required:
- A minimum of 1 years of consulting and/or relevant industry experience
- Understanding of Android Framework and Android app development.
- Experience in developing android apps using Kotlin and latest frameworks
- Knowledge and understanding of Design-Patterns and Data Structures.
- Ability to develop Android applications using latest Frameworks like Retrofit, RxJava
- Ability to write Unit test cases using the frameworks.
- Knowledge about how to consume the REST API's
- Understanding of Git/BitBucket or any version control system
- Good written and verbal communication skills.
- B.E/B.Tech/MCA/MSC/MS
Preferred:
- Understanding and usage of latest android frameworks like JetPack, Android Architectural components
- Experience in mentoring the new team members and also the junior folks.
- Exposure to various mobile architectures (ex: MVC, MVP, MVVM, etc..)
- Experience in handling the Android app deployment process.
- Experience in working in Agile methodology
You should understand concepts of Web very well, Web Services Relational Database : MySQL (Good to know PostgreySQL ) NoSQL DB : MongoDB or any other.
Having 6+ experience as a QA/SDET
Having good knowledge on iOS/Android App based apps testing.
Having good exposure on mobile based application testing and testing process.
Good knowledge on backend API testing
Good in writing manual test cases with all possible scenarios.
Good exposure on JIRA, Zypher and QC.
Good in debugging skills and ELK stack.
Good to have experience in Java and automation technologies









