Data Engineer
Mandatory Requirements
- Experience in AWS Glue
- Experience in Apache Parquet
- Proficient in AWS S3 and data lake
- Knowledge of Snowflake
- Understanding of file-based ingestion best practices.
- Scripting language - Python & pyspark
CORE RESPONSIBILITIES
- Create and manage cloud resources in AWS
- Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies
- Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform
- Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations
- Develop an infrastructure to collect, transform, combine and publish/distribute customer data.
- Define process improvement opportunities to optimize data collection, insights and displays.
- Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible
- Identify and interpret trends and patterns from complex data sets
- Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders.
- Key participant in regular Scrum ceremonies with the agile teams
- Proficient at developing queries, writing reports and presenting findings
- Mentor junior members and bring best industry practices
QUALIFICATIONS
- 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales)
- Strong background in math, statistics, computer science, data science or related discipline
- Advanced knowledge one of language: Java, Scala, Python, C#
- Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake
- Proficient with
- Data mining/programming tools (e.g. SAS, SQL, R, Python)
- Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
- Data visualization (e.g. Tableau, Looker, MicroStrategy)
- Comfortable learning about and deploying new technologies and tools.
- Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines.
- Good written and oral communication skills and ability to present results to non-technical audiences
- Knowledge of business intelligence and analytical tools, technologies and techniques.
Familiarity and experience in the following is a plus:
- AWS certification
- Spark Streaming
- Kafka Streaming / Kafka Connect
- ELK Stack
- Cassandra / MongoDB
- CI/CD: Jenkins, GitLab, Jira, Confluence other related tools
Similar jobs
Responsibilities-
- Writing back-end code & front –end code and building efficient Java modules
- Contribute in all phases of the development lifecycle, Write well designed, testable, Design, build, and maintain efficient, reusable, and reliable Java code code
- Help maintain code quality, organization, and automatization
- Ensure designs are in compliance with specifications
- Prepare and produce releases of software components
- Support continuous improvement by investigating alternatives and technologies and presenting these for architectural review
- Translate application storyboards and use cases into functional applications
- Ensure the best possible performance, quality, and responsiveness of the applications
- Identify bottlenecks and bugs, and devise solutions to these problems
- Align with organizational security protocols and data protection requirements and
- Implement the required feature
- Participate in all phases of the SDLC
Skills and Experience-
- BS/MS Degree in Computer Science, Engineering or a related subject
- Hands-on experience in designing and developing applications using Java EE platforms
- Object-oriented analysis and design using common design patterns.
- Profound insight of Java and JEE internals (Class loading, Memory Management, Transaction management, etc.)
- excellent knowledge of Relational Databases, SQL, and ORM technologies (JPA2, Hibernate)
- Experience in the Spring Framework
- Hands-on experience in designing and developing applications using JavaScript, j Query, and AJAX.
- Ensure that the APIs and services are adequate to support the application
- Profound insight of Java and JEE internals (Class loading, Memory Management, Transaction management etc.)
- Excellent knowledge of Relational Databases, SQL, and ORM technologies (JPA2, Hibernate)
- Experience with test-driven development
- excellent written and verbal communication skills Ability to quickly adapt and learn new technologies.
- Collaborate with other parts of the technology team, including product, QA, etc. to deliver a solid product.
Mobile Application Developer
Cubera is a data company revolutionizing big data analytics and Adtech through data share value principles wherein the users entrust their data to us. We refine the art of understanding, processing, extracting, and evaluating the data that is entrusted to us. We are a gateway for brands to increase their lead efficiency as the world moves towards web3.
The ideal candidate will be responsible for the technical design and implementation of new products and enhancements. They will work in all phases of the development cycle: concept to implementation.
Responsibilities
3+ yrs of experience in Cross Platform React-Native based app development.
Hands-On Experience of Android and IOS Cross Platform Development.
Should be well-versed with Mobile Application Architecture, React/React Native Life Cycle and Redux.
Good Command on Javascript Coding, CSS3 and HTML5 and ES6 Standards.
Basic Understanding of Graphic Design and UX Design.
Good understanding of OOP, design patterns, and industry best practices.
Self-motivated to explore new technologies, applications, and environments.
Hands-on Experience with Node JS and MongoDB is good to have.
Share ownership of the sprint, define task backlog and development process.
Reach out to the open-source community to encourage and help implement mission-critical software fixes—React Native moves fast and often breaks things.
Leverage native APIs as necessary for deep integrations with both platforms.
Write, document, and maintain code and automated tests to ensure the product is of the highest quality.
Develop and maintain build process with CI/CD tools for automated builds.
Qualifications
Bachelor’s degree or equivalent in Computer Science.
3+ years’ experience in related area.
Experience with iOS and Android platforms.
Job Category: Development
Job Type: Full Time
Job Location: Bangalore
Front End developers
- Angular.JS experience
- MongoDB query and aggregation experience (not a database administrator)
- GraphQL experience
- Node.JS and Typescript experience
- CSS and SCSS experience
- CI/CD experience with GitHub actions
Backend Developers:
- Software development experience, one of Python (preferred) or Node.JS/Typescript)
- Experience with Messaging architectures - RabbitMQ (preference) or Kafka
- Experience with docker-containers
- Experience with Apache NiFi (valued but not necessary)
- Experience with designing or implementing horizontally scalable solutions
- Experience working with RESTful APIs
- CI/CD experience with GitHub actions
- Experience with Azure cloud
Job description
Role/project description: will be responsible for user interface development of various android/ios based mobile applications for organization clients and partners.
The candidate will work in global, highly innovative and agile environment made up both by talented youngsters and senior professionals.
Location: Saudi Arabia
Job responsibilities:
- Design and develop high-volume, low-latency applications for mission-critical systems, delivering high-availability and performance
- Contribute in all phases of the development lifecycle concept, design, build, deploy, test, release to app stores and support.
- Diagnose performance issues, fix bugs including crashes and anrs to increase the functionality of the application
- Write well designed, testable, efficient code
- Ensure designs are in compliance with specifications.
- Prepare and produce releases of software components
- Support continuous improvement by investigating alternatives and technologies and presenting these for architectural review.
- Collaborate with team members product managers, developers, designers to brainstorm about new features and functionalities.
Desired profile:
- Proficient in Java/Kotlin programming
- Knowledge and experience in flutter framework and dart programming
- Hands on experience in using restful APIs
- Hands on experience in designing and developing micro-services architecture and containers
- Object oriented analysis, uml and design using common design patterns.
- Hands on experience in development ide android studio, android sdk, firebase test lab
- Experience with offline storage, threading, and performance tuning
- Familiarity with push notifications
- Familiarity with IOS integration with flutter
- Experience using GitHub or similar environment
- Complete understanding of SDLC &agile development
- Experience with material design and android ui design principles, patterns and best practices
- Good knowledge of adding third-party libraries
- Ability to understand business requirements and translate them into technical requirements
- Working knowledge of the general mobile landscape, architectures, trends, and emerging technologies
- A track record of delivering successful complex consumer product apps finance apps, e-commerce apps
- Critical thinker
Responsibilities
- Plan, develop and implement large-scale projects from conception to completion.
- Interface with clients and gather business requirements and objectives.
- Translate clients’ business requirements and objectives into technical applications and solutions.
- Understand and evaluate complex data models.
- Design, develop and implement new integration.
- Execute system development and maintenance activities.
- Develop solutions to improvise performance and scalability of systems.
- Mentor junior and mid-level engineers.
Minimum Requirements
- 3-5 years of relevant experience, working in Java related technologies.
- A Good Engineering or Masters degree from a reputed university
- Should have strong technical skills with a good grasp of OO concepts and design patterns
- Good knowledge of SQL database ( MySQL, Oracle, etc )
- Good understanding of frameworks like Spring, Hibernate, etc.
- Good understanding of spring boot and microservices.
- Exposure to AWS services - S3, SQS, Lambda, DynamoDB, API Gateway, etc.
Good to have
- Knowledge of No-SQL DBs like mongo, dynamoDB, etc.
- Knowledge of message brokers/queuing services like SQL, rabbitMQ, Kafka, etc.
Job Responsibilities:-
- E-bidding on Upwork and Freelancers, client communication, project finalizing and final delivery.
- Communication between the Client and the Technical teams.
- Generating Revenue & projects and closing deals with International Clients.
- Assists in enforcement of project deadlines and schedules.
- Quickly understands the business issues and data challenges of client’s organization and industry.
- Creating documents like BRS /SRS and project Cost Estimation
- Identifies client organizations strengths and weaknesses and suggests areas of improvement.
- Technical Recommendation and Testing
- At least 4 to 6 years of experience in developing web applications in Angular and has worked/knowledge of Angular 11
- Ability to create components and module hierarchy for a moderately complex application, along with their interactions
- In-depth knowledge of the Angular framework and Expert in Typescript, HTML 5, CSS 3
- Should have understanding of CSS pre- processors such as SCSS
- Must have understanding of unit testing frameworks such as Jasmine, Karma
- Hands-on experience on State Management using NgRx
- Ability to understand and put to use data grids such as AG Grid
- Any Certification in Angular [ Level 1(Junior) or Level 2(Intermediate) or Level 3(Expert) ] would be an advantage
- Below is the Technology stack that the development environment is planned on:
|
Framework / Library / Language / Tool |
Markup & Styles |
HTML5 / CSS3 |
CSS Pre-processor |
SCSS |
Base Development Framework |
Angular with TypeScript |
State Management |
NgRx |
Unit Testing |
Jasmine / Karma |
UI Widget / Responsive |
Bootstrap or Angular Material |
Grid Library |
agGrid |
Chart Library |
High Charts / D3JS |
Development Platform |
NodeJS |
Integration |
RESTful services with JSON based Data Model |
- Good understanding of front-end optimization techniques. Proficiency in browser rendering behavior and performance
- Experience in developing Touch screen applications
- Prior experience in modernization projects
- Knowledge of .net
- Excellent debugging skills; able to debug complex technical issues involving multiple system components
- Experience with Agile methodologies
Process Skills:
- Excellent understanding of business complexity and project interdependencies
- Effective problem-solving skills
Behavioral Skills:
- Result oriented player
- Excellent communication skills and ability to communicate with people from various backgrounds is essential
- Self-motivated, result oriented, and a team player
- Good command over English language
- Excellent troubleshooting skills
Academic Qualification:
- Graduate: Required
About the practice/ Project:
To remove/migrate Silverlight dependency of a Health Care Product which was built using ASP.Net 4.x / .NET C# / HTML4 / CSS / JavaScript- Sales and marketing of travel related products and services to various corporate and business houses.
- Corporate relationship build up
- Business Development
Qualification Criteria –
- Graduation : Graduation ( Any)
- Fluent in English
- Shall be smart, dynamic and motivated
- Willing to travel.
- 2-6 years of experience in travel industry / corporate sales (preferable).
- Compensation :
- Salary - As per Industry Standard.
- Benefits - Incentive, Mobile bills and Convenience, Health Insurance (post confirmation)