
Data Engineer
at consulting & implementation services in the area of Oil & Gas, Mining and Manufacturing Industry
- Data Engineer
Required skill set: AWS GLUE, AWS LAMBDA, AWS SNS/SQS, AWS ATHENA, SPARK, SNOWFLAKE, PYTHON
Mandatory Requirements
- Experience in AWS Glue
- Experience in Apache Parquet
- Proficient in AWS S3 and data lake
- Knowledge of Snowflake
- Understanding of file-based ingestion best practices.
- Scripting language - Python & pyspark
CORE RESPONSIBILITIES
- Create and manage cloud resources in AWS
- Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies
- Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform
- Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations
- Develop an infrastructure to collect, transform, combine and publish/distribute customer data.
- Define process improvement opportunities to optimize data collection, insights and displays.
- Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible
- Identify and interpret trends and patterns from complex data sets
- Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders.
- Key participant in regular Scrum ceremonies with the agile teams
- Proficient at developing queries, writing reports and presenting findings
- Mentor junior members and bring best industry practices
QUALIFICATIONS
- 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales)
- Strong background in math, statistics, computer science, data science or related discipline
- Advanced knowledge one of language: Java, Scala, Python, C#
- Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake
- Proficient with
- Data mining/programming tools (e.g. SAS, SQL, R, Python)
- Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
- Data visualization (e.g. Tableau, Looker, MicroStrategy)
- Comfortable learning about and deploying new technologies and tools.
- Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines.
- Good written and oral communication skills and ability to present results to non-technical audiences
- Knowledge of business intelligence and analytical tools, technologies and techniques.
Familiarity and experience in the following is a plus:
- AWS certification
- Spark Streaming
- Kafka Streaming / Kafka Connect
- ELK Stack
- Cassandra / MongoDB
- CI/CD: Jenkins, GitLab, Jira, Confluence other related tools

Similar jobs
- Experience in Core Java, CXF, Spring.
- Experience in spring boot, microservices.
- Extensive experience in developing enterprise-scale n-tier applications for the financial domain. Should possess good architectural knowledge and be aware of enterprise application design patterns.
- Should have the ability to analyze, design, develop and test complex, low-latency client-facing applications.
- Good development experience with RDBMS, preferably Sybase database
- Good knowledge of multi-threading and high volume server side development
- Experience in sales and trading platforms in investment banking/capital markets
- Basic working knowledge of Unix/Linux
- Excellent problem solving and coding skills in Java
- Strong interpersonal, communication and analytical skills.
- Should have the ability to express their design ideas and thoughts.
DESCRIPTION:
TMRW House of Brands (ABFRL) is looking for a Graphic Designer who will be responsible for designing & and editing all social media & and marketing collaterals including static and video templates. The ideal candidate must be well equipped with Adobe Suite and Canva and should know how to use Generative AI (mid-journey Firefly Dall-e) and other relevant editing tools, and must be able to deliver quality visual content consistently. The candidates are expected to have a minimum of 5 years of experience as a graphic designer.
Responsibilities:
- Study design briefs and determine requirements
- Conceptualize visuals based on requirements
- Prepare rough drafts and present ideas
- Develop illustrations, logos, and other designs using software or by hand
- Use the appropriate colors and layouts for each graphic
- Work with copywriters and creative lead to produce final design
- Amend designs quickly after feedback
- Ensure final graphics and layouts are visually appealing and are on-brand
- Meet deadlines provided by the design lead
Requirements and skills:
- Proven experience in Adobe Suite, Canva
- Good Knowledge on Generative AI (Mid journey, firefly, Canva AI)
- Proven graphic designing experience have worked with Agencies or Fashion Industry
- A strong portfolio of illustrations or other graphics
- Familiarity with design software and technologies (such as InDesign, Illustrator, After Effects Photoshop Canva )
- A keen eye for aesthetics and details
- Excellent communication skills
- Ability to work methodically and meet deadlines
Qualification: Graduation/Diploma in Visual Design
● Proven work experience as a Back-end developer.
● In-depth understanding of the entire web development process (design, development and deployment).
● Proficient in Java, with a good knowledge of its ecosystems
● Basic understanding of JVM, its limitations, weaknesses, and workarounds
● Ability to decide when to use relational vs NoSQL databases and must be experienced with at least one of
the relational databases (MySQL) as well as experience with ElasticSearch will be good to have
● Familiarity with concepts of MVC, JDBC, and RESTful
● Experience with Spring, Spring Boot, Spring MVC
● Experience in CI/CD and Cloud technologies
● Expertise in developing enterprise-level web applications and RESTful APIs using MicroServices, with
demonstrable production-scale experience
● Familiarity with front-end languages (e.g. HTML, JavaScript and CSS) - Not mandatory
● Participation in coding competitions such as hackathon, hackerrank will be added advantage.
-Maintaining a positive, empathetic and professional attitude toward customers at all times.
-Responding promptly to customer inquiries.
Acknowledging and resolving customer complaints.
- Ensure customer satisfaction and provide professional customer support.
-Follow company process accurately and efficiently Experience.
ESSENTIAL FUNCTIONS:
-
Writing well-designed, testable, and efficient code.
-
Gathering and evaluating user feedback.
-
Working as a part of a dynamic team to deliver winning products.
-
Providing code documentation and other inputs to technical documents.
-
Supporting continuous improvement by investigating alternatives and new technologies and presenting these for architectural review.
-
Troubleshooting and debugging to optimize performance.
-
Leading the design, creation, and implementation of a suite of software.
-
Architecting, designing, developing, and deploying new features for mobile applications.
-
Designing and implementing mobile applications.
-
Participating in the definition and implementation standards for mobile development.
-
Working on all parts of the code-base and contributing to every stage of the product development cycle.
SKILLS
-
PHP, Java Kotlin for Android
-
Experience in OOP with an understanding of ReactiveX programming
-
Familiar with Fastlane, CI/CD tools (Jenkins), and GitHub
-
Strong Hands-on coding, debugging, and troubleshooting skills
-
Strong understanding of unit testing frameworks
-
Ability to develop high performance and reusable code using a modular architecture.
-
Experience with RESTful APIs
-
Modeling skills (UML), sequence diagrams
-
Conceptual thinking and Attention to quality
-
Shares knowledge with others
-
Seeks to understand underlying requirements and business rationale
- Flexible working hours
- 5 days working
Work as a member of a team responsible for developing a large-scale, highly available and fault-tolerant SaaS based Leasing & Asset management solution in the commercial real estate space in accordance with established processes. You will apply your knowledge of building scalable, distributed applications and have the opportunity to work with technologies & frameworks such as Ruby on Rails, NodeJS, ReactJS, Heroku, AWS, Postgres DB
Essential Functions include but are not limited to the following.
You will be expected to:
- Contribute to all phases in the software lifecycle – requirements analysis, solution design, development, and deployment
- Maintain high quality standards for the work undertaken and be responsible for the quality of deliverables.
- Ensure assigned projects are developed in accordance with established engineering processes, adhering to scope, schedule constraints and agile project plans
- Guide/mentor the less experienced team members
- Participate in code reviews
- Work effectively as part of a distributed team
- Document the features worked by him/her
Key technical expertise areas expected for this role:
- Strong programming skills in Ruby with clear understanding of Object-Oriented and Functional programming.
- Experience working with Ruby on Rails framework
- Experience on REST API Programming preferably based on a Microservices Architecture
- Good Understanding of Databases (Postgres) and proficiency in database schema designing & writing efficient SQL Queries.
- Strong troubleshooting skills
- Demonstrable ability to learn new programming languages and frameworks quickly
- Experience with distributed systems with specific focus on security and scalability
- Experience with modern cloud technologies such as AWS
Additional areas that would add value:
- Experience working with Cloud Service providers & platforms like AWS, Heroku
- Strong understanding of Design Patterns & their application in system design
- Test Driven & Behavior Driven Development
- Automated Unit/Integration testing
- Using DevOps & Infrastructure tooling such as GoCD/Jenkins, Git
- Frontend web development with JavaScript frameworks like React
- Experience working on projects, preferably in the real estate domain
- Experience working with Virtualization and Containerization technologies including Docker, Kubernetes.
- Experience working in Agile Scrum/Kanban methodologies
- Experience working with Linux and Shell scripting
Education:
- Bachelors or Master’s in Computer Science or related fields
Ideal Candidate Profile
- Strong grasp of computer science fundamentals and excellent problem-solving skills.
- Good understanding of software engineering practices, Data Structures & Algorithms.
- Solid programming skills in Java/Kotlin.
- Good communication skills.
- Strong sense of ownership and accountability.
- Experience in Reactive programming, Asynchronous programming and Unit Testing will be an added advantage.
- 4-7years of experience in product driven organization.
Job Description:
- Integration developer who is having experience in any one of the integrations tools Dell Boomi, MuleSoft, Informatica.
- Understand requirements and participate in designing the solution
- Develop the solution as per the design by following coding guidelines.
- Test the developed solution.
- Work on defect fixes
- Follow project processes
- Provide accurate status report on a daily basis
Job Responsibilities:
- Participate in Design and develop as per the design and requirements
- Follow coding guidelines and produce quality output
- Follow the project processes and completed the development within the set target
- Analyze the defects to identify root cause and fix the defects.
- Be Open to learn other integration tools.
Primary Skills Required: Dell Boomi, Mulesoft, Informatica
Secondary Skills Required: Java, Salesforce
Technical Skills Required:
Experience in any one of the Integration tool, Dell Boomi, Mulesoft and Informatica.
Required at least one Certification on any Integration Tool











