
Data Engineer
at consulting & implementation services in the area of Oil & Gas, Mining and Manufacturing Industry
- Data Engineer
Required skill set: AWS GLUE, AWS LAMBDA, AWS SNS/SQS, AWS ATHENA, SPARK, SNOWFLAKE, PYTHON
Mandatory Requirements
- Experience in AWS Glue
- Experience in Apache Parquet
- Proficient in AWS S3 and data lake
- Knowledge of Snowflake
- Understanding of file-based ingestion best practices.
- Scripting language - Python & pyspark
CORE RESPONSIBILITIES
- Create and manage cloud resources in AWS
- Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies
- Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform
- Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations
- Develop an infrastructure to collect, transform, combine and publish/distribute customer data.
- Define process improvement opportunities to optimize data collection, insights and displays.
- Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible
- Identify and interpret trends and patterns from complex data sets
- Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders.
- Key participant in regular Scrum ceremonies with the agile teams
- Proficient at developing queries, writing reports and presenting findings
- Mentor junior members and bring best industry practices
QUALIFICATIONS
- 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales)
- Strong background in math, statistics, computer science, data science or related discipline
- Advanced knowledge one of language: Java, Scala, Python, C#
- Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake
- Proficient with
- Data mining/programming tools (e.g. SAS, SQL, R, Python)
- Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
- Data visualization (e.g. Tableau, Looker, MicroStrategy)
- Comfortable learning about and deploying new technologies and tools.
- Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines.
- Good written and oral communication skills and ability to present results to non-technical audiences
- Knowledge of business intelligence and analytical tools, technologies and techniques.
Familiarity and experience in the following is a plus:
- AWS certification
- Spark Streaming
- Kafka Streaming / Kafka Connect
- ELK Stack
- Cassandra / MongoDB
- CI/CD: Jenkins, GitLab, Jira, Confluence other related tools

Similar jobs
Strong Creative Video Production / Content Strategy Leadership Profile
Mandatory (Experience 1) – Must have 2+ YOE in Video Production & video content creation for B2C / Fin-Tech digital platforms.
Mandatory (Experience 2) – Must have extensive hands-on experience in storyboarding, scripting, copywriting, and video production processes (concept to execution).
Mandatory (Core Skill 1) – Must be proficient in AI-driven content creation tools and video production/editing software (Adobe Premiere Pro, Final Cut Pro, After Effects, Photoshop, etc.), along with familiarity in prototyping/automation tools.
Mandatory (Core Skill 2) – Strong expertise in video-led content strategy, project management, digital marketing principles, and performance tracking (CTR, engagement, conversions, SEO best practices).
Mandatory (Portfolio) – Must have a strong portfolio of video content strategy, production, and execution, showcasing work across diverse digital formats (explainer videos, product demos, customer storytelling, social content).
Mandatory (Company) - Social-first Digital Agencies, OR eCommerce / B2C Brands OR New-age internet companies
1) Be open to learn new frameworks like Hapi.JS , Typescript , Nest.JS
2) Strong DB concepts , and hands on knowledge on MongoDB , REDIS
3) Experience working with micro-services will be a plus
4) Experience working with JWT and IAM systems will be a plus
5) Experience working with Postman , Swagger will be a plus
6) TDD knowledge is an advantage and also working with Unit Test code and familiar with test code coverage concepts.
7) Strong operating system knowledge is a plus with knowledge of how to manage threads.
8) Working experience with RabbitMQ , Kafka will be a plus
9) Strong knowledge of JS internals is a must.
You can contact me on nine three one six one two zero one three two
Python. Django Rest Framework experience would be great, but not essential! We prioritise
quality over quantity.
Postgres with InfluxDB, Oracle, MySQL and Redis experience a plus.
Docker, Kubernetes, Helm, OpenShift and associated tooling.
AWS, especially ECS, Lambda, RDS and DynamoDB. Performance and uptime are super
important to us.
The challenge of scaling a global, distributed API to 10,000+ requests per second.
We have SDKs in a bunch of languages, so the more polyglot you are the better.
If you like writing JS and React that would be awesome too.
Job brief
We are looking for an iOS developer who possesses a passion for pushing mobile technologies to the limits and will work with our team of talented engineers to design and build the next generation of our mobile applications.
Responsibilities
- Design and build advanced applications for the iOS platform
- Collaborate with cross-functional teams to define, design, and ship new features.
- Unit-test code for robustness, including edge cases, usability, and general reliability.
- Work on bug fixing and improving application performance.
- Continuously discover, evaluate, and implement new technologies to maximize development efficiency.
Requirements and skills
- BS/MS degree in Computer Science, Engineering or a related subject
- Proven working experience in software development
- Working experience in iOS development
- Have published one or more iOS apps in the app store
- A deep familiarity with Objective-C and Cocoa Touch
- Experience working with iOS frameworks such as Core Data, Core Animation, Core Graphics and Core Text
- Experience with third-party libraries and APIs
- Working knowledge of the general mobile landscape, architectures, trends, and emerging technologies
- Solid understanding of the full mobile development life cycle
We at Kunato, a New York-based IT startup, are looking for a Head Product Design who can lead our UI/UX efforts.
The ideal candidate is a leader, self-motivated, organized, and creative individual who welcomes the challenges of designing products from scratch. You will be planning, designing, strategizing, doing market research, and collaborating with the product, and tech team to showcase the best design for our product suites. This is a unique opportunity to leading the creative vision not just for the design team but for the entire organization.
What would you be working on?
- As a Head UI/UX Designer at Kunato, you will work closely with Product Managers, Engineers and Business Development to understand the problem statement and design end-to-end solutions that can be iterated upon and scaled.
- You will help develop design requirements and deliver product features that are intuitive, accessible, and easy to use that could potentially reach millions of people around the world.
- You will rely on user-centered design principles to produce high-quality visuals — from concept to execution — across mobile and web. You’ll be leading your design team to constantly refine the design language and create innovative, great-looking products that people love to use.
What are we looking for?
- Practical experience or a Bachelor's degree in Human-Computer Interaction, Design, UX, or a related discipline.
- 4+ years of industry experience.
- Ability to deliver end-to-end design from concept to launch and iterate after user research.
- Track record in collaborating with Product Managers and Engineers to design and launch new product features.
- Previous experience leading the designs at a product-based company coupled with hands-on design experience is a must-have.
- Comfortable using Figma and its features and a good understanding of design systems
- A portfolio with good design rationale and visual design skill
- Strong oral and written communication skills; extreme attention to detail
- Must have prior work-from-home experience and is comfortable in the remote working setup
- Must be time-flexible and willing to extend hours as needed
If you can work in a fast-paced environment, love the UX/UI role from research to the actual design and testing, can communicate clearly and effectively your design rationale, can work comfortably from home, can attend sprint planning, and enjoy working remotely with other designers, developers and product managers (in the same and different time zones)and if you love the challenge of revolutionising the digital content space- then this can be your new long term job.
We are looking for an experienced Dot Net/angular Developers to join our growing and diverse team.
Mandatory Skills: DotNet(C#/ASP), MVC, Web API, SQL/PostgreSQL, JavaScript, Angular.
Experience: 3yrs to 5yrs
Responsibilities:
Build components that are scalable, flexible and compatible across different frameworks and browsers. Several of the frameworks, tools and techniques currently used
in our technical solutions:
Frontend development using VueJS or similar framework such as ReactJS or Angular.
Backend development using .NET Core.
DevOps work using GCP and/or AWS.Hosting using Docker/Containers.
Message queue such as RabbitMQ / AWS SQS.
Storage and events using Postgres/SQL, EventStore , ElasticSearch , Redis/NoSQL. Continuous development and deployment using tools like GitHub, TeamCity, Octopus Deploy.
Respond to trouble/support calls per SLA for applications in production to make quick repair to keep application in production. Conducts complex analyses trouble shooting issues.
Participate in code reviews to ensure that each increment adheres to user story and all standard resource libraries and architecture patterns as appropriate.
Be part of our onshore and offshore development team working on our API Management solution delivering business value with active participation in our SAFe development processes.
Create or Update documentation in support of development efforts.
Qualifications:
Undergraduate degree in Computer Science and/or equivalent experience.
Experience defining technical expectations and goals of projects
Development experience with Microsoft web technologies and database programming
Experience with C#, ASP.net, SQL, XML, COM, JavaScript, VBScript, HTML, Site Server
Good experience on Front end technologies: JavaScript, Typescript, Modern JavaScript Frameworks.
Working knowledge of GIT is good to have.
Demonstrated interest in, knowledge of, and enthusiasm for Internet technologies.
Our client is the Health-tech initiative of India's largest business house. Started in 2015, it empowers healthcare providers and consumers in India. All healthcare monitoring services are made available through an app that will help connect doctors, hospitals, pharmacies, laboratories and consumers, enabling preventive and predictive healthcare. It helps the care-givers to track the entire patient journey from the initial appointment and maintaining their records, generating lab test reports to providing virtual consultation and home-care solutions. It is expected that this futuristic guide will strengthen doctor-patient relationship and enhance the in-clinic experience.
As the iOS Developer, you will be required to create our mobile product (app) on iOS Platform.
- Architecting, designing, implementing, and maintaining native mobile applications used to interact with external hardware
- Writing clean, understandable, robust, and sustainable code for mobile platforms
- Negotiating, specifying, and documenting architecture, tools, libraries, and feature requirements with the software team
- Creating and writing test cases to exercise and validate mobile applications
Desired Candidate Profile
What you need to have:- Should have 5+ years of professional work experience designing outstanding Mobile App on iOS Platform
- Have worked on an outstanding iOS App before
- Proficient understanding of iOS Concepts
- Proficiency in Objective-C and/or Swift
- Excellent problem-solving skills
- Excellent interpersonal skills and the ability to build good working relationships.
- Must be self-motivated to prioritize and manage workload and meet critical project milestones and deadlines.
- Able to effectively collaborate with a team as well as take initiative and work independently to solve problems
- Should have min 65% in B.E./ B.Tech/ M.Tech
Job Location : Bangalore
Expereince : 3 to 9 Years
JD :
● Work break-down and orchestrating the development of components for each sprint
● Developing “Zero Defect Software” which is secured, instrumented, and resilient.
● Building Cloud-Native Application which runs on Cloud Platforms such as GCP / AWS.
● Creating design artifacts before implementation.
● Developing Test Cases before or in parallel with implementation.
● Ensuring the software developed passes static code analysis, performance, and load tests.
● Developing various kinds of components(such as UI Components, APIs, Business Components, Image Processing, etc.)
● Inventing new approaches to detecting existing fraud.
● Staying ahead of the game by predicting future fraud techniques and building solutions to prevent them.
golang, Elixir, Ruby on Rails, Python, react,
Must have
● An understanding of Product Development Methodologies
● Strong design skills in defining API Data Contracts / OOAD / Microservices / Data Models
● In-depth knowledge of either Elixir, GoLang, or Python, with a good understanding of OOPs and Concurrency concepts.
● Sound knowledge for User Interface development using modern Web Frameworks such as React.
● Experience in developing software in the Cloud such as GCP / AWS
● A passion to explore new technologies and express yourself through
technical blogs







