Cutshort logo
Picture the future logo
Data Engineer
Picture the future
Data Engineer
Picture the future's logo

Data Engineer

at Picture the future

Agency job
4 - 7 yrs
₹5L - ₹15L / yr
Hyderabad
Skills
PySpark
Data engineering
Big Data
Hadoop
Spark
skill iconAmazon Web Services (AWS)
Apache
Snow flake schema
skill iconPython
Relational Database (RDBMS)
RESTful APIs
skill iconC#

CORE RESPONSIBILITIES

  • Create and manage cloud resources in AWS 
  • Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies 
  • Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform 
  • Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations 
  • Develop an infrastructure to collect, transform, combine and publish/distribute customer data.
  • Define process improvement opportunities to optimize data collection, insights and displays.
  • Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible 
  • Identify and interpret trends and patterns from complex data sets 
  • Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders. 
  • Key participant in regular Scrum ceremonies with the agile teams  
  • Proficient at developing queries, writing reports and presenting findings 
  • Mentor junior members and bring best industry practices 

 

QUALIFICATIONS

  • 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales) 
  • Strong background in math, statistics, computer science, data science or related discipline
  • Advanced knowledge one of language: Java, Scala, Python, C# 
  • Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake  
  • Proficient with
  • Data mining/programming tools (e.g. SAS, SQL, R, Python)
  • Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
  • Data visualization (e.g. Tableau, Looker, MicroStrategy)
  • Comfortable learning about and deploying new technologies and tools. 
  • Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines. 
  • Good written and oral communication skills and ability to present results to non-technical audiences 
  • Knowledge of business intelligence and analytical tools, technologies and techniques.


Mandatory Requirements 

  • Experience in AWS Glue
  • Experience in Apache Parquet 
  • Proficient in AWS S3 and data lake 
  • Knowledge of Snowflake
  • Understanding of file-based ingestion best practices.
  • Scripting language - Python & pyspark

 

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

IndiWork Software Solutions Pvt. Limited
kajal kumari
Posted by kajal kumari
Mohali
1 - 3 yrs
₹2L - ₹3L / yr
Search Engine Optimization (SEO)
Social Media Optimization (SMO)

We Have an opening for SEO Executive.

Mohali Location 

Experience:- 1 to 3 years 

Skill ;- Seo , Google Adds , Backlinks , Smo .

Read more
elite manpower and training academy
Indore
4 - 5 yrs
₹4.8L - ₹6L / yr
skill iconC#
ASP.NET
MVC Framework
Entity Framework
SQL server
+4 more

Job Title: .NET Developer (Full Stack Preferred)

Experience: 4–5 Years

Location: Indore (Preferred)

Job Type: Full-Time


Job Summary:

We are seeking a skilled and experienced .NET Developer with 4–5 years of hands-on experience in Core .NET, MVC, and Entity Framework. The ideal candidate will be proficient in either Angular or React, with full stack development experience being an added advantage. Candidates from Indore or those willing to relocate are preferred.


The .NET Developer will be responsible for designing, developing, testing, and maintaining software applications based on the Microsoft .NET framework. You will collaborate with cross-functional teams to deliver high-quality solutions and contribute to all phases of the software development life cycle.


Responsibilities/Duties:

1. Software Development:

Design, code, test, and debug software applications using the .NET framework.


Collaborate with other developers and team members to deliver robust and scalable solutions.


2. System Analysis:

Analyze and understand business requirements to design efficient and scalable software solutions.


Conduct code reviews and provide constructive feedback to peers.


3. Application Maintenance:

Maintain and enhance existing applications by resolving issues and implementing new features.


Troubleshoot and debug software defects and performance issues.


4. Documentation:

Document code, technical specifications, and system architecture.


Prepare and maintain relevant project documentation.


5. Collaboration:

Work closely with product owners, business analysts, and QA teams to ensure software meets business goals and quality standards.


Collaborate with other developers on team projects and shared codebases.


6. Technology Stack:

Utilize Microsoft technologies, including C#, ASP.NET, MVC, Entity Framework, and SQL Server.


Qualifications/Requirements:

Education:

Bachelor’s degree in Computer Science, Software Engineering, or a related field.


Experience:

  • 4–5 years of professional experience in .NET development.
  • Experience with GitHub Copilot is a plus.


Skills:

  • Proficient in C#, ASP.NET, MVC, and Entity Framework.
  • Experience with either Angular or React.
  • Strong understanding of object-oriented programming and design patterns.
  • Familiarity with front-end technologies (HTML, CSS, JavaScript) is a plus.
  • Comfortable with version control systems like Git.
  • Excellent problem-solving and debugging skills.
  • Strong verbal and written communication skills.


Preferred:

  • Candidates based in Indore or willing to relocate.
  • Experience working in Agile/Scrum environments.
  • Full stack development experience is highly desirable.
Read more
Deqode
at Deqode
1 recruiter
Alisha Das
Posted by Alisha Das
Hyderabad, Bengaluru (Bangalore), Chennai
4.5 - 6 yrs
₹5L - ₹20L / yr
skill iconJava
06692
Microservices
skill iconAmazon Web Services (AWS)
J2EE

Job Summary:

We are seeking a skilled and experienced Java Developer with hands-on expertise in AWS, Spring Boot, and Microservices architecture. As a core member of our backend development team, you will design and build scalable cloud-native applications that support high-performance systems and business logic.

Key Responsibilities:

  • Design, develop, and maintain backend services using Java (Spring Boot).
  • Build and deploy microservices-based architectures hosted on AWS.
  • Collaborate with DevOps and architecture teams to ensure scalable and secure cloud solutions.
  • Write clean, efficient, and well-documented code.
  • Optimize application performance and troubleshoot production issues.
  • Participate in code reviews, technical discussions, and architecture planning.

Must-Have Skills:

  • 4.5+ years of experience in Java development.
  • Strong proficiency in Spring Boot and RESTful APIs.
  • Proven hands-on experience with AWS services (EC2, S3, Lambda, RDS, etc.).
  • Solid understanding of microservices architecture, CI/CD, and containerization tools.
  • Experience with version control (Git), and deployment tools.


Read more
Intellikart Ventures LLP
ramandeep intellikart
Posted by ramandeep intellikart
Bengaluru (Bangalore)
5 - 10 yrs
₹5L - ₹30L / yr
skill iconPython
skill iconAmazon Web Services (AWS)
Microsoft Windows Azure
Google Cloud Platform (GCP)
Databases
+1 more

How You'll Contribute:

● Redefine Fintech architecture standards by building easy-to-use, highly scalable,robust, and flexible APIs

● In-depth analysis of the systems/architectures and predict potential future breakdown and proactively bring solution

● Partner with internal stakeholders, to identify potential features implementation on that could cater to our growing business needs

● Drive the team towards writing high-quality codes, tackle abstracts/flaws in system design to attain revved-up API performance, high code reusability and readability.

● Think through the complex Fintech infrastructure and propose an easy-to-deploy modular infrastructure that could adapt and adjust to the specific requirements of the growing client base

● Design and create for scale, optimized memory usage and high throughput performance.​


Skills Required:

● 5+ years of experience in the development of complex distributed systems

● Prior experience in building sustainable, reliable and secure microservice-based scalable architecture using Python Programming Language

● In-depth understanding of Python associated libraries and frameworks

● Strong involvement in managing and maintaining produc Ɵ on-level code with high volume API hits and low-latency APIs

● Strong knowledge of Data Structure, Algorithms, Design Patterns, Multi threading concepts, etc

● Ability to design and implement technical road maps for the system and components

● Bring in new software development practices, design/architecture innovations to make our Tech stack more robust

● Hands-on experience in cloud technologies like AWS/GCP/Azure as well as relational databases like MySQL/PostgreSQL or any NoSQL database like DynamoDB

Read more
amIT Global solution
Mumbai, Kolkata, Bengaluru (Bangalore), Delhi
2 - 4 yrs
₹3L - ₹6L / yr
Client Management

Job Description:


Should be from broking industry and should have experience in on field sales.


Key Responsibilities:


  • Acquisition of Point of Sales Persons (POSPs) / Associates.
  • Identify the needs of POSPs / Associates and suggest suitable insurance products and payout rates from different insurers.
  • Provide joint call support to POSPs along with direct sales exposure.
  • Achieve individual business targets aligned with POSP acquisition and activation goals.
  • Manage customer relationships effectively.
  • Impart product training to POSPs acquired.
  • Stay updated with developments in:
  • Insurance products and services
  • Company policies and procedures
  • Sales processes


 

Required Skills and Attributes:


  • Logical and analytical approach to sales
  • Strong convincing and persuasion skills
  • Knowledge of Life, General, and Health Insurance products
  • Relationship-oriented with high energy levels
  • Client-centric mindset
  • Analytical thinking with a solution-oriented approach


 

 

Qualification:

•            Graduate

 

Key Skills:

•            Good communication skills

•            Strong analytical skills

•            Customer orientation


Functional Area:

•            Sales

Read more
MNC
MNC
Agency job
via Fragma Data Systems by Harpreet kour
Bengaluru (Bangalore)
4 - 6 yrs
₹15L - ₹20L / yr
skill iconJavascript
Wordpress
Web

Must Have
- Stack: Wordpress, Javascript

Nice to have
- Experience in Affiliate Marketing and Lead Generation
- Some experience/knowledge in python is preferred.
- Building wireframes

Read more
Miko
at Miko
Vaishnavi Rane
Posted by Vaishnavi Rane
Remote only
5 - 10 yrs
₹22L - ₹32L / yr
WebSocket
Vertex
skill iconJava
skill iconSpring Boot
Hibernate (Java)
+5 more

Company Description


Miko is an advanced artificial intelligence innovation lab with a mission to bring AI and robotics to every consumer home. Headquartered in Mumbai, India, our workforce spans several countries, including the

United States, Canada, Europe, and the Middle East. To check out various product offerings, visit Miko's website.


Position Overview:


We seek a highly skilled and experienced Senior/ Lead Software Engineer to join our innovative team. The ideal candidate will have a strong background in Java development and be proficient in various backend technologies and frameworks. The role involves designing, developing, and maintaining high-performance, scalable backend systems. The candidate should be comfortable working in a Linux environment and have hands-on experience with both SQL and NoSQL

databases, as well as modern containerization and orchestration tools.


Key Responsibilities:


• Design, develop, and maintain backend services using Java, Spring Boot, and Vert.x.

• Implement and manage database solutions using SQL and NoSQL databases.

• Work with Hibernate for ORM (Object-Relational Mapping).

• Develop and manage caching mechanisms with Redis.

• Implement messaging and streaming solutions using Kafka.

• Utilize Docker for containerization and Kubernetes for orchestration.

• Perform system designing to ensure high availability, scalability, and reliability of applications.

• Design and develop microservices or monolithic architectures based on project requirements.

• Collaborate with front-end developers and other team members to establish objectives and design more functional, cohesive code to enhance the user experience.

• Write clean, scalable code using Java programming languages.

• Revise, update, and debug code.

• Improve existing software.

• Develop documentation throughout the software development life cycle (SDLC).

• Serve as an expert on applications and provide technical support.


Mandatory Skills and Qualifications:


• Proven experience as a Java Backend Developer.

• Strong expertise in Java, Spring Boot, and Vert.x.

• Proficient in using Hibernate for ORM.

• Extensive experience with Linux operating systems.

• Hands-on experience with Git version control system.

• Solid understanding of SQL and NoSQL databases.

• Experience with Redis for caching.

• Practical knowledge of Kafka for messaging and streaming.

• Proficiency with Docker for containerization and Kubernetes for orchestration.

• Strong understanding of system designing principles.

• Experience with microservices or monolithic architecture.

• Excellent problem-solving skills and attention to detail.

• Ability to work independently and as part of a team.

• Strong communication skills.


Preferred Skills:


• Familiarity with CI/CD pipelines.

• Knowledge of cloud platforms (AWS, Azure, GCP).

• Understanding of network protocols and security.


Educational Qualifications:


• Bachelor's or Master’s degree in Computer Science, Information Technology, or a related field.


Why Miko?


Cutting-Edge Technology: Work with the latest in AI, robotics, and software development.

Dynamic Work Environment: Collaborative and inclusive culture encouraging creativity and innovation.

Career Growth: Opportunities for continuous learning, mentorship, and professional advancement.

Impactful Work: Contribute to products that enhance the learning and play experiences of children worldwide.

Global Reach: Be part of a brand that has a significant international presence.

Innovative Products: Develop revolutionary products like the Miko robot.

Supportive Culture: Enjoy a diverse, inclusive, and well-balanced work-life environment.

Competitive Compensation: Receive competitive salaries and benefits packages.

Entrepreneurial Spirit: Bring your ideas to life in a company that values initiative.

Community Engagement: Participate in outreach programs and initiatives that give back to the community.

Read more
makeO
at makeO
1 recruiter
chris Francis
Posted by chris Francis
Chennai, Bengaluru (Bangalore)
2 - 4 yrs
₹2L - ₹4.5L / yr
Operations management
Supply Chain Management (SCM)
Stakeholder management

• Responsible for leading and overseeing all operations in the company with Ownership

• Understand the entire Logistics process flow and drive the Operations team to achieve

maximum efficiency.

• Assisting in recruitment of Operations & Supply teams along with the support from HR

team

• Distribution of sales targets amongst the team members to ensure that the monthly

targets are achieved.

• Coordination with the different stakeholders and teams for smooth operations

• Updating the management team with progress, challenges, and developments on a

periodic basis.

Read more
Carpathy
at Carpathy
1 recruiter
Himani Bhalla
Posted by Himani Bhalla
NCR (Delhi | Gurgaon | Noida)
0 - 2 yrs
₹1L - ₹2L / yr
Sales
Field Sales
Telesales
Carpathy is a network of standardized automobile service centers in India with an aim to provide quality car repair and maintenance services at affordable prices. The platform provides handcrafted service packages designed to fulfill all your car's service requirements. We currently offer free pick-up & drop, walk-in, and doorstep services for more than 350 car models including luxury and premium cars across India.About the JobDay-to-day responsibilities include:1. Understand the products offered by the company2. Pitch company products to customers3. Respond to customer queries related to products4. Solve customer's doubt about products offered by the company5. Assist the team to better understand customer needs and serve them likewise6. Help regional and zonal managers to identify new opportunities related to products and services offered by the company
Read more
SwapsTech Software Solutions Pvt. Ltd.
Vikas Mane
Posted by Vikas Mane
Pune
4 - 8 yrs
₹5L - ₹10L / yr
skill iconJava
skill iconjQuery
skill iconAngularJS (1.x)
J2EE
Spring
+1 more
Founded by computer engineers, SwapsTech does one thing really well – that's engineering – solving complex problems at the Financial institutions with simple and easy to use technology solutions. SwapsTech is ISO 27001 certified, employee owned organization, with offices in Charlotte, North Carolina and Pune, India. Our products include Foreign Exchange trading system supporting global payments, Export/Import Trade Finance system, Loan and Collateral Management System. Our clients include multi-billion dollar banks and money service businesses in USA. SwapsTech is expanding its global team to support the growing client base, and have immediate openings in our Pune, India location.
Product Developer Competencies required: 1.5+ Years of Software Development Experience. 2.Deep knowledge in either one of the following set a)Core Java, Multi Threading, Spring, Security, JVM Troubleshooting, Build Automation, Scripting. b)Spring MVC, Multi Threading,JSP, Servlets, AJAX, HTML5,JQuery, Angular JS, JavaFX, Web Security. 3.Having knowledge or experience about below is plus a)SOAP, Restful Webservices, NoSQL, Messaging System, Distributed In-Memory DataGrid , ExtJS, JavaFX 4.Able to adopt and understand new technologies and utilize them efficiently 5.Passionate about code quality and readability 6.Basic experience and knowledge of UNIX 7.Excellent communication skills - essential to effective collaboration within the team and our clients across the globe. 8.Computer Science Degree or Technical equivalent, MS a plus
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos