Cutshort logo
Picture the future logo
Data Engineer
Picture the future
Data Engineer
Picture the future's logo

Data Engineer

at Picture the future

Agency job
4 - 7 yrs
₹5L - ₹15L / yr
Hyderabad
Skills
PySpark
Data engineering
Big Data
Hadoop
Spark
skill iconAmazon Web Services (AWS)
Apache
Snow flake schema
skill iconPython
Relational Database (RDBMS)
RESTful APIs
skill iconC#

CORE RESPONSIBILITIES

  • Create and manage cloud resources in AWS 
  • Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies 
  • Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform 
  • Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations 
  • Develop an infrastructure to collect, transform, combine and publish/distribute customer data.
  • Define process improvement opportunities to optimize data collection, insights and displays.
  • Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible 
  • Identify and interpret trends and patterns from complex data sets 
  • Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders. 
  • Key participant in regular Scrum ceremonies with the agile teams  
  • Proficient at developing queries, writing reports and presenting findings 
  • Mentor junior members and bring best industry practices 

 

QUALIFICATIONS

  • 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales) 
  • Strong background in math, statistics, computer science, data science or related discipline
  • Advanced knowledge one of language: Java, Scala, Python, C# 
  • Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake  
  • Proficient with
  • Data mining/programming tools (e.g. SAS, SQL, R, Python)
  • Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
  • Data visualization (e.g. Tableau, Looker, MicroStrategy)
  • Comfortable learning about and deploying new technologies and tools. 
  • Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines. 
  • Good written and oral communication skills and ability to present results to non-technical audiences 
  • Knowledge of business intelligence and analytical tools, technologies and techniques.


Mandatory Requirements 

  • Experience in AWS Glue
  • Experience in Apache Parquet 
  • Proficient in AWS S3 and data lake 
  • Knowledge of Snowflake
  • Understanding of file-based ingestion best practices.
  • Scripting language - Python & pyspark

 

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

NeoGenCode Technologies Pvt Ltd
Gurugram
3 - 6 yrs
₹4L - ₹9L / yr
skill iconPython
skill iconDjango
RabbitMQ
skill iconRedis
Celery
+3 more

Job Title : Python Developer (Immediate Joiner)

Experience Required : 3+ Years

Employment Type : Full-time

Location : Gurugram, India (Onsite)

Working Days : 6 Days (5 Days WFO + 1 Day WFH)


Job Summary :

We are seeking a talented and experienced Python Developer with a strong background in Django and a proven ability to build scalable, secure, and high-performance web applications. The ideal candidate will have hands-on experience with RabbitMQ, Redis, Celery, and PostgreSQL, and will play a key role in developing and maintaining robust backend systems. This is an onsite opportunity for immediate joiners.


Mandatory Skills : Python, Django, RabbitMQ, Redis, Celery, PostgreSQL, RESTful APIs, Docker.


Key Responsibilities :

  • Design, develop, and maintain Django-based web applications and APIs.
  • Implement asynchronous task handling using RabbitMQ and Celery.
  • Optimize application performance using Redis for caching and session storage.
  • Manage database operations, including schema design and query optimization, using PostgreSQL.
  • Collaborate with front-end developers, DevOps teams, and stakeholders to deliver full-featured solutions.
  • Write clean, modular, and well-documented code aligned with industry best practices.
  • Troubleshoot, debug, and resolve issues across the application stack.
  • Participate in architecture discussions, code reviews, and sprint planning.
  • Ensure the scalability, performance, and security of backend services.

Required Technical Skills :

  • Minimum 3 Years of experience in Python development.
  • Strong hands-on experience with the Django framework.
  • Proficiency in RabbitMQ for message brokering.
  • Practical experience with Redis for caching and session management.
  • Experience using Celery for background job/task queue management.
  • Solid knowledge of PostgreSQL (database design, indexing, and optimization).
  • Understanding of RESTful API development and integration.
  • Familiarity with Docker and containerization.

Preferred Skills :

  • Exposure to CI/CD tools and pipelines.
  • Experience working with cloud platforms such as AWS or GCP.
  • Knowledge of Django ORM optimization techniques.
  • Basic familiarity with front-end technologies like HTML, CSS, and JavaScript.

Soft Skills :

  • Strong analytical and problem-solving capabilities.
  • Effective communication and interpersonal skills.
  • Ability to thrive in an agile, fast-paced development environment.
Read more
Ekloud INC
ashwini rathod
Posted by ashwini rathod
Remote only
5 - 20 yrs
₹3L - ₹30L / yr
Workday
workday developer
raas
SOAP
core connectors
+4 more

Workday Developer


Total Experience: 5+ Years

Location: Remote


Job Responsibilities & Requirements:

Design, develop, test, and deploy Inbound and Outbound Integrations using RaaS, SOAP, Core Connectors, EIB, and Workday Studio.


Experience with Orchestration/Extend is an added advantage.

Develop and maintain custom Workday reports.

Provide support and troubleshooting for integration issues and ensure resolution using best practices along with strong documentation.

Good understanding of Workday Security concepts (preferred).


Experience working with core modules such as HCM, Payroll, Time Tracking, Absence, and Benefits.

Experience working in an Agile work management environment.

Workday Certification is a plus.

Functional experience in Workday modules is an added advantage.


Experience with ATS tools such as Greenhouse and related integrations/automations is a strong plus.

Ability to collaborate effectively with teams across different time zones.


Skills set Required :

 1 . Workday Integration Development

 2 . Workday Integration Tools (RaaS, EIB, Core Connectors, SOAP, Workday Studio)

3 . Advanced Workday Reporting & Calculated Fields

4. Integration Troubleshooting & Production Support

5 . Workday HCM Functional Understanding

6 . Data Management & Data Accuracy

7 . Technical Documentation

8 .Agile Development Practices

9. Stakeholder & Cross-Team Collaboration

10 .Workday Integration Architecture (Inbound/Outbound)

11. Integration Monitoring & Error Handling

12. EIB / Core Connector Configuration

Read more
Gurugram
7 - 15 yrs
₹12L - ₹40L / yr
DevOps
Devops Architect
skill iconMongoDB
AWS Solution Architect
CI/CD

Job Title: AWS Devops Engineer – Manager Business solutions

Location: Gurgaon, India

Experience Required: 8-12 years

Industry: IT


 

We are looking for a seasoned AWS DevOps Engineer with robust experience in AWS middleware services and MongoDB Cloud Infrastructure Management. The role involves designing, deploying, and maintaining secure, scalable, and high-availability infrastructure, along with developing efficient CI/CD pipelines and automating operational processes.

 

Key Deliverables (Essential functions & Responsibilities of the Job):

 

·         Design, deploy, and manage AWS infrastructure, with a focus on middleware services such as API Gateway, Lambda, SQS, SNS, ECS, and EKS.

·         Administer and optimize MongoDB Atlas or equivalent cloud-based MongoDB solutions for high availability, security, and performance.

·         Develop, manage, and enhance CI/CD pipelines using tools like AWS CodePipeline, Jenkins, GitHub Actions, GitLab CI/CD, or Bitbucket Pipelines.

·         Automate infrastructure provisioning using Terraform, AWS CloudFormation, or AWS CDK.

·         Implement monitoring and logging solutions using CloudWatch, Prometheus, Grafana, or the ELK Stack.

·         Enforce cloud security best practices — IAM, VPC setups, encryption, certificate management, and compliance controls.

·         Work closely with development teams to improve application reliability, scalability, and performance.

·         Manage containerized environments using Docker, Kubernetes (EKS), or AWS ECS.

·         Perform MongoDB administration tasks such as backups, performance tuning, indexing, and sharding.

·         Participate in on-call rotations to ensure 24/7 infrastructure availability and quick incident resolution.

 

Knowledge Skills and Abilities:

·         7+ years of hands-on AWS DevOps experience, especially with middleware services.

·         Strong expertise in MongoDB Atlas or other cloud MongoDB services.

·         Proficiency in Infrastructure as Code (IaC) tools like Terraform, CloudFormation, or AWS CDK.

·         Solid experience with CI/CD tools: Jenkins, CodePipeline, GitHub Actions, GitLab, Bitbucket, etc.

·         Excellent scripting skills in Python, Bash, or PowerShell.

·         Experience in containerization and orchestration: Docker, EKS, ECS.

·         Familiarity with monitoring tools like CloudWatch, ELK, Prometheus, Grafana.

·         Strong understanding of AWS networking and security: IAM, VPC, KMS, Security Groups.

·         Ability to solve complex problems and thrive in a fast-paced environment.

 

Preferred Qualifications

·         AWS Certified DevOps Engineer – Professional or AWS Solutions Architect – Associate/Professional.

·         MongoDB Certified DBA or Developer.

·         Experience with serverless services like AWS Lambda, Step Functions.

·         Exposure to multi-cloud or hybrid cloud environments.




Mail updated resume with current ctc-

Email: etalenthire[at]gmail[dot]com

Satish; 88 O2 74 97 43


Read more
KGISL MICROCOLLEGE
Agency job
via EWU by Pavasshrie Muruganandham
Coimbatore
5 - 8 yrs
₹5L - ₹8L / yr
Employee Engagement
Strategic thinking
Business acumen
Change Management
Effective communication

The HR Business Partner (HRBP) acts as a strategic partner to business units, aligning HR strategies with business objectives. The HRBP will work closely with leadership and employees to improve work relationships, build morale, and increase productivity and retention. This role involves supporting and implementing HR initiatives including performance management, organizational development, change management, and workforce planning.

Read more
Mumbai
10 - 15 yrs
₹14L - ₹20L / yr
Manufacturing
Operations

Job Purpose

A Plant Operations Manager is responsible for directing, coordinating, and managing the overall plant operations. Assures that the plant's production objectives are achieved at the lowest cost consistent with quality requirements while maintaining compliance.

 

Roles & Responsibilities

  • Provide leadership to all aspects of the manufacturing operations.

  • Facilitate, coach, counsel, and guide the manufacturing work group to ensure they can deliver results.

  • Educate, develop, and motivate a manufacturing work group to achieve required production results.

  • Develop and implement operating policies and procedures to achieve stated goals.

  • Strive for continuous improvement in manufacturing processes to ensure efficiencies and eliminate waste, and implement such plans through people, processes, procedures, and equipment.

  • Exercise direct supervision over R&D department, general supervisors and line supervisors concerning production volume, cost, and quality of production to meet production schedules and delivery dates.

  • Meet financial objectives and goals by forecasting requirements and supporting the annual budget process.

  • Review production costs and product quality and modify production and inventory control programs to maintain and enhance the profitable operation of the plant.

  • Direct and lead all operations to achieve monthly profit results with a focus on operations throughout.

 

 

 

 

 

 

Read more
Leading Payment Solutions Company
Leading Payment Solutions Company
Agency job
Chennai
3 - 8 yrs
₹4L - ₹14L / yr
Shell Scripting
Selenium
Appium
Test Automation (QA)
Software Testing (QA)
Greetings!!
 
We are looking for a Automation tester(Unix shell scripting) for one our premium clients in Chennai.
 
Experience:3-8 years(Automation with UNIX Shell Scripting)


Requirment:

  • Proven industrial experience in software
  • Excellent communication skill
  • Excellent on Unix and Shell Scripting, Vi Editor (also Python)
  • Development for any Test Automation with C++
  • Development experience in Test Automation with shell scripting
  • Should have good analysis skills, good comprehension and abstraction capability
  • Experience / expertise in Docker
  • Good experience working on Databases Oracle/MySQL: SQL Queries, Joins, Views etc.
  • Good understanding of C++ skills: STL, String Operations, Design Patterns, OOPS concepts
  • Know-how of Eclipse
  • CI (Continuous Integration), Jenkins, GIT
  • Working experience with Agile methodology, JIRA
Read more
A fast-growing SaaS commerce company WFH & WFO
A fast-growing SaaS commerce company WFH & WFO
Agency job
via Jobdost by Mamatha A
Remote, Bengaluru (Bangalore)
4 - 8 yrs
₹20L - ₹30L / yr
skill iconReact.js
skill iconAngularJS (1.x)
skill iconNodeJS (Node.js)
MySQL
NOSQL Databases
+4 more

What is the role?

You will be responsible for architecting and developing features on the application end to end. You will be working closely with the Product Managers and the Technical architect to come up with high-quality, resilient, and highly performant applications.

Key Responsibilities

  • Design and develop SaaS-based applications based on microservices architecture.
  • Work on the core backend and ensure it meets the performance benchmarks.
  • Work on the front end with ReactJS.
  • Design and develop APIs for the frontend to consume.
  • Constantly improve the application architecture by clearing the technical backlog.
  • Meet both technical and consumer needs.
  • Stay abreast of developments in web applications and programming languages.

What are we looking for?

An enthusiastic individual with the following skills. Please do not hesitate to apply if you do not match all of it. We are open to promising candidates who are passionate about their work and are team players.

  • Education - BE/MCA or equivalent.
  • Overall 4+ years of experience.
  • Agnostic/Polyglot with multiple tech stacks.
  • Worked on open source technologies – NodeJS, ReactJS, MySQL, NoSQL, MongoDB, DynamoDB.
  • Good experience with Front-end technologies like JavaScript frameworks, ReactJS, AngularJS.
  • Backend exposure – good knowledge of building API.
  • Worked on serverless technologies.
  • Efficient in building microservices to combine server and frontend.
  • Knowledge of cloud architecture.
  • Should have working experience with relational and columnar DB.
  • Should be innovative and communicative in your approach.
  • Were responsible for the functional/technical track of a project.

Who will you work with?

You will closely work with the Engineering team and support the Product Team of Empuls.

What can you look for?

A wholesome opportunity in a fast-paced environment that will enable you to juggle between concepts, yet maintain the quality of content, interact and share your ideas and have loads of learning while at work. Work with a team of highly talented young professionals and enjoy the comprehensive benefits.

We are

A fast-growing SaaS commerce company based in Bangalore with offices in Delhi, Mumbai, SF, Dubai, Singapore, and Dublin. We have three products in our portfolio: Plum, Empuls and Compass. Works with over 1000 global clients. We help our clients in engaging and motivating their employees, sales teams, channel partners and consumers for better business results.

Read more
A fast-growing SaaS commerce company permanent WFH & Office
A fast-growing SaaS commerce company permanent WFH & Office
Agency job
via Jobdost by Mamatha A
Remote only
5 - 10 yrs
₹60L - ₹80L / yr
Sales
Business Development
Sales management
Compensation & Benefits
Analytical Skills
+6 more
Sales Manager (USA)
Job Description
● Solicits and maintains network of prospects
● Sells products and/or services and develops new account relationships
● Initiates contact with prospective customers to sell targeted products
● Demonstrates and showcases capabilities of the products/platforms
● Works as a member of a sales team to sell assigned products or services to identified
key accounts
● Demonstrates product knowledge including various solutions, markets and competitive
intelligence
● Prepares and presents proposals to clients utilizing company resources and tools.
● Negotiates, structures and closes "deals" that meet customer expectations and
company ability to deliver; utilizes appropriate company resources per the resources
plan to provide product marketing support or specialized product sales expertise
● Assists in the development of sales plans and strategies.
● Meets sales goals and objectives.
● Other related duties assigned as needed
Education requirement
● Bachelor's degree or the equivalent combination of education, training, or work
experience
General knowledge, skills & abilities
● Good experience and understanding of rewards, incentives and gift card industry
● General knowledge of Human Capital Management, Compensation and Benefits
platforms including systems and applications
● Requires expert negotiation and communication skills, both written and verbal
● Requires solid decision-making and problem solving skills
● Analytical skills are required to determine client business needs and requirements
● Ability to remain calm under various levels of pressure
● Ability to show established track record of involvement in industry trade groups preferred
● Requires the ability to establish and maintain effective working relationships with all
levels of management (internally/externally), employees, clients and public
● Travel will be required
company  job level description
● 5 to 10 years field sales experience in a similar industry
● Needs to be a self-starter working with minimal supervision
● Mid-level quota carrying position with a career path to a sales leadership role
● Decisions are made within established policies and standard practices
● Learns to use professional concepts
● Applies company policies and procedures to resolve routine issues
● Is required to have good knowledge of company products and services
● May have own territory or work on a team
What can you look for?
A wholesome opportunity in a fast-paced environment that will enable you to juggle between
concepts, yet maintain the quality of content, interact and share your ideas and have loads of
learning while at work. Work with a team of highly talented young professionals and enjoy the
benefits of being at company.
We are
A fast-growing SaaS commerce company based in Bangalore with offices in Delhi, Mumbai, SF,
Dubai, Singapore, and Dublin. We have three products in our portfolio: Plum, Empuls, and
Compass.company works with over 1000 global clients. We help our clients in engaging and
motivating their employees, sales teams, channel partners, or consumers for better business
results.
Way forward
We look forward to connecting with you. As you may take time to review this opportunity, we will
wait for a reasonable time of around 3-5 days before we screen the collected applications and
start lining up job discussions with the hiring manager. We however assure you that we will
attempt to maintain a reasonable time window for successfully closing this requirement. The
candidates will be kept informed and updated on the feedback and application status
Read more
Metawing Pvt Ltd
at Metawing Pvt Ltd
1 recruiter
Ashwin Kain
Posted by Ashwin Kain
Gurugram
1 - 2 yrs
₹5L - ₹10L / yr
Blockchain
Ethereum
Hyperledger
BigchainDb
MultiChain
+1 more

Technical Experience :


- Solid understanding and experience in BlockChain Development preferred

- 1+ years of Blockchain application development experience on platforms such as Ethereum, Hyperledger, BigchainDb, and Multi-Chain.

- Experience with NodeJS

- Experience in solution building on Blockchain technology.

- Experience with development tools such as Geth, Hyperledger Fabric/Sawtooth, Composer, Solidity Remix Functional

- Basic understanding of Web application architecture and protocols.

- Any additional expertise with Python, containerization (Docker), and additional Cloud exposure is also a huge plus

- Any previous integration expertise, Strong in Agile, Banking, or Financial Service development expertise, as well as software development in a large Enterprise environment.
Read more
DutchView IT
at DutchView IT
1 recruiter
Simran Sandhu
Posted by Simran Sandhu
Bengaluru (Bangalore)
3 - 6 yrs
₹4L - ₹12L / yr
skill iconJava
Spring
skill iconKotlin
Hibernate (Java)
Microservices
+3 more

Title

Senior Java Backend Developer

 

Introduction

Are you a passionate backend developer looking for a new challenge in an international company? Do terms like spring-boot, Redis, Amazon EC2, REST-API and document based databases like MongoDB make you smile and would you like to work in an international company that values your personal growth? We are expanding in India and are looking for an enthusiastic and experienced Java Developer to join the team.

 

Your new job

Together with the team, you will be responsible for the development and migration of our FlexWhere application from a PHP based application to a java application. You report to the Manager Development & Support and collaborate with our Dutch IT Team, who work from our headquarters in the Netherlands. We work with two-week sprints, in which features and improvements are tested in an alpha and beta environment, after which you will release the services in our Kubernetes cluster. Our applications are being used by thousands of customers in Europe on a daily basis. By being in close contact with our helpdesk, you know what our users struggle with and how you can improve their experience.

 

You are not afraid to take ownership and have good interpersonal skills. You believe a good user experience is the ultimate goal and you continuously discover, evaluate and implement new technologies to maximize development efficiency. All in all: you have an innovative spirit and cannot wait to get aboard into an international IT-organization!

 

What you’ll bring

  • A degree in Engineering (B.Tech or BE);
  • Minimum of 3-year work experience as a Java developer in Java and/or Kotlin, Groovy;
  • Proficient understanding of code versioning tools (Git);
  • Experience with third-party API’s and third-party libraries like MongoDB, Redis, MySQL, ElasticSearch;
  • Familiar with automation testing tools;
  • Knowledge about scaling architectures in the cloud like EC2.

 

What you’ll get

  • Competitive salary;
  • Place within a company that is committed to diversity and inclusion;
  • Excellent career progression opportunity within an international organization;
  • The chance to discover the land of tulips and windmills!

 

Where you’ll work

We are Dutchview. An innovative IT company based in the Netherlands with offices in Germany, the United Kingdom and India. Our solutions make it possible for organisations to work smartly and effectively. So that they can focus all their energy on what they do best. It is precisely this freedom that leads to greater job satisfaction: the basis for better results. We make it easy for you.

Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos