Cutshort logo
Product and Service based company logo
Data Engineer
Product and Service based company
Data Engineer
Product and Service based company's logo

Data Engineer

at Product and Service based company

Agency job
4 - 8 yrs
₹15L - ₹30L / yr
Hyderabad, Ahmedabad
Skills
skill iconAmazon Web Services (AWS)
Apache
Snow flake schema
skill iconPython
Spark
Apache Hive
skill iconPostgreSQL
Cassandra
ETL
skill iconJava
skill iconScala
skill iconC#
HDFS
yarn
CI/CD
skill iconJenkins
JIRA
Apache Kafka

Job Description

 

Mandatory Requirements 

  • Experience in AWS Glue

  • Experience in Apache Parquet 

  • Proficient in AWS S3 and data lake 

  • Knowledge of Snowflake

  • Understanding of file-based ingestion best practices.

  • Scripting language - Python & pyspark

CORE RESPONSIBILITIES

  • Create and manage cloud resources in AWS 

  • Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies 

  • Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform 

  • Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations 

  • Develop an infrastructure to collect, transform, combine and publish/distribute customer data.

  • Define process improvement opportunities to optimize data collection, insights and displays.

  • Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible 

  • Identify and interpret trends and patterns from complex data sets 

  • Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders. 

  • Key participant in regular Scrum ceremonies with the agile teams  

  • Proficient at developing queries, writing reports and presenting findings 

  • Mentor junior members and bring best industry practices.

 

QUALIFICATIONS

  • 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales) 

  • Strong background in math, statistics, computer science, data science or related discipline

  • Advanced knowledge one of language: Java, Scala, Python, C# 

  • Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake  

  • Proficient with

  • Data mining/programming tools (e.g. SAS, SQL, R, Python)

  • Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)

  • Data visualization (e.g. Tableau, Looker, MicroStrategy)

  • Comfortable learning about and deploying new technologies and tools. 

  • Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines. 

  • Good written and oral communication skills and ability to present results to non-technical audiences 

  • Knowledge of business intelligence and analytical tools, technologies and techniques.

Familiarity and experience in the following is a plus: 

  • AWS certification

  • Spark Streaming 

  • Kafka Streaming / Kafka Connect 

  • ELK Stack 

  • Cassandra / MongoDB 

  • CI/CD: Jenkins, GitLab, Jira, Confluence other related tools

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Springer Capital
Andrew Rose
Posted by Andrew Rose
Remote only
0 - 0 yrs
₹5000 - ₹7000 / mo
Data Visualization
skill iconData Analytics
Microsoft BI
SQL
Microsoft Excel
+5 more

The Power BI Intern will assist the analytics team in using Microsoft Power BI to create interactive dashboards and reports. Working with actual datasets to assist well-informed business decision-making, this position provides practical exposure to data analysis, visualization, and business intelligence techniques.

Read more
With reputed company
With reputed company
Agency job
via Jobdost by Saida Pathan
Udupi, Bengaluru/Udupi, Manipal, Bengaluru (Bangalore)
4 - 8 yrs
₹5L - ₹8L / yr
ASP.NET
skill icon.NET
Web Development
Web developer
skill iconHTML/CSS
+5 more
Role Description : 
As a Senior Web Developer, you will be responsible for developing and/or designing websites for Yuva Pay. You will be working alongside a team of other developers in creating, maintaining and updating our websites. You get to work with some of the best minds in the industry at a place where opportunity lurks everywhere and in everything. You will also be collaborating with the other team members such as the Content Team as well as the Design Team to refine the website and fix the technical issues. Your ultimate goal will be to provide user information solutions by creating web pages and apps.

Responsibilities : 
Your responsibilities are as follows.
• Write well designed, testable, efficient code by using best software development practices
• Create website layout/user interface by using standard HTML/CSS practices
• Integrate data from various back-end services and databases
• Gather and refine specifications and requirements based on technical needs
• Create and maintain software documentation
• Be responsible for maintaining, expanding, and scaling our site
• Stay plugged into emerging technologies/industry trends and apply them into operations and activities
• Cooperate with web designers to match visual design intent

We are looking for individuals who are curious, excited about learning, and navigating through the uncertainties and complexities that are associated with a growing company. Some qualifications that we think would help you thrive in this role are:
• Minimum 4 Years of experience in web programming
• Top-notch programming skills and in-depth knowledge of modern HTML/CSS
• Familiarity with at least one of the following programming languages: ASP.NET Core (C#), JavaScript or PHP
• A solid understanding of how web applications work including security, session management, and best development practices
• Adequate knowledge of relational database systems, Object Oriented Programming and web application development
• Hands-on experience with network diagnostics, network analytics tools
• Basic knowledge of Search Engine Optimization process
• Strong organizational skills to juggle multiple tasks within the constraints of timelines and budgets with business acumen
• Ability to work and thrive in a fast-paced environment, learn rapidly and master diverse web technologies and techniques.
• Bachelor/Masters of CS/IT Engineering, BCA/MCA, B Sc/M Sc in CS/IT.

Preferred Qualifications
• Exceptional working knowledge of various website development techniques.
• Exceptional understanding of UI Prototyping tools.
• Great interpersonal skills.
• Exceptional oral and written communication skills.
• Strong organizational skills.
• Ability to manage and handle multiple tasks.
• Outstanding problem-solving skills.
• A keen eye on details.
• Exceptional time management abilities.
Read more
Hestiya
Sharukh Alve
Posted by Sharukh Alve
alt.f coworking sector 58 noida
3 - 5 yrs
₹3L - ₹7L / yr
skill iconReact.js
skill iconPython
skill iconJavascript
Blockchain
skill iconDjango
+2 more


The ideal candidate will work on developing carbon-credit–based workflows, dashboards, and user platforms, while owning end-to-end product development — including frontend, backend, API integrations, data pipelines, and scalable system architecture.What We’re Looking For


Frontend:


React.js / Next.js, Angular


JavaScript / TypeScript


Web3 integrations (preferred)


Backend:


Node.js, Python, Django, Ruby

If you are passionate about creating meaningful impact in the Climate Tech space and want to be part of a fast-growing, innovative team, we’d love to hear from you.


Read more
Pitchline
Jeevanth R
Posted by Jeevanth R
Remote only
0 - 1 yrs
₹20000 - ₹30000 / mo
skill iconPython
skill iconDjango
skill iconReact.js
skill iconPostgreSQL
SQLAlchemy
+2 more

Full Stack Developer Internship – (Remote)

Pay: ₹20,000 - ₹30,000/month | Duration: 3 months


We’re building Pitchline - a voice based conversational sales AI agent, an ambitious AI-powered web app aimed at solving meaningful problems in the B2B space. It’s currently in MVP stage and has strong early demand. I’m looking for a hands-on an Full Stack Developer Intern who can work closely with me to bring this to life.

You’ll be one of the first people to touch the codebase — shaping the foundation and solving problems across AI integration, backend APIs, and a bit of frontend work.


What you'll be doing

  • Build and maintain backend APIs (Python)
  • Integrate AI models (OpenAI, LangChain, Pinecone/Weaviate etc.) for core workflows
  • Design DB schemas and manage basic infra (Postgres)
  • Support frontend development (basic UI integration in React or similar)
  • Rapidly iterate on product ideas and ship working features
  • Collaborate closely with me (Founder) to shape the MVP


What we're looking for

  • Curiosity to learn new things. You don’t wait for someone to unblock you and take full ownership and get things done by yourself.
  • Strong foundation in backend development
  • Experience working with APIs, databases, and deploying backend services
  • Curious about or experienced in AI/LLM tools like OpenAI APIs, LangChain, vector databases, etc.
  • Comfortable working with version control and basic dev workflows
  • Worked on real projects or shipped anything end-to-end (Even if it is a personal project)


Why join us?

You’ll be a core member of the team. What we’re building is one of a kind and being a part of the successful founding team will fast track your personal and professional growth.

You’ll work on a real product with potential, witnessing in real time the impact your hard work brings.

You’ll get ownership and be part of early decisions.

You'll learn how design, tech, and business come together in early-stage product building

Flexible working hours

Opportunity to convert to full-time upon successful conversion.


We’re a fast paced team, working hard to deploy the MVP as soon as possible. If you're excited about AI, startup building, and getting your hands dirty with real development then our company is a great place to grow.

Read more
Recro
at Recro
1 video
32 recruiters
Sreha Prasad
Posted by Sreha Prasad
Bengaluru (Bangalore)
2.5 - 6 yrs
Best in industry
skill iconNodeJS (Node.js)
skill iconMongoDB
Mongoose
skill iconExpress


  • Rewrite existing APIs in NodeJS. 
  • Remodel the APIs into Micro services-based architecture. 
  • Implement a caching layer wherever possible. 
  • Optimize the API for high performance and scalability. 
  • Write unit tests for API Testing.
  • Automate the code testing and deployment process.


Skills Required: 

  • At least 2 years of experience developing Backends using NodeJS — should be well versed with its asynchronous nature & event loop, and know its quirks and workarounds. 
  • Excellent hands-on experience using MySQL or any other SQL Database. 
  • Good knowledge of MongoDB or any other NoSQL Database. 
  • Good knowledge of Redis, its data types, and their use cases. 
  • Experience with graph-based databases like GraphQL and Neo4j. 
  • Experience developing and deploying REST APIs. 
  • Good knowledge of Unit Testing and available Test Frameworks. 
  • Good understanding of advanced JS libraries and frameworks. 
  • Experience with Web sockets, Service Workers, and Web Push Notifications. 
  • Familiar with NodeJS profiling tools. 
  • Proficient understanding of code versioning tools such as Git. 
  • Good knowledge of creating and maintaining DevOps infrastructure on cloud platforms. 
  • Should be a fast learner and a go-getter — without any fear of trying out new things Preferences. 
  • Experience building a large scale social or location-based app.


Read more
Bengaluru (Bangalore)
3 - 8 yrs
₹20L - ₹30L / yr
skill iconPython
skill iconDjango
skill iconFlask
skill iconAmazon Web Services (AWS)

Roles & Responsibilities

- Writing good quality code.

- Be able to design ,implement and deploy scalable backend applications on cloud(AWS/Azure).

- Be able to take ownership of projects and deliver them on time.

- Be able to lead a team and mentor junior developers.

 

Qualifications:

- BE/BTech degree in CS/IT or similar related field.

- 4+ years experience as backend engineer.

- Good knowledge in Python and at least one of the framework - Django, Flask, FastAPI, etc.

- Hands on experience in building microservices applications on AWS/GCP/Azure.

- Good understanding of platforms(Docker, AWS/Azure).

- Must have good understanding of Data Structures/Algorithms/Databases and other CS concepts.

- Experience working in multiple databases and data modelling.

- Experience writing APIs and related technologies like REST, JSON, websockets, grpc etc.

- Should be inquisitive enough picking up any language and frameworks based on need.

- Should be able to design/implement/deploy end-to-end systems.

- Having good knowledge on deploying cloud applications and with Dockers/Kubernetes is a plus.

- Experience building end-to-end analytics systems is a plus.

Read more
Dalet
at Dalet
1 recruiter
SOWRAV Kumar
Posted by SOWRAV Kumar
Chennai
4 - 10 yrs
₹5L - ₹15L / yr
RESTful APIs
skill iconJava
Software Testing (QA)
Test Automation (QA)
Appium
+8 more
Senior Software Developer in Test (SDET) – Java
We are looking for a Senior Software Developer in Test (SDET) to join the Flex Media Platform
engineering QA team to develop and maintain a test automation platform that enables Dalet to
deliver complex software rapidly without compromising quality.
Dalet empowers media-rich organizations to transform their production and distribution workflows
– accelerating media operations, maximizing collaboration and creating higher value from content.
As a leading media technology and service provider with over three decades of innovation, our
software solutions enable greater control, enhanced visibility and increased productivity for content
professionals and storytellers around the globe.
Leading organizations such as Fox Networks Group, Arsenal Football Club, MediaCorp, Audi, and the
BBC trust Dalet to support their daily content operations. Our team is driven by a passion for media
and committed to empowering a world where compelling stories are beautifully made, effortlessly
told, and thoughtfully delivered.
Roles and responsibilities
• Engage with product owners and engineers, understand product design objectives and
features being delivered to develop and execute test plans.
• Develop and maintain automated test suites which are executed by CI/CD pipelines to verify
the functionality of service and platform features.
• Develop comprehensive multi component and system wide automated regressions tests
suites that assure quality prior to product releases.
• Develop load and performance test suites to verify non-functional requirements are met and
maintained.
• Participate in Agile development ceremonies including sprint planning and sprint
retrospectives.
• Investigate issues raised by customer and help support and operations teams to resolve
issues.
• Research and investigate new test tools and methodologies to maintain state of the art testing
practices and processes.
What you will bring
• A Bachelor's degree in computer science, computer engineering, or a related field.
• At least 5 years of software QA experience with a strong emphasis on automation.
• Strong experience of coding and programming skills in Java / Node JS.
• Expertise in building Test Automation Frameworks using Cucumber, Selenium, TestNG/Junit
or API / Webservices, Mocha or Jest, Maven and ANT build tools.
• Experience in API Test Automation using Rest Assured, JSON and Postman.
• Experience in developing web frontend test automation using Selenium or similar.
• Experience working with Jenkins or similar CI/CD platforms.
• Exposure to Behaviour Driven development.
• The ability to recognise risk and errors in software systems.
• A passion for testing, development, and design.
• Experience with Performance Engineering using tools like JMeter is a Plus.

Building QA Excellence India | QA Manager
Read more
A Reputed Consulting Frm
A Reputed Consulting Frm
Agency job
via 2COMS by Rafikhunnisa Shaik
Gurugram, Bengaluru (Bangalore), Mumbai
1 - 8 yrs
₹5L - ₹12L / yr
skill iconData Analytics
Data Visualization
PowerBI
Tableau
Qlikview
+3 more

Job Role : Audit Analytics – Need from Non Banking domain

Job Location : Gurgaon / Mumbai / B’lore


  • Understanding of business processes and potential risk scenarios.
  • Ability to conceptualize appropriate logic for analyzing potential risk scenarios
  • Ability to understand requirements clearly and to be flexible in learning new data sources and technologies, meeting tight deadlines, and delivering quality reports for auditors.
  • Maintain strong client focus by building positive relationships with clients, scheduling, conducting and presenting on key client meetings.
  • Should be able to write/optimize complex scripts in the technology of expertise. Should be able to review results and identify false positives basis business understanding
  • Should be a self-starter and eager to tackle business problem using experience and skills
  • Play a key role in the development of less expert staff through mentoring, training and advising.
  • 30% Travel in India and Overseas, if required
  • Excellent communication skills and willingness to stretch and multi-task
  • May be assigned on a project on a long term basis.
  • Responsibilities include managing projects involving audit analytics and continuous control monitoring.
    • Understanding of business process (Accounts Payable, Revenue, Fixed Asset, Inventory, MJEs) from analytics requirements
    • Understanding of ERPs (SAP\ JDE\ Oracle\ Concur etc.) – Techno Functional side (Tables and Reports)

 

Qualifications

Minimum qualifications

  • Preferred Post Graduates– MCom\ MSc (IT)\ MBA (IT)\ BE
  • Years of experience in related field of Audit\ Business \ Financial analytics (Non-banking).
  • Working knowledge of analytical / BI tools
  • ACL, SQL / R / Python, Alteryx – Should have any 2 or more
  • VBA, Power BI / Tableau / QlikView
  • GRC Solutions, AWS/Azure cloud based analytical solutionsGood to have
  • Have worked on data analytics support work either as tool implementation, automation of control or MIS development
Read more
SarvaGram
at SarvaGram
1 recruiter
Suraj Mundada
Posted by Suraj Mundada
Pune
1 - 6 yrs
₹6L - ₹30L / yr
skill iconSpring Boot
Spring MVC
Spring
skill iconJava
J2EE
+2 more
Responsibilities -
1. Be hands-on and ship good quality code Fast
2. Understand business and product requirements and brainstorm the technology solutions
3. Take responsibility for the individual modules development, maintenance, deployment
4. Understand existing code, maintain and improve it.

Qualifications -
1. 1+ years of Hands on experience in Core Java,Spring Boot, Spring MVC, Hibernate, Play etc
2. Hands on experience in SQL and NoSQL databases like Postgres, MongoDB, ElasticSearch, Redis
3. Knowledge of software development models like RAD and Agile
4. Quick Learner
Read more
Oxxus Technologies Pvt Ltd
Kartik Menon
Posted by Kartik Menon
Navi Mumbai
2 - 6 yrs
₹2L - ₹7L / yr
skill iconDjango
RESTful APIs
skill iconPostgreSQL
skill iconPostman
We are a Uniserved is at heart a curated marketplace, where we provide our customers (Small and medium-sized System Integrators and Hardware Distributors) with validated skilled resources in various technologies like Enterprise Telephone, Information Security, Cloud Applications etc. We also provide our freelance partners (Small companies and freelancers with the above-mentioned skills) with access to the infrastructure and credibility of an established setup Job Description We are looking for a Django developer to join the team developing the Uniserved ISM (infrastructure Services Management) product. We are looking for someone who has the following technical skills: - 2-3 years experience in Python Development. - 2-3 years experience in Django Web Services (REST) implementation. - Experience with Postgresql - Should be comfortable on Git and have used it regularly Good to Have skills: - Familiar with Linux working environment. - Familiarity with nginx,gunicorn. - Ability to work on projects with the Agile Team. - Experience in using AWS(Amazon Web Services) with at least one service/product. We are looking for the following non-negotiable personality traits: - Dedication to completing the task on hand - Ability to solve problems and more importantly when to ask for help We have a fun working environment, with a startup vibe, even though we are a four year old company. We can promise you continual challenges and an excellent opportunity for growth. Will explain in greater detail during the interview.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos