Cutshort logo
Cloudesign Technology Solutions logo
Python ETL Developer(Data Engineer)
Python ETL Developer(Data Engineer)
Cloudesign Technology Solutions's logo

Python ETL Developer(Data Engineer)

Anshul Saxena's profile picture
Posted by Anshul Saxena
5 - 13 yrs
₹15L - ₹28L / yr
Remote only
Skills
skill iconData Analytics
Data Visualization
PowerBI
Tableau
Qlikview
Spotfire
skill iconPython
ETL
Data engineering
Apache Synapse
SQL Azure
databricks
PySpark

Job Description: Data Engineer

Location: Remote

Experience Required: 6 to 12 years in Data Engineering

Employment Type: [Full-time]

Notice: Looking for candidates, Who can join immediately or 15days Max

 

About the Role:

We are looking for a highly skilled Data Engineer with extensive experience in Python, Databricks, and Azure services. The ideal candidate will have a strong background in building and optimizing ETL processes, managing large-scale data infrastructures, and implementing data transformation and modeling tasks.

 

Key Responsibilities:

ETL Development:

Use Python as an ETL tool to read data from various sources, perform data type transformations, handle errors, implement logging mechanisms, and load data into Databricks-managed delta tables.

Develop robust data pipelines to support analytics and reporting needs.

Data Transformation & Optimization:

Perform data transformations and evaluations within Databricks.

Work on optimizing data workflows for performance and scalability.

Azure Expertise:

Implement and manage Azure services, including Azure SQL Database, Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake.

Coding & Development:

Utilize Python for complex tasks involving classes, objects, methods, dictionaries, loops, packages, wheel files, and database connectivity.

Write scalable and maintainable code to manage streaming and batch data processing.

Cloud & Infrastructure Management:

Leverage Spark, Scala, and cloud-based solutions to design and maintain large-scale data infrastructures.

Work with cloud data warehouses, data lakes, and storage formats.

Project Leadership:

Lead data engineering projects and collaborate with cross-functional teams to deliver solutions on time.


Required Skills & Qualifications:

Technical Proficiency:

  • Expertise in Python for ETL and data pipeline development.
  • Strong experience with Databricks and Apache Spark.
  • Proven skills in handling Azure services, including Azure SQL Database, Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake.


Experience & Knowledge:

  • Minimum 6+ years of experience in data engineering.
  • Solid understanding of data modeling, ETL processes, and optimizing data pipelines.
  • Familiarity with Unix shell scripting and scheduling tools.

Other Skills:

  • Knowledge of cloud warehouses and storage formats.
  • Experience in handling large-scale data infrastructures and streaming data.

 

Preferred Qualifications:

  • Proven experience with Spark and Scala for big data processing.
  • Prior experience in leading or mentoring data engineering teams.
  • Hands-on experience with end-to-end project lifecycle in data engineering.

 

What We Offer:

  • Opportunity to work on challenging and impactful data projects.
  • A collaborative and innovative work environment.
  • Competitive compensation and benefits.

 

How to Apply:

https://cloudesign.keka.com/careers/jobdetails/73555

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos

About Cloudesign Technology Solutions

Founded :
2014
Type :
Products & Services
Size :
20-100
Stage :
Profitable

About

Cloudesign is a Software Services and Development company in Mumbai, Delhi, Bangalore focusing on Website & Mobile App Software Development
Read more

Connect with the team

Profile picture
neha mhaprolkar

Company social profiles

bloglinkedintwitterfacebook

Similar jobs

Remote, Hyderabad
0 - 2 yrs
₹1L - ₹4L / yr
skill iconAdobe Illustrator
Adobe Photoshop
Adobe Indesign
Graphic Designing
  • Overall Synopsis (Skills to focus) 
  • Brush up your skills in Photoshop & Illustrator
  • Illustrator tools - Pen tool, Gradient, Pathfinder, Blending modes, type on a path, rotate and reflect, mesh tool, selection tool, etc.
  • Photoshop tools – change the color of the background, remove a selection, pen tool etc. 
  • Make sure to revise to recreate curves, and nodes smoothly while doing vectorization.
  • Try making some logo designs, and work on the curves & texture.



This is FULL TIME WFH NIGHT SHIFT role.


The role is fully Remote but the client is conducting Drive interview at Hyderabad on 7-8 Sep


If interested kindly share your updated cv at 82008 31681

Read more
Logistic & supply chain company
Logistic & supply chain company
Agency job
via Jobdost by Sathish Kumar
Remote only
2 - 7 yrs
₹9L - ₹22L / yr
skill iconJava
skill iconPython
skill iconRuby on Rails (ROR)
AWS Lambda
skill iconKotlin
+2 more

SDE

Responsibilities

  • Software Engineering
    • Design and develop highly scalable, available, reliable, secure and fault tolerant systems with minimal guidance for a market leader in the logistics industry
    • Partner with team members on functional and nonfunctional requirements and spread design philosophy, goals and improve the code quality across the team
    • Research new technologies and tools that enable building the next generation of our services
    • Provide technology leadership to the team and foster engineering excellence
  • Product Delivery
    • Partner with product managers to define and execute on the feature roadmap
    • Translate business requirements into scalable and extensible design
    • Coordinate with various cross functional teams on planning and execution
    • Maintaining automated build / test / deployment environments

 

Qualifications

  • Software Engineering
    • Should have at least 3 years of hands-on experience in designing, developing, testing and deploying applications on Java, Ruby, Kotlin, Python, Node or Go for large scale applications
    • Deep knowledge of one of the programming languages they have experience in
    • Proficient in OOP and Design Patterns, experience with functional programming would be a plus
    • Data modelling experience in Relational Databases
    • Ability to design and implement low latency RESTful services
  • Product Delivery
    • Ability to scope, review and refine user stories for technical completeness and to alleviate dependency
    • Well versed in working with agile methodologies which includes phases such as design, development, code review, testing and release management
    • Ability to have worked in a CI/CD environment, with hands on experience with Git or any similar source code management tools
  • Product Maintenance
  • Experience troubleshooting server performance issues such as memory tuning, GC tuning, resource leaks
  • Continuously refactor applications to ensure high quality design

 

Read more
Catalyst Media Integrated LLP
Catalyst Media Integrated LLP
Agency job
via Jobdost by Sathish Kumar
Mumbai
1 - 5 yrs
₹4L - ₹15L / yr
skill iconiOS App Development
skill iconObjective C
skill iconSwift
Xcode
Model-View-View-Model (MVVM)
+1 more

Key Skills required

1. Understanding of the entire Mobile Application Development lifecycle

2. Solid experience of 2 years + in building Native Swift based iOS applications

3. Excellent knowledge of iOS specific user interfaces, user experiences and guidelines

4. Working experience with MVC and MVVM architectures

5. In depth knowledge of iOS specific user experiences and human interface guidelines

6. In depth experience in implementing user interfaces for iOS - Auto Layout

7. Hands on experience working with API integration within iOS applications

8. Hands on experience working with 3rd party SDKs, Libraries and APIs

9. Experience with media streaming & playback using AV Player, AV Foundation & AV Capture

10. Experience working with analytical SDKs like Firebase Crashlytics, Branch.io etc

11. Experience with Push Messaging, Local Notifications, Background services

12. Experience in debugging errors and crashes using tools such as Crashlytics or Sentry

13. Experience with Marketing and Attribution SDKs such as Clevertap, Branch and/or Appsflyer

14. Experience in releasing applications to the Apple App Store

15. Ability to work in an Agile environment

16. An inclination towards cross platform technologies such as React Native

Read more
Wissen Technology
at Wissen Technology
4 recruiters
Nishita Bangera
Posted by Nishita Bangera
Mumbai
7 - 10 yrs
₹20L - ₹30L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
skill iconAmazon Web Services (AWS)
+2 more

Must Have:


  • Azure Cloud experience (Kubernetes, terraform, CI/CD etc). Few cloud certifications is a big plus
  • Java
  • Spring boot
  • Microservices & System Design
  • Understanding of Kafka
  • A good learning attitude


Read more
Lyzerio
at Lyzerio
1 recruiter
Akansh Saxena
Posted by Akansh Saxena
Noida, NCR (Delhi | Gurgaon | Noida)
3 - 5 yrs
₹6L - ₹10L / yr
skill iconPython
LAMP Stack
skill iconFlask
skill iconPHP
MySQL
+2 more

Job Description:

As a Software Development Engineer at Lyzer.io you will-

 

  • Be a part of our initial core team to design and develop our platform
  • Work on building scalable backend platform for seller apps, dashboards, analytics platform, product information management platform and several cross-platform software components
  • Participate in the process to fundamentally change the food and grocery ecosystem in India, and impact billions of people through technology, mobile, and data science


An ideal candidate for this role is someone who has-

 

  • BE/BTech degree in Computer Science from a respected engineering school
  • 3-5 years of professional software development experience
  • Relevant practical experience in Python Flask development as well as LAMP Stack
  • Strong problem-solving skills and strong command on object-oriented design, data structures, algorithms and other computer science fundamentals.
  • Strong coding skills – professional experience in developing production-quality
  • Expertise in Web Services, Service-oriented architecture, Databases, MySQL, Distributed systems, Cloud
  • Extreme software engineering skills to design and develop low-latency, high availability, internet-scale web services
  • Solid understanding of the full software development life cycle and software engineering best practices
  • Ability to understand business requirements and translate them into technical requirements
  • Demonstrated ability to own software design and development end to end from requirements to launch.
  • Ability to collaborate with cross-functional teams to define, design, and ship new
  • A startup mindset – An athlete who can run at the breakneck speed of a startup, yet someone who can bring method to madness through processes suitable for different stages of the company – early-stage prototyping and rapid experimentation, before product/market fit, after product/market fit, and
  • Familiarity with Agile development, Scrums, continuous integration, and test-driven development processes
  • Data-driven product development approach – strong focus on data-backed engineering
  • Ability to develop products incrementally in fast iterations
  • Ability to do collaborative problem solving and design/build chaos resilient systems
  • Strong focus on software quality
  • Ability to mentor junior developers, and help build an excellent engineering team
  • Ability to be a talent magnet – attract great talent to join the core

 

 

We are looking for warriors who have the hunger to impact real lives and who can match our high bar on Core Values that we live by.

If you-

 

  • can apply first principles thinking to solve problems
  • can envision a great future that you want to create
  • have the fire in your belly to get out of your cube and do something about your vision and passion
  • want to work with some really smart people, and still raise the bar for all of us
  • can have fun and help your colleagues have fun doing all of the above
Read more
Looking for Multinational Client PAN India Location
Looking for Multinational Client PAN India Location
Agency job
via Natalie Consultants by Rahul Kumar
Pune, Bengaluru (Bangalore), Delhi, Gurugram, Noida, Ghaziabad, Faridabad, Chennai, Mumbai
1 - 3 yrs
₹2L - ₹10L / yr
skill iconJava
Microservices
skill iconAngular (2+)
skill iconSpring Boot
Hibernate (Java)

Roles & Responsibilities

As a member of our fast-growing engineering team, your responsibility will be to get involved in day-to-day development operations and solve complex problems of digitization to meet the demands of business.

To be successful, you must have a self-driven mindset, go getter attitude.

The responsibilities include:

  • Writing the clean quality code & Understanding functional requirements thoroughly and analyzing the requirements in the context of the product
  • Envisioning the overall solution for defined functional and non-functional requirements, and being able to define technologies, patterns and frameworks
  • Determining and implementing design methodologies and tool sets
  • Enabling application development by coordinating requirements, schedules, and activities
  • Being able to lead/support UAT and production roll outs
  • Creating, understanding and validating estimated effort for given module/task, and being able to justify it
  • Addressing issues promptly, responding positively to setbacks and challenges with a mindset of continuous improvement
  • Giving constructive feedback to the team members and setting clear expectations
  • Helping the team in troubleshooting and resolving complex bugs
  • Coming up with solutions to any issue that is raised during code/design review and being able to justify the decision taken
  • Carrying out POCs to make sure that suggested design/technologies meet the requirements
  • Carrying out DevOps activities which includes creating Jenkins pipeline

Key Skills

Should possess hands-on full life-cycle development experience (architect, design, code, test, release) be comfortable around both front-end and back-end coding languages, client/server-side development frameworks and third-party libraries.

  • Should be strong in data structures and algorithms. Solid understanding of object-oriented programming
  • Work with cutting edge technologies like Java 8, Scala, React, Akka, Docker, Puppet, and Salt
  • Hands-on knowledge of Spring core, MVC, JPA. Working knowledge of Spring Boot
  • Should have strong hands-on on one of the JavaScript frameworks: jQuery, AngularJS, ReactJS, and Vue.js.
  • Willing to working with latest Cloud and Container technologies like AWS
  • Experience with both external and embedded databases. NoSQL DB experience is good to have
  • Implementing unit testing using frameworks like JUnit, Mockito, etc.
  • Proficient understanding of code versioning tools, such as Git
  • Familiarity with Maven (Other building tools Ant and Gradle are good to have)
  • Familiarity with continuous integration
  • Good understanding of Agile practices
Read more
Cargoflash Infotech
at Cargoflash Infotech
5 recruiters
Rishabh Bhasin
Posted by Rishabh Bhasin
Remote, NCR (Delhi | Gurgaon | Noida)
2 - 4 yrs
₹7L - ₹10L / yr
User Experience (UX) Design
UX Designer
skill iconHTML/CSS
Wireframing
Prototyping
+1 more

UX Designers are responsible for the end-to-end execution of a project. You should have highly developed design skills and good communication ability. You are the right fit if you enjoy creating interfaces, love challenges, and designing digital products

Role & Responsibilities

Conduct workshops and collaborate with other designers and stakeholders to understand business needs, user needs & to achieve the goals of the project.
Create personas to understand target audiences, craft user journeys, and use cases for the product
Create design assets that showcase relationships between product features, users, and data
Create high-quality wireframes that fulfill the goals of the product in a highly efficient and simple manner
Audit designs that are already developed to identify improvements or conduct usability tests on your designs Must have Skills
Critical thinking and highly developed wireframing, presentation, and prototyping skills
Very keen attention to detail
Excellent documentation skills
Proficiency with modern design and prototyping tools like Figma
Ability to present and explain your work to others with articulate communication
Ability to plan & deliver projects on time. Expected Outcomes
High-quality wireframes, prototypes, and documents that meet the goals of the project. Continuous communication between internal teams, project managers, and stakeholders
Documentation of the screens designed for a smooth handover to visual designers and developers

 

Special Notes
Freshers are not eligible
Education criteria are not strict
A Detailed portfolio is a must in which only individual projects/work must be showcased.
The ability to create illustrations is preferred but not required.

Read more
Democratize good design for homes in India. (DC1)
Democratize good design for homes in India. (DC1)
Agency job
via Multi Recruit by Fiona RKS
Bengaluru (Bangalore)
2 - 5 yrs
₹15L - ₹18L / yr
skill iconReact.js
React.Js with Ecommerce background
  • You'll help shape the product by leading the overall design and development of the technical solution
  • Designing and developing user interfaces using React best practices,
  • Developing Front end application code and unit tests in React along with Service Layer
  • Shine with engineering excellence by developing test infrastructures, writing documentation, ensuring high performance, and following an agile development methodology
  • Optimizing components for maximum performance across a vast array of web-capable devices and browsers
  • Research on new frameworks for improving the architecture
  • Ensure development best practices are followed (Clean Code, Clean Architecture, code reviews)
  • Actively communicate with the stakeholder and team

Desired Profile of the candidate

  • Proficiency with ReactJS and its libraries
  • Good to have Node experience Proficiency with ReactJS and its libraries
  • Good to have Node experience
  • Ensuring a clear dependency chain, regarding business logic as well as the file system
  • Experience in JavaScript build tools like grunt or gulp
  • Expert in any one of the modern JavaScript MV-VM/MVC frameworks (React, JQuery, NodeJS)
  • Hand on and implements complex ReactJS applications, directives, controllers, services
  • Expertise in writing and consuming web services,
  • Good to have, knowledge in Cloud services
  • Ability to quickly script a working solution for a given problem.
  • Creative problem-solving skills.
  • A results-focused mindset.
  • Able to proactively communicate with non-technical stakeholders, manage expectations, and explain the value of addressing technical debt
  • Ensuring a clear dependency chain, regarding business logic as well as the file system
  • Experience in JavaScript build tools like grunt or gulp
  • Expert in any one of the modern JavaScript MV-VM/MVC frameworks (React, JQuery, NodeJS)
  • Hand on and implements complex ReactJS applications, directives, controllers, services
  • Expertise in writing and consuming web services,
  • Good to have, knowledge in Cloud services
  • Ability to quickly script a working solution for a given problem.
  • Creative problem-solving skills.
  • A results-focused mindset.
  • Able to proactively communicate with non-technical stakeholders, manage expectations, and explain the value of addressing technical debt.

 

Read more
Y Media Labs
at Y Media Labs
8 recruiters
Trisha Arya
Posted by Trisha Arya
Remote, Bengaluru (Bangalore)
9 - 15 yrs
₹25L - ₹42L / yr
Engineering Management
Engineering Manager
Technical Architecture
Technical lead
Tech lead
+7 more

Y Media Labs is a creative technology company that helps brands re-imagine their customer  experiences. Our mission is to export the Silicon Valley mindset to the rest of the world.  

We create digital products with purpose that have a lasting impact on users' lives and clients'  businesses. We are a team of dreamers and doers united by a simple idea: If we make a  difference for your customers, we will make a difference for your business too. And it works.  Since 2009, we have led early-stage startups and top-tier brands to "wow" their customers  with best-in-class digital products and experiences. The Wall Street Journal calls us “YML is  one of the most innovative companies in Silicon Valley.”  

Through next-generation technologies and world-class design, we help brands like Apple,  PayPal, L'Oreal, Home Depot, Kaiser Permanente, State Farm, First Republic Bank develop  solutions that drive major business outcomes. Founded in 2009, Y Media Labs is  headquartered in Silicon Valley with four offices worldwide including Atlanta, Indianapolis,  Bangalore & Sao Paulo.  

We came of age with the invention of the app store. We have mobile in our DNA. We create  solutions across the digital ecosystem. Unlike agencies who are born desktop, we are deeply  connected to how consumer perception has shifted thanks to the mobile lifestyle. We have  

built and launched 207 products, delighted over 407 million users, built over 200+ apps, work  with 30 Fortune 500 clients, been responsible for over 400 billion transactions through our  work and generated over $200 billion in transactions for our clients, and been featured on the  app store over 700+ times!  

  • Portfolio of our work can be found @ ymedialabs.com/work  
  • Live look into our engineering team @ medium.com/ymedialabs-innovation  • Live look into our design team @ dribbble.com/ymedialabs  

Our team in Bangalore is close to 250 strong, and we are growing in a variety of ways. Our  goals include a culture of excellence and we are looking to transform the team to be one of  the best tech teams in Bangalore.  

We are looking to hire multiple Android Engineers at different levels to help us code the  world class apps we are creating. If you are a mobile engineer looking to build apps that will  be used by millions of consumers worldwide, build apps for brands that you can be proud to  show to your family and friends – you need to join us! 



We are looking to hire Engineering Manager - Frontend for our team in Bangalore. If you are excited about building products that will be used by millions of consumers worldwide, building products for brands that you can be proud to show to your family and friends - you need to join us!

 

Responsibilities:

  • Lead and coach a group of engineers in delivering scalable, flexible and secure features to our customers.
  • Leading engineering teams composed of backend, frontend, iOS, Android developers and QA.
  • Deep dive into work of your team, review the code submitted by your team, and resolve the root cause of problems.
  • Coach your team members how to increase the quality of their code based on real examples.
  • Involve in hiring for your teams.
  • Drive a continuous improvement process - introduce new tools & automations based on real data analysis
  • Represent the team to engineering groups internally, to executive leaders in various functional groups within YML, to current and future customers, and to our partner organizations.
  • Build a diverse team while fostering a collaborative and inclusive environment.
  • Collaborate with Product/Project Managers to plan, implement and deliver tasks and modules on a timely basis with best practices and adherence to SOPs.
  • Manage the development pipeline to deliver features on schedule while maintaining high bar for quality.
  • Closely Interact with other functions such as PM/Product, Design, UI/UX, Architecture, QA, and deliver planned features
  • Deliver Web, Android and iOS applications with integration to backend services deployed on the cloud with high quality and responsiveness.
  • Create strong practices around test driven development, automating delivery of apps to the marketplace with strong CI/CD practices.
  • Play the role of an unblocker in a tight scrum environment.
  • Prioritize to manage ad-hoc requests in parallel with ongoing projects.

 

Requirements:

  • Should be able to help other developers with challenges, problem solving, and help achieve milestones as per plan.
  • Hands on with programming with 50%+ of bandwidth going into modules owned.
  • A highly talented developer with 10+ years of hands-on experience
  • Primarily in web application development experience using, JAVA, Angular, ReactJS, Python, GO.
  • Working with MVVM, MVP, MVC patterns.
  • Additional Mobile development experience Android, Kotlin, iOS, Swift, Objective C will be a bonus.
  • Must have at least 3+ years of experience in an engineering management role, and a clear record of success prior to that as a senior/staff engineer.
  • Must be compelling and clear communicator, able to represent your team to internal and external audiences with differing levels of technical fluency.
  • Ability to handle multiple competing priorities/projects in a fast-paced environment.
  • Good Analytical, Problem solving and Debugging skills.
  • Hands on experience in Designing, Coding and release management.
  • Continuously increasing your team's work quality & performance.
  • Experience with writing and maintaining unit-tests, functional tests, and CI/CD pipelines.
  • Ability to think from a product mindset.

 

Nice to Have:

  • Hands-on cloud development experience.
  • Qualification - B. Tech/M. Tech/MCA (IT/Computer Science).
  • Years of Exp - 9+.
Read more
US based Fintech with products in capital markets
US based Fintech with products in capital markets
Agency job
via Saimedha by Dhananjay Pershad
Hyderabad
4 - 8 yrs
₹12L - ₹20L / yr
skill iconReact.js
skill iconJavascript
skill iconHTML/CSS
Object Oriented Javascript (OOJS)
D3.js
+1 more
Role: Sr Frontend Developer (React/OOJS)
Experience: 4 to 8yrs
Location: Hyderabad
  • The UI developer will produce robust front end for advanced financial banking and trading applications connecting with server side using micro services
  • 3+ years of relevant experience in front end development using React.JS.
  • Strong knowledge of Web development technologies, including HTML5, CSS3 etc
  • Should have a knowledge of java script libraries like ag-grid, datagrid, chart js, D3 js etc
  • Strong experience in developing UI applications showing large amount of data in grid format.
  • Must have good experience of testing frameworks like mocha/chai, jasmine etc. for React JS.
  • Excellent knowledge of Java and spring, with experience of use in a professional environment
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos