Cutshort logo
Cloudesign Technology Solutions logo
Python ETL Developer(Data Engineer)
Python ETL Developer(Data Engineer)
Cloudesign Technology Solutions's logo

Python ETL Developer(Data Engineer)

Anshul Saxena's profile picture
Posted by Anshul Saxena
5 - 13 yrs
₹15L - ₹28L / yr
Remote only
Skills
Spotfire
Qlikview
Tableau
PowerBI
Data Visualization
skill iconData Analytics
skill iconPython
ETL
Data engineering
Apache Synapse
SQL Azure
databricks
PySpark

Job Description: Data Engineer

Location: Remote

Experience Required: 6 to 12 years in Data Engineering

Employment Type: [Full-time]

Notice: Looking for candidates, Who can join immediately or 15days Max

 

About the Role:

We are looking for a highly skilled Data Engineer with extensive experience in Python, Databricks, and Azure services. The ideal candidate will have a strong background in building and optimizing ETL processes, managing large-scale data infrastructures, and implementing data transformation and modeling tasks.

 

Key Responsibilities:

ETL Development:

Use Python as an ETL tool to read data from various sources, perform data type transformations, handle errors, implement logging mechanisms, and load data into Databricks-managed delta tables.

Develop robust data pipelines to support analytics and reporting needs.

Data Transformation & Optimization:

Perform data transformations and evaluations within Databricks.

Work on optimizing data workflows for performance and scalability.

Azure Expertise:

Implement and manage Azure services, including Azure SQL Database, Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake.

Coding & Development:

Utilize Python for complex tasks involving classes, objects, methods, dictionaries, loops, packages, wheel files, and database connectivity.

Write scalable and maintainable code to manage streaming and batch data processing.

Cloud & Infrastructure Management:

Leverage Spark, Scala, and cloud-based solutions to design and maintain large-scale data infrastructures.

Work with cloud data warehouses, data lakes, and storage formats.

Project Leadership:

Lead data engineering projects and collaborate with cross-functional teams to deliver solutions on time.


Required Skills & Qualifications:

Technical Proficiency:

  • Expertise in Python for ETL and data pipeline development.
  • Strong experience with Databricks and Apache Spark.
  • Proven skills in handling Azure services, including Azure SQL Database, Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake.


Experience & Knowledge:

  • Minimum 6+ years of experience in data engineering.
  • Solid understanding of data modeling, ETL processes, and optimizing data pipelines.
  • Familiarity with Unix shell scripting and scheduling tools.

Other Skills:

  • Knowledge of cloud warehouses and storage formats.
  • Experience in handling large-scale data infrastructures and streaming data.

 

Preferred Qualifications:

  • Proven experience with Spark and Scala for big data processing.
  • Prior experience in leading or mentoring data engineering teams.
  • Hands-on experience with end-to-end project lifecycle in data engineering.

 

What We Offer:

  • Opportunity to work on challenging and impactful data projects.
  • A collaborative and innovative work environment.
  • Competitive compensation and benefits.

 

How to Apply:

https://cloudesign.keka.com/careers/jobdetails/73555

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Cloudesign Technology Solutions

Founded :
2014
Type :
Products & Services
Size :
20-100
Stage :
Profitable

About

Cloudesign is a Software Services and Development company in Mumbai, Delhi, Bangalore focusing on Website & Mobile App Software Development
Read more

Connect with the team

Profile picture
neha mhaprolkar

Company social profiles

bloglinkedintwitterfacebook

Similar jobs

Enalo Technologies Private Ltd.
Om Prakash
Posted by Om Prakash
Remote, Hyderabad
2 - 4 yrs
₹6L - ₹12L / yr
skill iconDjango
skill iconAmazon Web Services (AWS)
skill iconPython
RESTful APIs
MySQL
+2 more
- Must have good knowledge of Rest API, Django ORM

- Solid understanding of Data structures and Algorithms.

- Exceptional coding skills in an Object-Oriented programming language (Golang/Python)

- Must have basic understanding of AWS (EC2, Lambda, Boto, CI/CD), Celery, RabbitMq and similar task queue management tools/libraries.

- Experience with web technologies Python, Linux, Apache, Solr, Memcache, Redis, grpc

- Experience with high performance services catering to millions of daily traffic is a plus

- Strong understanding of Python and Django.

- Good knowledge of various Python Libraries, APIs, and tool kits.

- Basic understanding of front-end technologies, such as JavaScript, HTML5, and CSS3.

- Proficient understanding of code versioning tools such as Git.

- Understanding of the threading limitations of Python, and multi-process architecture

- Understanding of databases and MySQL

Responsibilities :

- Comply with coding standards and technical design.

- Adapts structured coding styles for easy review, testing, and maintainability of the code.

- Active participation in troubleshooting and debugging.

- Preparing technical documentation of code.
Read more
Matellio India Private Limited
Harshit Sharma
Posted by Harshit Sharma
Remote only
4 - 14 yrs
₹7L - ₹15L / yr
HAL
Linux/Unix
AOSP
skill iconAndroid Development
skill iconKotlin
+4 more

Bringing up Android on custom hardware 

  •  Android OS modifications, HAL interface definition language (C++ and Java)
  •  Android, JNI and Android application performance optimization 

 

 Preferred Skills and Experience:

  •  Experience in Java or Kotlin development (preferably Android) 
  •  Experience in C/C++ with deep understanding of Object-Oriented Analysis, Design and Programming. 
  •  Experience with GIT or similar repository management and version control tools. Familiarity with software configuration management tools, defect tracking tools and Agile methodology. 
  •  Development in a Linux environment with emphasis on Unit testing alongside functional integration testing. 
  •  Android-For-Work, Android Enterprise features and EMM/MDM management solutions 
Read more
Frisco Analytics Pvt Ltd
Cedrick Mariadas
Posted by Cedrick Mariadas
Bengaluru (Bangalore), Hyderabad
5 - 8 yrs
₹15L - ₹20L / yr
databricks
Apache Spark
skill iconPython
SQL
MySQL
+3 more

We are actively seeking a self-motivated Data Engineer with expertise in Azure cloud and Databricks, with a thorough understanding of Delta Lake and Lake-house Architecture. The ideal candidate should excel in developing scalable data solutions, crafting platform tools, and integrating systems, while demonstrating proficiency in cloud-native database solutions and distributed data processing.


Key Responsibilities:

  • Contribute to the development and upkeep of a scalable data platform, incorporating tools and frameworks that leverage Azure and Databricks capabilities.
  • Exhibit proficiency in various RDBMS databases such as MySQL and SQL-Server, emphasizing their integration in applications and pipeline development.
  • Design and maintain high-caliber code, including data pipelines and applications, utilizing Python, Scala, and PHP.
  • Implement effective data processing solutions via Apache Spark, optimizing Spark applications for large-scale data handling.
  • Optimize data storage using formats like Parquet and Delta Lake to ensure efficient data accessibility and reliable performance.
  • Demonstrate understanding of Hive Metastore, Unity Catalog Metastore, and the operational dynamics of external tables.
  • Collaborate with diverse teams to convert business requirements into precise technical specifications.

Requirements:

  • Bachelor’s degree in Computer Science, Engineering, or a related discipline.
  • Demonstrated hands-on experience with Azure cloud services and Databricks.
  • Proficient programming skills in Python, Scala, and PHP.
  • In-depth knowledge of SQL, NoSQL databases, and data warehousing principles.
  • Familiarity with distributed data processing and external table management.
  • Insight into enterprise data solutions for PIM, CDP, MDM, and ERP applications.
  • Exceptional problem-solving acumen and meticulous attention to detail.

Additional Qualifications :

  • Acquaintance with data security and privacy standards.
  • Experience in CI/CD pipelines and version control systems, notably Git.
  • Familiarity with Agile methodologies and DevOps practices.
  • Competence in technical writing for comprehensive documentation.


Read more
Fintech Hire
Agency job
via Novo tree minds by Pranamya Devadiga
Remote, Mumbai
6 - 9 yrs
₹12L - ₹15L / yr
skill iconReact.js
skill iconJavascript
skill iconRedux/Flux
skill iconHTML/CSS
Object Oriented Programming (OOPs)
You will be an integral member in the design, analysis, development and deployment efforts
for multiple enterprise application projects to solve complex business problems.
 You will help develop new features or improvements in the existing workflow.
 You will be responsible for writing modular, scalable, optimized and reusable code.
 Ensuring technical feasibility and product requirement.
 Analyze specifications and business needs to determine appropriate technologies and
configurations to meet those business requirements
Desired Skills:
 Must have experience in React.js with proficiency in HTML5, CSS3, JavaScript
 Have good knowledge of OOPs concept.
 Extensive knowledge of web technologies and building large-scale web applications
 Expertise with cross-browser platforms and design constraints on the web
 Experience building responsive user interfaces that work seamlessly across mobile, tablet
and desktop web platform
 Translate storyboards and use cases into functional applications
 Must have experiences in any state management tools like Redux, Flux and Mobx
 Sound knowledge of Front-end testing tools like Jest and Enzyme
 Should have good knowledge of build tools like web pack
 Should have exposure to different UI libraries like MaterialUI, ant
Read more
Humalect
at Humalect
1 recruiter
RAJESH TILWANI
Posted by RAJESH TILWANI
Bengaluru (Bangalore)
4 - 8 yrs
₹30L - ₹35L / yr
skill iconNodeJS (Node.js)
skill iconMongoDB
RabbitMQ
skill iconAmazon Web Services (AWS)
skill iconHTML/CSS
+2 more

Job Description
We are looking for a Back-End Web Developer responsible for managing the interchange of data between the server and the users. Your primary focus will be development of all server-side logic, definition and maintenance of the central database, and ensuring high performance and responsiveness to requests from the front-end.

 

Responsibilities

  • Integration of user-facing elements developed by a front-end developers with server side logic
  • Building reusable code and libraries for future use
  • Optimization of the application for maximum speed and scalability
  • Implementation of security and data protection

Skills And Qualifications

  • Basic understanding of front-end technologies and platforms, such as JavaScript, HTML5, and CSS3
  • User authentication and authorization between multiple systems, servers, and environments
  • Integration of multiple data sources and databases into one system
  • Management of hosting environment, including database administration and scaling an application to support load changes
  • Data migration, transformation, and scripting
  • Setup and administration of backups
  • Creating database schemas that represent and support business processes
  • Implementing automated testing platforms and unit tests
  • Experience with Kafka / RabbitMQ
  • Proficient knowledge of NodeJS
  • Working knowledge of databases like PostgreSQL and MongoDB
  • Experience with AWS Cloud services like S3 and EC2
  • Proficient understanding of code versioning tools, such as Git
Read more
Kolkata
1 - 4 yrs
₹1.2L - ₹2.8L / yr
Sales
Search Engine Optimization (SEO)
Business Development
Field Sales
Telesales
+3 more
B2B/ Website campaign Night shift job opening for experienced web consultant.
kolkata location jobs.

Immediate joiners required for night shift !!

We are hiring for Website Sales (Outbound Voice)
Shift: US Shift (Night)

Designation: CCE/ Team Lead.
Process: B2B Website process.

Salary: Upto 15K +Huge Incentives+other benefits

5 Days Working, saturday and sunday fixed off.

Experience Required: minimum 6 months in B2B Website Sales.
Candidates should be comfortable to work in Night shift

Immediate joiners required.

Aryston web solution pvt. ltd.
Read more
Marketing and Advertising startup
Marketing and Advertising startup
Agency job
via Qrata by Mrunal Kokate
Mumbai
3 - 6 yrs
₹15L - ₹23L / yr
skill iconMongoDB
skill iconExpress
skill iconReact.js
skill iconNodeJS (Node.js)
About the company

Qrata is hiring for the company which provides business tools for thecreators to set up paid communities by providing one time and subscription based services.

Quick Facts

Founded in: 2019
Number of Employees: 11 - 50 Employees
Industry: Marketing & Advertising
Headquarters: Mumbai
Technology Stack: MongoDB, Express, React, Node

Full-stack Developer - Job Skills & Responsibilities

  • Work with development teams and product managers to ideate software solutions
  • Design client-side and server-side architecture
  • Build the front-end of applications through appealing visual design
  • Develop and manage well-functioning databases and applications
  • Write effective APIs
  • Test software to ensure responsiveness and efficiency
  • Troubleshoot, debug and upgrade software
  • Create security and data protection settings
  • Build features and applications with a mobile responsive design
  • Write technical documentation
  • Work with data scientists and analysts to improve software
Read more
Fulgent Technologies
at Fulgent Technologies
1 recruiter
Sumit Raj
Posted by Sumit Raj
NCR (Delhi | Gurgaon | Noida)
1 - 4 yrs
₹2L - ₹4L / yr
Sales
Business Development
Field Sales
Telesales
Fulgent Technologies is a software development and marketing technologies company. Located in Noida, UP. We are delivering the best software and website solutions to our clients with full fledged marketing strategy including treditional and digital marketing.
Read more
GST Edge
at GST Edge
2 recruiters
Kshitij Tarkas
Posted by Kshitij Tarkas
Mumbai
1 - 4 yrs
₹4L - ₹6L / yr
skill iconJavascript
skill iconHTML/CSS
skill iconAngular (2+)
Responsibilities & Duties: - Design, develop, test, deploy, maintain and improve the software- Invest in learning about a fully developed frontend stack and picking up gaps in understandingSkills & Qualifications: - Strong development skills in HTML5, CSS3, JavaScript, Angular 2+- Basic understanding of backend development, ReST APIs and internet infrastructure in general. - Open to learning new technologies. - Comfortable working in a low monitoring/guidance environment. - Strong sense of initiative, ownership, urgency, and drive. - Good verbal and written communication skills. - Excellent organizational and leadership skills.- Good understanding of design, UI, and UX. - Experience with third-party libraries is a plus. - Ability to write clean, concise and well-documented code. - Familiar with version control and writing tests cases.- Experience with the usage of open source technologies. - Working knowledge of GIT.- A solid foundation in computer science, with sound knowledge of data structures, algorithms, and software design.We are looking for a natural problem solver who has the ability and tenacity to execute, to course correct and to repeat the learning cycle. Opportunity to learn with a fast-growing startup and learn from a great team.Only those candidates can apply who: - Available for full time- Immediate joining (within 2 weeks)Benefits:Our team works hard and gets rewarded equally. The following benefits will be provided by the company:- Technical Training- Medi-claim- Insurance- Employee Referral Bonus- Business Referral Bonus- Overtime Benefits
Read more
Impact Guru
at Impact Guru
15 recruiters
Karan Shetty
Posted by Karan Shetty
Mumbai
3 - 7 yrs
₹6L - ₹15L / yr
skill iconJavascript
skill iconPHP
MySQL
skill iconHTML/CSS
LAMP Stack
Job Description: If you are interested to be part of a dynamic social startup that works towards serving the common good and will not just change India for the better but also make “giving back” more inclusive and fun, then Impact Guru is the right place for you. We are looking for driven Full Stack Developer. The role is a fulltime role based out of our Mumbai office. If you are interested to be part of a dynamic social startup that works towards serving the common good and will not just change India for the better but also make - giving back- more inclusive and fun, then Impact Guru is the right place for you. We are looking for a Chief Technology Officer - CTO/Head of Product with experience and expertise to lead end to end product design, development, and implementation (web, mobile browser, smartphone apps) based on strategic priorities, industry experience, customer feedback, and analytics. The role is based out of our office in South Mumbai (Opera House). Job Responsibilities: - Design and build efficient, scalable systems that are used by millions of people - Own what you build as you create, test, and refine what’s under the hood of our pages and services - Investigate production issues pertaining to customer features to determine root cause and implement solutions - Investigate existing queries and write new queries with performance optimization in mind - Build well-designed software in a way that is generic, reusable, and easily extensible, as well as solves the business needs and requirements - Collaborate with product managers, designers, and software engineers to ensure design vision is maintained, final markup is standards compliant, and UI deliverables are completed on time - Work with the real time feedback from our users (external and internal) to make the products better - Discover, design, develop, deploy, debug. Repeat! Requirements: - Proficiency in web scripting programming with PHP. - Experience with SQL Databases. - Prior experience with a significant consumer-facing website or service. - Top-notch programming skills in Javascript and strong understanding of web fundamentals - Design, build and maintain high performance, scalable and secure code. - Experience with cloud services like AWS. - Experience with MVC architecture is a plus. - Knowledge / experience in building an API and consuming OAuth tokens. - Solid understanding of the foundations of security and best practices. - Good grasp of data structures and algorithms - Excellent problem solving skills. - Take ownership of the backend services, ensure the best possible performance, quality and responsiveness, as well as maintaining code quality, organisation and testing/deployment. - Passionate about technology and willing to develop expertise in any emerging field. - Strong organisational and communication skills, team player. Perquisites & Benefits: - A competitive salary and performance bonus per month - Letter of Recommendation from Harvard and Wharton alumnus - Opportunity to be part of a diverse working environment, valuable social sector work experience - Fun, casual, relaxed and flexible work environment
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos