


Job Description: Data Engineer
Location: Remote
Experience Required: 6 to 12 years in Data Engineering
Employment Type: [Full-time]
Notice: Looking for candidates, Who can join immediately or 15days Max
About the Role:
We are looking for a highly skilled Data Engineer with extensive experience in Python, Databricks, and Azure services. The ideal candidate will have a strong background in building and optimizing ETL processes, managing large-scale data infrastructures, and implementing data transformation and modeling tasks.
Key Responsibilities:
ETL Development:
Use Python as an ETL tool to read data from various sources, perform data type transformations, handle errors, implement logging mechanisms, and load data into Databricks-managed delta tables.
Develop robust data pipelines to support analytics and reporting needs.
Data Transformation & Optimization:
Perform data transformations and evaluations within Databricks.
Work on optimizing data workflows for performance and scalability.
Azure Expertise:
Implement and manage Azure services, including Azure SQL Database, Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake.
Coding & Development:
Utilize Python for complex tasks involving classes, objects, methods, dictionaries, loops, packages, wheel files, and database connectivity.
Write scalable and maintainable code to manage streaming and batch data processing.
Cloud & Infrastructure Management:
Leverage Spark, Scala, and cloud-based solutions to design and maintain large-scale data infrastructures.
Work with cloud data warehouses, data lakes, and storage formats.
Project Leadership:
Lead data engineering projects and collaborate with cross-functional teams to deliver solutions on time.
Required Skills & Qualifications:
Technical Proficiency:
- Expertise in Python for ETL and data pipeline development.
- Strong experience with Databricks and Apache Spark.
- Proven skills in handling Azure services, including Azure SQL Database, Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake.
Experience & Knowledge:
- Minimum 6+ years of experience in data engineering.
- Solid understanding of data modeling, ETL processes, and optimizing data pipelines.
- Familiarity with Unix shell scripting and scheduling tools.
Other Skills:
- Knowledge of cloud warehouses and storage formats.
- Experience in handling large-scale data infrastructures and streaming data.
Preferred Qualifications:
- Proven experience with Spark and Scala for big data processing.
- Prior experience in leading or mentoring data engineering teams.
- Hands-on experience with end-to-end project lifecycle in data engineering.
What We Offer:
- Opportunity to work on challenging and impactful data projects.
- A collaborative and innovative work environment.
- Competitive compensation and benefits.
How to Apply:

About Cloudesign Technology Solutions
Similar jobs

- Solid understanding of Data structures and Algorithms.
- Exceptional coding skills in an Object-Oriented programming language (Golang/Python)
- Must have basic understanding of AWS (EC2, Lambda, Boto, CI/CD), Celery, RabbitMq and similar task queue management tools/libraries.
- Experience with web technologies Python, Linux, Apache, Solr, Memcache, Redis, grpc
- Experience with high performance services catering to millions of daily traffic is a plus
- Strong understanding of Python and Django.
- Good knowledge of various Python Libraries, APIs, and tool kits.
- Basic understanding of front-end technologies, such as JavaScript, HTML5, and CSS3.
- Proficient understanding of code versioning tools such as Git.
- Understanding of the threading limitations of Python, and multi-process architecture
- Understanding of databases and MySQL
Responsibilities :
- Comply with coding standards and technical design.
- Adapts structured coding styles for easy review, testing, and maintainability of the code.
- Active participation in troubleshooting and debugging.
- Preparing technical documentation of code.

Bringing up Android on custom hardware
- Android OS modifications, HAL interface definition language (C++ and Java)
- Android, JNI and Android application performance optimization
Preferred Skills and Experience:
- Experience in Java or Kotlin development (preferably Android)
- Experience in C/C++ with deep understanding of Object-Oriented Analysis, Design and Programming.
- Experience with GIT or similar repository management and version control tools. Familiarity with software configuration management tools, defect tracking tools and Agile methodology.
- Development in a Linux environment with emphasis on Unit testing alongside functional integration testing.
- Android-For-Work, Android Enterprise features and EMM/MDM management solutions

We are actively seeking a self-motivated Data Engineer with expertise in Azure cloud and Databricks, with a thorough understanding of Delta Lake and Lake-house Architecture. The ideal candidate should excel in developing scalable data solutions, crafting platform tools, and integrating systems, while demonstrating proficiency in cloud-native database solutions and distributed data processing.
Key Responsibilities:
- Contribute to the development and upkeep of a scalable data platform, incorporating tools and frameworks that leverage Azure and Databricks capabilities.
- Exhibit proficiency in various RDBMS databases such as MySQL and SQL-Server, emphasizing their integration in applications and pipeline development.
- Design and maintain high-caliber code, including data pipelines and applications, utilizing Python, Scala, and PHP.
- Implement effective data processing solutions via Apache Spark, optimizing Spark applications for large-scale data handling.
- Optimize data storage using formats like Parquet and Delta Lake to ensure efficient data accessibility and reliable performance.
- Demonstrate understanding of Hive Metastore, Unity Catalog Metastore, and the operational dynamics of external tables.
- Collaborate with diverse teams to convert business requirements into precise technical specifications.
Requirements:
- Bachelor’s degree in Computer Science, Engineering, or a related discipline.
- Demonstrated hands-on experience with Azure cloud services and Databricks.
- Proficient programming skills in Python, Scala, and PHP.
- In-depth knowledge of SQL, NoSQL databases, and data warehousing principles.
- Familiarity with distributed data processing and external table management.
- Insight into enterprise data solutions for PIM, CDP, MDM, and ERP applications.
- Exceptional problem-solving acumen and meticulous attention to detail.
Additional Qualifications :
- Acquaintance with data security and privacy standards.
- Experience in CI/CD pipelines and version control systems, notably Git.
- Familiarity with Agile methodologies and DevOps practices.
- Competence in technical writing for comprehensive documentation.

for multiple enterprise application projects to solve complex business problems.
You will help develop new features or improvements in the existing workflow.
You will be responsible for writing modular, scalable, optimized and reusable code.
Ensuring technical feasibility and product requirement.
Analyze specifications and business needs to determine appropriate technologies and
configurations to meet those business requirements
Desired Skills:
Must have experience in React.js with proficiency in HTML5, CSS3, JavaScript
Have good knowledge of OOPs concept.
Extensive knowledge of web technologies and building large-scale web applications
Expertise with cross-browser platforms and design constraints on the web
Experience building responsive user interfaces that work seamlessly across mobile, tablet
and desktop web platform
Translate storyboards and use cases into functional applications
Must have experiences in any state management tools like Redux, Flux and Mobx
Sound knowledge of Front-end testing tools like Jest and Enzyme
Should have good knowledge of build tools like web pack
Should have exposure to different UI libraries like MaterialUI, ant
Job Description
We are looking for a Back-End Web Developer responsible for managing the interchange of data between the server and the users. Your primary focus will be development of all server-side logic, definition and maintenance of the central database, and ensuring high performance and responsiveness to requests from the front-end.
Responsibilities
- Integration of user-facing elements developed by a front-end developers with server side logic
- Building reusable code and libraries for future use
- Optimization of the application for maximum speed and scalability
- Implementation of security and data protection
Skills And Qualifications
- Basic understanding of front-end technologies and platforms, such as JavaScript, HTML5, and CSS3
- User authentication and authorization between multiple systems, servers, and environments
- Integration of multiple data sources and databases into one system
- Management of hosting environment, including database administration and scaling an application to support load changes
- Data migration, transformation, and scripting
- Setup and administration of backups
- Creating database schemas that represent and support business processes
- Implementing automated testing platforms and unit tests
- Experience with Kafka / RabbitMQ
- Proficient knowledge of NodeJS
- Working knowledge of databases like PostgreSQL and MongoDB
- Experience with AWS Cloud services like S3 and EC2
- Proficient understanding of code versioning tools, such as Git
kolkata location jobs.
Immediate joiners required for night shift !!
We are hiring for Website Sales (Outbound Voice)
Shift: US Shift (Night)
Designation: CCE/ Team Lead.
Process: B2B Website process.
Salary: Upto 15K +Huge Incentives+other benefits
5 Days Working, saturday and sunday fixed off.
Experience Required: minimum 6 months in B2B Website Sales.
Candidates should be comfortable to work in Night shift
Immediate joiners required.
Aryston web solution pvt. ltd.

Qrata is hiring for the company which provides business tools for thecreators to set up paid communities by providing one time and subscription based services.
Quick Facts
Founded in: 2019
Number of Employees: 11 - 50 Employees
Industry: Marketing & Advertising
Headquarters: Mumbai
Technology Stack: MongoDB, Express, React, Node
- Work with development teams and product managers to ideate software solutions
- Design client-side and server-side architecture
- Build the front-end of applications through appealing visual design
- Develop and manage well-functioning databases and applications
- Write effective APIs
- Test software to ensure responsiveness and efficiency
- Troubleshoot, debug and upgrade software
- Create security and data protection settings
- Build features and applications with a mobile responsive design
- Write technical documentation
- Work with data scientists and analysts to improve software


