11+ HDFS Jobs in Ahmedabad | HDFS Job openings in Ahmedabad
Apply to 11+ HDFS Jobs in Ahmedabad on CutShort.io. Explore the latest HDFS Job opportunities across top companies like Google, Amazon & Adobe.
Job Description
Mandatory Requirements
-
Experience in AWS Glue
-
Experience in Apache Parquet
-
Proficient in AWS S3 and data lake
-
Knowledge of Snowflake
-
Understanding of file-based ingestion best practices.
-
Scripting language - Python & pyspark
CORE RESPONSIBILITIES
-
Create and manage cloud resources in AWS
-
Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies
-
Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform
-
Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations
-
Develop an infrastructure to collect, transform, combine and publish/distribute customer data.
-
Define process improvement opportunities to optimize data collection, insights and displays.
-
Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible
-
Identify and interpret trends and patterns from complex data sets
-
Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders.
-
Key participant in regular Scrum ceremonies with the agile teams
-
Proficient at developing queries, writing reports and presenting findings
-
Mentor junior members and bring best industry practices.
QUALIFICATIONS
-
5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales)
-
Strong background in math, statistics, computer science, data science or related discipline
-
Advanced knowledge one of language: Java, Scala, Python, C#
-
Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake
-
Proficient with
-
Data mining/programming tools (e.g. SAS, SQL, R, Python)
-
Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
-
Data visualization (e.g. Tableau, Looker, MicroStrategy)
-
Comfortable learning about and deploying new technologies and tools.
-
Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines.
-
Good written and oral communication skills and ability to present results to non-technical audiences
-
Knowledge of business intelligence and analytical tools, technologies and techniques.
Familiarity and experience in the following is a plus:
-
AWS certification
-
Spark Streaming
-
Kafka Streaming / Kafka Connect
-
ELK Stack
-
Cassandra / MongoDB
-
CI/CD: Jenkins, GitLab, Jira, Confluence other related tools
Position: Lead Python Developer
Location: Ahmedabad
The Client company includes a team of experienced information services professionals who are
passionate about growing and enhancing the value of information services businesses. They provide
support with talent, technology, tools, infrastructure and expertise required to deliver across the Data ecosystem.
Position Summary
We are seeking a skilled and experienced Backend Developer with strong expertise in TypeScript, Python,
and web scraping. You will be responsible for designing, developing, and maintaining scalable backend services and APIs that power our data-driven products. Your role will involve collaborating with cross-
functional teams, optimizing system performance, ensuring data integrity, and contributing to the design of efficient and secure architectures.
Job Responsibility
● Design, develop, and maintain backend systems and services using Python and TypeScript.
● Develop and maintain web scraping solutions to extract, process, and manage large-scale data from multiple sources.
● Work with relational and non-relational databases, ensuring high availability, scalability, and performance.
● Implement authentication, authorization, and security best practices across services.
● Write clean, maintainable, and testable code following best practices and coding standards.
● Collaborate with frontend engineers, data engineers, and DevOps teams to deliver robust solutions and troubleshoot, debug, and upgrade existing applications.
● Stay updated with backend development trends, tools, and frameworks to continuously improve processes.
● Utilize core crawling experience to design efficient strategies for scraping the data from different websites and applications.
● Collaborate with technology teams, data collection teams to build end to end technology-enabled ecosystems and partner in research projects to analyze the massive data inputs.
● Responsible for the design and development of web crawlers, able to independently solve various problems encountered in the actual development process.
● Stay updated with the latest web scraping techniques, tools, and industry trends to continuously improve the scraping processes.
Job Requirements
● 4+ years of professional experience in backend development with TypeScript and Python.
● Strong understanding of TypeScript-based server-side frameworks (e.g., Node.js, NestJS, Express) and Python frameworks (e.g., FastAPI, Django, Flask).
● Experience with tools and libraries for web scraping (e.g., Scrapy, BeautifulSoup, Selenium, Puppeteer)
● Hands-on experience with Temporal for creating and orchestrating workflows.
● Proven hands-on experience in web scraping, including crawling, data extraction, deduplication, and handling dynamic websites.
● Proficient in implementing proxy solutions and handling bot-detection challenges (e.g., Cloudflare).
● Experience working with Docker, containerized deployments, and cloud environments (GCP or Azure).
● Proficiency with database systems such as MongoDB and ElasticSearch.
● Hands-on experience with designing and maintaining scalable APIs.
● Knowledge of software testing practices (unit, integration, end-to-end).
● Familiarity with CI/CD pipelines and version control systems (Git).
● Strong problem-solving skills, attention to detail, and ability to work in agile environments.
● Great communication skills and ability to navigate in undirected situations.
Job Exposure:
● Opportunity to apply creative methods in acquiring and filtering the North American government, agencies data from various websites, sources
● In depth industry exposure on data harvesting techniques to build, scale the robust and sustainable model, using open-source applications
● Effectively collaboration with IT team to design the tailor-made solutions basis upon clients’ requirement
● Unique opportunity to research on various agencies, vendors, products as well as technology tools to compose a solution
Team Leads Interior Design
- Experience: 10+ years
- Location: Ahmedabad(Sanand)
- CTC: Up to 80 k/ month
- Mon to Saturday
- Work from Office
- Degree of interior design is compulsory
Requirements and Skills
· A bachelor's or master's degree in Interior Designing is typically required.
· A minimum of 8 to 10 years of professional experience in Interior Designing, with demonstrated leadership skills and project coordination experience.
· Proficiency in Interior Designing software and tools.
· IIID association will be plus.
· Strong design creativity, attention to detail, and the ability to provide design guidance and feedback.
· Project management experience, including scheduling, budgeting, and resource allocation.
· Effective communication and interpersonal skills to collaborate with team members, clients, and stakeholders.
· Knowledge of Interior Designing principles, building systems, construction methods, and industry regulations.
Roles and Responsibilities:
- Good Command of HTML, CSS, Bootstrap, and Javascript
- Must work in Elementor Pro
- Experience with PSD to WordPress
- Good Understanding of PSD requirements
- Knowledge about PSD to HTML Conversion
- Knowledge of PSD Layers/My SQL
- Knowledge of woo commerce,PHP
- Good knowledge of Elementor and Page Builder
Must have exp in Django. [ Mandatory]
- The ability to problem-solve and critically think.
- High level of knowledge of Python and the Django framework.
- Familiarity with event driven programming as well as the MVC.
- Good understanding of SQL databases.
- Good understanding of REST APIs.
About Us:
At Sublime Data Systems, we are dedicated to creating scalable, enterprise-level software solutions that drive innovation and growth. We are seeking an experienced Fullstack Engineer to join our dynamic team. As a core member of our cross-functional unit, you will play a pivotal role in the entire development life cycle, from conception to deployment. Your leadership will be essential in mentoring and guiding our team towards excellence. If you are passionate about coding, thrive in an entrepreneurial environment, and possess expertise in front-end and back-end technologies, we would love to meet you.
Key Responsibilities:
- Architect and develop robust, scalable, and efficient web applications using Node.js and React.js.
- Lead a team of developers in the design, development, testing, and deployment of high-performance web applications.
- Collaborate with cross-functional teams to define, design, and ship new features.
- Ensure the technical feasibility of UI/UX designs and optimize applications for maximum speed and scalability.
- Stay up-to-date with emerging technologies and industry trends to drive innovation and excellence in our products.
- Conduct code reviews to ensure code quality and adherence to best practices.
- Mentor and coach team members to foster a culture of continuous learning and growth.
- Troubleshoot and resolve complex technical issues, ensuring seamless application performance.
Qualifications:
- Bachelor's degree in Computer Science, Engineering, or a related field.
- Minimum of 5 years of experience in full-stack web development.
- Proficiency in Node.js, Express, Nest.js, React.js, and Next.js along with expertise in Typescript.
- Proven experience leading a team of engineers in a fast-paced, agile environment.
- Strong understanding of software development best practices, design patterns, and architectural principles.
- Extensive experience with front-end technologies such as HTML, CSS, and JavaScript.
- In-depth knowledge of RESTful APIs and experience with API integration.
- Expertise in utilizing modern development tools and deploying workflows, such as Git and CI/CD pipelines.
- Familiarity with message broker systems like RabbitMQ.
- Proficiency in databases such as Postgres or MySQL.
- Experience with ORM Frameworks like Sequelize or Typeform.
- Experience with microservices architecture.
- Experience with DevOps (AWS) practices
- Excellent problem-solving and debugging skills.
- Strong communication and leadership abilities.
Benefits:
- Positive work environment
- Encourage and sponsor learning and development programs
- Chance to work with advanced technology
Job Description – Laravel Developer
We are searching for a Laravel developer with experience to build web applications for our company. In this role, you will design and create projects using Laravel framework and PHP, and assist the team in delivering high-quality web applications, services, and tools for our business.
Responsibility
- Collaborating with other developers (front-end, back-end, mobile app, etc.) and project managers to move the software projects faster
- Documenting the task progress, architecture, and development process
- keeping up-to-date with the latest technology trends and best practices in https://laravel.com/docs/4.2/quick#local-development-environment">Laravel development
- Learn and develop Shopify APIs, Shopify Apps and other Laravel projects.
- Write clean, testable, secure, and dynamic codes based on standard web development best practices
- Check if the CSS, HTML, and JavaScript are accurate and consistent across different apps
- Integrate back-end data services and improve current API data services
- Optimize performance by performing UI and back-end tests
- Scale, expand and improve our websites and applications
- Perform debugging and troubleshooting on apps
Skills and Qualification
- A bachelor’s or master’s degree in Computer Science, Engineering, and IT.
- Proven experience as a Laravel or PHP Developer
- Fundamental understanding of front-end technologies like HTML5, CSS3, and JavaScript
- Top-notch skills in building SQL Schema design, REST API design, and SOLID principles
- Familiarity with MVC and fundamental design principles
- Ability to work in a fast-paced environment and collaborate effectively with other team members and stakeholders
- Strong project management skills
Location : Ahmedabad
Work from office only
Sr. Android Developer
It is a digital consultancy that partners with the world's leading brands to design and deliver compelling digital products and services for their customers. It is a digital engagement provider for more than 200 of the world’s leading brands. We are a collective of consultants, designers, developers, cloud advisors, and data scientists - spread across 3 continents and 9 offices - who create compelling digital experiences to help clients show they care to the people who matter most - their consumers, patients, and employees.
We are seeking a Senior Android Developer with demonstrated experience designing and implementing enterprise scale mobile solutions. The ideal candidate will bring both strategic vision and solid execution skills to create native applications for mobile devices.
Responsibilities:
- Design and develop native mobile applications for Android
- Integrate mobile apps with RESTful web services
- Work with UX Designers, Mobile Architects and other Developers to build enterprise mobile solutions
- Work as part of an agile team on leading edge technologies
Skills and Experience:
- 5+ years experience developing applications software
- Excellent working knowledge of an objective oriented language (Java, C++, Objective-C, C#, or similar) - including 2+ years Java
- Android, Android Jetpack, Kotlin, Java, coroutines, MVVM, MVP, Pro-Guard, test cases, unit cases, Agile, Git, App Security
- Demonstrated expertise with the Android SDK
- Experience using RESTful APIs to integrate mobile applications to server side systems.
- Good understanding of software development best practices
- Experience working in an agile environment
- Working knowledge of SCM with strong emphasis on Git and proper Git Flow
- Must reference at least one application you developed that is available today.
- Knowledge of Hybrid technologies like : ReactNative, Ionic will be plus point.
Qualifications:
- Bachelor in Computer Science or equivalent work experience
- Good communicator and team player with strong organizational skills
- Ability to be proactive, find solutions and meet deadlines
- A good sense of humor and a passion for technology
-
- At least 3 to 5 years of experience in .Net.
- The candidate should be a system thinker.
- Strong knowledge of at least one of the .NET languages (e.g. C#, Visual Basic .NET) and HTML5/CSS3.
- Enjoy Event-Driven Design Patterns and Event Sourcing.
- Familiar with Document Store Databases (like Cosmos DB / Mongo DB).
- Knowledge in Modular Architecture and Microservices.
- Comfortable leading large technical projects.
- Knowledge of any cloud services AWS, Azure, Google Cloud.
- Good understanding of ASP.NET framework, SQL Server and design/architectural patterns (e.g. Model-View-Controller (MVC)).
- Experience with architecture styles/APIs (REST, RPC).
- Understanding of Agile methodologies.
- Strive for continuous improvement and build continuous integration, continuous development, and constant deployment pipeline (CI/CD Pipeline).
- Bachelor’s Degree in Computer Science or Information Technology
- Excellent writing skills
- Proficient in Web use, Outlook and Microsoft Office
- Travel as needed





