UX Designer

Job Description: 

Please find below details:

Experience - 5+ Years

Location- Bangalore/Python

Role Overview

We are seeking a skilled Python Data Engineer with expertise in designing and implementing data solutions using the AWS cloud platform. The ideal candidate will be responsible for building and maintaining scalable, efficient, and secure data pipelines while leveraging Python and AWS services to enable robust data analytics and decision-making processes.

Key Responsibilities

• Design, develop, and optimize data pipelines using Python and AWS services such as Glue, Lambda, S3, EMR, Redshift, Athena, and Kinesis.
• Implement ETL/ELT processes to extract, transform, and load data from various sources into centralized repositories (e.g., data lakes or data warehouses).
• Collaborate with cross-functional teams to understand business requirements and translate them into scalable data solutions.
• Monitor, troubleshoot, and enhance data workflows for performance and cost optimization.
• Ensure data quality and consistency by implementing validation and governance practices.
• Work on data security best practices in compliance with organizational policies and regulations.
• Automate repetitive data engineering tasks using Python scripts and frameworks.
• Leverage CI/CD pipelines for deployment of data workflows on AWS.

Required Skills and Qualifications

• Professional Experience: 5+ years of experience in data engineering or a related field.
• Programming: Strong proficiency in Python, with experience in libraries like pandas, pySpark, or boto3.
• AWS Expertise: Hands-on experience with core AWS services for data engineering, such as:
• AWS Glue for ETL/ELT.
• S3 for storage.
• Redshift or Athena for data warehousing and querying.
• Lambda for serverless compute.
• Kinesis or SNS/SQS for data streaming.
• IAM Roles for security.
• Databases: Proficiency in SQL and experience with relational (e.g., PostgreSQL, MySQL) and NoSQL (e.g., DynamoDB) databases.
• Data Processing: Knowledge of big data frameworks (e.g., Hadoop, Spark) is a plus.
• DevOps: Familiarity with CI/CD pipelines and tools like Jenkins, Git, and CodePipeline.
• Version Control: Proficient with Git-based workflows.
• Problem Solving: Excellent analytical and debugging skills.

Optional Skills

• Knowledge of data modeling and data warehouse design principles.
• Experience with data visualization tools (e.g., Tableau, Power BI).
• Familiarity with containerization (e.g., Docker) and orchestration (e.g., Kubernetes).
• Exposure to other programming languages like Scala or Java.

Skills / Tools

• SQL & Python / PySpark
• AWS Services: Glue, Appflow, Redshift - Mandatory
• Data warehousing basics
• Data modelling basics
• 
  

Job Description

• Experience of implementing and delivering data solutions and pipelines on AWS Cloud Platform. Design/ implement, and maintain the data architecture for all AWS data services
• A strong understanding of data modelling, data structures, databases (Redshift), and ETL processes
• Work with stakeholders to identify business needs and requirements for data-related project
• Strong SQL and/or Python or PySpark knowledge
• Creating data models that can be used to extract information from various sources & store it in a usable format
• Optimize data models for performance and efficiency
• Write SQL queries to support data analysis and reporting
• Monitor and troubleshoot data pipelines
• Collaborate with software engineers to design and implement data-driven features 
• Perform root cause analysis on data issues 
• Maintain documentation of the data architecture and ETL processes 
• Identifying opportunities to improve performance by improving database structure or indexing methods 
• Maintaining existing applications by updating existing code or adding new features to meet new requirements 
• Designing and implementing security measures to protect data from unauthorized access or misuse 
• Recommending infrastructure changes to improve capacity or performance 
• Experience in Process industry

• Building reusable components and front-end libraries for future use
• Translating designs and wireframes into high-quality code
• Optimizing components for maximum performance across a vast array of web-capable devices and browsers
• Strong proficiency in JavaScript, including DOM manipulation and the JavaScript object model
• Experience with popular React.js workflows (such as Flux or Redux)
• Familiarity with newer specifications of EcmaScript
• Experience with data structure libraries (e.g., Immutable.js)
• Knowledge of isomorphic React is a plus
• Familiarity with RESTful APIs
• Knowledge of modern authorization mechanisms, such as JSON Web Token
• Experience with common front-end development tools such as Babel, Webpack, NPM, etc.
• Ability to understand business requirements and translate them into technical requirements
• A knack for benchmarking and optimization
• Ability to work through new and difficult React Native Issues and contribute to libraries as needed.
• Ability to create and maintain continuous integration and delivery of React Native applications.