Data Engineer

Roles & Responsibilities

• Data Engineering Excellence: Design and implement data pipelines using formats like JSON, Parquet, CSV, and ORC, utilizing batch and streaming ingestion.
• Cloud Data Migration Leadership: Lead cloud migration projects, developing scalable Spark pipelines.
• Medallion Architecture: Implement Bronze, Silver, and gold tables for scalable data systems.
• Spark Code Optimization: Optimize Spark code to ensure efficient cloud migration.
• Data Modeling: Develop and maintain data models with strong governance practices.
• Data Cataloging & Quality: Implement cataloging strategies with Unity Catalog to maintain high-quality data.
• Delta Live Table Leadership: Lead the design and implementation of Delta Live Tables (DLT) pipelines for secure, tamper-resistant data management.
• Customer Collaboration: Collaborate with clients to optimize cloud migrations and ensure best practices in design and governance.

Educational Qualifications

• Experience: Minimum 5 years of hands-on experience in data engineering, with a proven track record in complex pipeline development and cloud-based data migration projects.
• Education: Bachelor’s or higher degree in Computer Science, Data Engineering, or a related field.
• Skills
• Must-have: Proficiency in Spark, SQL, Python, and other relevant data processing technologies. Strong knowledge of Databricks and its components, including Delta Live Table (DLT) pipeline implementations. Expertise in on-premises to cloud Spark code optimization and Medallion Architecture.

Good to Have

• Familiarity with AWS services (experience with additional cloud platforms like GCP or Azure is a plus).

Soft Skills

• Excellent communication and collaboration skills, with the ability to work effectively with clients and internal teams.
• Certifications
• AWS/GCP/Azure Data Engineer Certification.

Microsoft 365 admin center –Administration –User, Team & groups, Roles, Support & Reports.

• Create a ticket and resolve any critical issues

• As per request, the user level access granted for calendar and SharePoint

• Troubleshoot issues related to Mail-flow, Shared Mailbox, Distribution List, User Mailbox, Anti-

Anti-malware, Security and compliance

• Mailbox issue checking includes capabilities such as mailbox permission, delegation, quota

management, and enable features archive and assigning license & mail tracking

• Installing, Configuring and administering Windows 2016 & 2019 Server

• Add-Delete-modify user account & group information, reset user passwords in Domain controller

• Managed and organized large volumes of data stored on QNAP NAS devices efficiently.

• Implemented, and maintained network infrastructure including routers, switches, firewalls, and

access points to ensure reliable connectivity and security

• Managed Sonic firewall monitoring creating VPN users, configuration and block to IP’s and web

sites.

• Worked on enabling & disabling the firewall specific access configuration

• Install, configure, and troubleshoot Microsoft Outlook & Outlook Express.

• Responsible for end-user computing and other devices preparation, configuration, backup, and

Connectivity

• Installed, configured, and maintained antivirus software on desktops, laptops, servers, and mobile

devices to safeguard against malware, ransomware, and other threat

• Implementing & troubleshooting network access LAN, WAN, and Wi-Fi.

• Install, configure, and troubleshoot LaserJet printers, Network printers & scanners

• Implemented data backup and recovery strategies to ensure data integrity and availability

• Administered Cloud Tele calling system, including user management, system configuration, and

troubleshooting to ensure smooth operation.

• Administered Tele calling system, including user management, user and campaign

configuration, and troubleshooting to ensure smooth operation

• Managed and administered cloud Endpoint Security solutions to protect endpoints across the

organization.

• Installed and configured hardware components including servers, workstations, network devices, and

peripherals according to specifications and requirements.

• Ensured compatibility and proper integration of hardware components within IT systems and network

infrastructure.

• Provides back-end support and assistance with CCTV installation, Support & Troubleshoot.

• Handling the procurement of system and network related machines

• Purchase Orders following with Vendors as per requirement related to all Assets

• Maintaining the cloud-based surveillance configuration (CCTV – NVR & DVR) for all the locations

• Worked extensively in drafting Troubleshooting and day to day procedures.

Linux Operating system Ubuntu/Centos Install Configuration.

Webserver (Apache/Nginx) Install and configuration Trouble setting the issue.

 DevOps(Jenkins) Configure & troubleshooting

Cloud AWS / Azure / Hyper-V.

Create VPN Configuration using PPTP / L2TP

CV at Satya at honeycombindia dot net

Job Description

SquareShift is a fast-growing cloud consulting company, solving cloud challenges through excellence in technology, thought leadership, and quality in execution. We are based in Singapore, with a world-class engineering team in India. 

Founded by serial entrepreneurs, we are a team of tech-enthusiasts who have strong expertise in enterprise product development and cloud technologies.

Requirements

• 5+ years of professional experience in building and designing SaaS based web applications.
• Proven backend development skills with experience in a language like Ruby
• Knowledge of open-source technologies such as Apache, Solr, Lucene, Elastic Search, Memcached.
• Experience working with Product Management to build and release products in an agile environment.
• You are familiar with SDLC tools like Ant, Maven, Git, SVN, Jenkins, Travis, Puppet, Ansible, Docker.
• You have some knowledge around how AWS services and deployments work.
• You have excellent interpersonal skills and can explain complex problems to technical

Benefits

Why SquareShift?

We firmly believe that our growth, long term success & wellbeing as an organization are a direct outcome of the culture and teamwork. At SquareShift, you can expect,

• High-growth, collaborative environment with diverse and inclusive teams
• Continuous learning, enrichment, and development opportunities
• Competitive pay and allowances for professional development 
• Flexible time off to relax and recharge

Website - squareshift.co

Responsibilities

• Managing small to medium teams with a focus on performance and talent retention
• Participate in creation and execution of product and technology roadmap with stakeholders.
• Collaborate with product managers and other leads/architects for building and delivering projects
• Ownership of front-end and back-end development work carried out with reusability, scalability, and testability of the projects
• Hire and mentor junior team members and coordinate their training
• Coordinate with external stakeholders for new integrations and tools
• Review and update policies relevant to internal systems and equipment and stay compliant with security regulations
• Monitor reliability and performance of all customer-facing and internal projects
• Manage software development projects by setting requirements, goals, and timelines

Requirements

• Work experience as an engineering manager or in a similar senior-level position at an engineering department
• Experience in the Fintech space
• Extensive experience with cloud technologies (AWS preferred) and server-side technologies (Java preferred)
• Hands-on experience in back-end and front-end development
• Good understanding of SDLC using agile methodologies (SCRUM / Kanban / SAFe)
• Leadership abilities with a strategic mind
• Excellent project management skills
• BSc/MSc in Engineering, Computer Science or relevant field

• Looking for an expert JavaScript developer who is highly skilled with Vue.js and Vuex(redux).
• Someone with the ability to create testable, reusable, and scalable code.
• Someone very good at understanding requirements and developing services & features quickly.
• Good communication skills & team player, who engages with all stakeholders of the project to add clarity for all aspects of the ongoing software development project.

Your responsibilities will include:

• Collaborate with project stakeholders, gather requirements, and develop the UI application.
• Create reusable, effective, and scalable VueJs Code.
• Implement front-end components with Vue.js and Vuex(redux) framework.
• Ensure developing robust, secure, modular, and maintainable code.
• Translate technical requirements into code.
• Build responsive UI screens with cross-browser & cross-platform support.
• Test and update web applications.

Key Requirements :

• Degree in Computer Science, Engineering or a related field.
• Highly proficient with the JavaScript language and its modern ES6+ syntax and features.
• Experience with the Vue.js ecosystem, including Vue CLI, Vuex, Vue Router, and Nuxt.js
• Should be having strong knowledge in HTML, HTML DOM, Bootstrap, Stylus, Sass, Less, CSS, and npm for builds.
• Good problem solving, decision making, and prioritization

• Work with the architect in identifying modules, interfaces, functionality to be developed
• Participate in the entire application lifecycle, focusing on coding and debugging
• Write clean code to develop functional web application, addressing technical and design requirements
• Understand and implement heuristic algorithms as necessary
• Troubleshoot and debug applications
• Create and maintain upto date documentation 
• Collaborate with Front-end developers to integrate user-facing elements with server side logic
• Provide training and support to internal teams
• Build reusable code and libraries for future use
• Liaise with developers, architects,  designers and system administrators to identify and incorporate new features

• Proven work experience in Java as a Back-end developer
• In-depth understanding of the entire web development process (design, development and deployment)
• Hands on experience with programming languages like https://resources.workable.com/back-end-developer-job-description" target="_blank">Java and Python
• Hands on experience in relational and non relational databases
• Working knowledge of CMS framework
• Familiarity with front-end languages (e.g. HTML, JavaScript and CSS)
• Excellent analytical and time management skills
• Teamwork skills with a problem-solving attitude
• BE/ MS degree in Computer Science or relevant field

Roles and Responsibilities

• Design and implement components of our web application, and admin panel
• Build a robust, lightweight, and high-performance client-side app
• Translating designs and wireframes into high quality code
• Write documentation and guides for web app & admin panel

Key Qualifications

• Expertise in ReactJS/Redux
• Working knowledge of TypeScript or Flow is a plus
• PURE experience of 1.5 Years and more in Frontend Development
• Expert-level knowledge of developing, shipping, and maintaining Javascript applications
• Knowledge of general software design patterns
• Deep understanding of Javascript
• Up-to-date on the latest build tools, and libraries such as ES6, Webpack, Babel
• Proficient in Javascript with strong object-oriented design skills
• Able to work independently and drive results