
Lead I - Data Engineering (Python, AWS Glue, Pyspark, Terraform)
at Global Digital Transformation Solutions Provider
Job Details
- Job Title: Lead I - Data Engineering (Python, AWS Glue, Pyspark, Terraform)
- Industry: Global digital transformation solutions provider
- Domain - Information technology (IT)
- Experience Required: 5-7 years
- Employment Type: Full Time
- Job Location: Hyderabad
- CTC Range: Best in Industry
Job Description
Data Engineer with AWS, Python, Glue, Terraform, Step function and Spark
Skills: Python, AWS Glue, Pyspark, Terraform - All are mandatory
******
Notice period - 0 to 15 days only
Job stability is mandatory
Location: Hyderabad

Similar jobs

- Data Engineer
Required skill set: AWS GLUE, AWS LAMBDA, AWS SNS/SQS, AWS ATHENA, SPARK, SNOWFLAKE, PYTHON
Mandatory Requirements
- Experience in AWS Glue
- Experience in Apache Parquet
- Proficient in AWS S3 and data lake
- Knowledge of Snowflake
- Understanding of file-based ingestion best practices.
- Scripting language - Python & pyspark
CORE RESPONSIBILITIES
- Create and manage cloud resources in AWS
- Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies
- Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform
- Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations
- Develop an infrastructure to collect, transform, combine and publish/distribute customer data.
- Define process improvement opportunities to optimize data collection, insights and displays.
- Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible
- Identify and interpret trends and patterns from complex data sets
- Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders.
- Key participant in regular Scrum ceremonies with the agile teams
- Proficient at developing queries, writing reports and presenting findings
- Mentor junior members and bring best industry practices
QUALIFICATIONS
- 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales)
- Strong background in math, statistics, computer science, data science or related discipline
- Advanced knowledge one of language: Java, Scala, Python, C#
- Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake
- Proficient with
- Data mining/programming tools (e.g. SAS, SQL, R, Python)
- Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
- Data visualization (e.g. Tableau, Looker, MicroStrategy)
- Comfortable learning about and deploying new technologies and tools.
- Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines.
- Good written and oral communication skills and ability to present results to non-technical audiences
- Knowledge of business intelligence and analytical tools, technologies and techniques.
Familiarity and experience in the following is a plus:
- AWS certification
- Spark Streaming
- Kafka Streaming / Kafka Connect
- ELK Stack
- Cassandra / MongoDB
- CI/CD: Jenkins, GitLab, Jira, Confluence other related tools
- Edit videos for social media, marketing campaigns, advertisements, and promotional content
- Create engaging short-form and long-form video content
- Add transitions, animations, sound effects, subtitles, and motion graphics
- Collaborate with the marketing and creative team to develop content ideas
- Understand brand guidelines and maintain consistency across videos
- Stay updated with market trends, viral formats, and editing styles
- Optimize videos for platforms like Instagram, YouTube, LinkedIn, and Facebook
- Manage raw footage, organize assets, and deliver projects on time
- Take ownership of assigned projects from concept to final delivery.
Role & Responsibilities
- You will be working with the Rust compiler and will be responsible for compiling to alternate targets such as WebAssembly
- You will be exposed with TDD for unit testing individual functions and integration testing for testing publicly exposed APIs
- Working with a Git style workflow where every commit deploys to a stagingenvironment and merged pull requests deploy to production
- Setting up CI/CD pipelines for testing and deployment (canary, staging) using Github actionsaccording to project needs
- Developing software in Rust
- Maintaining and improving existing rust codebases.
Job Description – Business Process Manager
Position: Full-Time
Location: Work from Office Role at Phase 8 Mohali Punjab
About the Role
We are looking for a Process Manager to help us transform into a process-driven, BPO-style organization. The role focuses on building scalable systems, clear SOPs, and efficient workflows to manage multiple projects smoothly.
- Key ResponsibilitiesDesign and document end-to-end processes and SOPs for different functions.
- Build frameworks for scalable operations, similar to BPO setups like Teleperformance/eClerx.
- Ensure process compliance and quality control across teams.
- Implement basic performance metrics (KPIs/SLAs) to track efficiency.
- Support team training to ensure adoption of new processes.
- Requirements5–10 years of experience in process management, operations, or BPO/KPO setups.
- Strong skills in process design, documentation, and standardization.
- Good communication and change management abilities.
- Knowledge of tools for workflow and operations management is a plus.
Job Title: Site Reliability Engineer (SRE)
Experience: 4+ Years
Work Location: Bangalore / Chennai / Pune / Gurgaon
Work Mode: Hybrid or Onsite (based on project need)
Domain Preference: Candidates with past experience working in shoe/footwear retail brands (e.g., Nike, Adidas, Puma) are highly preferred.
🛠️ Key Responsibilities
- Design, implement, and manage scalable, reliable, and secure infrastructure on AWS.
- Develop and maintain Python-based automation scripts for deployment, monitoring, and alerting.
- Monitor system performance, uptime, and overall health using tools like Prometheus, Grafana, or Datadog.
- Handle incident response, root cause analysis, and ensure proactive remediation of production issues.
- Define and implement Service Level Objectives (SLOs) and Error Budgets in alignment with business requirements.
- Build tools to improve system reliability, automate manual tasks, and enforce infrastructure consistency.
- Collaborate with development and DevOps teams to ensure robust CI/CD pipelines and safe deployments.
- Conduct chaos testing and participate in on-call rotations to maintain 24/7 application availability.
✅ Must-Have Skills
- 4+ years of experience in Site Reliability Engineering or DevOps with a focus on reliability, monitoring, and automation.
- Strong programming skills in Python (mandatory).
- Hands-on experience with AWS cloud services (EC2, S3, Lambda, ECS/EKS, CloudWatch, etc.).
- Expertise in monitoring and alerting tools like Prometheus, Grafana, Datadog, CloudWatch, etc.
- Strong background in Linux-based systems and shell scripting.
- Experience implementing infrastructure as code using tools like Terraform or CloudFormation.
- Deep understanding of incident management, SLOs/SLIs, and postmortem practices.
- Prior working experience in footwear/retail brands such as Nike or similar is highly preferred.
Job Description –Analytics Engineering Lead
About Freespace* (a.k.a. Workplace Fabric)
Workplace Fabric develops solutions that makes workplaces intelligent. Our solutions help increase productivity of office workers while helping to lower the cost of real estate. Our Flagship
product Freespace is installed in over 40 cities around the world and serves over 30,000 people every day. Starting with the first deployment in March 2016 we have rapidly grown with our solution being rolled out globally while continuing to stay cash positive. With successes at several blue-chip clients Workplace Fabric has carved a unique leadership position in workplace management and employee engagement SaaS solutions.
*To find out more, follow us on social media – LinkedIn & Facebook @ workplace-fabric
What is on our offer?
- An absolutely action packed, fun, and demanding workplace lets our employees to thrive in a team-based environment with passion, fun, pride and teamwork as our core values.
- We can offer you career opportunities to challenge, develop and exceed your aspirations with training and development throughout your career.
- Life is never dull at Freespace as there is always something to learn, constantly pushing you to develop your skills and take on the next exciting challenge.
Profile Brief:
This is a fantastic opportunity to work at the heart of a data driven organisation to shape the business insights crucial to our clients as they return to the workplace.
You will work closely with the Analytics product owner to build and develop a strong, motivated, cross functional analytics team, delivering high quality, creative solutions for clients.
You have overall responsible for the analytics development team and delivery. Set the direction to ensure the team can meet the exciting and challenging demands, using different technologies. Own the delivery of the product roadmap and lead through a tight scrum process to deliver quality, timely solutions.
Work closely with the product owner and client facing teams to ensure the client needs are well understood when developing and delivering innovative solutions.
The lead role will have experience in leading development teams to deliver web solutions and will have a passion for data and analytics. They will understand how to manage big data and should ideally also have an understanding of industry leading analytics platforms, specifically Tableau. As such, should have experience in leading teams with cross disciplinary skills working on multiple platforms.
They will be well versed in working across the organisation with senior technical leads to ensure the analytics service and solutions meets the organisational technology standards and delivers secure, compliant and accurate solutions for the client.
Education
- Master’s degree in Computer Science, Computer Engineering or equivalent work experience
- If you have the right experience and skills but don’t have a relevant degree, please apply for the role.
Key Skills and Experience
- Required Skills: Team Leadership, Scrum
- Good to have: JavaScript (ES6+), SQL, Nodejs, React, AWS, TypeScript, amCharts, D3.js (or industry equivalent), Tableau understanding
Experience: 6-10 years
- Proven track record in growing and developing a high-performance team.
- Experience working with big data architectures and analytics.
- In-depth knowledge of regulatory rules surrounding data.
- Ability to understand, design and fully document end-to-end scalable IoT systems.
- Knowledge of Well-Architected solutions using AWS Services (eg Lambda, Athena, S3 etc).
- Knowledge in developing frontend applications and ideally analytics dashboards using .js charts.
- Comfortable with JavaScript, ES6+, TypeScript & emerging web technologies.
- Data processing and manipulation experience and able to easily comprehend and write efficient SQL queries.
- Able to lead the team but get stuck in and contribute.
- Rich experience of handling multi-national clients.
- Excellent written and verbal communication skills in English.
Key Behaviors
- Be passionate about understanding the business problem and using data to tell the stories in delivering solutions which drive client decisions.
- Inspire, develop and mentoring a motivated, enthusiastic team.
- Lead by example and ensuring best practice principles embedded within the team.
- Own the delivery of the product roadmap through Scrum and ensure team resourced and assigned appropriately
- See projects through from conception into production and support, ensuring quality throughout.
- Ensure high standards by instilling data quality checks, code reviews and documentation in work and team practices.
- Clear thinker with a systematic problem-solving approach, breaking the problem down into simple achievable and realistically estimated steps.
- Able to challenge solutions and processes in creating the best products and environment to work.
- Be unafraid to own mistakes
- Always ensure customer priority and focus
Key Areas of Responsibilities:
- Partner with Corporate IT Security Architects, the Development Head and CTO to ensure adherence to security practices and compliance for Infrastructure Engineering.
- Partner with Product Management, Engineering and Support teams to collaboratively develop architectures and to support them conform to high standards of security practices and compliance.
To build brand’s advocacy on social media with creative conceptualization and execution of
memorable campaigns
Apply if you have
▪ Social media custodian with extensive experience in adapting the brand brief into
shareable social content
▪ Experience in unique social media content creation, implementation, and optimization
▪ Ability to work with cross functional teams for end-to-end solutions.
▪ Excellent creative thinking and communication skills, both verbal and written.
▪ High proficiency in using social media tools like buffer/ sprout social etc
- Build responsive web-pages
- Experience in Javascript, jQuery, CSS, HTML5
- Expert in JavaScript who can build up a JavaScript framework from scratch.
- Possess good knowledge in front-end performance tuning.
- Understands how to use the page speed tool and tackle on issue based on its suggestions.
- Consume REST API's provided by the backend team
- Experience in some modern JavaScript framework like easyUI or reactJS would be a plus









