Cutshort logo
Consulting and Services company logo
Data Engineer
Consulting and Services company
Data Engineer
Consulting and Services company's logo

Data Engineer

at Consulting and Services company

Agency job
5 - 10 yrs
₹5L - ₹30L / yr (ESOP available)
Hyderabad, Ahmedabad
Skills
skill iconAmazon Web Services (AWS)
Apache
skill iconPython
PySpark

Data Engineer 

  

Mandatory Requirements  

  • Experience in AWS Glue 
  • Experience in Apache Parquet  
  • Proficient in AWS S3 and data lake  
  • Knowledge of Snowflake 
  • Understanding of file-based ingestion best practices. 
  • Scripting language - Python & pyspark 

 

CORE RESPONSIBILITIES 

  • Create and manage cloud resources in AWS  
  • Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies  
  • Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform  
  • Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations  
  • Develop an infrastructure to collect, transform, combine and publish/distribute customer data. 
  • Define process improvement opportunities to optimize data collection, insights and displays. 
  • Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible  
  • Identify and interpret trends and patterns from complex data sets  
  • Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders.  
  • Key participant in regular Scrum ceremonies with the agile teams   
  • Proficient at developing queries, writing reports and presenting findings  
  • Mentor junior members and bring best industry practices  

 

QUALIFICATIONS 

  • 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales)  
  • Strong background in math, statistics, computer science, data science or related discipline 
  • Advanced knowledge one of language: Java, Scala, Python, C#  
  • Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake   
  • Proficient with 
  • Data mining/programming tools (e.g. SAS, SQL, R, Python) 
  • Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum) 
  • Data visualization (e.g. Tableau, Looker, MicroStrategy) 
  • Comfortable learning about and deploying new technologies and tools.  
  • Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines.  
  • Good written and oral communication skills and ability to present results to non-technical audiences  
  • Knowledge of business intelligence and analytical tools, technologies and techniques. 

 

Familiarity and experience in the following is a plus:  

  • AWS certification 
  • Spark Streaming  
  • Kafka Streaming / Kafka Connect  
  • ELK Stack  
  • Cassandra / MongoDB  
  • CI/CD: Jenkins, GitLab, Jira, Confluence other related tools 
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

AdTech Industry
AdTech Industry
Agency job
via Peak Hire Solutions by Dhara Thakkar
Noida
4 - 8 yrs
₹20L - ₹30L / yr
Office 365
Network Security
Microsoft Windows Azure
Microsoft Office
Windows Azure
+26 more

Review Criteria

  • Strong IT Engineer Profile
  • 4+ years of hands-on experience in Azure/Office 365 compliance and management, including policy enforcement, audit readiness, DLP, security configurations, and overall governance.
  • Must have strong experience handling user onboarding/offboarding, identity & access provisioning, MFA, SSO configurations, and lifecycle management across Windows/Mac/Linux environments.
  • Must have proven expertise in IT Inventory Management, including asset tracking, device lifecycle, CMDB updates, and hardware/software allocation with complete documentation.
  • Hands-on experience configuring and managing FortiGate Firewalls, including routing, VPN setups, policies, NAT, and overall network security.
  • Must have practical experience with FortiGate WiFi, AP configurations, SSID management, troubleshooting connectivity issues, and securing wireless environments.
  • Must have strong knowledge and hands-on experience with Antivirus Endpoint Central (or equivalent) for patching, endpoint protection, compliance, and threat remediation.
  • Must have solid understanding of Networking, including routing, switching, subnetting, DHCP, DNS, VPN, LAN/WAN troubleshooting.
  • Must have strong troubleshooting experience across Windows, Linux, and macOS environments for system issues, updates, performance, and configurations.
  • Must have expertise in Cisco/Polycom A/V solutions, including setup, configuration, video conferencing troubleshooting, and meeting room infrastructure support.
  • Must have hands-on experience in Shell Scripting / Bash / PowerShell for automation of routine IT tasks, monitoring, and system efficiencies.


Job Specific Criteria:

  • CV Attachment is mandatory
  • Q1. Please share details of experience in troubleshooting (Rate out of 10, 10 being highly experienced) A. Windows Troubleshooting B. Linux Troubleshooting C. Macbook Troubleshooting
  • Q2. Please share details of experience in below process (Rate out of 10, 10 being highly experienced) A. User Onboarding/Offboarding B. Inventory Management
  • Q3. Please share details of experience in below tools and administrations (Rate out of 10, 10 being highly experienced) A. FortiGate Firewall B. FortiGate WiFi C. Antivirus Endpoint Central D. Networking E. Cisco/Polycom A/V solutions F. Shell Scripting/Bash/PowerShell G. Azure/Office 365 compliance and management
  • Q4. Are you okay for F2F round (Noida)?
  • Q5. What's you current company?
  • Q6. Are you okay for rotational shift (10am - 7pm and 2pm to 11pm)?


Role & Responsibilities:

We are seeking an experienced IT Infrastructure/System Administrator to manage, secure, and optimize our IT environment. The ideal candidate will have expertise in enterprise-grade tools, strong troubleshooting skills, and hands-on experience configuring secure integrations, managing endpoint deployments, and ensuring compliance across platforms.

  • Administer and manage Office 365 suite (Outlook, SharePoint, OneDrive, Teams etc) and related services/configurations.
  • Handle user onboarding and offboarding, ensuring secure and efficient account provisioning and deprovisioning.
  • Oversee IT compliance frameworks, audit processes, and IT asset inventory management, attendance systems.
  • Administer Jira, FortiGate firewalls and Wi-Fi, antivirus solutions, and endpoint management systems.
  • Provide network administration: routing, subnetting, VPNs, and firewall configurations.
  • Support, patch, update, and troubleshoot Windows, Linux, and macOS environments, including applying vulnerability fixes and ensuring system security.
  • Manage Assets Explorer for device and asset management/inventory.
  • Set up, manage, and troubleshoot Cisco and Polycom audio/video conferencing systems.
  • Provide remote support for end-users, ensuring quick resolution of technical issues.
  • Monitor IT systems and network for performance, security, and reliability, ensuring high availability.
  • Collaborate with internal teams and external vendors to resolve issues and optimize systems.
  • Document configurations, processes, and troubleshooting procedures for compliance and knowledge sharing.


Ideal Candidate:

  • Proven hands-on experience with:
  • Office 365 administration and compliance.
  • User onboarding/offboarding processes.
  • Compliance, audit, and inventory management tools.
  • Jira administration, FortiGate firewall, Wi-Fi, and antivirus solutions.
  • Networking fundamentals: subnetting, routing, switching.
  • Patch management, updates, and vulnerability remediation across Windows, Linux, and macOS.
  • Assets Explorer/inventory management
  • Strong troubleshooting, documentation, and communication skills.

 

Preferred Skills:

  • Scripting knowledge in Bash, PowerShell for automation.
  • Experience working with Jira and Confluence.


Perks, Benefits and Work Culture:

  • Competitive Salary Package
  • Generous Leave Policy
  • Flexible Working Hours
  • Performance-Based Bonuses
  • Health Care Benefits 
Read more
Resources Valley
at Resources Valley
1 recruiter
Manind Gupta
Posted by Manind Gupta
Jaipur, Bengaluru (Bangalore)
2 - 8 yrs
₹4L - ₹15L / yr
skill iconPython
skill iconDjango
skill iconFlask

Job description

Job Overview:


The position requires an experienced and ambitious candidate who is passionate about technology and is self-driven. We have a challenging workplace where we welcome innovative ideas and offers growth opportunities and positive environment for accomplishing goals. Our purpose is to create abundance for everyone we touch.


Job Description:


  • Experience on Open Source Platforms in designing/ developing Web-based applications.
  • Require Strong knowledge in Python with application/package/module development, tuning, and debugging tools.
  • Proficient understanding of Python Identifiers, Reserved Words, Basic Operators, Variable Types, and User defined exception handling with their usage.
  • In-depth knowledge of Python Dictionary and default modules included in Python (String, DateTime, Numbers, and other required functions usage).
  • Proficient understanding of Sequences and its differences (Tuples/Lists).
  • File manipulation-using Python (Create, Edit, and Delete view file).
  • Ability to organize code logically and with the understandable procedure that is well defined, documented, and testable.
  •  

Skills Required:


  • Strong understanding of OOPS and Design Patterns (Code design skills in Python-based object-oriented programming and functional programming).
  • Developing Web Applications with Python - Hands on experience using MVC frameworks like Django.
  • Exposure to Code Versioning Systems such as Atlassian Bitbucket.
  • In-depth Knowledge in JavaScript and jQuery.
  • The candidate must display excellent written and verbal skills with demonstrated interpersonal and organizational abilities.
Read more
SquareShiftco
at SquareShiftco
6 recruiters
George Vasanthan
Posted by George Vasanthan
Hyderabad
5 - 10 yrs
₹7L - ₹15L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
Object Oriented Programming (OOPs)
+1 more

Java/J2EE Developer:

SquareShift is a young and fast-growing cloud consulting company, solving cloud challenges through excellence in technology, thought leadership, and quality in execution. We are based in Singapore, with a world-class engineering team in India. 

Founded by serial entrepreneurs, we are a team of tech-enthusiasts who have strong expertise in enterprise product development and cloud technologies. As an early and core member of the team, you will work with founders and will own the organization's business development efforts.

  • 5+ years of experience in Java and J2EE
  • Expertise in Object Oriented Programming and Design Patterns
  • Experience with Web Services (SOAP/REST), JMS, XML
  • Experience working with relational databases like Oracle, MSSQL
  • Proficient in writing SQL Queries and knowledge on PL/SQL
  • Experience with multi-tiered application architecture
  • Knowledge of writing secure and optimized code
  • Experience with Version Control Systems preferably GIT
  • Working experience of build and continuous integration tools – MAVEN and JENKINS
  • Strong knowledge of unit testing technologies – JUNIT
  • Exceptional defect analysis, triaging and fixing skills
  • Experience in Agile Software Development (Scrum or Kanban)
Read more
Linarc Inc
at Linarc Inc
3 recruiters
jhansi peter
Posted by jhansi peter
Chennai
4 - 9 yrs
₹15L - ₹35L / yr
skill iconPython
skill iconDjango

What We’re Looking For

  • 4+ years of backend development experience in scalable web applications.
  • Strong expertise in Python, Django ORM, and RESTful API design.
  • Familiarity with relational databases like PostgreSQL and MySQL databases
  • Comfortable working in a startup environment with multiple priorities.
  • Understanding of cloud-native architectures and SaaS models.
  • Strong ownership mindset and ability to work with minimal supervision.
  • Excellent communication and teamwork skills.


Read more
OmnePresent
Sonali Shinde
Posted by Sonali Shinde
Pune
2 - 6 yrs
₹4L - ₹9L / yr
skill iconJava

Job Location: Pune (Hybrid)

Note:

  • For onboarding, you will have to sign a 2.5 years service agreement with the company.

Job Description:

  • CANDIDATE SHOULD BE OPEN TO LEARNING AND WORKING ON NEW TECHNOLOGIES

  • Experience in OutSystems platforms

  • Experience in Web Application Development and Mobile Development

  • Certification in OutSystems technology Web or Mobile

  • Experience in creating applications using 4LC

  • Experience in debugging processes using Service Center

  • Experience in integrating various systems into OutSystems and external DB

  • Experience using integration studio

  • Experience with Reactive Web Applications will be added advantage

Read more
Seanergy Digital India Pvt Ltd
Hyderabad, Visakhapatnam
3 - 8 yrs
₹7L - ₹30L / yr
skill icon.NET
ASP.NET
skill iconC#
MVC Framework
ASP.NET MVC

Position Type: Full Time


Location: Hitech City, Hyderabad

Required Skills :

- Should have 3-8 years in .Net programming using .Net MVC or .Net Core.

- Must have hands-on experience with C# programming including .NET Framework, ASP.NET, and ADO.NET.

- Strong OOPS concepts and Unit Testing experience is a must.

- Experience on React.js is added advantage.

Read more
ARM Worldwide
at ARM Worldwide
2 recruiters
Tanshi Chaturvedi
Posted by Tanshi Chaturvedi
Gurugram, Mumbai
3 - 5 yrs
₹5L - ₹7L / yr
Project Management
IT project management
Project budget
Communication Skills
Agile/Scrum
  • Discussing potential projects and their parameters with clients, executives, and software developers.
  • Planning out the blueprints for software projects, including defining the scope, allocating resources, setting deadlines, laying out communication strategies, and indicating tests and maintenance.
  • Assembling and leading the project team.
  • Participating in and supervising each stage of the project.
  • Ensuring each project stays on schedule and adheres to the deadlines.
  • Creating a project budget and ensuring the project adheres to the budget as closely as possible.
  • Determining and overseeing consistent testing, evaluation, and troubleshooting of all products in all stages of completion.
  • Tracking milestones, deliverables, and change requests.
  • Serving as a liaison to communicate information regarding changes, milestones reached, and other pertinent information.
  • Delivering completed software products to clients and performing regular checks on the products' performance.
Read more
Brainchain Technologies Pvt Ltd
Brainchain Technology
Posted by Brainchain Technology
Delhi
3 - 5 yrs
₹3L - ₹5L / yr
Content Writing
Content Writer
Creative Writing
Blogging
Responsibilities:
·      Develop content (blogs, case studies, social media posts, captions, ads, newsletters, articles, interviews) on cryptocurrency and blockchain technology to publish and distribute through website, social media and newsletters.
·      Prepare website and mobile app content.
·      Conduct research on blockchain, cryptocurrency and digital asset trends/insights and stay updated with latest developments/happenings.
·      Content writing style should be lucid and unpack the fundamentals into digestible content for the average reader.
·      Experience in content writing for cryptocurrency and blockchain, crypto exchange platforms, NFTs, online market research industry, ed-tech industry, digital advertising industry, e-commerce industry etc. is certainly a bonus.
·      Candidate should have excellent content writing skills.
·      Collaborate with internal teams to develop digital content with the objective of increasing brand reach, engagement with relevant stakeholders.

Job Type: Full-time
Salary: Negotiable
Location: Delhi NCR
Experience: 1-2 years

Note: By applying to this job position you will have an opportunity to work with a blockchain and cryptocurrency tech start-up.
Read more
Nexopay
at Nexopay
2 recruiters
Meenal Sharma
Posted by Meenal Sharma
Bengaluru (Bangalore)
3 - 7 yrs
₹6L - ₹15L / yr
skill iconJava
skill iconNodeJS (Node.js)
skill iconPython
skill iconAndroid Development
skill iconiOS App Development

About us: Nexopay helps transforming digital payments and enabling instant financing for parents, across schools and colleges world-wide.

Responsibilities:

  • Lead product development and integration efforts
  • Lead interactions with clients and integrations partners
  • Work with development leads so that product requirements are understood
  • Explore new ways of improving existing services and products
  • Identify and present innovative product solutions

 

Requirements:

  • Proven track record of technical product management
  • Must have lead 3rd party integrations in the past
  • Proven track record of guiding peers and junior members of the team.
  • Excellent English communication skills (verbal and oral)
  • Learning mindset and strong problem solving skills
  • Entrepreneur or keen interest in early stage ventures
Read more
IASHINE ENTERPRISES PVT LTD
Mohammed Ahmed
Posted by Mohammed Ahmed
Remote, Anywhere
3 - 7 yrs
₹1L - ₹4L / yr
User Interface (UI) Design
User Experience (UX) Design
skill iconHTML/CSS
Graphic Designing
Need UI/UX Designer or Website / Android /iOS / Portal/ Kiosk Designing with work flow. Wire Framing familiarity with UI tools needs be a Team player and provide timely update to respective project team. Latest and Modern designer skills required HTML/CSS is a plus along with Angular JS.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos