Cutshort logo
Picture the future logo
Data Engineer
Picture the future
Data Engineer
Picture the future's logo

Data Engineer

at Picture the future

Agency job
4 - 7 yrs
₹5L - ₹15L / yr
Hyderabad
Skills
PySpark
Data engineering
Big Data
Hadoop
Spark
skill iconAmazon Web Services (AWS)
Apache
Snow flake schema
skill iconPython
Relational Database (RDBMS)
RESTful APIs
skill iconC#

CORE RESPONSIBILITIES

  • Create and manage cloud resources in AWS 
  • Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies 
  • Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform 
  • Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations 
  • Develop an infrastructure to collect, transform, combine and publish/distribute customer data.
  • Define process improvement opportunities to optimize data collection, insights and displays.
  • Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible 
  • Identify and interpret trends and patterns from complex data sets 
  • Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders. 
  • Key participant in regular Scrum ceremonies with the agile teams  
  • Proficient at developing queries, writing reports and presenting findings 
  • Mentor junior members and bring best industry practices 

 

QUALIFICATIONS

  • 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales) 
  • Strong background in math, statistics, computer science, data science or related discipline
  • Advanced knowledge one of language: Java, Scala, Python, C# 
  • Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake  
  • Proficient with
  • Data mining/programming tools (e.g. SAS, SQL, R, Python)
  • Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
  • Data visualization (e.g. Tableau, Looker, MicroStrategy)
  • Comfortable learning about and deploying new technologies and tools. 
  • Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines. 
  • Good written and oral communication skills and ability to present results to non-technical audiences 
  • Knowledge of business intelligence and analytical tools, technologies and techniques.


Mandatory Requirements 

  • Experience in AWS Glue
  • Experience in Apache Parquet 
  • Proficient in AWS S3 and data lake 
  • Knowledge of Snowflake
  • Understanding of file-based ingestion best practices.
  • Scripting language - Python & pyspark

 

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

NonStop io Technologies Pvt Ltd
Kalyani Wadnere
Posted by Kalyani Wadnere
Pune
5 - 7 yrs
Best in industry
skill iconJava
Selenium
Selenium Web driver
CI/CD
Appium
+11 more

About NonStop io Technologies:

NonStop io Technologies is a value-driven company with a strong focus on process-oriented software engineering. We specialize in Product Development and have a decade's worth of experience in building web and mobile applications across various domains. NonStop io Technologies follows core principles that guide its operations and believes in staying invested in a product's vision for the long term. We are a small but proud group of individuals who believe in the 'givers gain' philosophy and strive to provide value in order to seek value. We are committed to and specialize in building cutting-edge technology products and serving as trusted technology partners for startups and enterprises. We pride ourselves on fostering innovation, learning, and community engagement. Join us to work on impactful projects in a collaborative and vibrant environment.


Brief Description:

We are seeking a highly skilled QA Automation Engineer with strong expertise in Java and Selenium to join our growing engineering team. The ideal candidate will play a key role in designing, developing, and maintaining scalable test automation frameworks while ensuring high product quality across releases.


Roles and Responsibilities:

● Design, develop, and maintain robust automation frameworks using Java and Selenium

● Build automated test scripts for web applications and integrate them into CI CD pipelines

● Collaborate closely with developers, product managers, and business analysts to understand requirements and define effective test strategies

● Participate in sprint planning, requirement reviews, and technical discussions

● Perform root cause analysis for defects and work with engineering teams for resolution

● Improve automation coverage and reduce manual regression effort

● Ensure test environments, test data, and execution reports are maintained and documented

● Mentor junior QA engineers and promote best practices in automation

● Develop, execute, and maintain comprehensive test plans and test cases for manual and automated testing

● Perform functional, regression, performance, and security testing to ensure software quality

● Design and develop automated test scripts using tools such as Selenium, Appium, or similar frameworks

● Identify, document, and track software defects, working closely with development teams for resolution

● Ensure test coverage by working closely with developers, product managers, and other stakeholders

● Establish and maintain continuous integration (CI) and continuous deployment (CD) pipelines for test automation

● Conduct API testing using tools like Postman or RestAssured

● Collaborate with cross-functional teams to enhance the overall quality of the product

● Stay up to date with the latest industry trends and best practices in QA methodologies and automation frameworks


Requirements:

● 5 to 7 years of experience in QA automation

● Strong hands-on experience with Java and Selenium WebDriver

● Experience in building or enhancing automation frameworks from scratch

● Good understanding of TestNG or JUnit

● Experience with Maven or Gradle

● Familiarity with CI CD tools such as Jenkins, GitHub Actions, or similar

● Strong understanding of Agile Scrum methodology

● Experience with API testing tools such as Rest Assured or Postman is a plus

● Knowledge of version control systems like Git

● Strong analytical and problem-solving skills

● Strong understanding of software testing life cycle (STLC) and defect lifecycle management

● Experience with version control systems (e.g., Git)

● Relevant certifications in software testing (e.g., ISTQB) are desirable but not required

● Solid understanding of software testing principles, methodologies, and techniques

● Excellent analytical and problem-solving skills

● Strong attention to detail and a commitment to delivering high-quality software

● Good communication and collaboration skills, with the ability to work effectively in a team environment


Good to Have:

● Experience with performance testing tools

● Exposure to cloud platforms such as AWS or Azure

● Knowledge of containerization tools like Docker

● Experience in BDD frameworks such as Cucumber.


Why Join Us?

● A collaborative and learning-driven environment

● Exposure to AI and software engineering innovations

● Excellent work ethic and culture


If you're passionate about technology and want to work on impactful projects, we'd love to hear from you!

Read more
Lorven technologies Inc
Bengaluru (Bangalore)
4 - 8 yrs
₹2L - ₹13L / yr
skill icon.NET
skill iconC#
skill iconReact.js
Azure
Azure Service
+1 more

Required Capabilities:-

Primary Skills: .Net Core, ReactJS, Azure (Azure, Key Vault , Azure Function, Azure service bus, Azure Blob storage, Cosmos, App insights, App services)

  • Significant software development experience in front-end, back-end, and cloud automation.
  • Agile team experience, following best practices for architecture, design, and testing with high code quality.
  • Proficient in .Net/C# programming and React.
  • Strong SQL Server skills.
  • Familiar with Redis.
  • Knowledge of CI/CD pipelines.
  • Understanding of Azure Storage accounts and service bus.
  • Experience with Azure or other cloud hosting.
  • Familiarity with Entity Framework.
  • Expertise in .Net API


Read more
An Indian energy and power company.
An Indian energy and power company.
Agency job
via Jobdost by Sathish Kumar
Ahmedabad
3 - 10 yrs
₹5L - ₹15L / yr
Network Security
Cyber Security
IT security
Web application security
Torrent Power is an Indian energy and power company, having interests in power generation, transmission, distribution and manufacturing and supply of power cables.

Security (AM/Executive)

• To design the security infrastructure / policies for the organisation, implement & monitor the same
• To ensure security compliance with respect to recommendations received from government agencies like CEA, NCIIPC
• Design, review, implement & monitor IT security related controls as part of Internal
• Controls, IFC, ERM
• ISMS certification (ISO 27001) for IT systems; this will include preparation and periodic review of policies and SOPs, regular trainings and maintaining records in prescribed formats
• Conducting internal security audit and generating reports by deploying VA tools
• Periodic security/VAPT audits and implementation of the findings
• IT security related new initiatives like - Security Operations Centre (SOC), Security Information and Event Management (SIEM), cloud security, EMM-enterprise mobility management
• Creating IT Security awareness within the organisation
Read more
Housing.com
Nandipati Yaswanth Kumar
Posted by Nandipati Yaswanth Kumar
Kochi (Cochin)
6 - 9 yrs
₹9L - ₹14L / yr
Team Lead
Client Acquisition
b2b sales
Field Sales

Housing.com

Role: Team Manager

Department: Developer Sales

Location: Kochi

 

Housing.com

 

Founded in 2012 and acquired by REA India in 2017, Housing.com is India’s most innovative real estate advertising platform for homeowners, landlords, developers, and real estate brokers. The company offers listings for new homes, resale homes, rentals, plots and co-living spaces in India. Backed by strong research and analytics, the company’s experts provide comprehensive real estate services that cover advertising and marketing, sales solutions for real estate developers, personalized search, virtual viewing, AR&VR content, home loans, end-to-end transaction services, and post-transaction services to consumers for both buying and renting.

 

What does this role hold for you…??

●       Accountable for maintaining relationships with priority clients.

●       Drive growth through sales planning and precise actualization and sell online space to key accounts.

●       Accountable for data management to ensure 100% coverage in assigned territory and tracking other key parameters.

●       Ensure client management, negotiation & contract development.

●       Handle client acquisition campaigns and generate leads to build a flagship brand for property services in the respective region.

●       Accountable for service delivery and ensuring client retention.

●       Provide market insights and data assessment for the marketing team to launch the right promotional and customer communication initiatives.

●       Map new projects & new builders in designated territories and acquire new projects & builders to ensure coverage across the designated territories.

●       Ensuring efficient Relationship Management with existing clients to ensure 100% coverage of new projects launched by them.

 

Apply if you have…

 

·        Worked in a real estate business.

·        Dexterity in creating and delivering presentations.

·        Passion for selling and dexterity in communicating with people at all levels.

 

 


 


Read more
Beauto Systems Private Limited
Beauto Systems
Posted by Beauto Systems
Pune
5 - 10 yrs
₹1L - ₹8L / yr
skill iconJava
AWS CloudFormation
skill iconDocker
Solution architecture
Java Architecture for XML Binding (JAXBJava Architecture for XML Binding...

Position: Solution Architect (Java)

Company ProfileBeauto Systems Pvt. Ltd.

Address :

Office 203, Pride Gateway Tower, Veerbhadra Nagar, Baner, Pune, Maharashtra 411045

Website: https://www.beautosys.com/ 

Brief : Beauto Systems is guided by eminent leadership who have excellent technical track record yet keen to learn and deliver. Our product R&D and Innovation lab is driven by 15+ Innovators who are abreast and constantly learning the most contemporary world technology.

These values bound our employees, customers and future businesses to keep trust and faith in the services we provide in covering Software and Hardware developments, Mechanical & Electronics that can translate into end-to-end design, development and maintenance of products and services to enable business growth and value creation. We think Business value add (as a first step) to create, design and deliver our solutions !!!

Key Responsibilities:

1. Solution Design: Collaborate with stakeholders to understand business requirements and design scalable and efficient solutions that align with the company's technology strategy.

2. Technology Evaluation: Stay up-to-date with the latest industry trends and emerging technologies, and evaluate their applicability to our projects.

3. Architecture Documentation: Create and maintain detailed architecture documentation, including system diagrams, design patterns, and technical specifications.

4. Technical Leadership: Provide technical leadership and guidance to development teams, ensuring adherence to best practices and architectural standards.

5. Prototyping: Develop prototypes and proof-of-concepts to validate technical feasibility and demonstrate proposed solutions.

6. Performance Optimization: Identify performance bottlenecks and recommend optimizations to enhance system performance.

7. Risk Assessment: Assess potential risks and challenges in proposed solutions and develop mitigation strategies.

8. Collaboration: Collaborate with cross-functional teams, including developers, product managers, and quality assurance, to ensure successful project delivery.

9. Mentoring: Mentor junior architects and developers, sharing your knowledge and expertise.

10. Compliance: Ensure solutions comply with security, regulatory, and compliance requirements.

Qualifications:


Bachelor's degree in Computer Science or a related field (Master's preferred).

Minimum of 5+ years of experience in the information technology industry.

Strong proficiency in Java and experience with other programming languages is a plus.

Excellent problem-solving and analytical skills.

In-depth knowledge of software architecture principles and design patterns.

Familiarity with cloud computing platforms (e.g., AWS, Azure, GCP).

Experience with containerization and orchestration tools (e.g., Docker, Kubernetes).

Knowledge of microservices architecture and RESTful API design.

Excellent communication and interpersonal skills.

Ability to work effectively in a collaborative team environment.


Read more
Propellor.ai
at Propellor.ai
5 candid answers
1 video
Kajal Jain
Posted by Kajal Jain
Remote only
1 - 4 yrs
₹5L - ₹15L / yr
skill iconPython
SQL
Spark
Hadoop
Big Data
+2 more

Big Data Engineer/Data Engineer


What we are solving
Welcome to today’s business data world where:
• Unification of all customer data into one platform is a challenge

• Extraction is expensive
• Business users do not have the time/skill to write queries
• High dependency on tech team for written queries

These facts may look scary but there are solutions with real-time self-serve analytics:
• Fully automated data integration from any kind of a data source into a universal schema
• Analytics database that streamlines data indexing, query and analysis into a single platform.
• Start generating value from Day 1 through deep dives, root cause analysis and micro segmentation

At Propellor.ai, this is what we do.
• We help our clients reduce effort and increase effectiveness quickly
• By clearly defining the scope of Projects
• Using Dependable, scalable, future proof technology solution like Big Data Solutions and Cloud Platforms
• Engaging with Data Scientists and Data Engineers to provide End to End Solutions leading to industrialisation of Data Science Model Development and Deployment

What we have achieved so far
Since we started in 2016,
• We have worked across 9 countries with 25+ global brands and 75+ projects
• We have 50+ clients, 100+ Data Sources and 20TB+ data processed daily

Work culture at Propellor.ai
We are a small, remote team that believes in
• Working with a few, but only with highest quality team members who want to become the very best in their fields.
• With each member's belief and faith in what we are solving, we collectively see the Big Picture
• No hierarchy leads us to believe in reaching the decision maker without any hesitation so that our actions can have fruitful and aligned outcomes.
• Each one is a CEO of their domain.So, the criteria while making a choice is so our employees and clients can succeed together!

To read more about us click here:
https://bit.ly/3idXzs0" target="_blank">https://bit.ly/3idXzs0

About the role
We are building an exceptional team of Data engineers who are passionate developers and wants to push the boundaries to solve complex business problems using the latest tech stack. As a Big Data Engineer, you will work with various Technology and Business teams to deliver our Data Engineering offerings to our clients across the globe.

Role Description

• The role would involve big data pre-processing & reporting workflows including collecting, parsing, managing, analysing, and visualizing large sets of data to turn information into business insights
• Develop the software and systems needed for end-to-end execution on large projects
• Work across all phases of SDLC, and use Software Engineering principles to build scalable solutions
• Build the knowledge base required to deliver increasingly complex technology projects
• The role would also involve testing various machine learning models on Big Data and deploying learned models for ongoing scoring and prediction.

Education & Experience
• B.Tech. or Equivalent degree in CS/CE/IT/ECE/EEE 3+ years of experience designing technological solutions to complex data problems, developing & testing modular, reusable, efficient and scalable code to implement those solutions.

Must have (hands-on) experience
• Python and SQL expertise
• Distributed computing frameworks (Hadoop Ecosystem & Spark components)
• Must be proficient in any Cloud computing platforms (AWS/Azure/GCP)  • Experience in in any cloud platform would be preferred - GCP (Big Query/Bigtable, Pub sub, Data Flow, App engine )/ AWS/ Azure

• Linux environment, SQL and Shell scripting Desirable
• Statistical or machine learning DSL like R
• Distributed and low latency (streaming) application architecture
• Row store distributed DBMSs such as Cassandra, CouchDB, MongoDB, etc
. • Familiarity with API design

Hiring Process:
1. One phone screening round to gauge your interest and knowledge of fundamentals
2. An assignment to test your skills and ability to come up with solutions in a certain time
3. Interview 1 with our Data Engineer lead
4. Final Interview with our Data Engineer Lead and the Business Teams

Preferred Immediate Joiners

Read more
AKS Interactive
Kajal Tiwari
Posted by Kajal Tiwari
Delhi
1 - 3 yrs
₹3L - ₹4L / yr
IT project management
Content Management System (CMS)
Project planning
Project coordination

Hi,

 

PBF details for Project Coordinator profile:

 

 

Experience: 1+

 

Education: BTech/BE/BCA and above, PMP Certification good to have

 

Responsibility:

  1. To manage Mobile/Web Application Projects, Ecommerce and CMS Based Website Projects.
  2. Testing of these applications
  3. Ensure the projectstays under scope and under prescribed timeline 
  4. Communicate with clients and ensure the gap between client and technical team is taken care of.

Must have:

  1. Good oral and written communication and pleasing personality.
  2. Understanding of technical requirements of mobile/web apps and websites. 
Read more
Sportz Interactive
at Sportz Interactive
2 recruiters
Nishita Dsouza
Posted by Nishita Dsouza
Mumbai
4 - 10 yrs
₹8L - ₹14L / yr
skill iconNodeJS (Node.js)
skill iconReact.js
skill iconVue.js
skill iconJavascript
skill iconAmazon Web Services (AWS)

Sportz Interactive (SI) works with its clients and partners to revolutionize the sports fan experience across consumption points by creating best-in-class, kickass products. SI was founded in 2002 as a B2B sports content business. Through the years, it gained immense reputation for its state-of-the-art hosted solutions, digital simulators, match centers and fantasy games. Sportz Interactive has a fantastic reputation in the online sports community, having worked with clients across the globe including the likes of The International Cricket Council, STAR Sports, Yahoo!, AOL, Eurosport, Castrol, Web 18, NDTV, Nimbus, Times of India, Rediff.com and Singtel amongst others. 

Sportz Interactive provides in-depth sports information and content and specializes in product development for the web, mobile and other interactive platforms. 
http://www.sportzinteractive.net/">www.sportzinteractive.net 


Sportz Interactive is looking to hire smart and passionate Lead Fullstack developer who would be responsible for developing kick-ass applications and products catering to the legions of global sports fans.

Responsibilities:
• Building of user-facing elements and Integration
• Writing reusable, testable, and efficient code
• Design and implementation of low-latency, high-availability, and real time applications
• Architecting applications and strategizing them to be scalable for traffic.
• Identifying and working on new innovations which can relate to any kind of technology

Requirements:
  •  4-10 years of experience with JavaScript, JQuery, Vue.js, Node.js
  • Experience in managing a team is mandatory.
  • Understanding the nature of asynchronous programming and its quirks and workarounds
  • Good understanding of front-end technologies.
  •  Understanding fundamental design principles behind a scalable application
  • Understanding differences between multiple delivery platforms, such as mobile vs. desktop, and optimizing output to match the specific platform
  •  Creating database schemas that represent and support business processes implementing unit tests
  •  Proficient understanding of code versioning tools, such as Git
Read more
Rupeek
Rupeek
Agency job
via zyoin by Pratibha Yadav
Bengaluru (Bangalore)
5 - 9 yrs
₹22L - ₹75L / yr
skill iconJava
skill iconC++
J2EE
skill iconSpring Boot
Hibernate (Java)
+1 more
Some skills we consider critical to being a Lead Software Engineer:
● A Bachelor’s degree in Computer Science or equivalent combination of technical education and
work experience
● 5 to 9 years of Software Development experience
● Experience in system design, distributed systems, relational and No-SQL databases.
● Strong, object-oriented design and coding skills (C/C++ and/or Java preferably on a UNIX or Linux
platform)
● Solid software development background including design patterns, algorithms, data structures,
test driven development
● Any previous experience in working with Big Data or leveraging machine learning in improving
consumer experience is desirable.
● Excellent verbal and written communication skills
Read more
KrypC Technologies
at KrypC Technologies
2 recruiters
Vijayendra Human
Posted by Vijayendra Human
Bengaluru (Bangalore)
3 - 6 yrs
₹9L - ₹11L / yr
Technical Writing
Creative Writing
Documentation
KrypC is seeking capabilities for developing and updating product documentation deliverables for the KrypC product releases. Strong technical writing and editing skills are needed to produce topic-oriented technical content. Product documentation is produced in softcopy formats for delivery to customers, business partners and support representatives to provide information about concepts, tasks, and reference information related to the product software. Product documentation generally relates to installing, administering, and maintaining of product software. The candidate is responsible for planning, organizing and creating user guides, reference material and release notes for target design engineering audience. The documentation development tasks include researching and organizing initial source material into a quality draft. Source material includes product specifications, training and conference materials and engineering input. The interaction with engineering includes soliciting feedback and reviews from Applications and R&D engineers. The candidate demonstrates and implements good standard writing practices in the development of these material. The candidate should have good understanding of software knowledge along with a working knowledge of related EDA tools. Experience: Requires 4-6 years of technical writing experience with excellent written and verbal communication skills. He or she should have good problem solving skills and ability to consistently meet aggressive deadlines. Education: Requires an engineering degree or equivalent with 4-6 years of relevant software solutions and product knowledge
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos