Cutshort logo
Product and Service based company logo
Data Engineer
Product and Service based company
Data Engineer
Product and Service based company's logo

Data Engineer

at Product and Service based company

Agency job
4 - 8 yrs
₹15L - ₹30L / yr
Hyderabad, Ahmedabad
Skills
skill iconAmazon Web Services (AWS)
Apache
Snow flake schema
skill iconPython
Spark
Apache Hive
skill iconPostgreSQL
Cassandra
ETL
skill iconJava
skill iconScala
skill iconC#
HDFS
yarn
CI/CD
skill iconJenkins
JIRA
Apache Kafka

Job Description

 

Mandatory Requirements 

  • Experience in AWS Glue

  • Experience in Apache Parquet 

  • Proficient in AWS S3 and data lake 

  • Knowledge of Snowflake

  • Understanding of file-based ingestion best practices.

  • Scripting language - Python & pyspark

CORE RESPONSIBILITIES

  • Create and manage cloud resources in AWS 

  • Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies 

  • Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform 

  • Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations 

  • Develop an infrastructure to collect, transform, combine and publish/distribute customer data.

  • Define process improvement opportunities to optimize data collection, insights and displays.

  • Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible 

  • Identify and interpret trends and patterns from complex data sets 

  • Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders. 

  • Key participant in regular Scrum ceremonies with the agile teams  

  • Proficient at developing queries, writing reports and presenting findings 

  • Mentor junior members and bring best industry practices.

 

QUALIFICATIONS

  • 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales) 

  • Strong background in math, statistics, computer science, data science or related discipline

  • Advanced knowledge one of language: Java, Scala, Python, C# 

  • Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake  

  • Proficient with

  • Data mining/programming tools (e.g. SAS, SQL, R, Python)

  • Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)

  • Data visualization (e.g. Tableau, Looker, MicroStrategy)

  • Comfortable learning about and deploying new technologies and tools. 

  • Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines. 

  • Good written and oral communication skills and ability to present results to non-technical audiences 

  • Knowledge of business intelligence and analytical tools, technologies and techniques.

Familiarity and experience in the following is a plus: 

  • AWS certification

  • Spark Streaming 

  • Kafka Streaming / Kafka Connect 

  • ELK Stack 

  • Cassandra / MongoDB 

  • CI/CD: Jenkins, GitLab, Jira, Confluence other related tools

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Enables businesses to onboard their customers better
Enables businesses to onboard their customers better
Agency job
via Qrata by Blessy Fernandes
Chennai
1 - 5 yrs
₹10L - ₹22L / yr
skill iconReact.js
skill iconHTML/CSS
skill iconSASS
Description:
Are you a front-end developer looking to fast-track your learning and growth? Have you
looked at world class products like Asana, Notion, or Airtable, and felt “I wish I were part of
the early team that built these products”?  we’re a team that has previously built and rolled out globally successful SaaS products used by tens of thousands of customers. We’re laser focused on delivering a world class new product again, and looking for an ambitious front-end engineer to join our existing team of 9 engineers. If it excites you to think of a fast paced start-up environment, building something big from scratch, breaking down new problems, creating well structured UI components, executing on pixel perfect design, paying great attention to every little interaction detail, and doing demos of your work every Friday with a happy and passionate team, then this is the right opportunity for you.
Some of the tech problems you get to work-on as a front-end developer would include
building real-time collaboration experiences across our product, building live document
editing and modern spreadsheet experiences from scratch, creating flexible new
Kanban-style views of work tasks, and crafting cool new UI components and interactions that we will use across our product.
Tech Requirements:
● Expertise in React
● Hands-on experience in HTML, CSS, SASS & Object Oriented Javascript
● SPA Framework patterns
Browser features (Caching / Storage / Compatibility etc )

Nice to have:
● Familiarity with AWS
● Experience with startups or early stage teams
● Knowledge of module bundlers like Webpac
Read more
Bengaluru (Bangalore)
1 - 3 yrs
₹15L - ₹15L / yr
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJavascript
+4 more

As a Full Stack Developer, you'll be instrumental in shaping the future of AI assistants for data teams and understanding the intricacies of Large Language Models (LLMs) to optimise their usage across multiple use cases. Utilising Django, you'll architect backend infrastructures optimised for handling data processes and LLM interactions. Your role involves building APIs with the Django Rest Framework. With React, you'll design user-centric interfaces that seamlessly integrate with our AI assistants, ensuring that data teams have an intuitive experience. Working at the forefront of AI revolutions and pushing the boundaries of what AI can achieve in data management and analysis.


Responsibilities:

  • Back-end Development: Utilise Django to architect robust back-end infrastructures. Ensure they are tailored for complex data processes and seamless LLM interactions.
  • API Design: Craft efficient and scalable APIs using the Django Rest Framework.
  • Front-end Development: Transform UI/UX designs into functional web pages using React. Prioritise performance and deliver seamless user experiences.
  • AI Integration: Design user interfaces that flawlessly integrate with our LLMs, and AI assistants, aiming to offer data teams an intuitive and efficient interaction.
  • Innovation: Stay abreast of AI advancements. Push boundaries and explore new possibilities in data management and analysis using AI.


Requirements:

  • Pre-requisite Tech Stack: Python, Django, React, Springboot, CSS, and SQL
  • Previous work experience with a start-up or similar setting is preferred
  • Having an interest in system architecture design


Read more
JFrog
at JFrog
8 recruiters
Alpana Java
Posted by Alpana Java
Bengaluru (Bangalore)
6 - 9 yrs
Best in industry
skill iconJava
Microservices
Multithreading
skill iconGo Programming (Golang)
skill iconDocker
+1 more

At JFrog, we’re reinventing DevOps to help the world’s greatest companies innovate -- and we want you along for the ride. This is a special place with a unique combination of brilliance, spirit and just all-around great people. Here, if you’re willing to do more, your career can take off. And since software plays a central role in everyone’s lives, you’ll be part of an important mission. Thousands of customers, including the majority of the Fortune 100, trust JFrog to manage, accelerate, and secure their software delivery from code to production -- a concept we call “liquid software.” Wouldn't it be amazing if you could join us in our journey?

We are looking for an experienced, hands-on developer to join an innovative and talented R&D team, responsible for delivering fast and high quality code, using the latest frameworks and technologies.

As a Senior Software Engineer in JFrog you will... 

  • Be responsible for all development aspects form design to production of a wide hybrid/ cloud naitive product 
  • Write high quality, testable and efficient code in Java and Go
  • Initiate and promote new ideas for continuous improvement of the product functionality
  • Work closely with other team members as well as mentoring new team members

To be a Senior Software Engineer in JFrog you need...

  • 5+ years of software development experience
  • Proven deep knowledge of Java or Go
  • Deep understanding of relational databases, concurrent programming and performance tuning
  • Vast experience with large scale production environments 
  • Experience with micro services architecture, multithreading
  • Familiarity with Cloud infrastructure, Docker, Kubernetes & CI/CD
  • Disciplined approach to testing and quality assurance

 

Read more
Singapore based company
Singapore based company
Agency job
via Kalibre global konnects by Sophiya Sama
Ahmedabad
3 - 8 yrs
₹2L - ₹12L / yr
skill icon.NET
MVC Framework
ASP.NET
skill iconC#
Web API
+3 more
Job Description:

·         Job Title:- MS Dot Net MVC Developer

·         Job Location:- CG Road, Ahmedabad

·         Experience:- 3 to 8 Years

·         Number of Vacancy:- 03

 

The DotNet Developer will help to produce scalable software solutions. This person will be part of a cross-functional team that is responsible for the full software development life cycle, from conception to deployment - participating in the design and creation of scalable software, writing clean functional code, testing and fixing bugs or other coding issues. This person should be comfortable with DotNet, development frameworks and third-party libraries. This developer should also be a team player, as the role is responsible for interacting with users to define system requirements and/or necessary modifications in an Agile/Scrum environment followed by development and delivery of committed features.

Mandatory Skills Competencies:

 

·         Ability to communicate effectively with clients and teams.

·         Strong Team Player and ability to lead, guide, mentor, review track progress of team members.

·         Good interpersonal skill

·         Proven troubleshooting and debugging skills

·         Strong knowledge of OOPs and Design Pattern

·         Strong technical experience with .NET framework (4.0/4.5), C#, WEB API, http://asp.net/" target="_blank">ASP.NET MVC, JavaScript

·         Sound understanding of Database concepts experienced with SQL SERVER

·         Knowledge of Angular/React JS, Redux, Node JS, TypeScript, ES6 and Object-oriented JAVASCRIPT will be an added advantage

·         Knowledge of HTML5 and CSS3

·         Knowledge of any message queuing software (MSMQ, RabbitMQ)

·         Knowledge of writing secure code (OWASP Guidelines)

·         Experience with .NET CORE, Azure, docker and Kubernetes

·         Understanding of Code Optimization techniques, Code coverage tool and code analysis tool

·         Involved in analysis, design, development, unit testing and maintenance of detailed software modules

·         Awareness with any of revision control systems like Git/SVN/TFS/VSS etc

Read more
Telyport technologies pvt ltd
Victor James
Posted by Victor James
Bengaluru (Bangalore)
3 - 7 yrs
Best in industry
skill iconPython
Angular
skill iconReact.js
skill iconAngular (2+)
skill iconMongoDB
+2 more


About Telyport

Telyport is an emerging tech startup in the logistics space. We are building a robust hyperlocal distribution network that is affordable, convenient, and reliable for locals, SMEs, and large enterprises with a vision to bring local commerce online.

You can share your CV to victor @ telyport dot com


Job Description

We are looking for a seasoned full-stack engineer (Python, MongoDB and Angular/React or similar JS Framework) to build out and manage our entire web infrastructure. Successful candidates will have a minimum of three years’ recent experience with all of the skills listed below.

Our project entails implementing our pre-approved UI, constructing our API, connecting the two, and setting up our server infrastructure. This includes all associated areas such as database and architecture design.

Responsibilities: Build & Maintain TELYPORT INFRASTRUCTURE

- Design and implementation of the overall web architecture.

- “Pixel-perfect” implementation of our approved user interface.

- Design and deployment of our database.

- Ensuring the entire stack is designed and built for speed and scalability.

- Design and construction of our REST API.

- Integrating our front-end UI with the constructed API.

- Design and implementation of continuous integration and deployment.

Skills: Python, MongoDB & Angular/React or similar JavaScript framework

- At least three years’ experience with:

- Writing HTML, CSS, and JavaScript. Being up on latest practices is a must, e.g., HTML5, CSS3, and ECMAScript 6 (minimum)

- A relevant back-end programming language (Python)

- Database design and management, including being up on the latest practices and associated versions

- Server management and deployment for the relevant environment

- Familiarity with a relevant and globally supported framework—both front-end and back-end, if necessary— (e.g., Angular, React, Vue, Laravel or Flask)

- Ideally, familiarity with CSS preprocessors, bundlers, and associated languages/syntaxes/libraries (e.g., Sass, Less, and webpack)

- Thorough understanding of user experience and possibly even product strategy

- Experience implementing testing platforms and unit tests

- Proficiency with Git (or another version control system as required)

- Appreciation for clean and well documented code

 

This is not your typical 9-5 job. If you are a hustler, passionate about what you do and would like to challenge yourself into new areas and arenas, look no further. You will have absolute creative independence in executing your roles while at the same time be chasing aggressive goals and targets to pursue and a highly competitive group of people to challenge and learn from.

 

Experience or College Educations don’t matter. What matters is your love & passion for building technology products. Compensation will be competitive with an option for ESOPs
Read more
My client is a US based Product development company.
My client is a US based Product development company.
Agency job
Remote, Noida, NCR (Delhi | Gurgaon | Noida)
8 - 15 yrs
₹30L - ₹45L / yr
skill iconData Science
Natural Language Processing (NLP)
skill iconMachine Learning (ML)
skill iconDeep Learning
Predictive modelling

Responsibilities: 

  • Identify complex business problems and work towards building analytical solutions in-order to create large business impact.
  • Demonstrate leadership through innovation in software and data products from ideation/conception through design, development and ongoing enhancement, leveraging user research techniques, traditional data tools, and techniques from the data science toolkit such as predictive modelling, NLP, statistical analysis, vector space modelling, machine learning etc.
  • Collaborate and ideate with cross-functional teams to identify strategic questions for the business that can be solved and champion the effectiveness of utilizing data, analytics, and insights to shape business.
  • Contribute to company growth efforts, increasing revenue and supporting other key business outcomes using analytics techniques.
  • Focus on driving operational efficiencies by use of data and analytics to impact cost and employee efficiency.
  • Baseline current analytics capability, ensure optimum utilization and continued advancement to stay abridge with industry developments.
  • Establish self as a strategic partner with stakeholders, focused on full innovation system and fully supportive of initiatives from early stages to activation.
  • Review stakeholder objectives and team's recommendations to ensure alignment and understanding.
  • Drive analytics thought leadership and effectively contributes towards transformational initiatives.
  • Ensure accuracy of data and deliverables of reporting employees with comprehensive policies and processes.
Read more
Call Me Social
at Call Me Social
1 recruiter
Aditi Jain
Posted by Aditi Jain
NCR (Delhi | Gurgaon | Noida)
1 - 2 yrs
₹1.2L - ₹2.5L / yr
Social Media Marketing (SMM)
Community Management
Viral Marketing
Content Writing
Web Analytics
The job entails content planning and executing strategy for all social media forums including website.

We need an enthusiastic, creative go-getter who is sincere and passionate about social issues.

If interested pls send your resumes. 
Read more
SVAPPS SOFT SOLUTIONS PVT LTD
swetha svapps
Posted by swetha svapps
Remote, Warangal, Hyderabad
1 - 4 yrs
₹1L - ₹3L / yr
User Interface (UI) Design
User Experience (UX) Design
skill iconHTML/CSS
Graphic Designing
SVAPPS Always Looking to Grow our Team With Talented People.
-A Warm Welcome to SVAPPS Interview.
This is a Good Opportunity for You the People in Warangal.
-To make this Process Easier for All,
Please Refer Your Friends is Anyone Having Good Knowledge Self-Reliant, able to Work Independently and Accept Responsibility for Projects
Very Good Communication Skills and Interpersonal Skills
EXPERIENCE - 1 - 4Years
Job Location -Warangal.
Read more
Ness Technologies
at Ness Technologies
1 recruiter
Avinash NB
Posted by Avinash NB
Hyderabad
6 - 12 yrs
₹1L - ₹14L / yr
UFT
Software Testing (QA)
Test Automation (QA)
Selenium


Greetings from NESS Technologies!!

We are hiring "Senior QA Engineer"
Job Type: Full Time.
Experience Level: 6 - 12 Years,
Minimum and Preferred Education: Bachelor's degree in technology related field.
Location: Maximus Buiilding _ Raheja Mindspace Madhapur IT Park _ Hyderabad.

Skills Required:
6+ years of software testing experience in all phases of testing including test planning ,test execution and test closure
Excellent understanding of QA and testing methodologies, best practices
3+ years of experience as an Automation QA Tester
3+ years of experience creating, maintaining, and executing automation tests utilizing tools such as UFT, Tricentis Tosca, Selenium required (Python preferred)
3+ Years of experience in Agile processes (Scrum preferred)
Web Service Testing using SOAP UI & Postman (Rest services preferred)
Experience creating and maintaining automation frameworks preferred
Experience using SQL to query databases required
Experience with test data management techniques
Experience with change management and defect tracking tools
Zeal to be domain expert and learn new technologies
Demonstrated analytical and problem-solving skills
Excellent interpersonal skills and written communications
High standards of confidentiality; ability to handle sensitive information with integrity and trust.

Responsibilities:
Develop, maintain and execute automated and manual test scripts for functional requirements validation, integration, regression, and usability testing
Communicate effectively with team members at all levels
Follow quality assurance standards and track quality assurance activities
Learn and apply project high-level and detailed business requirements
Create test strategies, test estimation and all planning activities
Draft test artifacts, including Test Plans, Test Scenarios and Requirements Traceability Matrices
Create and maintain reusable test data for automation scripts
Create, execute and debug SQL scripts to be used for test validation
Document test results and lead defect management
Produce status reports and metrics related to the testing process
Perform analysis related to enhancements to the application
Review and maintain all project documentation in accordance with department procedures
Assist with technical artifacts and engage in technical discussions
Support testing of application and environmental upgrades as well as resolution of production issues
Maintain understanding of current and new testing technologies
Lead Lessons Learned or Project Review sessions, and identify potential work process improvements
Assist with team training needs and other responsibilities as assigned
DevOps integration of automation tools and web services.

Interested Candidates can please send the updated resume and below details 
Total Experience:
Current Location:
Current CTC:
Expected CTC:
Official notice Period:
Negotiable Notice Period:
Have you attended any interview with NESS Technologies:


Read more
E-Mobility Company in Mumbai
E-Mobility Company in Mumbai
Agency job
via Adept Global by Deonnie Rodrigues
Mumbai
4 - 9 yrs
₹5L - ₹12L / yr
skill iconReact Native
skill iconJavascript
skill iconHTML/CSS
User Interface (UI) Design
Job Description :  The ideal candidate is motivated to combine the art of design with the art of programming to help build rich, dynamic client-side applications using JavaScript, leveraging latest technologies React Native & Redux, to launch stunning, usable and scalable products for our users.  You will design digital product experiences across our product suite.  You weave iconography, typography, color, space, and texture together to help users successfully navigate our products. The React Native developer will be focused on buildinginnovative implementations while partnering with front end & back-end team.  Responsibilities will include translation of the UI/UX design wireframes to actual code that will produce visual and functional elements of the application.  You will own UI/UX designs and bridge the gap between graphical design and technical implementation, taking an active role on both sides and defining how the application looks as well as how it works.  Having a passion for what design and UI/UX can bring to an application is extremely important.  Ideally, the person that fills this role could bounce between creating visual designs and production ready code with an emphasis on the latter. Responsibilities:  Develop new user-facing features.  Build reusable code and libraries for future use.  Ensure the technical feasibility of UI/UX designs.  Optimize applications for maximum speed and scalability.  Assure that all user input is validated before submitting to back-end.  Collaborate with other team members and stakeholders.  Stay on top of UI frameworks/technology trends and best practices for web and mobile.  Jump between design and development roles.  Maintain and support organizational UI/UX patterns and methodologies. Required Experience, Skills and Qualifications:  Experience in React Native & Redux.  Deep knowledge and experience building UX & UI style and pattern guides.  Experience translating UI/UX designs to code.  Experience with prototyping tool is a big plus.  Experience in connecting with Restful Web Services.  Experience in CLIs, WebPack, Grunt, Bower etc.  Self-motivated and able to work independently or as part of a team.  Experience in a fast-paced software environment, and an ability to execute against aggressive timelines.  Highly creative and inquisitive; able to multitask effectively.  High energy level, enthusiastic, and eager to do what is necessary to be successful  You are curious, innovative, detail-oriented and an awesome team player, excited about our product, and excited to join the rest of our talented team.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos