Cutshort logo
Product and Service based company logo
Data Engineer
Product and Service based company
Data Engineer
Product and Service based company's logo

Data Engineer

at Product and Service based company

Agency job
4 - 8 yrs
₹15L - ₹30L / yr
Hyderabad, Ahmedabad
Skills
skill iconAmazon Web Services (AWS)
Apache
Snow flake schema
skill iconPython
Spark
Apache Hive
skill iconPostgreSQL
Cassandra
ETL
skill iconJava
skill iconScala
skill iconC#
HDFS
yarn
CI/CD
skill iconJenkins
JIRA
Apache Kafka

Job Description

 

Mandatory Requirements 

  • Experience in AWS Glue

  • Experience in Apache Parquet 

  • Proficient in AWS S3 and data lake 

  • Knowledge of Snowflake

  • Understanding of file-based ingestion best practices.

  • Scripting language - Python & pyspark

CORE RESPONSIBILITIES

  • Create and manage cloud resources in AWS 

  • Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies 

  • Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform 

  • Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations 

  • Develop an infrastructure to collect, transform, combine and publish/distribute customer data.

  • Define process improvement opportunities to optimize data collection, insights and displays.

  • Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible 

  • Identify and interpret trends and patterns from complex data sets 

  • Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders. 

  • Key participant in regular Scrum ceremonies with the agile teams  

  • Proficient at developing queries, writing reports and presenting findings 

  • Mentor junior members and bring best industry practices.

 

QUALIFICATIONS

  • 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales) 

  • Strong background in math, statistics, computer science, data science or related discipline

  • Advanced knowledge one of language: Java, Scala, Python, C# 

  • Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake  

  • Proficient with

  • Data mining/programming tools (e.g. SAS, SQL, R, Python)

  • Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)

  • Data visualization (e.g. Tableau, Looker, MicroStrategy)

  • Comfortable learning about and deploying new technologies and tools. 

  • Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines. 

  • Good written and oral communication skills and ability to present results to non-technical audiences 

  • Knowledge of business intelligence and analytical tools, technologies and techniques.

Familiarity and experience in the following is a plus: 

  • AWS certification

  • Spark Streaming 

  • Kafka Streaming / Kafka Connect 

  • ELK Stack 

  • Cassandra / MongoDB 

  • CI/CD: Jenkins, GitLab, Jira, Confluence other related tools

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Bits In Glass
at Bits In Glass
3 candid answers
Nikita Sinha
Posted by Nikita Sinha
Remote, Hyderabad, Pune, Mohali
5 - 10 yrs
Upto ₹45L / yr (Varies
)
BOOMI
Groovy
skill iconJavascript

Key Responsibilities:


  • Design and Development: Design, develop, test, and deploy complex integration processes using Dell Boomi's platform, considering architecture and design best practices.
  • Collaboration: Collaborate with cross-functional teams and stakeholders to identify integration requirements and develop solutions that meet business needs.
  • API Development: Develop and maintain APIs, connectors, and other integration components, including REST and SOAP APIs for multi-country e-commerce platforms.
  • Troubleshooting: Troubleshoot and resolve complex integration issues, ensuring data quality, integrity, and security.
  • Documentation: Develop and maintain technical documentation for integration processes.
  • Best Practices: Stay up-to-date with Dell Boomi's latest features and best practices.


Required Qualifications:


  • Experience: 5-10 years of experience in Dell Boomi development or similar integration technologies.
  • Dell Boomi Expertise: Strong knowledge of Dell Boomi's platform, including API management, data integration, and workflow automation.
  • API Design: Experience with API design and development, including REST and SOAP APIs.
  • Data Formats: Strong understanding of data formats, including XML, JSON, and CSV.
  • Data Mapping: Experience with data mapping and transformation.
  • Programming Skills: Experience with scripting languages like Groovy or JavaScript.
  • Agile Methodologies: Experience with Agile development methodologies.
  • Communication: Excellent communication and collaboration skills.


Qualifications:


  • Architecture: Experience with architecture and design considerations for integration solutions.
  • Deployment Models: Knowledge of deployment models, including cloud and on-premises.
  • Multi-Country E-commerce: Experience designing APIs for multi-country e-commerce platforms.
  • Validation and Security: Strong understanding of validation and security best practices for integrations.
  • Authentication: Experience configuring and managing authentication mechanisms, such as OAuth and Basic Authentication.
  • EDI Integration: Experience integrating EDI (Electronic Data Interchange) systems using Dell Boomi.
Read more
Ekronne Services
Rafat Shaikh
Posted by Rafat Shaikh
Mumbai
2 - 5 yrs
₹6L - ₹9L / yr
skill icon.NET
ASP.NET
skill iconC#

Job description.

  • Determine and define project scope and objectives Organizing and managing all phases

of the project to ensure on-time completion

  • Predict resources needed to reach objectives and manage resources in an effective and

efficient manner

  • Prepare budget based on scope of work and resource requirements
  • Track project costs in order to meet budget
  • Develop and manage a detailed project schedule and work plan
  • Provide project updates on a consistent basis to the management about strategy,

planning, adjustments, and progress
Utilize industry best practices, techniques, and standards throughout entire project
execution

  • Monitor progress and make adjustments as needed
  • Measure project performance to identify areas for improvement
  • Maintains organization's effectiveness and efficiency by defining, delivering, and

supporting strategic plans.

  • Maintaining a safe and secure work environment, and developing personal growth opportunities.

Job Types: Full-time, Regular / Permanent

Salary: ₹50,000.00 - ₹75,000.00 per month
 
Candidates Preferably from Mira road or near by location only

Read more
Bengaluru (Bangalore), Mumbai
2 - 9 yrs
₹4L - ₹30L / yr
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconHTML/CSS
skill iconJavascript
TypeScript
+3 more
 Expertise in Angular 2/4/5 framework - Must needed skill
 Experience in UX/UI designing and development.
 Strong knowledge in UI/ MVC architecture.
 Strong knowledge on HTML 5/ CSS3 standards.
 Experience in UI Metadata Development (SASS or LESS).
 Experience in Bootstrap, Material design frameworks.
 Strong knowledge in Javascript and its frameworks like Jquery, React, Dojo etc.
 Strong knowledge in Typescript, Ajax, JSON and XML.
 Hands on experience in UI optimization best practice implementations.
 Technical expertise in the design, development, coding, testing, and debugging of software.
Read more
Extramarks
at Extramarks
4 recruiters
Prachi Sharma
Posted by Prachi Sharma
Noida, Delhi, Gurugram, Ghaziabad, Faridabad
2 - 5 yrs
₹7L - ₹12L / yr
Content Writing
Technical Writing
Creative Writing
Blogging

We are looking for a creative storyteller aka Content writer who is digital savvy and has a good hold on brand content strategy and initiatives. The successful candidate will be responsible for building brand content across all internal as well as external platforms. Most importantly, this individual should have a high sense of ownership, who can conceptualize and strategize our visual and written content endeavours.

 

Role & Responsibilities:

Work closely with business and product managers to understand content strategy objectives and deliverables.

Strong project manager with the ability to engage productively and successfully with key stakeholders from creative, media, marketing, product, and research teams.

Look after short form of content such as push notifications, SMS, emails & social media; as well as SEO driven long form of organic and paid content.

Understand impact of content on overall customer engagement and prioritize tasks accordingly.

Establish guidelines and best practices across teams on content generation.

 

Qualifications & Skills:

 

Demonstrated ability to manage multiple projects - prioritization, planning and task delegation.

Have experience in both long form and short form of content.

Excellent written and verbal communication skills

Good organisational and time-management/team building skills

Bachelors/ Masters in Design, Marketing, Communications, Journalism or relevant field.

Read more
Beetonz Infotech
at Beetonz Infotech
1 recruiter
Manohar Varu
Posted by Manohar Varu
Surat
0 - 3 yrs
₹2L - ₹3L / yr
skill iconiOS App Development
skill iconObjective C
skill iconSwift
iPhone SDK
Job description
We’re looking for iOS Mobile Application Developer who has solid knowledge of iOS application’s life cycle, specially in modern mobile application. We need someone to build the native applications for iOS using Swift & Objective-C on Xcode. You’ll need to create applications from scratch or configure the existing applications.

  • RESPONSIBILITIES:


i. Design and implement applications from initial concept, app architecture, and user interface to finished deliverable.
ii. Implement new features, enhancements, and content of existing applications.
iii. Implement design of native application using Auto Layout Guide & Constraints in Interface Builder.
iv. Create and update re-usable code libraries to streamline app development cycle.
v. Contribute to all phases of the product development: design, develop, test, maintain and improvise.

  • BASIC SKILLS:


i. Good communication and interpersonal skills.
iii. Having experience with Auto Layout Guide.
iv. Strong knowledge of current iOS development languages (Swift & Objective-C).
v. Ability to manage multiple projects at a time.
vi. Flexibility and eagerness to identify, learn, and use new and changing technologies.
v. Self Confident and Enthusiastic.

  • Contract length: 12 Month


Job Types: Full-time, Contract, Fresher

Pay: 16,000- ₹22,000 per month
Read more
Wolf of Webstreet
at Wolf of Webstreet
1 recruiter
Rohit Langde
Posted by Rohit Langde
Pune
0 - 1 yrs
₹2L - ₹2L / yr
Content Marketing
Link building
Marketing & Communication
SEMRush
Search Engine Optimization (SEO)
+1 more
More than Experience, we are looking for Enthusiasm in candidate and willing to learn. Qualification: Doesn't matter but should be good in English (Verbal and Written). You will be responsible for content promotion using link building strategies. It includes keyword research, content ideas curation and email outreach.
Read more
Quorum Technology
Quorum Technology
Agency job
via Billowpeople Services by Sirisa Anand
Pune
3.6 - 8 yrs
₹5L - ₹17L / yr
Windows Azure
Azure
skill iconDocker
skill iconKubernetes
DevOps
+8 more
Bachelor’s degree in Computer Science or related field or higher-level education equivalent

 4 – 6 years of application development with design, development, implementation, and
support experience, including the following:
o C#
o JavaScript
o HTML
o SQL
o Messaging/RabbitMQ
o Asynchronous communication patterns
 Experience with Visual Studio and Git
 A working understanding of build and release automation, preferably with Azure DevOps
 Excellent understanding of object-oriented concepts and .Net framework
 Experience in creating reusable libraries in C#
 Ability to troubleshoot and isolate/solve complex bugs, connectivity issues, or OS related
issues
 Ability to write complex SQL queries and stored procedures in Oracle and/or MS SQL
 Proven ability to use design patterns to accomplish scalable architecture
 Understanding of event-driven architecture
 Experience with message brokers such as RabbitMQ
 Experience in the development of REST APIs
 Understanding of basic steps of an Agile SDLC
 Excellent communication (both written and verbal) and interpersonal skills
 Demonstrated accountability and ownership of assigned tasks
 Demonstrated leadership and ability to work as a leader on large and complex tasks
Read more
MindTickle
at MindTickle
1 video
11 recruiters
Namrata Priya
Posted by Namrata Priya
Pune
5 - 14 yrs
₹10L - ₹35L / yr
Data security
Information security
Privacy
data privacy
GDPR
+2 more

Job Brief:

 

You'll be joining Mindtickle’s InfoSec and Compliance team, which is responsible for various functions related to Security, Privacy, and Compliance around Mindtickle's rapidly growing cloud platform. You'll play a crucial role in all our compliance & information security initiatives, including but not limited to those arising from regulations (e.g., GDPR, CCPA, UK DPA 2018, FINRA), audit requirements (e.g., SOC 2, HIPAA), and customer/ prospects requests (typically large enterprises).

 

As Data Privacy & Compliance Manager, you will champion the highest data privacy standards and drive forward compliance across all of Mindtickle. Crucial to this role will be an expert knowledge of international data protection laws and a proactive and pragmatic approach towards data privacy and compliance. 

 

Key Responsibilities:

  • Act as the single point of contact for all privacy-related topics, including communication with customers and prospects, including RFPs, emails, or privacy calls

  • Closely working with the internal legal team and external legal counsel to support the review of third parties/customer data processing addendums (DPAs), standard contractual clauses, contracts, and other data protection agreements

  • Maintain the data protection terms agreed with customers in a contract management software

  • Perform due diligence of new third parties and periodic risk review of existing third parties, including processes around sub-processors

  • Support in other industry compliance projects such as ADA, Section 508, WCAG, FINRA, 21 CFR Part 11, etc.

  • Lead the assessment of new legislation or other regulatory changes (GDPR, CCPA, UK DPA 2018, LGPD, PIPEDA, Swiss FDAP) and make recommendations as necessary to ensure that risks are mitigated as well as ongoing compliance

  • To work flexibly and collaboratively across all teams in the organization while driving privacy & compliance-related projects, including sales, customer success, product, and engineering

  • Own internal and external privacy audit projects, including planning, scoping, need analysis, ongoing project management, and communications with all relevant stakeholders

  • Onboard privacy solutions, design, build and deploy data privacy programs on the solutions to ensure compliance with privacy requirements

  • Maintain Records of Processing Activities (ROPA) and ensure Privacy By Design for new features/changes in the platform

  • Undertake all other reasonable and related tasks associated with this role

Desired Qualification:

  • 5-10 years of experience in data privacy and compliance, with exposure to cloud software platforms

  • Extensive experience in data protection and knowledge of relevant legislation, including GDPR, Standard Contractual Clauses, Transfer Impact Assessment, CCPA, UK DPA 2018, LGPD, PIPEDA, Swiss FDAP, etc.

  • Certifications such as CIPP/E, CIPP/US, CIPM, CIPT, etc., are preferred

  • Specialist knowledge in a relevant area, e.g., data security and individual rights requests

  • Excellent communication, interpersonal, project management, and issue resolution skills

  • Excellent analytical skills, organizational skills, ingenuity, and the ability to work as part of a team

  • Experience in managing privacy audits and risk management processes

  • Demonstrated ability to learn quickly, take the initiative, and drive complex projects

 

Read more
EmerTech Innovations
at EmerTech Innovations
1 recruiter
Aarti T
Posted by Aarti T
Navi Mumbai
0 - 2 yrs
₹3.6L - ₹7L / yr
skill iconReact.js
skill iconJavascript
skill iconRedux/Flux
Position: Front-end Developer
We are looking for a ReactJS Developer to be responsible for the development and maintenance of web-apps that are UX friendly, with good problem-solving skills and the ability to learn and apply new concepts.
● Experience or willingness to excel in ReactJS - State management, React Hooks, Lifecycle Events.
Experience with Redux is highly preferred.
● Good knowledge and experience in implementing React architectural patterns.
● In depth understanding of JavaScript, the DOM, and modern CSS (especially Flexbox and
grid layout).
● Good understanding of integration with third-party NPM libraries.
● Experience in working with at least one component library like Ant Design, React Strap,
React-Bootstrap, etc.
● Proficient in Git version control.
● Experience in interacting with REST endpoints. Familiarity with NodeJS is a plus.
Read more
Analytics Consulting Company
Analytics Consulting Company
Agency job
via Unnati by Veena Salian
Mumbai
3 - 7 yrs
₹12L - ₹15L / yr
skill iconReact.js
User Interface (UI) Design
skill iconJavascript
skill iconjQuery
skill iconRedux/Flux
+7 more
Do you want to use your software skills and contribute to finding meaningful technology driven solutions for various kinds of businesses and grow your career, then read on.
 
Our client provides data-based process optimization and analytics solutions to businesses worldwide. Their innovative algorithms and customized IT solutions cater to complex problems related to every field or industry, through tools that are non standard and are backed-up by extensive research. They serve startups as well as large, medium and small enterprises, a majority of their clients being industry leaders.
 
With registered offices in India, USA and UAE, their projects support various sectors and functions like logistics, IT, Retail, Ecommerce, Healthcare industry among others, across Asia, America and Europe. The founder holds a Master’s degree from IIT and a PhD in Operations Research from USA, with rich experience in Optimization and Analytics for various industries. His team of top scientists and pedagogy experts are focusing on innovative revenue generation ideas with minimum operational costs.
 
As a UI Developer (React), you will be responsible for converting UI/UX design framework into actual codes that will product visual elements of the application and design solutions.
 
What you will do:
  • Working with the UI/UX designer and bridge the gap between graphical design and technical implementation, taking an active role on both sides and defining how the application looks as well as how it works.
  • Being able to develop new user facing features.
  • Ensuring the technical feasibility of UI/UX designs.
  • Optimizing application for maximum speed and scalability.
  • Assuring that all user input is validated before submitting to the back end.
  • Collaborating with other team members and stakeholders.

 


Candidate Profile:

What you need to have:

  • Proficient understanding of web mark-up, including HTML5, CSS3
  • Basic understanding of CSS pre-processing platforms, such as LESS and SASS
  • Rock-solid understanding of JavaScript. Should have experience in React, Redux, or any other state management library.
  • Huge plus if you are worked on complex UIs which involved drag & drop interactions.
  • Good understanding of asynchronous request handling, partial page updates and AJAX.
  • Hands-on experience in optimizing the UI of an application.
  • Proficient understanding of cross-browser compatibility issues and ways to work around them.
  • Proficient understanding of code versioning tools, such as Git.
  • Knowledge about Docker, Nginx, Angular and RxJs are nice to have and adds as a bonus.

 

Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos