Data Engineer

Picture the future

Data Engineer

Jobdost

Company

Home

Data Engineer

at Picture the future

Agency job

via Jobdost

4 - 7 yrs

₹5L - ₹15L / yr

Hyderabad

Skills

Spark

Hadoop

Big Data

Data engineering

PySpark

Amazon Web Services (AWS)

Apache

Snow flake schema

Python

Relational Database (RDBMS)

RESTful APIs

CORE RESPONSIBILITIES

Create and manage cloud resources in AWS
Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies
Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform
Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations
Develop an infrastructure to collect, transform, combine and publish/distribute customer data.
Define process improvement opportunities to optimize data collection, insights and displays.
Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible
Identify and interpret trends and patterns from complex data sets
Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders.
Key participant in regular Scrum ceremonies with the agile teams
Proficient at developing queries, writing reports and presenting findings
Mentor junior members and bring best industry practices

QUALIFICATIONS

5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales)
Strong background in math, statistics, computer science, data science or related discipline
Advanced knowledge one of language: Java, Scala, Python, C#
Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake
Proficient with
Data mining/programming tools (e.g. SAS, SQL, R, Python)
Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
Data visualization (e.g. Tableau, Looker, MicroStrategy)
Comfortable learning about and deploying new technologies and tools.
Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines.
Good written and oral communication skills and ability to present results to non-technical audiences
Knowledge of business intelligence and analytical tools, technologies and techniques.

Mandatory Requirements

Experience in AWS Glue
Experience in Apache Parquet
Proficient in AWS S3 and data lake
Knowledge of Snowflake
Understanding of file-based ingestion best practices.
Scripting language - Python & pyspark

CORE RESPONSIBILITIES

Create and manage cloud resources in AWS
Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies
Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform
Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations
Develop an infrastructure to collect, transform, combine and publish/distribute customer data.
Define process improvement opportunities to optimize data collection, insights and displays.
Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible
Identify and interpret trends and patterns from complex data sets
Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders.
Key participant in regular Scrum ceremonies with the agile teams
Proficient at developing queries, writing reports and presenting findings
Mentor junior members and bring best industry practices

QUALIFICATIONS

5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales)
Strong background in math, statistics, computer science, data science or related discipline
Advanced knowledge one of language: Java, Scala, Python, C#
Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake
Proficient with
Data mining/programming tools (e.g. SAS, SQL, R, Python)
Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
Data visualization (e.g. Tableau, Looker, MicroStrategy)
Comfortable learning about and deploying new technologies and tools.
Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines.
Good written and oral communication skills and ability to present results to non-technical audiences
Knowledge of business intelligence and analytical tools, technologies and techniques.

Mandatory Requirements

Experience in AWS Glue
Experience in Apache Parquet
Proficient in AWS S3 and data lake
Knowledge of Snowflake
Understanding of file-based ingestion best practices.
Scripting language - Python & pyspark

Users love Cutshort

Read about what our users have to say about finding their next opportunity on Cutshort.

Subodh Popalwar

Software Engineer, Memorres

For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.

Companies hiring on Cutshort

Similar jobs

IIB ACE Developer

at Cateina Technologies Pvt Ltd

Posted by Hussain Shaikh

Mumbai

2.5 - 4 yrs

₹8L - ₹10L / yr

IIB ACE

IBM WebSphere Message Broker

IBM app connect enterprise

Job Description

Cateina Technologies is looking for IBM ACE Developers

Technical Skills

● IBM Message Broker

● IIB ACE

● Kubernetes

● Microservices

● Docker

● EAI and SOA architecture

● Java

● Web services (REST, SOAP)

● JSON, XML

● Database knowledge

● Understanding of Nodes

● Basic Unix knowledge

● Angular JS

● Jira

Required competencies

● Experience in designing, developing, implementing and supporting SDLC by using IBM integration bus/IBM connect API/IBM ACE

● Required API Banking Knowledge Banking Domain, Oracle PL SQL 16 WebSphere Message Broker IBM Integration Bus IIB

● Sound knowledge of REST XML/JSON, WSDL, SOAP, JMS, HHTP, SSL, XSLs, XST and gateway script is required

● Clear understanding of the IBM API Connect architecture and its components.

● Should be clear on the concepts of different protocols (HTTP(s) etc) and RESTful services standards.

Skills

Strong communication skills both written and verbal
Any degree

Who can apply

Candidates who:

are willing to travel to client site
willing to relocate to Mumbai

Office Location

Cateina Technologies

Vikhroli (West),

Mumbai, Maharashtra 400083

Job Description

Cateina Technologies is looking for IBM ACE Developers

Technical Skills

● IBM Message Broker

● IIB ACE

● Kubernetes

● Microservices

● Docker

● EAI and SOA architecture

● Java

● Web services (REST, SOAP)

● JSON, XML

● Database knowledge

● Understanding of Nodes

● Basic Unix knowledge

● Angular JS

● Jira

Required competencies

● Experience in designing, developing, implementing and supporting SDLC by using IBM integration bus/IBM connect API/IBM ACE

● Required API Banking Knowledge Banking Domain, Oracle PL SQL 16 WebSphere Message Broker IBM Integration Bus IIB

● Sound knowledge of REST XML/JSON, WSDL, SOAP, JMS, HHTP, SSL, XSLs, XST and gateway script is required

● Clear understanding of the IBM API Connect architecture and its components.

● Should be clear on the concepts of different protocols (HTTP(s) etc) and RESTful services standards.

Skills

Strong communication skills both written and verbal
Any degree

Who can apply

Candidates who:

are willing to travel to client site
willing to relocate to Mumbai

Office Location

Cateina Technologies

Vikhroli (West),

Mumbai, Maharashtra 400083

SysOps - DevOps Engineer

at Trellissoft Engineering Serices Pvt Ltd

Posted by Barkha Dave

Gandhinagar, Goa, Bengaluru (Bangalore)

3 - 10 yrs

₹3L - ₹10L / yr

Linux/Unix

Ubuntu

Nginx

Apache

Software deployment

+1 more

1. Experience working on Linux Ubuntu, Nginx, Application Deployment & Implementation

2. Excellent understanding of Python.

3. Configuration and managing databases such as MySQL, Mongo

4. Excellent troubleshooting

5. Working knowledge of various tools, open-source technologies, and cloud services

6. Awareness of critical concepts in DevOps and Agile principles

7. Understanding customer requirements and project KPIs

8. Implementing various development, testing, automation tools, and IT infrastructure

9. Planning the team structure, activities, and involvement in project management activities.

10. Managing stakeholders and external interfaces

11. Setting up tools and required infrastructure

12. Defining and setting development, test, release, update, and support processes for DevOps operation

13. Have the technical skill to review, verify, and validate the software code developed in the project.

14. Troubleshooting techniques and fixing the code bugs

15. Monitoring the processes during the entire lifecycle for their adherence and updating or creating new processes for improvement and minimizing the wastage

16. Encouraging and building automated processes wherever possible

17. Identifying and deploying cybersecurity measures by continuously performing vulnerability assessment and risk management

18. Incidence management and root cause analysis

19. Coordination and communication within the team and with customers

20. Selecting and deploying appropriate CI/CD tools

21. Strive for continuous improvement and build continuous integration, continuous development, and constant deployment pipeline (CI/CD Pipeline)

22. Mentoring and guiding the team members

23. Monitoring and measuring customer experience and KPIs

24. Managing periodic reporting on the progress to the management and the customer

1. Experience working on Linux Ubuntu, Nginx, Application Deployment & Implementation

2. Excellent understanding of Python.

3. Configuration and managing databases such as MySQL, Mongo

4. Excellent troubleshooting

5. Working knowledge of various tools, open-source technologies, and cloud services

6. Awareness of critical concepts in DevOps and Agile principles

7. Understanding customer requirements and project KPIs

8. Implementing various development, testing, automation tools, and IT infrastructure

9. Planning the team structure, activities, and involvement in project management activities.

10. Managing stakeholders and external interfaces

11. Setting up tools and required infrastructure

12. Defining and setting development, test, release, update, and support processes for DevOps operation

13. Have the technical skill to review, verify, and validate the software code developed in the project.

14. Troubleshooting techniques and fixing the code bugs

15. Monitoring the processes during the entire lifecycle for their adherence and updating or creating new processes for improvement and minimizing the wastage

16. Encouraging and building automated processes wherever possible

17. Identifying and deploying cybersecurity measures by continuously performing vulnerability assessment and risk management

18. Incidence management and root cause analysis

19. Coordination and communication within the team and with customers

20. Selecting and deploying appropriate CI/CD tools

21. Strive for continuous improvement and build continuous integration, continuous development, and constant deployment pipeline (CI/CD Pipeline)

22. Mentoring and guiding the team members

23. Monitoring and measuring customer experience and KPIs

24. Managing periodic reporting on the progress to the management and the customer

Sr. Accountant

at Dikazo Solutions Pvt Ltd

Posted by Shiva Kumar

chaderghat

5 - 10 yrs

₹3L - ₹5L / yr

Tally

TDS

Prepare accurate, timely financial statements in accordance with our established schedule and with input from the rest of the accounting department
Conduct monthly and quarterly account reconciliations to ensure accurate reporting and ledger maintenance
Analyze financial statements for discrepancies and other issues that should be brought to the CFO’s attention
Review all inter-company transactions and generate invoices as necessary
Reconcile balance sheet accounts
Delegate financial responsibilities to accounting team
Coordinate semi-annual audits and assist CFO with conducting audits
Conduct regular ledger maintenance

QUALIFICATION: MBA

Prepare accurate, timely financial statements in accordance with our established schedule and with input from the rest of the accounting department
Conduct monthly and quarterly account reconciliations to ensure accurate reporting and ledger maintenance
Analyze financial statements for discrepancies and other issues that should be brought to the CFO’s attention
Review all inter-company transactions and generate invoices as necessary
Reconcile balance sheet accounts
Delegate financial responsibilities to accounting team
Coordinate semi-annual audits and assist CFO with conducting audits
Conduct regular ledger maintenance

QUALIFICATION: MBA

Front End Developer

Technical Architect/CTO

at Impact Guru

15 recruiters

Posted by Pooja Malde

Mumbai

7 - 12 yrs

₹20L - ₹25L / yr

PHP

CodeIgniter

Laravel

Amazon Web Services (AWS)

Mobile App Development

+4 more

Job Responsibilities:

- Hands-on Coding experience preferably on PHP and multiple programming languages

- Preferable experience on Codeigniter and Laravel
- Hands-on/ Implementation OR exposure to Front end tools and frameworks like
Angular.js/React.js
- Strong experience handling large data (batch and real-time), workflows and scheduling,
building pluggable frameworks and systems, strong abstraction, and design skills
- Knowledge of Linux with advanced knowledge of command-line interface
- Knowledge of AWS required for cloud set up and configuration and system security
- Advance MySQL knowledge required with hand-on experience with query building and query optimization

- Exposure to building big data and machine learning systems preferred.

Must-Have:

- Excellent architecture and designing experience of highly scalable technology systems
- Currently Hands-on with coding and development process.
- Team management is highly preferred.

Job Specifications:

- Build, lead, develop and provide hands-on leadership for top-notch engineers
- Drive strategy and vision across teams in a rapidly evolving environment
- Work closely with diverse stakeholders and enable them by providing scalable, high-quality, and secure technology solutions.
- Understand company needs to define system specifications and system architecture, and ensure the implementation of agreed architecture
- Oversee assigned tasks and provide guidance to team members and follow best practices
- Take accountability for optimizing key technology and business metrics
- Drive agility in execution, create a strong team culture of responsiveness by leading by
example
- Keep eye for technology and competitive landscape to stay ahead of the trends and
competition.

Job Responsibilities:

- Hands-on Coding experience preferably on PHP and multiple programming languages

- Exposure to building big data and machine learning systems preferred.

Must-Have:

- Excellent architecture and designing experience of highly scalable technology systems
- Currently Hands-on with coding and development process.
- Team management is highly preferred.

Job Specifications:

J2EE Developer

at Mobigossip Infotech Pvt Ltd

2 recruiters

Posted by Rishi Tyagi

NCR (Delhi | Gurgaon | Noida)

4 - 5 yrs

₹5L - ₹6L / yr

JPA

Java Collection Framework

Java Networking

REST Web Services

Amazon Web Services (AWS)

+3 more

Title: J2EE Developer Experience: 4-5 Years Salary: 5-6L/A Work Location: Gurgaon Qualification: B.E/B.Tech/M.Tech/MCA/MSc.. Mandatory Skills: Java Spring MVC Frameworks, Hibernate, JSF, web Technologies, Web Applications development Java, JQuery, Debugging & Troubleshooting skills Web Technologies Key Skills: J2EE(JSP , Servlet , Java Spring MVC Framework), Hibernate, JPA,AJAX , Javascript, XML, Webservice(Rest/Soap), Websphere / Weblogic / JBoss, Database knowledge , understand when to use Design pattern Java, JEE, Javascript (JQuery/Dojo/extJS), Design patterns . Designs, develops and supports application solutions with focus on Web Technologies. This role may design, develop and/or re-engineer highly complex application components, and integrate software packages, programs and reusable objects residing on multiple platforms.

Wordpress Developer

at StarClinch

1 video

9 recruiters

Posted by Yashveer Singh

NCR (Delhi | Gurgaon | Noida)

3 - 5 yrs

₹3L - ₹4L / yr

Wordpress

Content Management System (CMS)

HTML/CSS

Responsibilities : Identify user and system requirements for the website. Create wireframes to decide on the layout. Plugins Building, Installation & Customization. Write clean code and test it throughout the development process to ensure the top-tier quality. Write or review code for various applications. MySQL database programming. API integrations. Requirements : Must have minimum 1+ Years of experience in Wordpress. Should be an expert at building Wordpress CMS websites. Candidate must have experience of Wordpress PlugIN & Theme development and customization. Expertise in the programming language, preferably PHP & MySQL.

HR Manager

Fintech NBFC

Agency job

via Global serve solutions by Prashanth Ramdas

Chennai

8 - 10 yrs

₹12L - ₹15L / yr

0066

Human Resources (HR)

Recruitment/Talent Acquisition

Performance Evaluation

Employee Engagement

*Evaluate organization vision, mission, culture and recommend, design and facilitate implementation of solutions to ensure alignment with the Company’s overall direction • Manage core Performance Management and feedback processes. Develop manager capability in employing these processes and obtaining best in class results • Ensure timely recruiting and hiring support, by developing recruitment plans and implementing lateral/campus hiring activities • Periodic evaluation of employee benefits and services to ensure the most effective and high-quality programs; administration of all benefits programs • Collaborate with management to drive workforce planning initiatives across Units, and co-ordinate annual compensation planning and dispensation • Provide proactive guidance and counsel to supervisors and team members on employee relations issues • Introduce, lead and influence change management initiatives to address issues that will enhance overall performance • Coach employees on subjects such as career, leadership and performance development plans, compensation matters • Oversee employee engagement, culture building and office administration • Develop training plans and programs; organize training sessions, workshops, and related activities

Senior Angular JS Developer

Bengaluru (Bangalore)

4 - 10 yrs

₹7L - ₹12L / yr

AngularJS (1.x)

HTML/CSS

Git

Roles and Responsibilities: Developing and integrating the frontend of our new platform based using AngularJS Writing high-quality HTML and CSS code that works across platforms Establish processes and best practices around front-end development standards. Skills / competencies: Strong knowledge in frontend development of complex web applications using AngularJS, HTML5, and CSS Secondary skills: Bootstrap, CSS animations, a versioning system (GIT, SVN) Ability to work and communicate clearly and efficiently with team members. Mandatory experience working in an Agile environment (SCRUM certification a major plus) Special Requirements: 4+ years experience in Angular JS Experience with enterprise-scale systems a major plus. Proficiency in Adobe Photoshop is a great plus

Magento Developer

at i-Vista Digital Solutions Pvt.Ltd.

1 recruiter

Posted by Soumi Poddar

Bengaluru (Bangalore)

5 - 7 yrs

₹4L - ₹7L / yr

Magento

HTML/CSS

Route16 is a young and upcoming start-up in the online commerce space, founded by experienced professionals from diverse backgrounds and great global exposure. We aim to build India’s most result oriented full services e-commerce partner for brands to amplify their online business in a proven and cost effective manner. Our model is to partner with brands to sell their products/services online under their own brand and make it contribute significantly to the top-line sales on a completely managed basis. Route16 is thus in the business of increasing a brand’s online business.

Why apply to jobs via Cutshort