Cutshort logo
consulting & implementation services in the area of Oil & Gas, Mining and Manufacturing Industry logo
Data Engineer
consulting & implementation services in the area of Oil & Gas, Mining and Manufacturing Industry
Data Engineer
Jobdost's logo

Data Engineer

at consulting & implementation services in the area of Oil & Gas, Mining and Manufacturing Industry

Agency job
5 - 7 yrs
₹18L - ₹25L / yr
Ahmedabad, Hyderabad, Pune, Delhi
Skills
AWS Lambda
AWS Simple Notification Service (SNS)
AWS Simple Queuing Service (SQS)
skill iconPython
PySpark
Cassandra
skill iconMongoDB
skill iconScala
SAS
skill iconJava
EMC GreenPlum
AWS glue
AWS Athena
Snowflake
  1. Data Engineer

 Required skill set: AWS GLUE, AWS LAMBDA, AWS SNS/SQS, AWS ATHENA, SPARK, SNOWFLAKE, PYTHON

Mandatory Requirements  

  • Experience in AWS Glue
  • Experience in Apache Parquet 
  • Proficient in AWS S3 and data lake 
  • Knowledge of Snowflake
  • Understanding of file-based ingestion best practices.
  • Scripting language - Python & pyspark 

CORE RESPONSIBILITIES 

  • Create and manage cloud resources in AWS 
  • Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies 
  • Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform 
  • Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations 
  • Develop an infrastructure to collect, transform, combine and publish/distribute customer data.
  • Define process improvement opportunities to optimize data collection, insights and displays.
  • Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible 
  • Identify and interpret trends and patterns from complex data sets 
  • Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders. 
  • Key participant in regular Scrum ceremonies with the agile teams  
  • Proficient at developing queries, writing reports and presenting findings 
  • Mentor junior members and bring best industry practices 

QUALIFICATIONS 

  • 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales) 
  • Strong background in math, statistics, computer science, data science or related discipline
  • Advanced knowledge one of language: Java, Scala, Python, C# 
  • Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake  
  • Proficient with
  • Data mining/programming tools (e.g. SAS, SQL, R, Python)
  • Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
  • Data visualization (e.g. Tableau, Looker, MicroStrategy)
  • Comfortable learning about and deploying new technologies and tools. 
  • Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines. 
  • Good written and oral communication skills and ability to present results to non-technical audiences 
  • Knowledge of business intelligence and analytical tools, technologies and techniques.

  

Familiarity and experience in the following is a plus:  

  • AWS certification
  • Spark Streaming 
  • Kafka Streaming / Kafka Connect 
  • ELK Stack 
  • Cassandra / MongoDB 
  • CI/CD: Jenkins, GitLab, Jira, Confluence other related tools
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Wissen Technology
at Wissen Technology
4 recruiters
Tony Tom
Posted by Tony Tom
Bengaluru (Bangalore)
2 - 10 yrs
Best in industry
skill iconJava
06692
Microservices
Multithreading
Algorithms
+1 more
  • Experience in Core Java, CXF, Spring.
  • Experience in spring boot, microservices.
  • Extensive experience in developing enterprise-scale n-tier applications for the financial domain. Should possess good architectural knowledge and be aware of enterprise application design patterns.
  • Should have the ability to analyze, design, develop and test complex, low-latency client-facing applications.
  • Good development experience with RDBMS, preferably Sybase database
  • Good knowledge of multi-threading and high volume server side development
  • Experience in sales and trading platforms in investment banking/capital markets
  • Basic working knowledge of Unix/Linux
  • Excellent problem solving and coding skills in Java
  • Strong interpersonal, communication and analytical skills.
  • Should have the ability to express their design ideas and thoughts.


Read more
Guitaa Technology
Adv Vishakh Khandelwal
Posted by Adv Vishakh Khandelwal
Jaipur
0 - 5 yrs
₹0.1L - ₹3L / yr
Sales

Should be good if experience . else intern are most welcome first. unlimited incentives will be provided

Read more
Browku Pvt Ltd
at Browku Pvt Ltd
1 recruiter
Abhishek Gupta
Posted by Abhishek Gupta
Chandigarh, Mohali, NCR (Delhi | Gurgaon | Noida), Bhopal, Pune, Ahmedabad, Indore, Lucknow, Ambala, Ludhiana
0 - 5 yrs
₹0 / mo
Business Development
Sales
Field Sales
Telesales

We are looking for someone to join an exciting, soon launching real estate based company as a Business Development intern. Not only is this job a great way to get into the corporate industry it will also be a great internship experience to showcase in your resume. No two days will be the same in this job, and the ideal candidate should be able to communicate with a wide range of clientele and manage relations with high-profile delegates.

 

Responsibilities Include

  • Generating Leads
  • Managing client relationships.
  • Increasing the exposure of the company.

 

Requirements Include

  • Excellent communication skills.
  • Graduate/Postgraduate.
  • A proven ability to work within a team.
Read more
SteelEye
at SteelEye
1 video
3 recruiters
akanksha rajput
Posted by akanksha rajput
Bengaluru (Bangalore)
4 - 6 yrs
₹15L - ₹30L / yr
skill iconDjango
skill iconFlask
skill iconPython
skill iconElastic Search
skill iconAmazon Web Services (AWS)
+1 more

Company Description

SteelEye is a fast growing FinTech company based in London and has offices in Bangalore and Paris, that offers a data platform to help financial institutions such as Investment Banks, Hedge Funds, Brokerage Firms, Asset Management Firms to comply with financial regulations in the European Union. Our clients can aggregate, search, surveillance and report on trade, communications and market data. SteelEye also enables customers to gain powerful insights from their data, helping them to trade with greater efficiency and profitability.

The company has a highly experienced management team and a strong board, who have decades of technology and management experience and worked in senior positions at many leading international financial businesses.

We are looking to hire a seasoned Sr API Developer to join us as we start on our next phase of growth. We have a culture of openness, collaboration, and the passion to get things done whilst appreciating the importance of a good work life balance.
Being part of a start-up can be equally exciting as it is challenging. You will be part of the SteelEye team not just because of your talent but also because of your entrepreneurial flare which we thrive on at SteelEye. This means we want you to be curious, contribute, ask questions and share ideas. We encourage you to get involved in helping shape our business.

 

SteelEye is a fast growing FinTech company based in London and has offices in Bangalore and Paris, that offers a data platform to help financial institutions such as Investment Banks, Hedge Funds, Brokerage Firms, Asset Management Firms to comply with financial regulations in the European Union. Our clients can aggregate, search, surveillance and report on trade, communications and market data. SteelEye also enables customers to gain powerful insights from their data, helping them to trade with greater efficiency and profitability.

The company has a highly experienced management team and a strong board, who have decades of technology and management experience and worked in senior positions at many leading international financial businesses.

We are looking to hire a seasoned Sr API Developer to join us as we start on our next phase of growth. We have a culture of openness, collaboration, and the passion to get things done whilst appreciating the importance of a good work life balance.
Being part of a start-up can be equally exciting as it is challenging. You will be part of the SteelEye team not just because of your talent but also because of your entrepreneurial flare which we thrive on at SteelEye. This means we want you to be curious, contribute, ask questions and share ideas. We encourage you to get involved in helping shape our business.

Job Description

 

What you’ll do

  • Develop new features and functionality in SteelEye's best breed SaaS application
  • Work on setup API Developer for our growing SaaS product
  • Ensure the software is up-to-date with latest technologies
  • Triage issues and enhance core features of our existing API's for rapidly growing client base
  • Design and architech our API layer solving problems around scale and performance
  • Be part of great team building a fantastic product!

 

What we’re looking for

 

  • You are experienced Python Developer, with minimum 5 years in commercial Python experience
  • You have experience building REST-based API's using Flask, Django or FastAPI in a production environment
  • You have excellent knowledge of data structures, software design patterns and software architecture
  • You are comfortable working in a fast-paced environment and can adapt to changing requirements
  • You have experience with code versioning (Git) and CI/CD (Jenkins, Circle, etc..) tools
  • Familiarity/Experience with Elasticsearch is a huge plus
  • Familiarity/Experience with FastAPI nice to have
  • You are experienced Python Developer, with minimum 5 years in commercial Python experience
  • You have experience building REST-based API's using Flask, Django or FastAPI in a production environment
  • You have excellent knowledge of data structures, software design patterns and software architecture
  • You are comfortable working in a fast-paced environment and can adapt to changing requirements
  • You have experience with code versioning (Git) and CI/CD (Jenkins, Circle, etc..) tools
  • Familiarity/Experience with Elasticsearch is a huge plus
  • Familiarity/Experience with FastAPI nice to have

 

Read more
Zyvka global services
Zyvka global services
Agency job
via Zyvka Global Services by Ridhima Sharma
Delhi, Gurugram
3 - 6 yrs
₹1L - ₹20L / yr
skill iconNodeJS (Node.js)
Data Structures
Algorithms
skill iconHTML/CSS
GraphQL
+9 more

ROLES AND RESPONSIBILITIES 

  • Proven working experience in backend app development and experience with Node JS.  
  • Build advanced ecommerce backend applications for the multiple client platforms (both React and Android).  
  • Understanding of design principles and good architecture patterns.  
  • Proper Data Structures and Algorithm knowledge is a must.  
  • Graph QL and Apollo Server knowledge.  
  • Collaborate with cross-functional teams to define, design, and ship new features. Work with outside data sources and APIs like the one of Unicommerce.  
  • Create Unit-test code for robustness, including edge cases, usability, and general reliability.  
  • Work on bug fixing and improving application performance.  
  • Continuously discover, evaluate, and implement new technologies to maximize development efficiency.  

 

  • Translate designs and wireframes into high quality code.  
  • Have a good understanding of CI/CD tools (any).  
  • Robust knowledge of popular databases like MongoDB, Elastic Search, DynamoDB, Redis etc;  
  • Knowledge about AWS Services like EC2, Lambda, Kinesis, Redshift, S3 is super plus. 
  •  

CANDIDATES MUST HAVE  

  • Node JS. 
  • Data Structures and Algorithm  
  • HTML5 and CSS3 
  • Graph QL and Apollo Server  
  • MongoDB, Elastic Search, DynamoDB, Redis 
  • AWS Services like EC2, Lambda, Kinesis, Redshift, S3  


REQUIREMENTS  

  • Bachelor's degree in computer science, information science, or similar.  
  • Extensive knowledge of JavaScript, web stacks, libraries, and frameworks.  
  • Knowledge of front-end technologies such as HTML5 and CSS3.  
  • Superb interpersonal, communication, and collaboration skills.  
  • Exceptional analytical and problem-solving aptitude.  
  • Great organisational and time management skills.  
  • Availability to resolve urgent web application issues outside of business hours 
Read more
We Build Valuable Solutions With Code
We Build Valuable Solutions With Code
Agency job
via Sygnific Services by Sheeba Patel
Mohali
2 - 8 yrs
₹8L - ₹12L / yr
MERN Stack
skill iconReact.js
skill iconNodeJS (Node.js)
Looking for ReactJS / NodeJS (MERN Stack) developer who can work full-time
from the office.
Experience Required - 2 years to 6 years
Location -A-45 Atrium of Quark city Mohali
Requirements :
We are looking for a Full-stack Node.js, React js.
- 2+ years of experience with ReactJS
- 2+ years of experience with NodeJS
- MongoDB Knowledge
-Skills : Node.js, React js HTML, CSS,javascript.
-Should have experience in working on Linux (Ubuntu) Environment and basic Linux
commands.
-You will also be responsible for integrating the front-end elements into the application.
- availability to start the work and join immediately
- good communication skill and have knowledge of Slack/Trello/GitHub/Bitbucket
Read more
Impact Guru
at Impact Guru
15 recruiters
Pooja Malde
Posted by Pooja Malde
Mumbai
1 - 5 yrs
₹5L - ₹8L / yr
Product Management
Product Manager
Analytics
Wireframing
Prototyping
Role - Associate Product Manager.
Location - Andheri (Mumbai)
 
Job Responsibilities:
 Contribute to the overall product roadmap across all platforms - web, mobile, apps -- after careful consideration of the needs of internal and external parties
 Lead development of new product offerings by conducting market research, user surveys, and the like to understand where and how we can satisfy unmet consumer needs.
 Manage the product development process from conception through wireframing, design, build, release, analysis, and iteration
 Be a critical voice of the user within Impact Guru. Ensure we are doing everything we can to help users save money.
 Employ a range of qualitative (user discovery research, focus groups, usability studies, etc.) and quantitative (surveys, analytics, market research, etc) methods to better understand our users' needs.
 Conduct A/B tests to understand how we can increase the desired use case(s) of our
products.

Skills And Qualifications:
 1-3 years of experience developing web products ideally with a background in technical
product management or web engineering.
 Capacity to think strategically, and an ability to understand how product decisions are tied to key business drivers
 Strong quantitative capabilities, and experience using analytics platforms to understand product usability (Google Suite, Adobe Analytics, FB Analytics, Omniture, Clevertap, etc.)
 Familiarity with APIs, documentation, web system architecture
 Mobile-first approach and Focus on creating super-optimized user experience for mobile users
 An understanding of what makes for good user experience and beautiful design.
 BE/BTech/BA/BS Degree in Computer Science/Engineering, business, marketing, etc.
 MBA is a plus
 Good knowledge of MySQL and/or other RDBMS
 Proficiency in MS Excel
 Proficiency in using wireframing and prototyping tools like Balsamiq, ProtoIO, inVision, etc.
Read more
Our Client company is into Computer Software. (EC1)
Our Client company is into Computer Software. (EC1)
Agency job
via Multi Recruit by Manjunath Multirecruit
Bengaluru (Bangalore)
14 - 18 yrs
₹36.4L - ₹38.7L / yr
ADF
Snowflake
Data Architect
Data architecture
Data engineering
  • Establish and maintain a trusted advisor relationship within the company’s IT, Commercial Digital Solutions, Functions, and Businesses you interact with
  • Establish and maintain close working relationships with teams responsible for delivering solutions to the company’s businesses and functions
  • Perform key management and thought leadership in the areas of advanced data techniques, including data modeling, data access, data integration, data visualization, big data solutions, text mining, data discovery, statistical methods, and database design
  • Work with business partners to define ways to leverage data to develop platforms and solutions to drive business growth
  • Engage collaboratively with project teams to support project objectives through the application of sound data architectural principles; support the project with knowledge of existing data assets and provide guidance on reusable data structures
  • Share knowledge of external and internal data capabilities and trends, provide leadership, and facilitate the evaluation of vendors and products
  • Utilize advanced data analysis, including statistical analysis and data mining techniques
  • Collaborate with others to set an enterprise data vision with solid recommendations, and work to gain business and IT consensus

Basic Qualifications

  • Overall 15+ years of IT Environment Experience.
  • Solid background as a data architect/cloud architect with a minimum of 5 years as a core architect
  • Architecting experience in the cloud data warehouse solutions (Snowflake preferred, big query/redshift/synapse analytics-nice to have)
  • Strong architecture and design skills using Azure Services( Like ADF/Data Flows/Evengrids/IOTHUB/EvenHub/ADLS Gen2 /Serverless Azure Functions/Logic Apps/Azure Analysis Services Cube Design patterns/Azure SQL Db)
  • Working Knowledge on Lambda/Kappa frameworks within the data Lake designs& architecture solutions
  • Deep understanding of the DevOps/DataOps patterns
  • Architecting the semantic models
  • Data modeling experience with Data vault principles
  • Cloud-native Batch & Realtime ELT/ETL patterns
  • Familiarity with Lucid Chart/Visio
  • Logging & monitoring pattern designs in the data lake /data warehouse context
  • Meta data-driven design patterns * solutioning expertise
  • Data Catalog integration experience in the data lake designs
  • 3+ years of experience partnering with business managers to develop technical strategies and architectures to support their objectives
  • 2+ years of hands-on experience with analytics deployment in the cloud (prefer Azure but AWS knowledge is acceptable)
  • 5+ years of delivering analytics in modern data architecture (Hadoop, Massively Parallel Processing Database Platforms, and Semantic Modeling)
  • Demonstrable knowledge of ETL and ELT patterns and when to use either one; experience selecting among different tools that could be leveraged to accomplish this (Talend, Informatica, Azure Data Factory, SSIS, SAP Data Services)
  • Demonstrable knowledge of and experience with different scripting languages (python, javascript, PIG, or object-oriented programming like Java or . NET)

Preferred Qualifications

  • Bachelor’s degree in Computer Science, MIS, related field, or equivalent experience
  • Experience working with solutions delivery teams using Agile/Scrum or similar methodologies
  • 2+ years of experience designing solutions leveraging Microsoft Cortana Intelligence Suite of Products [Azure SQL, Azure SQL DW, Cosmos DB, HDInsight, DataBricks]
  • Experience with enterprise systems, like CRM, ERP, Field Services Management, Supply Chain solutions, HR systems
  • Ability to work independently, establishing strategic objectives, project plans, and milestones
  • Exceptional written, verbal & presentation skills

 

 

Read more
Qualification : Diploma Mechanical
Qualification : Diploma Mechanical
Agency job
via Classic Job Solutions by Adhira Gaikwad
Nagpur
3 - 7 yrs
₹5L - ₹6L / yr
AutoCAD
MS-Office
MS-Excel
Qualification : Diploma Mechanical NOTE - BE candidates cannot applicable. We need Diploma only. Job Post: – JR . Engineer Experience : 0 yrs (Freshers only) Gender : Male Industry : Manufacturing Salary: -12000/- to 15000/- Location:- Nagpur / Pune
Read more
India Representation Company
NCR (Delhi | Gurgaon | Noida)
1 - 2 yrs
₹2.4L - ₹2.8L / yr
English Proficiency
Interpersonal Skills
Communication Skills
Position: Virtual Assistant (International Process) Job Timings : 9:00 am - 6:00 pm (Monday Friday) Experience Required : 1-2 Years Salary Bracket : 18-22k/month Job Brief : We are looking for a Virtual Assistant for a Canadian immigration company based in Ontario, Canada. As a Virtual Assistant, you will perform various tasks, including processing immigrations files, contacting clients for fulfilling documentation requirements, answering emails and other administrative tasks. It a great opportunity for you to work directly with an international client of IRC. Skills Required : Good communication skills Excellent time management and organization ability Graduate Good Internet skills Excellent phone, email and instant messaging communication skills Confident and outgoing Job Responsibilities: Communicate daily with the client via Skype, email, Whatsapp  Perform various administrative tasks as requested by the client Assist in processing of immigration files Interested candidates can contact on 9899348288
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos