Cutshort logo
consulting & implementation services in the area of Oil & Gas, Mining and Manufacturing Industry logo
Data Engineer
consulting & implementation services in the area of Oil & Gas, Mining and Manufacturing Industry
Data Engineer
consulting & implementation services in the area of Oil & Gas, Mining and Manufacturing Industry's logo

Data Engineer

at consulting & implementation services in the area of Oil & Gas, Mining and Manufacturing Industry

Agency job
5 - 7 yrs
₹18L - ₹25L / yr
Ahmedabad, Hyderabad, Pune, Delhi
Skills
AWS Lambda
AWS Simple Notification Service (SNS)
AWS Simple Queuing Service (SQS)
skill iconPython
PySpark
Cassandra
skill iconMongoDB
skill iconScala
SAS
skill iconJava
EMC GreenPlum
AWS glue
AWS Athena
Snowflake
  1. Data Engineer

 Required skill set: AWS GLUE, AWS LAMBDA, AWS SNS/SQS, AWS ATHENA, SPARK, SNOWFLAKE, PYTHON

Mandatory Requirements  

  • Experience in AWS Glue
  • Experience in Apache Parquet 
  • Proficient in AWS S3 and data lake 
  • Knowledge of Snowflake
  • Understanding of file-based ingestion best practices.
  • Scripting language - Python & pyspark 

CORE RESPONSIBILITIES 

  • Create and manage cloud resources in AWS 
  • Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies 
  • Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform 
  • Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations 
  • Develop an infrastructure to collect, transform, combine and publish/distribute customer data.
  • Define process improvement opportunities to optimize data collection, insights and displays.
  • Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible 
  • Identify and interpret trends and patterns from complex data sets 
  • Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders. 
  • Key participant in regular Scrum ceremonies with the agile teams  
  • Proficient at developing queries, writing reports and presenting findings 
  • Mentor junior members and bring best industry practices 

QUALIFICATIONS 

  • 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales) 
  • Strong background in math, statistics, computer science, data science or related discipline
  • Advanced knowledge one of language: Java, Scala, Python, C# 
  • Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake  
  • Proficient with
  • Data mining/programming tools (e.g. SAS, SQL, R, Python)
  • Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
  • Data visualization (e.g. Tableau, Looker, MicroStrategy)
  • Comfortable learning about and deploying new technologies and tools. 
  • Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines. 
  • Good written and oral communication skills and ability to present results to non-technical audiences 
  • Knowledge of business intelligence and analytical tools, technologies and techniques.

  

Familiarity and experience in the following is a plus:  

  • AWS certification
  • Spark Streaming 
  • Kafka Streaming / Kafka Connect 
  • ELK Stack 
  • Cassandra / MongoDB 
  • CI/CD: Jenkins, GitLab, Jira, Confluence other related tools
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

CIEL HR Services
at CIEL HR Services
19 recruiters
Swati M
Posted by Swati M
Bengaluru (Bangalore)
2 - 5 yrs
₹8L - ₹15L / yr
skill iconData Analytics
Redpoint
Red point

Analytical tool:  Redpoint 

  • Research and drawing insights  
  • Excellent written, oral and presentation skill  
  • Critical thinking and problem-solving skill
  • Applications: SQL, Redpoint  

Description:  



  • Create unique fleet rich database using multi step matching rules  
  • Critical thinking in identifying record survivor ship rules for identifying master record  
  • Data roll-up at different levels, by providing linkage across databases  
  • Learn issues clients are currently facing with their dataset  
  • Foresee the problems in solving the issue during project planning based on historical work  
  • Convert requirements into process flow. Customize & automate the process for upkeep  
  • Helps clients identify their best Industry based on multiple KPIs’  
  • Helps understand complete market, penetration level and available market  
  • Identify core segments which can be penetrated with less effort.  
  • Prioritize existing data to increase the penetration level
  • Helps understand complete market, penetration level and available market  
  • Identify core segments which can be penetrated with less effort.
  • Prioritize existing data to increase the penetration level
Read more
Qrata
at Qrata
7 recruiters
Prajakta Kulkarni
Posted by Prajakta Kulkarni
Mumbai, Bengaluru (Bangalore)
1 - 6 yrs
₹3L - ₹9L / yr
Recruitment
Recruitment/Talent Acquisition

We are currently hiring for multiple Talent Acquisition Partner positions for our team at www.qrata.co, Qrata is a talent startup that helps scale funded startups globally, we work with most of the top VCs in India as well as help build remote engineering teams for US/Europe-based startups. We will be launching our talent product to analyze talent using machine learning to help our customers find the right fit.

 

Responsibilities

 

  • Build an effective candidate pipeline through Inbound/Outbound sourcing channels with minimal dependency
  • Source and recruit candidates by using databases, social media, and hiring portals (Naukri, IIM Jobs, LinkedIn etc.) and other creative sources
  • Plan and execute candidate engagement activities, including owning the candidate experience from start to finish, pre-onboarding engagement, and post-joining engagement.
  • Keep track of employee growth and the company's atmosphere and culture to ensure that it remains pleasant and productive.
  • Research, mapping, company analysis, pitching, understanding the startup ecosystem, having intelligent discussions with talent and founders, preparing talent for interviews, and following up with talent are all things which need to be handled.
  • Drive outcomes with zeal, think and act fast, and function long-term and in the best interests of the organization.

 

What are we Looking for

 

  • Ability to work with a wide range of clients, including senior level business leaders and seasoned professional candidates within the engineering organization; proficient in using data to guide decisions and change
  • Recognize how to recruit and keep the best brains from all walks of life while harnessing the potential of a diverse workforce.
  • Ability to mix the position of strategic talent adviser with a sense of urgency while also managing and achieving outcomes in a fast-paced, expanding environment
  • Proven track record of developing talent pipelines and sourcing
  • Continuously developing talent pipelines and identifying suitable individuals is a plus.
  • A thorough grasp of and application of recruitment metrics to guide decision-making is highly recommended.
  • Ability to talk intelligently about the firm and respond to any technical inquiries posed by a prospective recruit
  • 3 plus years of experience

 

Star Points if you have

  • Startup Experience
  • Effective client contact abilities at all levels
  • Interpersonal skills and the capacity to interact effectively in a professional setting
  • Consistent with our beliefs and values
  • Initiative/leadership experience in projects or events
  • Solid understanding of LinkedIn, Naukri, IIM platforms.
Read more
Tyroo Technologies
at Tyroo Technologies
1 recruiter
Pragati Rawat
Posted by Pragati Rawat
Gurugram
1 - 3 yrs
₹2L - ₹6L / yr
skill iconPython
skill iconNodeJS (Node.js)
RESTful APIs
WebSocket
Microservices
+1 more

Introduction:

Tyroo’s Vidtech.ai is one of the largest independent marketing automation cloud built for the video first world. We build softwares and platforms that allow our partners to derive maximum yields on their marketing spends on various video first social platforms. We work on problems that involve building high availability, low latency solutions which require computing optimal decisions using various self-created modules as well as pre-available modules popular in the ML and Big Data world.

 

We are looking for a back-end developer who has at least 1 years professional experience in building systems on either Python or Node.js and is able to become an anchor/pillar for the team. The role will require you to architect and develop systems/features needed for our marketing automation products. Strong leadership and mentoring skills are also necessary so that the individual can train, educate and manage junior resources.

 

 

Key Requirements:

  • Must be able to tackle complex business problems by breaking it down into set of simpler problems and architect solutions for the same
  • Must exhibit thought leadership and should be committed towards mentoring and team building
  • Must have excellent communication skills as the individual needs to collaborate with Business and Product team
  • Must be proactive towards changing software development landscape and keep upskilling
  • Must be able to contribute in setting up best practices and effective design patterns in complete development lifecycle.

 

Technical Requirements:

  • Must have 1+ years’ experience in developing scalable systems on Python/Node.js with strong grasp on microservices and serverless architectural patterns
  • Must have prior experience with databases like MySQL, Elasticsearch, MongoDB, Redis
  • Must be exposed to cloud platforms like AWS or GCP and containerization using Dockers
  • Must have worked with RESTful APIs and WebSockets
  • Must have deep understanding of HTTP, web browsers and token-based authentication/authorization (OAuth, JWT)
  • Must be experienced on Version Control Tools (Git) and Package Managers (npm, yarn, pip)
  • Must adhere to coding standards and have the habit of doing unit testing along with regular and rigorous code reviews
  • Should know about microservices orchestration using Kubernetes, web servers like Nginx/Apache and queuing systems like Kafka/Kinesis
Read more
An US based firm offering permanent WFH
An US based firm offering permanent WFH
Agency job
via Jobdost by Mamatha A
Remote only
3 - 10 yrs
₹5L - ₹10L / yr
DevOps
skill iconKubernetes
skill iconAmazon Web Services (AWS)
CI/CD
skill iconJenkins
+6 more

A network of the world's best developers - full-time, long-term remote software jobs with better compensation and career growth.  We enable our clients to accelerate their Cloud Offering, and Capitalize on Cloud.  We have our own IOT/AI platform and we provide professional services on that platform to build custom clouds for their IOT devices.  We also build mobile apps, run 24x7 devops/site reliability engineering for our clients.


This person MUST have:

  • B.E Computer Science or equivalent
  • 2+ Years of hands-on experience troubleshooting/setting up of the Linux environment, who can write shell scripts for any given requirement.
  • 1+ Years of hands-on experience setting up/configuring AWS or GCP services from SCRATCH and maintaining them.
  • 1+ Years of hands-on experience setting up/configuring Kubernetes & EKS and ensuring high availability of container orchestration.
  • 1+ Years of hands-on experience setting up CICD from SCRATCH in Jenkins & Gitlab.
  • Experience configuring/maintaining one monitoring tool.
  • Excellent verbal & written communication skills.
  • Candidates with certifications - AWS, GCP, CKA, etc will be preferred
  • Hands-on experience with databases (Cassandra, MongoDB, MySQL, RDS).

Experience:


  • Min 3 years of experience as SRE automation engineer building, running, and maintaining production sites. Not looking for candidates who have experience only as L1/L2 or Build & Deploy..

Location:

  • Remotely, anywhere in India

Timings:

  • The person is expected to deliver with both high speed and high quality as well as work for 40 Hours per week (~6.5 hours per day, 6 days per week) in shifts which will rotate every month.

Position:

  • Full time/Direct
  • We have great benefits such as PF, medical insurance, 12 annual company holidays, 12 PTO leaves per year, annual increments, Diwali bonus, spot bonuses and other incentives etc.
  • We dont believe in locking in people with large notice periods.  You will stay here because you love the company.  We have only a 15 days notice period.
Read more
WhizCo
at WhizCo
2 recruiters
Aastha Goel
Posted by Aastha Goel
Delhi, Gurugram, Noida, Ghaziabad, Faridabad
2 - 4 yrs
₹6L - ₹10L / yr
skill iconReact Native
skill iconReact.js
skill iconJavascript
skill iconRedux/Flux
Job Description:

We are looking for 2-3 year expierenced React Native developer interested in building performant mobile apps on both the iOS and Android platforms. You will be responsible for architecting and building these applications, as well as coordinating with the teams responsible for other layers of the product infrastructure. Building a product is a highly collaborative effort, and as such, a strong team player with a commitment to perfection is required.

Responsibilities

  • Build pixel-perfect, buttery smooth UIs across both mobile platforms.
  • Leverage native APIs for deep integrations with both platforms.
  • Diagnose and fix bugs and performance bottlenecks for performance that feels native.
  • Reach out to the open source community to encourage and help implement mission-critical software fixes—React Native moves fast and often breaks things.
  • Maintain code and write automated tests to ensure the product is of the highest quality.
  • Transition existing React web apps to React Native.


Skills

  • Firm grasp of the JavaScript language and its nuances, including ES6+ syntax.
  • Knowledge of functional or object-oriented programming
  • Ability to write well-documented, clean Javascript code
  • Rock solid at working with third-party dependencies and debugging dependency conflicts
  • Familiarity with native build tools, like XCode, Gradle, Android Studio.
  • Understanding of REST APIs, the document request model, and offline storage
  • Experience with automated testing suites, like (Jest or Mocha)
Read more
Smart Owls
at Smart Owls
1 recruiter
Sarika Grover
Posted by Sarika Grover
Jalandhar
2 - 7 yrs
₹2.5L - ₹5L / yr
skill iconAndroid Development
skill iconiOS App Development
Analytical Skills
Problem solving
skill iconKotlin
  • Candidate Must be well versed with latest SDK versions, XCode, Objective C, Swift, UIKit, Cocoa etc.
  • Expertise in integrating web services (XML/ JSon etc.) with iPhone applications.
  • An experience in using Maps API, GPS services for iPhone/ iOS apps is required.
  • Experience with third-party libraries and APIs.
  • Working knowledge of the general mobile orientation, architectures, trends, and emerging technologies.
  • Experience working with iOS frameworks such as Core Data, Core Animation, Core Graphics and Core Text, Core Location.
  • To take care of build and release process (Adhoc releases, Final release).
  • Should have worked on cocoa touch, story board, core data, auto layout.
  • Hands-on experience in Cloud APIs, push notifications, social media integration, and integration of analytics is an added advantage.
  • Must have good analytical, debugging, App publishing and problem solving skills.
  • Self-starter having the ability to independently acquire the knowledge required in succeeding his job.
Read more
Casey Foods
at Casey Foods
7 recruiters
HR Coordinator
Posted by HR Coordinator
Remote, Balangir
4 - 7 yrs
₹2L - ₹3L / yr
Sales
Problem solving
Team leadership
  • Manage sales operations in assigned district to achieve revenue goals.
  • Supervise sales team members; the BSMs, on daily basis and provide guidance whenever needed.
  • Identify skill gaps and conduct trainings to sales team.
  • Work with team to implement new sales techniques to obtain profits.
  • Assist in employee recruitment, promotion, retention and termination activities.
  • Conduct employee performance evaluation and provide feedback for improvements.
  • Contact potential customers and identify new business opportunities.
  • Stay abreast with customer needs, market trends and competitors.
  • Maintain clear and complete sales reports for management review.
  • Build strong relationships with customers for business growth.
  • Analyze sales performances and recommend improvements.
  • Ensure that sales team follows company policies and procedures at all times.
  • Develop promotional programs to increase sales and revenue.
  • Plan and coordinate sales activities for assigned projects.
Provide outstanding services and ensure customer satisfaction.
Read more
Rapha English Solutions LLP
Sanjo Jacob
Posted by Sanjo Jacob
Bengaluru (Bangalore)
1 - 4 yrs
₹4L - ₹9L / yr
skill iconNodeJS (Node.js)
skill iconExpress
skill iconMongoDB
skill iconReact.js
RESTful APIs
Full Stack Developers who will work with the core product team which will give exposure to the end-to-end life cycle of product development. Should have experience in : Should have experience in NodeJs product development with expressJs & Mongodb Should be familiar with API integrations and development HTML5/CSS/JavaScript and familiarity with Frontend JS Frameworks Experienced with REST API implementation Exposure to scrum or another agile methodology High proficiency with development tools and workflows (modern source control systems, unit testing, continuous workflow, and such) Should have experience in React Js and react native experience is a plus
Read more
Story Digital
at Story Digital
2 recruiters
pranav gupta
Posted by pranav gupta
NCR (Delhi | Gurgaon | Noida)
0 - 1 yrs
₹3L - ₹3.6L / yr
Human Resources (HR)
Recruitment
Employee Engagement
Sourcing
Screening
Overview: Story is seeking a young HR professional who has proficient communication & people management skills. In this role, you will work to support HR operations that will include tasks like recruitment, employee engagement, grievance handling, joining and exit formalities, along with payroll and compliance activities.Job Responsibilities: - Partner with HR Business Partners, Legal, Payroll and other functional teams to ensure a comprehensive employee-centric and legally compliant approach to HR processes and make sure we are supporting them in solving our toughest people problems- Well versed in Technical and Contractual Hiring- Recruitment Process & Recruiting: Creating Job Descriptions, Sourcing & Screening Candidates, Co-ordinating with department heads for Hiring processes, negotiations, offers & ensuring a smooth interview process internally.- On-boarding & Orientations: Ensuring smooth joining & on-boarding formalities for the new joinees, with necessary documentations & legal formalities.- Ensure a seamless joining/relieving process for the employees, along with personal document collection.- Assist the Finance & Administration department for the payroll management, compensation, which includes, loss of pay, incentives, increments, stop pay, leaves, lates, etc.- Assist co-founders, administration department in employee engagement activities, etc. - Co-ordinate with department heads for Employee performance, review, target achievement, etc. - Experience in Training and DevelopmentRequirements:-0-3 years of work experience in HR.-Proficient writing and reading skills in English-Experience with Hiring platforms & employee management softwares-Scanning through Technical Profiles is an add on.-Knowledge of Labour Laws, Legal Rules & Regulations regarding HR is an add on-MSExcel or Google Sheets, is a must-Good people-handling skills, coupled with an ability to prioritise tasks and organise workload according to priority, and sticking to timelines.
Read more
LogiNext
at LogiNext
1 video
7 recruiters
Mukti Shetty
Posted by Mukti Shetty
Mumbai
7 - 10 yrs
₹15L - ₹25L / yr
skill iconJava
Application Specific Integrated Circuit (ASIC)
Spring
RESTful APIs
skill iconJavascript
+5 more
Tech Lead - JavaMumbaiAbout : LogiNextLogiNext is a cloud-based logistics and field service optimization company with core expertise in automated delivery scheduling, route optimization, live tracking of resources, and delivery validation.Using advanced machine learning algorithms, LogiNext enables its clients with omnichannel capabilities creating a seamless delivery experience for all the customers. Using automated delivery automation and dispatch for increased efficiency, route optimization to avoid local traffic hassles, live tracking of resourcesfor operative responsiveness, and delivery validation for complete transparency, LogiNext helps companies process same-day and even two-hour deliveries.LogiNext has more than 200 enterprise clients including many satisfied retail and e-commerce players in North America, Middle-East, South and Southeast Asia. It has also been heralded by multiple platforms as being one of the fastest growing SaaS companies in the world.The true growth hackers, who paved way for this success are the people working exceptionally hard and adding value to our organisation. Our brand ambassadors - that's how we address our people, bring unique values, discipline and problem-solving skills to nurture the innovative and entrepreneurial work culture at LogiNext. Passion, versatility, expertise and a hunger for success is theMantra chanted by every Logi-Nexter!About the Role :- LogiNext is looking for a technically savvy and experienced technical architect to serve as the lead, and mentor for a growing team of strong developers. - You will help the team grow in size and skills, optimizing their code while working on your own. - With your technical expertise you will manage priorities, deadlines and deliverables, identify and mitigate the risks. - You will design and develop the products that exceed client expectations in terms of value and benefit.- You have deep expertise in building secure, high-performing and scalable systems in Java. - You have successfully managed complex and cross discipline Big Data projects in the past. - Your design intuition inclines towards usability, elegance and simplicity. - You have successfully shipped applications with beautiful front-end and intelligent backend. - You have demonstrated strong interpersonal and communication skills.Responsibilities :- Lead end-to-end design and development of cutting-edge products- Work with product management and engineering team to build highly scalable products- Keep an eye out for open source projects and technology trends that can be introduced in the products- Be hands-on, adopt practical approach to software and technology- Work closely with development team to explain the requirements and constantly monitor the progress - Suggest improvements in systems & processes and assist technical team with issues needing technical expertise- Create technical content such as blogs, technical specification documents and system integration requirements documentsRequirements :- Master's or Bachelor's in Computer Science, Information Technology, Info Systems, or related field- 7+ years of relevant experience in designing and developing scalable and distributed enterprise applications- Expertise in common frameworks like Spring, JPA, RESTful Web Services, etc. and managing and optimizing data stores such as MySQL, MongoDB, Elasticsearch, etc- Experience in front-end tools and technologies (HTML5, CSS, JavaScript, jQuery, etc) and Geographic Information System (GIS) is preferred- Experience in building the configuration details for installation, deployment and configuration of cloud automation solutions on AWS- Strong foundation in computer science, with strong competencies in data structures, algorithms and software design- Proven ability to drive large scale projects with deep understanding of Agile SDLC, high collaboration and leadership- Excellent written and oral communication skills, judgment and decision making skills, and the ability to work under continual deadline pressure
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos