Cutshort logo
Product and Service based company logo
Data Engineer
Product and Service based company
Data Engineer
Product and Service based company's logo

Data Engineer

at Product and Service based company

Agency job
4 - 8 yrs
₹15L - ₹30L / yr
Hyderabad, Ahmedabad
Skills
skill iconAmazon Web Services (AWS)
Apache
Snow flake schema
skill iconPython
Spark
Apache Hive
skill iconPostgreSQL
Cassandra
ETL
skill iconJava
skill iconScala
skill iconC#
HDFS
yarn
CI/CD
skill iconJenkins
JIRA
Apache Kafka

Job Description

 

Mandatory Requirements 

  • Experience in AWS Glue

  • Experience in Apache Parquet 

  • Proficient in AWS S3 and data lake 

  • Knowledge of Snowflake

  • Understanding of file-based ingestion best practices.

  • Scripting language - Python & pyspark

CORE RESPONSIBILITIES

  • Create and manage cloud resources in AWS 

  • Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies 

  • Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform 

  • Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations 

  • Develop an infrastructure to collect, transform, combine and publish/distribute customer data.

  • Define process improvement opportunities to optimize data collection, insights and displays.

  • Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible 

  • Identify and interpret trends and patterns from complex data sets 

  • Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders. 

  • Key participant in regular Scrum ceremonies with the agile teams  

  • Proficient at developing queries, writing reports and presenting findings 

  • Mentor junior members and bring best industry practices.

 

QUALIFICATIONS

  • 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales) 

  • Strong background in math, statistics, computer science, data science or related discipline

  • Advanced knowledge one of language: Java, Scala, Python, C# 

  • Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake  

  • Proficient with

  • Data mining/programming tools (e.g. SAS, SQL, R, Python)

  • Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)

  • Data visualization (e.g. Tableau, Looker, MicroStrategy)

  • Comfortable learning about and deploying new technologies and tools. 

  • Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines. 

  • Good written and oral communication skills and ability to present results to non-technical audiences 

  • Knowledge of business intelligence and analytical tools, technologies and techniques.

Familiarity and experience in the following is a plus: 

  • AWS certification

  • Spark Streaming 

  • Kafka Streaming / Kafka Connect 

  • ELK Stack 

  • Cassandra / MongoDB 

  • CI/CD: Jenkins, GitLab, Jira, Confluence other related tools

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Bengaluru (Bangalore), Mumbai, Pune, Hyderabad, Chennai, Gurugram
7 - 15 yrs
Best in industry
Oracle HCM
Oracle Cloud
Oracle Fusion

Oracle Fusion HCM Functional Consultant (Oracle workforce compensation and Talent Management)

 

 POSITION SUMMARY

 

·    7-9+ years experience in Oracle Cloud.

·    Must have experience in Oracle Fusion Cloud HCM Modules (Oracle workforce compensation and Talent Management).

·    End to end configuration of above Modules.

·    Create and update configuration books.

·    Support the preparation and execution of test scripts and resolve testing defects.

·    Create and update functional design documents.

·    Release upgrade testing.

·    Securities.

·    Good presentation and communication skills - Responsible for communicating and escalating project issues to the team leads.

·    Responsible for project deliverables from offshore for HCM Modules.

·   Exposure to structured software development life-cycle methodology.

·   Experience of working with multi-cultural teams in a geographically diverse environment.

·    Experience in creating workflow and security for the module.

·    Good to have experience in Redwood theme and Visual builder studio.


Read more
HIPPO CLOUD TECHNOLOGIES
Hyderabad, Secunderabad, Anantapur, Kadapa, Kurnool, Vijayawada
1 - 2 yrs
₹1.5L - ₹2.5L / yr
Tally
Tally ERP
Customer Support
Field Sales
Communication Skills
+1 more

We Are Hiring For Tally Customer Support

Job Role: Customer Support, Filed Sales.

Candidates Must Have Good Communication Skills.

Candidates Must Have Knowledge in Tally.

Candidates Must Have Two Wheeler.

Experience : 0 to 1 Year.

Qualification: B.com, M.com or any Degree

Job Location: Hyderabad, Secunderabad, Anantapur, Bhimavaram, Kadapa, Chirala, Vijayawada, kurnool


Read more
Matellio India Private Limited
Harshit Sharma
Posted by Harshit Sharma
Remote only
3 - 10 yrs
₹4L - ₹16L / yr
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconNodeJS (Node.js)
skill iconMongoDB
+1 more

Roles and Responsibilities 

1) Understand client requirements and functionalities. 

2) Write well-designed, testable, efficient code. 

3) Responsible for solving complex technical issues. 

4) Ensure quality projects are delivered within defined timelines. 

5) Active involvement in client communication to understand functional requirements. 

6) Maintain high standards of quality for code, documentation and other deliverables. 

 

Required Skills 

1) Good experience in React

2) Hand on Node.JS./Express JS 

3) Database : MYSQL/MongoDB 

4) Experience in Java Script, Typescript. 

5)Good experience in HTML5, CSS3, JavaScript, Jquery 

6) Experience working in an Agile environment. 

7) Good communication skills.

Read more
Appitsimple infotek Pvt. Ltd.
Kiran Guwalani
Posted by Kiran Guwalani
Ahmedabad
2 - 4 yrs
₹4.8L - ₹5.4L / yr
MS-Office
Time management
Appointment scheduling
Effective communication

Headquartered in Ahmedabad, Appitsimple is better known for its innovative "Digital Products" - SoftwareSuggest and CallHippo. It is an IT company that has been revolutionizing & simplifying the way organizations do business since Jan 2014.

 

We are a growing team of 150+ professional experts coming from diverse backgrounds who have keen expertise in dealing with Digital Products. A flexible work environment, a high level of empowerment, involvement in the company's business decisions, leadership development through mentoring, skills development initiatives are the big takeaways at Appitsimple Infotek.  

 

URL: https://appitsimple.com/about  

 

Appitsimple is looking for a highly resourceful EA to CEO with the ability to also be extremely effective independently.

 

Responsibilities:

  • Managing an active calendar of appointments of the CEO
  • Complete a broad variety of administrative tasks.
  • Provide a bridge for smooth communication between the CEO and internal departments
  • Taking MOM and working closely and effectively with the CEO to keep him well informed of upcoming commitments and responsibilities.
  • Maintain and take care of organization data.
  • Proficient in Microsoft Office.

 Requirements

  • Strong organizational skills that reflect the ability to perform and prioritize multiple tasks seamlessly with excellent attention to detail.
  • Very strong interpersonal skills and the ability to build relationships with employees 
  • Expert-level is written and verbal communication skills.
  • Demonstrated proactive approaches to problem-solving with strong decision-making capability.
  • Proven ability to handle confidential information with discretion.
  • Demonstrated ability to achieve high-performance goals and meet deadlines in a fast-paced environment.
  • Forward-looking thinker, who actively seeks opportunities and proposes solutions.
Read more
au small finance bank
at au small finance bank
1 recruiter
Nandini Agarwal
Posted by Nandini Agarwal
Jaipur
5 - 14 yrs
₹6L - ₹25L / yr
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconNodeJS (Node.js)

Job Description – Sr. Full Stack Developer


Summary

You will be responsible for the full software development Lifecyle.


Core Accountabilities

  • Motivate, develop, coach, and formally appraise the Software Development team.
  • Monitor & co-ordinate any management information and capacity relating to the work of the team.
  • Responsible for leading the software development team and providing technical guidance.
  • Responsible for full stack, architectural, solution design specification and documentation.
  • Responsible for the design, development, modification, maintenance, testing and deployment.
  • Develop fully integrated back-end to front-end innovative solutions.
  • Design, develop and maintain database solutions associated to data driven platforms.
  • Develop to high quality coding standards.
  • Responsible for project version control, coding standards, branching strategy and deployment.
  • As part of the full development life cycle you will be responsible for continuous integration testing, Unit Testing and Performance Testing.
  • Provide advanced technical support escalated from the development support team for all Voyager systems, solutions, and data sets.
  • Scope and define detailed product backlog item descriptions that feed into sprint planning.
  • Provide effective technical analysis, design requirements and relevant documentation.
  • Using appropriate tools to define and communicate the required solution. These may include user journeys, prototypes, and wireframes.
  • Coordinate release and sprint planning & conduct daily scrum meetings.
  • Develop and maintain a thorough and up-to-date working technical knowledge of digital solutions and the Voyager Worldwide product suite.
  • Develop and maintain a detailed technical understanding of our products, systems, technologies, architecture, and data sets.
  • Develop and maintain a thorough and up-to-date working technical knowledge and understanding of AI, ML and RPA technologies.
  • It should be noted that the above list of main duties and responsibilities is not necessarily a complete statement of the final duties of the post.


Qualifications & Experiences

  • 8+ years’ software engineering experience in developing data driven based software solutions.
  • 2 years’ leading end to end full stack design, development and implementation.
  • Excellent working technical knowledge and understanding of AI, ML and RPA technologies.
  • C#.Net: i.e. (.Net Frameworks, WPF, WCF, MVC, MVVM, XAML, Xamarin)
  • Python: i.e. (TensorFlow, Keras, Theano, Scikit-learn, PyTorch, NumPy, Pandas)
  • JavaScript: i.e. (ES6, Node.js, NPM, Sails.js, Ember.js, React, Mocha, Electron)
  • JavaScript framework experience (e.g., Ember, React, Angular)
  • jQuery, CSS, and HTML
  • Excellent working knowledge and understanding of version control systems such as SVN, TFS & GIT.
  • Strong SQL Database design and programming skills.
  • Excellent working knowledge and understanding of project management tools such as VSTS DevOps
Read more
QEOSOL
RACHANA PK
Posted by RACHANA PK
Bengaluru (Bangalore), Noida
3 - 10 yrs
₹7L - ₹25L / yr
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconHTML/CSS
Model-View-View-Model (MVVM)
Spring MVC
+5 more

Bachelor’s degree in computer science, computer engineering or similar.

  • Previous work experience of 4-6 years as an angularJS developer.
  • Proficient in CSS, HTML, and writing cross-browser compatible code.
  • Experience using JavaScript building tools like Gulp or Grunt.
  • Knowledge of JavaScript MV-VM/MVC frameworks including AngluarJS.
  • Excellent project management skills.
  • Proven experience implementing front-end and back-end JavaScript applications.
  • Excellent communication skills.
  • Critical thinker and good problem-solver.
Read more
Salesken.ai
at Salesken.ai
2 recruiters
akash r
Posted by akash r
Bengaluru (Bangalore)
6 - 12 yrs
₹40L - ₹65L / yr
skill iconJava
Data Structures
Algorithms
SQL
Microservices
+1 more


1. Be a visible leader to drive and own the architecture and design of some of the most advanced & complex software systems / products in the industry to create company wide impact
2. Design systems that can scale to billions of data records in micro service architecture
3. Design and develop full stack product features based on customer and business requirements
4. Be an operational and technical leader with a passion for distributed systems, cloud service development, deployment and delivery
5. Technically Hands-on with scalable Architecture managing team of (30+) Sr. Engineers / Engineers, and coaching mentoring while maintaining a hands-on role with code development
6. Drive code and design reviews of components / systems / products in scope and drives the architectural governance for them
7. Set directional paths for the teams/department for adoption of new technology stacks for solving business problems
8. Be a very visible representative of multiple technology domains and represent Salesken in external technical forums
9. Teamwork skills, flexibility, and ability to handle multiple tasks
10. Bring in software engineering life cycle best practice
11. Analytical and problem-solving skills

Desired Candidate Profile
1. Strong Java, Java 8 including OOAD design patterns
2. A solid engineer with must have knowledge and experience of Micro services design, security designs, and best practices
3. Excellent knowledge and skills in the areas of Java, Spring Boot, JSP/Servlet, J2EE design patterns, App server & Web servers
4. Strong hands-on technology experience building and running large scale systems handling multi-million sessions/transactions per day
5. Excellent knowledge of RDBMS, NoSQL databases like MySQL and Cassandra
6. Strong design/development experience in building massively large scale distributed internet systems and products
7. Excellent programming skills in Java and expertise in multi-threading and performance oriented programming
8. Sound knowledge of cloud platforms like GCP, AWS, Azure, etc
9. Solid experience in Distributed systems, highly scalable products, performance & reliability
10. Excellent understanding of processing platforms and queues
11. Excellent understanding of standard protocols such as HTTP/HTTPS, DNS, SSL, etc
12. Experience and knowledge of open source software, frameworks and broader cutting edge technologies around server side development in Java
Read more
21n78e Creative Labs
at 21n78e Creative Labs
1 video
1 recruiter
Mansi Thakkar
Posted by Mansi Thakkar
Mumbai, Bengaluru (Bangalore)
1 - 7 yrs
₹3L - ₹7L / yr
Adobe After Effects
Adobe Photoshop
skill iconAdobe Illustrator

21N78E Creative Labs is looking for Visualizers.

• Work with all the Marketing and Client teams to create effective client communication, develop innovative products, enabling client acquisition and customer delight.

• Responsible for conceptualizing, strategizing and visualizing concepts and designing for a variety of products and clients in the following areas.
o Advertising – Mainline and Digital
o Social media
o Outdoor
o Audio Visuals
o UI Design
o Corporate Communication

• Strong Design skills | Proficient in Adobe Creative Suite | Working Knowledge of Motion Graphics software’s (Adobe Premiere & After Effects) | Clear grasp of social media formats

Read more
SpringML
at SpringML
1 video
2 recruiters
Kayal Vizhi
Posted by Kayal Vizhi
Hyderabad
4 - 11 yrs
₹8L - ₹20L / yr
Big Data
Hadoop
Apache Spark
Spark
Data Structures
+3 more

SpringML is looking to hire a top-notch Senior  Data Engineer who is passionate about working with data and using the latest distributed framework to process large dataset. As an Associate Data Engineer, your primary role will be to design and build data pipelines. You will be focused on helping client projects on data integration, data prep and implementing machine learning on datasets. In this role, you will work on some of the latest technologies, collaborate with partners on early win, consultative approach with clients, interact daily with executive leadership, and help build a great company. Chosen team members will be part of the core team and play a critical role in scaling up our emerging practice.

RESPONSIBILITIES:

 

  • Ability to work as a member of a team assigned to design and implement data integration solutions.
  • Build Data pipelines using standard frameworks in Hadoop, Apache Beam and other open-source solutions.
  • Learn quickly – ability to understand and rapidly comprehend new areas – functional and technical – and apply detailed and critical thinking to customer solutions.
  • Propose design solutions and recommend best practices for large scale data analysis

 

SKILLS:

 

  • B.tech  degree in computer science, mathematics or other relevant fields.
  • 4+years of experience in ETL, Data Warehouse, Visualization and building data pipelines.
  • Strong Programming skills – experience and expertise in one of the following: Java, Python, Scala, C.
  • Proficient in big data/distributed computing frameworks such as Apache,Spark, Kafka,
  • Experience with Agile implementation methodologies
Read more
FreightCrate Technologies Pvt, Ltd.
Poonam Dakshini
Posted by Poonam Dakshini
Mumbai
2 - 10 yrs
₹4L - ₹15L / yr
skill iconPython
skill iconReact.js
MySQL
Memcached
skill iconPostgreSQL
+3 more
FreightCrate Technologies:

FreightCrate Technologies is a Logistics Technology company that aims to transform international shipping through innovative and cost-effective tech solutions that can mutually benefit exporters, importers and logistics service providers.  
Our web-platform, FreightCrate offers online tech-enabled quote and shipment management solutions for export and import businesses to and from more than 50,000 global locations.
We have had more than 50 media coverages including Entrepreneur, Maritime Gateway, Cargotalk, BW Disrupt, INC42, Silicon India, Tech Observer and several other newspapers and online magazines.

Our vision is to utilize cutting edge technology, engineering, deep learning and artificial intelligence to create an intelligent freight management system that can automate and optimize international trade operations for global businesses.


FOUNDERS:

Samir Lambay is the Co-Founder and CEO with an MSc in Shipping, Trade and Finance from Cass Business School, London, UK with Distinction.
Samir has worked in the shipping and logistics industry across both family businesses and multinational companies. His most recent job was at DB Schenker Logistics (Part of Deutsche Bahn Group - Fortune 200) where he was the youngest Vertical Manager globally and won two awards including Vertical Manager of the year and a Global Award.


Ruchi Dogra is a Co-Founder & Director and is in charge of sales and marketing. She has worked for over 15 years across the top 3 logistics/supply chain companies globally. She set-up the hotel, wines and beverages vertical at Kuehne & Nagel and DB Schenker. Her latest assignment was at DHL Global Forwarding where she worked as a Vertical Manager for Engineering and Manufacturing; handling top Indian and multinational accounts including several Fortune 100 companies. She brings with her an extensive knowledge in strategy, sales, operations and customer service.


Title
Software Developer

Description

The Software Developer’s role is to develop new innovative programs to optimize and automate user experiences by creating high-quality, innovative and fully performing software that complies with coding standards and technical design.
Should be familiar with the software development life cycle (SDLC) from preliminary system analysis to tests and deployment. 

Compensation

As this is a new business the compensation is negotiable and we will make an offer depending on the experience of the candidate.

Responsibilities

• Design flowcharts, layouts and documentation to identify requirements and solutions
• Produce clean, efficient code based on specifications
• Execute full software development life cycle (SDLC)
• Integrate software components and third-party programs and API’s
• Troubleshoot, debug and upgrade existing software
• Gather and evaluate user feedback
• Recommend and execute improvements
• Create technical documentation for reference and reporting


Skill Sets:

• PHP/Python
• AWS & Cloud-computing
• Mysql/PostgreSql
• Memcache/Redis
• Frontend technologies HTML, CSS, JS, ReactJS, Vue.js
• Frameworks like Django
• DevOps
• ELK
• Tools like Datadog, NewRelic, etc
• Shell-scripting 
• Setting & managing dev/beta/prod environments
• Tools like Jenkins, Chef, Puppet, Ansible, etc.
• Knowledge of Solr/Elastic search will be an advantage

Personal Requirements:

• Min of 3+ years of Hands on experience in Web development, algorithm design, implementation, architecture design, product management, databases and UI/UX in consumer facing applications.
• Experience on projects involving engineering and algorithmic functions, machine learning, deep learning and artificial intelligence is very advantageous.
• Creative self-starter who is comfortable with both taking initiative and working in teams.
• Previous experience working on logistics technology products is advantageous but not mandatory.
• Strong communication skills.
• Willingness to learn and utilize emerging technologies.
• Sincere passion to use disruptive technologies that can be globally significant.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos