Cutshort logo
Data Team logo
Senior Data Engineer
Data Team
Senior Data Engineer
Data Team's logo

Senior Data Engineer

at Data Team

Agency job
8 - 12 yrs
₹10L - ₹20L / yr (ESOP available)
Remote only
Skills
Big Data
Data engineering
Hadoop
data engineer
Apache Hive
Apache Kafka
Senior Data Engineer (SDE)

(Hadoop, HDFS, Kafka, Spark, Hive)

Overall Experience - 8 to 12 years

Relevant exp on Big data - 3+ years in above

Salary: Max up-to 20LPA 

Job location - Chennai / Bangalore / 

Notice Period - Immediate joiner / 15-to-20-day Max 

The Responsibilities of The Senior Data Engineer Are:

- Requirements gathering and assessment

- Breakdown complexity and translate requirements to specification artifacts and story boards to build towards, using a test-driven approach

- Engineer scalable data pipelines using big data technologies including but not limited to Hadoop, HDFS, Kafka, HBase, Elastic

- Implement the pipelines using execution frameworks including but not limited to MapReduce, Spark, Hive, using Java/Scala/Python for application design.

- Mentoring juniors in a dynamic team setting

- Manage stakeholders with proactive communication upholding TheDataTeam's brand and values

A Candidate Must Have the Following Skills:

- Strong problem-solving ability

- Excellent software design and implementation ability

- Exposure and commitment to agile methodologies

- Detail oriented with willingness to proactively own software tasks as well as management tasks, and see them to completion with minimal guidance

- Minimum 8 years of experience

- Should have experience in full life-cycle of one big data application

- Strong understanding of various storage formats (ORC/Parquet/Avro)

- Should have hands on experience in one of the Hadoop distributions (Hortoworks/Cloudera/MapR)

- Experience in at least one cloud environment (GCP/AWS/Azure)

- Should be well versed with at least one database (MySQL/Oracle/MongoDB/Postgres)

- Bachelor's in Computer Science, and preferably, a Masters as well - Should have good code review and debugging skills

Additional skills (Good to have):

- Experience in Containerization (docker/Heroku)

- Exposure to microservices

- Exposure to DevOps practices - Experience in Performance tuning of big data applications
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

HashRoot
Agency job
via HashRoot by Deepak S
Remote only
4 - 15 yrs
₹6L - ₹15L / yr
Windows Azure
DevOps
SQL
Shell Scripting
Bash
+2 more

Overview

As an engineer in the Service Operations division, you will be responsible for the day-to-day management of the systems and services that power client products. Working with your team, you will ensure daily tasks and activities are successfully completed and where necessary, use standard operating procedures and knowledge to resolve any faults/errors encountered.


Job Description

Key Tasks and Responsibilities:

Ensure daily tasks and activities have successfully completed. Where this is not the case, recovery and remediation steps will be undertaken.

Undertake patching and upgrade activities in support of ParentPay compliance programs. These being PCI DSS, ISO27001 and Cyber Essentials+.

Action requests from the ServiceNow work queue that have been allocated to your relevant resolver group. These include incidents, problems, changes and service requests.

Investigate alerts and events detected from the monitoring systems that indicate a change in component health.

Create and maintain support documentation in the form of departmental wiki and ServiceNow knowledge articles that allow for continual improvement of fault detection and recovery times.

Work with colleagues to identify and champion the automation of all manual interventions undertaken within the team.

Attend and complete all mandatory training courses.

Engage and own the transition of new services into Service Operations.

Participate in the out of hours on call support rota.


Qualifications and Experience:

Experience working in an IT service delivery or support function OR

MBA or Degree in Information Technology or Information Security.

Experience working with Microsoft technologies.

Excellent communication skills developed working in a service centric organisation.

Ability to interpret fault descriptions provided by customers or internal escalations and translate these into resolutions.

Ability to manage and prioritise own workload.

Experience working within Education Technology would be an advantage.


Technical knowledge:

Advanced automation scripting using Terraform and Powershell. 

Knowledge of bicep and ansible advantageous. 

Advanced Microsoft Active Directory configuration and support.

Microsoft Azure and AWS cloud hosting platform administration.

Advanced Microsoft SQL server experience.

Windows Server and desktop management and configuration.

Microsoft IIS web services administration and configuration.

Advanced management of data and SQL backup solutions.

Advanced scripting and automation capabilities. 

Advanced knowledge of Azure analytics and KQL.

 

Skills & Requirements

IT Service Delivery, Information Technology, Information Security, Microsoft Technologies, Communication Skills, Fault Interpretation, Workload Prioritization, Automation Scripting, Terraform, PowerShell, Microsoft Active Directory, Microsoft Azure, AWS, Microsoft SQL Server, Windows Server, Windows Desktop Configuration, Microsoft IIS, Data Backup Management, SQL Backup Solutions, Scripting, Azure Analytics, KQL.

Read more
Arting Digital
Pragati Bhardwaj
Posted by Pragati Bhardwaj
Pune
5 - 12 yrs
₹20L - ₹28L / yr
skill iconAndroid Development
skill iconKotlin
skill iconJava

Job Title: Android Developer


Experience: 5+ years


Location: Pune


Working Mode: Hybrid


Primary Skills: Android, Java, Kotlin


Good to have: Exp in video streaming tools


Qualification: B.Tech, M.Tech, MCA


Requirements:


· Proficiency in Kotlin programming language (3+ years)


· Experience with Java programming language


· Excellent understanding of design principles and implementation of MVVM


· Excellent object-oriented programming design


· Must know best practices for descriptive variable and function naming for quality of code and comments


· Experience writing unit tests


· Experience with Agile methodologies and Scrum


· Experience working with Git for source control


· Experience working with JIRA


· Experience in creating technical documentation (UML, Sequence, etc.).


· Experience with Agile methodologies and Scrum


· Knowledge in basic design best practices: Single Responsibility; Dependency Injection


· Knowledge and understanding of RESTful services, APIs, and the JSON file format & parsing.


· Understanding of CI/CD, frameworks, and deployment processes is desired


· Desired Flow, Coroutines, RxJava experience


· Desired C++ experience


· Experience with IoT is plus



Video Specific required:


· webRTC

· RTP

· Steaming protocol – HLS

· exoPlayer

· Video Codecs

· OpenGL

· MP4

· .H264/.H265

· G711 and/or Opus


Read more
Black Market
KrishnaPrasad L
Posted by KrishnaPrasad L
Remote only
0 - 0 yrs
₹2000 - ₹4000 / mo
Digital Marketing
Social Media Marketing (SMM)
English Proficiency

As a Digital Marketing intern at Black Market, you will have the opportunity to work with a dynamic team and gain hands-on experience in the exciting world of digital marketing. Your responsibilities will include:


1. Assisting in the development and implementation of social media marketing strategies to increase brand awareness and engagement.

2. Managing and creating content for Instagram marketing campaigns to drive traffic and increase followers.

3. Monitoring and analyzing social media metrics to track the success of campaigns and make data-driven decisions.

4. Collaborating with the creative team to develop visually appealing and on-brand content.

5. Contributing ideas and suggestions for innovative digital marketing strategies to reach target audiences effectively.


If you are a creative, proactive individual with a passion for digital marketing and social media, we want to hear from you! This internship will provide valuable experience and the opportunity to learn and grow in a fast-paced environment. English proficiency is required for this role. Apply now and be a part of our exciting team at Black Market!

Read more
Indian financial services company
Indian financial services company
Agency job
via Talengage by Himani Walia
Mumbai
0 - 1 yrs
₹3L - ₹7L / yr
Trading
NBFC
sharemarket

Job Description


  • Advising Clients for Commodities and Currency products.
  • Calling existing clients for Commodity.
  • Passing on research calls and engaging clients to trade


Qualification:

  • Min Graduate (Candidate with MBA Degree or candidate with higher study plan should not apply)
  • Ready to work in shifts
  • Morning Shift- 8.30-5.30pm
  • Evening shift -3pm to 12 am
  • (Night travelling Allowance will be seperate
Read more
I SQUARE SOFT
at I SQUARE SOFT
1 recruiter
Tejaswini R
Posted by Tejaswini R
Bengaluru (Bangalore)
1 - 6 yrs
₹2L - ₹5.5L / yr
Network engineering
Communication Skills
Routing & Switching
Cisco Certified Network Associate (CCNA)
Troubleshooting
+5 more

Hi Folks!!


Currently we are hiring for Network Engineer for Top MNC


Roles and Responsibilities:

·      Providing support to the Enterprise level clients in configuration of the Wireless LAN Controllers, Access Points and CPPM server

·      Troubleshooting all kind of network and user connectivity issues post deployment

·      Fault localization and restoration of service over remote session

·      Handling POC cases and escalation tickets as well

·      Making configuration changes as per customer’s requirement and wireless environment

·      Co-ordinate with multi-vendors engineers to have successful user authentication like Layer-2 Security features 802.1x authentication, Port security and VLAN Mobility

·      Co-ordinate with L3 Engineers to resolve critical issues        

·      Effectively handle network outage issues and resolve them in a timely manner

·      Configuring Authentication and encryption in wireless networks with Clear pass

·      Working with AAA configuration, including AD, LDAP, RADIUS for Windows and MAC OS X platform

·      Reviewing the WLAN configuration of customers and identifying any configuration mistakes that could cause potential issues

·      Recreating/simulating the customer’s issues in the local lab to verify the issue and provide an effective resolution

·      Providing network support for client’s wired and wireless networks via remote management and telephone

·      Conduct technical discussion with level 1 engineers on weekly basis

Required Skills:

·      CCNA certified with Wireless Knowledge

·      Basic Knowledge on any of Aruba Clear Pass, FortiNAC, Cisco ISE NAC solution

·      Basic implementation skills on Aruba Clear Pass for Wired, Wireless and Guest NAC solution.

·      Must have experience in configuring switches, routers.

·      Must provide technical support for the team & projects during escalation.

·      Good understanding of dot1x, mac authentication and solution for BYOD

·      Capable to prepare HLD (high level design) and LLD (low level design) for new requirements.

 

 


Read more
Reputed MNC client of people first consultant
Reputed MNC client of people first consultant
Agency job
Bengaluru (Bangalore), Mysore, Chennai, Pune
9 - 12 yrs
₹12L - ₹30L / yr
skill iconAmazon Web Services (AWS)
AWS Lambda
POC
Deignation: AWS Architect
Experience: 9-12 years
Location: Bangalore
Job Description

Strong Experience across Applications Migration to Cloud, Cloud native Architecture, Amazon EKS, Serverless (Lambda).​

Delivery of customer Cloud Strategies aligned with customers business objectives and with a focus on Cloud Migrations and App Modernization.​

Design of clients Cloud solutions with a focus on AWS.​

Undertake short-term delivery engagements related to cloud architecture with a specific focus on AWS and Cloud Migrations/Modernization.​

Provide leadership in migration and modernization methodologies and techniques including mass application movements into the cloud.​

Implementation of AWS within in large regulated enterprise environments.​

Nurture Cloud computing expertise internally and externally to drive Cloud Adoption.​

Work with designers and developers in the team to guide them through the solution implementation.​

Participate in performing Proof of Concept (POC) for various upcoming technologies to fit in business requirement. 
Read more
Creative Frenzy Pvt Ltd
Delhi, Gurugram, Noida, Ghaziabad, Faridabad
2 - 7 yrs
₹3L - ₹21L / yr
skill iconJava
Firebase
SDK Knowledge
skill iconKotlin
skill iconAndroid Development
+9 more
We are looking for an Android developer responsible for the development and maintenance of a Social Networking Application aimed at a vast number of diverse Android Mobile devices. Your primary focus will be the development of Android applications and their integration with back-end services. You will be working alongside other engineers and developers working on different layers of the infrastructure. Therefore, commitment to collaborative problem solving, sophisticated design, and creating quality products is essential.

Responsibilities:-

  • Translate designs and wireframes into high-quality code
  • Design, build and maintain high performance, reusable, and reliable Java
  • code
  • Ensure the best possible performance, quality, and responsiveness of the
  • application
  • Identify and correct bottlenecks and fix bugs
  • Help maintain code quality, organization, and automatization
  • Follow best practices in code implementation
  • Willing to work on flexible time zones if required

Required Skills:-

  • Strong knowledge of Android SDK, different versions of Android, and how to deal with different screen sizes
  • Familiarity with RESTful APIs to connect Android applications to back-end
  • services
  • Strong knowledge of Android UI design principles, patterns, and best
  • practices
  • Experience with offline storage, threading, and performance tuning
  • Ability to design applications around natural user interfaces, such as touch
  • Familiarity with the use of additional sensors, such as gyroscopes and
  • accelerometers (preferred)
  • Knowledge of the open-source Android ecosystem and the libraries available for common tasks
  • Ability to understand business requirements and translate them into technical
  • requirements
  • Familiarity with cloud message APIs and push notifications –
  • A knack for benchmarking and optimization
  • Understanding of Google's Android design principles and interface guidelines
  • Proficient understanding of code versioning tools, such as Git
  • Familiarity with continuous integration
  • Must have experience in Chat (one to one, group chat, file sharing)
  • Knowledge in Google Maps APIs is preferred

Location: Noida, UP.
Read more
Intelligent Cloud Machine Platform
Intelligent Cloud Machine Platform
Agency job
via Unnati by Veena Salian
Bengaluru (Bangalore)
4 - 7 yrs
₹18L - ₹20L / yr
skill iconRuby
skill iconRuby on Rails (ROR)
skill iconPython
skill iconAngularJS (1.x)
Cucumber
+4 more
Work with a Globally recognised and preferred IT services company. Read on for more details.
 
Our client is a startup based out of Singapore, Australia and India. It develops highly efficient and scalable Ecommerce apps and websites for their clients. Their venture also provides 3D printing on demand, for their clients who want customised sheet manufacturing through cloud-based solutions. They have their office in Dehradun and plan to expand soon.
 
They aim to make the 3D printing available to manufacturing companies of tools, medical equipment, laser printing etc apart from diverse domains like NGOs, digital enterprises and platforms. The founder is a PhD from Pune Univ. specialising in Startup models and Manufacturing platforms, studied business from Swinburne Univ. and has handled multiple projects in manufacturing, technology and laser machines.
 
As a Senior Software Developer, you will develop web application using Ruby Rails and AngularJS and manage the Servers and Databases
 
What you will do:
  • Building scalable and large scale web applications, and creating flexible solutions and integrations with other applications
  • Independently drawing up milestones and ensuring completion as per the timelines
  • Solving complex technical problems
  • Researching, Learning and Implementing new functionalities and modules in other technologies (C++, Python, Javascript) and integrating them into the product in very quick cycles.
  • Keeping abreast of new developments in the technology as well as understanding the feature differences.
  • Comfortable working in an intensive start-up culture with tight delivery cycles

 

Desired Candidate Profile

What you need to have:
  • At least 1+ year experience in working with Ruby on Rails and minimum 4 years of experience with software development (Backend + Frontend)
  • Extensive knowledge in testing frameworks like Rspec/ Cucumber/ Capybara
  • Exposure to AngularJS a plus
  • Worked with Frontend HTML5/ CSS development and integrating with mySQL/ PostGres Database
  • Must have experience in creating flexible solutions and integrations with other applications
  • A strong knowledge of web coding standards, licensing and best practices
  • Must have experience in building scalable and large scale web applications
  • Ability to manage the Servers and Databases
Read more
Series C Funded Startup providing academic excellence system
Series C Funded Startup providing academic excellence system
Agency job
via ConsultBae by Consult Bae
Bengaluru (Bangalore), Mumbai
5 - 7 yrs
₹18L - ₹35L / yr
Product Management
Product Manager
Product Strategy
Roadmaps management
A/B Testing
+4 more

Product Manager

Compensation​ - ₹18.0L - ₹35.0L 
Experience​ - 5.0 - 7.0 Year(s) : Min 5 yrs of Solid Product management Experience
Location​ - Bangalore / Mumbai
Working days​ - 5
Qualification​ - B.Tech/B.E.
Requirements:

  •  Candidates shall be working in a product/internet consumer firm and only B2B Product Firms (Not B2C)
  •  Candidates shall be a full time MBA from a tier1 Institutes
  •  Candidates shall have experience in Road-mapping, goal setting, managing project execution, A/B testing, UI/UX wire-framing, defining product roll-out strategy.

Responsibilities:

  • Own delivery of product initiatives and releases Lead ideation, development, launch, testing, and iteration of new features Translate high-level conceptual product ideas into clearly defined product specifications.
  •  Collaborate with design, engineering, marketing, and sales to drive the product development process
  •  Define and execute the LEAD School product vision, priorities and roadmap
  •  Collaborate with engineering to determine the best technical implementation of the product features by Using your skill on PRD, wireframe, mind map, trello and etc.
  •  Use data and metrics to help inform roadmap and product decisions to help better acquire, convert and retain users
  •  Define user stories and product requirements that both reflect and anticipate the needs of LEAD School broad user base Proactively engage with LEAD School users in user research and to identify market opportunities
  •  Understand the competitive landscape and evaluate market trends to better inform product roadmap.

Skills and Qualifications:

  •  3+ years’ experience in a product management role within a B2B software company Experienced being the product owner in agile product teams
  •  Experience with A/B testing and using data to inform product decisions
  •  Technical enough to work effectively with engineers to decide on different product paths Design-capable enough to work effectively with designers to decide on good platform UI/UX choices
  •  Strong prototyping and wireframing skills using tools like Balsamiq, Moqups etc.
  •  Experienced in managing product backlogs and priorities based on user research and collaborating with internal stakeholder
  •  Effective decision maker and can help teams understand rationale and reasons for the product decisions and roadmap direction
  •  Thrive in a fast-paced startup environment
  •  Self-starter, independent and excellent at driving teams and projects
  •  Excellent communication skills at all level’s small groups, large groups, and with executives
Read more
Functionize Software Pvt ltd
Ankur Verma
Posted by Ankur Verma
NCR (Delhi | Gurgaon | Noida)
3 - 10 yrs
₹6L - ₹20L / yr
skill iconPHP
MySQL
Zend
skill iconjQuery
skill iconNodeJS (Node.js)
+3 more
Recognized as 'One of the Most Innovative Companies in Automation Testing', Functionize delivers the first autonomous, AI cloud-based testing platform to automate software testing. Its platform creates selenium-compatible cross-browser tests from natural language text that run on the cloud with no coding. The scalable cloud architecture is trusted by many marquee enterprise customers for its cross-browser compatibility, mobile support and the ability to use real browsers, real workflows, and real non-simulated virtual users. Functionize allows enterprises to seamlessly manage and scale their testing requirements without the need for large traditional QA teams, and harness the power of AI and Machine Learning as part of their existing enterprise processes including CI/CD and Gated Releases. Want to learn more about who we are and what we do? Visit us at www.functionize.com. Functionize is seeking a rockstar engineering leader to develop its web application platform. The right candidate would have experience successfully building highly scalable enterprise applications based on open source architecture (LAMP and Java), and thrives on the challenges and opportunities in an extremely high growth startup environment. Having done this at companies and startups (preferably US based) which have a global footprint of similar scale as Functionize would be a huge advantage. This position requires someone with a deep interest in active coding and programming skills - the majority of the work is active hands on coding in PHP / MySQL / jQuery & Javascript libraries. Job Description : - Must love active hands on PHP / Javascript and HTML coding - Excellent Communication Skills - both written and spoken english is a must - Ability to solve complex problems using innovative solutions and actively coding and developing PHP /Javascript/ HTML based web applications - Writing of fully optimized code for optimum performance and efficiency of the website. - Adhere to the coding standards and guidelines. - Contribute to customer support over e-mail and telephone on a regular basis. - Should be very strong in Object-Oriented programming and design patterns. - Should be strong in writing optimized SQL queries. Skills Required : - Must have extensive demonstrable knowledge in PHP - both Core PHP and MVC Frameworks (Preferrably Zend framework). - Exp.- 5 - 10 Yrs. - Demonstrated exposure to complex web UI applications and front end development is a must - experience with wordpress and cms website development does not count. - Core PHP should be very strong - This is a mandatory requirement. - Excellent exposure to Javascript libraries - including jQuery, Bootstrap - and demonstrable experience in using them on complex web applications. - Demonstrated ability to use frontend libraries and javascript to develop complex and dynamic User Interfaces is a must. - Proficiency in PHP, jQuery, AJAX, Javascript, CSS, HTML, MySQL - Experience working with Web design / photo editing tools a plus - Excellent Verbal and Written English Communication Skills - Experience developing Cloud based web applications, and working with large databases is a huge plus - Experience working with NodeJS and NoSQL databases like Cassandra and Mongo is a big plus. Salary Range: Depends on skills, experience, and past renumeration history NOTE: Immediate Joiners or Short Notice period candidates will be preferred.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos