Cutshort logo
Data Team logo
Senior Data Engineer
Data Team
Senior Data Engineer
Data Team's logo

Senior Data Engineer

at Data Team

Agency job
8 - 12 yrs
₹10L - ₹20L / yr (ESOP available)
Remote only
Skills
Big Data
Data engineering
Hadoop
data engineer
Apache Hive
Apache Kafka
Senior Data Engineer (SDE)

(Hadoop, HDFS, Kafka, Spark, Hive)

Overall Experience - 8 to 12 years

Relevant exp on Big data - 3+ years in above

Salary: Max up-to 20LPA 

Job location - Chennai / Bangalore / 

Notice Period - Immediate joiner / 15-to-20-day Max 

The Responsibilities of The Senior Data Engineer Are:

- Requirements gathering and assessment

- Breakdown complexity and translate requirements to specification artifacts and story boards to build towards, using a test-driven approach

- Engineer scalable data pipelines using big data technologies including but not limited to Hadoop, HDFS, Kafka, HBase, Elastic

- Implement the pipelines using execution frameworks including but not limited to MapReduce, Spark, Hive, using Java/Scala/Python for application design.

- Mentoring juniors in a dynamic team setting

- Manage stakeholders with proactive communication upholding TheDataTeam's brand and values

A Candidate Must Have the Following Skills:

- Strong problem-solving ability

- Excellent software design and implementation ability

- Exposure and commitment to agile methodologies

- Detail oriented with willingness to proactively own software tasks as well as management tasks, and see them to completion with minimal guidance

- Minimum 8 years of experience

- Should have experience in full life-cycle of one big data application

- Strong understanding of various storage formats (ORC/Parquet/Avro)

- Should have hands on experience in one of the Hadoop distributions (Hortoworks/Cloudera/MapR)

- Experience in at least one cloud environment (GCP/AWS/Azure)

- Should be well versed with at least one database (MySQL/Oracle/MongoDB/Postgres)

- Bachelor's in Computer Science, and preferably, a Masters as well - Should have good code review and debugging skills

Additional skills (Good to have):

- Experience in Containerization (docker/Heroku)

- Exposure to microservices

- Exposure to DevOps practices - Experience in Performance tuning of big data applications
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Grid Dynamics
Hyderabad, Bengaluru (Bangalore)
7 - 15 yrs
₹25L - ₹45L / yr
Generative AI
AGENTIC
PEFT (Parameter-Efficient Fine-Tuning)
LORA
Retrieval Augmented Generation (RAG)
+7 more

Job Description:

Experience: 7 -15 Years


Job Description :

Key responsibilities

As an GEN AI Expert [Min 4 + years of relevant exp on NLP, CV and LLMs], you will be responsible for designing, building, and fine-tuning NLP models and large language model (LLM) agents to solve business challenges. You will play a key role in creating intuitive and efficient model designs that enhance user experiences and business processes. The position demands strong design skills, hands-on coding expertise, advanced proficiency in Python development, specialized knowledge in LLM agent design and development, and exceptional debugging capabilities.

  • Model & Agent Design: Conceptualize and design robust NLP solutions and LLM agents tailored to specific business needs, with a focus on user experience, interactivity,   latency, failover and functionality.
  • Hands-on Coding: Write,test, and maintain clean, efficient, and scalable code for NLP models and AI agents, with a strong emphasis on Python programming.
  • Build high quality multi-modal & multi-agents applications/frameworks
  • Knowledge on input/output token utilization, prioritization and consumption w.r.t AI agents
  • Performance Monitoring: Monitor, optimize LLM agents, implementing model explainability, handling model drift, and ensuring robustness.
  • Research Implementation:Ability to read, comprehend, and implement AI Agent research papers into practical solutions. Stay abreast of the latest academic and industry   research to apply cutting-edge methodologies and techniques.
  • Debugging & Issue Resolution: Proactively identify, diagnose, and resolve issues related to AI agents, including model inaccuracies, performance bottlenecks, and   system integration problems. Utilize debugging tools and techniques to troubleshoot complex problems in model behavior, data inconsistencies, and deployment errors.
  • Innovation and Research:Stay updated with the latest advancements in AI agents technologies,experimenting with new techniques and tools to enhance agent capabilities and performance.
  • Continuous Learning: Adaptability to unlearn outdated practices, patterns, technologies and quickly learn and implement new technologies & papers as the ML world evolves. Maintain a proactive approach to staying current with emerging trends and technologies in Agent based solutions (Text & Multi Modal).
  • Clear understanding of tool usage and structured outputs in agents
  • Clear understanding of speculative decoding and AST-Code RAG
  • Clear understanding of Streaming and Sync/Async processing
  • Clear understanding of embedding models and their limitations

Tech stack required:

Programming languages: Python

Public Cloud: Azure

Frameworks: Vector Databases such as Milvus, Qdrant/ ChromaDB, or usage of CosmosDB or MongoDB as Vector stores. Knowledge of AI Orchestration, AI evaluation and Observability Tools. Knowledge of Guardrails strategy for LLM. Knowledge on Arize or any other ML/LLM observability tool.

Experience: Experience in building functional platforms using ML, CV, LLM platforms. Experience in evaluating and monitoring AI platforms in production.

Read more
Panamax InfoTech Ltd.
at Panamax InfoTech Ltd.
2 recruiters
Bhavani P
Posted by Bhavani P
Remote only
5 - 10 yrs
₹5L - ₹15L / yr
Oracle BI Publisher
Oracle SCM
Linux/Unix
Shell Scripting
Oracle Application Framework
+7 more
ABOUT US: Panamax Inc., the technology arm of Bankai Group, is a global leader in FinTech, 1.2 Billion Dollar Revenue, 800 Employees, Presence is worldwide 12 Countries Telecommunication, and Consulting services for telecom operators, carriers, MNOs and MVNOs. Headquartered in New York, it was established in the year 2001. The company has worked with some highly reputed clients over the years and has gained invaluable insights that have helped us optimize our telecom and technology turnkey solutions. Our solutions and services are specifically designed to ensure a seamless integration with the existing ecosystems of our potential clients. We're proud to have a 4.4 Glassdoor rating from our employees. We are hiring a Recruiter to join the Panamax Inc. team. If you're hard-working and dedicated, Panamax Inc. is an excellent place to grow your career.

Position: Oracle EBS Technical Lead - SCM
Experience: 6-8 Years
Location: Remote

Technical & Professional requirement:

Minimum 6 years of professional Oracle EBS experience in Oracle EBusiness Suite release 12.2.x or higher with
emphasis on modules Oracle Order Management, Oracle Advance Pricing, O2C cycle.
Must have ability to support customizations, develop process documents and share implementation plans and
best practices advice.
Experience with Web services, Alerts, PLLs, DFFs, module related APIs is a must
Extensive experience in Oracle database and development technologies such as Oracle Forms,
Oracle Reports, OAF/ADF framework, Workflow and BI Publisher
Oracle Database 11g or higher with strong experience in SQL and PL/SQL.
Exposure to SOA stack is a plus .
Good knowledge of basic Unix shell scripting will be added advantage
Strong technical knowledge with database design architecture. Ability to design and implement tables, views,
procedures, constraints, and relationships
Solve complex issues using methodical troubleshooting based on expert knowledge of Oracle
EBS applications functionality and technology
Ability to identify technical risks, present solutions to non-technical personnel and influence technical decisions.
Design, Development, Testing, Migration, Documentation.
Adhere and follow the Organization and Client Processes.
Support milestone events, defect resolutions, status updates etc.
Coordinate and participate in interaction with Functional counterparts and Users, Infrastructure team for
issues/configurations.

To qualify for the role, you must have

Minimum 6 Years of experience as EBS Technical Consultant
Oracle EBS R12 Technical, Sound knowledge of EBS, PL/SQL, Oracle Application Framework. Good understanding
of business flows – Oracle Order Management, Oracle Advance Pricing, O2C cycle.
Bachelor’s Degree in any engineering.

Basic:

Excellent ability to convince multiple stakeholders - internal and external
Good communication skills
Good presentation skills
Experience throughout the software development life cycle
Familiarity with Agile methodologies
Ability to interface directly with client
Read more
Semperfi Solution
at Semperfi Solution
1 recruiter
Ambika Jituri
Posted by Ambika Jituri
Bengaluru (Bangalore)
7 - 8 yrs
₹14L - ₹24L / yr
skill iconAngularJS (1.x)
skill iconAngular (2+)
Material handling
skill iconHTML/CSS
User Interface (UI) Design
+3 more

Responsibilities :

 
 

·         In-depth knowledge in web markup, including HTML5, CSS3, client-side scripting, and JavaScript frameworks, including jQuery

·         Good understanding of asynchronous request handling, partial page updates, and AJAX

·         Deep knowledge of Angular 2+ (Typescript)

·         Strong knowledge of CSS3 extended languages such as SASS / LESS

·         Implementing responsive design for mobile sites

·         Ability to write high-performance, reusable code using JS best practices.

·         Experience in code optimization and refactoring.

·         Experience working with theme frameworks like Bootstrap or any Material Design libraries

·         Comfortable with JSON data manipulations

·         Good understanding of cross-browser compatibility issues and ways to work around    them

·         Experience with version control, such as Git

·         Testing the site during development for usability and fixing any bugs.

·         Cooperating with web designers to match visual design intent.

·         The role requires constant interaction with other developers in the team


 

Kindly revert with your updated resume

 

THANK YOU

 
Read more
New-Age Smart-Learning Platform
New-Age Smart-Learning Platform
Agency job
via Unnati by Seemi Ejaz
NCR (Delhi | Gurgaon | Noida), Bengaluru (Bangalore), Mumbai
0 - 1 yrs
₹5L - ₹6L / yr
Sales
B2C Sales
Communication Skills
Lead Generation
Revenue growth
+5 more
Are you looking for a promising career with a well known ed-tech brand, which is looking to make life easier for kids and parents to understand basic concepts of learning? Then read on.

Our client is a new age ed-tech platform that provides a perfect combination of classroom learning and technology to the kids of KG to class 7. Their experiences with inquiry based learning systems, child psychology, active pedagogy and gamification of study materials, helps students to learn and clear their respective Math and English levels easily and without the need for tuitions.

The founders are XLRI alumni who have experience in Education as well as other sectors and well versed with running a successful business. Backed by FIITJEE, it has been recognised as one of the most Promising Educational Apps. The app promotes fun learning and focuses on mastery of the subject, ensuring that the new age kids possess critical thinking, problem solving and communication skills.
 
As a B2C Sales Executive, you will be the first point of contact for the students/ parents and answer all their queries regarding the company and product/ sevice, eventually converting them and other leads.
 
What you will do:
  • Generating Leads by calling on Parent Leads through the CRM
  • Calling 60-75 Leads on a daily basis
  • Generating trail classes by pitching to the parents to take the Trial Class
  • Conducting counselling sessions for parents who take trial classes
  • Closing the sale through smart and strategic approach
  • Generating and meeting revenue numbers (3L+ per month)



What you need to have:
  • Freshers with a graduate or post graduate degree
  • A keen desire to drive Sales for a fast-growing startup
  • Willing to work 6 days a week(Mondays off)
 
Read more
Competitive Monetised Gaming Platform
Competitive Monetised Gaming Platform
Agency job
via Unnati by Veena Salian
Bengaluru (Bangalore)
3 - 7 yrs
₹3L - ₹8L / yr
skill iconAndroid Development
skill iconKotlin
skill iconJava
RESTful APIs
Fullstack Developer
+2 more
Work with a team that is driving the gaming industry, and giving the best opportunities to India's smartest developers.
 
Our client is a unique platform with a plethora of gaming options and allows its users to safely and securely earn real cash while gaming. Partnering with leading UPI and fintech apps, it hosts some of the most popular skill-based and legal games like Call of Duty, Ludo, Carrom, Fastest Finger, Clash Royale and more.
 
With instant payouts and cash bonuses, the app has gained extreme popularity among the gaming community. The app runs tournaments for most of the games and ensures only 100% verified profiles are allowed while maintaining a reliable and responsible gaming attitude. Founded by the creators of a global Adtech brand with extensive entrepreneurial and business experience, the team now plans to bring onboard the most anticipated games of the year and continue giving a boost to the esports biz in India.
 
As an Android Developer, you will be working along-side other developers working on different platforms for the Application.
 
What you will do:
  • Implementing security and data protection.
  • Integrating the design into high quality code.
  • Ensuring the performance, quality, and responsiveness of application.
  • Identifying and correcting bottlenecks and fix bugs.
  • Unit-testing code for robustness, including edge cases, usability, and general reliability
  • Working on bug fixing and improving application performance

 

 

What you need to have:

  • Proficient in Mobile App development with full stack development capabilities.
  • In-depth understanding of the entire web development process (design, development and deployment)
  • Good knowledge on code signing, debugging tools and project configuration on Android.
  • Sound knowledge of REST Standards
  • Experience working with a relational database
  • Nice To Have
  1. Strong algorithm/ data structures design and problem solving skills
  2. Experience with cloud environments like AWS is a plus.
  • Soft Skills
  1. Must be able to work in a team.
  2. Must have good communication skills.
Read more
There is an urgent opening for Snowflake in MNC company.
There is an urgent opening for Snowflake in MNC company.
Agency job
via Volibits by Ankita Mishra
Pune, Mumbai, Bengaluru (Bangalore), Chennai, Noida, Hyderabad
7 - 12 yrs
₹5L - ₹15L / yr
Snow flake schema
SnowSQL
Snowpipe
There is an urgent requirement for Snowflake Developer in MNC company. Notice Period should be joining in April or 2nd week of May. Having skills like Snowpipe, SnowSQL, Snowflake schema & Snowflake developer.The Budget for this profile is upto 22 LPA.
Read more
Wellness 360 Technologies
at Wellness 360 Technologies
1 video
1 recruiter
Amit Sharma
Posted by Amit Sharma
Hyderabad
0 - 3 yrs
₹2L - ₹4L / yr
skill iconJava
J2EE
Struts
Spring
Hibernate (Java)
+1 more

1. Java Developer

Job profile:

  • Project Role: Spring boot application developer
  • Project Role Description: Design, build and configure spring boot applications to meet
  • business process and application requirements.
  • Work Experience: Fresher. Should have done at least one project in Java. Hands on
  • experience on the Spring boot project is an added advantage.

 

Must Have Skills: Core Java or Spring boot Application

 

Important: Engineers should be able to code, Interview will involve actual coding

 

Key Responsibilities:

  • Design, build and configure applications to meet business process and application requirements
  • Understanding of
  1. server side technologies, how the web applications work. Role of Database and APIs in modern web and mobile applications.
  2. client side web frameworks, such as Angular or React and they integration with back end systems
  • Implementation and customization of Web based solutions
  • Development of custom components such as web interfaces, Validation Services etc.
  • Continuously discover, evaluate, and implement new technologies to maximize development efficiency.
  •     Write clean, maintainable code while rapidly iterating and shipping
  •      Participate in all phases of development, from design to implementation, unit testing, and release.
  •  Knowledge of javascript, OOPS including experience with design Pattern
  • Excellent in Design patterns, Data Structure.

 

Technical Experience:

  • Engineers should have done project(s) in Java or Spring boot.
  • Knowledge of
  1. Test and automation tools
  2. Git
  3. Restful APIs.
  4. Solid understanding of object-oriented design and programming concepts.
  • Have a passion for quality and writing clean, solid, readable code that scales and performs well.

Expected Competencies:

 

  • Adaptable to change; able to respond to shifting requirements and priorities
  • A well-organized and structured approach to work with good attention to detail.
  • Comfortable with coordinating and collaborating with business teams to drive required decisions and outcomes.
  • A high degree of personal integrity and strong ability to work collaboratively and effectively in a fast-paced, flexible, team-based environment.

Work Location: Hyderabad
Read more
Casey Foods
at Casey Foods
7 recruiters
Swati Ray
Posted by Swati Ray
Remote, Cuttack
6 - 15 yrs
₹2L - ₹6L / yr
Sales
Marketing
Team Management
  • Should be passionate about transforming sales, service and marketing and whose values align with that of Casey Foods.
  • Should have high emotional intelligence and genuine empathy for others through which he should be able to maximize the impact by understanding the motivations of the team and adapting through effective communications.
  • Should be a positive game player having a track record of at least 12-15 years of experience of leading and empowering groups towards driving improvement while navigating change and simultaneously winning.
  • Should be able to create a culture of transparency and focussed improvement while having fun and fostering a strong team environment.
  • Should be a data driven personality who could leverage and communicate using data to improve core marketing strategies that matters to the individual of our team.
  • Should have well experienced in managing or being managed in a structural sales environment.
Read more
flockwits
at flockwits
1 recruiter
Arvindh Saravanabhavan
Posted by Arvindh Saravanabhavan
Coimbatore
0 - 2 yrs
₹1L - ₹2L / yr
skill iconJava
Big Data
Data storage
Intelligence
Spring
+4 more
FlockWits is looking for Software Engineers to join team which is destined to build the advanced unified marketing platform powered by machine learning, enabled by Big data . You will be responsible for helping design, build, and deliver a platform that accelerates sales of clients. This role requires thirst to learn cutting technologies on App development, Data storage and processing, Artificial Intelligence, security and dev ops. We look for desire to create new things, dive in wherever there's a need, eagerness to make an impact as an individual and the willingness to learn new things. You must be self-motivated, innovative, and proactive. The role offers significant opportunities for growth. You will... • Help build the leading platform using Java spring for app, NoSQL for storage , Hadoop for processing , python for machine learning and Jenkins for dev ops. • Design, code, and implement clean and elegant user interfaces and workflows • Design and build UI with best usable features . You have... • Any engineering degree or MCA • Thirst to learn. • Self-driven and motivated, with a strong sense of ownership and craftsmanship. • Enthusiasm to sharpen soft skills like written and verbal communication.
Read more
Zoliday
at Zoliday
2 recruiters
Paras Jain
Posted by Paras Jain
Bengaluru (Bangalore)
3 - 8 yrs
₹12L - ₹18L / yr
skill iconPython
MySQL
skill iconRedis
Are you a Software Engineer with extensive coding experience? Are you enthusiastic about writing modular, reliable, and efficient code? Do you love seeing your work impact the end-user directly? If so, let’s connect. We are looking for smart people who can use the best available tools to get things done quickly. About Zoliday: -------------------Zoliday is a modern, online business travel platform. We believe business travel should be smooth and efficient for both travellers and travel management teams. With Zoliday, companies can manage the complete cycle of business trips - from requests and bookings to expenses and reports - all on one portal. We use data, machine learning, and algorithms with consumer-grade UX to deliver significant improvement in time-to-book and give real-time recommendations and insights.We are a funded startup with years under our belt in the travel domain and partnerships with leading travel providers, hotel chains and GDS platforms. Our clients include prominent startups and leading FMCG companies.Your Role: --------------As a senior software engineer, you will have ownership of server-side architecture, development, and scaling. You will be part of the core engineering team working with the product team to design, build, and implement the product.Your responsibilities:---------------------------- - Product development in Python/Tornado/Django and Angular 6/7- Integrating APIs for booking, payment, and reports- Design, build, and test modules- Create and implement system architecture. Required Experience and Skills:------------------------------------------ - Extensive experience of building complex web products in a similar role (typically 4 years or more)- Full stack development experience or expertise in server-scaling will be preferred.- Agility and ability to deliver products quickly using open libraries, tools, modules.- Eager to learn and try out new technologies and frameworks.Our stack:--------------Applications and Platforms - Python, Tornado, Django, MySQL, Redis, Angular 6/7, jQueryDevops - Nginx, Ansible, Supervisor, EC2, RDS, CDN, SES, WebpackBenefits:------------ ESOP options
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos