Cutshort logo
It is a global technology consultancy  logo
Senior Data Engineer
It is a global technology consultancy
Senior Data Engineer
Scaling Theory's logo

Senior Data Engineer

at It is a global technology consultancy

Agency job
4.5 - 10 yrs
₹15L - ₹30L / yr
Bengaluru (Bangalore)
Skills
Spark
skill iconScala
Hadoop
skill iconAmazon Web Services (AWS)

Role overview:

  • Must have About 5 - 11 years and at least 3 years relevant experience with Bigdata. 
  • Must have Experience in building highly scalable business applications, which involve implementing large complex business flows and dealing with huge amounts of data. 
  • Must have experience in Hadoop, Hive, Spark with Scala with good experience in performance tuning and debugging issues.
  • Good to have any stream processing Spark/Java Kafka. 
  • Must have experience in design and development of Big data projects.
  • Good knowledge in Functional programming and OOP concepts, SOLID principles, design patterns for developing scalable applications. 
  • Familiarity with build tools like Maven. 
  • Must have experience with any RDBMS and at least one SQL database preferably PostgresSQL
  • Must have experience writing unit and integration tests using scaliest
  • Must have experience using any versioning control system - Git 
  • Must have experience with CI / CD pipeline – Jenkins is a plus  
  • Basic hands-on experience in one of the cloud provider (AWS/Azure) is a plus
  • Databricks Spark certification is a plus.


What would you do here:

As a Software Development Engineer 2 you will be responsible for expanding and optimising our data and data pipeline architecture as well as optimising data flow and collection for cross-functional teams. The ideal candidate is an experienced data pipeline design and data wrangler who enjoys optimising data systems and building them from the ground up. The Data Engineer will lead our software developers on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. The right candidate will be excited by the prospect of optimising or even re-designing our company’s data architecture to support our next generation of products and data initiatives.

 

Responsibilities:

 

•Create and maintain optimal data pipeline architecture

•Assemble large complex data sets that meet functional / non-functional business requirements.

•Identify design and implement internal process improvements: automating manual processes optimising data delivery, coordinating to re-design infrastructure for greater scalability etc.

•Work with stakeholders including the Executive Product Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.

•Keep our data separated and secure

•Work with data and analytics experts to strive for greater functionality in our data systems.

- Support PROD systems


Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

KGiSL Educational Institution
at KGiSL Educational Institution
2 candid answers
Muthusudha M
Posted by Muthusudha M
Malappuram
2 - 5 yrs
₹15L - ₹45L / yr
skill iconAmazon Web Services (AWS)
Cloud Computing
CI/CD

AWS & Cloud Computing Trainer

Ignite Careers. Inspire Innovation. Shape the Future of Cloud Technology.

KGiSL Educational Institution is looking for a passionate and dynamic AWS & Cloud Computing Trainer to empower the next generation of cloud professionals. If you have expertise in AWS and a passion for teaching, this is your opportunity to make a lasting impact.


Strong knowledge of AWS services such as EC2, S3, RDS, VPC, IAM, and Lambda.

Understanding of cloud computing, networking, Linux, and cloud security.

Excellent communication, presentation, and mentoring skills.

Passion for teaching and helping students succeed.

AWS certifications are an added advantage.

Read more
QAgile Services
at QAgile Services
1 recruiter
Radhika Chotai
Posted by Radhika Chotai
Bengaluru (Bangalore)
4 - 6 yrs
₹12L - ₹25L / yr
skill iconData Science
skill iconPython
skill iconMachine Learning (ML)
PowerBI
SQL
+5 more

Proven experience as a Data Scientist or similar role with relevant experience of at least 4 years and total experience 6-8 years.


· Technical expertiseregarding data models, database design development, data mining and segmentation techniques


· Strong knowledge of and experience with reporting packages (Business Objects and likewise), databases, programming in ETL frameworks


· Experience with data movement and management in the Cloud utilizing a combination of Azure or AWS features


· Hands on experience in data visualization tools – Power BI preferred


· Solid understanding of machine learning


· Knowledge of data management and visualization techniques


· A knack for statistical analysis and predictive modeling


· Good knowledge of Python and Matlab


· Experience with SQL and NoSQL databases including ability to write complex queries and procedures

Read more
Genius Placement Service
Muskan Keshvani
Posted by Muskan Keshvani
Ahmedabad
3 - 5 yrs
₹3L - ₹8L / yr
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconNodeJS (Node.js)
skill iconMongoDB
+3 more

We are looking for Full Stack Developer.

Experience - 3 to 5 years 

Location - Ahmedabad 

5 Days working 

 

Required Skills:

 

  • Should have strong hands on experience in Node.js, React.js & Angular.js.
  • Should have experience in MongoDB and Express.Js.
  • Deep understanding of object - oriented JavaScript and design principles and standards, and has a solid programming background
  • Experience handling different browser capabilities
  • Hands - on experience in UI optimization best practice implementations
  • Demonstrated ability to accurately estimate and scope development work
  • Good analytical and problem - solving skills
  • Communication skills are imperative both in written and in verbal form
  • Excellent organizational and coordination skills

 

Read more
codersbrain
at codersbrain
1 recruiter
Aishwarya Hire
Posted by Aishwarya Hire
Remote only
10 - 15 yrs
₹12L - ₹15L / yr
skill icon.NET
ASP.NET
skill iconC#
SQL server
• Proven experience as a .NET Developer using C# .Net
• Familiarity with the https://asp.net/?fbclid=IwAR2E05CZKAc0ulAMVDXy-U1b4z5TNHMd32KluZKxPgDb7gWeN-3I3gJTRl4" target="_blank">ASP.NET framework, SQL Server and design/architectural patterns (e.g. Model-View-Controller (MVC))
• Extensive experience using MS SQL Server
• Knowledge of at least one of the .NET languages (e.g. C#, Visual Basic .NET) and HTML5/CSS3 and Java Script
• Familiarity with architecture styles/APIs (REST, RPC)
• Understanding of Agile methodologies
• Excellent troubleshooting and communication skills
• Any experience Microsoft TFS server would be advantage
Read more
Swizzlein
at Swizzlein
1 recruiter
Vrinda Singhal
Posted by Vrinda Singhal
Bengaluru (Bangalore)
1 - 3 yrs
₹3.6L - ₹4.8L / yr
Search Engine Optimization (SEO)
Search Engine Marketing (SEM)
skill iconGoogle Analytics
Team Management
Social Media Marketing (SMM)
+1 more
  • You will be the One go-to person for - everything- Revenue & Growth. Responsible for building the team, processes & programs that enable growth.
  • Owns the overall revenue of the organisation. Manage P&L, Discounts & Marketing budgets efficiently.
  • Completely own User Acquisition, Conversion & Retention Drive tech enabled growth for the company.
  • Drive Digital & Offline marketing strategies. Completely own the performance marketing and assist in brand building.
  • Work with the agency to drive SEO (website) mandates for growing the organic traffic.
  • Influence online product changes on websites that drive discovery, user engagement & revenue.
  • Lead corporate partnerships and programs to build brand awareness and cost effective user acquisition.
Read more
Niyati Technologies
at Niyati Technologies
4 recruiters
Niyati T
Posted by Niyati T
Remote only
2 - 3 yrs
₹4L - ₹6L / yr
skill iconJavascript
skill iconVue.js
skill iconHTML/CSS
skill iconAngular (2+)
JSON
As a Fullstack Frontend UI Developer, you will be responsible for the development of rich user interfaces for our customer facing web applications. Candidates with prior experience in developing rich, interactive web applications with light-weight CSS and achieving >98% rating in Responsive Designs (using Lighthouse audits) will be preferred.

Candidates with experiencec in SaaS product development, deployment and Code Versioning using Git/BitBucket, and exposure to agile development practices will have an added advantage. 
Read more
Guerrillas Inc
at Guerrillas Inc
1 recruiter
Vishal Saini
Posted by Vishal Saini
NCR (Delhi | Gurgaon | Noida)
1 - 3 yrs
₹2L - ₹3L / yr
Social Media Marketing (SMM)
Viral Marketing
Content Writing
Content Marketing
Community Management
+1 more
We are looking for someone that has experience working with multiple brands in the social media marketing space. Must be well-organized, a strong communicator, client-facing, rock-star that bleeds social media marketing. We are growing and need someone that can hit the ground running! Candidate will oversee Social Media campaigns which include but are not limited to research, campaign & content creation, execution, monitoring, and reporting. Knowledge of some SEO best practices is also helpful but not a requirement (we can teach) as it is correlated to items we do in the social marketing and SEO space. RESPONSIBILITIES ● Work with clients to create a social media strategy that collaborates with marketing, PR and advertising campaigns, research top influencers, competitors, and trends in clients’ industries. ● Create timely and engaging content optimized for the platform used and intended audience. ● Monitor sites for customer service opportunities and initiate conversations on behalf of the client. ● Be happy, smile, and bring a positive attitude to the office ● Analyze and report social media actions on a monthly basis for successes and new opportunities. ● Create engaging and professional visuals that reflect client and their brand (Customize social media pages (ex. Facebook, Twitter, Google+, YouTube), develop supporting offline collateral, create original content, etc). ● Stay current with social media trends and tools – includes attending networking and educational events, reading blogs, and listening to podcasts. ● Continue to refine and define our social marketing process. ● Work with teams to create a solid branding message that’s reflected in Guerrillas marketing materials, social media content and shared by employees ● Available to attend events we sponsor on a monthly basis (usually no more than 1-2) on behalf of Guerrillas outside of standard hours SKILLS & EXPERIENCE ● 2+ years of social media marketing experience (prefer to have account management experience). ● Experience including but not limited to Facebook, LinkedIn, Google+, Google Communities, Twitter, Flickr, YouTube, Pinterest, and more. ● Knowledge of social media and analytics software (Hootsuite, Raven Tools, Google Analytics, Facebook Insights, etc.). ● Working knowledge of social media paid advertising campaigns including Facebook, Linkedin, and Twitter. ● Ability to blog about social media on the Guerrillas website based on research, experience, and relevant social media news. ADDITIONAL CONSIDERATION FOR... ● Strong understanding of user-generated content management, content marketing, and reputation management. ● Strong, professional written and verbal communication skills. ● Strategic content creation and excellent writing skills. ● Ability to work independently and in a team environment. ● Exceptional time management skills including the ability to handle multiple clients with changing priorities.
Read more
MindTickle
at MindTickle
1 video
11 recruiters
Akanksha Negi
Posted by Akanksha Negi
Remote, Pune
2 - 6 yrs
₹8L - ₹15L / yr
Software Testing (QA)
Test Automation (QA)
Load Testing
Performance Testing
Stress Testing
+2 more
We are looking for people who are have good analytical thinking, a well-defined approach, and an eye for detail.
As an QA in MindTickle you will be required to:
• The role will include working on web and mobile application.
• Be keen on finding loopholes, bugs in systems and should be able to think out of the box.
• Have good communication skills and be a good team player as well as an individual contributor.
• Own responsibility and handle ownership of assignments.
• Role will gradually grow from Manual to a full stack QA (Manual + Automation).
• Good programming skills.
Read more
Hurix Systems
at Hurix Systems
3 recruiters
Mohit Yadav
Posted by Mohit Yadav
Mumbai
0 - 1 yrs
₹1L - ₹2L / yr
Adobe Captivate
skill iconAdobe Illustrator
Adobe Photoshop
Captivate
Articulate storyline
Internship Duration – 3 months Photoshop & illustrator trained candidate
Read more
Swiggy
at Swiggy
1 video
13 recruiters
Suresh Kaushik
Posted by Suresh Kaushik
Bengaluru (Bangalore)
8 - 15 yrs
₹60L - ₹75L / yr
Engineering Management
Scalability
Software development management
Technical Architecture
skill iconJava
+1 more
Responsibilities And Scope • You not only have the technical chops to roll up sleeves and provide technical leadership to major projects, but also build and manage a team of 10-15 top notch engineers. • You not only optimize your own code but make sure engineers are able to optimize theirs. As an Engineering Manager you manage your business goals, contribute to product strategy and help develop your team • Create clear career paths for team members and help them grow with regular & deep mentoring. Perform regular performance evaluation and share and seek feedback. • Operating with scale and speed amidst flux, there is just a LOT happening. • Our world-class software engineers are just getting started -- and as a manager, you guide the way. You are their default mentor. • You work closely with Product Management, Business Development and Operations team and enable them by providing scalable and high quality technology solutions at a rapid pace • You set up best practices for development and champion their adoption and at the same time Architect & design technically robust, flexible and scalable solutions • You work with designers, business analysts, and product managers to estimate and plan projects in an Agile environment • Perform well in uncertainties and collaborate and work with unclear interfaces to other teams in our rapidly evolving organizations Must Have • Excellent leadership skills to mentor the engineers under you. • Deep understanding of technologies and architecture in a highly scalable and available set-up. • Deep understanding & expertise with highly transactional, large relational and complex systems • Strong object oriented design skills, and an uncanny ability to design intuitive module and class-level interfaces • Superior project management skills to manage multi-engineer projects and experience of delivering high quality projects on time • Above 9 years of experience with technology depth as well as good people skills • A BE/BTech in Computer Science or some equivalent academic stance. Nice To Have • Able to establish credibility with smart engineers quickly, and provide longer term vision and motivation. • Great people skills to closely work with other teams. Product Management, Business Development, and Operations, all need your expertise to ensure superior solutions match our scale of operations. • Very high technical competence, strong technical background with track record of individual technical accomplishments – Ability to play the role of the architect for the team
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos