Cutshort logo
Data Engineer
Top startup of India -  News App's logo

Data Engineer

Agency job
2 - 5 yrs
₹20L - ₹35L / yr (ESOP available)
Noida
Skills
Linux/Unix
skill iconPython
Hadoop
Apache Spark
skill iconMongoDB
Data flow
BigQuery
NOSQL Databases
Google Cloud Platform (GCP)
Responsibilities
● Create and maintain optimal data pipeline architecture.
● Assemble large, complex data sets that meet functional / non-functional
business requirements.
● Building and optimizing ‘big data’ data pipelines, architectures and data sets.
● Maintain, organize & automate data processes for various use cases.
● Identifying trends, doing follow-up analysis, preparing visualizations.
● Creating daily, weekly and monthly reports of product KPIs.
● Create informative, actionable and repeatable reporting that highlights
relevant business trends and opportunities for improvement.

Required Skills And Experience:
● 2-5 years of work experience in data analytics- including analyzing large data sets.
● BTech in Mathematics/Computer Science
● Strong analytical, quantitative and data interpretation skills.
● Hands-on experience with Python, Apache Spark, Hadoop, NoSQL
databases(MongoDB preferred), Linux is a must.
● Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
● Experience with Google Cloud Data Analytics Products such as BigQuery, Dataflow, Dataproc etc. (or similar cloud-based platforms).
● Experience working within a Linux computing environment, and use of
command-line tools including knowledge of shell/Python scripting for
automating common tasks.
● Previous experience working at startups and/or in fast-paced environments.
● Previous experience as a data engineer or in a similar role.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos

About Top startup of India - News App

Founded
Type
Size
Stage
About
N/A
Company social profiles
N/A

Similar jobs

Optisol Business Solutions Pvt Ltd
Veeralakshmi K
Posted by Veeralakshmi K
Remote, Chennai, Coimbatore, Madurai
4 - 10 yrs
₹10L - ₹15L / yr
skill iconPython
SQL
Amazon Redshift
Amazon RDS
AWS Simple Notification Service (SNS)
+5 more

Role Summary


As a Data Engineer, you will be an integral part of our Data Engineering team supporting an event-driven server less data engineering pipeline on AWS cloud, responsible for assisting in the end-to-end analysis, development & maintenance of data pipelines and systems (DataOps). You will work closely with fellow data engineers & production support to ensure the availability and reliability of data for analytics and business intelligence purposes.


Requirements:


·      Around 4 years of working experience in data warehousing / BI system.

·      Strong hands-on experience with Snowflake AND strong programming skills in Python

·      Strong hands-on SQL skills

·      Knowledge with any of the cloud databases such as Snowflake,Redshift,Google BigQuery,RDS,etc.

·      Knowledge on debt for cloud databases

·      AWS Services such as SNS, SQS, ECS, Docker, Kinesis & Lambda functions

·      Solid understanding of ETL processes, and data warehousing concepts

·      Familiarity with version control systems (e.g., Git/bit bucket, etc.) and collaborative development practices in an agile framework

·      Experience with scrum methodologies

·      Infrastructure build tools such as CFT / Terraform is a plus.

·      Knowledge on Denodo, data cataloguing tools & data quality mechanisms is a plus.

·      Strong team player with good communication skills.


Overview Optisol Business Solutions


OptiSol was named on this year's Best Companies to Work for list by Great place to work. We are a team of about 500+ Agile employees with a development center in India and global offices in the US, UK (United Kingdom), Australia, Ireland, Sweden, and Dubai. 16+ years of joyful journey and we have built about 500+ digital solutions. We have 200+ happy and satisfied clients across 24 countries.


Benefits, working with Optisol


·      Great Learning & Development program

·      Flextime, Work-at-Home & Hybrid Options

·      A knowledgeable, high-achieving, experienced & fun team.

·      Spot Awards & Recognition.

·      The chance to be a part of next success story.

·      A competitive base salary.


More Than Just a Job, We Offer an Opportunity To Grow. Are you the one, who looks out to Build your Future & Build your Dream? We have the Job for you, to make your dream comes true.

Read more
Carsome
at Carsome
3 recruiters
Piyush Palkar
Posted by Piyush Palkar
Remote, Kuala Lumpur
2 - 5 yrs
₹20L - ₹30L / yr
skill iconPython
skill iconAmazon Web Services (AWS)
skill iconDjango
skill iconFlask
TensorFlow
+2 more
Carsome is a growing startup that is utilising data to improve the experience of second hand car shoppers. This involves developing, deploying & maintaining machine learning models that are used to improve our customers' experience. We are looking for candidates who are aware of the machine learning project lifecycle and can help managing ML deployments.

Responsibilities: - Write and maintain production level code in Python for deploying machine learning models - Create and maintain deployment pipelines through CI/CD tools (preferribly GitLab CI) - Implement alerts and monitoring for prediction accuracy and data drift detection - Implement automated pipelines for training and replacing models - Work closely with with the data science team to deploy new models to production Required Qualifications: - Degree in Computer Science, Data Science, IT or a related discipline. - 2+ years of experience in software engineering or data engineering. - Programming experience in Python - Experience in data profiling, ETL development, testing and implementation - Experience in deploying machine learning models

Good to have: - Experience in AWS resources for ML and data engineering (SageMaker, Glue, Athena, Redshift, S3) - Experience in deploying TensorFlow models - Experience in deploying and managing ML Flow
Read more
LS Spectrum Solutions Private Limited
Mumbai
5 - 10 yrs
₹8L - ₹15L / yr
skill iconPostgreSQL
Database Design
Database architecture
Databases
Linux/Unix
+5 more

Job Description

▪ You are responsible for setting up, operating, and monitoring LS system solutions on premise and in the cloud

▪ You are responsible for the analysis and long-term elimination of system errors

▪ You provide support in the area of ​​information and IT security

▪ You will work on the strategic further development and optimize the platform used

▪ You will work in a global, international team requirement profile

▪ You have successfully completed an apprenticeship / degree in the field of IT

▪ You can demonstrate in-depth knowledge and experience in the following areas:

▪ PostgreSQL databases

▪ Linux (e.g. Ubuntu, Oracle Linux, RHEL)

▪ Windows (e.g. Windows Server 2019/2022)

▪ Automation / IaC (e.g. Ansible, Terraform)

▪ Containerization with Kubernetes / Virtualization with Vmware is an advantage

▪ Service APIs (AWS, Azure)

▪ You have very good knowledge of English, knowledge of German is an advantage

▪ You are a born team player, show high commitment and are resilient

Read more
Dotball Interactive Private Limited
Veena K V
Posted by Veena K V
Bengaluru (Bangalore)
1 - 2 yrs
₹3L - ₹6L / yr
skill iconPython
skill iconData Analytics
SQL server
- Excellent skill in SQL and SQL tools - Fantasy Gamer - Excited to dive deep into data and derive insights - Decent communication and writing skills - Interested in Automated solutions - Startup and Growth Mindset - Analytical Data mining thinking - Python - Good programmer
Read more
Hiring for a leading client
New Delhi
3 - 5 yrs
₹10L - ₹15L / yr
Big Data
Apache Kafka
Business Intelligence (BI)
Data Warehouse (DWH)
Coding
+15 more
Job Description:
Senior Software Engineer - Data Team

We are seeking a highly motivated Senior Software Engineer with hands-on experience and build scalable, extensible data solutions, identifying and addressing performance bottlenecks, collaborating with other team members, and implementing best practices for data engineering. Our engineering process is fully agile, and has a really fast release cycle - which keeps our environment very energetic and fun.

What you'll do:

Design and development of scalable applications.
Work with Product Management teams to get maximum value out of existing data.
Contribute to continual improvement by suggesting improvements to the software system.
Ensure high scalability and performance
You will advocate for good, clean, well documented and performing code; follow standards and best practices.
We'd love for you to have:

Education: Bachelor/Master Degree in Computer Science.
Experience: 3-5 years of relevant experience in BI/DW with hands-on coding experience.

Mandatory Skills

Strong in problem-solving
Strong experience with Big Data technologies, Hive, Hadoop, Impala, Hbase, Kafka, Spark
Strong experience with orchestration framework like Apache oozie, Airflow
Strong experience of Data Engineering
Strong experience with Database and Data Warehousing technologies and ability to understand complex design, system architecture
Experience with the full software development lifecycle, design, develop, review, debug, document, and deliver (especially in a multi-location organization)
Good knowledge of Java
Desired Skills

Experience with Python
Experience with reporting tools like Tableau, QlikView
Experience of Git and CI-CD pipeline
Awareness of cloud platform ex:- AWS
Excellent communication skills with team members, Business owners, across teams
Be able to work in a challenging, dynamic environment and meet tight deadlines
Read more
TVS Credit Services
at TVS Credit Services
2 recruiters
Vinodhkumar Panneerselvam
Posted by Vinodhkumar Panneerselvam
Chennai
4 - 10 yrs
₹10L - ₹20L / yr
skill iconData Science
skill iconR Programming
skill iconPython
skill iconMachine Learning (ML)
Hadoop
+3 more
Job Description: Be responsible for scaling our analytics capability across all internal disciplines and guide our strategic direction in regards to analytics Organize and analyze large, diverse data sets across multiple platforms Identify key insights and leverage them to inform and influence product strategy Technical Interactions with vendor or partners in technical capacity for scope/ approach & deliverables. Develops proof of concept to prove or disprove validity of concept. Working with all parts of the business to identify analytical requirements and formalize an approach for reliable, relevant, accurate, efficientreporting on those requirements Designing and implementing advanced statistical testing for customized problem solving Deliver concise verbal and written explanations of analyses to senior management that elevate findings into strategic recommendations Desired Candidate Profile: MTech / BE / BTech / MSc in CS or Stats or Maths, Operation Research, Statistics, Econometrics or in any quantitative field Experience in using Python, R, SAS Experience in working with large data sets and big data systems (SQL, Hadoop, Hive, etc.) Keen aptitude for large-scale data analysis with a passion for identifying key insights from data Expert working knowledge in various machine learning algorithms such XGBoost, SVM Etc. We are looking candidates from the following: Experience in Unsecured Loans & SME Loans analytics (cards, installment loans) - risk based pricing analytics Experience in Differential pricing / selection analytics (retail, airlines / travel etc). Experience in Digital product companies or Digital eCommerce with Product mindset and experience Experience in Fraud / Risk from Banks, NBFC / Fintech / Credit Bureau Experience in Online media with knowledge of media, online ads & sales (agencies) - Knowledge of DMP, DFP, Adobe/Omniture tools, Cloud Experience in Consumer Durable Loans lending companies (Experience in Credit Cards, Personal Loan - optional) Experience in Tractor Loans lending companies (Experience in Farm) Experience in Recovery, Collections analytics Experience in Marketing Analytics with Digital Marketing, Market Mix modelling, Advertising Technology
Read more
Kalibre global konnects
at Kalibre global konnects
7 recruiters
Monika Sanghvi
Posted by Monika Sanghvi
Ahmedabad
1 - 4 yrs
₹3L - ₹5L / yr
skill iconPython
skill iconR Programming
skill iconData Science
skill iconData Analytics
Big Data
Job Description:-
 Job Title:- Assistant Manager - Business Analytics
 Age: Max. 35years.
 Working Days:- 6 days a week
 Location:- Ahmedabad, Gujarat
 Monthly CTC:- Salary will commensurate with experience.
 Educational Qualification:- The candidate should have bachelor’s degree in
IT/Engineering from any recognized university..
 Experience:- 2+ years of work experience in AI/ML/business analytics with Institute of
repute or corporate.
Required Technical Skills:-
 A fair bit of understanding of Business Analytics, Data Science, Visualization/Big Data
etc.
 Basic knowledge of different analytical tools such as R Programming, Python etc.
 Hands on experience in Moodle Development (desirable).
 Good knowledge in customizing Moodle functionalities and developing custom themes
for Moodle (desirable).
 An analytical mind-set who enjoy helping participants solving problems and turning data
into useful actionable information
Key Responsibilities include:-
 Understand the tools and technologies specific to e-learning and blended learning
development and delivery.
 Provide academic as well as technical assistance to the faculty members teaching the
analytics courses.
 Working closely with the Instructors and assisting them in programming, coding, testing
etc.
 Preparing the lab study material in coordination with the Instructors and assisting
students in programming lab and solving their doubts.
 Works on assignments dealing with the routine and daily operation, use, and
configuration of the Learning Management System (LMS).
 Administers learning technology platforms including the creation of courses,
certifications and other e-learning programs on the platforms.
 Responsible to provide support within the eLearning department, provide technical
support to our external clients, and administrate the Learning Management System.
 Creates user groups and assigns content and assessments to the right target audience,
runs reports and creates learning evens in the LMS system.
 Performs regular maintenance of LMS database, including adding or removing courses.
 Uploads, tests, deploys and maintains all training materials/learning assets hosted in the
LMS.
 Ability to Multi-task.
 Ability to demonstrate accuracy on detailed oriented and repetitive job assignments.
 Responsible and reliable
Read more
Chennai, Bengaluru (Bangalore), Hyderabad
2 - 5 yrs
₹4L - ₹13L / yr
skill iconMachine Learning (ML)
skill iconData Science
skill iconPython
NumPy
pandas
+3 more

 

Job Title : Analyst / Sr. Analyst – Data Science Developer - Python

Exp : 2 to 5 yrs

Loc : B’lore / Hyd / Chennai

NP: Candidate should join us in 2 months (Max) / Immediate Joiners Pref.

 

About the role:

 

We are looking for an Analyst / Senior Analyst who works in the analytics domain with a strong python background.

 

Desired Skills, Competencies & Experience:

 

•                     • 2-4 years of experience in working in the analytics domain with a strong python background.

•                     • Visualization skills in python with plotly, matplotlib, seaborn etc. Ability to create customized plots using such tools.

•                     • Ability to write effective, scalable and modular code. Should be able to understand, test and debug existing python project modules quickly and contribute to that.

•                     • Should be familiarized with Git workflows.

 

Good to Have:

•                     • Familiarity with cloud platforms like AWS, AzureML, Databricks, GCP etc.

•                     • Understanding of shell scripting, python package development.

•                     • Experienced with Python data science packages like Pandas, numpy, sklearn etc.

•                     • ML model building and evaluation experience using sklearn.

 

Read more
Fint Solutions
at Fint Solutions
1 recruiter
Thallada Naveen
Posted by Thallada Naveen
Hyderabad
7 - 10 yrs
₹10L - ₹20L / yr
Data engineering
Data engineer
SSIS
Azure data factory
Data migration
+2 more
Job Locations: Hyderabad, Telangana, India
Required Experience: 5 - 7 Years
Skills : ADF, Azure, SSIS, python
Job Description
Azure Data Engineer with hands on SSIS migrations and ADF expertise.

Roles & Responsibilities
•Overall, 6+ years’ experience in Cloud Data Engineering, with hands on experience in ADF (Azure Data Factory) is required.
Hands on experience with SSIS to ADF migration is preferred.
SQL Server Integration Services (SSIS) workloads to SSIS in ADF. ( Must have done at least one migration)
Hands on experience implementing Azure Data Factory frameworks, scheduling, and performance tuning.
Hands on experience in migrating SSIS solutions to ADF
Hands on experience in ADF coding side.
Hands on experience with MPP Database architecture
Hands on experience in python
Read more
NCR (Delhi | Gurgaon | Noida)
10 - 12 yrs
₹20L - ₹25L / yr
skill iconPython
skill iconDjango
Product Management
Product development
Position: Associate Director – Technology Lead (Gurgaon) Reporting to: Head – Product and Engineering (VP) (Gurgaon) Experience :10-12 years Who are we looking for: We are looking for a smart and dynamic Technology Champion who will be responsible for leading a dynamic tech team to partner with business and create solutions that are forward looking and futuristic. The successful applicant would thrive in a fast paced environment, and would be excited to work on delivering world class systems using innovative solutions to business problem. We would like to invite people who have worked in progressive organizations, as part of a successful Technology team to come and join us. If you think you would enjoy working in a fast paced, hyper growth organization, you are the right person for us. What would you be expected to do: ✓ Responsible for developing architecture frameworks using latest tools and technologies ✓ Developing and supporting Python and Django based applications in highly scalable environments ✓ Responsible for application design using Design Patterns, UML, component architecture, automated unit/functional testing, and/ or database design and modeling ✓ Hands-on experience with setting up a web server such as Apache or nginx ✓ Experience with Public Cloud services such as AWS (EC2, S3, RDS, SQS) ✓ Experience in Web Services Soap/Rest, and front end technologies like jQuery, JSP and HTML ✓ Proficient in a modern open-source relational database such as MySQL or Postgres ✓ Proficient in HTTP protocol, REST APIs, JSON ✓ Strong understanding of the technology industry, including current and emerging solutions and trends ✓ Exceptional executive communication and interpersonal skills with the proven ability to transfer knowledge and inspire a growth mindset ✓ Consistent record of driving complex projects with quality and timeliness ✓ Drive the right technology choices (e.g. languages, libraries, frameworks) ✓ Lay out the technology architecture for both immediate and long term growth ✓ Work closely with cross-functional team members including product and project management to ensure high quality, on time software product delivery ✓ Drive innovative, mission-critical design and architecture using log streams and micro-services ✓ Support Continuous Integration and Continuous Deployment of use cases and solutions partnering with all relevant stakeholders ✓ Lead and collaborate with a team of diverse thinkers Leadership Attributes ✓ Mentor and guide the professional and technical development of your team members. Help develop in their roles by leveraging their skill levels, personalities, work styles, and professional goals. Hire the best Engineers to build out the Software development team ✓ Assist Delivery and Operations team with customization requests and technical feasibility responses to the clients ✓ Participate with Core-team in making key Product and tech roadmap related decisions Successful Candidate would have: ✓ 10-12 years of experience, leading projects and high performance teams ✓ Must have worked closely with the business ✓ Strategic thinker and problem solver with excellent analytical and reporting skills ✓ Engaging people leader with proven ability to inspire and lead the team ✓ Personal drive (proactive), flexible, creative (thinks out of the box), result driven, responsible, curious, team player and fast learner ✓ Ability to succeed in a culture where change and speed are part of daily work. ✓ Strong collaboration skills and the ability to engage with team members, fostering a high degree of commitment to quality, delivery and client satisfaction ✓ Engage with key stakeholders in a creative, dynamic and flexible manner. If interested, please send your updated profile in word format with below details for further discussion at the earliest. 1. Current Company 2. Current Designation 3. Total Experience 4. Current CTC( Fixed & Variable) 5. Expected CTC 6. Notice Period 7. Current Location 8. Reason for Change 9. Availability for face to face interview on weekdays 10.Education Degree 11. People Management Exposure 12.Key Tech Skills Exposure Thanks & Regards, Hema Talent Socio
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos