Cutshort logo
one-to-one, one-to-many, and many-to-many logo
Data Engineer
one-to-one, one-to-many, and many-to-many
Data Engineer
The Hub's logo

Data Engineer

at one-to-one, one-to-many, and many-to-many

Agency job
5 - 9 yrs
₹1L - ₹15L / yr
Chennai
Skills
PowerBI
skill iconPython
Spark
skill iconData Analytics
data brick

Position Overview: We are seeking a talented Data Engineer with expertise in Power BI to join our team. The ideal candidate will be responsible for designing and implementing data pipelines, as well as developing insightful visualizations and reports using Power BI. Additionally, the candidate should have strong skills in Python, data analytics, PySpark, and Databricks. This role requires a blend of technical expertise, analytical thinking, and effective communication skills.

Key Responsibilities:

  1. Design, develop, and maintain data pipelines and architectures using PySpark and Databricks.
  2. Implement ETL processes to extract, transform, and load data from various sources into data warehouses or data lakes.
  3. Collaborate with data analysts and business stakeholders to understand data requirements and translate them into actionable insights.
  4. Develop interactive dashboards, reports, and visualizations using Power BI to communicate key metrics and trends.
  5. Optimize and tune data pipelines for performance, scalability, and reliability.
  6. Monitor and troubleshoot data infrastructure to ensure data quality, integrity, and availability.
  7. Implement security measures and best practices to protect sensitive data.
  8. Stay updated with emerging technologies and best practices in data engineering and data visualization.
  9. Document processes, workflows, and configurations to maintain a comprehensive knowledge base.

Requirements:

  1. Bachelor’s degree in Computer Science, Engineering, or related field. (Master’s degree preferred)
  2. Proven experience as a Data Engineer with expertise in Power BI, Python, PySpark, and Databricks.
  3. Strong proficiency in Power BI, including data modeling, DAX calculations, and creating interactive reports and dashboards.
  4. Solid understanding of data analytics concepts and techniques.
  5. Experience working with Big Data technologies such as Hadoop, Spark, or Kafka.
  6. Proficiency in programming languages such as Python and SQL.
  7. Hands-on experience with cloud platforms like AWS, Azure, or Google Cloud.
  8. Excellent analytical and problem-solving skills with attention to detail.
  9. Strong communication and collaboration skills to work effectively with cross-functional teams.
  10. Ability to work independently and manage multiple tasks simultaneously in a fast-paced environment.

Preferred Qualifications:

  • Advanced degree in Computer Science, Engineering, or related field.
  • Certifications in Power BI or related technologies.
  • Experience with data visualization tools other than Power BI (e.g., Tableau, QlikView).
  • Knowledge of machine learning concepts and frameworks.


Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Talent Pro
Mayank choudhary
Posted by Mayank choudhary
Bengaluru (Bangalore)
2 - 4 yrs
₹15L - ₹20L / yr
1.Performance marketing and its budgeting 2. ATL-BTL Marketing exposure...

1.Performance marketing and its budgeting

2. ATL-BTL Marketing exposure

3.Should have hands on experience in Influencer Marketing (Meta)

4.Candidates from D2C space only will be considered

Read more
Hunarstreet Technology
Hunarstreet Technology
Agency job
via Hunarstreet Technologies Pvt Ltd by Sakshi Patankar
Sanjan Gujrat
9 - 10 yrs
₹15L - ₹24L / yr
Manufacturing
Welding

1. Production and Demand & Supply Planning (Shift Wise/Daily/Weekly/Monthly)

2. Ensuring that customer needs are met in a way to improve customer satisfaction level

and handling customer complaints (if any) (Supplies, Services, Continuous Improvement,

Communications, etc.)

3. Building new processes / procedures.

4. Simplifying manufacturing through work study, line balancing and promoting automation

5. Prioritizing and accommodating change requests in a prioritized manner

6. Ensure Adherence to Quality assurance processes by evaluating quality of inputs,

processes and outputs.

7. Improve the topline by ensuring the RFD Adherence and Dispatch Adherence as per target

and using forward thinking to identify the possible bottlenecks to achieve the same and

hence, initiate the necessary action to de-bottleneck the process.

8. Establish a system to reduce the dependency on the workforce and set up a

semi-automatic process or low cost automation to make the process more agile and

robust.

9. Exhibit Safety Leadership by adhering to safety standards, enhancing behavioral safety,

machine safety, process safety, ergonomics safety, industrial hygiene

10.Establish a System related to EHS (Environment Health & Safety) to ensure that risks are

assessed, the workplace remains safe and healthy for manpower .

11.Ensure protection of Environment by adopting environmentally conscious practices.

12.Ensure the adherence of plant statutory compliance norms

13.Ensure the smooth batch processing of new products at Plant through the existing

resources by developing process performance & process development.

14.People Development in different segments to ensure multi skill availability of the

workforce.

15.People (White Collar) Development and Management & Middle Level Leadership

development. (Talent Management, Planning Individual Development, Upskilling, etc.)

16.Managing performance of Production employees (Staff & Workers)

17.Budgeting, Monitor & Control on Conversion and Operational Cost Management and

achieve a new benchmark.

18.Inventory control to ensure the minimal variance in ERP Vs Physical Stock.

19.Development of Local Vendor to find alternate solutions related to manufacturing and

having cost effective solutions.

Read more
Building decentralized financial protocols and applications
Building decentralized financial protocols and applications
Agency job
via Qrata by Blessy Fernandes
Remote only
2 - 5 yrs
₹20L - ₹35L / yr
DevOps
skill iconDocker
skill iconKubernetes
CI/CD
Reliability engineering
+2 more
Role & Responsibilities:
 Managing cloud-based serverless infrastructure on AWS, GCP(firebase) with IaC
(Terraform, CloudFormation etc.,)
 Deploying and maintaining products, services, and network components with a focus
on security, reliability, and zero downtime
 Automating and streamlining existing processes to aid the development team
 Working with the development team to create ephemeral environments, simplifying
the development lifecycle
 Driving forward our blockchain infrastructure by creating and managing validators for
a wide variety of new and existing blockchains
Requirements:
 1-3+ years in a SRE / DevOps / DevSecOps or Infrastructure Engineering role
 Strong working knowledge of Amazon Web Services (AWS) or GCP or similar cloud
ecosystem
 Experience working with declarative Infrastructure-as-Code frameworks(Terraform,
CloudFormation)
 Experience with containerization technologies and tools (Docker, Kubernetes), CI/CD
pipelines and Linux/Unix administration
 Bonus points - if you know more about crypto, staking, defi, proof-of-stake,
validators, delegations
Benefits:
 Competitive CTC on par with market along with ESOPs/Tokens
Read more
Machint solutions private Limited
Ram Nallanthighal
Posted by Ram Nallanthighal
Hyderabad
4 - 15 yrs
₹10L - ₹30L / yr
Pega
Pega PRPC
certified senior system architect
Machint Solutions is a IT Solutions and Services provider in the space of intelligent Automation using the Business Process Autoamtion and Artificial Intelligence. We are seeking to hire a few Senior and Certified Pega developers with a minimum 4 years of relevant experiece in the pega application development.

What we need from you:
  • CSSA certification prior to Dec 2019
  • Minimum 4 years relevant experience in pega application development
  • Strong technical acumen
  • Willingness to work from Office, if required, after the pandemic
  • Represent Machint if deployed at client location
  • Cadets with a shorter notice period OR left with a shorter notice while serving notice are the TOP PRIORITY.
Read more
Bidgely
at Bidgely
4 candid answers
2 recruiters
Agency job
via wrackle by Naveen Taalanki
Bengaluru (Bangalore)
6 - 10 yrs
₹20L - ₹40L / yr
SDET
Automation
Test Automation (QA)
Selenium
TestNG
+18 more
Responsibilities

  • Design and develop a framework, internal tools, and scripts for testing large-scale data systems, machine learning algorithms, and responsive User Interfaces.
  • Create repeatability in testing through automation
  • Participate in code reviews, design reviews, architecture discussions.
  • Performance testing and benchmarking of Bidgely product suites
  • Driving the adoption of these best practices around coding, design, quality, performance in your team.
  • Lead the team on all technical aspects and own the quality of your teams’ deliverables
  • Understand requirements, design exhaustive test scenarios, execute manual and automated test cases, dig deeper into issues, identify root causes, and articulate defects clearly.
  • Strive for excellence in quality by looking beyond obvious scenarios and stated requirements and by keeping end-user needs in mind.
  • Debug automation, product, deployment, and production issues and work with stakeholders/team on quick resolution
  • Deliver a high-quality robust product in a fast-paced start-up environment.
  • Collaborate with the engineering team and product management to elicit & understand their requirements and develop potential solutions.
  • Stay current with the latest technology, tools, and methodologies; share knowledge by clearly articulating results and ideas to key decision-makers.

Requirements

  •  BS/MS in Computer Science, Electrical or equivalent
  • 6+ years of experience in designing automation frameworks, tools
  • Strong object-oriented design skills, knowledge of design patterns, and an uncanny ability to
    design intuitive module and class-level interfaces
  • Deep understanding of design patterns, optimizations
  • Experience leading multi-engineer projects and mentoring junior engineers
  • Good understanding of data structures and algorithms and their space and time complexities. Strong technical aptitude and a good knowledge of CS fundamentals
  • Experience in non-functional testing and performance benchmarking
  • Knowledge of Test-Driven Development &  implementing CD/CD
  • Strong hands-on and practical working experience with at least one programming language: Java/Python/C++
  • Strong analytical, problem solving, and debugging skills.
  • Strong experience in API automation using Jersey/Rest Assured.
  • Fluency in automation tools, frameworks such as Selenium, TestNG, Jmeter, JUnit, Jersey, etc...
  • Exposure to distributed systems or web applications
  • Good in RDBMS or any of the large data systems such as Hadoop, Cassandra, etc.
  • Hands-on experience with build tools like Maven/Gradle &  Jenkins
  • Experience in testing on various browsers and devices.
  • Strong communication and collaboration skills.
Read more
Bengaluru (Bangalore)
1 - 8 yrs
₹8L - ₹14L / yr
Spark
Hadoop
Big Data
Data engineering
PySpark
+8 more
In this role, you will be part of a growing, global team of data engineers, who collaborate in DevOps mode, in order to enable Merck business with state-of-the-art technology to leverage data as an asset and to take better informed decisions.

The Merck Data Engineering Team is responsible for designing, developing, testing, and supporting automated end-to-end data pipelines and applications on Merck’s data management and global analytics platform (Palantir Foundry, Hadoop, AWS and other components).

The Foundry platform comprises multiple different technology stacks, which are hosted on Amazon Web Services (AWS) infrastructure or on-premise Merck’s own data centers. Developing pipelines and applications on Foundry requires:

• Proficiency in SQL / Java / Python (Python required; all 3 not necessary)
• Proficiency in PySpark for distributed computation
• Familiarity with Postgres and ElasticSearch
• Familiarity with HTML, CSS, and JavaScript and basic design/visual competency
• Familiarity with common databases (e.g. JDBC, mySQL, Microsoft SQL). Not all types required

This position will be project based and may work across multiple smaller projects or a single large project utilizing an agile project methodology.

Roles & Responsibilities:
• Develop data pipelines by ingesting various data sources – structured and un-structured – into Palantir Foundry
• Participate in end to end project lifecycle, from requirements analysis to go-live and operations of an application
• Acts as business analyst for developing requirements for Foundry pipelines
• Review code developed by other data engineers and check against platform-specific standards, cross-cutting concerns, coding and configuration standards and functional specification of the pipeline
• Document technical work in a professional and transparent way. Create high quality technical documentation
• Work out the best possible balance between technical feasibility and business requirements (the latter can be quite strict)
• Deploy applications on Foundry platform infrastructure with clearly defined checks
• Implementation of changes and bug fixes via Merck's change management framework and according to system engineering practices (additional training will be provided)
• DevOps project setup following Agile principles (e.g. Scrum)
• Besides working on projects, act as third level support for critical applications; analyze and resolve complex incidents/problems. Debug problems across a full stack of Foundry and code based on Python, Pyspark, and Java
• Work closely with business users, data scientists/analysts to design physical data models
Read more
Quazma Techno Solutions
Chhabi Saxena
Posted by Chhabi Saxena
Indore
1 - 3 yrs
₹2L - ₹4L / yr
skill iconPHP
skill iconLaravel
MySQL
skill iconHTML/CSS
Web Development

We are hiring PHP Developer

Strong understanding of core PHP, MySQL, JavaScript, and any PHP framework Can handle projects independently and should be a good team builder. -Excellent Technical knowledge is a must. I-Excellent problem-solving skills and love a technical challenge.Must have prior experience in WordPress, Codeigniter, Laravel, MVC.

Responsibilities and Duties

  • Build efficient, testable, and reusable PHP modules
  • Solve complex performance problems and architectural challenges
  • Write “clean”, well-designed code
  • Produce detailed specifications
  • Troubleshoot, test, and maintain the core product software and databases to ensure strong optimization and functionality
  • Contribute to all phases of the development life cycle
  • Follow industry best practices
  • Develop and deploy new features to facilitate related procedures and tools if necessary
  • Required Experience, Skills, and Qualifications
  • Core knowledge of PHP 5. X.X
  • Good knowledge of APACHE / NGINX configurations
  • Good knowledge of MySQL / SQL queries.
  • Strong OOPS concept and OOPS usage in PHP.
  • Knowledge of MVC Architecture (Codeigniter) based frameworks in PHP.
  • Good Skills in HTML, HTML 5. javaScript / Jquery, CSS and AJAX.
  • Good Skills in J
  • Proven hands-on experience of CMS like Magneto, Word press,
  • WooCommerce would be a plus point
  • Must have knowledge of WordPress theme Building from Scratch.
  • Must be able to handle multiple projects and deadlines.
  • Must have Working experience with WordPress themes and Plugins

Additional Skills:

  • Good analytical, reasoning, logic, and troubleshooting skills.
  • Decent communication.
  • Having worked on Linux / Ubuntu systems.
  • Job Location: Indore
  • 5Dayworking
Read more
Saankhya Technosystems Pvt Ltd
Pune
0 - 3 yrs
₹1L - ₹1.8L / yr
Oracle Financials
SQL
Oracle
Oracle Fusion
Functional Capabilities
 
1.     Bachelor’s degree in Commerce , Inter CA/Inter CWA
2.     Minimum experience of 0-1 years working support/implementation of oracle financial modules
3.     Understanding of India Localization taxes and EBT
4.     Strong accounting knowledge
5.     Proficiency with MS Office applications
6.     Team player with excellent written and verbal communication skill
7.     Quick Learner
8.     Basic knowledge of SQL,PL/SQL and Good technical understanding will be added advantage

Read more
DemandMatrix
at DemandMatrix
4 recruiters
Harwinder Singh
Posted by Harwinder Singh
Remote only
9 - 12 yrs
₹25L - ₹30L / yr
Big Data
PySpark
Apache Hadoop
Spark
skill iconPython
+3 more

Only a solid grounding in computer engineering, Unix, data structures and algorithms would enable you to meet this challenge.

7+ years of experience architecting, developing, releasing, and maintaining large-scale big data platforms on AWS or GCP

Understanding of how Big Data tech and NoSQL stores like MongoDB, HBase/HDFS, ElasticSearch synergize to power applications in analytics, AI and knowledge graphs

Understandingof how data processing models, data location patterns, disk IO, network IO, shuffling affect large scale text processing - feature extraction, searching etc

Expertise with a variety of data processing systems, including streaming, event, and batch (Spark,  Hadoop/MapReduce)

5+ years proficiency in configuring and deploying applications on Linux-based systems

5+ years of experience Spark - especially Pyspark for transforming large non-structured text data, creating highly optimized pipelines

Experience with RDBMS, ETL techniques and frameworks (Sqoop, Flume) and big data querying tools (Pig, Hive)

Stickler of world class best practices, uncompromising on the quality of engineering, understand standards and reference architectures and deep in Unix philosophy with appreciation of big data design patterns, orthogonal code design and functional computation models
Read more
Gymnage Labs Pvt. Ltd.
at Gymnage Labs Pvt. Ltd.
1 recruiter
Swarup K
Posted by Swarup K
Hyderabad
2 - 4 yrs
₹3L - ₹5L / yr
Agile/Scrum
Functional Testing
Software Testing (QA)
At Gymnage Labs, we are building the next level software for gyms. Wether it is building web apps to help gyms streamline their operations or building mobile apps to drive customer engagement and retention, we live and breath to help gyms serve their customers better. We are looking for a QA Analyst to join our team of 3 developers. Expected day to day responsibilities include - 1. Taking complete ownership of defining requirements. 2. Formulating quality test cases 3. Manual execution of test cases 4. Test reporting 5. Tracking Regressions 5. Bug Triages The ideal candidate should be - 1. A Self Starter 2. Not afraid of taking ownership 3. Comfortable working in an agile environment 4. Experienced with using a test management tool (We use Jira and Zephyr to track our user stories and test cases) The recruited candidate will be the only QA in the team and is expected take up lead role as the product, team and company continues to grow. If you think you are up to it, please apply to this job and we'll take it from there.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos