Power BI: How to Remove Duplicate Rows Automatically
When your dataset is very large, there is a chance that there are duplicate rows of data that may cause inaccuracies when you aggregate data in your analysis. It is a good idea to remove duplicate rows as part of the data clean up process before developing your dashboard.
By duplicate rows, we mean that all the data across all columns in the row are exactly the same. Even if one column value is different, then Power BI will not consider it as a duplicate row.
Remove Duplicate Rows in Power Query Editor
Power Query Editor allows you to remove all duplicate rows with a few clicks. Once you have loaded your data then,
- Go to Power Query Editor (Home > Transform Data)
- From the Home table, select the Reduce Rows dropdown.
- From there, select the Remove Rows dropdown
- From the dropdown, select Remove Duplicates from the list.
This will remove all duplicate rows from the dataset.