Fidument Tools · Beta version

How do I remove CSV duplicates by selected columns?

Choose CSV columns to match rows. Keep the first or last record and download the cleaned file.

How do I remove CSV duplicates by selected columns?

How to use this tool

  1. Read the CSV headers

    Open a UTF-8 CSV, check the delimiter and select Read columns.

  2. Choose the key and retention rule

    Select the columns that identify a row together. Keep the first or last record in each group.

  3. Review the result

    Select Remove duplicates, check the number of removed rows and download the CSV.

When should I choose more than one column?

With code and warehouse selected, rows are duplicates when both values match. Rows with an empty key field are kept by default. You can include them in matching.

Who is it for?

  • People working with data exports and spreadsheets

Input

  • CSV UTF-8

Output

  • CSV

Capabilities

  • Open a UTF-8 CSV, check the delimiter and select Read columns.
  • Select the columns that identify a row together. Keep the first or last record in each group.
  • Select Remove duplicates, check the number of removed rows and download the CSV.

Limitations

  • CSV with unique headers up to 2 MiB, 20,000 rows and 100 columns. Matching is case- and whitespace-sensitive. Formula-like export fields may receive an apostrophe.

Example use

With code and warehouse selected, the same code in two warehouses remains in two rows.

Questions and answers

Where is my file processed?

Your browser processes the file on your device.

Related tools

Merge CSV files

Merge CSV files in your browser. Match columns by header name and choose file order.

Compare CSV files

Match two lists by an ID or compound key. Find changed, missing and duplicate records in your browser.

Remove CSV duplicates

Check access and export conditions in the app. A product description does not grant access.