How to remove all the duplicated words on every line using Notepad++?

Gabriel

I'm working on a file containing lines with keywords and some lines contain duplicated keywords.

For example:

dangerous,dangerous,hazardous,perilous

I want to tell Notepad++ that I want to remove every duplicated word per line. For this example dangerous, would be removed:

dangerous,hazardous,perilous

I have a bunch of lines like that and that's why I'm looking for an automated way of doing this.

amiregelz

You can use a regular expression to remove consecutive duplicated words in a line, however I don't think it's possible to remove duplicated words which are not consecutive (e.g dangerous, hazardous, dangerous).

Use this regex in the replace window in Notepad++, and don't forget to select "Regular expression" as the Search Mode option below:

This regex will remove all consecutive duplicated words - whether it's 2 duplicated words or 10 duplicated words consecutively: \b(\w+)(?:,\s+\1\b)+.

The exact same no-commas regex would be: \b(\w+)(?:\s+\1\b)+ (might be useful for other users).

If you want a regex specifically for only two duplicated words (doubles), use this regex: (\b\w+\b)\W+\1.

Place this regex in the Replace with box to keep one occurrence of the word (otherwise all repeated words will be removed): ${1}.

These regular expressions will fix a situation like the one you described in your question as an example. The first regex will work for every number of duplicated words (e.g dangerous, dangerous, dangerous, dangerous, hazardous), while the second version will only work for two duplicated words (e.g dangerous, dangerous, hazardous).

Note: The regular expression will only apply to the format described in the question, meaning that formats like two words, two words, anotherword, two-words, two-words, anotherword, three words expression, three words expression, anotherword won't be changed because the regex won't apply to them.

Collected from the Internet

Please contact [email protected] to delete if infringement.

edited at
0

Comments

0 comments
Login to comment

Related

How to remove every odd line in Notepad++?

Remove all entries except specific words using notepad ++

How to remove 'all duplicated ' values?

How to add a character after every ODD line and before every EVEN line using Notepad++

How to extract unique words/remove duplicated words from strings

Replace words in a line using notepad++

How to remove a specific, duplicated line within a file?

How do I remove every second character in all line with Emeditor

How to delete every third line on Notepad++?

How to remove the duplicate words between the line using Awk

Remove everything except for first 3 words of a line in Notepad++

using R How to remove all words after a specific character in

Remove all duplicated rows

Complexity of generating all pairs of words in a line for every line in a file

Notepad++ delete until colon for every line with replace all

Using Notepad++, how to find certain character(s) in every line in position X

How to copy upto a particular character(including that character) in every line using Notepad ++

How to write a program that reads the text file line by line and remove all the 'the' words and write it to another file

How to draw a line every 25 words?

How can I add double inverted commas to all the words/strings in a sentence using Notepad++?

How to remove or hide the folding line in Notepad++?

Notepad++ : How to Delete every line starting with string + the previous line

Using recursive function to remove all duplicated array elements

Remove duplicated strings within Notepad++

Notepad ++ How to remove all characters after a string

How to remove all words before specific word using Python (if there are multiple specific words)?

Remove duplicated line dividers with jQuery

Notepad++ : How to remove everything in a multiple lines except words in Capital

Notepad++ Remove all characters at beginning of line before alpha character

TOP Ranking

  1. 1

    Failed to listen on localhost:8000 (reason: Cannot assign requested address)

  2. 2

    Loopback Error: connect ECONNREFUSED 127.0.0.1:3306 (MAMP)

  3. 3

    How to import an asset in swift using Bundle.main.path() in a react-native native module

  4. 4

    pump.io port in URL

  5. 5

    Compiler error CS0246 (type or namespace not found) on using Ninject in ASP.NET vNext

  6. 6

    BigQuery - concatenate ignoring NULL

  7. 7

    ngClass error (Can't bind ngClass since it isn't a known property of div) in Angular 11.0.3

  8. 8

    ggplotly no applicable method for 'plotly_build' applied to an object of class "NULL" if statements

  9. 9

    Spring Boot JPA PostgreSQL Web App - Internal Authentication Error

  10. 10

    How to remove the extra space from right in a webview?

  11. 11

    java.lang.NullPointerException: Cannot read the array length because "<local3>" is null

  12. 12

    Jquery different data trapped from direct mousedown event and simulation via $(this).trigger('mousedown');

  13. 13

    flutter: dropdown item programmatically unselect problem

  14. 14

    How to use merge windows unallocated space into Ubuntu using GParted?

  15. 15

    Change dd-mm-yyyy date format of dataframe date column to yyyy-mm-dd

  16. 16

    Nuget add packages gives access denied errors

  17. 17

    Svchost high CPU from Microsoft.BingWeather app errors

  18. 18

    Can't pre-populate phone number and message body in SMS link on iPhones when SMS app is not running in the background

  19. 19

    12.04.3--- Dconf Editor won't show com>canonical>unity option

  20. 20

    Any way to remove trailing whitespace *FOR EDITED* lines in Eclipse [for Java]?

  21. 21

    maven-jaxb2-plugin cannot generate classes due to two declarations cause a collision in ObjectFactory class

HotTag

Archive