Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

USOM - Top misleading site block list #386

Closed
3 tasks done
Soickan opened this issue Oct 24, 2023 · 11 comments
Closed
3 tasks done

USOM - Top misleading site block list #386

Soickan opened this issue Oct 24, 2023 · 11 comments
Labels
blocklist Blocklist inclusion request

Comments

@Soickan
Copy link

Soickan commented Oct 24, 2023

Prerequisites

  • I checked the documentation and found no answer;
  • I checked to make sure that this issue has not already been filed;
  • This is not an ad/bug report.

Problem description

Add list: USOM - Official Turk Cyber Block Center (www.usom.gov.tr)

Proposed solution

Hi,

Add please USOM - Official Turk Cyber Block Center (http://www.usom.gov.tr) block list. There is no ad blocking in the list. The list includes a list of fake and misleading sites. It is mostly updated hourly.

You can learn the details of blocked sites at https://www.usom.gov.tr/adres

This list address: https://www.usom.gov.tr/url-list.txt

Thanks

Additional information

No response

@Alex-302 Alex-302 transferred this issue from AdguardTeam/AdGuardSDNSFilter Oct 25, 2023
@Alex-302
Copy link
Member

@Soickan Moved to the correct repository.

@Sergey-Lyapin Sergey-Lyapin added blocklist Blocklist inclusion request in progress The request is accepted, but it requires some additional work on our side labels Dec 22, 2023
@Sergey-Lyapin
Copy link
Contributor

Hello @Soickan, thank you for suggestion.
Here is blocklist requirements

How can I check this list against these criteria?

The blocklist should have a place for receiving user complaints and holding discussions, such as a repository on github.com, or a public website/forum.

The blocklist should be relatively popular, meaning:
- if there is a repository on GitHub, the number of stars should be at least 50.
- if there is no repository on GitHub, the number of reported issues and discussions should be at least 10 per month.
- the blocklist should be actively supported for at least 6 months.

The blocklist should be regularly updated with at least 10 updates per month.

@Alex-302
Copy link
Member

Hm. I don't see working domains below 20k line. The most domains are blocked/dead.

@Soickan
Copy link
Author

Soickan commented Dec 26, 2023

Since they are mostly misleading (phishing) sites, when they are detected, the site owners close the site. Therefore, there will be old sites that do not work. This is, in a way, proof that the detection of sites is quick.

@Alex-302
Copy link
Member

Alex-302 commented Jan 3, 2024

It has more than 250k domains, and the most of that domains are dead/unregistered.
Why don't they remove or move to another file domains, that are dead?

@Soickan
Copy link
Author

Soickan commented Jan 4, 2024

It has more than 250k domains, and the most of that domains are dead/unregistered. Why don't they remove or move to another file domains, that are dead?

First of all, although it is officially detected and blocked, it continues to prevent phishing by remaining on the list.

Other ad blocking filters do not guarantee a 100% active domain. I see that retroactive cleaning is not done much in these filters.

@hagezi
Copy link
Contributor

hagezi commented Jan 4, 2024

The active domains are included in my Threat Intelligence Feed list. The USOM also has a few false positive domains from time to time, these are also filtered out.

The TIF is available in AdGuard DNS.

@hagezi
Copy link
Contributor

hagezi commented Jan 4, 2024

Stats from the last TIF build:

 Nr | Included | Dead | Removed |   Count | URL/File
136 |      25% |  75% |      0% |  250898 | https://www.usom.gov.tr/url-list.txt

75% dead domains, <1% false positives,

@Alex-302
Copy link
Member

Alex-302 commented Jan 4, 2024

@hagezi Which tool do you use to check dead domains? 3p or your own?

@hagezi
Copy link
Contributor

hagezi commented Jan 4, 2024

@Alex-302 I check this myself with my own script against the Google DNS. My lists are checked once a month. I also check the deadlist once a month to see if dead domains are active again. I can make the list of dead domains available if required.

@Sergey-Lyapin
Copy link
Contributor

The active domains on this list are included in Hagezi's Threat Intelligence Feed list, so we won't add this list separately.

@Sergey-Lyapin Sergey-Lyapin removed the in progress The request is accepted, but it requires some additional work on our side label May 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
blocklist Blocklist inclusion request
Projects
None yet
Development

No branches or pull requests

4 participants