Vetted blocklists thread

[ameshkov]

AdGuard Home lets the user choose from a list of vetted blocklists.

If you have in mind any lists that can be added there, please leave a comment in this thread, we'll consider it.

Previous task with a relevant comments thread: #1325

Requirements

• Maintained
• Clear purpose
• We prefer (mostly) original lists to compilations (like Energized or oisd.nl). Maybe we should add a special section for compilations (?)

[nezorflame]

StevenBlack's one would be nice to have, along with the Energized lists.

[ameshkov]

As I recall, there were some people against Energized: #1325 (comment)

@DandelionSprout
Since the Energized lists are compiled almost entirely from other lists (except for ~20,000 of the entries that come from Energized Core), I personally would have chose to prioritise adding the best ones among the source lists instead.

Can we just include the Energized Core?

[DandelionSprout]

Sadly not, because of AdroitAdorKhan/EnergizedProtection#60.

[ameshkov]

Weird stuff, so adding Energized means that the whitelist should be added as well

[ameshkov]

We should consider adding Luminati and Avast to the list of "Services", see the lists here: https://github.com/durablenapkin/block

[ameshkov]

Hungarian list: https://github.com/hufilter/hufilter/blob/master/hufilter-dns.txt

[YBS-PC]

it will be good if you replace Spam404 link
from https://raw.githubusercontent.com/Spam404/lists/master/main-blacklist.txt
to https://raw.githubusercontent.com/Spam404/lists/master/adblock-list.txt

[ameshkov]

@YBS-PC the "adblock-list" is supposed to be used by traditional adblockers and not in host-level blockers and there's a risk that at some point there will be added some unsupported modifiers like $third-party or $document. That's why I'd better keep simple hosts list for now.

[emlimap]

URLhaus Malicious URL Blocklist - https://gitlab.com/curben/urlhaus-filter#urlhaus-malicious-url-blocklist

This list is being used by ublock origin to replace Malware domains list. The author also has an AGH specific list https://gitlab.com/curben/urlhaus-filter#domain-based-adguard-home

[DandelionSprout]

It is now pretty safe to assume that anything Energized-related is ruled out entirely, since the lead dev is too often absent that the possibility of creating a Core + Whitelist combo for AGH probably wouldn't be worth the effort to suggest and hope for.

On the other hand, I'm currently testing out Block List Project: Ads, with good results so far.

[josephbu]

This list is being used by ublock origin to replace Malware domains list. The author also has an AGH specific list https://gitlab.com/curben/urlhaus-filter#domain-based-adguard-home

Based on my experience I would suggest using the "Lite version" of the URLhaus list, that version contains the current online domains/IPs only.

The full list results in false positives as it contains entries that once contained malware but may have been fixed 6 months or a year ago, but are still included in the list as historic.

[ameshkov]

One more interesting list - WindowsSpyBlocker - Hosts spy rules by @crazy-max
https://raw.githubusercontent.com/crazy-max/WindowsSpyBlocker/master/data/hosts/spy.txt

[DandelionSprout]

It is now reasonably safe to assume that no projects or lists made by Energized Protection should ever be included in AdGuard Home or any other AdGuard project, due to long-term negligence of reported problems by its one actual maintainer: https://github.com/EnergizedProtection/block/issues/562

Edit: Okay, so in my eagerness to point this out, I forgot I had essentially pointed out the same thing near-verbatim a month ago, although without a proper conclusive source at the time. My fault. 😅

[crazy-max]

@ameshkov

One more interesting list - WindowsSpyBlocker - Hosts spy rules by @crazy-max
https://raw.githubusercontent.com/crazy-max/WindowsSpyBlocker/master/data/hosts/spy.txt

Feel free to get back to me if you use this list.

[lordraiden]

These are a must have
https://abp.oisd.nl/
https://phishing.army/download/phishing_army_blocklist_extended.txt
https://gitlab.com/curben/urlhaus-filter/raw/master/urlhaus-filter-domains.txt

To block DoH
https://raw.githubusercontent.com/thiagocrepaldi/doh_servers/master/dohservers.txt
https://raw.githubusercontent.com/thiagocrepaldi/doh_servers/master/dohservers2.txt
https://heuristicsecurity.com/dohservers.txt (it doesn't work now)

[ameshkov]

One more interesting list:
https://github.com/jerryn70/GoodbyeAds

[uservictor]

This list is nice for blocking trackers.
https://gitlab.com/quidsup/notrack-blocklists/raw/master/notrack-blocklist.txt

Have a nice day

[ghost]

Developer Dan's Ads & Tracking

A programmatically expanded list of hosts used for advertisements and tracking. This is my primary list and I recommend using it. This list was last updated on December 18, 2020.

Website: https://www.github.developerdan.com/hosts/
List: https://www.github.developerdan.com/hosts/lists/ads-and-tracking-extended.txt

[ZeroClover]

The Malware Domain List vetted by AGH no longer appears to be valid.

https://www.malwaredomainlist.com/hostslist/hosts.txt

[ameshkov]

@DandelionSprout it resulted, we just create additional issues for actually adding or updating lists. This one is purely for discussion and suggestions.

[gyCfjSnO]

Problem Description

Have to manually find more lists, defaults aren't enough

Proposed Solution

Add lists that are green & bulleted with a tick from Firebog.net to the default "Choose from the list" option

https://v.firebog.net/hosts/lists.php?type=tick

[timkgh]

Could this data be incorporated into the default AG list or into a separate list?
EFF's Privacy Badger
https://github.com/EFForg/badger-sett
https://raw.githubusercontent.com/EFForg/badger-sett/master/results.json

[DandelionSprout]

After doing some RegEx conversion testing of Privacy Badger's list, there are some problems with it, and the problems are pretty big at that, sadly.

They've set the list to block spotify.com and yahoo.com, while they've set it to allow adnuntius.com, in-appadvertising.com and exoticads.com. It also has the peculiar distinction of having more allowed domains than it has blocked domains.

[timkgh]

An allow list for affiliate links would be useful too, but we'd need a version of this that applies to subdomains too.
https://raw.githubusercontent.com/nextdns/metadata/master/privacy/affiliate-tracking-domains

[ghost]

@timkgh, I have converted the A&T links list to AdGuard format, extended it with my own domains and use it in AdGuard Home: https://raw.githubusercontent.com/Zelo72/adguard/main/whitelist.referral.adguard

Feel free to use it, it will be updated regularly.

[timkgh]

@timkgh, I have converted the A&T links list to AdGuard format, extended it with my own domains and use it in AdGuard Home: https://raw.githubusercontent.com/Zelo72/adguard/main/whitelist.referral.adguard

Feel free to use it, it will be updated regularly.

@Zelo72 the converted list does not seem to allow subdomains, using the NextDNS list directly has the same problem. I think the converted version needs to use the @@||...^ syntax instead.
Update: Fixed. Thank you @Zelo72

[DandelionSprout]

Apparently xorcan's Turkish list is gone. An apparent successor has been created: https://raw.githubusercontent.com/HuzunluArtemis/TurkishAdblockList/main/src/HostsList.txt

[gyCfjSnO]

Can we please have the ticked firebog lists added/vetted?

https://v.firebog.net/hosts/lists.php?type=tick

[Potterli20]

International/China accelerated ad filtering rules subscription.
国际/中国加速广告过滤规则订阅
Trli rules is the only global library that provides a complete set of rules, and the rules are updated 24 hours a day, probably starting at 0:00 US time.
冷莫(trli)的规则唯一一个提供全球比较全的库，规则是24小时更新，大概是第二天的从美国时间0点开始。

文件库:trli.coding.net/public
说明库:github.com/Potterli20/hosts
Library: trli.coding.net/public
That library: github.com/Potterli20/hosts

adguardhome:https://trli.coding.net/p/file/d/ad-hosts/git/lfs/master/ad-adguardhome.txt

allow:https://trli.coding.net/p/file/d/allow/git/lfs/master/allow.txt

The project is available globally and has been made out of a black and white list of global examples.
Of course, the blacklist has mistakenly killed the domain name processing.

[DandelionSprout]

My current understanding is that when it comes to lists that should be natively included in AGH as opt-ins, such requests are now supposed to be submitted to https://github.com/AdguardTeam/HostlistsRegistry, although it doesn't seem to me that that repository have taken effect in stable AdGuard versions yet.

For general simple suggestions, however, I can only presume that this thread is still the intended place.

[gyCfjSnO]

Can we look at adding some of the lists from Zelo72 https://github.com/Zelo72/adguard

[timkgh]

Can we look at adding some of the lists from Zelo72 https://github.com/Zelo72/adguard

Zelo72 seems to be gone, does anyone know what happened to him and whether there are replacements for this list? #1913 (comment)

[gyCfjSnO]

Can we look at adding some of the lists from Zelo72 https://github.com/Zelo72/adguard

Zelo72 seems to be gone, does anyone know what happened to him and whether there are replacements for this list? #1913 (comment)

Oh no! I really enjoyed using Zelo72's lists 🥲 I hope it's temporary.

[timkgh]

Can we look at adding some of the lists from Zelo72 https://github.com/Zelo72/adguard

Zelo72 seems to be gone, does anyone know what happened to him and whether there are replacements for this list? #1913 (comment)

Oh no! I really enjoyed using Zelo72's lists 🥲 I hope it's temporary.

The list is now https://raw.githubusercontent.com/hagezi/dns-blocklists/main/adblock/whitelist-referral.txt

[ainar-g]

Starting with AdGuard Home 0.107.17, AdGuard Home will use the Hostlists Registry as the source of its filtering rule lists. Please send your suggestions to that repo. See #3972. Thanks!