Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Proposing converted entries from Liste FR #1627

Open
3 tasks done
DandelionSprout opened this issue Feb 7, 2024 · 7 comments
Open
3 tasks done

Proposing converted entries from Liste FR #1627

DandelionSprout opened this issue Feb 7, 2024 · 7 comments
Labels
Feature Request New feature or request

Comments

@DandelionSprout
Copy link
Member

DandelionSprout commented Feb 7, 2024

Prerequisites

  • I checked the documentation and found no answer;
  • I checked to make sure that this issue has not already been filed;
  • This is not an ad/bug report.

Problem description

It has been established for some time that the 23 entries from https://raw.githubusercontent.com/AdguardTeam/AdguardFilters/master/FrenchFilter/sections/adservers.txt and https://raw.githubusercontent.com/AdguardTeam/AdguardFilters/master/FrenchFilter/sections/adservers_firstparty.txt is a tad little, even if the reasoning is decent enough.

Nevertheless, I gave it a try to see "Okay, how many entries from Liste FR would be mostly okay to propose adding to DNS Filter somehow?"

The process wasn't super-easy, and would be a nightmare to automate, but I landed on the 8,462 entries in the attachment below.

Proposed solution

I went through the entirety of https://filters.adtidy.org/extension/ublock/filters/16.txt, and narrowed down the entries until the remaining ones were generally those that would make sense in DNS filtering:

Liste.FR.AdGuard.DNS.Filter.testing.txt (I apparently didn't even need to compress the file this time around.)

Additional information

I can see that #970 discussed it to a basic extent, so I decided to play it really, really safe with the pasted file, to the point I even discarded $third-party entries; as well as almost all entries that ended with a period (.), and IP entries.

Liste FR conversions were one of the things that really made https://raw.githubusercontent.com/DandelionSprout/adfilt/master/AdGuard%20Home%20Compilation%20List/AdGuardHomeCompilationList.txt stand out from AdGuard DNS Filter, but as I gradually began losing energy to maintain the former, an inclusion of Liste FR of some sort in AdGuard DNS Filter would help me gradually narrow down the amount of entries and needed maintenance in my list, as I began conceding defeat to DNS Filter.

Nevertheless, my list still converts a few other lists that DNS Filter doesn't (Primarily EasyList Spanish, Liste AR, uBlock Filters, and Adblock Warning Removal List).

@DandelionSprout DandelionSprout added the Feature Request New feature or request label Feb 7, 2024
@Alex-302
Copy link
Member

Alex-302 commented Feb 9, 2024

The problem is that this filter includes rules that can break sites, incl. non-advertising.
90 rules are badfiltered.

@Alex-302
Copy link
Member

Alex-302 commented Feb 9, 2024

Also it seems 5700 domains in your list are dead:)
Liste.FR.AdGuard.DNS.Filter.testing-dead.txt

@DandelionSprout
Copy link
Member Author

Certainly explains a bit. 😅 It probably should've struck me to run PyFunceble on the results, but when more than half of them are dead, maybe someone should tell Liste FR to run PyFunceble on their list upstream first.

@DandelionSprout
Copy link
Member Author

Based on this tip, I created https://github.com/easylist/listefr/pull/177 over at his repo, and I presume I'm awaiting his decision on the PR before I'd attempt a new conversion of some sort.

@DandelionSprout
Copy link
Member Author

He apparently did not get the memo at https://github.com/easylist/listefr/pull/177. At all.

I'll see when, and if so how, I'll do a 2nd attempt at this issue report.

@DandelionSprout
Copy link
Member Author

To play it ultra-hyper-safe, by almost only including domains with the word ads in them, or which began with ad. At that point it's a matter of covering French users to a basic extent, and not to take some workloads off my shoulders.

The approximately 210 proposed entries:
||1-1ads.com^
||301ads.com^
||ad-3.me^
||ad-center.com^
||ad-lead.com^
||ad-miner.com^
||ad-sys.com^
||ad.ccmbg.com^
||ad.genybet.fr^
||ad.graciamediaweb.com^
||ad.groupon.fr^
||ad.jeune-independant.net^
||ad.mailo.com^
||ad.mediabong.com^
||ad.net-c.com^
||ad.oujdacity.net^
||ad.publicidees.com^
||ad.vacanceo.com^
||ad.zanox.com^
||ad380.com^
||ad6.fr^
||ada33bea5b.com^
||adaccess.fr^
||adback.co^
||adbison.com^
||adblock.vidomo.xyz^
||adbucks.com^
||adc-lc.eu^
||adcapt.com^
||adcloud.us^
||adconda.com^
||adconnect.fr^
||adcpm.com^
||adfever.com^
||adfornet.com^
||adgoal.net^
||adhispanic.com^
||adhoc1.net^
||adhoc2.net^
||adhslx.com^
||adincube.com^
||adinfo.support^
||adinlive.com^
||adintop.com^
||adlead.com^
||adleadevent.com^
||adleave.com^
||adlike.net^
||adlookr.com^
||adlure.net^
||adm-vids.com^
||admailtiser.com^
||admanmedia.fr^
||admark.fr^
||admarketplace.com^
||admathhd.com^
||admediaking.com^
||admetix.com^
||adminer.com^
||admireddepend.com^
||admiredfreakishgraveyard.com^
||admissionmining.com^
||admized.com^
||admtpmp123.com^
||admtpmp124.com^
||admuncher.com^
||adn-performance.com^
||adn.tukif.com^
||adnetpro.com^
||adnetwrk.com^
||adnotbad.com^
||adnplay.com^
||adnsolution.net^
||adnxtr.com^
||adoffers.network^
||adpile.net^
||adpixo.com^
||adpointbreakrtb.com^
||adpub.eu^
||ads-blue.com^
||ads-tracking.beop.io^
||ads-tracking.beopinion.com^
||ads-x.com^
||ads.ch^
||ads.vnhell.com^
||ads2rtb.com^
||adsadminister.com^
||adsb4track.com^
||adsbtrack.com^
||adscafe.net^
||adschemist.com^
||adsclick.com.br^
||adscoo.com^
||adsearch.pl^
||adserver.pm^
||adserveradulte.com^
||adservingsolutionsinc.com^
||adsgarden.com^
||adslead.com^
||adsmansion.com^
||adsmena.com^
||adsoid.com^
||adsplain.com^
||adsplex.com^
||adspot.ch^
||adsregieonline.com^
||adsrevenue.com^
||adsrvs.com^
||adstechnology.co^
||adsteroid.pro^
||adsterratools.com^
||adstract.com^
||adstronic.net^
||adstune.com^
||adsupply.dsp.wtf^
||adsupplyads.com^
||adsupplyads.net^
||adsurge.com^
||adsvidsdouble.com^
||adsvidss.com^
||adswinner.com^
||adsximg.com^
||adsxxxtraff.com^
||adtictac.com^
||adtracker2.com^
||adtrafic.com^
||adtrk20.com^
||adturtle.biz^
||adual.net^
||adunblock.com^
||advantagedoctrinepleased.com^
||adverline.com^
||adverteasy.fr^
||adverti.fr^
||advertine.com^
||advertising-support.com^
||advertsight.com^
||advertsponsor.com^
||advinapps.com^
||advrich.com^
||adwidecenter.com^
||adwise.bg^
||adxchanger.com^
||adxcore.com^
||adxfactory.com^
||adxprts.com^
||adyieldoptimizer.com^
||adyou.me^
||adzbux.com^
||adzbuzz.com^
||adzerg.com^
||adzmath.com^
||adzzone.com^
||arabyads.com^
||best-deals-products.com^
||bitadspool.com^
||cam4ads.com^
||clckads.com^
||clintads.com^
||copyop-ads.com^
||dialogads.com^
||digiads.tv^
||edgexads.com^
||effective-ads.com^
||eonads.com^
||ex-ads.com^
||explorads.com^
||fbofferads.com^
||gateads.co^
||heliumads.com^
||igadserver.net^
||iwadserver.com^
||juicyads.rocks^
||kadserver.com^
||kyoads.com^
||lemonads.com^
||madison-ads.net^
||mellowads.com^
||mhadst.com^
||mochiads.com^
||monarchads.com^
||mypushads.com^
||nativeads.rocks^
||offpageads.com^
||onhitads.net^
||oxiads.fr^
||peoplesearchads.com^
||placedesleads.com^
||polads.pro^
||reactads.com^
||redirect-ads.com^
||rlnads.net^
||sarmady-ads.com^
||sharemyads.com^
||smartxads.com^
||stickyads.tv^
||tamdamads.com^
||teads.de^
||teads.fr^
||teads.net^
||tradefxads.com^
||trads.io^
||unlockads.com^
||voltads.com^
||wads.ozap.com^
||wads.plurielles.fr^
||wbsadsdel.com^
||wbsadsdel2.com^
||y-ads.net^
||zxcvads.com^

@Alex-302
Copy link
Member

Alex-302 commented Mar 19, 2024

Dead:

Details
! ||ada33bea5b.com^
! ||adaccess.fr^
! ||adback.co^
! ||adconda.com^
! ||adhispanic.com^
! ||admetix.com^
! ||adoffers.network^
! ||adpile.net^
! ||ads2rtb.com^
! ||adstechnology.co^
! ||adsvidsdouble.com^
! ||adtrk20.com^
! ||adual.net^
! ||adyou.me^
! ||bitadspool.com^
! ||clintads.com^
! ||igadserver.net^
! ||madison-ads.net^
! ||mypushads.com^
! ||offpageads.com^
! ||teads.fr^
! ||tradefxads.com^
! ||y-ads.net^
! ||1-1ads.com^

The rest - checked few random domains - they are not used (adsplex.com), not respond or owned probably by spammers (like admtpmp123.com, admtpmp124.com)

Details
||301ads.com^
||ad-3.me^
||ad-center.com^
||ad-lead.com^
||ad-miner.com^
||ad-sys.com^
||ad.ccmbg.com^
||ad.genybet.fr^
||ad.graciamediaweb.com^
||ad.groupon.fr^
||ad.jeune-independant.net^
||ad.mailo.com^
||ad.mediabong.com^
||ad.net-c.com^
||ad.oujdacity.net^
||ad.publicidees.com^
||ad.vacanceo.com^
||ad.zanox.com^
||ad380.com^
||ad6.fr^
||adbison.com^
||adblock.vidomo.xyz^
||adbucks.com^
||adc-lc.eu^
||adcapt.com^
||adcloud.us^
||adconnect.fr^
||adcpm.com^
||adfever.com^
||adfornet.com^
||adgoal.net^
||adhoc1.net^
||adhoc2.net^
||adhslx.com^
||adincube.com^
||adinfo.support^
||adinlive.com^
||adintop.com^
||adlead.com^
||adleadevent.com^
||adleave.com^
||adlike.net^
||adlookr.com^
||adlure.net^
||adm-vids.com^
||admailtiser.com^
||admanmedia.fr^
||admark.fr^
||admarketplace.com^
||admathhd.com^
||admediaking.com^
||adminer.com^
||admireddepend.com^
||admiredfreakishgraveyard.com^
||admissionmining.com^
||admized.com^
||admtpmp123.com^
||admtpmp124.com^
||admuncher.com^
||adn-performance.com^
||adn.tukif.com^
||adnetpro.com^
||adnetwrk.com^
||adnotbad.com^
||adnplay.com^
||adnsolution.net^
||adnxtr.com^
||adpixo.com^
||adpointbreakrtb.com^
||adpub.eu^
||ads-blue.com^
||ads-tracking.beop.io^
||ads-tracking.beopinion.com^
||ads-x.com^
||ads.ch^
||ads.vnhell.com^
||adsadminister.com^
||adsb4track.com^
||adsbtrack.com^
||adscafe.net^
||adschemist.com^
||adsclick.com.br^
||adscoo.com^
||adsearch.pl^
||adserver.pm^
||adserveradulte.com^
||adservingsolutionsinc.com^
||adsgarden.com^
||adslead.com^
||adsmansion.com^
||adsmena.com^
||adsoid.com^
||adsplain.com^
||adsplex.com^
||adspot.ch^
||adsregieonline.com^
||adsrevenue.com^
||adsrvs.com^
||adsteroid.pro^
||adsterratools.com^
||adstract.com^
||adstronic.net^
||adstune.com^
||adsupply.dsp.wtf^
||adsupplyads.com^
||adsupplyads.net^
||adsurge.com^
||adsvidss.com^
||adswinner.com^
||adsximg.com^
||adsxxxtraff.com^
||adtictac.com^
||adtracker2.com^
||adtrafic.com^
||adturtle.biz^
||adunblock.com^
||advantagedoctrinepleased.com^
||adverline.com^
||adverteasy.fr^
||adverti.fr^
||advertine.com^
||advertising-support.com^
||advertsight.com^
||advertsponsor.com^
||advinapps.com^
||advrich.com^
||adwidecenter.com^
||adwise.bg^
||adxchanger.com^
||adxcore.com^
||adxfactory.com^
||adxprts.com^
||adyieldoptimizer.com^
||adzbux.com^
||adzbuzz.com^
||adzerg.com^
||adzmath.com^
||adzzone.com^
||arabyads.com^
||best-deals-products.com^
||cam4ads.com^
||clckads.com^
||copyop-ads.com^
||dialogads.com^
||digiads.tv^
||edgexads.com^
||effective-ads.com^
||eonads.com^
||ex-ads.com^
||explorads.com^
||fbofferads.com^
||gateads.co^
||heliumads.com^
||iwadserver.com^
||juicyads.rocks^
||kadserver.com^
||kyoads.com^
||lemonads.com^
||mellowads.com^
||mhadst.com^
||mochiads.com^
||monarchads.com^
||nativeads.rocks^
||onhitads.net^
||oxiads.fr^
||peoplesearchads.com^
||placedesleads.com^
||polads.pro^
||reactads.com^
||redirect-ads.com^
||rlnads.net^
||sarmady-ads.com^
||sharemyads.com^
||smartxads.com^
||stickyads.tv^
||tamdamads.com^
||teads.de^
||teads.net^
||trads.io^
||unlockads.com^
||voltads.com^
||wads.ozap.com^
||wads.plurielles.fr^
||wbsadsdel.com^
||wbsadsdel2.com^
||zxcvads.com^

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Feature Request New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants