Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add "Orion and Ad-blocking Tests" documentation page #659

Open
wants to merge 4 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions docs/.vitepress/config.ts
Original file line number Diff line number Diff line change
Expand Up @@ -442,6 +442,7 @@ function sidebarOrion() {
link: '/orion/privacy-and-security/ad-tracking-blocking',
items: [
{ text: 'Configure Ad & Tracking Blocking', link: '/orion/privacy-and-security/ad-tracking-blocking' },
{ text: 'Orion and Ad-blocking Tests', link: '/orion/privacy-and-security/adblock-tests' },
{ text: 'Respecting Privacy', link: '/orion/privacy-and-security/respecting-privacy' },
{ text: 'Protecting Privacy', link: '/orion/privacy-and-security/protecting-privacy' },
{ text: 'Preventing Fingerprinting', link: '/orion/privacy-and-security/preventing-fingerprinting' },
Expand Down
9 changes: 4 additions & 5 deletions docs/orion/features/custom-blocklists.md
Original file line number Diff line number Diff line change
Expand Up @@ -18,13 +18,12 @@

Orion includes the following blocklists by default.
The blocklists in **bold** are enabled by default and provide sufficient protection against most ads and trackers.
- **EasyList**
- **EasyPrivacy**
- **d3Host List by d3ward**
- **AdGuard Base filter (Optimized)**
- **AdGuard Tracking Protection filter (Optimized)**
- AdGuard Annoyances Filter (Optimized)
- AdGuard Social Media filter (Optimized)
- Hagezi Light DNS Blocklist
- Fanboy's Annoyance
- Hagezi Pro Plus Mini
- Privacy Essentials
- Block third-party fonts

On macOS, you can enable or disable these blocklists in **Orion** > **Settings** > **Privacy**, then click the **Manage Filter Lists...** button.
Expand Down
60 changes: 60 additions & 0 deletions docs/orion/privacy-and-security/adblock-tests.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,60 @@
# Orion and Ad-blocking Tests


## Table of Contents

- [Overview](#overview)
- [The Problems with Ad-blocking Tests](#problems)
- [Orion's Stance](#orions_stance)
- [Further Reading](#further_reading)

<a name="overview"></a>
## Overview {#overview}

This documentation page is intended to answer questions users might have about the scores Orion receives on various ad-blocking test sites.
In short, the tests are flawed and do not reflect real-world usage in any meaningful way, and there is no reason to be concerned about the test results.
This is explained in greater detail below, with links to further reading.

<a name="problems"></a>
## The problems with ad-blocking tests {#test_problems}

The demand for privacy and security is greater than ever before.
This trend is particularly relevant when it comes to web browsers.
Consequently, it is common for users to test the ad-blocking features of their browsers and extensions by running various content-blocking tests found online.
These tests generally report the percentage of ads and trackers that the user's browser configuration was able to block:
<img src="./media/d3ward.png" width="500" alt="An example score on https://d3ward.github.io/toolz/adblock"><br/>
<img src="./media/superadblocktest.png" width="500" alt="An example score on https://superadblocktest.com/"><br/>

Unfortunately, these tests do not reflect the real-world content-blocking capabilities of any browser or extension, often resulting in concerned reports about the privacy or security features of said browser or extension.
For example, based on the example results above, a user might think that 26% or 35% of the undesired content online, respectively, is making its way through the content blocker, exposing the user to great dangers and indicating that their configuration is inadequate for safe browsing.

Fortunately, the above example is not true.
Instead, the tests that claim to accurately measure ad-blocking capabilities mislead their users either into a false sense of security or into mistakenly thinking that there is something wrong with their setup, even if they are not encountering any issues on the web pages they visit daily.
<a name="orions_stance"></a>
## Orion's stance{#stance}
As can be seen from the above, users should not expect their browsers to ace any content-blocking test; instead, they should focus on real-world usage.
Orion strives to provide a thorough yet sleek approach to ad blocking out of the box.
This is achieved by having sensible default filter lists in the content blocker.
The default configuration is designed to be more than adequate for the vast majority of users while also minimizing website breakage and any performance hits.
If you encounter sites where that is not the case, please [report the issue](../support-and-community/roadmap-feedback-forum.md).
Advanced users can configure their content blockers to fit their needs.
Please see the [custom blocklists](../features/custom-blocklists.md) documentation page for further information.

Previously, Orion shipped with lists that, in addition to the above, also included rules to score well on the aforementioned test as this reduced the number of reports created about these tests.
As the Orion team continues to improve the built-in content blocker, it was decided that the test should no longer receive any attention, and the unnecessary rules were removed from the default content blocker configuration, as they did not improve the privacy of the users or the performance of the browser.

We believe this is the correct way forward, and we invite our users to focus on real-world content blocking rather than flawed tests.

<a name="further_reading"></a>
## Further reading{#further_reading}

- [How “test your adblocker” websites can harm users and the adblocker ecosystem](https://brave.com/blog/adblocker-testing-websites-harm-users/) ([Archived](https://web.archive.org/web/20250110081559/https://brave.com/blog/adblocker-testing-websites-harm-users/))

A more technical and detailed post written by the Lead for Privacy Engineering of Brave.

- [uBlock Origin creator Raymond Hill (gorhill) on X](https://x.com/gorhill/status/1583581072197312512)

The post is a couple of years old at this point but the misinterpretation of ad-blocker test results continues.

- [The workarounds added to uBlock Origin due to flawed tests](https://github.com/uBlockOrigin/uAssets/blob/4a654ecf710749e39c50baa86e86e26681ea3aca/filters/filters.txt#L13688-L13692)
- [The workarounds added to AdGuard lists due to flawed tests](https://github.com/AdguardTeam/AdguardFilters/blob/daba77058c72b983f2a46b97dca5b669710a7414/SpywareFilter/sections/specific.txt#L4491-L4521)
Binary file added docs/orion/privacy-and-security/media/d3ward.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
6 changes: 3 additions & 3 deletions docs/orion/privacy-and-security/respecting-privacy.md
Original file line number Diff line number Diff line change
@@ -1,9 +1,9 @@
# Respecting Privacy

Orion has no built-in telemetry, so it can never "phone home" and risk exposing your data. Orion is truly and verifiably a privacy-respecting browser, unlike those that offer only an illusion of privacy.
Orion has no built-in telemetry, so it can never "phone home" and risk exposing your data. Orion is truly and verifiably a privacy-respecting browser, unlike those that offer only an illusion of privacy.

Most browsers regularly "phone home" dozens or even [hundreds](https://brave.com/popular-browsers-first-run/) times. Each request poses a security risk, no matter what information it sends, by potentially exposing your IP address and your browser fingerprint. Telemetry can also inadvertently leak personally identifiable information or corporate intelligence.
Most browsers regularly "phone home" dozens or even [hundreds](https://brave.com/popular-browsers-first-run/) of times. Each request poses a security risk, no matter what information it sends, by potentially exposing your IP address and your browser fingerprint. Telemetry can also inadvertently leak personally identifiable information or corporate intelligence.

<img src="./media/orion_start.jpg" width="500" alt="Telemetry of Browsers on Startup"><br />

The safest way to secure your private data is for your browser to be zero telemetry out of the box. Want to keep your information safe and private? Orion makes it possible!
The safest way to secure your private data is for your browser to be zero telemetry out of the box. Want to keep your information safe and private? Orion makes it possible!