2021.08

Update from August crawl

2021.07

Update from July crawl

2021.06

Update from June crawl

2021.05

• Update from May crawl

2021.04

• 📨 Update from April crawl
• 🐦 Dataset now contains data about calls to document.interestCohort and takes it into account in api_fingerprinting_weights.json

2021.03

• 📨 Update from March crawl

Note: Do not use entity prevalence numbers from this release. We discovered an error in the prevalence calculations, limited to this release only.

2021.02

• 📨 Update from February crawl
• ‼️Tacker Radar doubled in size - we now have over 23k domains (up from 11.8k) because we stopped filtering out domains that don't set cookies or call JS APIs (PR).
• 🍪 We are now including information about first party cookies being set by 3rd party scripts (PR):

"resources": [
    {
      "rule": "google-analytics\\.com\\/analytics\\.js",
      "firstPartyCookies": {
        "_ga": {
          "ttl": 63072001, // median expiry of this cookie, in seconds from set time.
          "length": 26, // mean string length of the cookie value
          "prevalence": 0.23242023108118448, // proportion of sites in the crawl where this cookie was set by this script
          "uniqueness": 1 // number of distinct values seen divided by times set (0 = we have only seen one value, 1 = unique value on very load)
        },
    ...

• 🍪 AND information about first party cookie values being sent in another 3rd party request (PR):

"resources": [
...
   {
      "firstPartyCookiesSent": {
        "_ga": 0.03884765475552835, // proportion of sites in the crawl where the value of this 1st party cookie was sent to this endpoint
        "G_ENABLED_IDPS": 0.0005126635549774275
      },

• 🔧 We have fixed last few places where we were not using private entries for calculating eTLD+1 (PR).

2021.01

• Update entities and domains from January crawl
• Add domain name servers

2020.12

Updated domains and entities from December crawl.

2020.11

November crawler data

• adds exampleSites for each resource
• adds automatically calculated fingerprint API weights. The old static file build-data/static/api_fingerprint_weights.json is replaced by build-data/generated/api_fingerprint_weights.json https://github.com/duckduckgo/tracker-radar/blob/main/build-data/generated/api_fingerprint_weights.json