Works on...

[007revad]

Please comment if this worked for you, or didn't work for you, with the following information:

• Working: yes/no
• NAS model:
• DSM version:
• SSD brand and model:

[AdrianDForsyth]

Working: no
NAS model: RS1219+
DSM version: 7.2.1-69057-3
SSD brand and model: Mostly Ironwolfs (HDD)

Cannot pass go, model or DSM version not supported

[007revad]

Unfortunately models with Avoton CPUs don't have the required files in DSM.

[TheJACKedViking]

Working: no
NAS model: DS2422+
DSM version: 7.2.1 Update 4
SSD brand and model: WD Red Pros ( HDD )

Script says its enabled. Data De-duplication time scheduling shows up fine. Option to configure specific volumes does not appear. DSM restart and clearing browser cache did not resolve. All volumes have Analytics enabled.

[007revad]

It looks like maybe something has changed in DSM 7.2.1 Update 4

My DS1821+ that had deduplication enabled before updating to DSM 7.2.1 Update 4 still shows the configure data deduplication option for all volumes.

But my DS720+ did not have deduplication enabled before updating to DSM 7.2.1 Update 4 and it's not showing the configure data deduplication option for any volumes.

So at least it's not just you and I can reproduce the issue... and hopefully fix it.

[007revad]

I can't see anything different in DSM 7.2.1 Update 4.

Can you tell me what these commands return:

grep -c 'SYNO.SDS.StorageUtils.supportBtrfsDedupe&&e.dedup_info.show_config_btn' /var/packages/StorageManager/target/ui/storage_panel.js

grep -c 'SYNO.SDS.StorageUtils.supportBtrfsDedupe,' /var/packages/StorageManager/target/ui/storage_panel.js

synogetkeyvalue /etc.defaults/synoinfo.conf support_btrfs_dedupe

synogetkeyvalue /etc/synoinfo.conf support_btrfs_dedupe

synogetkeyvalue /etc.defaults/synoinfo.conf support_tiny_btrfs_dedupe

synogetkeyvalue /etc/synoinfo.conf support_tiny_btrfs_dedupe

[3QInc]

xyz@abc:/$ grep -c 'SYNO.SDS.StorageUtils.supportBtrfsDedupe&&e.dedup_info.show_config_btn' /var/packages/StorageManager/target/ui/storage_panel.js
1
xyz@abc:/$ grep -c 'SYNO.SDS.StorageUtils.supportBtrfsDedupe,' /var/packages/StorageManager/target/ui/storage_panel.js
1
xyz@abc:/$ synogetkeyvalue /etc.defaults/synoinfo.conf support_btrfs_dedupeno
xyz@abc:/$ synogetkeyvalue /etc/synoinfo.conf support_btrfs_dedupe
no
xyz@abc:/$ synogetkeyvalue /etc.defaults/synoinfo.conf support_tiny_btrfs_dedupe
yes
xyz@abc:/$ synogetkeyvalue /etc/synoinfo.conf support_tiny_btrfs_dedupe
yes
xyz@abc:/$

[3QInc]

Thanks for your work and innovation on this. I'm using this on a 923+ with 8GB ram and update 4 of the DSM.

[007revad]

I was reminded the other day that after running the script it can take up to 20 minutes for the Depuplication menu to become available.

[Vuego99]

Working: yes
NAS model: 3622xs+
DSM version: DSM 7.2.1-69057-4
SSD brand and model: Kingston 600M, Hdd synology

Thank you for working on the script

[t0mm1e]

Working: yes
NAS model: DS1823xs+, 64 GB mem
DSM version: DSM 7.2.1-69057 Update 4
SSD brand and model: WD201KFGX-68BKJN (WD Red Pro)

It worked before, but I did a full reinstall today, and now I can't get it to work. The scripts says it installs fine, but the menu options to deduplicate does not appear. It might be update 4.
Running the checks mentioned above, this is the result:

grep -c 'SYNO.SDS.StorageUtils.supportBtrfsDedupe&&e.dedup_info.show_config_btn' /var/packages/StorageManager/target/ui/storage_panel.js
0
grep -c 'SYNO.SDS.StorageUtils.supportBtrfsDedupe,' /var/packages/StorageManager/target/ui/storage_panel.js
1
synogetkeyvalue /etc.defaults/synoinfo.conf support_btrfs_dedupe
yes
synogetkeyvalue /etc/synoinfo.conf support_btrfs_dedupe
yes
synogetkeyvalue /etc.defaults/synoinfo.conf support_tiny_btrfs_dedupe
no
synogetkeyvalue /etc/synoinfo.conf support_tiny_btrfs_dedupe
no

[t0mm1e]

Woah, the menu option just appeared!

Took a while, but it works now 😉

[007revad]

I've noticed it can take up to 20 minutes before the menu appears.

[cuter-doc0]

Working: no
NAS model: DS1621+
DSM version: DSM 7.2.1-69057 Update 3
SSD brand and model: TEAM TM8FP6512G
Setup: 6x HDD SHR with 2x nvme SSD cache Btrfs volume

[cuter-doc0]

reading the replies here I might just need to wait - will check back in a bit and report on the result :)

[007revad]

DSM does not allow deduplication of SSD caches. Deduplication is only available for Btrfs volumes.

If volume 1 is using btrfs, and has usage detail analysis enabled, check if the deduplication option is available for volume 1.

[cuter-doc0]

oh, I see. I really do like ssd cache - makes my synology near silent in daily operations. I'll keep that in mind though when storage space becomes a constraint and a heavier priority than head-seeking noises.

[lastangel32]

Hi, but work on Apollolake cpu with 7.2.1 or letter?? Or only from 7.0.1 to 7.2?

I read this “works in DSM 7.0.1 to 7.2 on models with one of following [CPU architectures]…, Apollolake…”

[007revad]

Actually, I don't think it works at all for Apollolake. Let me check.

[007revad]

DSM for models with an Apollolake CPU is missing 26 deduplication related files.

I've updated the readme.

[lastangel32]

DSM for models with an Apollolake CPU is missing 26 deduplication related files.

I've updated the readme.

Perfect

anyway, thanks for the work you do

[rbosch1887]

Working: no YES (need to run "syno_enable_dedupe.sh --hdd" and "synology_hdd_db -n") as discussed below
NAS model: DS423+
DSM version: DSM 7.2.1-69057 Update 5
RAM: 18GB
SSD brand and model: Samsung SSD 980 1TB as Volume 2 JBOD with your Synology_M2_volume script
HDD: 4x HDD Seagate Ironwolf 4TB as Volume 1 SHR

grep -c 'SYNO.SDS.StorageUtils.supportBtrfsDedupe&&e.dedup_info.show_config_btn' /var/packages/StorageManager/target/ui/storage_panel.js
1
grep -c 'SYNO.SDS.StorageUtils.supportBtrfsDedupe,' /var/packages/StorageManager/target/ui/storage_panel.js
1
synogetkeyvalue /etc.defaults/synoinfo.conf support_btrfs_dedupe
yes
synogetkeyvalue /etc/synoinfo.conf support_btrfs_dedupe
yes
synogetkeyvalue /etc.defaults/synoinfo.conf support_tiny_btrfs_dedupe
no
synogetkeyvalue /etc/synoinfo.conf support_tiny_btrfs_dedupe
no

[007revad]

Have you run https://github.com/007revad/Synology_HDD_db to add your drives to DSM's supported drive database? Run it with the -n option to prevent DSM updating the supported drive database.

Have you rebooted since running syno_enable_dedupe.sh ?

You could try running the script with the --hdd option

syno_enable_dedupe.sh --hdd

[rbosch1887]

yes, but without the -n option. some months ago as i run the m2 volume script. an the scripts is scheduled at every shutdown.
but will try running with the -n

yes rebooted twice after hour (waited the 20 minutes as stated somewhere up)

will try to run it with the --hdd option.

will let you know

[rbosch1887]

Have you run https://github.com/007revad/Synology_HDD_db to add your drives to DSM's supported drive database? Run it with the -n option to prevent DSM updating the supported drive database.

Have you rebooted since running syno_enable_dedupe.sh ?

You could try running the script with the --hdd option

syno_enable_dedupe.sh --hdd

it worked! right after reboot there is the deduplication menu item.
Thank you!

[StusBrainDump]

Hi, I see this is listed as working on 720+ 420+ 220+ but there is no mention of 920+ ? Anyone say it works?

[007revad]

I'm not sure how I neglected to include the DS920+.

The script works on any model with a Geminilake CPU. I've added DS920+ to the "working list" now.

[lastangel32]

HI

Working: yes (no Automatic?)
NAS model: DS923+
DSM version: DSM 7.2.2-72806
SSD brand and model: Active on HDD driver (no ssd)

start manual deduplication fork fine but when enable "Automatic Decuplication" but it doesn't do anything (enable schedule data for all time of day)

[t0mm1e]

How do you know it isn't working?

[lastangel32]

Hi,
the script work perfect, thanks
eh...godd question...how i can find last deduplication state run?

i had tried

~$ sudo btrfs version
btrfs-progs v4.0

~$ sudo btrfs dedupe status /volume3
btrfs: unknown token 'dedupe'

[t0mm1e]

Check /var/log/synobtrfsdedupe.log I suppose it seems to contain reports from dedupe activity, including how much was cloned.

You can also check how much data is 'exclusive', not cloned that is:

root@HugeStorage:/volume1/Storage/Downloads# btrfs filesystem du --summarize 2024
     Total   Exclusive  Set shared  Filename
 245.14GiB    22.11GiB   186.44GiB  2024

(too bad no Markdown support inside code blocks, wanted to make the btrfs command bold so it would stand out more)

That is only 22 GiB of real data. But... That doesn't seem right, that's way too much non-exclusive.
I don't have much time left to check that out, but it's kind of important. If something is amiss with my storage or backups, that would be a disaster if something would happen and the data isn't really there to be restored in case of emergency.

[lastangel32]

hi, one easy question.
if i need to will replace the DiskStation i need to Undeduplication data before change it? (ipotize a replacement)

[007revad]

No. Just migrate the drives to the new Synology.