Run WebAssembly Tests in your browser
This is a very fast DXT/ETC encoder that I wrote, checking out the following idea. "What if while we design a block compression algorithm, we put the compression speed before everything else?" Of course, our compressed results should be reasonable enough; let's say it should be better than a baseline. Let's set our baseline to a texture downsampled by the factor of two in RGB565 format which gives us the same memory footprint as DXT1/BC1.
Why would we need a compressor that is very-very fast but cannot compete with well-known codecs in terms of quality?
I think such a compressor might be useful for several reasons:
- To quickly encode an uncompressed texture on the fly. When you need to use uncompressed texture for rendering (synthesised or fetched from the Internet), it may be a good option to compress it first using Goofy to save some device memory and performance.
- To make a "preview" build for massive projects. Usually, you need to compress thousands of textures before you can play or test the build. Sometimes you don't care about texture quality that much, and you only want to get you playable build as fast as possible.
- Quick preview for live-sync tools. You can immediately show any texture changes using Goofy and then run a more high-quality but slow encoder in parallel to improve the final look of the texture (progressive live texture sync)
- Performance over quality.
- One heuristics to rule them all. In favor of speed, I can't afford to check different combinations or explore a solution space deep enough.
- SSE2 friendly. Let's get this SSE2 thing to the extreme! I should be able to run encoder sixteen SIMD lanes wide using SSE2 instruction set.
- Find the principal axis using the diagonal of the bounding box in RGB space.
- Convert the principal axis to perceptual brightness using the YCoCg color model.
- Convert all the 16 block pixel from RGB to perceptual brightness
- Project 16 pixels to the principal axis using brightness values
- For ETC1 encoder, get a base color as an average color of 16 pixels but adjust the brightness to get into the center of the principal axis.
Of course, the devil is in the detail; there are a lot of small optimizations/tricks on how to make it fast and parallel for 16 pixels at a time. I recommend you to look at the code for this, I tried to make it as clear as possible and made a lot of comments to keep the data transformation flow clear.
ETC1 always encoded using ETC1s format.
NOTE: Due to quantization based on perceptual brightness and because of ETC1s format limitation Goofy codec doesn't fit well for Normal Maps.
All the performance timings below gathered for the following CPU: i7-7820HQ, 2.9Ghz single thread. To compute timings, I ran encoder 128 times and chose the fastest timing from the run to avoid noise from OS.
| Encoder | MP/s | RGB-PSNR (db) |
|---|---|---|
| Baseline | n/a | 33.39 |
| Goofy DXT1 | 1429 | 37.02 |
| Goofy ETC1 | 1221 | 36.30 |
Those numbers looks pretty good. As far as I can tell, this is the fastest CPU compressor available at the moment. https://github.com/castano/nvidia-texture-tools/wiki/RealTimeDXTCompression
For all the encoders in the comparison, I've used the fastest available options/lowest quality.
| Encoder | MP/s | RGB-PSNR (db) |
|---|---|---|
| Baseline | n/a | 33.39 |
| Goofy DXT1 | 1429 | 37.02 |
| icbc DXT1 v1.0 (SSE2 enabled, fast DXT encoding using box fitting) | 24 | 41.00 |
| rgbcx v1.08 (level0 low-quality) | 60 | 40.85 |
| ryg DXT1 (STB_DXT_NORMAL) | 43 | 40.82 |
| Goofy ETC1 | 1221 | 36.30 |
| Basisu ETC1 | n/a | 36.27 |
| rg v1.04 ETC1 (low-quality, dithering disabled) | 3 | 40.87 |
The following chart shows the RGB-PSNR vs. Performance for every image in the test image set.
Note: As I mentioned earlier compressed Normal Map quality is way worse than photos or albedo textures.
Note: Comparison with "Basisu" is not fair, because this library is supercompressor and target to reduce the final image size. But this is the only ETC1S codec available to compare.
Goofy is a header-only library and it's very easy to use.
// Add a preprocessor definition and include goofy header
#define GOOFYTC_IMPLEMENTATION
#include <goofy_tc.h>
// You are all set
void test(unsigned char* result, const unsigned char* input, unsigned int width, unsigned int height, unsigned int stride)
{
goofy::compressDXT1(dest, source, width, height, stride);
goofy::compressETC1(dest, source, width, height, stride);
}
At some point, I hope I'll make a DXT5/ETC2 alpha encoder based on this code. It should be pretty much straightforward because I can use alpha directly instead of brightness.
Look like it should be easy enough to write support for ARM NEON instruction set. Lack of _mm_movemask_epi8 analog may cause some extra troubles, but everything else should be fine.
I appreciate any push requests and improvements. Feel free to ping me and/or send your PRs.
Basis Universal GPU Texture Codec by Binomial LLC
https://github.com/BinomialLLC/basis_universal
DXT1/DXT5 compressor. Originally written by Fabian "ryg" Giesen
https://github.com/nothings/stb/blob/master/stb_dxt.h
rg-etc1 encoder by Rich Geldreich
https://github.com/richgel999/rg-etc1
Fast, single source file BC1-5 and BC7/BPTC GPU texture encoders by Rich Geldreich
https://github.com/richgel999/bc7enc
ICBC - A High Quality BC1 Encoder by Ignacio Castano
https://github.com/castano/icbc
The squish open source DXT compression library. Originally written by Simon Brown.
https://github.com/Cavewhere/squish
Etc2Comp - Texture to ETC2 compressor. Originally written by Colt McAnlis.
https://github.com/google/etc2comp
https://medium.com/@duhroach/building-a-blazing-fast-etc2-compressor-307f3e9aad99
SIMD transposes by Fabian "ryg" Giesen
https://fgiesen.wordpress.com/2013/07/09/simd-transposes-1/
Performance Tuning for CPU. Part 2: Advanced SIMD Optimization by Marat Dukhan
https://docs.google.com/presentation/u/1/d/1I0-SiHid1hTsv7tjLST2dYW5YF5AJVfs9l4Rg9rvz48/htmlpresent
A few missing SSE intrinsics by Alfred Klomp
http://www.alfredklomp.com/programming/sse-intrinsics/
Accelerating Texture Compression with Intel Streaming SIMD Extensions by RADU V. (Intel)
KTX (Khronos Texture) Library and Tools
https://github.com/KhronosGroup/KTX-Software
DXT Compression Techniques by Simon Brown
http://sjbrown.co.uk/2006/01/19/dxt-compression-techniques/
Extreme DXT Compression by Peter Uliciansky
http://www.cauldron.sk/files/extreme_dxt_compression.pdf
Real-Time YCoCg-DXT Compression by J.M.P. van Waveren and Ignacio Castano
Real-Time DXT Compression by J.M.P. van Waveren
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.215.7942&rep=rep1&type=pdf