Lines Matching +full:fast +full:- +full:speed
6 - `zstd` : default CLI supporting gzip-like arguments; includes dictionary builder, benchmark, and …
7 - `zstd_nolegacy` : Same as `zstd` but without support for legacy zstd formats
8 - `zstd-small` : CLI optimized for minimal size; no dictionary builder, no benchmark, and no suppor…
9 - `zstd-compress` : version of CLI which can only compress into zstd format
10 - `zstd-decompress` : version of CLI which can only decompress zstd format
16 - __HAVE_THREAD__ : multithreading is automatically enabled when `pthread` is detected.
23 - __ZSTD_LEGACY_SUPPORT__ : `zstd` can decompress files compressed by older versions of `zstd`.
34 - __HAVE_ZLIB__ : `zstd` can compress and decompress files in `.gz` format.
35 This is ordered through command `--format=gzip`.
44 - __HAVE_LZMA__ : `zstd` can compress and decompress files in `.xz` and `.lzma` formats.
45 This is ordered through commands `--format=xz` and `--format=lzma` respectively.
54 - __HAVE_LZ4__ : `zstd` can compress and decompress files in `.lz4` formats.
55 This is ordered through commands `--format=lz4`.
64 - __ZSTD_NOBENCH__ : `zstd` cli will be compiled without its integrated benchmark module.
68 - __ZSTD_NODICT__ : `zstd` cli will be compiled without support for the integrated dictionary build…
72 - __ZSTD_NOCOMPRESS__ : `zstd` cli will be compiled without support for compression.
75 A corresponding `Makefile` target using this ability is `zstd-decompress`.
77 - __ZSTD_NODECOMPRESS__ : `zstd` cli will be compiled without support for decompression.
80 A corresponding `Makefile` target using this ability is `zstd-compress`.
82 - __BACKTRACE__ : `zstd` can display a stack backtrace when execution
91 CLI supports aggregation of parameters i.e. `-b1`, `-e18`, and `-i1` can be joined into `-b1e18i1`.
97 - `zstdmt` : compress using all cores available on local system.
98 - `zcat` : will decompress and output target file using any of the supported formats. `gzcat` and `…
99 - `gzip` : if zlib support is enabled, will mimic `gzip` by compressing file using `.gz` format, re…
100 - `xz` : if lzma support is enabled, will mimic `xz` by compressing file using `.xz` format, removi…
101 - `lzma` : if lzma support is enabled, will mimic `lzma` by compressing file using `.lzma` format, …
102 - `lz4` : if lz4 support is enabled, will mimic `lz4` by compressing file using `.lz4` format. If l…
103 - `unzstd` and `unlz4` will decompress any of the supported format.
104 - `ungz`, `unxz` and `unlzma` will do the same, and will also remove source file by default (use `-…
110 in a file selected with the `-o` option (default name is `dictionary`),
122 1. Create the dictionary : `zstd --train PathToTrainingSet/* -o dictionaryName`
123 2. Compress with the dictionary: `zstd FILE -D dictionaryName`
124 3. Decompress with the dictionary: `zstd --decompress FILE.zst -D dictionaryName`
128 CLI includes in-memory compression benchmark module for zstd.
132 or names of directories can be used as parameters with `-r` option.
134 The benchmark measures ratio, compressed size, compression and decompression speed.
135 One can select compression levels starting from `-b` and ending with `-e`.
136 The `-i` parameter selects minimal time used for each of tested levels.
140 The full list of options can be obtained with `-h` or `-H` parameter:
143 zstd [args] [FILE(s)] [-o file]
146 with no FILE, or when FILE is - , read standard input
148 -# : # compression level (1-19, default: 3)
149 -d : decompression
150 -D DICT: use DICT as Dictionary for compression or decompression
151 -o file: result stored into `file` (only 1 output file)
152 -f : overwrite output without prompting, also (de)compress links
153 --rm : remove source file(s) after successful de/compression
154 -k : preserve source file(s) (default)
155 -h/-H : display help/long help and exit
158 -V : display Version number and exit
159 -c : write to standard output (even if it is the console)
160 -v : verbose mode; specify multiple times to increase verbosity
161 -q : suppress warnings; specify twice to suppress errors too
162 --no-progress : do not display the progress counter
163 -r : operate recursively on directories
164 --filelist FILE : read list of files to operate upon from FILE
165 --output-dir-flat DIR : processed files are stored into DIR
166 --output-dir-mirror DIR : processed files are stored into DIR respecting original directory structu…
167 --[no-]check : during compression, add XXH64 integrity checksum to frame (default: enabled). If spe…
168 -- : All arguments after "--" are treated as files
171 --ultra : enable levels beyond 19, up to 22 (requires more memory)
172 --long[=#]: enable long distance matching with given window log (default: 27)
173 --fast[=#]: switch to very fast compression levels (default: 1)
174 --adapt : dynamically adapt compression level to I/O conditions
175 --patch-from=FILE : specify the file to be used as a reference point for zstd's diff engine
176 -T# : spawns # compression threads (default: 1, 0==# cores)
177 -B# : select size of each job (default: 0==automatic)
178 --single-thread : use a single thread for both I/O and compression (result slightly different than …
179 --rsyncable : compress using a rsync-friendly method (-B sets block size)
180 --exclude-compressed: only compress files that are not already compressed
181 --stream-size=# : specify size of streaming input from `stdin`
182 --size-hint=# optimize compression parameters for streaming input of approximately this size
183 --target-compressed-block-size=# : generate compressed block of approximately targeted size
184 --no-dictID : don't write dictID into header (dictionary compression only)
185 --[no-]compress-literals : force (un)compressed literals
186 --format=zstd : compress files to the .zst format (default)
187 --format=gzip : compress files to the .gz format
188 --format=xz : compress files to the .xz format
189 --format=lzma : compress files to the .lzma format
190 --format=lz4 : compress files to the .lz4 format
193 -l : print information about zstd compressed files
194 --test : test compressed file integrity
195 -M# : Set a memory usage limit for decompression
196 --[no-]sparse : sparse mode (default: disabled)
199 --train ## : create a dictionary from a training set of files
200 --train-cover[=k=#,d=#,steps=#,split=#,shrink[=#]] : use the cover algorithm with optional args
201 --train-fastcover[=k=#,d=#,f=#,steps=#,split=#,accel=#,shrink[=#]] : use the fast cover algorithm w…
202 --train-legacy[=s=#] : use the legacy algorithm with selectivity (default: 9)
203 -o DICT : DICT is dictionary name (default: dictionary)
204 --maxdict=# : limit dictionary to specified size (default: 112640)
205 --dictID=# : force dictionary ID to specified value (default: random)
208 -b# : benchmark file(s), using # compression level (default: 3)
209 -e# : test all compression levels successively from -b# to -e# (default: 1)
210 -i# : minimum evaluation time in seconds (default: 3s)
211 -B# : cut file into independent blocks of size # (default: no block)
212 -S : output one benchmark result per input file (default: consolidated result)
213 --priority=rt : set process priority to real-time
217 There is no "generic" way to pass "any kind of parameter" to `zstd` in a pass-through manner.
229 which is either 64 in 32-bit mode, or 256 for 64-bit environments.
232 One such scenario is `tar --zstd`.
235 `-#` for compression level and `-T#` for number of threads.
239 The long distance matching mode, enabled with `--long`, is designed to improve
241 maximum window size, `128 MiB`) while still maintaining compression speed.
244 usage for both the compressor and decompressor. Performance in terms of speed is
245 dependent on long matches being found. Compression speed may degrade if few long
246 matches are found. Decompression speed usually improves when there are many long
249 Below are graphs comparing the compression speed, compression ratio, and
250 decompression speed with and without long distance matching on an ideal use
256 Compression Speed vs Ratio | Decompression Speed
257 ---------------------------|---------------------
258 …Speed vs Ratio](https://raw.githubusercontent.com/facebook/zstd/v1.3.3/doc/images/ldmCspeed.png "C…
260 | Method | Compression ratio | Compression speed | Decompression speed |
261 |:-------|------------------:|-------------------------:|---------------------------:|
262 | `zstd -1` | `5.065` | `284.8 MB/s` | `759.3 MB/s` |
263 | `zstd -5` | `5.826` | `124.9 MB/s` | `674.0 MB/s` |
264 | `zstd -10` | `6.504` | `29.5 MB/s` | `771.3 MB/s` |
265 | `zstd -1 --long` | `17.426` | `220.6 MB/s` | `1638.4 MB/s` |
266 | `zstd -5 --long` | `19.661` | `165.5 MB/s` | `1530.6 MB/s` |
267 | `zstd -10 --long`| `21.949` | `75.6 MB/s` | `1632.6 MB/s` |
270 on compression speed, and the decompression speed doubles.
274 compression speed (for lower levels) with minimal change in compression ratio.
280 | Method | Compression ratio | Compression speed | Decompression speed |
281 |:-------|------------------:|------------------:|---------------------:|
282 | `zstd -1` | `2.878` | `231.7 MB/s` | `594.4 MB/s` |
283 | `zstd -1 --long` | `2.929` | `106.5 MB/s` | `517.9 MB/s` |
284 | `zstd -5` | `3.274` | `77.1 MB/s` | `464.2 MB/s` |
285 | `zstd -5 --long` | `3.319` | `51.7 MB/s` | `371.9 MB/s` |
286 | `zstd -10` | `3.523` | `16.4 MB/s` | `489.2 MB/s` |
287 | `zstd -10 --long`| `3.566` | `16.2 MB/s` | `415.7 MB/s` |
301 `zstdcat -D dictionary -qc -- file.zst | grep pattern`