| /freebsd/sys/contrib/zstd/programs/ |
| H A D | Makefile | 10 # zstd : Command Line Utility, supporting gzip-like arguments
11 # zstd32 : Same as zstd, but forced to compile in 32-bits mode
12 # zstd-nolegacy : zstd without support of decompression of legacy versions
13 # zstd-small : minimal zstd without dictionary builder and benchmark
14 # zstd-compress : compressor-only version of zstd
15 # zstd-decompress : decompressor-only version of zstd
19 default: zstd-release
78 NO_ZLIB_MSG := ==> no zlib, building zstd without .gz support
81 ZLIB_MSG := ==> building zstd with .gz compression support
89 NO_LZMA_MSG := ==> no liblzma, building zstd without .xz/.lzma support
[all …]
|
| H A D | README.md | 6 - `zstd` : default CLI supporting gzip-like arguments; includes dictionary builder, benchmark, and …
7 - `zstd_nolegacy` : Same as `zstd` but without support for legacy zstd formats
8 - `zstd-small` : CLI optimized for minimal size; no dictionary builder, no benchmark, and no suppor…
9 - `zstd-compress` : version of CLI which can only compress into zstd format
10 - `zstd-decompress` : version of CLI which can only decompress zstd format
14 `zstd` scope can be altered by modifying the following `make` variables :
18 Example : `make zstd HAVE_THREAD=0`
23 - __ZSTD_LEGACY_SUPPORT__ : `zstd` can decompress files compressed by older versions of `zstd`.
24 …Starting v0.8.0, all versions of `zstd` produce frames compliant with the [specification](../doc/z…
26 By default, `zstd` supports decoding legacy formats >= v0.4.0 (`ZSTD_LEGACY_SUPPORT=4`).
[all …]
|
| H A D | zstd.1.md | 1 zstd(1) -- zstd, zstdmt, unzstd, zstdcat - Compress or decompress .zst files
7 `zstd` [*OPTIONS*] [-|_INPUT-FILE_] [-o _OUTPUT-FILE_]
9 `zstdmt` is equivalent to `zstd -T0`
11 `unzstd` is equivalent to `zstd -d`
13 `zstdcat` is equivalent to `zstd -dcf`
18 `zstd` is a fast lossless compression algorithm and data compression tool,
21 `zstd` offers highly configurable compression speed,
26 `zstd` command line syntax is generally similar to gzip,
31 - When compressing a single file, `zstd` displays progress notifications
34 - `zstd` does not accept input from console,
[all …]
|
| H A D | zstd.1 | 2 .TH "ZSTD" "1" "January 2022" "zstd 1.5.2" "User Commands"
5 \fBzstd\fR \- zstd, zstdmt, unzstd, zstdcat \- Compress or decompress \.zst files
8 \fBzstd\fR [\fIOPTIONS\fR] [\-|\fIINPUT\-FILE\fR] [\-o \fIOUTPUT\-FILE\fR]
11 \fBzstdmt\fR is equivalent to \fBzstd \-T0\fR
14 \fBunzstd\fR is equivalent to \fBzstd \-d\fR
17 \fBzstdcat\fR is equivalent to \fBzstd \-dcf\fR
20 …zstd\fR is a fast lossless compression algorithm and data compression tool, with command line synt…
23 \fBzstd\fR command line syntax is generally similar to gzip, but features the following differences…
29 When compressing a single file, \fBzstd\fR displays progress notifications and result summary by de…
32 \fBzstd\fR does not accept input from console, but it properly accepts \fBstdin\fR when it\'s not t…
[all …]
|
| /freebsd/contrib/file/tests/ |
| H A D | Makefile.am | 118 zstd-3-skippable-frames.result \
119 zstd-dictionary-0.result \
120 zstd-dictionary-1.result \
121 zstd-dictionary-2.result \
122 zstd-skippable-frame-0.result \
123 zstd-skippable-frame-4.result \
124 zstd-skippable-frame-8.result \
125 zstd-skippable-frame-C.result \
126 zstd-v0.2-FF.result \
127 zstd-v0.2-FF.testfile \
[all …]
|
| H A D | Makefile.in | 411 zstd-3-skippable-frames.result \
412 zstd-dictionary-0.result \
413 zstd-dictionary-1.result \
414 zstd-dictionary-2.result \
415 zstd-skippable-frame-0.result \
416 zstd-skippable-frame-4.result \
417 zstd-skippable-frame-8.result \
418 zstd-skippable-frame-C.result \
419 zstd-v0.2-FF.result \
420 zstd-v0.2-FF.testfile \
[all …]
|
| /freebsd/sys/contrib/openzfs/lib/libzstd/ |
| H A D | Makefile.am | 4 # -fno-tree-vectorize is set for gcc in zstd/common/compiler.h
11 module/zstd/lib/common/entropy_common.c \
12 module/zstd/lib/common/error_private.c \
13 module/zstd/lib/common/fse_decompress.c \
14 module/zstd/lib/common/pool.c \
15 module/zstd/lib/common/zstd_common.c \
16 module/zstd/lib/compress/fse_compress.c \
17 module/zstd/lib/compress/hist.c \
18 module/zstd/lib/compress/huf_compress.c \
19 module/zstd/lib/compress/zstd_compress_literals.c \
[all …]
|
| /freebsd/sys/contrib/openzfs/tests/zfs-tests/tests/functional/cli_root/zfs_set/ |
| H A D | zfs_set_feature_activation.ksh | 33 # Setting the compression property to any of the zstd levels should activate
34 # the zstd feature flag. Destroying the last dataset using the zstd feature flag
39 # 2. Check that the zstd feature flag is 'enabled'.
40 # 3. Setting the compression property to zstd.
41 # 4. Check that the zstd feature flag is now 'active'.
48 log_assert "Setting compression=zstd should activate the"\
53 export VDEV_ZSTD="$TEST_BASE_DIR/vdev-zstd"
57 if poolexists $TESTPOOL-zstd ; then
58 destroy_pool $TESTPOOL-zstd
66 log_must zpool create $TESTPOOL-zstd $VDEV_ZSTD
[all …]
|
| /freebsd/sys/contrib/openzfs/module/zstd/ |
| H A D | README.md | 1 # ZSTD-On-ZFS Library Manual
5 This subtree contains the ZSTD library used in ZFS. It is heavily cut-down by
7 intentionally unmodified. Please do not alter the file containing the zstd
8 library, besides upgrading to a newer ZSTD release.
14 * `zstd-in.c` is our template file for generating the single-file library
17 future. Thus we keep them private to ZSTD.
19 ## Updating ZSTD
21 To update ZSTD the following steps need to be taken:
23 1. Grab the latest release of [ZSTD](https://github.com/facebook/zstd/releases).
24 2. Copy the files output by the following script to `module/zstd/lib/`:
[all …]
|
| /freebsd/usr.bin/zstd/ |
| H A D | Makefile | 1 PROG= zstd
13 CFLAGS+= -I${SRCTOP}/sys/contrib/zstd/programs \
14 -I${SRCTOP}/sys/contrib/zstd/lib/common \
15 -I${SRCTOP}/sys/contrib/zstd/lib/compress \
16 -I${SRCTOP}/sys/contrib/zstd/lib/dictBuilder \
17 -I${SRCTOP}/sys/contrib/zstd/lib \
21 LINKS= ${BINDIR}/zstd ${BINDIR}/unzstd \
22 ${BINDIR}/zstd ${BINDIR}/zstdcat \
23 ${BINDIR}/zstd ${BINDIR}/zstdmt
24 MLINKS= zstd.1 unzstd.1 \
[all …]
|
| /freebsd/sys/contrib/zstd/ |
| H A D | README.md | 1 <p align="center"><img src="https://raw.githubusercontent.com/facebook/zstd/dev/doc/images/zstd_log…
3 __Zstandard__, or `zstd` as short version, is a fast lossless compression algorithm,
11 a list of known ports and bindings is provided on [Zstandard homepage](http://www.zstd.net/#other-l…
21 [travisDevBadge]: https://api.travis-ci.com/facebook/zstd.svg?branch=dev "Continuous Integration te…
22 [travisLink]: https://travis-ci.com/facebook/zstd
24 [AppveyorLink]: https://ci.appveyor.com/project/YannCollet/zstd-p0yf0
25 [CircleDevBadge]: https://circleci.com/gh/facebook/zstd/tree/dev.svg?style=shield "Short test suite"
26 [CircleLink]: https://circleci.com/gh/facebook/zstd
27 [CirrusDevBadge]: https://api.cirrus-ci.com/github/facebook/zstd.svg?branch=dev
28 [CirrusLink]: https://cirrus-ci.com/github/facebook/zstd
[all …]
|
| H A D | appveyor.yml | 64 ECHO Building zstd &&
72 make -C programs DEBUGFLAGS= clean zstd &&
73 cd programs\ && 7z a -tzip -mx9 zstd-win-binary-%PLATFORM%.zip zstd.exe &&
74 appveyor PushArtifact zstd-win-binary-%PLATFORM%.zip &&
75 cp zstd.exe ..\bin\zstd.exe &&
76 git clone --depth 1 --branch release https://github.com/facebook/zstd &&
77 cd zstd &&
78 git archive --format=tar release -o zstd-src.tar &&
79 ..\zstd -19 zstd-src.tar &&
80 appveyor PushArtifact zstd-src.tar.zst &&
[all …]
|
| H A D | CONTRIBUTING.md | 30 Zstd uses a branch-based workflow for making changes to the codebase. Typically, zstd
37 * Checkout your fork of zstd if you have not already
39 git checkout https://github.com/<username>/zstd
40 cd zstd
44 git pull https://github.com/facebook/zstd dev
99 …* Eventually, someone from the zstd team will approve your pull request and not long after merge i…
106 … that the change must make it to an official zstd release for it to be meaningful. We recommend
108 … their change makes it to the next release of zstd. Users will often discover bugs in your code or
113 executing it. It usually helps us find many simple bugs. Zstd uses clang's `scan-build` tool for
152 branch of zstd. You can then find the status of the tests on the PR's page. You can also
[all …]
|
| /freebsd/sys/contrib/zstd/zlibWrapper/ |
| H A D | README.md | 4 …e main objective of creating a zstd wrapper for [zlib](http://zlib.net/) is to allow a quick and s…
8 To build the zstd wrapper for zlib the following files are required:
15 - a static or dynamic zstd library
17 The first two files are required by all projects using zlib and they are not included with the zstd…
18 The further files are supplied with the zstd distribution.
21 #### Embedding the zstd wrapper within your project
26 To compile the zstd wrapper with your project you have to do the following:
28 - compile your project with `zstd_zlibwrapper.c`, `gz*.c` and a static or dynamic zstd library
34 #### Enabling zstd compression within your project
36 After embedding the zstd wrapper within your project the zstd library is turned off by default.
[all …]
|
| H A D | zstd_zlibwrapper.h | 29 /* returns a string with version of zstd library */
34 /* ZWRAP_useZSTDcompression() enables/disables zstd compression during runtime.
35 … By default zstd compression is disabled. To enable zstd compression please use one of the methods:
39 All above-mentioned methods will enable zstd compression for all threads.
43 /* checks if zstd compression is turned on */
47 It will change ZSTD compression parameters what may improve compression speed and/or ratio.
64 /* ZWRAP_setDecompressionType() enables/disables automatic recognition of zstd/zlib compressed data…
65 By default auto-detection of zstd and zlib streams in enabled (ZWRAP_AUTO).
71 /* checks zstd decompression type */
74 /* Checks if zstd decompression is used for a given stream.
[all …]
|
| /freebsd/contrib/llvm-project/llvm/lib/Support/ |
| H A D | Compression.cpp | 24 #include <zstd.h>
37 case compression::Format::Zstd: in getReasonIfUnsupported()
38 if (zstd::isAvailable()) in getReasonIfUnsupported()
40 return "LLVM was not built with LLVM_ENABLE_ZSTD or did not find zstd at " in getReasonIfUnsupported()
52 case compression::Format::Zstd: in compress()
53 zstd::compress(Input, Output, P.level, P.zstdEnableLdm); in compress()
63 case compression::Format::Zstd: in decompress()
64 return zstd::decompress(Input, Output, UncompressedSize); in decompress()
75 case compression::Format::Zstd: in decompress()
76 return zstd::decompress(Input, Output, UncompressedSize); in decompress()
[all …]
|
| /freebsd/sys/contrib/openzfs/tests/zfs-tests/tests/functional/cli_root/zdb/ |
| H A D | zdb_decompress_zstd.ksh | 24 # zdb -Z pool <objid> will display the ZSTD compression header
26 # the version of ZSTD used to compress the block, and the compression level
29 # 1. Create a pool, set compression to zstd-<random level>
32 # 4. Record the DVA, lsize, and psize, and ZSTD header of L0 block 0
33 # 5. Check that the ZSTD length is less than psize
34 # 6. Check that the ZSTD level matches the level we requested
43 log_assert "Verify zdb -Z (read ZSTD header) works as expected"
55 log_must zfs set compression=zstd-$random_level $TESTPOOL/$TESTFS
86 # Get the ZSTD header reported by zdb -Z
87 read -r zstd_size zstd_version zstd_level < <(sed -Ene 's/^.+ ZSTD:size=([^:]+):version=([^:]+):lev…
[all …]
|
| /freebsd/contrib/libarchive/libarchive/ |
| H A D | archive_read_support_filter_zstd.c | 46 #include <zstd.h>
61 char in_frame; /* True = in the middle of a zstd frame. */
65 /* Zstd Filter. */
71 * Note that we can detect zstd compressed files even if we can't decompress
73 * messages.) So the bid framework here gets compiled even if no zstd library
91 if (__archive_read_register_bidder(a, NULL, "zstd", in archive_read_support_filter_zstd()
99 "Using external zstd program for zstd decompression"); in archive_read_support_filter_zstd()
115 /* Zstd frame magic values */ in zstd_bidder_bid()
139 * decompression directly. We can, however, try to run "zstd -d"
147 r = __archive_read_program(self, "zstd -d -qq"); in zstd_bidder_init()
[all …]
|
| /freebsd/sys/contrib/openzfs/module/zcommon/ |
| H A D | zfs_prop.c | 134 { "zstd", ZIO_COMPRESS_ZSTD }, in zfs_prop_init()
135 { "zstd-fast", in zfs_prop_init()
139 * ZSTD 1-19 are synthetic. We store the compression level in a in zfs_prop_init()
150 { "zstd-1", ZIO_COMPLEVEL_ZSTD(ZIO_ZSTD_LEVEL_1) }, in zfs_prop_init()
151 { "zstd-2", ZIO_COMPLEVEL_ZSTD(ZIO_ZSTD_LEVEL_2) }, in zfs_prop_init()
152 { "zstd-3", ZIO_COMPLEVEL_ZSTD(ZIO_ZSTD_LEVEL_3) }, in zfs_prop_init()
153 { "zstd-4", ZIO_COMPLEVEL_ZSTD(ZIO_ZSTD_LEVEL_4) }, in zfs_prop_init()
154 { "zstd-5", ZIO_COMPLEVEL_ZSTD(ZIO_ZSTD_LEVEL_5) }, in zfs_prop_init()
155 { "zstd-6", ZIO_COMPLEVEL_ZSTD(ZIO_ZSTD_LEVEL_6) }, in zfs_prop_init()
156 { "zstd-7", ZIO_COMPLEVEL_ZSTD(ZIO_ZSTD_LEVEL_7) }, in zfs_prop_init()
[all …]
|
| /freebsd/sys/contrib/openzfs/tests/zfs-tests/tests/functional/cli_root/zfs_receive/ |
| H A D | zfs_receive_from_zstd.ksh | 27 # ZFS should receive a ZSTD compressed block and be able to determine the level
30 # 1. Create a ZSTD compressed dataset (random level)
51 log_assert "ZFS should track compression level when receiving a ZSTD stream"
57 log_note "Randomly selected ZSTD level: $random_level"
59 log_must zfs create -o compress=zstd-$random_level $TESTPOOL/$TESTFS1
76 read -r zstd_size1 zstd_version1 zstd_level1 < <(sed -Ene 's/^.+ ZSTD:size=([^:]+):version=([^:]+):…
77 log_note "ZSTD src: size=$zstd_size1 version=$zstd_version1 level=$zstd_level1"
79 log_note "Verify ZFS can receive the ZSTD compressed stream"
95 read -r zstd_size2 zstd_version2 zstd_level2 < <(sed -Ene 's/^.+ ZSTD:size=([^:]+):version=([^:]+):…
96 log_note "ZSTD dest: size=$zstd_size2 version=$zstd_version2 level=$zstd_level2"
[all …]
|
| /freebsd/sys/contrib/zstd/examples/ |
| H A D | dictionary_decompression.c | 14 #include <zstd.h> // presumes zstd library is installed
18 `dictFileName` is supposed to have been created using `zstd --train` */
35 * that it is always present. By default, zstd will write the content size in decompress()
41 CHECK(rSize != ZSTD_CONTENTSIZE_ERROR, "%s: not compressed by zstd!", fname); in decompress()
46 * If a non-zstd dictionary is used, then both will be zero. in decompress()
47 * By default zstd always writes the dictionary ID into the frame. in decompress()
48 * Zstd will check if there is a dictionary ID mismatch as well. in decompress()
66 /* When zstd knows the content size, it will error if it doesn't match. */ in decompress()
67 CHECK(dSize == rSize, "Impossible because zstd will check this condition!"); in decompress()
|
| /freebsd/contrib/libarchive/cpio/test/ |
| H A D | test_option_zstd.c | 18 /* Archive it with zstd compression. */ in DEFINE_TEST()
19 r = systemf("echo f | %s -o --zstd >archive.out 2>archive.err", in DEFINE_TEST()
26 "without zstd support"); in DEFINE_TEST()
34 skipping("This version of bsdcpio uses an external zstd program " in DEFINE_TEST()
43 skipping("This version of bsdcpio uses an external zstd program " in DEFINE_TEST()
50 skipping("This version of bsdcpio uses an external zstd program " in DEFINE_TEST()
54 failure("--zstd option is broken: %s", p); in DEFINE_TEST()
59 /* Check that the archive file has an zstd signature. */ in DEFINE_TEST()
|
| /freebsd/sys/contrib/zstd/lib/ |
| H A D | README.md | 37 via the [advanced API defined in `lib/zstd.h`](https://github.com/facebook/zstd/blob/v1.4.3/lib/zst…
42 Zstandard's stable API is exposed within [lib/zstd.h](zstd.h).
52 - `ZSTD_STATIC_LINKING_ONLY` : if this macro is defined _before_ including `zstd.h`,
54 exposed in the second part of `zstd.h`.
78 - `lib/legacy` : makes it possible to decompress legacy zstd formats, starting from `v0.1.0`.
113 a time or two symbols at a time. Zstd normally includes both (and dispatches
151 that zstd does not use. Not all unused functions are hidden, but they can be if needed.
170 The header file `zstd.h` and the dynamic library `dll\libzstd.dll` are required to
173 It means that if a project that uses ZSTD consists of a single `test-dll.c`
178 The compiled executable will require ZSTD DLL which is available at `dll\libzstd.dll`.
[all …]
|
| H A D | zdict.h | 40 * Zstd dictionary builder
47 * Zstd can use dictionaries to improve compression ratio of small data.
52 * these files. Then, zstd can use the dictionary to find repetitions that are
66 * Simply pass the dictionary to the zstd compressor with
69 * more advanced functions that allow selecting some options, see zstd.h for
72 * What is a zstd dictionary?
75 * A zstd dictionary has two pieces: Its header, and its content. The header
77 * entropy tables allow zstd to save on header costs in the compressed file,
84 * A raw content dictionary is just bytes. It doesn't have a zstd dictionary
110 * The zstd CLI defaults to a 110KB dictionary. You likely don't need a
[all …]
|
| /freebsd/contrib/libarchive/libarchive/test/ |
| H A D | test_compat_zstd.c | 27 * Verify our ability to read sample files compatibly with 'zstd -d'.
30 * * zstd -d will read multiple zstd streams, concatenating the output
31 * * zstd -d will skip over zstd skippable frames
46 skipping("zstd reading not fully supported on this platform"); in compat_zstd()
67 assertEqualString(archive_filter_name(a, 0), "zstd"); in compat_zstd()
77 /* This sample was compressed as 3 separate streams with a zstd skippable in DEFINE_TEST()
|