1 2XZ Utils 3======== 4 5 0. Overview 6 1. Documentation 7 1.1. Overall documentation 8 1.2. Documentation for command line tools 9 1.3. Documentation for liblzma 10 2. Version numbering 11 3. Reporting bugs 12 4. Other implementations of the .xz format 13 5. Contact information 14 15 160. Overview 17----------- 18 19 XZ Utils provide a general-purpose data compression library and 20 command line tools. The native file format is the .xz format, but 21 also the legacy .lzma format is supported. The .xz format supports 22 multiple compression algorithms, which are called "filters" in 23 context of XZ Utils. The primary filter is currently LZMA2. With 24 typical files, XZ Utils create about 30 % smaller files than gzip. 25 26 To ease adapting support for the .xz format into existing applications 27 and scripts, the API of liblzma is somewhat similar to the API of the 28 popular zlib library. For the same reason, the command line tool xz 29 has similar command line syntax than that of gzip. 30 31 When aiming for the highest compression ratio, LZMA2 encoder uses 32 a lot of CPU time and may use, depending on the settings, even 33 hundreds of megabytes of RAM. However, in fast modes, LZMA2 encoder 34 competes with bzip2 in compression speed, RAM usage, and compression 35 ratio. 36 37 LZMA2 is reasonably fast to decompress. It is a little slower than 38 gzip, but a lot faster than bzip2. Being fast to decompress means 39 that the .xz format is especially nice when the same file will be 40 decompressed very many times (usually on different computers), which 41 is the case e.g. when distributing software packages. In such 42 situations, it's not too bad if the compression takes some time, 43 since that needs to be done only once to benefit many people. 44 45 With some file types, combining (or "chaining") LZMA2 with an 46 additional filter can improve compression ratio. A filter chain may 47 contain up to four filters, although usually only one two is used. 48 For example, putting a BCJ (Branch/Call/Jump) filter before LZMA2 49 in the filter chain can improve compression ratio of executable files. 50 51 Since the .xz format allows adding new filter IDs, it is possible that 52 some day there will be a filter that is, for example, much faster to 53 compress than LZMA2 (but probably with worse compression ratio). 54 Similarly, it is possible that some day there is a filter that will 55 compress better than LZMA2. 56 57 XZ Utils doesn't support multithreaded compression or decompression 58 yet. It has been planned though and taken into account when designing 59 the .xz file format. 60 61 621. Documentation 63---------------- 64 651.1. Overall documentation 66 67 README This file 68 69 INSTALL.generic Generic install instructions for those not familiar 70 with packages using GNU Autotools 71 INSTALL Installation instructions specific to XZ Utils 72 PACKAGERS Information to packagers of XZ Utils 73 74 COPYING XZ Utils copyright and license information 75 COPYING.GPLv2 GNU General Public License version 2 76 COPYING.GPLv3 GNU General Public License version 3 77 COPYING.LGPLv2.1 GNU Lesser General Public License version 2.1 78 79 AUTHORS The main authors of XZ Utils 80 THANKS Incomplete list of people who have helped making 81 this software 82 NEWS User-visible changes between XZ Utils releases 83 ChangeLog Detailed list of changes (commit log) 84 TODO Known bugs and some sort of to-do list 85 86 Note that only some of the above files are included in binary 87 packages. 88 89 901.2. Documentation for command line tools 91 92 The command line tools are documented as man pages. In source code 93 releases (and possibly also in some binary packages), the man pages 94 are also provided in plain text (ASCII only) and PDF formats in the 95 directory "doc/man" to make the man pages more accessible to those 96 whose operating system doesn't provide an easy way to view man pages. 97 98 991.3. Documentation for liblzma 100 101 The liblzma API headers include short docs about each function 102 and data type as Doxygen tags. These docs should be quite OK as 103 a quick reference. 104 105 I have planned to write a bunch of very well documented example 106 programs, which (due to comments) should work as a tutorial to 107 various features of liblzma. No such example programs have been 108 written yet. 109 110 For now, if you have never used liblzma, libbzip2, or zlib, I 111 recommend learning *basics* of zlib API. Once you know that, it 112 should be easier to learn liblzma. 113 114 http://zlib.net/manual.html 115 http://zlib.net/zlib_how.html 116 117 1182. Version numbering 119-------------------- 120 121 The version number format of XZ Utils is X.Y.ZS: 122 123 - X is the major version. When this is incremented, the library 124 API and ABI break. 125 126 - Y is the minor version. It is incremented when new features are 127 added without breaking existing API or ABI. Even Y indicates 128 stable release and odd Y indicates unstable (alpha or beta 129 version). 130 131 - Z is the revision. This has different meaning for stable and 132 unstable releases: 133 * Stable: Z is incremented when bugs get fixed without adding 134 any new features. 135 * Unstable: Z is just a counter. API or ABI of features added 136 in earlier unstable releases having the same X.Y may break. 137 138 - S indicates stability of the release. It is missing from the 139 stable releases where Y is an even number. When Y is odd, S 140 is either "alpha" or "beta" to make it very clear that such 141 versions are not stable releases. The same X.Y.Z combination is 142 not used for more than one stability level i.e. after X.Y.Zalpha, 143 the next version can be X.Y.(Z+1)beta but not X.Y.Zbeta. 144 145 1463. Reporting bugs 147----------------- 148 149 Naturally it is easiest for me if you already know what causes the 150 unexpected behavior. Even better if you have a patch to propose. 151 However, quite often the reason for unexpected behavior is unknown, 152 so here are a few things to do before sending a bug report: 153 154 1. Try to create a small example how to reproduce the issue. 155 156 2. Compile XZ Utils with debugging code using configure switches 157 --enable-debug and, if possible, --disable-shared. If you are 158 using GCC, use CFLAGS='-O0 -ggdb3'. Don't strip the resulting 159 binaries. 160 161 3. Turn on core dumps. The exact command depends on your shell; 162 for example in GNU bash it is done with "ulimit -c unlimited", 163 and in tcsh with "limit coredumpsize unlimited". 164 165 4. Try to reproduce the suspected bug. If you get "assertion failed" 166 message, be sure to include the complete message in your bug 167 report. If the application leaves a coredump, get a backtrace 168 using gdb: 169 $ gdb /path/to/app-binary # Load the app to the debugger. 170 (gdb) core core # Open the coredump. 171 (gdb) bt # Print the backtrace. Copy & paste to bug report. 172 (gdb) quit # Quit gdb. 173 174 Report your bug via email or IRC (see Contact information below). 175 Don't send core dump files or any executables. If you have a small 176 example file(s) (total size less than 256 KiB), please include 177 it/them as an attachment. If you have bigger test files, put them 178 online somewhere and include an URL to the file(s) in the bug report. 179 180 Always include the exact version number of XZ Utils in the bug report. 181 If you are using a snapshot from the git repository, use "git describe" 182 to get the exact snapshot version. If you are using XZ Utils shipped 183 in an operating system distribution, mention the distribution name, 184 distribution version, and exact xz package version; if you cannot 185 repeat the bug with the code compiled from unpatched source code, 186 you probably need to report a bug to your distribution's bug tracking 187 system. 188 189 1904. Other implementations of the .xz format 191------------------------------------------ 192 193 7-Zip and the p7zip port of 7-Zip support the .xz format starting 194 from the version 9.00alpha. 195 196 http://7-zip.org/ 197 http://p7zip.sourceforge.net/ 198 199 XZ Embedded is a limited implementation written for use in the Linux 200 kernel, but it is also suitable for other embedded use. 201 202 http://tukaani.org/xz/embedded.html 203 204 2055. Contact information 206---------------------- 207 208 If you have questions, bug reports, patches etc. related to XZ Utils, 209 contact Lasse Collin <lasse.collin@tukaani.org> (in Finnish or English). 210 tukaani.org uses greylisting to reduce spam, thus when you send your 211 first email, it may get delayed by a few hours. In addition to that, 212 I'm sometimes slow at replying. If you haven't got a reply within two 213 weeks, assume that your email has got lost and resend it or use IRC. 214 215 You can find me also from #tukaani on Freenode; my nick is Larhzu. 216 The channel tends to be pretty quiet, so just ask your question and 217 someone may wake up. 218 219