1b39628e7SDag-Erling Smørgrav.\"- 2b39628e7SDag-Erling Smørgrav.\" Copyright (c) 2000 Dag-Erling Co�dan Sm�rgrav 3b39628e7SDag-Erling Smørgrav.\" All rights reserved. 4114c3c1aSDag-Erling Smørgrav.\" Portions Copyright (c) 1999 Massachusetts Institute of Technology; used 5114c3c1aSDag-Erling Smørgrav.\" by permission. 6b39628e7SDag-Erling Smørgrav.\" 7b39628e7SDag-Erling Smørgrav.\" Redistribution and use in source and binary forms, with or without 8b39628e7SDag-Erling Smørgrav.\" modification, are permitted provided that the following conditions 9b39628e7SDag-Erling Smørgrav.\" are met: 10b39628e7SDag-Erling Smørgrav.\" 1. Redistributions of source code must retain the above copyright 11b39628e7SDag-Erling Smørgrav.\" notice, this list of conditions and the following disclaimer 12b39628e7SDag-Erling Smørgrav.\" in this position and unchanged. 13b39628e7SDag-Erling Smørgrav.\" 2. Redistributions in binary form must reproduce the above copyright 14b39628e7SDag-Erling Smørgrav.\" notice, this list of conditions and the following disclaimer in the 15b39628e7SDag-Erling Smørgrav.\" documentation and/or other materials provided with the distribution. 16b39628e7SDag-Erling Smørgrav.\" 3. The name of the author may not be used to endorse or promote products 17b39628e7SDag-Erling Smørgrav.\" derived from this software without specific prior written permission. 18b39628e7SDag-Erling Smørgrav.\" 19b39628e7SDag-Erling Smørgrav.\" THIS SOFTWARE IS PROVIDED BY THE AUTHOR ``AS IS'' AND ANY EXPRESS OR 20b39628e7SDag-Erling Smørgrav.\" IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES 21b39628e7SDag-Erling Smørgrav.\" OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. 22b39628e7SDag-Erling Smørgrav.\" IN NO EVENT SHALL THE AUTHOR BE LIABLE FOR ANY DIRECT, INDIRECT, 23b39628e7SDag-Erling Smørgrav.\" INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT 24b39628e7SDag-Erling Smørgrav.\" NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, 25b39628e7SDag-Erling Smørgrav.\" DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY 26b39628e7SDag-Erling Smørgrav.\" THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT 27b39628e7SDag-Erling Smørgrav.\" (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF 28b39628e7SDag-Erling Smørgrav.\" THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. 29b39628e7SDag-Erling Smørgrav.\" 30c3aac50fSPeter Wemm.\" $FreeBSD$ 31b39628e7SDag-Erling Smørgrav.\" 32b39628e7SDag-Erling Smørgrav.Dd June 28, 2000 337fefc698SJordan K. Hubbard.Dt FETCH 1 34b39628e7SDag-Erling Smørgrav.Os 357fefc698SJordan K. Hubbard.Sh NAME 367fefc698SJordan K. Hubbard.Nm fetch 377fefc698SJordan K. Hubbard.Nd retrieve a file by Uniform Resource Locator 387fefc698SJordan K. Hubbard.Sh SYNOPSIS 39b39628e7SDag-Erling Smørgrav.Nm 40047843ddSDag-Erling Smørgrav.Op Fl 146AFHMPRadlmnpqrsv 41b39628e7SDag-Erling Smørgrav.Op Fl B Ar bytes 42b39628e7SDag-Erling Smørgrav.Op Fl S Ar bytes 43b39628e7SDag-Erling Smørgrav.Op Fl T Ar seconds 447fefc698SJordan K. Hubbard.Op Fl o Ar file 45b39628e7SDag-Erling Smørgrav.Op Fl w Ar seconds 46047843ddSDag-Erling Smørgrav.Op Fl h Ar host 47047843ddSDag-Erling Smørgrav.Op Fl c Ar dir 48047843ddSDag-Erling Smørgrav.Op Fl f Ar file 49047843ddSDag-Erling Smørgrav.Op Ar URL ... 507fefc698SJordan K. Hubbard.Sh DESCRIPTION 51b39628e7SDag-Erling Smørgrav.Nm Fetch 52b39628e7SDag-Erling Smørgravprovides a command-line interface to the 53b39628e7SDag-Erling Smørgrav.Xr fetch 3 54b39628e7SDag-Erling Smørgravlibrary. 55b39628e7SDag-Erling SmørgravIts purpose is to retrieve the file(s) pointed to by the URL(s) on the 56b39628e7SDag-Erling Smørgravcommand line. 577fefc698SJordan K. Hubbard.Pp 587fefc698SJordan K. HubbardThe following options are available: 5976dafb89SGarrett Wollman.Bl -tag -width Fl 60b39628e7SDag-Erling Smørgrav.It Fl \&1 61b39628e7SDag-Erling SmørgravStop and return exit code 0 at the first successfully retrieved file. 62b39628e7SDag-Erling Smørgrav.It Fl 4 63b39628e7SDag-Erling SmørgravForces 64b39628e7SDag-Erling Smørgrav.Nm 65b39628e7SDag-Erling Smørgravto use IPv4 addresses only. 66b39628e7SDag-Erling Smørgrav.It Fl 6 67b39628e7SDag-Erling SmørgravForces 68b39628e7SDag-Erling Smørgrav.Nm 69b39628e7SDag-Erling Smørgravto use IPv6 addresses only. 70189da044SGarrett Wollman.It Fl A 71b39628e7SDag-Erling SmørgravDo not automatically follow ``temporary'' (302) redirects. 72b39628e7SDag-Erling SmørgravSome broken Web sites will return a redirect instead of a not-found 73b39628e7SDag-Erling Smørgraverror when the requested object does not exist. 742494e810SGarrett Wollman.It Fl a 752494e810SGarrett WollmanAutomatically retry the transfer upon soft failures. 76b39628e7SDag-Erling Smørgrav.It Fl B Ar bytes 77b39628e7SDag-Erling SmørgravSpecify the read buffer size in bytes. 78b39628e7SDag-Erling SmørgravThe default is 4096 bytes. 79b39628e7SDag-Erling SmørgravAttempts to set a buffer size lower than this will be silently 80b39628e7SDag-Erling Smørgravignored. 81b39628e7SDag-Erling SmørgravThe number of reads actually performed is reported at verbosity level 82b39628e7SDag-Erling Smørgravtwo or higher (see the 83b39628e7SDag-Erling Smørgrav.Fl v 84b39628e7SDag-Erling Smørgravflag). 8578be3199SGarrett Wollman.It Fl c Ar dir 8678be3199SGarrett WollmanThe file to retrieve is in directory 8778be3199SGarrett Wollman.Ar dir 8878be3199SGarrett Wollmanon the remote host. 89047843ddSDag-Erling SmørgravThis option is deprecated and is provided for backward compatibility 90047843ddSDag-Erling Smørgravonly. 91047843ddSDag-Erling Smørgrav.It Fl d 92047843ddSDag-Erling SmørgravUse a direct connection even if a proxy is configured. 93d6a8296aSBrian Feldman.It Fl F 94b39628e7SDag-Erling SmørgravIn combination with the 95d6a8296aSBrian Feldman.Fl r 96b39628e7SDag-Erling Smørgravflag, forces a restart even if the local and remote files have 97b39628e7SDag-Erling Smørgravdifferent modification times. 9878be3199SGarrett Wollman.It Fl f Ar file 9978be3199SGarrett WollmanThe file to retrieve is named 10078be3199SGarrett Wollman.Ar file 10178be3199SGarrett Wollmanon the remote host. 102047843ddSDag-Erling SmørgravThis option is deprecated and is provided for backward compatibility 103047843ddSDag-Erling Smørgravonly. 104b39628e7SDag-Erling Smørgrav.It Fl H 105b39628e7SDag-Erling SmørgravWhen using passive FTP, allocate a high port for the data connection. 106b39628e7SDag-Erling SmørgravSee 107b39628e7SDag-Erling Smørgrav.Xr ip 4 108b39628e7SDag-Erling Smørgravfor details on how to specify which port range this corresponds to. 10978be3199SGarrett Wollman.It Fl h Ar host 11078be3199SGarrett WollmanThe file to retrieve is located on the host 11178be3199SGarrett Wollman.Ar host . 112047843ddSDag-Erling SmørgravThis option is deprecated and is provided for backward compatibility 113047843ddSDag-Erling Smørgravonly. 11478be3199SGarrett Wollman.It Fl l 115b39628e7SDag-Erling SmørgravIf the target is a file-scheme URL, make a symbolic link to the target 116b39628e7SDag-Erling Smørgravrather than trying to copy it. 1177fefc698SJordan K. Hubbard.It Fl M 1187fefc698SJordan K. Hubbard.It Fl m 1190b474bc6SDag-Erling SmørgravMirror mode: if the file already exists locally and has the same size 1200b474bc6SDag-Erling Smørgravand modification time as the remote file, it will not be fetched. 121c0b0d54eSDag-Erling SmørgravNote that the 122c0b0d54eSDag-Erling Smørgrav.Fl m 123c0b0d54eSDag-Erling Smørgravand 124c0b0d54eSDag-Erling Smørgrav.Fl r 125c0b0d54eSDag-Erling Smørgravflags are mutually exclusive. 1266b5c2db2SJordan K. Hubbard.It Fl n 1270b474bc6SDag-Erling SmørgravDon't preserve the modification time of the transferred file. 12878be3199SGarrett Wollman.It Fl o Ar file 12978be3199SGarrett WollmanSet the output file name to 13078be3199SGarrett Wollman.Ar file . 13178be3199SGarrett WollmanBy default, a ``pathname'' is extracted from the specified URI, and 132b39628e7SDag-Erling Smørgravits basename is used as the name of the output file. 133b39628e7SDag-Erling SmørgravA 13478be3199SGarrett Wollman.Ar file 13578be3199SGarrett Wollmanargument of 13678be3199SGarrett Wollman.Sq Li \&- 13778be3199SGarrett Wollmanindicates that results are to be directed to the standard output. 1387fefc698SJordan K. Hubbard.It Fl P 1397fefc698SJordan K. Hubbard.It Fl p 140b39628e7SDag-Erling SmørgravUse passive FTP. 141b39628e7SDag-Erling SmørgravThis is useful if you are behind a firewall which blocks incoming 142b39628e7SDag-Erling Smørgravconnections. 143b39628e7SDag-Erling SmørgravTry this flag if 144b39628e7SDag-Erling Smørgrav.Nm 145b39628e7SDag-Erling Smørgravseems to hang when retrieving FTP URLs. 14678be3199SGarrett Wollman.It Fl q 14787faa07bSSheldon HearnQuiet mode. 148b39628e7SDag-Erling SmørgravThis works by setting the verbosity level to zero; see the 149b39628e7SDag-Erling Smørgrav.Fl v 150b39628e7SDag-Erling Smørgravoption. 15178be3199SGarrett Wollman.It Fl R 152b39628e7SDag-Erling SmørgravThe output files are precious, and should not be deleted under any 153b39628e7SDag-Erling Smørgravcircumstances, even if the transfer failed or was incomplete. 15478be3199SGarrett Wollman.It Fl r 15578be3199SGarrett WollmanRestart a previously interrupted transfer. 156c0b0d54eSDag-Erling SmørgravNote that the 157c0b0d54eSDag-Erling Smørgrav.Fl m 158c0b0d54eSDag-Erling Smørgravand 159c0b0d54eSDag-Erling Smørgrav.Fl r 160c0b0d54eSDag-Erling Smørgravflags are mutually exclusive. 1610637c2ccSJordan K. Hubbard.It Fl S Ar bytes 162b39628e7SDag-Erling SmørgravRequire the file size reported by the server to match the specified 163b39628e7SDag-Erling Smørgravvalue. 164b39628e7SDag-Erling SmørgravIf it does not, a message is printed and the file is not fetched. 165b39628e7SDag-Erling SmørgravIf the server does not support reporting file sizes, this option is 166b39628e7SDag-Erling Smørgravignored and the file is fetched unconditionally. 167b451f452SMartin Cracauer.It Fl s 168b39628e7SDag-Erling SmørgravPrint the size in bytes of each requested file, without fetching it. 169fc6fcbf9SJordan K. Hubbard.It Fl T Ar seconds 170fc6fcbf9SJordan K. HubbardSet timeout value to 171fc6fcbf9SJordan K. Hubbard.Ar seconds. 172a43a248cSPeter WemmOverrides the environment variables 173fc6fcbf9SJordan K. Hubbard.Ev FTP_TIMEOUT 174b39628e7SDag-Erling Smørgravfor FTP transfers or 175a43a248cSPeter Wemm.Ev HTTP_TIMEOUT 176b39628e7SDag-Erling Smørgravfor HTTP transfers if set. 1779f63f2aaSDag-Erling Smørgrav.It Fl t 1789f63f2aaSDag-Erling SmørgravWork around a different set of buggy 1799f63f2aaSDag-Erling Smørgrav.Tn TCP 1809f63f2aaSDag-Erling Smørgravimplementations. 1817ae26f14SJordan K. Hubbard.It Fl v 182b39628e7SDag-Erling SmørgravEach instance of this flag increases the verbosity level by one. 183b39628e7SDag-Erling SmørgravLevel one (the default) only gives a summary after each file; level 184b39628e7SDag-Erling Smørgravtwo show a running count during the transfer, provided that the 185b39628e7SDag-Erling Smørgravstandard output goes to a terminal; level three enables messages from 186b39628e7SDag-Erling Smørgravthe 187b39628e7SDag-Erling Smørgrav.Xr fetch 3 188b39628e7SDag-Erling Smørgravlibrary. 189b39628e7SDag-Erling Smørgrav.It Fl w Ar seconds 190b39628e7SDag-Erling SmørgravWhen the 191b39628e7SDag-Erling Smørgrav.Fl a 192b39628e7SDag-Erling Smørgravflag is specified, wait this many seconds between successive retries. 1937fefc698SJordan K. Hubbard.El 194b39628e7SDag-Erling Smørgrav.Sh DIAGNOSTICS 19576dafb89SGarrett WollmanThe 19676dafb89SGarrett Wollman.Nm 197b39628e7SDag-Erling Smørgravcommand returns zero on success, or one on failure. 198b39628e7SDag-Erling SmørgravIf multiple URLs are listed on the command line, 19976dafb89SGarrett Wollman.Nm 200b39628e7SDag-Erling Smørgravwill attempt to retrieve them each of them in turn, and return zero 201b39628e7SDag-Erling Smørgravonly if they were all successfully retrieved. 2027fefc698SJordan K. Hubbard.Sh ENVIRONMENT 20378be3199SGarrett Wollman.Bl -tag -width FTP_PASSIVE_MODE -offset indent 20478be3199SGarrett Wollman.It Ev FTP_TIMEOUT 20578be3199SGarrett Wollmanmaximum time, in seconds, to wait before aborting an 20678be3199SGarrett Wollman.Tn FTP 20778be3199SGarrett Wollmanconnection. 20876dafb89SGarrett Wollman.It Ev HTTP_TIMEOUT 20976dafb89SGarrett Wollmanmaximum time, in seconds, to wait before aborting an 21076dafb89SGarrett Wollman.Tn HTTP 21176dafb89SGarrett Wollmanconnection. 212b39628e7SDag-Erling Smørgrav.El 213b39628e7SDag-Erling Smørgrav.Pp 214b39628e7SDag-Erling SmørgravAll environment variables mentioned in the documentation for the 215b39628e7SDag-Erling Smørgrav.Xr fetch 3 216b39628e7SDag-Erling Smørgravlibrary are supported. 2177fefc698SJordan K. Hubbard.Sh SEE ALSO 218b39628e7SDag-Erling Smørgrav.Xr fetch 3 2197fefc698SJordan K. Hubbard.Sh HISTORY 2207fefc698SJordan K. HubbardThe 221b39628e7SDag-Erling Smørgrav.Nm 22285cf659aSMike Pritchardcommand appeared in 22385cf659aSMike Pritchard.Fx 2.1.5 . 224b39628e7SDag-Erling SmørgravThis implementation first appeared in 225b39628e7SDag-Erling Smørgrav.Fx 4.1 . 22678be3199SGarrett Wollman.Sh AUTHORS 22778be3199SGarrett WollmanThe original implementation of 22878be3199SGarrett Wollman.Nm 229306005e7SPhilippe Charnierwas done by 230306005e7SPhilippe Charnier.An Jean-Marc Zucconi . 231306005e7SPhilippe CharnierIt was extensively re-worked for 232bc5d5816SWolfram Schneider.Fx 2.2 233306005e7SPhilippe Charnierby 234b39628e7SDag-Erling Smørgrav.An Garrett Wollman , 235b39628e7SDag-Erling Smørgravand later completely rewritten to use the 236b39628e7SDag-Erling Smørgrav.Xr fetch 3 237b39628e7SDag-Erling Smørgravlibrary by 238b39628e7SDag-Erling Smørgrav.An Dag-Erling Sm�rgrav . 239b39628e7SDag-Erling Smørgrav.Sh NOTES 2402494e810SGarrett WollmanThe 2410c8cc99eSGarrett Wollman.Fl b 242b39628e7SDag-Erling Smørgravand 243b39628e7SDag-Erling Smørgrav.Fl t 244b39628e7SDag-Erling Smørgravoptions are no longer supported and will generate warnings. 245b39628e7SDag-Erling SmørgravThey were workarounds for bugs in other OSes which this implementation 246b39628e7SDag-Erling Smørgravdoes not trigger. 247c1468430SGarrett Wollman.Pp 248047843ddSDag-Erling SmørgravOne cannot both use the 249047843ddSDag-Erling Smørgrav.Fl h , 250047843ddSDag-Erling Smørgrav.Fl c and 251b39628e7SDag-Erling Smørgrav.Fl f 252047843ddSDag-Erling Smørgravoptions and specify URLs on the command line. 253