xref: /freebsd/usr.sbin/jail/jail.8 (revision 9f23cbd6cae82fd77edfad7173432fa8dccd0a95)
1.\" Copyright (c) 2000, 2003 Robert N. M. Watson
2.\" Copyright (c) 2008-2012 James Gritton
3.\" All rights reserved.
4.\"
5.\" Redistribution and use in source and binary forms, with or without
6.\" modification, are permitted provided that the following conditions
7.\" are met:
8.\" 1. Redistributions of source code must retain the above copyright
9.\"    notice, this list of conditions and the following disclaimer.
10.\" 2. Redistributions in binary form must reproduce the above copyright
11.\"    notice, this list of conditions and the following disclaimer in the
12.\"    documentation and/or other materials provided with the distribution.
13.\"
14.\" THIS SOFTWARE IS PROVIDED BY THE AUTHOR AND CONTRIBUTORS ``AS IS'' AND
15.\" ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
16.\" IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE
17.\" ARE DISCLAIMED.  IN NO EVENT SHALL THE AUTHOR OR CONTRIBUTORS BE LIABLE
18.\" FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL
19.\" DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS
20.\" OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION)
21.\" HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT
22.\" LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY
23.\" OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF
24.\" SUCH DAMAGE.
25.\"
26.\" $FreeBSD$
27.\"
28.Dd March 12, 2023
29.Dt JAIL 8
30.Os
31.Sh NAME
32.Nm jail
33.Nd "manage system jails"
34.Sh SYNOPSIS
35.Nm
36.Op Fl dhilqv
37.Op Fl J Ar jid_file
38.Op Fl u Ar username
39.Op Fl U Ar username
40.Op Fl cmr
41.Ar param Ns = Ns Ar value ...
42.Op Cm command Ns = Ns Ar command ...
43.Nm
44.Op Fl dqv
45.Op Fl f Ar conf_file
46.Op Fl p Ar limit
47.Op Fl cmr
48.Op Ar jail
49.Nm
50.Op Fl qv
51.Op Fl f Ar conf_file
52.Op Fl rR
53.Op Cm * | Ar jail ...
54.Nm
55.Op Fl dhilqv
56.Op Fl J Ar jid_file
57.Op Fl u Ar username
58.Op Fl U Ar username
59.Op Fl n Ar jailname
60.Op Fl s Ar securelevel
61.Ar path hostname ip Ns Op Cm \&, Ns Ar ...
62.Ar command ...
63.Nm
64.Op Fl f Ar conf_file
65.Fl e
66.Ar separator
67.Sh DESCRIPTION
68The
69.Nm
70utility creates new jails, or modifies or removes existing jails.
71It can also print a list of configured jails and their parameters.
72A jail
73.Pq or Dq prison
74is specified via parameters on the command line, or in the
75.Xr jail.conf 5
76file.
77.Pp
78At least one of the options
79.Fl c ,
80.Fl e ,
81.Fl m
82or
83.Fl r
84must be specified.
85These options are used alone or in combination to describe the operation to
86perform:
87.Bl -tag -width indent
88.It Fl c
89Create a new jail.
90The jail
91.Va jid
92and
93.Va name
94parameters (if specified on the command line)
95must not refer to an existing jail.
96.It Fl e Ar separator
97Exhibit a list of all configured non-wildcard jails and their parameters.
98No jail creation, modification or removal performed if this option is used.
99The
100.Ar separator
101string is used to separate parameters.
102Use
103.Xr jls 8
104utility to list running jails.
105.It Fl m
106Modify an existing jail.
107One of the
108.Va jid
109or
110.Va name
111parameters must exist and refer to an existing jail.
112Some parameters may not be changed on a running jail.
113.It Fl r
114Remove the
115.Ar jail
116specified by jid or name.
117All jailed processes are killed, and all jails that are
118children of this jail are also
119removed.
120.It Fl rc
121Restart an existing jail.
122The jail is first removed and then re-created, as if
123.Dq Nm Fl r
124and
125.Dq Nm Fl c
126were run in succession.
127.It Fl cm
128Create a jail if it does not exist, or modify the jail if it does exist.
129.It Fl mr
130Modify an existing jail.
131The jail may be restarted if necessary to modify parameters than could
132not otherwise be changed.
133.It Fl cmr
134Create a jail if it doesn't exist, or modify (and possibly restart) the
135jail if it does exist.
136.El
137.Pp
138Other available options are:
139.Bl -tag -width indent
140.It Fl d
141Allow making changes to a dying jail, equivalent to the
142.Va allow.dying
143parameter.
144.It Fl f Ar conf_file
145Use configuration file
146.Ar conf_file
147instead of the default
148.Pa /etc/jail.conf .
149.It Fl h
150Resolve the
151.Va host.hostname
152parameter (or
153.Va hostname )
154and add all IP addresses returned by the resolver
155to the list of addresses for this jail.
156This is equivalent to the
157.Va ip_hostname
158parameter.
159.It Fl i
160Output (only) the jail identifier of the newly created jail(s).
161This implies the
162.Fl q
163option.
164.It Fl J Ar jid_file
165Write a
166.Ar jid_file
167file, containing the parameters used to start the jail.
168.It Fl l
169Run commands in a clean environment.
170This is deprecated and is equivalent to the exec.clean parameter.
171.It Fl n Ar jailname
172Set the jail's name.
173This is deprecated and is equivalent to the
174.Va name
175parameter.
176.It Fl p Ar limit
177Limit the number of commands from
178.Va  exec.*
179that can run simultaneously.
180.It Fl q
181Suppress the message printed whenever a jail is created, modified or removed.
182Only error messages will be printed.
183.It Fl R
184A variation of the
185.Fl r
186option that removes an existing jail without using the configuration file.
187No removal-related parameters for this jail will be used \(em the jail will
188simply be removed.
189.It Fl s Ar securelevel
190Set the
191.Va kern.securelevel
192MIB entry to the specified value inside the newly created jail.
193This is deprecated and is equivalent to the
194.Va securelevel
195parameter.
196.It Fl u Ar username
197The user name from host environment as whom jailed commands should run.
198This is deprecated and is equivalent to the
199.Va exec.jail_user
200and
201.Va exec.system_jail_user
202parameters.
203.It Fl U Ar username
204The user name from the jailed environment as whom jailed commands should run.
205This is deprecated and is equivalent to the
206.Va exec.jail_user
207parameter.
208.It Fl v
209Print a message on every operation, such as running commands and
210mounting filesystems.
211.El
212.Pp
213If no arguments are given after the options, the operation (except
214remove) will be performed on all jails specified in the
215.Xr jail.conf 5
216file.
217A single argument of a jail name will operate only on the specified jail.
218The
219.Fl r
220and
221.Fl R
222options can also remove running jails that aren't in the
223.Xr jail.conf 5
224file, specified by name or jid.
225.Pp
226An argument of
227.Dq *
228is a wildcard that will operate on all jails, regardless of whether
229they appear in
230.Xr jail.conf 5 ;
231this is the surest way for
232.Fl r
233to remove all jails.
234If hierarchical jails exist, a partial-matching wildcard definition may
235be specified.
236For example, an argument of
237.Dq foo.*
238would apply to jails with names like
239.Dq foo.bar
240and
241.Dq foo.bar.baz .
242.Pp
243A jail may be specified with parameters directly on the command line.
244In this case, the
245.Xr jail.conf 5
246file will not be used.
247For backward compatibility, the command line may also have four fixed
248parameters, without names:
249.Ar path ,
250.Ar hostname ,
251.Ar ip ,
252and
253.Ar command .
254This mode will always create a new jail, and the
255.Fl c
256and
257.Fl m
258options do not apply (and must not be present).
259.Ss Jail Parameters
260Parameters in the
261.Xr jail.conf 5
262file, or on the command line, are generally of the form
263.Dq name=value .
264Some parameters are boolean, and do not have a value but are set by the
265name alone with or without a
266.Dq no
267prefix, e.g.
268.Va persist
269or
270.Va nopersist .
271They can also be given the values
272.Dq true
273and
274.Dq false .
275Other parameters may have more than one value, specified as a
276comma-separated list or with
277.Dq +=
278in the configuration file (see
279.Xr jail.conf 5
280for details).
281.Pp
282The
283.Nm
284utility recognizes two classes of parameters.
285There are the true jail
286parameters that are passed to the kernel when the jail is created,
287which can be seen with
288.Xr jls 8 ,
289and can (usually) be changed with
290.Dq Nm Fl m .
291Then there are pseudo-parameters that are only used by
292.Nm
293itself.
294.Pp
295Jails have a set of core parameters, and kernel modules can add their own
296jail parameters.
297The current set of available parameters can be retrieved via
298.Dq Nm sysctl Fl d Va security.jail.param .
299Any parameters not set will be given default values, often based on the
300current environment.
301The core parameters are:
302.Bl -tag -width indent
303.It Va jid
304The jail identifier.
305This will be assigned automatically to a new jail (or can be explicitly
306set), and can be used to identify the jail for later modification, or
307for such commands as
308.Xr jls 8
309or
310.Xr jexec 8 .
311.It Va name
312The jail name.
313This is an arbitrary string that identifies a jail (except it may not
314contain a
315.Sq \&. ) .
316Like the
317.Va jid ,
318it can be passed to later
319.Nm
320commands, or to
321.Xr jls 8
322or
323.Xr jexec 8 .
324If no
325.Va name
326is supplied, a default is assumed that is the same as the
327.Va jid .
328The
329.Va name
330parameter is implied by the
331.Xr jail.conf 5
332file format, and need not be explicitly set when using the configuration
333file.
334.It Va path
335The directory which is to be the root of the jail.
336Any commands run inside the jail, either by
337.Nm
338or from
339.Xr jexec 8 ,
340are run from this directory.
341.It Va ip4.addr
342A list of IPv4 addresses assigned to the jail.
343If this is set, the jail is restricted to using only these addresses.
344Any attempts to use other addresses fail, and attempts to use wildcard
345addresses silently use the jailed address instead.
346For IPv4 the first address given will be used as the source address
347when source address selection on unbound sockets cannot find a better
348match.
349It is only possible to start multiple jails with the same IP address
350if none of the jails has more than this single overlapping IP address
351assigned to itself.
352.It Va ip4.saddrsel
353A boolean option to change the formerly mentioned behaviour and disable
354IPv4 source address selection for the jail in favour of the primary
355IPv4 address of the jail.
356Source address selection is enabled by default for all jails and the
357.Va ip4.nosaddrsel
358setting of a parent jail is not inherited for any child jails.
359.It Va ip4
360Control the availability of IPv4 addresses.
361Possible values are
362.Dq inherit
363to allow unrestricted access to all system addresses,
364.Dq new
365to restrict addresses via
366.Va ip4.addr ,
367and
368.Dq disable
369to stop the jail from using IPv4 entirely.
370Setting the
371.Va ip4.addr
372parameter implies a value of
373.Dq new .
374.It Va ip6.addr , Va ip6.saddrsel , Va ip6
375A set of IPv6 options for the jail, the counterparts to
376.Va ip4.addr ,
377.Va ip4.saddrsel
378and
379.Va ip4
380above.
381.It Va vnet
382Create the jail with its own virtual network stack,
383with its own network interfaces, addresses, routing table, etc.
384The kernel must have been compiled with the
385.Sy VIMAGE option
386for this to be available.
387Possible values are
388.Dq inherit
389to use the system network stack, possibly with restricted IP addresses,
390and
391.Dq new
392to create a new network stack.
393.It Va host.hostname
394The hostname of the jail.
395Other similar parameters are
396.Va host.domainname ,
397.Va host.hostuuid
398and
399.Va host.hostid .
400.It Va host
401Set the origin of hostname and related information.
402Possible values are
403.Dq inherit
404to use the system information and
405.Dq new
406for the jail to use the information from the above fields.
407Setting any of the above fields implies a value of
408.Dq new .
409.It Va securelevel
410The value of the jail's
411.Va kern.securelevel
412sysctl.
413A jail never has a lower securelevel than its parent system, but by
414setting this parameter it may have a higher one.
415If the system securelevel is changed, any jail securelevels will be at
416least as secure.
417.It Va devfs_ruleset
418The number of the devfs ruleset that is enforced for mounting devfs in
419this jail.
420A value of zero (default) means no ruleset is enforced.
421Descendant jails inherit the parent jail's devfs ruleset enforcement.
422Mounting devfs inside a jail is possible only if the
423.Va allow.mount
424and
425.Va allow.mount.devfs
426permissions are effective and
427.Va enforce_statfs
428is set to a value lower than 2.
429Devfs rules and rulesets cannot be viewed or modified from inside a jail.
430.Pp
431NOTE: It is important that only appropriate device nodes in devfs be
432exposed to a jail; access to disk devices in the jail may permit processes
433in the jail to bypass the jail sandboxing by modifying files outside of
434the jail.
435See
436.Xr devfs 8
437for information on how to use devfs rules to limit access to entries
438in the per-jail devfs.
439A simple devfs ruleset for jails is available as ruleset #4 in
440.Pa /etc/defaults/devfs.rules .
441.It Va children.max
442The number of child jails allowed to be created by this jail (or by
443other jails under this jail).
444This limit is zero by default, indicating the jail is not allowed to
445create child jails.
446See the
447.Sx "Hierarchical Jails"
448section for more information.
449.It Va children.cur
450The number of descendants of this jail, including its own child jails
451and any jails created under them.
452.It Va enforce_statfs
453This determines what information processes in a jail are able to get
454about mount points.
455It affects the behaviour of the following syscalls:
456.Xr statfs 2 ,
457.Xr fstatfs 2 ,
458.Xr getfsstat 2 ,
459and
460.Xr fhstatfs 2
461(as well as similar compatibility syscalls).
462When set to 0, all mount points are available without any restrictions.
463When set to 1, only mount points below the jail's chroot directory are
464visible.
465In addition to that, the path to the jail's chroot directory is removed
466from the front of their pathnames.
467When set to 2 (default), above syscalls can operate only on a mount-point
468where the jail's chroot directory is located.
469.It Va persist
470Setting this boolean parameter allows a jail to exist without any
471processes.
472Normally, a command is run as part of jail creation, and then the jail
473is destroyed as its last process exits.
474A new jail must have either the
475.Va persist
476parameter or
477.Va exec.start
478or
479.Va command
480pseudo-parameter set.
481.It Va cpuset.id
482The ID of the cpuset associated with this jail (read-only).
483.It Va dying
484This is true if the jail is in the process of shutting down (read-only).
485.It Va parent
486The
487.Va jid
488of the parent of this jail, or zero if this is a top-level jail
489(read-only).
490.It Va osrelease
491The string for the jail's
492.Va kern.osrelease
493sysctl and uname -r.
494.It Va osreldate
495The number for the jail's
496.Va kern.osreldate
497and uname -K.
498.It Va allow.*
499Some restrictions of the jail environment may be set on a per-jail
500basis.
501With the exception of
502.Va allow.set_hostname
503and
504.Va allow.reserved_ports ,
505these boolean parameters are off by default.
506.Bl -tag -width indent
507.It Va allow.set_hostname
508The jail's hostname may be changed via
509.Xr hostname 1
510or
511.Xr sethostname 3 .
512.It Va allow.sysvipc
513A process within the jail has access to System V IPC primitives.
514This is deprecated in favor of the per-module parameters (see below).
515When this parameter is set, it is equivalent to setting
516.Va sysvmsg ,
517.Va sysvsem ,
518and
519.Va sysvshm
520all to
521.Dq inherit .
522.It Va allow.raw_sockets
523The jail root is allowed to create raw sockets.
524Setting this parameter allows utilities like
525.Xr ping 8
526and
527.Xr traceroute 8
528to operate inside the jail.
529If this is set, the source IP addresses are enforced to comply
530with the IP address bound to the jail, regardless of whether or not
531the
532.Dv IP_HDRINCL
533flag has been set on the socket.
534Since raw sockets can be used to configure and interact with various
535network subsystems, extra caution should be used where privileged access
536to jails is given out to untrusted parties.
537.It Va allow.chflags
538Normally, privileged users inside a jail are treated as unprivileged by
539.Xr chflags 2 .
540When this parameter is set, such users are treated as privileged, and
541may manipulate system file flags subject to the usual constraints on
542.Va kern.securelevel .
543.It Va allow.mount
544privileged users inside the jail will be able to mount and unmount file
545system types marked as jail-friendly.
546The
547.Xr lsvfs 1
548command can be used to find file system types available for mount from
549within a jail.
550This permission is effective only if
551.Va enforce_statfs
552is set to a value lower than 2.
553.It Va allow.mount.devfs
554privileged users inside the jail will be able to mount and unmount the
555devfs file system.
556This permission is effective only together with
557.Va allow.mount
558and only when
559.Va enforce_statfs
560is set to a value lower than 2.
561The devfs ruleset should be restricted from the default by using the
562.Va devfs_ruleset
563option.
564.It Va allow.quotas
565The jail root may administer quotas on the jail's filesystem(s).
566This includes filesystems that the jail may share with other jails or
567with non-jailed parts of the system.
568.It Va allow.read_msgbuf
569Jailed users may read the kernel message buffer.
570If the
571.Va security.bsd.unprivileged_read_msgbuf
572MIB entry is zero, this will be restricted to the root user.
573.It Va allow.socket_af
574Sockets within a jail are normally restricted to IPv4, IPv6, local
575(UNIX), and route.  This allows access to other protocol stacks that
576have not had jail functionality added to them.
577.It Va allow.mlock
578Locking or unlocking physical pages in memory are normally not available
579within a jail.
580When this parameter is set, users may
581.Xr mlock 2
582or
583.Xr munlock 2
584memory subject to
585.Va security.bsd.unprivileged_mlock
586and resource limits.
587.It Va allow.nfsd
588The
589.Xr mountd 8 ,
590.Xr nfsd 8 ,
591.Xr nfsuserd 8 ,
592.Xr gssd 8
593and
594.Xr rpc.tlsservd 8
595daemons are permitted to run inside a properly configured vnet-enabled jail.
596The jail's root must be a file system mount point and
597.Va enforce_statfs
598must not be set to 0, so that
599.Xr mountd 8
600can export file systems visible within the jail.
601.Va enforce_statfs
602must be set to 1 if file systems mounted under the
603jail's file system need to be exported by
604.Xr mount 8 .
605For exporting only the jail's file system, a setting of 2
606is sufficient.
607If the kernel configuration does not include the
608.Sy NFSD
609option,
610.Pa nfsd.ko
611must be loaded outside of the jails.
612This is normally done by adding
613.Dq nfsd
614to
615.Va kld_list
616in the
617.Xr rc.conf 5
618file outside of the jails.
619Similarily, if the
620.Xr gssd 8
621is to be run in a jail, either the kernel
622.Sy KGSSAPI
623option needs to be specified or
624.Dq kgssapi
625and
626.Dq kgssapi_krb5
627need to be in
628.Va kld_list
629in the
630.Xr rc.conf 5
631file outside of the jails.
632.It Va allow.reserved_ports
633The jail root may bind to ports lower than 1024.
634.It Va allow.unprivileged_proc_debug
635Unprivileged processes in the jail may use debugging facilities.
636.It Va allow.suser
637The value of the jail's
638.Va security.bsd.suser_enabled
639sysctl.
640The super-user will be disabled automatically if its parent system has it
641disabled.
642The super-user is enabled by default.
643.El
644.El
645.Pp
646Kernel modules may add their own parameters, which only exist when the
647module is loaded.
648These are typically headed under a parameter named after the module,
649with values of
650.Dq inherit
651to give the jail full use of the module,
652.Dq new
653to encapsulate the jail in some module-specific way,
654and
655.Dq disable
656to make the module unavailable to the jail.
657There also may be other parameters to define jail behavior within the module.
658Module-specific parameters include:
659.Bl -tag -width indent
660.It Va allow.mount.fdescfs
661privileged users inside the jail will be able to mount and unmount the
662fdescfs file system.
663This permission is effective only together with
664.Va allow.mount
665and only when
666.Va enforce_statfs
667is set to a value lower than 2.
668.It Va allow.mount.fusefs
669privileged users inside the jail will be able to mount and unmount
670fuse-based file systems.
671This permission is effective only together with
672.Va allow.mount
673and only when
674.Va enforce_statfs
675is set to a value lower than 2.
676.It Va allow.mount.nullfs
677privileged users inside the jail will be able to mount and unmount the
678nullfs file system.
679This permission is effective only together with
680.Va allow.mount
681and only when
682.Va enforce_statfs
683is set to a value lower than 2.
684.It Va allow.mount.procfs
685privileged users inside the jail will be able to mount and unmount the
686procfs file system.
687This permission is effective only together with
688.Va allow.mount
689and only when
690.Va enforce_statfs
691is set to a value lower than 2.
692.It Va allow.mount.linprocfs
693privileged users inside the jail will be able to mount and unmount the
694linprocfs file system.
695This permission is effective only together with
696.Va allow.mount
697and only when
698.Va enforce_statfs
699is set to a value lower than 2.
700.It Va allow.mount.linsysfs
701privileged users inside the jail will be able to mount and unmount the
702linsysfs file system.
703This permission is effective only together with
704.Va allow.mount
705and only when
706.Va enforce_statfs
707is set to a value lower than 2.
708.It Va allow.mount.tmpfs
709privileged users inside the jail will be able to mount and unmount the
710tmpfs file system.
711This permission is effective only together with
712.Va allow.mount
713and only when
714.Va enforce_statfs
715is set to a value lower than 2.
716.It Va allow.mount.zfs
717privileged users inside the jail will be able to mount and unmount the
718ZFS file system.
719This permission is effective only together with
720.Va allow.mount
721and only when
722.Va enforce_statfs
723is set to a value lower than 2.
724See
725.Xr zfs 8
726for information on how to configure the ZFS filesystem to operate from
727within a jail.
728.It Va allow.vmm
729The jail may access
730.Xr vmm 4 .
731This flag is only available when the
732.Xr vmm 4
733kernel module is loaded.
734.It Va linux
735Determine how a jail's Linux emulation environment appears.
736A value of
737.Dq inherit
738will keep the same environment, and
739.Dq new
740will give the jail its own environment (still originally inherited when
741the jail is created).
742.It Va linux.osname , linux.osrelease , linux.oss_version
743The Linux OS name, OS release, and OSS version associated with this jail.
744.It Va sysvmsg
745Allow access to SYSV IPC message primitives.
746If set to
747.Dq inherit ,
748all IPC objects on the system are visible to this jail, whether they
749were created by the jail itself, the base system, or other jails.
750If set to
751.Dq new ,
752the jail will have its own key namespace, and can only see the objects
753that it has created;
754the system (or parent jail) has access to the jail's objects, but not to
755its keys.
756If set to
757.Dq disable ,
758the jail cannot perform any sysvmsg-related system calls.
759.It Va sysvsem, sysvshm
760Allow access to SYSV IPC semaphore and shared memory primitives, in the
761same manner as
762.Va sysvmsg.
763.El
764.Pp
765There are pseudo-parameters that are not passed to the kernel, but are
766used by
767.Nm
768to set up the jail environment, often by running specified commands
769when jails are created or removed.
770The
771.Va exec.*
772command parameters are
773.Xr sh 1
774command lines that are run in either the system or jail environment.
775They may be given multiple values, which would run the specified
776commands in sequence.
777All commands must succeed (return a zero exit status), or the jail will
778not be created or removed, as appropriate.
779.Pp
780The pseudo-parameters are:
781.Bl -tag -width indent
782.It Va exec.prepare
783Command(s) to run in the system environment to prepare a jail for creation.
784These commands are executed before assigning IP addresses and mounting
785filesystems, so they may be used to create a new jail filesystem if it does
786not already exist.
787.It Va exec.prestart
788Command(s) to run in the system environment before a jail is created.
789.It Va exec.created
790Command(s) to run in the system environment right after a jail has been
791created, but before commands (or services) get executed in the jail.
792.It Va exec.start
793Command(s) to run in the jail environment when a jail is created.
794A typical command to run is
795.Dq sh /etc/rc .
796.It Va command
797A synonym for
798.Va exec.start
799for use when specifying a jail directly on the command line.
800Unlike other parameters whose value is a single string,
801.Va command
802uses the remainder of the
803.Nm
804command line as its own arguments.
805.It Va exec.poststart
806Command(s) to run in the system environment after a jail is created,
807and after any
808.Va exec.start
809commands have completed.
810.It Va exec.prestop
811Command(s) to run in the system environment before a jail is removed.
812.It Va exec.stop
813Command(s) to run in the jail environment before a jail is removed,
814and after any
815.Va exec.prestop
816commands have completed.
817A typical command to run is
818.Dq sh /etc/rc.shutdown jail .
819.It Va exec.poststop
820Command(s) to run in the system environment after a jail is removed.
821.It Va exec.release
822Command(s) to run in the system environment after all other actions are done.
823These commands are executed after unmounting filesystems and removing IP
824addresses, so they may be used to remove a jail filesystem if it is no longer
825needed.
826.It Va exec.clean
827Run commands in a clean environment.
828The environment is discarded except for
829.Ev HOME , SHELL , TERM
830and
831.Ev USER .
832.Ev HOME
833and
834.Ev SHELL
835are set to the target login's default values.
836.Ev USER
837is set to the target login.
838.Ev TERM
839is imported from the current environment.
840The environment variables from the login class capability database for the
841target login are also set.
842.It Va exec.jail_user
843The user to run commands as, when running in the jail environment.
844The default is to run the commands as the current user.
845.It Va exec.system_jail_user
846This boolean option looks for the
847.Va exec.jail_user
848in the system
849.Xr passwd 5
850file, instead of in the jail's file.
851.It Va exec.system_user
852The user to run commands as, when running in the system environment.
853The default is to run the commands as the current user.
854.It Va exec.timeout
855The maximum amount of time to wait for a command to complete, in
856seconds.
857If a command is still running after this timeout has passed,
858the jail will not be created or removed, as appropriate.
859.It Va exec.consolelog
860A file to direct command output (stdout and stderr) to.
861.It Va exec.fib
862The FIB (routing table) to set when running commands inside the jail.
863.It Va stop.timeout
864The maximum amount of time to wait for a jail's processes to exit
865after sending them a
866.Dv SIGTERM
867signal (which happens after the
868.Va exec.stop
869commands have completed).
870After this many seconds have passed, the jail will be removed, which
871will kill any remaining processes.
872If this is set to zero, no
873.Dv SIGTERM
874is sent and the jail is immediately removed.
875The default is 10 seconds.
876.It Va interface
877A network interface to add the jail's IP addresses
878.Va ( ip4.addr
879and
880.Va ip6.addr )
881to.
882An alias for each address will be added to the interface before the
883jail is created, and will be removed from the interface after the
884jail is removed.
885.It Va ip4.addr
886In addition to the IP addresses that are passed to the kernel, an
887interface, netmask and additional parameters (as supported by
888.Xr ifconfig 8 Ns )
889may also be specified, in the form
890.Dq Ar interface Ns | Ns Ar ip-address Ns / Ns Ar netmask param ... .
891If an interface is given before the IP address, an alias for the address
892will be added to that interface, as it is with the
893.Va interface
894parameter.
895If a netmask in either dotted-quad or CIDR form is given
896after an IP address, it will be used when adding the IP alias.
897If additional parameters are specified then they will also be used when
898adding the IP alias.
899.It Va ip6.addr
900In addition to the IP addresses that are passed to the kernel,
901an interface, prefix and additional parameters (as supported by
902.Xr ifconfig 8 Ns )
903may also be specified, in the form
904.Dq Ar interface Ns | Ns Ar ip-address Ns / Ns Ar prefix param ... .
905.It Va vnet.interface
906A network interface to give to a vnet-enabled jail after is it created.
907The interface will automatically be released when the jail is removed.
908.It Va ip_hostname
909Resolve the
910.Va host.hostname
911parameter and add all IP addresses returned by the resolver
912to the list of addresses
913.Po Va ip4.addr
914or
915.Va ip6.addr Pc
916for this jail.
917This may affect default address selection for outgoing IPv4 connections
918from jails.
919The address first returned by the resolver for each address family
920will be used as the primary address.
921.It Va mount
922A filesystem to mount before creating the jail (and to unmount after
923removing it), given as a single
924.Xr fstab 5
925line.
926.It Va mount.fstab
927An
928.Xr fstab 5
929format file containing filesystems to mount before creating a jail.
930.It Va mount.devfs
931Mount a
932.Xr devfs 5
933filesystem on the chrooted
934.Pa /dev
935directory, and apply the ruleset in the
936.Va devfs_ruleset
937parameter (or a default of ruleset 4: devfsrules_jail)
938to restrict the devices visible inside the jail.
939.It Va mount.fdescfs
940Mount a
941.Xr fdescfs 5
942filesystem on the chrooted
943.Pa /dev/fd
944directory.
945.It Va mount.procfs
946Mount a
947.Xr procfs 5
948filesystem on the chrooted
949.Pa /proc
950directory.
951.It Va allow.dying
952Allow making changes to a
953.Va dying
954jail.
955.It Va depend
956Specify a jail (or jails) that this jail depends on.
957When this jail is to be created, any jail(s) it depends on must already exist.
958If not, they will be created automatically, up to the completion of the last
959.Va exec.poststart
960command, before any action will taken to create this jail.
961When jails are removed the opposite is true:
962this jail will be removed, up to the last
963.Va exec.poststop
964command, before any jail(s) it depends on are stopped.
965.El
966.Sh EXAMPLES
967Jails are typically set up using one of two philosophies: either to
968constrain a specific application (possibly running with privilege), or
969to create a
970.Dq "virtual system image"
971running a variety of daemons and services.
972In both cases, a fairly complete file system install of
973.Fx
974is
975required, so as to provide the necessary command line tools, daemons,
976libraries, application configuration files, etc.
977However, for a virtual server configuration, a fair amount of
978additional work is required so as to replace the
979.Dq boot
980process.
981This manual page documents the configuration steps necessary to support
982either of these steps, although the configuration steps may need to be
983refined based on local requirements.
984.Ss "Setting up a Jail Directory Tree"
985To set up a jail directory tree containing an entire
986.Fx
987distribution, the following
988.Xr sh 1
989command script can be used:
990.Bd -literal -offset indent
991D=/here/is/the/jail
992cd /usr/src
993mkdir -p $D
994make world DESTDIR=$D
995make distribution DESTDIR=$D
996.Ed
997.Pp
998In many cases this example would put far more in the jail than needed.
999In the other extreme case a jail might contain only one file:
1000the executable to be run in the jail.
1001.Pp
1002We recommend experimentation, and caution that it is a lot easier to
1003start with a
1004.Dq fat
1005jail and remove things until it stops working,
1006than it is to start with a
1007.Dq thin
1008jail and add things until it works.
1009.Ss "Setting Up a Jail"
1010Do what was described in
1011.Sx "Setting Up a Jail Directory Tree"
1012to build the jail directory tree.
1013For the sake of this example, we will
1014assume you built it in
1015.Pa /data/jail/testjail ,
1016for a jail named
1017.Dq testjail .
1018Substitute below as needed with your
1019own directory, IP address, and hostname.
1020.Ss "Setting up the Host Environment"
1021First, set up the real system's environment to be
1022.Dq jail-friendly .
1023For consistency, we will refer to the parent box as the
1024.Dq "host environment" ,
1025and to the jailed virtual machine as the
1026.Dq "jail environment" .
1027Since jails are implemented using IP aliases, one of the first things to do
1028is to disable IP services on the host system that listen on all local
1029IP addresses for a service.
1030If a network service is present in the host environment that binds all
1031available IP addresses rather than specific IP addresses, it may service
1032requests sent to jail IP addresses if the jail did not bind the port.
1033This means changing
1034.Xr inetd 8
1035to only listen on the
1036appropriate IP address, and so forth.
1037Add the following to
1038.Pa /etc/rc.conf
1039in the host environment:
1040.Bd -literal -offset indent
1041sendmail_enable="NO"
1042inetd_flags="-wW -a 192.0.2.23"
1043rpcbind_enable="NO"
1044.Ed
1045.Pp
1046.Li 192.0.2.23
1047is the native IP address for the host system, in this example.
1048Daemons that run out of
1049.Xr inetd 8
1050can be easily configured to use only the specified host IP address.
1051Other daemons
1052will need to be manually configured \(em for some this is possible through
1053.Xr rc.conf 5
1054flags entries; for others it is necessary to modify per-application
1055configuration files, or to recompile the application.
1056The following frequently deployed services must have their individual
1057configuration files modified to limit the application to listening
1058to a specific IP address:
1059.Pp
1060To configure
1061.Xr sshd 8 ,
1062it is necessary to modify
1063.Pa /etc/ssh/sshd_config .
1064.Pp
1065To configure
1066.Xr sendmail 8 ,
1067it is necessary to modify
1068.Pa /etc/mail/sendmail.cf .
1069.Pp
1070In addition, a number of services must be recompiled in order to run
1071them in the host environment.
1072This includes most applications providing services using
1073.Xr rpc 3 ,
1074such as
1075.Xr rpcbind 8 ,
1076.Xr nfsd 8 ,
1077and
1078.Xr mountd 8 .
1079In general, applications for which it is not possible to specify which
1080IP address to bind should not be run in the host environment unless they
1081should also service requests sent to jail IP addresses.
1082Attempting to serve
1083NFS from the host environment may also cause confusion, and cannot be
1084easily reconfigured to use only specific IPs, as some NFS services are
1085hosted directly from the kernel.
1086Any third-party network software running
1087in the host environment should also be checked and configured so that it
1088does not bind all IP addresses, which would result in those services also
1089appearing to be offered by the jail environments.
1090.Pp
1091Once
1092these daemons have been disabled or fixed in the host environment, it is
1093best to reboot so that all daemons are in a known state, to reduce the
1094potential for confusion later (such as finding that when you send mail
1095to a jail, and its sendmail is down, the mail is delivered to the host,
1096etc.).
1097.Ss "Configuring the Jail"
1098Start any jail for the first time without configuring the network
1099interface so that you can clean it up a little and set up accounts.
1100As
1101with any machine (virtual or not), you will need to set a root password, time
1102zone, etc.
1103Some of these steps apply only if you intend to run a full virtual server
1104inside the jail; others apply both for constraining a particular application
1105or for running a virtual server.
1106.Pp
1107Start a shell in the jail:
1108.Bd -literal -offset indent
1109jail -c path=/data/jail/testjail mount.devfs \\
1110	host.hostname=testhostname ip4.addr=192.0.2.100 \\
1111	command=/bin/sh
1112.Ed
1113.Pp
1114Assuming no errors, you will end up with a shell prompt within the jail.
1115You can now run
1116.Xr bsdconfig 8
1117and do the post-install configuration to set various configuration options,
1118or perform these actions manually by editing
1119.Pa /etc/rc.conf ,
1120etc.
1121.Pp
1122.Bl -bullet -offset indent -compact
1123.It
1124Configure
1125.Pa /etc/resolv.conf
1126so that name resolution within the jail will work correctly.
1127.It
1128Run
1129.Xr newaliases 1
1130to quell
1131.Xr sendmail 8
1132warnings.
1133.It
1134Set a root password, probably different from the real host system.
1135.It
1136Set the timezone.
1137.It
1138Add accounts for users in the jail environment.
1139.It
1140Install any packages the environment requires.
1141.El
1142.Pp
1143You may also want to perform any package-specific configuration (web servers,
1144SSH servers, etc), patch up
1145.Pa /etc/syslog.conf
1146so it logs as you would like, etc.
1147If you are not using a virtual server, you may wish to modify
1148.Xr syslogd 8
1149in the host environment to listen on the syslog socket in the jail
1150environment; in this example, the syslog socket would be stored in
1151.Pa /data/jail/testjail/var/run/log .
1152.Pp
1153Exit from the shell, and the jail will be shut down.
1154.Ss "Starting the Jail"
1155You are now ready to restart the jail and bring up the environment with
1156all of its daemons and other programs.
1157Create an entry for the jail in
1158.Pa /etc/jail.conf :
1159.Bd -literal -offset indent
1160testjail {
1161	path = /tmp/jail/testjail;
1162	mount.devfs;
1163	host.hostname = testhostname;
1164	ip4.addr = 192.0.2.100;
1165	interface = em0;
1166	exec.start = "/bin/sh /etc/rc";
1167	exec.stop = "/bin/sh /etc/rc.shutdown jail";
1168}
1169.Ed
1170.Pp
1171To start a virtual server environment,
1172.Pa /etc/rc
1173is run to launch various daemons and services, and
1174.Pa /etc/rc.shutdown
1175is run to shut them down when the jail is removed.
1176If you are running a single application in the jail,
1177substitute the command used to start the application for
1178.Dq /bin/sh /etc/rc ;
1179there may be some script available to cleanly shut down the application,
1180or it may be sufficient to go without a stop command, and have
1181.Nm
1182send
1183.Dv SIGTERM
1184to the application.
1185.Pp
1186Start the jail by running:
1187.Bd -literal -offset indent
1188jail -c testjail
1189.Ed
1190.Pp
1191A few warnings may be produced; however, it should all work properly.
1192You should be able to see
1193.Xr inetd 8 ,
1194.Xr syslogd 8 ,
1195and other processes running within the jail using
1196.Xr ps 1 ,
1197with the
1198.Ql J
1199flag appearing beside jailed processes.
1200To see an active list of jails, use
1201.Xr jls 8 .
1202If
1203.Xr sshd 8
1204is enabled in the jail environment, you should be able to
1205.Xr ssh 1
1206to the hostname or IP address of the jailed environment, and log
1207in using the accounts you created previously.
1208.Pp
1209It is possible to have jails started at boot time.
1210Please refer to the
1211.Dq jail_*
1212variables in
1213.Xr rc.conf 5
1214for more information.
1215.Ss "Managing the Jail"
1216Normal machine shutdown commands, such as
1217.Xr halt 8 ,
1218.Xr reboot 8 ,
1219and
1220.Xr shutdown 8 ,
1221cannot be used successfully within the jail.
1222To kill all processes from within a jail, you may use one of the
1223following commands, depending on what you want to accomplish:
1224.Bd -literal -offset indent
1225kill -TERM -1
1226kill -KILL -1
1227.Ed
1228.Pp
1229This will send the
1230.Dv SIGTERM
1231or
1232.Dv SIGKILL
1233signals to all processes in the jail \(em be careful not to run this from
1234the host environment!
1235Once all of the jail's processes have died, unless the jail was created
1236with the
1237.Va persist
1238parameter, the jail will be removed.
1239Depending on
1240the intended use of the jail, you may also want to run
1241.Pa /etc/rc.shutdown
1242from within the jail.
1243.Pp
1244To shut down the jail from the outside, simply remove it with:
1245.Bd -literal -offset indent
1246jail -r
1247.Ed
1248.Pp
1249which will run any commands specified by
1250.Va exec.stop ,
1251and then send
1252.Dv SIGTERM
1253and eventually
1254.Dv SIGKILL
1255to any remaining jailed processes.
1256.Pp
1257The
1258.Pa /proc/ Ns Ar pid Ns Pa /status
1259file contains, as its last field, the name of the jail in which the
1260process runs, or
1261.Dq Li -
1262to indicate that the process is not running within a jail.
1263The
1264.Xr ps 1
1265command also shows a
1266.Ql J
1267flag for processes in a jail.
1268.Pp
1269You can also list/kill processes based on their jail ID.
1270To show processes and their jail ID, use the following command:
1271.Pp
1272.Dl "ps ax -o pid,jid,args"
1273.Pp
1274To show and then kill processes in jail number 3 use the following commands:
1275.Bd -literal -offset indent
1276pgrep -lfj 3
1277pkill -j 3
1278.Ed
1279or:
1280.Pp
1281.Dl "killall -j 3"
1282.Ss "Jails and File Systems"
1283It is not possible to
1284.Xr mount 8
1285or
1286.Xr umount 8
1287any file system inside a jail unless the file system is marked
1288jail-friendly, the jail's
1289.Va allow.mount
1290parameter is set, and the jail's
1291.Va enforce_statfs
1292parameter is lower than 2.
1293.Pp
1294Multiple jails sharing the same file system can influence each other.
1295For example, a user in one jail can fill the file system,
1296leaving no space for processes in the other jail.
1297Trying to use
1298.Xr quota 1
1299to prevent this will not work either, as the file system quotas
1300are not aware of jails but only look at the user and group IDs.
1301This means the same user ID in two jails share a single file
1302system quota.
1303One would need to use one file system per jail to make this work.
1304.Ss "Sysctl MIB Entries"
1305The read-only entry
1306.Va security.jail.jailed
1307can be used to determine if a process is running inside a jail (value
1308is one) or not (value is zero).
1309.Pp
1310The variable
1311.Va security.jail.jail_max_af_ips
1312determines how may address per address family a jail may have.
1313The default is 255.
1314.Pp
1315Some MIB variables have per-jail settings.
1316Changes to these variables by a jailed process do not affect the host
1317environment, only the jail environment.
1318These variables are
1319.Va kern.securelevel ,
1320.Va security.bsd.suser_enabled ,
1321.Va kern.hostname ,
1322.Va kern.domainname ,
1323.Va kern.hostid ,
1324and
1325.Va kern.hostuuid .
1326.Ss "Hierarchical Jails"
1327By setting a jail's
1328.Va children.max
1329parameter, processes within a jail may be able to create jails of their own.
1330These child jails are kept in a hierarchy, with jails only able to see and/or
1331modify the jails they created (or those jails' children).
1332Each jail has a read-only
1333.Va parent
1334parameter, containing the
1335.Va jid
1336of the jail that created it; a
1337.Va jid
1338of 0 indicates the jail is a child of the current jail (or is a top-level
1339jail if the current process isn't jailed).
1340.Pp
1341Jailed processes are not allowed to confer greater permissions than they
1342themselves are given, e.g., if a jail is created with
1343.Va allow.nomount ,
1344it is not able to create a jail with
1345.Va allow.mount
1346set.
1347Similarly, such restrictions as
1348.Va ip4.addr
1349and
1350.Va securelevel
1351may not be bypassed in child jails.
1352.Pp
1353A child jail may in turn create its own child jails if its own
1354.Va children.max
1355parameter is set (remember it is zero by default).
1356These jails are visible to and can be modified by their parent and all
1357ancestors.
1358.Pp
1359Jail names reflect this hierarchy, with a full name being an MIB-type string
1360separated by dots.
1361For example, if a base system process creates a jail
1362.Dq foo ,
1363and a process under that jail creates another jail
1364.Dq bar ,
1365then the second jail will be seen as
1366.Dq foo.bar
1367in the base system (though it is only seen as
1368.Dq bar
1369to any processes inside jail
1370.Dq foo ) .
1371Jids on the other hand exist in a single space, and each jail must have a
1372unique jid.
1373.Pp
1374Like the names, a child jail's
1375.Va path
1376appears relative to its creator's own
1377.Va path .
1378This is by virtue of the child jail being created in the chrooted
1379environment of the first jail.
1380.Sh SEE ALSO
1381.Xr killall 1 ,
1382.Xr lsvfs 1 ,
1383.Xr newaliases 1 ,
1384.Xr pgrep 1 ,
1385.Xr pkill 1 ,
1386.Xr ps 1 ,
1387.Xr quota 1 ,
1388.Xr jail_set 2 ,
1389.Xr vmm 4 ,
1390.Xr devfs 5 ,
1391.Xr fdescfs 5 ,
1392.Xr jail.conf 5 ,
1393.Xr linprocfs 5 ,
1394.Xr linsysfs 5 ,
1395.Xr procfs 5 ,
1396.Xr rc.conf 5 ,
1397.Xr sysctl.conf 5 ,
1398.Xr bsdconfig 8 ,
1399.Xr chroot 8 ,
1400.Xr devfs 8 ,
1401.Xr halt 8 ,
1402.Xr ifconfig 8 ,
1403.Xr inetd 8 ,
1404.Xr jexec 8 ,
1405.Xr jls 8 ,
1406.Xr mount 8 ,
1407.Xr mountd 8 ,
1408.Xr nfsd 8 ,
1409.Xr reboot 8 ,
1410.Xr rpcbind 8 ,
1411.Xr sendmail 8 ,
1412.Xr shutdown 8 ,
1413.Xr sysctl 8 ,
1414.Xr syslogd 8 ,
1415.Xr umount 8
1416.Sh HISTORY
1417The
1418.Nm
1419utility appeared in
1420.Fx 4.0 .
1421Hierarchical/extensible jails were introduced in
1422.Fx 8.0 .
1423The configuration file was introduced in
1424.Fx 9.1 .
1425.Sh AUTHORS
1426.An -nosplit
1427The jail feature was written by
1428.An Poul-Henning Kamp
1429for R&D Associates
1430who contributed it to
1431.Fx .
1432.Pp
1433.An Robert Watson
1434wrote the extended documentation, found a few bugs, added
1435a few new features, and cleaned up the userland jail environment.
1436.Pp
1437.An Bjoern A. Zeeb
1438added multi-IP jail support for IPv4 and IPv6 based on a patch
1439originally done by
1440.An Pawel Jakub Dawidek
1441for IPv4.
1442.Pp
1443.An James Gritton
1444added the extensible jail parameters, hierarchical jails,
1445and the configuration file.
1446.Sh BUGS
1447It might be a good idea to add an
1448address alias flag such that daemons listening on all IPs
1449.Pq Dv INADDR_ANY
1450will not bind on that address, which would facilitate building a safe
1451host environment such that host daemons do not impose on services offered
1452from within jails.
1453Currently, the simplest answer is to minimize services
1454offered on the host, possibly limiting it to services offered from
1455.Xr inetd 8
1456which is easily configurable.
1457.Sh NOTES
1458Great care should be taken when managing directories visible within the jail.
1459For example, if a jailed process has its current working directory set to a
1460directory that is moved out of the jail's chroot, then the process may gain
1461access to the file space outside of the jail.
1462It is recommended that directories always be copied, rather than moved, out
1463of a jail.
1464.Pp
1465In addition, there are several ways in which an unprivileged user
1466outside the jail can cooperate with a privileged user inside the jail
1467and thereby obtain elevated privileges in the host environment.
1468Most of these attacks can be mitigated by ensuring that the jail root
1469is not accessible to unprivileged users in the host environment.
1470Regardless, as a general rule, untrusted users with privileged access
1471to a jail should not be given access to the host environment.
1472