xref: /freebsd/usr.sbin/jail/jail.8 (revision edf8578117e8844e02c0121147f45e4609b30680)
1.\" Copyright (c) 2000, 2003 Robert N. M. Watson
2.\" Copyright (c) 2008-2012 James Gritton
3.\" All rights reserved.
4.\"
5.\" Redistribution and use in source and binary forms, with or without
6.\" modification, are permitted provided that the following conditions
7.\" are met:
8.\" 1. Redistributions of source code must retain the above copyright
9.\"    notice, this list of conditions and the following disclaimer.
10.\" 2. Redistributions in binary form must reproduce the above copyright
11.\"    notice, this list of conditions and the following disclaimer in the
12.\"    documentation and/or other materials provided with the distribution.
13.\"
14.\" THIS SOFTWARE IS PROVIDED BY THE AUTHOR AND CONTRIBUTORS ``AS IS'' AND
15.\" ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
16.\" IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE
17.\" ARE DISCLAIMED.  IN NO EVENT SHALL THE AUTHOR OR CONTRIBUTORS BE LIABLE
18.\" FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL
19.\" DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS
20.\" OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION)
21.\" HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT
22.\" LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY
23.\" OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF
24.\" SUCH DAMAGE.
25.\"
26.Dd September 1, 2023
27.Dt JAIL 8
28.Os
29.Sh NAME
30.Nm jail
31.Nd "manage system jails"
32.Sh SYNOPSIS
33.Ss From Configuration File
34.Nm
35.Op Fl cm
36.Op Fl dqv
37.Op Fl f Ar conf_file
38.Op Fl p Ar limit
39.Op Ar jail
40.Nm
41.Op Fl r
42.Op Fl qv
43.Op Fl f Ar conf_file
44.Op Fl p Ar limit
45.Op Cm * | Ar jail ...
46.Ss Without Configuration File
47.Nm
48.Op Fl cm
49.Op Fl dhilqv
50.Op Fl J Ar jid_file
51.Op Fl u Ar username
52.Op Fl U Ar username
53.Ar param Ns = Ns Ar value ...
54.Op Cm command Ns = Ns Ar command ...
55.Nm
56.Op Fl rR
57.Op Fl qv
58.Op Cm * | Ar jail ...
59.Ss Show Parameters
60.Nm
61.Op Fl f Ar conf_file
62.Fl e
63.Ar separator
64.Ss Backward Compatibility
65.Nm
66.Op Fl dhilqv
67.Op Fl J Ar jid_file
68.Op Fl u Ar username
69.Op Fl U Ar username
70.Op Fl n Ar jailname
71.Op Fl s Ar securelevel
72.Ar path hostname ip Ns Op Cm \&, Ns Ar ...
73.Ar command ...
74.Sh DESCRIPTION
75The
76.Nm
77utility creates new jails, or modifies or removes existing jails.
78It can also print a list of configured jails and their parameters.
79A jail
80.Pq or Dq prison
81is specified via parameters on the command line, or in the
82.Xr jail.conf 5
83file.
84.Pp
85At least one of the options
86.Fl c ,
87.Fl e ,
88.Fl m
89or
90.Fl r
91must be specified.
92These options are used alone or in combination to describe the operation to
93perform:
94.Bl -tag -width indent
95.It Fl c
96Create a new jail.
97The jail
98.Va jid
99and
100.Va name
101parameters (if specified on the command line)
102must not refer to an existing jail.
103.It Fl e Ar separator
104Exhibit a list of all configured non-wildcard jails and their parameters.
105No jail creation, modification or removal performed if this option is used.
106The
107.Ar separator
108string is used to separate parameters.
109Use
110.Xr jls 8
111utility to list running jails.
112.It Fl m
113Modify an existing jail.
114One of the
115.Va jid
116or
117.Va name
118parameters must exist and refer to an existing jail.
119Some parameters may not be changed on a running jail.
120.It Fl r
121Remove the
122.Ar jail
123specified by jid or name.
124All jailed processes are killed, and all jails that are
125children of this jail are also
126removed.
127.It Fl rc
128Restart an existing jail.
129The jail is first removed and then re-created, as if
130.Dq Nm Fl r
131and
132.Dq Nm Fl c
133were run in succession.
134.It Fl cm
135Create a jail if it does not exist, or modify the jail if it does exist.
136.It Fl mr
137Modify an existing jail.
138The jail may be restarted if necessary to modify parameters than could
139not otherwise be changed.
140.It Fl cmr
141Create a jail if it doesn't exist, or modify (and possibly restart) the
142jail if it does exist.
143.El
144.Pp
145Other available options are:
146.Bl -tag -width indent
147.It Fl d
148Allow making changes to a dying jail, equivalent to the
149.Va allow.dying
150parameter.
151.It Fl f Ar conf_file
152Use configuration file
153.Ar conf_file
154instead of the default
155.Pa /etc/jail.conf .
156.It Fl h
157Resolve the
158.Va host.hostname
159parameter (or
160.Va hostname )
161and add all IP addresses returned by the resolver
162to the list of addresses for this jail.
163This is equivalent to the
164.Va ip_hostname
165parameter.
166.It Fl i
167Output (only) the jail identifier of the newly created jail(s).
168This implies the
169.Fl q
170option.
171.It Fl J Ar jid_file
172Write a
173.Ar jid_file
174file, containing the parameters used to start the jail.
175.It Fl l
176Run commands in a clean environment.
177This is deprecated and is equivalent to the exec.clean parameter.
178.It Fl n Ar jailname
179Set the jail's name.
180This is deprecated and is equivalent to the
181.Va name
182parameter.
183.It Fl p Ar limit
184Limit the number of commands from
185.Va  exec.*
186that can run simultaneously.
187.It Fl q
188Suppress the message printed whenever a jail is created, modified or removed.
189Only error messages will be printed.
190.It Fl R
191A variation of the
192.Fl r
193option that removes an existing jail without using the configuration file.
194No removal-related parameters for this jail will be used \(em the jail will
195simply be removed.
196.It Fl s Ar securelevel
197Set the
198.Va kern.securelevel
199MIB entry to the specified value inside the newly created jail.
200This is deprecated and is equivalent to the
201.Va securelevel
202parameter.
203.It Fl u Ar username
204The user name from host environment as whom jailed commands should run.
205This is deprecated and is equivalent to the
206.Va exec.jail_user
207and
208.Va exec.system_jail_user
209parameters.
210.It Fl U Ar username
211The user name from the jailed environment as whom jailed commands should run.
212This is deprecated and is equivalent to the
213.Va exec.jail_user
214parameter.
215.It Fl v
216Print a message on every operation, such as running commands and
217mounting filesystems.
218.El
219.Pp
220If no arguments are given after the options, the operation (except
221remove) will be performed on all jails specified in the
222.Xr jail.conf 5
223file.
224A single argument of a jail name will operate only on the specified jail.
225The
226.Fl r
227and
228.Fl R
229options can also remove running jails that aren't in the
230.Xr jail.conf 5
231file, specified by name or jid.
232.Pp
233An argument of
234.Dq *
235is a wildcard that will operate on all jails, regardless of whether
236they appear in
237.Xr jail.conf 5 ;
238this is the surest way for
239.Fl r
240to remove all jails.
241If hierarchical jails exist, a partial-matching wildcard definition may
242be specified.
243For example, an argument of
244.Dq foo.*
245would apply to jails with names like
246.Dq foo.bar
247and
248.Dq foo.bar.baz .
249.Pp
250A jail may also be specified via parameters directly on the command line in
251.Dq name=value
252form, ignoring the contents of
253.Xr jail.conf 5 .
254For backward compatibility, the command line may also have four fixed
255parameters, without names:
256.Ar path ,
257.Ar hostname ,
258.Ar ip ,
259and
260.Ar command .
261.Ss Jail Parameters
262Parameters in the
263.Xr jail.conf 5
264file, or on the command line, are generally of the form
265.Dq name=value .
266Some parameters are boolean, and do not have a value but are set by the
267name alone with or without a
268.Dq no
269prefix, e.g.
270.Va persist
271or
272.Va nopersist .
273They can also be given the values
274.Dq true
275and
276.Dq false .
277Other parameters may have more than one value, specified as a
278comma-separated list or with
279.Dq +=
280in the configuration file (see
281.Xr jail.conf 5
282for details).
283.Pp
284The
285.Nm
286utility recognizes two classes of parameters.
287There are the true jail
288parameters that are passed to the kernel when the jail is created,
289which can be seen with
290.Xr jls 8 ,
291and can (usually) be changed with
292.Dq Nm Fl m .
293Then there are pseudo-parameters that are only used by
294.Nm
295itself.
296.Pp
297Jails have a set of core parameters, and kernel modules can add their own
298jail parameters.
299The current set of available parameters can be retrieved via
300.Dq Nm sysctl Fl d Va security.jail.param .
301Any parameters not set will be given default values, often based on the
302current environment.
303The core parameters are:
304.Bl -tag -width indent
305.It Va jid
306The jail identifier.
307This will be assigned automatically to a new jail (or can be explicitly
308set), and can be used to identify the jail for later modification, or
309for such commands as
310.Xr jls 8
311or
312.Xr jexec 8 .
313.It Va name
314The jail name.
315This is an arbitrary string that identifies a jail (except it may not
316contain a
317.Sq \&. ) .
318Like the
319.Va jid ,
320it can be passed to later
321.Nm
322commands, or to
323.Xr jls 8
324or
325.Xr jexec 8 .
326If no
327.Va name
328is supplied, a default is assumed that is the same as the
329.Va jid .
330The
331.Va name
332parameter is implied by the
333.Xr jail.conf 5
334file format, and need not be explicitly set when using the configuration
335file.
336.It Va path
337The directory which is to be the root of the jail.
338Any commands run inside the jail, either by
339.Nm
340or from
341.Xr jexec 8 ,
342are run from this directory.
343.It Va ip4.addr
344A list of IPv4 addresses assigned to the jail.
345If this is set, the jail is restricted to using only these addresses.
346Any attempts to use other addresses fail, and attempts to use wildcard
347addresses silently use the jailed address instead.
348For IPv4 the first address given will be used as the source address
349when source address selection on unbound sockets cannot find a better
350match.
351It is only possible to start multiple jails with the same IP address
352if none of the jails has more than this single overlapping IP address
353assigned to itself.
354.It Va ip4.saddrsel
355A boolean option to change the formerly mentioned behaviour and disable
356IPv4 source address selection for the jail in favour of the primary
357IPv4 address of the jail.
358Source address selection is enabled by default for all jails and the
359.Va ip4.nosaddrsel
360setting of a parent jail is not inherited for any child jails.
361.It Va ip4
362Control the availability of IPv4 addresses.
363Possible values are
364.Dq inherit
365to allow unrestricted access to all system addresses,
366.Dq new
367to restrict addresses via
368.Va ip4.addr ,
369and
370.Dq disable
371to stop the jail from using IPv4 entirely.
372Setting the
373.Va ip4.addr
374parameter implies a value of
375.Dq new .
376.It Va ip6.addr , Va ip6.saddrsel , Va ip6
377A set of IPv6 options for the jail, the counterparts to
378.Va ip4.addr ,
379.Va ip4.saddrsel
380and
381.Va ip4
382above.
383.It Va vnet
384Create the jail with its own virtual network stack,
385with its own network interfaces, addresses, routing table, etc.
386The kernel must have been compiled with the
387.Sy VIMAGE option
388for this to be available.
389Possible values are
390.Dq inherit
391to use the system network stack, possibly with restricted IP addresses,
392and
393.Dq new
394to create a new network stack.
395.It Va host.hostname
396The hostname of the jail.
397Other similar parameters are
398.Va host.domainname ,
399.Va host.hostuuid
400and
401.Va host.hostid .
402.It Va host
403Set the origin of hostname and related information.
404Possible values are
405.Dq inherit
406to use the system information and
407.Dq new
408for the jail to use the information from the above fields.
409Setting any of the above fields implies a value of
410.Dq new .
411.It Va securelevel
412The value of the jail's
413.Va kern.securelevel
414sysctl.
415A jail never has a lower securelevel than its parent system, but by
416setting this parameter it may have a higher one.
417If the system securelevel is changed, any jail securelevels will be at
418least as secure.
419.It Va devfs_ruleset
420The number of the devfs ruleset that is enforced for mounting devfs in
421this jail.
422A value of zero (default) means no ruleset is enforced.
423Descendant jails inherit the parent jail's devfs ruleset enforcement.
424Mounting devfs inside a jail is possible only if the
425.Va allow.mount
426and
427.Va allow.mount.devfs
428permissions are effective and
429.Va enforce_statfs
430is set to a value lower than 2.
431Devfs rules and rulesets cannot be viewed or modified from inside a jail.
432.Pp
433NOTE: It is important that only appropriate device nodes in devfs be
434exposed to a jail; access to disk devices in the jail may permit processes
435in the jail to bypass the jail sandboxing by modifying files outside of
436the jail.
437See
438.Xr devfs 8
439for information on how to use devfs rules to limit access to entries
440in the per-jail devfs.
441A simple devfs ruleset for jails is available as ruleset #4 in
442.Pa /etc/defaults/devfs.rules .
443.It Va children.max
444The number of child jails allowed to be created by this jail (or by
445other jails under this jail).
446This limit is zero by default, indicating the jail is not allowed to
447create child jails.
448See the
449.Sx "Hierarchical Jails"
450section for more information.
451.It Va children.cur
452The number of descendants of this jail, including its own child jails
453and any jails created under them.
454.It Va enforce_statfs
455This determines what information processes in a jail are able to get
456about mount points.
457It affects the behaviour of the following syscalls:
458.Xr statfs 2 ,
459.Xr fstatfs 2 ,
460.Xr getfsstat 2 ,
461and
462.Xr fhstatfs 2
463(as well as similar compatibility syscalls).
464When set to 0, all mount points are available without any restrictions.
465When set to 1, only mount points below the jail's chroot directory are
466visible.
467In addition to that, the path to the jail's chroot directory is removed
468from the front of their pathnames.
469When set to 2 (default), above syscalls can operate only on a mount-point
470where the jail's chroot directory is located.
471.It Va persist
472Setting this boolean parameter allows a jail to exist without any
473processes.
474Normally, a command is run as part of jail creation, and then the jail
475is destroyed as its last process exits.
476A new jail must have either the
477.Va persist
478parameter or
479.Va exec.start
480or
481.Va command
482pseudo-parameter set.
483.It Va cpuset.id
484The ID of the cpuset associated with this jail (read-only).
485.It Va dying
486This is true if the jail is in the process of shutting down (read-only).
487.It Va parent
488The
489.Va jid
490of the parent of this jail, or zero if this is a top-level jail
491(read-only).
492.It Va osrelease
493The string for the jail's
494.Va kern.osrelease
495sysctl and uname -r.
496.It Va osreldate
497The number for the jail's
498.Va kern.osreldate
499and uname -K.
500.It Va allow.*
501Some restrictions of the jail environment may be set on a per-jail
502basis.
503With the exception of
504.Va allow.set_hostname
505and
506.Va allow.reserved_ports ,
507these boolean parameters are off by default.
508.Bl -tag -width indent
509.It Va allow.set_hostname
510The jail's hostname may be changed via
511.Xr hostname 1
512or
513.Xr sethostname 3 .
514.It Va allow.sysvipc
515A process within the jail has access to System V IPC primitives.
516This is deprecated in favor of the per-module parameters (see below).
517When this parameter is set, it is equivalent to setting
518.Va sysvmsg ,
519.Va sysvsem ,
520and
521.Va sysvshm
522all to
523.Dq inherit .
524.It Va allow.raw_sockets
525The jail root is allowed to create raw sockets.
526Setting this parameter allows utilities like
527.Xr ping 8
528and
529.Xr traceroute 8
530to operate inside the jail.
531If this is set, the source IP addresses are enforced to comply
532with the IP address bound to the jail, regardless of whether or not
533the
534.Dv IP_HDRINCL
535flag has been set on the socket.
536Since raw sockets can be used to configure and interact with various
537network subsystems, extra caution should be used where privileged access
538to jails is given out to untrusted parties.
539.It Va allow.chflags
540Normally, privileged users inside a jail are treated as unprivileged by
541.Xr chflags 2 .
542When this parameter is set, such users are treated as privileged, and
543may manipulate system file flags subject to the usual constraints on
544.Va kern.securelevel .
545.It Va allow.mount
546privileged users inside the jail will be able to mount and unmount file
547system types marked as jail-friendly.
548The
549.Xr lsvfs 1
550command can be used to find file system types available for mount from
551within a jail.
552This permission is effective only if
553.Va enforce_statfs
554is set to a value lower than 2.
555.It Va allow.mount.devfs
556privileged users inside the jail will be able to mount and unmount the
557devfs file system.
558This permission is effective only together with
559.Va allow.mount
560and only when
561.Va enforce_statfs
562is set to a value lower than 2.
563The devfs ruleset should be restricted from the default by using the
564.Va devfs_ruleset
565option.
566.It Va allow.quotas
567The jail root may administer quotas on the jail's filesystem(s).
568This includes filesystems that the jail may share with other jails or
569with non-jailed parts of the system.
570.It Va allow.read_msgbuf
571Jailed users may read the kernel message buffer.
572If the
573.Va security.bsd.unprivileged_read_msgbuf
574MIB entry is zero, this will be restricted to the root user.
575.It Va allow.socket_af
576Sockets within a jail are normally restricted to IPv4, IPv6, local
577(UNIX), and route.
578This allows access to other protocol stacks that have not had jail
579functionality added to them.
580.It Va allow.mlock
581Locking or unlocking physical pages in memory are normally not available
582within a jail.
583When this parameter is set, users may
584.Xr mlock 2
585or
586.Xr munlock 2
587memory subject to
588.Va security.bsd.unprivileged_mlock
589and resource limits.
590.It Va allow.nfsd
591The
592.Xr mountd 8 ,
593.Xr nfsd 8 ,
594.Xr nfsuserd 8 ,
595.Xr gssd 8
596and
597.Xr rpc.tlsservd 8
598daemons are permitted to run inside a properly configured vnet-enabled jail.
599The jail's root must be a file system mount point and
600.Va enforce_statfs
601must not be set to 0, so that
602.Xr mountd 8
603can export file systems visible within the jail.
604.Va enforce_statfs
605must be set to 1 if file systems mounted under the
606jail's file system need to be exported by
607.Xr mount 8 .
608For exporting only the jail's file system, a setting of 2
609is sufficient.
610If the kernel configuration does not include the
611.Sy NFSD
612option,
613.Pa nfsd.ko
614must be loaded outside of the jails.
615This is normally done by adding
616.Dq nfsd
617to
618.Va kld_list
619in the
620.Xr rc.conf 5
621file outside of the jails.
622Similarily, if the
623.Xr gssd 8
624is to be run in a jail, either the kernel
625.Sy KGSSAPI
626option needs to be specified or
627.Dq kgssapi
628and
629.Dq kgssapi_krb5
630need to be in
631.Va kld_list
632in the
633.Xr rc.conf 5
634file outside of the jails.
635.It Va allow.reserved_ports
636The jail root may bind to ports lower than 1024.
637.It Va allow.unprivileged_proc_debug
638Unprivileged processes in the jail may use debugging facilities.
639.It Va allow.suser
640The value of the jail's
641.Va security.bsd.suser_enabled
642sysctl.
643The super-user will be disabled automatically if its parent system has it
644disabled.
645The super-user is enabled by default.
646.It Va allow.extattr
647Allow privileged process in the jail to manipulate filesystem extended
648attributes in the system namespace.
649.El
650.El
651.Pp
652Kernel modules may add their own parameters, which only exist when the
653module is loaded.
654These are typically headed under a parameter named after the module,
655with values of
656.Dq inherit
657to give the jail full use of the module,
658.Dq new
659to encapsulate the jail in some module-specific way,
660and
661.Dq disable
662to make the module unavailable to the jail.
663There also may be other parameters to define jail behavior within the module.
664Module-specific parameters include:
665.Bl -tag -width indent
666.It Va allow.mount.fdescfs
667privileged users inside the jail will be able to mount and unmount the
668fdescfs file system.
669This permission is effective only together with
670.Va allow.mount
671and only when
672.Va enforce_statfs
673is set to a value lower than 2.
674.It Va allow.mount.fusefs
675privileged users inside the jail will be able to mount and unmount
676fuse-based file systems.
677This permission is effective only together with
678.Va allow.mount
679and only when
680.Va enforce_statfs
681is set to a value lower than 2.
682.It Va allow.mount.nullfs
683privileged users inside the jail will be able to mount and unmount the
684nullfs file system.
685This permission is effective only together with
686.Va allow.mount
687and only when
688.Va enforce_statfs
689is set to a value lower than 2.
690.It Va allow.mount.procfs
691privileged users inside the jail will be able to mount and unmount the
692procfs file system.
693This permission is effective only together with
694.Va allow.mount
695and only when
696.Va enforce_statfs
697is set to a value lower than 2.
698.It Va allow.mount.linprocfs
699privileged users inside the jail will be able to mount and unmount the
700linprocfs file system.
701This permission is effective only together with
702.Va allow.mount
703and only when
704.Va enforce_statfs
705is set to a value lower than 2.
706.It Va allow.mount.linsysfs
707privileged users inside the jail will be able to mount and unmount the
708linsysfs file system.
709This permission is effective only together with
710.Va allow.mount
711and only when
712.Va enforce_statfs
713is set to a value lower than 2.
714.It Va allow.mount.tmpfs
715privileged users inside the jail will be able to mount and unmount the
716tmpfs file system.
717This permission is effective only together with
718.Va allow.mount
719and only when
720.Va enforce_statfs
721is set to a value lower than 2.
722.It Va allow.mount.zfs
723privileged users inside the jail will be able to mount and unmount the
724ZFS file system.
725This permission is effective only together with
726.Va allow.mount
727and only when
728.Va enforce_statfs
729is set to a value lower than 2.
730See
731.Xr zfs 8
732for information on how to configure the ZFS filesystem to operate from
733within a jail.
734.It Va allow.vmm
735The jail may access
736.Xr vmm 4 .
737This flag is only available when the
738.Xr vmm 4
739kernel module is loaded.
740.It Va linux
741Determine how a jail's Linux emulation environment appears.
742A value of
743.Dq inherit
744will keep the same environment, and
745.Dq new
746will give the jail its own environment (still originally inherited when
747the jail is created).
748.It Va linux.osname , linux.osrelease , linux.oss_version
749The Linux OS name, OS release, and OSS version associated with this jail.
750.It Va sysvmsg
751Allow access to SYSV IPC message primitives.
752If set to
753.Dq inherit ,
754all IPC objects on the system are visible to this jail, whether they
755were created by the jail itself, the base system, or other jails.
756If set to
757.Dq new ,
758the jail will have its own key namespace, and can only see the objects
759that it has created;
760the system (or parent jail) has access to the jail's objects, but not to
761its keys.
762If set to
763.Dq disable ,
764the jail cannot perform any sysvmsg-related system calls.
765.It Va sysvsem, sysvshm
766Allow access to SYSV IPC semaphore and shared memory primitives, in the
767same manner as
768.Va sysvmsg .
769.El
770.Pp
771There are pseudo-parameters that are not passed to the kernel, but are
772used by
773.Nm
774to set up the jail environment, often by running specified commands
775when jails are created or removed.
776The
777.Va exec.*
778command parameters are
779.Xr sh 1
780command lines that are run in either the system or jail environment.
781They may be given multiple values, which would run the specified
782commands in sequence.
783All commands must succeed (return a zero exit status), or the jail will
784not be created or removed, as appropriate.
785.Pp
786The pseudo-parameters are:
787.Bl -tag -width indent
788.It Va exec.prepare
789Command(s) to run in the system environment to prepare a jail for creation.
790These commands are executed before assigning IP addresses and mounting
791filesystems, so they may be used to create a new jail filesystem if it does
792not already exist.
793.It Va exec.prestart
794Command(s) to run in the system environment before a jail is created.
795.It Va exec.created
796Command(s) to run in the system environment right after a jail has been
797created, but before commands (or services) get executed in the jail.
798.It Va exec.start
799Command(s) to run in the jail environment when a jail is created.
800A typical command to run is
801.Dq sh /etc/rc .
802.It Va command
803A synonym for
804.Va exec.start
805for use when specifying a jail directly on the command line.
806Unlike other parameters whose value is a single string,
807.Va command
808uses the remainder of the
809.Nm
810command line as its own arguments.
811.It Va exec.poststart
812Command(s) to run in the system environment after a jail is created,
813and after any
814.Va exec.start
815commands have completed.
816.It Va exec.prestop
817Command(s) to run in the system environment before a jail is removed.
818.It Va exec.stop
819Command(s) to run in the jail environment before a jail is removed,
820and after any
821.Va exec.prestop
822commands have completed.
823A typical command to run is
824.Dq sh /etc/rc.shutdown jail .
825.It Va exec.poststop
826Command(s) to run in the system environment after a jail is removed.
827.It Va exec.release
828Command(s) to run in the system environment after all other actions are done.
829These commands are executed after unmounting filesystems and removing IP
830addresses, so they may be used to remove a jail filesystem if it is no longer
831needed.
832.It Va exec.clean
833Run commands in a clean environment.
834The environment is discarded except for
835.Ev HOME , SHELL , TERM
836and
837.Ev USER .
838.Ev HOME
839and
840.Ev SHELL
841are set to the target login's default values.
842.Ev USER
843is set to the target login.
844.Ev TERM
845is imported from the current environment.
846The environment variables from the login class capability database for the
847target login are also set.
848.It Va exec.jail_user
849The user to run commands as, when running in the jail environment.
850The default is to run the commands as the current user.
851.It Va exec.system_jail_user
852This boolean option looks for the
853.Va exec.jail_user
854in the system
855.Xr passwd 5
856file, instead of in the jail's file.
857.It Va exec.system_user
858The user to run commands as, when running in the system environment.
859The default is to run the commands as the current user.
860.It Va exec.timeout
861The maximum amount of time to wait for a command to complete, in
862seconds.
863If a command is still running after this timeout has passed,
864the jail will not be created or removed, as appropriate.
865.It Va exec.consolelog
866A file to direct command output (stdout and stderr) to.
867.It Va exec.fib
868The FIB (routing table) to set when running commands inside the jail.
869.It Va stop.timeout
870The maximum amount of time to wait for a jail's processes to exit
871after sending them a
872.Dv SIGTERM
873signal (which happens after the
874.Va exec.stop
875commands have completed).
876After this many seconds have passed, the jail will be removed, which
877will kill any remaining processes.
878If this is set to zero, no
879.Dv SIGTERM
880is sent and the jail is immediately removed.
881The default is 10 seconds.
882.It Va interface
883A network interface to add the jail's IP addresses
884.Va ( ip4.addr
885and
886.Va ip6.addr )
887to.
888An alias for each address will be added to the interface before the
889jail is created, and will be removed from the interface after the
890jail is removed.
891.It Va ip4.addr
892In addition to the IP addresses that are passed to the kernel, an
893interface, netmask and additional parameters (as supported by
894.Xr ifconfig 8 Ns )
895may also be specified, in the form
896.Dq Ar interface Ns | Ns Ar ip-address Ns / Ns Ar netmask param ... .
897If an interface is given before the IP address, an alias for the address
898will be added to that interface, as it is with the
899.Va interface
900parameter.
901If a netmask in either dotted-quad or CIDR form is given
902after an IP address, it will be used when adding the IP alias.
903If additional parameters are specified then they will also be used when
904adding the IP alias.
905.It Va ip6.addr
906In addition to the IP addresses that are passed to the kernel,
907an interface, prefix and additional parameters (as supported by
908.Xr ifconfig 8 Ns )
909may also be specified, in the form
910.Dq Ar interface Ns | Ns Ar ip-address Ns / Ns Ar prefix param ... .
911.It Va vnet.interface
912A network interface to give to a vnet-enabled jail after is it created.
913The interface will automatically be released when the jail is removed.
914.It Va ip_hostname
915Resolve the
916.Va host.hostname
917parameter and add all IP addresses returned by the resolver
918to the list of addresses
919.Po Va ip4.addr
920or
921.Va ip6.addr Pc
922for this jail.
923This may affect default address selection for outgoing IPv4 connections
924from jails.
925The address first returned by the resolver for each address family
926will be used as the primary address.
927.It Va mount
928A filesystem to mount before creating the jail (and to unmount after
929removing it), given as a single
930.Xr fstab 5
931line.
932.It Va mount.fstab
933An
934.Xr fstab 5
935format file containing filesystems to mount before creating a jail.
936.It Va mount.devfs
937Mount a
938.Xr devfs 5
939filesystem on the chrooted
940.Pa /dev
941directory, and apply the ruleset in the
942.Va devfs_ruleset
943parameter (or a default of ruleset 4: devfsrules_jail)
944to restrict the devices visible inside the jail.
945.It Va mount.fdescfs
946Mount a
947.Xr fdescfs 5
948filesystem on the chrooted
949.Pa /dev/fd
950directory.
951.It Va mount.procfs
952Mount a
953.Xr procfs 5
954filesystem on the chrooted
955.Pa /proc
956directory.
957.It Va allow.dying
958Allow making changes to a
959.Va dying
960jail.
961.It Va depend
962Specify a jail (or jails) that this jail depends on.
963When this jail is to be created, any jail(s) it depends on must already exist.
964If not, they will be created automatically, up to the completion of the last
965.Va exec.poststart
966command, before any action will taken to create this jail.
967When jails are removed the opposite is true:
968this jail will be removed, up to the last
969.Va exec.poststop
970command, before any jail(s) it depends on are stopped.
971.El
972.Sh EXAMPLES
973Jails are typically set up using one of two philosophies: either to
974constrain a specific application (possibly running with privilege), or
975to create a
976.Dq "virtual system image"
977running a variety of daemons and services.
978In both cases, a fairly complete file system install of
979.Fx
980is
981required, so as to provide the necessary command line tools, daemons,
982libraries, application configuration files, etc.
983However, for a virtual server configuration, a fair amount of
984additional work is required so as to replace the
985.Dq boot
986process.
987This manual page documents the configuration steps necessary to support
988either of these steps, although the configuration steps may need to be
989refined based on local requirements.
990.Ss "Setting up a Jail Directory Tree"
991To set up a jail directory tree containing an entire
992.Fx
993distribution, the following
994.Xr sh 1
995command script can be used:
996.Bd -literal -offset indent
997D=/here/is/the/jail
998cd /usr/src
999mkdir -p $D
1000make world DESTDIR=$D
1001make distribution DESTDIR=$D
1002.Ed
1003.Pp
1004In many cases this example would put far more in the jail than needed.
1005In the other extreme case a jail might contain only one file:
1006the executable to be run in the jail.
1007.Pp
1008We recommend experimentation, and caution that it is a lot easier to
1009start with a
1010.Dq fat
1011jail and remove things until it stops working,
1012than it is to start with a
1013.Dq thin
1014jail and add things until it works.
1015.Ss "Setting Up a Jail"
1016Do what was described in
1017.Sx "Setting Up a Jail Directory Tree"
1018to build the jail directory tree.
1019For the sake of this example, we will
1020assume you built it in
1021.Pa /data/jail/testjail ,
1022for a jail named
1023.Dq testjail .
1024Substitute below as needed with your
1025own directory, IP address, and hostname.
1026.Ss "Setting up the Host Environment"
1027First, set up the real system's environment to be
1028.Dq jail-friendly .
1029For consistency, we will refer to the parent box as the
1030.Dq "host environment" ,
1031and to the jailed virtual machine as the
1032.Dq "jail environment" .
1033Since jails are implemented using IP aliases, one of the first things to do
1034is to disable IP services on the host system that listen on all local
1035IP addresses for a service.
1036If a network service is present in the host environment that binds all
1037available IP addresses rather than specific IP addresses, it may service
1038requests sent to jail IP addresses if the jail did not bind the port.
1039This means changing
1040.Xr inetd 8
1041to only listen on the
1042appropriate IP address, and so forth.
1043Add the following to
1044.Pa /etc/rc.conf
1045in the host environment:
1046.Bd -literal -offset indent
1047sendmail_enable="NO"
1048inetd_flags="-wW -a 192.0.2.23"
1049rpcbind_enable="NO"
1050.Ed
1051.Pp
1052.Li 192.0.2.23
1053is the native IP address for the host system, in this example.
1054Daemons that run out of
1055.Xr inetd 8
1056can be easily configured to use only the specified host IP address.
1057Other daemons
1058will need to be manually configured \(em for some this is possible through
1059.Xr rc.conf 5
1060flags entries; for others it is necessary to modify per-application
1061configuration files, or to recompile the application.
1062The following frequently deployed services must have their individual
1063configuration files modified to limit the application to listening
1064to a specific IP address:
1065.Pp
1066To configure
1067.Xr sshd 8 ,
1068it is necessary to modify
1069.Pa /etc/ssh/sshd_config .
1070.Pp
1071To configure
1072.Xr sendmail 8 ,
1073it is necessary to modify
1074.Pa /etc/mail/sendmail.cf .
1075.Pp
1076In addition, a number of services must be recompiled in order to run
1077them in the host environment.
1078This includes most applications providing services using
1079.Xr rpc 3 ,
1080such as
1081.Xr rpcbind 8 ,
1082.Xr nfsd 8 ,
1083and
1084.Xr mountd 8 .
1085In general, applications for which it is not possible to specify which
1086IP address to bind should not be run in the host environment unless they
1087should also service requests sent to jail IP addresses.
1088Attempting to serve
1089NFS from the host environment may also cause confusion, and cannot be
1090easily reconfigured to use only specific IPs, as some NFS services are
1091hosted directly from the kernel.
1092Any third-party network software running
1093in the host environment should also be checked and configured so that it
1094does not bind all IP addresses, which would result in those services also
1095appearing to be offered by the jail environments.
1096.Pp
1097Once
1098these daemons have been disabled or fixed in the host environment, it is
1099best to reboot so that all daemons are in a known state, to reduce the
1100potential for confusion later (such as finding that when you send mail
1101to a jail, and its sendmail is down, the mail is delivered to the host,
1102etc.).
1103.Ss "Configuring the Jail"
1104Start any jail for the first time without configuring the network
1105interface so that you can clean it up a little and set up accounts.
1106As
1107with any machine (virtual or not), you will need to set a root password, time
1108zone, etc.
1109Some of these steps apply only if you intend to run a full virtual server
1110inside the jail; others apply both for constraining a particular application
1111or for running a virtual server.
1112.Pp
1113Start a shell in the jail:
1114.Bd -literal -offset indent
1115jail -c path=/data/jail/testjail mount.devfs \\
1116	host.hostname=testhostname ip4.addr=192.0.2.100 \\
1117	command=/bin/sh
1118.Ed
1119.Pp
1120Assuming no errors, you will end up with a shell prompt within the jail.
1121You can now run
1122.Xr bsdconfig 8
1123and do the post-install configuration to set various configuration options,
1124or perform these actions manually by editing
1125.Pa /etc/rc.conf ,
1126etc.
1127.Pp
1128.Bl -bullet -offset indent -compact
1129.It
1130Configure
1131.Pa /etc/resolv.conf
1132so that name resolution within the jail will work correctly.
1133.It
1134Run
1135.Xr newaliases 1
1136to quell
1137.Xr sendmail 8
1138warnings.
1139.It
1140Set a root password, probably different from the real host system.
1141.It
1142Set the timezone.
1143.It
1144Add accounts for users in the jail environment.
1145.It
1146Install any packages the environment requires.
1147.El
1148.Pp
1149You may also want to perform any package-specific configuration (web servers,
1150SSH servers, etc), patch up
1151.Pa /etc/syslog.conf
1152so it logs as you would like, etc.
1153If you are not using a virtual server, you may wish to modify
1154.Xr syslogd 8
1155in the host environment to listen on the syslog socket in the jail
1156environment; in this example, the syslog socket would be stored in
1157.Pa /data/jail/testjail/var/run/log .
1158.Pp
1159Exit from the shell, and the jail will be shut down.
1160.Ss "Starting the Jail"
1161You are now ready to restart the jail and bring up the environment with
1162all of its daemons and other programs.
1163Create an entry for the jail in
1164.Pa /etc/jail.conf :
1165.Bd -literal -offset indent
1166testjail {
1167	path = /tmp/jail/testjail;
1168	mount.devfs;
1169	host.hostname = testhostname;
1170	ip4.addr = 192.0.2.100;
1171	interface = em0;
1172	exec.start = "/bin/sh /etc/rc";
1173	exec.stop = "/bin/sh /etc/rc.shutdown jail";
1174}
1175.Ed
1176.Pp
1177To start a virtual server environment,
1178.Pa /etc/rc
1179is run to launch various daemons and services, and
1180.Pa /etc/rc.shutdown
1181is run to shut them down when the jail is removed.
1182If you are running a single application in the jail,
1183substitute the command used to start the application for
1184.Dq /bin/sh /etc/rc ;
1185there may be some script available to cleanly shut down the application,
1186or it may be sufficient to go without a stop command, and have
1187.Nm
1188send
1189.Dv SIGTERM
1190to the application.
1191.Pp
1192Start the jail by running:
1193.Bd -literal -offset indent
1194jail -c testjail
1195.Ed
1196.Pp
1197A few warnings may be produced; however, it should all work properly.
1198You should be able to see
1199.Xr inetd 8 ,
1200.Xr syslogd 8 ,
1201and other processes running within the jail using
1202.Xr ps 1 ,
1203with the
1204.Ql J
1205flag appearing beside jailed processes.
1206To see an active list of jails, use
1207.Xr jls 8 .
1208If
1209.Xr sshd 8
1210is enabled in the jail environment, you should be able to
1211.Xr ssh 1
1212to the hostname or IP address of the jailed environment, and log
1213in using the accounts you created previously.
1214.Pp
1215It is possible to have jails started at boot time.
1216Please refer to the
1217.Dq jail_*
1218variables in
1219.Xr rc.conf 5
1220for more information.
1221.Ss "Managing the Jail"
1222Normal machine shutdown commands, such as
1223.Xr halt 8 ,
1224.Xr reboot 8 ,
1225and
1226.Xr shutdown 8 ,
1227cannot be used successfully within the jail.
1228To kill all processes from within a jail, you may use one of the
1229following commands, depending on what you want to accomplish:
1230.Bd -literal -offset indent
1231kill -TERM -1
1232kill -KILL -1
1233.Ed
1234.Pp
1235This will send the
1236.Dv SIGTERM
1237or
1238.Dv SIGKILL
1239signals to all processes in the jail \(em be careful not to run this from
1240the host environment!
1241Once all of the jail's processes have died, unless the jail was created
1242with the
1243.Va persist
1244parameter, the jail will be removed.
1245Depending on
1246the intended use of the jail, you may also want to run
1247.Pa /etc/rc.shutdown
1248from within the jail.
1249.Pp
1250To shut down the jail from the outside, simply remove it with:
1251.Bd -literal -offset indent
1252jail -r
1253.Ed
1254.Pp
1255which will run any commands specified by
1256.Va exec.stop ,
1257and then send
1258.Dv SIGTERM
1259and eventually
1260.Dv SIGKILL
1261to any remaining jailed processes.
1262.Pp
1263The
1264.Pa /proc/ Ns Ar pid Ns Pa /status
1265file contains, as its last field, the name of the jail in which the
1266process runs, or
1267.Dq Li -
1268to indicate that the process is not running within a jail.
1269The
1270.Xr ps 1
1271command also shows a
1272.Ql J
1273flag for processes in a jail.
1274.Pp
1275You can also list/kill processes based on their jail ID.
1276To show processes and their jail ID, use the following command:
1277.Pp
1278.Dl "ps ax -o pid,jid,args"
1279.Pp
1280To show and then kill processes in jail number 3 use the following commands:
1281.Bd -literal -offset indent
1282pgrep -lfj 3
1283pkill -j 3
1284.Ed
1285or:
1286.Pp
1287.Dl "killall -j 3"
1288.Ss "Jails and File Systems"
1289It is not possible to
1290.Xr mount 8
1291or
1292.Xr umount 8
1293any file system inside a jail unless the file system is marked
1294jail-friendly, the jail's
1295.Va allow.mount
1296parameter is set, and the jail's
1297.Va enforce_statfs
1298parameter is lower than 2.
1299.Pp
1300Multiple jails sharing the same file system can influence each other.
1301For example, a user in one jail can fill the file system,
1302leaving no space for processes in the other jail.
1303Trying to use
1304.Xr quota 1
1305to prevent this will not work either, as the file system quotas
1306are not aware of jails but only look at the user and group IDs.
1307This means the same user ID in two jails share a single file
1308system quota.
1309One would need to use one file system per jail to make this work.
1310.Ss "Sysctl MIB Entries"
1311The read-only entry
1312.Va security.jail.jailed
1313can be used to determine if a process is running inside a jail (value
1314is one) or not (value is zero).
1315.Pp
1316The variable
1317.Va security.jail.jail_max_af_ips
1318determines how may address per address family a jail may have.
1319The default is 255.
1320.Pp
1321Some MIB variables have per-jail settings.
1322Changes to these variables by a jailed process do not affect the host
1323environment, only the jail environment.
1324These variables are
1325.Va kern.securelevel ,
1326.Va security.bsd.suser_enabled ,
1327.Va kern.hostname ,
1328.Va kern.domainname ,
1329.Va kern.hostid ,
1330and
1331.Va kern.hostuuid .
1332.Ss "Hierarchical Jails"
1333By setting a jail's
1334.Va children.max
1335parameter, processes within a jail may be able to create jails of their own.
1336These child jails are kept in a hierarchy, with jails only able to see and/or
1337modify the jails they created (or those jails' children).
1338Each jail has a read-only
1339.Va parent
1340parameter, containing the
1341.Va jid
1342of the jail that created it; a
1343.Va jid
1344of 0 indicates the jail is a child of the current jail (or is a top-level
1345jail if the current process isn't jailed).
1346.Pp
1347Jailed processes are not allowed to confer greater permissions than they
1348themselves are given, e.g., if a jail is created with
1349.Va allow.nomount ,
1350it is not able to create a jail with
1351.Va allow.mount
1352set.
1353Similarly, such restrictions as
1354.Va ip4.addr
1355and
1356.Va securelevel
1357may not be bypassed in child jails.
1358.Pp
1359A child jail may in turn create its own child jails if its own
1360.Va children.max
1361parameter is set (remember it is zero by default).
1362These jails are visible to and can be modified by their parent and all
1363ancestors.
1364.Pp
1365Jail names reflect this hierarchy, with a full name being an MIB-type string
1366separated by dots.
1367For example, if a base system process creates a jail
1368.Dq foo ,
1369and a process under that jail creates another jail
1370.Dq bar ,
1371then the second jail will be seen as
1372.Dq foo.bar
1373in the base system (though it is only seen as
1374.Dq bar
1375to any processes inside jail
1376.Dq foo ) .
1377Jids on the other hand exist in a single space, and each jail must have a
1378unique jid.
1379.Pp
1380Like the names, a child jail's
1381.Va path
1382appears relative to its creator's own
1383.Va path .
1384This is by virtue of the child jail being created in the chrooted
1385environment of the first jail.
1386.Sh SEE ALSO
1387.Xr killall 1 ,
1388.Xr lsvfs 1 ,
1389.Xr newaliases 1 ,
1390.Xr pgrep 1 ,
1391.Xr pkill 1 ,
1392.Xr ps 1 ,
1393.Xr quota 1 ,
1394.Xr jail_set 2 ,
1395.Xr vmm 4 ,
1396.Xr devfs 5 ,
1397.Xr fdescfs 5 ,
1398.Xr jail.conf 5 ,
1399.Xr linprocfs 5 ,
1400.Xr linsysfs 5 ,
1401.Xr procfs 5 ,
1402.Xr rc.conf 5 ,
1403.Xr sysctl.conf 5 ,
1404.Xr bsdconfig 8 ,
1405.Xr chroot 8 ,
1406.Xr devfs 8 ,
1407.Xr halt 8 ,
1408.Xr ifconfig 8 ,
1409.Xr inetd 8 ,
1410.Xr jexec 8 ,
1411.Xr jls 8 ,
1412.Xr mount 8 ,
1413.Xr mountd 8 ,
1414.Xr nfsd 8 ,
1415.Xr reboot 8 ,
1416.Xr rpcbind 8 ,
1417.Xr sendmail 8 ,
1418.Xr shutdown 8 ,
1419.Xr sysctl 8 ,
1420.Xr syslogd 8 ,
1421.Xr umount 8 ,
1422.Xr extattr 9
1423.Sh HISTORY
1424The
1425.Nm
1426utility appeared in
1427.Fx 4.0 .
1428Hierarchical/extensible jails were introduced in
1429.Fx 8.0 .
1430The configuration file was introduced in
1431.Fx 9.1 .
1432.Sh AUTHORS
1433.An -nosplit
1434The jail feature was written by
1435.An Poul-Henning Kamp
1436for R&D Associates
1437who contributed it to
1438.Fx .
1439.Pp
1440.An Robert Watson
1441wrote the extended documentation, found a few bugs, added
1442a few new features, and cleaned up the userland jail environment.
1443.Pp
1444.An Bjoern A. Zeeb
1445added multi-IP jail support for IPv4 and IPv6 based on a patch
1446originally done by
1447.An Pawel Jakub Dawidek
1448for IPv4.
1449.Pp
1450.An James Gritton
1451added the extensible jail parameters, hierarchical jails,
1452and the configuration file.
1453.Sh BUGS
1454It might be a good idea to add an
1455address alias flag such that daemons listening on all IPs
1456.Pq Dv INADDR_ANY
1457will not bind on that address, which would facilitate building a safe
1458host environment such that host daemons do not impose on services offered
1459from within jails.
1460Currently, the simplest answer is to minimize services
1461offered on the host, possibly limiting it to services offered from
1462.Xr inetd 8
1463which is easily configurable.
1464.Sh NOTES
1465Great care should be taken when managing directories visible within the jail.
1466For example, if a jailed process has its current working directory set to a
1467directory that is moved out of the jail's chroot, then the process may gain
1468access to the file space outside of the jail.
1469It is recommended that directories always be copied, rather than moved, out
1470of a jail.
1471.Pp
1472In addition, there are several ways in which an unprivileged user
1473outside the jail can cooperate with a privileged user inside the jail
1474and thereby obtain elevated privileges in the host environment.
1475Most of these attacks can be mitigated by ensuring that the jail root
1476is not accessible to unprivileged users in the host environment.
1477Regardless, as a general rule, untrusted users with privileged access
1478to a jail should not be given access to the host environment.
1479