xref: /freebsd/usr.sbin/jail/jail.8 (revision 26a222dc0c048fc071b548eadad7b80405a1b126)
1.\" Copyright (c) 2000, 2003 Robert N. M. Watson
2.\" Copyright (c) 2008-2012 James Gritton
3.\" All rights reserved.
4.\"
5.\" Redistribution and use in source and binary forms, with or without
6.\" modification, are permitted provided that the following conditions
7.\" are met:
8.\" 1. Redistributions of source code must retain the above copyright
9.\"    notice, this list of conditions and the following disclaimer.
10.\" 2. Redistributions in binary form must reproduce the above copyright
11.\"    notice, this list of conditions and the following disclaimer in the
12.\"    documentation and/or other materials provided with the distribution.
13.\"
14.\" THIS SOFTWARE IS PROVIDED BY THE AUTHOR AND CONTRIBUTORS ``AS IS'' AND
15.\" ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
16.\" IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE
17.\" ARE DISCLAIMED.  IN NO EVENT SHALL THE AUTHOR OR CONTRIBUTORS BE LIABLE
18.\" FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL
19.\" DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS
20.\" OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION)
21.\" HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT
22.\" LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY
23.\" OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF
24.\" SUCH DAMAGE.
25.\"
26.\" $FreeBSD$
27.\"
28.Dd February 25, 2015
29.Dt JAIL 8
30.Os
31.Sh NAME
32.Nm jail
33.Nd "manage system jails"
34.Sh SYNOPSIS
35.Nm
36.Op Fl dhilqv
37.Op Fl J Ar jid_file
38.Op Fl u Ar username
39.Op Fl U Ar username
40.Op Fl cmr
41.Ar param Ns = Ns Ar value ...
42.Op Cm command Ns = Ns Ar command ...
43.Nm
44.Op Fl dqv
45.Op Fl f Ar conf_file
46.Op Fl p Ar limit
47.Op Fl cmr
48.Op Ar jail
49.Nm
50.Op Fl qv
51.Op Fl f Ar conf_file
52.Op Fl rR
53.Op Cm * | Ar jail ...
54.Nm
55.Op Fl dhilqv
56.Op Fl J Ar jid_file
57.Op Fl u Ar username
58.Op Fl U Ar username
59.Op Fl n Ar jailname
60.Op Fl s Ar securelevel
61.Op Ar path hostname [ Ar ip Ns [ Ns Ar ,... Ns ]] Ar command ...
62.Sh DESCRIPTION
63The
64.Nm
65utility creates new jails, or modifies or removes existing jails.
66A jail
67.Pq or Dq prison
68is specified via parameters on the command line, or in the
69.Xr jail.conf 5
70file.
71.Pp
72At least one of the options
73.Fl c ,
74.Fl m
75or
76.Fl r
77must be specified.
78These options are used alone or in combination to describe the operation to
79perform:
80.Bl -tag -width indent
81.It Fl c
82Create a new jail.
83The jail
84.Va jid
85and
86.Va name
87parameters (if specified on the command line)
88must not refer to an existing jail.
89.It Fl m
90Modify an existing jail.
91One of the
92.Va jid
93or
94.Va name
95parameters must exist and refer to an existing jail.
96Some parameters may not be changed on a running jail.
97.It Fl r
98Remove the
99.Ar jail
100specified by jid or name.
101All jailed processes are killed, and all jails that are
102children of this jail are also
103removed.
104.It Fl rc
105Restart an existing jail.
106The jail is first removed and then re-created, as if
107.Dq Nm Fl r
108and
109.Dq Nm Fl c
110were run in succession.
111.It Fl cm
112Create a jail if it does not exist, or modify the jail if it does exist.
113.It Fl mr
114Modify an existing jail.
115The jail may be restarted if necessary to modify parameters than could
116not otherwise be changed.
117.It Fl cmr
118Create a jail if it doesn't exist, or modify (and possibly restart) the
119jail if it does exist.
120.El
121.Pp
122Other available options are:
123.Bl -tag -width indent
124.It Fl d
125Allow making changes to a dying jail, equivalent to the
126.Va allow.dying
127parameter.
128.It Fl f Ar conf_file
129Use configuration file
130.Ar conf_file
131instead of the default
132.Pa /etc/jail.conf .
133.It Fl h
134Resolve the
135.Va host.hostname
136parameter (or
137.Va hostname )
138and add all IP addresses returned by the resolver
139to the list of addresses for this jail.
140This is equivalent to the
141.Va ip_hostname
142parameter.
143.It Fl i
144Output (only) the jail identifier of the newly created jail(s).
145This implies the
146.Fl q
147option.
148.It Fl J Ar jid_file
149Write a
150.Ar jid_file
151file, containing the parameters used to start the jail.
152.It Fl l
153Run commands in a clean environment.
154This is deprecated and is equivalent to the exec.clean parameter.
155.It Fl n Ar jailname
156Set the jail's name.
157This is deprecated and is equivalent to the
158.Va name
159parameter.
160.It Fl p Ar limit
161Limit the number of commands from
162.Va  exec.*
163that can run simultaneously.
164.It Fl q
165Suppress the message printed whenever a jail is created, modified or removed.
166Only error messages will be printed.
167.It Fl R
168A variation of the
169.Fl r
170option that removes an existing jail without using the configuration file.
171No removal-related parameters for this jail will be used \(em the jail will
172simply be removed.
173.It Fl s Ar securelevel
174Set the
175.Va kern.securelevel
176MIB entry to the specified value inside the newly created jail.
177This is deprecated and is equivalent to the
178.Va securelevel
179parameter.
180.It Fl u Ar username
181The user name from host environment as whom jailed commands should run.
182This is deprecated and is equivalent to the
183.Va exec.jail_user
184and
185.Va exec.system_jail_user
186parameters.
187.It Fl U Ar username
188The user name from the jailed environment as whom jailed commands should run.
189This is deprecated and is equivalent to the
190.Va exec.jail_user
191parameter.
192.It Fl v
193Print a message on every operation, such as running commands and
194mounting filesystems.
195.El
196.Pp
197If no arguments are given after the options, the operation (except
198remove) will be performed on all jails specified in the
199.Xr jail.conf 5
200file.
201A single argument of a jail name will operate only on the specified jail.
202The
203.Fl r
204and
205.Fl R
206options can also remove running jails that aren't in the
207.Xr jail.conf 5
208file, specified by name or jid.
209.Pp
210An argument of
211.Dq *
212is a wildcard that will operate on all jails, regardless of whether
213they appear in
214.Xr jail.conf 5 ;
215this is the surest way for
216.Fl r
217to remove all jails.
218If hierarchical jails exist, a partial-matching wildcard definition may
219be specified.
220For example, an argument of
221.Dq foo.*
222would apply to jails with names like
223.Dq foo.bar
224and
225.Dq foo.bar.baz .
226.Pp
227A jail may be specified with parameters directly on the command line.
228In this case, the
229.Xr jail.conf 5
230file will not be used.
231For backward compatibility, the command line may also have four fixed
232parameters, without names:
233.Ar path ,
234.Ar hostname ,
235.Ar ip ,
236and
237.Ar command .
238This mode will always create a new jail, and the
239.Fl c
240and
241.Fl m
242options do not apply (and must not be present).
243.Ss Jail Parameters
244Parameters in the
245.Xr jail.conf 5
246file, or on the command line, are generally of the form
247.Dq name=value .
248Some parameters are boolean, and do not have a value but are set by the
249name alone with or without a
250.Dq no
251prefix, e.g.
252.Va persist
253or
254.Va nopersist .
255They can also be given the values
256.Dq true
257and
258.Dq false .
259Other parameters may have more than one value, specified as a
260comma-separated list or with
261.Dq +=
262in the configuration file (see
263.Xr jail.conf 5
264for details).
265.Pp
266The
267.Nm
268utility recognizes two classes of parameters.
269There are the true jail
270parameters that are passed to the kernel when the jail is created,
271which can be seen with
272.Xr jls 8 ,
273and can (usually) be changed with
274.Dq Nm Fl m .
275Then there are pseudo-parameters that are only used by
276.Nm
277itself.
278.Pp
279Jails have a set of core parameters, and kernel modules can add their own
280jail parameters.
281The current set of available parameters can be retrieved via
282.Dq Nm sysctl Fl d Va security.jail.param .
283Any parameters not set will be given default values, often based on the
284current environment.
285The core parameters are:
286.Bl -tag -width indent
287.It Va jid
288The jail identifier.
289This will be assigned automatically to a new jail (or can be explicitly
290set), and can be used to identify the jail for later modification, or
291for such commands as
292.Xr jls 8
293or
294.Xr jexec 8 .
295.It Va name
296The jail name.
297This is an arbitrary string that identifies a jail (except it may not
298contain a
299.Sq \&. ) .
300Like the
301.Va jid ,
302it can be passed to later
303.Nm
304commands, or to
305.Xr jls 8
306or
307.Xr jexec 8 .
308If no
309.Va name
310is supplied, a default is assumed that is the same as the
311.Va jid .
312The
313.Va name
314parameter is implied by the
315.Xr jail.conf 5
316file format, and need not be explicitly set when using the configuration
317file.
318.It Va path
319The directory which is to be the root of the jail.
320Any commands run inside the jail, either by
321.Nm
322or from
323.Xr jexec 8 ,
324are run from this directory.
325.It Va ip4.addr
326A list of IPv4 addresses assigned to the jail.
327If this is set, the jail is restricted to using only these addresses.
328Any attempts to use other addresses fail, and attempts to use wildcard
329addresses silently use the jailed address instead.
330For IPv4 the first address given will be used as the source address
331when source address selection on unbound sockets cannot find a better
332match.
333It is only possible to start multiple jails with the same IP address
334if none of the jails has more than this single overlapping IP address
335assigned to itself.
336.It Va ip4.saddrsel
337A boolean option to change the formerly mentioned behaviour and disable
338IPv4 source address selection for the jail in favour of the primary
339IPv4 address of the jail.
340Source address selection is enabled by default for all jails and the
341.Va ip4.nosaddrsel
342setting of a parent jail is not inherited for any child jails.
343.It Va ip4
344Control the availability of IPv4 addresses.
345Possible values are
346.Dq inherit
347to allow unrestricted access to all system addresses,
348.Dq new
349to restrict addresses via
350.Va ip4.addr ,
351and
352.Dq disable
353to stop the jail from using IPv4 entirely.
354Setting the
355.Va ip4.addr
356parameter implies a value of
357.Dq new .
358.It Va ip6.addr , Va ip6.saddrsel , Va ip6
359A set of IPv6 options for the jail, the counterparts to
360.Va ip4.addr ,
361.Va ip4.saddrsel
362and
363.Va ip4
364above.
365.It Va vnet
366Create the jail with its own virtual network stack,
367with its own network interfaces, addresses, routing table, etc.
368The kernel must have been compiled with the
369.Sy VIMAGE option
370for this to be available.
371Possible values are
372.Dq inherit
373to use the system network stack, possibly with restricted IP addresses,
374and
375.Dq new
376to create a new network stack.
377.It Va host.hostname
378The hostname of the jail.
379Other similar parameters are
380.Va host.domainname ,
381.Va host.hostuuid
382and
383.Va host.hostid .
384.It Va host
385Set the origin of hostname and related information.
386Possible values are
387.Dq inherit
388to use the system information and
389.Dq new
390for the jail to use the information from the above fields.
391Setting any of the above fields implies a value of
392.Dq new .
393.It Va securelevel
394The value of the jail's
395.Va kern.securelevel
396sysctl.
397A jail never has a lower securelevel than its parent system, but by
398setting this parameter it may have a higher one.
399If the system securelevel is changed, any jail securelevels will be at
400least as secure.
401.It Va devfs_ruleset
402The number of the devfs ruleset that is enforced for mounting devfs in
403this jail.
404A value of zero (default) means no ruleset is enforced.
405Descendant jails inherit the parent jail's devfs ruleset enforcement.
406Mounting devfs inside a jail is possible only if the
407.Va allow.mount
408and
409.Va allow.mount.devfs
410permissions are effective and
411.Va enforce_statfs
412is set to a value lower than 2.
413Devfs rules and rulesets cannot be viewed or modified from inside a jail.
414.Pp
415NOTE: It is important that only appropriate device nodes in devfs be
416exposed to a jail; access to disk devices in the jail may permit processes
417in the jail to bypass the jail sandboxing by modifying files outside of
418the jail.
419See
420.Xr devfs 8
421for information on how to use devfs rules to limit access to entries
422in the per-jail devfs.
423A simple devfs ruleset for jails is available as ruleset #4 in
424.Pa /etc/defaults/devfs.rules .
425.It Va children.max
426The number of child jails allowed to be created by this jail (or by
427other jails under this jail).
428This limit is zero by default, indicating the jail is not allowed to
429create child jails.
430See the
431.Sx "Hierarchical Jails"
432section for more information.
433.It Va children.cur
434The number of descendants of this jail, including its own child jails
435and any jails created under them.
436.It Va enforce_statfs
437This determines what information processes in a jail are able to get
438about mount points.
439It affects the behaviour of the following syscalls:
440.Xr statfs 2 ,
441.Xr fstatfs 2 ,
442.Xr getfsstat 2 ,
443and
444.Xr fhstatfs 2
445(as well as similar compatibility syscalls).
446When set to 0, all mount points are available without any restrictions.
447When set to 1, only mount points below the jail's chroot directory are
448visible.
449In addition to that, the path to the jail's chroot directory is removed
450from the front of their pathnames.
451When set to 2 (default), above syscalls can operate only on a mount-point
452where the jail's chroot directory is located.
453.It Va persist
454Setting this boolean parameter allows a jail to exist without any
455processes.
456Normally, a command is run as part of jail creation, and then the jail
457is destroyed as its last process exits.
458A new jail must have either the
459.Va persist
460parameter or
461.Va exec.start
462or
463.Va command
464pseudo-parameter set.
465.It Va cpuset.id
466The ID of the cpuset associated with this jail (read-only).
467.It Va dying
468This is true if the jail is in the process of shutting down (read-only).
469.It Va parent
470The
471.Va jid
472of the parent of this jail, or zero if this is a top-level jail
473(read-only).
474.It Va osrelease
475The string for the jail's
476.Va kern.osrelease
477sysctl and uname -r.
478.It Va osreldate
479The number for the jail's
480.Va kern.osreldate
481and uname -K.
482.It Va allow.*
483Some restrictions of the jail environment may be set on a per-jail
484basis.
485With the exception of
486.Va allow.set_hostname ,
487these boolean parameters are off by default.
488.Bl -tag -width indent
489.It Va allow.set_hostname
490The jail's hostname may be changed via
491.Xr hostname 1
492or
493.Xr sethostname 3 .
494.It Va allow.sysvipc
495A process within the jail has access to System V IPC primitives.
496In the current jail implementation, System V primitives share a single
497namespace across the host and jail environments, meaning that processes
498within a jail would be able to communicate with (and potentially interfere
499with) processes outside of the jail, and in other jails.
500.It Va allow.raw_sockets
501The jail root is allowed to create raw sockets.
502Setting this parameter allows utilities like
503.Xr ping 8
504and
505.Xr traceroute 8
506to operate inside the jail.
507If this is set, the source IP addresses are enforced to comply
508with the IP address bound to the jail, regardless of whether or not
509the
510.Dv IP_HDRINCL
511flag has been set on the socket.
512Since raw sockets can be used to configure and interact with various
513network subsystems, extra caution should be used where privileged access
514to jails is given out to untrusted parties.
515.It Va allow.chflags
516Normally, privileged users inside a jail are treated as unprivileged by
517.Xr chflags 2 .
518When this parameter is set, such users are treated as privileged, and
519may manipulate system file flags subject to the usual constraints on
520.Va kern.securelevel .
521.It Va allow.mount
522privileged users inside the jail will be able to mount and unmount file
523system types marked as jail-friendly.
524The
525.Xr lsvfs 1
526command can be used to find file system types available for mount from
527within a jail.
528This permission is effective only if
529.Va enforce_statfs
530is set to a value lower than 2.
531.It Va allow.mount.devfs
532privileged users inside the jail will be able to mount and unmount the
533devfs file system.
534This permission is effective only together with
535.Va allow.mount
536and only when
537.Va enforce_statfs
538is set to a value lower than 2.
539The devfs ruleset should be restricted from the default by using the
540.Va devfs_ruleset
541option.
542.It Va allow.mount.fdescfs
543privileged users inside the jail will be able to mount and unmount the
544fdescfs file system.
545This permission is effective only together with
546.Va allow.mount
547and only when
548.Va enforce_statfs
549is set to a value lower than 2.
550.It Va allow.mount.nullfs
551privileged users inside the jail will be able to mount and unmount the
552nullfs file system.
553This permission is effective only together with
554.Va allow.mount
555and only when
556.Va enforce_statfs
557is set to a value lower than 2.
558.It Va allow.mount.procfs
559privileged users inside the jail will be able to mount and unmount the
560procfs file system.
561This permission is effective only together with
562.Va allow.mount
563and only when
564.Va enforce_statfs
565is set to a value lower than 2.
566.It Va allow.mount.tmpfs
567privileged users inside the jail will be able to mount and unmount the
568tmpfs file system.
569This permission is effective only together with
570.Va allow.mount
571and only when
572.Va enforce_statfs
573is set to a value lower than 2.
574.It Va allow.mount.zfs
575privileged users inside the jail will be able to mount and unmount the
576ZFS file system.
577This permission is effective only together with
578.Va allow.mount
579and only when
580.Va enforce_statfs
581is set to a value lower than 2.
582See
583.Xr zfs 8
584for information on how to configure the ZFS filesystem to operate from
585within a jail.
586.It Va allow.quotas
587The jail root may administer quotas on the jail's filesystem(s).
588This includes filesystems that the jail may share with other jails or
589with non-jailed parts of the system.
590.It Va allow.socket_af
591Sockets within a jail are normally restricted to IPv4, IPv6, local
592(UNIX), and route.  This allows access to other protocol stacks that
593have not had jail functionality added to them.
594.El
595.El
596.Pp
597There are pseudo-parameters that are not passed to the kernel, but are
598used by
599.Nm
600to set up the jail environment, often by running specified commands
601when jails are created or removed.
602The
603.Va exec.*
604command parameters are
605.Xr sh 1
606command lines that are run in either the system or jail environment.
607They may be given multiple values, which run would the specified
608commands in sequence.
609All commands must succeed (return a zero exit status), or the jail will
610not be created or removed, as appropriate.
611.Pp
612The pseudo-parameters are:
613.Bl -tag -width indent
614.It Va exec.prestart
615Command(s) to run in the system environment before a jail is created.
616.It Va exec.start
617Command(s) to run in the jail environment when a jail is created.
618A typical command to run is
619.Dq sh /etc/rc .
620.It Va command
621A synonym for
622.Va exec.start
623for use when specifying a jail directly on the command line.
624Unlike other parameters whose value is a single string,
625.Va command
626uses the remainder of the
627.Nm
628command line as its own arguments.
629.It Va exec.poststart
630Command(s) to run in the system environment after a jail is created,
631and after any
632.Va exec.start
633commands have completed.
634.It Va exec.prestop
635Command(s) to run in the system environment before a jail is removed.
636.It Va exec.stop
637Command(s) to run in the jail environment before a jail is removed,
638and after any
639.Va exec.prestop
640commands have completed.
641A typical command to run is
642.Dq sh /etc/rc.shutdown .
643.It Va exec.poststop
644Command(s) to run in the system environment after a jail is removed.
645.It Va exec.clean
646Run commands in a clean environment.
647The environment is discarded except for
648.Ev HOME , SHELL , TERM
649and
650.Ev USER .
651.Ev HOME
652and
653.Ev SHELL
654are set to the target login's default values.
655.Ev USER
656is set to the target login.
657.Ev TERM
658is imported from the current environment.
659The environment variables from the login class capability database for the
660target login are also set.
661.It Va exec.jail_user
662The user to run commands as, when running in the jail environment.
663The default is to run the commands as the current user.
664.It Va exec.system_jail_user
665This boolean option looks for the
666.Va exec.jail_user
667in the system
668.Xr passwd 5
669file, instead of in the jail's file.
670.It Va exec.system_user
671The user to run commands as, when running in the system environment.
672The default is to run the commands as the current user.
673.It Va exec.timeout
674The maximum amount of time to wait for a command to complete, in
675seconds.
676If a command is still running after this timeout has passed,
677the jail will not be created or removed, as appropriate.
678.It Va exec.consolelog
679A file to direct command output (stdout and stderr) to.
680.It Va exec.fib
681The FIB (routing table) to set when running commands inside the jail.
682.It Va stop.timeout
683The maximum amount of time to wait for a jail's processes to exit
684after sending them a
685.Dv SIGTERM
686signal (which happens after the
687.Va exec.stop
688commands have completed).
689After this many seconds have passed, the jail will be removed, which
690will kill any remaining processes.
691If this is set to zero, no
692.Dv SIGTERM
693is sent and the jail is immediately removed.
694The default is 10 seconds.
695.It Va interface
696A network interface to add the jail's IP addresses
697.Va ( ip4.addr
698and
699.Va ip6.addr )
700to.
701An alias for each address will be added to the interface before the
702jail is created, and will be removed from the interface after the
703jail is removed.
704.It Va ip4.addr
705In addition to the IP addresses that are passed to the kernel, an
706interface, netmask and additional paramters (as supported by
707.Xr ifconfig 8 Ns )
708may also be specified, in the form
709.Dq Ar interface Ns | Ns Ar ip-address Ns / Ns Ar netmask param ... .
710If an interface is given before the IP address, an alias for the address
711will be added to that interface, as it is with the
712.Va interface
713parameter.
714If a netmask in either dotted-quad or CIDR form is given
715after an IP address, it will be used when adding the IP alias.
716If additional parameters are specified then they will also be used when
717adding the IP alias.
718.It Va ip6.addr
719In addition to the IP addresses that are passed to the kernel,
720an interface, prefix and additional parameters (as supported by
721.Xr ifconfig 8 Ns )
722may also be specified, in the form
723.Dq Ar interface Ns | Ns Ar ip-address Ns / Ns Ar prefix param ... .
724.It Va vnet.interface
725A network interface to give to a vnet-enabled jail after is it created.
726The interface will automatically be released when the jail is removed.
727.It Va ip_hostname
728Resolve the
729.Va host.hostname
730parameter and add all IP addresses returned by the resolver
731to the list of addresses
732.Po Va ip4.addr
733or
734.Va ip6.addr Pc
735for this jail.
736This may affect default address selection for outgoing IPv4 connections
737from jails.
738The address first returned by the resolver for each address family
739will be used as the primary address.
740.It Va mount
741A filesystem to mount before creating the jail (and to unmount after
742removing it), given as a single
743.Xr fstab 5
744line.
745.It Va mount.fstab
746An
747.Xr fstab 5
748format file containing filesystems to mount before creating a jail.
749.It Va mount.devfs
750Mount a
751.Xr devfs 5
752filesystem on the chrooted
753.Pa /dev
754directory, and apply the ruleset in the
755.Va devfs_ruleset
756parameter (or a default of ruleset 4: devfsrules_jail)
757to restrict the devices visible inside the jail.
758.It Va mount.fdescfs
759Mount a
760.Xr fdescfs 5
761filesystem on the chrooted
762.Pa /dev/fd
763directory.
764.It Va mount.procfs
765Mount a
766.Xr procfs 5
767filesystem on the chrooted
768.Pa /proc
769directory.
770.It Va allow.dying
771Allow making changes to a
772.Va dying
773jail.
774.It Va depend
775Specify a jail (or jails) that this jail depends on.
776Any such jails must be fully created, up to the last
777.Va exec.poststart
778command, before any action will taken to create this jail.
779When jails are removed the opposite is true:
780this jail must be fully removed, up to the last
781.Va exec.poststop
782command, before the jail(s) it depends on are stopped.
783.El
784.Sh EXAMPLES
785Jails are typically set up using one of two philosophies: either to
786constrain a specific application (possibly running with privilege), or
787to create a
788.Dq "virtual system image"
789running a variety of daemons and services.
790In both cases, a fairly complete file system install of
791.Fx
792is
793required, so as to provide the necessary command line tools, daemons,
794libraries, application configuration files, etc.
795However, for a virtual server configuration, a fair amount of
796additional work is required so as to replace the
797.Dq boot
798process.
799This manual page documents the configuration steps necessary to support
800either of these steps, although the configuration steps may need to be
801refined based on local requirements.
802.Ss "Setting up a Jail Directory Tree"
803To set up a jail directory tree containing an entire
804.Fx
805distribution, the following
806.Xr sh 1
807command script can be used:
808.Bd -literal
809D=/here/is/the/jail
810cd /usr/src
811mkdir -p $D
812make world DESTDIR=$D
813make distribution DESTDIR=$D
814.Ed
815.Pp
816In many cases this example would put far more in the jail than needed.
817In the other extreme case a jail might contain only one file:
818the executable to be run in the jail.
819.Pp
820We recommend experimentation, and caution that it is a lot easier to
821start with a
822.Dq fat
823jail and remove things until it stops working,
824than it is to start with a
825.Dq thin
826jail and add things until it works.
827.Ss "Setting Up a Jail"
828Do what was described in
829.Sx "Setting Up a Jail Directory Tree"
830to build the jail directory tree.
831For the sake of this example, we will
832assume you built it in
833.Pa /data/jail/testjail ,
834for a jail named
835.Dq testjail .
836Substitute below as needed with your
837own directory, IP address, and hostname.
838.Ss "Setting up the Host Environment"
839First, set up the real system's environment to be
840.Dq jail-friendly .
841For consistency, we will refer to the parent box as the
842.Dq "host environment" ,
843and to the jailed virtual machine as the
844.Dq "jail environment" .
845Since jails are implemented using IP aliases, one of the first things to do
846is to disable IP services on the host system that listen on all local
847IP addresses for a service.
848If a network service is present in the host environment that binds all
849available IP addresses rather than specific IP addresses, it may service
850requests sent to jail IP addresses if the jail did not bind the port.
851This means changing
852.Xr inetd 8
853to only listen on the
854appropriate IP address, and so forth.
855Add the following to
856.Pa /etc/rc.conf
857in the host environment:
858.Bd -literal -offset indent
859sendmail_enable="NO"
860inetd_flags="-wW -a 192.0.2.23"
861rpcbind_enable="NO"
862.Ed
863.Pp
864.Li 192.0.2.23
865is the native IP address for the host system, in this example.
866Daemons that run out of
867.Xr inetd 8
868can be easily configured to use only the specified host IP address.
869Other daemons
870will need to be manually configured \(em for some this is possible through
871.Xr rc.conf 5
872flags entries; for others it is necessary to modify per-application
873configuration files, or to recompile the application.
874The following frequently deployed services must have their individual
875configuration files modified to limit the application to listening
876to a specific IP address:
877.Pp
878To configure
879.Xr sshd 8 ,
880it is necessary to modify
881.Pa /etc/ssh/sshd_config .
882.Pp
883To configure
884.Xr sendmail 8 ,
885it is necessary to modify
886.Pa /etc/mail/sendmail.cf .
887.Pp
888For
889.Xr named 8 ,
890it is necessary to modify
891.Pa /etc/namedb/named.conf .
892.Pp
893In addition, a number of services must be recompiled in order to run
894them in the host environment.
895This includes most applications providing services using
896.Xr rpc 3 ,
897such as
898.Xr rpcbind 8 ,
899.Xr nfsd 8 ,
900and
901.Xr mountd 8 .
902In general, applications for which it is not possible to specify which
903IP address to bind should not be run in the host environment unless they
904should also service requests sent to jail IP addresses.
905Attempting to serve
906NFS from the host environment may also cause confusion, and cannot be
907easily reconfigured to use only specific IPs, as some NFS services are
908hosted directly from the kernel.
909Any third-party network software running
910in the host environment should also be checked and configured so that it
911does not bind all IP addresses, which would result in those services also
912appearing to be offered by the jail environments.
913.Pp
914Once
915these daemons have been disabled or fixed in the host environment, it is
916best to reboot so that all daemons are in a known state, to reduce the
917potential for confusion later (such as finding that when you send mail
918to a jail, and its sendmail is down, the mail is delivered to the host,
919etc.).
920.Ss "Configuring the Jail"
921Start any jail for the first time without configuring the network
922interface so that you can clean it up a little and set up accounts.
923As
924with any machine (virtual or not), you will need to set a root password, time
925zone, etc.
926Some of these steps apply only if you intend to run a full virtual server
927inside the jail; others apply both for constraining a particular application
928or for running a virtual server.
929.Pp
930Start a shell in the jail:
931.Bd -literal -offset indent
932jail -c path=/data/jail/testjail mount.devfs \\
933	host.hostname=testhostname ip4.addr=192.0.2.100 \\
934	command=/bin/sh
935.Ed
936.Pp
937Assuming no errors, you will end up with a shell prompt within the jail.
938You can now run
939.Pa /usr/sbin/sysinstall
940and do the post-install configuration to set various configuration options,
941or perform these actions manually by editing
942.Pa /etc/rc.conf ,
943etc.
944.Pp
945.Bl -bullet -offset indent -compact
946.It
947Configure
948.Pa /etc/resolv.conf
949so that name resolution within the jail will work correctly.
950.It
951Run
952.Xr newaliases 1
953to quell
954.Xr sendmail 8
955warnings.
956.It
957Set a root password, probably different from the real host system.
958.It
959Set the timezone.
960.It
961Add accounts for users in the jail environment.
962.It
963Install any packages the environment requires.
964.El
965.Pp
966You may also want to perform any package-specific configuration (web servers,
967SSH servers, etc), patch up
968.Pa /etc/syslog.conf
969so it logs as you would like, etc.
970If you are not using a virtual server, you may wish to modify
971.Xr syslogd 8
972in the host environment to listen on the syslog socket in the jail
973environment; in this example, the syslog socket would be stored in
974.Pa /data/jail/testjail/var/run/log .
975.Pp
976Exit from the shell, and the jail will be shut down.
977.Ss "Starting the Jail"
978You are now ready to restart the jail and bring up the environment with
979all of its daemons and other programs.
980Create an entry for the jail in
981.Pa /etc/jail.conf :
982.Bd -literal -offset indent
983testjail {
984	path = /tmp/jail/testjail;
985	mount.devfs;
986	host.hostname = testhostname;
987	ip4.addr = 192.0.2.100;
988	interface = ed0;
989	exec.start = "/bin/sh /etc/rc";
990	exec.stop = "/bin/sh /etc/rc.shutdown";
991}
992.Ed
993.Pp
994To start a virtual server environment,
995.Pa /etc/rc
996is run to launch various daemons and services, and
997.Pa /etc/rc.shutdown
998is run to shut them down when the jail is removed.
999If you are running a single application in the jail,
1000substitute the command used to start the application for
1001.Dq /bin/sh /etc/rc ;
1002there may be some script available to cleanly shut down the application,
1003or it may be sufficient to go without a stop command, and have
1004.Nm
1005send
1006.Dv SIGTERM
1007to the application.
1008.Pp
1009Start the jail by running:
1010.Bd -literal -offset indent
1011jail -c testjail
1012.Ed
1013.Pp
1014A few warnings may be produced; however, it should all work properly.
1015You should be able to see
1016.Xr inetd 8 ,
1017.Xr syslogd 8 ,
1018and other processes running within the jail using
1019.Xr ps 1 ,
1020with the
1021.Ql J
1022flag appearing beside jailed processes.
1023To see an active list of jails, use
1024.Xr jls 8 .
1025If
1026.Xr sshd 8
1027is enabled in the jail environment, you should be able to
1028.Xr ssh 1
1029to the hostname or IP address of the jailed environment, and log
1030in using the accounts you created previously.
1031.Pp
1032It is possible to have jails started at boot time.
1033Please refer to the
1034.Dq jail_*
1035variables in
1036.Xr rc.conf 5
1037for more information.
1038.Ss "Managing the Jail"
1039Normal machine shutdown commands, such as
1040.Xr halt 8 ,
1041.Xr reboot 8 ,
1042and
1043.Xr shutdown 8 ,
1044cannot be used successfully within the jail.
1045To kill all processes from within a jail, you may use one of the
1046following commands, depending on what you want to accomplish:
1047.Bd -literal -offset indent
1048kill -TERM -1
1049kill -KILL -1
1050.Ed
1051.Pp
1052This will send the
1053.Dv SIGTERM
1054or
1055.Dv SIGKILL
1056signals to all processes in the jail \(em be careful not to run this from
1057the host environment!
1058Once all of the jail's processes have died, unless the jail was created
1059with the
1060.Va persist
1061parameter, the jail will be removed.
1062Depending on
1063the intended use of the jail, you may also want to run
1064.Pa /etc/rc.shutdown
1065from within the jail.
1066.Pp
1067To shut down the jail from the outside, simply remove it with
1068.Nm
1069.Ar -r ,
1070which will run any commands specified by
1071.Va exec.stop ,
1072and then send
1073.Dv SIGTERM
1074and eventually
1075.Dv SIGKILL
1076to any remaining jailed processes.
1077.Pp
1078The
1079.Pa /proc/ Ns Ar pid Ns Pa /status
1080file contains, as its last field, the name of the jail in which the
1081process runs, or
1082.Dq Li -
1083to indicate that the process is not running within a jail.
1084The
1085.Xr ps 1
1086command also shows a
1087.Ql J
1088flag for processes in a jail.
1089.Pp
1090You can also list/kill processes based on their jail ID.
1091To show processes and their jail ID, use the following command:
1092.Pp
1093.Dl "ps ax -o pid,jid,args"
1094.Pp
1095To show and then kill processes in jail number 3 use the following commands:
1096.Bd -literal -offset indent
1097pgrep -lfj 3
1098pkill -j 3
1099.Ed
1100or:
1101.Pp
1102.Dl "killall -j 3"
1103.Ss "Jails and File Systems"
1104It is not possible to
1105.Xr mount 8
1106or
1107.Xr umount 8
1108any file system inside a jail unless the file system is marked
1109jail-friendly, the jail's
1110.Va allow.mount
1111parameter is set, and the jail's
1112.Va enforce_statfs
1113parameter is lower than 2.
1114.Pp
1115Multiple jails sharing the same file system can influence each other.
1116For example, a user in one jail can fill the file system,
1117leaving no space for processes in the other jail.
1118Trying to use
1119.Xr quota 1
1120to prevent this will not work either, as the file system quotas
1121are not aware of jails but only look at the user and group IDs.
1122This means the same user ID in two jails share a single file
1123system quota.
1124One would need to use one file system per jail to make this work.
1125.Ss "Sysctl MIB Entries"
1126The read-only entry
1127.Va security.jail.jailed
1128can be used to determine if a process is running inside a jail (value
1129is one) or not (value is zero).
1130.Pp
1131The variable
1132.Va security.jail.max_af_ips
1133determines how may address per address family a jail may have.
1134The default is 255.
1135.Pp
1136Some MIB variables have per-jail settings.
1137Changes to these variables by a jailed process do not affect the host
1138environment, only the jail environment.
1139These variables are
1140.Va kern.securelevel ,
1141.Va kern.hostname ,
1142.Va kern.domainname ,
1143.Va kern.hostid ,
1144and
1145.Va kern.hostuuid .
1146.Ss "Hierarchical Jails"
1147By setting a jail's
1148.Va children.max
1149parameter, processes within a jail may be able to create jails of their own.
1150These child jails are kept in a hierarchy, with jails only able to see and/or
1151modify the jails they created (or those jails' children).
1152Each jail has a read-only
1153.Va parent
1154parameter, containing the
1155.Va jid
1156of the jail that created it; a
1157.Va jid
1158of 0 indicates the jail is a child of the current jail (or is a top-level
1159jail if the current process isn't jailed).
1160.Pp
1161Jailed processes are not allowed to confer greater permissions than they
1162themselves are given, e.g., if a jail is created with
1163.Va allow.nomount ,
1164it is not able to create a jail with
1165.Va allow.mount
1166set.
1167Similarly, such restrictions as
1168.Va ip4.addr
1169and
1170.Va securelevel
1171may not be bypassed in child jails.
1172.Pp
1173A child jail may in turn create its own child jails if its own
1174.Va children.max
1175parameter is set (remember it is zero by default).
1176These jails are visible to and can be modified by their parent and all
1177ancestors.
1178.Pp
1179Jail names reflect this hierarchy, with a full name being an MIB-type string
1180separated by dots.
1181For example, if a base system process creates a jail
1182.Dq foo ,
1183and a process under that jail creates another jail
1184.Dq bar ,
1185then the second jail will be seen as
1186.Dq foo.bar
1187in the base system (though it is only seen as
1188.Dq bar
1189to any processes inside jail
1190.Dq foo ) .
1191Jids on the other hand exist in a single space, and each jail must have a
1192unique jid.
1193.Pp
1194Like the names, a child jail's
1195.Va path
1196appears relative to its creator's own
1197.Va path .
1198This is by virtue of the child jail being created in the chrooted
1199environment of the first jail.
1200.Sh SEE ALSO
1201.Xr killall 1 ,
1202.Xr lsvfs 1 ,
1203.Xr newaliases 1 ,
1204.Xr pgrep 1 ,
1205.Xr pkill 1 ,
1206.Xr ps 1 ,
1207.Xr quota 1 ,
1208.Xr jail_set 2 ,
1209.Xr devfs 5 ,
1210.Xr fdescfs 5 ,
1211.Xr jail.conf 5 ,
1212.Xr procfs 5 ,
1213.Xr rc.conf 5 ,
1214.Xr sysctl.conf 5 ,
1215.Xr chroot 8 ,
1216.Xr devfs 8 ,
1217.Xr halt 8 ,
1218.Xr ifconfig 8 ,
1219.Xr inetd 8 ,
1220.Xr jexec 8 ,
1221.Xr jls 8 ,
1222.Xr mount 8 ,
1223.Xr named 8 ,
1224.Xr procfs 5 ,
1225.Xr reboot 8 ,
1226.Xr rpcbind 8 ,
1227.Xr sendmail 8 ,
1228.Xr shutdown 8 ,
1229.Xr sysctl 8 ,
1230.Xr syslogd 8 ,
1231.Xr umount 8
1232.Sh HISTORY
1233The
1234.Nm
1235utility appeared in
1236.Fx 4.0 .
1237Hierarchical/extensible jails were introduced in
1238.Fx 8.0 .
1239The configuration file was introduced in
1240.Fx 9.1 .
1241.Sh AUTHORS
1242.An -nosplit
1243The jail feature was written by
1244.An Poul-Henning Kamp
1245for R&D Associates
1246.Pa http://www.rndassociates.com/
1247who contributed it to
1248.Fx .
1249.Pp
1250.An Robert Watson
1251wrote the extended documentation, found a few bugs, added
1252a few new features, and cleaned up the userland jail environment.
1253.Pp
1254.An Bjoern A. Zeeb
1255added multi-IP jail support for IPv4 and IPv6 based on a patch
1256originally done by
1257.An Pawel Jakub Dawidek
1258for IPv4.
1259.Pp
1260.An James Gritton
1261added the extensible jail parameters, hierarchical jails,
1262and the configuration file.
1263.Sh BUGS
1264It might be a good idea to add an
1265address alias flag such that daemons listening on all IPs
1266.Pq Dv INADDR_ANY
1267will not bind on that address, which would facilitate building a safe
1268host environment such that host daemons do not impose on services offered
1269from within jails.
1270Currently, the simplest answer is to minimize services
1271offered on the host, possibly limiting it to services offered from
1272.Xr inetd 8
1273which is easily configurable.
1274.Sh NOTES
1275Great care should be taken when managing directories visible within the jail.
1276For example, if a jailed process has its current working directory set to a
1277directory that is moved out of the jail's chroot, then the process may gain
1278access to the file space outside of the jail.
1279It is recommended that directories always be copied, rather than moved, out
1280of a jail.
1281.Pp
1282In addition, there are several ways in which an unprivileged user
1283outside the jail can cooperate with a privileged user inside the jail
1284and thereby obtain elevated privileges in the host environment.
1285Most of these attacks can be mitigated by ensuring that the jail root
1286is not accessible to unprivileged users in the host environment.
1287Regardless, as a general rule, untrusted users with privileged access
1288to a jail should not be given access to the host environment.
1289