xref: /freebsd/sbin/ipfw/ipfw.8 (revision d5b0e70f7e04d971691517ce1304d86a1e367e2e)
1.\"
2.\" $FreeBSD$
3.\"
4.Dd August 17, 2022
5.Dt IPFW 8
6.Os
7.Sh NAME
8.Nm ipfw , dnctl
9.Nd User interface for firewall, traffic shaper, packet scheduler,
10in-kernel NAT.
11.Sh SYNOPSIS
12.Ss FIREWALL CONFIGURATION
13.Nm
14.Op Fl cq
15.Cm add
16.Ar rule
17.Nm
18.Op Fl acdefnNStT
19.Op Cm set Ar N
20.Brq Cm list | show
21.Op Ar rule | first-last ...
22.Nm
23.Op Fl f | q
24.Op Cm set Ar N
25.Cm flush
26.Nm
27.Op Fl q
28.Op Cm set Ar N
29.Brq Cm delete | zero | resetlog
30.Op Ar number ...
31.Pp
32.Nm
33.Cm set Oo Cm disable Ar number ... Oc Op Cm enable Ar number ...
34.Nm
35.Cm set move
36.Op Cm rule
37.Ar number Cm to Ar number
38.Nm
39.Cm set swap Ar number number
40.Nm
41.Cm set show
42.Ss SYSCTL SHORTCUTS
43.Nm
44.Cm enable
45.Brq Cm firewall | altq | one_pass | debug | verbose | dyn_keepalive
46.Nm
47.Cm disable
48.Brq Cm firewall | altq | one_pass | debug | verbose | dyn_keepalive
49.Ss LOOKUP TABLES
50.Nm
51.Oo Cm set Ar N Oc Cm table Ar name Cm create Ar create-options
52.Nm
53.Oo Cm set Ar N Oc Cm table
54.Brq Ar name | all
55.Cm destroy
56.Nm
57.Oo Cm set Ar N Oc Cm table Ar name Cm modify Ar modify-options
58.Nm
59.Oo Cm set Ar N Oc Cm table Ar name Cm swap Ar name
60.Nm
61.Oo Cm set Ar N Oc Cm table Ar name Cm add Ar table-key Op Ar value
62.Nm
63.Oo Cm set Ar N Oc Cm table Ar name Cm add Op Ar table-key Ar value ...
64.Nm
65.Oo Cm set Ar N Oc Cm table Ar name Cm atomic add Op Ar table-key Ar value ...
66.Nm
67.Oo Cm set Ar N Oc Cm table Ar name Cm delete Op Ar table-key ...
68.Nm
69.Oo Cm set Ar N Oc Cm table Ar name Cm lookup Ar addr
70.Nm
71.Oo Cm set Ar N Oc Cm table Ar name Cm lock
72.Nm
73.Oo Cm set Ar N Oc Cm table Ar name Cm unlock
74.Nm
75.Oo Cm set Ar N Oc Cm table
76.Brq Ar name | all
77.Cm list
78.Nm
79.Oo Cm set Ar N Oc Cm table
80.Brq Ar name | all
81.Cm info
82.Nm
83.Oo Cm set Ar N Oc Cm table
84.Brq Ar name | all
85.Cm detail
86.Nm
87.Oo Cm set Ar N Oc Cm table
88.Brq Ar name | all
89.Cm flush
90.Ss DUMMYNET CONFIGURATION (TRAFFIC SHAPER AND PACKET SCHEDULER)
91.Nm dnctl
92.Brq Cm pipe | queue | sched
93.Ar number
94.Cm config
95.Ar config-options
96.Nm dnctl
97.Op Fl s Op Ar field
98.Brq Cm pipe | queue | sched
99.Brq Cm delete | list | show
100.Op Ar number ...
101.Ss IN-KERNEL NAT
102.Nm
103.Op Fl q
104.Cm nat
105.Ar number
106.Cm config
107.Ar config-options
108.Nm
109.Cm nat
110.Ar number
111.Cm show
112.Brq Cm config | log
113.Ss STATEFUL IPv6/IPv4 NETWORK ADDRESS AND PROTOCOL TRANSLATION
114.Nm
115.Oo Cm set Ar N Oc Cm nat64lsn Ar name Cm create Ar create-options
116.Nm
117.Oo Cm set Ar N Oc Cm nat64lsn Ar name Cm config Ar config-options
118.Nm
119.Oo Cm set Ar N Oc Cm nat64lsn
120.Brq Ar name | all
121.Brq Cm list | show
122.Op Cm states
123.Nm
124.Oo Cm set Ar N Oc Cm nat64lsn
125.Brq Ar name | all
126.Cm destroy
127.Nm
128.Oo Cm set Ar N Oc Cm nat64lsn Ar name Cm stats Op Cm reset
129.Ss STATELESS IPv6/IPv4 NETWORK ADDRESS AND PROTOCOL TRANSLATION
130.Nm
131.Oo Cm set Ar N Oc Cm nat64stl Ar name Cm create Ar create-options
132.Nm
133.Oo Cm set Ar N Oc Cm nat64stl Ar name Cm config Ar config-options
134.Nm
135.Oo Cm set Ar N Oc Cm nat64stl
136.Brq Ar name | all
137.Brq Cm list | show
138.Nm
139.Oo Cm set Ar N Oc Cm nat64stl
140.Brq Ar name | all
141.Cm destroy
142.Nm
143.Oo Cm set Ar N Oc Cm nat64stl Ar name Cm stats Op Cm reset
144.Ss XLAT464 CLAT IPv6/IPv4 NETWORK ADDRESS AND PROTOCOL TRANSLATION
145.Nm
146.Oo Cm set Ar N Oc Cm nat64clat Ar name Cm create Ar create-options
147.Nm
148.Oo Cm set Ar N Oc Cm nat64clat Ar name Cm config Ar config-options
149.Nm
150.Oo Cm set Ar N Oc Cm nat64clat
151.Brq Ar name | all
152.Brq Cm list | show
153.Nm
154.Oo Cm set Ar N Oc Cm nat64clat
155.Brq Ar name | all
156.Cm destroy
157.Nm
158.Oo Cm set Ar N Oc Cm nat64clat Ar name Cm stats Op Cm reset
159.Ss IPv6-to-IPv6 NETWORK PREFIX TRANSLATION
160.Nm
161.Oo Cm set Ar N Oc Cm nptv6 Ar name Cm create Ar create-options
162.Nm
163.Oo Cm set Ar N Oc Cm nptv6
164.Brq Ar name | all
165.Brq Cm list | show
166.Nm
167.Oo Cm set Ar N Oc Cm nptv6
168.Brq Ar name | all
169.Cm destroy
170.Nm
171.Oo Cm set Ar N Oc Cm nptv6 Ar name Cm stats Op Cm reset
172.Ss INTERNAL DIAGNOSTICS
173.Nm
174.Cm internal iflist
175.Nm
176.Cm internal talist
177.Nm
178.Cm internal vlist
179.Ss LIST OF RULES AND PREPROCESSING
180.Nm
181.Op Fl cfnNqS
182.Oo
183.Fl p Ar preproc
184.Oo
185.Ar preproc-flags
186.Oc
187.Oc
188.Ar pathname
189.Sh DESCRIPTION
190The
191.Nm
192utility is the user interface for controlling the
193.Xr ipfw 4
194firewall, the
195.Xr dummynet 4
196traffic shaper/packet scheduler, and the
197in-kernel NAT services.
198.Pp
199A firewall configuration, or
200.Em ruleset ,
201is made of a list of
202.Em rules
203numbered from 1 to 65535.
204Packets are passed to the firewall
205from a number of different places in the protocol stack
206(depending on the source and destination of the packet,
207it is possible for the firewall to be
208invoked multiple times on the same packet).
209The packet passed to the firewall is compared
210against each of the rules in the
211.Em ruleset ,
212in rule-number order
213(multiple rules with the same number are permitted, in which case
214they are processed in order of insertion).
215When a match is found, the action corresponding to the
216matching rule is performed.
217.Pp
218Depending on the action and certain system settings, packets
219can be reinjected into the firewall at some rule after the
220matching one for further processing.
221.Pp
222A ruleset always includes a
223.Em default
224rule (numbered 65535) which cannot be modified or deleted,
225and matches all packets.
226The action associated with the
227.Em default
228rule can be either
229.Cm deny
230or
231.Cm allow
232depending on how the kernel is configured.
233.Pp
234If the ruleset includes one or more rules with the
235.Cm keep-state ,
236.Cm record-state ,
237.Cm limit
238or
239.Cm set-limit
240option,
241the firewall will have a
242.Em stateful
243behaviour, i.e., upon a match it will create
244.Em dynamic rules ,
245i.e., rules that match packets with the same 5-tuple
246(protocol, source and destination addresses and ports)
247as the packet which caused their creation.
248Dynamic rules, which have a limited lifetime, are checked
249at the first occurrence of a
250.Cm check-state ,
251.Cm keep-state
252or
253.Cm limit
254rule, and are typically used to open the firewall on-demand to
255legitimate traffic only.
256Please note, that
257.Cm keep-state
258and
259.Cm limit
260imply implicit
261.Cm check-state
262for all packets (not only these matched by the rule) but
263.Cm record-state
264and
265.Cm set-limit
266have no implicit
267.Cm check-state .
268See the
269.Sx STATEFUL FIREWALL
270and
271.Sx EXAMPLES
272Sections below for more information on the stateful behaviour of
273.Nm .
274.Pp
275All rules (including dynamic ones) have a few associated counters:
276a packet count, a byte count, a log count and a timestamp
277indicating the time of the last match.
278Counters can be displayed or reset with
279.Nm
280commands.
281.Pp
282Each rule belongs to one of 32 different
283.Em sets
284, and there are
285.Nm
286commands to atomically manipulate sets, such as enable,
287disable, swap sets, move all rules in a set to another
288one, delete all rules in a set.
289These can be useful to
290install temporary configurations, or to test them.
291See Section
292.Sx SETS OF RULES
293for more information on
294.Em sets .
295.Pp
296Rules can be added with the
297.Cm add
298command; deleted individually or in groups with the
299.Cm delete
300command, and globally (except those in set 31) with the
301.Cm flush
302command; displayed, optionally with the content of the
303counters, using the
304.Cm show
305and
306.Cm list
307commands.
308Finally, counters can be reset with the
309.Cm zero
310and
311.Cm resetlog
312commands.
313.Ss COMMAND OPTIONS
314The following general options are available when invoking
315.Nm :
316.Bl -tag -width indent
317.It Fl a
318Show counter values when listing rules.
319The
320.Cm show
321command implies this option.
322.It Fl b
323Only show the action and the comment, not the body of a rule.
324Implies
325.Fl c .
326.It Fl c
327When entering or showing rules, print them in compact form,
328i.e., omitting the "ip from any to any" string
329when this does not carry any additional information.
330.It Fl d
331When listing, show dynamic rules in addition to static ones.
332.It Fl D
333When listing, show only dynamic states.
334When deleting, delete only dynamic states.
335.It Fl f
336Run without prompting for confirmation for commands that can cause problems if misused,
337i.e.,
338.Cm flush .
339If there is no tty associated with the process, this is implied.
340The
341.Cm delete
342command with this flag ignores possible errors,
343i.e., nonexistent rule number.
344And for batched commands execution continues with the next command.
345.It Fl i
346When listing a table (see the
347.Sx LOOKUP TABLES
348section below for more information on lookup tables), format values
349as IP addresses.
350By default, values are shown as integers.
351.It Fl n
352Only check syntax of the command strings, without actually passing
353them to the kernel.
354.It Fl N
355Try to resolve addresses and service names in output.
356.It Fl q
357Be quiet when executing the
358.Cm add ,
359.Cm nat ,
360.Cm zero ,
361.Cm resetlog
362or
363.Cm flush
364commands;
365(implies
366.Fl f ) .
367This is useful when updating rulesets by executing multiple
368.Nm
369commands in a script
370(e.g.,
371.Ql sh\ /etc/rc.firewall ) ,
372or by processing a file with many
373.Nm
374rules across a remote login session.
375It also stops a table add or delete
376from failing if the entry already exists or is not present.
377.Pp
378The reason why this option may be important is that
379for some of these actions,
380.Nm
381may print a message; if the action results in blocking the
382traffic to the remote client,
383the remote login session will be closed
384and the rest of the ruleset will not be processed.
385Access to the console would then be required to recover.
386.It Fl S
387When listing rules, show the
388.Em set
389each rule belongs to.
390If this flag is not specified, disabled rules will not be
391listed.
392.It Fl s Op Ar field
393When listing pipes, sort according to one of the four
394counters (total or current packets or bytes).
395.It Fl t
396When listing, show last match timestamp converted with
397.Fn ctime .
398.It Fl T
399When listing, show last match timestamp as seconds from the epoch.
400This form can be more convenient for postprocessing by scripts.
401.El
402.Ss LIST OF RULES AND PREPROCESSING
403To ease configuration, rules can be put into a file which is
404processed using
405.Nm
406as shown in the last synopsis line.
407An absolute
408.Ar pathname
409must be used.
410The file will be read line by line and applied as arguments to the
411.Nm
412utility.
413.Pp
414Optionally, a preprocessor can be specified using
415.Fl p Ar preproc
416where
417.Ar pathname
418is to be piped through.
419Useful preprocessors include
420.Xr cpp 1
421and
422.Xr m4 1 .
423If
424.Ar preproc
425does not start with a slash
426.Pq Ql /
427as its first character, the usual
428.Ev PATH
429name search is performed.
430Care should be taken with this in environments where not all
431file systems are mounted (yet) by the time
432.Nm
433is being run (e.g.\& when they are mounted over NFS).
434Once
435.Fl p
436has been specified, any additional arguments are passed on to the preprocessor
437for interpretation.
438This allows for flexible configuration files (like conditionalizing
439them on the local hostname) and the use of macros to centralize
440frequently required arguments like IP addresses.
441.Ss TRAFFIC SHAPER CONFIGURATION
442The
443.Nm dnctl
444.Cm pipe , queue
445and
446.Cm sched
447commands are used to configure the traffic shaper and packet scheduler.
448See the
449.Sx TRAFFIC SHAPER (DUMMYNET) CONFIGURATION
450Section below for details.
451.Pp
452If the world and the kernel get out of sync the
453.Nm
454ABI may break, preventing you from being able to add any rules.
455This can adversely affect the booting process.
456You can use
457.Nm
458.Cm disable
459.Cm firewall
460to temporarily disable the firewall to regain access to the network,
461allowing you to fix the problem.
462.Sh PACKET FLOW
463A packet is checked against the active ruleset in multiple places
464in the protocol stack, under control of several sysctl variables.
465These places and variables are shown below, and it is important to
466have this picture in mind in order to design a correct ruleset.
467.Bd -literal -offset indent
468       ^    to upper layers    V
469       |                       |
470       +----------->-----------+
471       ^                       V
472 [ip(6)_input]           [ip(6)_output]     net.inet(6).ip(6).fw.enable=1
473       |                       |
474       ^                       V
475 [ether_demux]        [ether_output_frame]  net.link.ether.ipfw=1
476       |                       |
477       +-->--[bdg_forward]-->--+            net.link.bridge.ipfw=1
478       ^                       V
479       |      to devices       |
480.Ed
481.Pp
482The number of
483times the same packet goes through the firewall can
484vary between 0 and 4 depending on packet source and
485destination, and system configuration.
486.Pp
487Note that as packets flow through the stack, headers can be
488stripped or added to it, and so they may or may not be available
489for inspection.
490E.g., incoming packets will include the MAC header when
491.Nm
492is invoked from
493.Cm ether_demux() ,
494but the same packets will have the MAC header stripped off when
495.Nm
496is invoked from
497.Cm ip_input()
498or
499.Cm ip6_input() .
500.Pp
501Also note that each packet is always checked against the complete ruleset,
502irrespective of the place where the check occurs, or the source of the packet.
503If a rule contains some match patterns or actions which are not valid
504for the place of invocation (e.g.\& trying to match a MAC header within
505.Cm ip_input
506or
507.Cm ip6_input ),
508the match pattern will not match, but a
509.Cm not
510operator in front of such patterns
511.Em will
512cause the pattern to
513.Em always
514match on those packets.
515It is thus the responsibility of
516the programmer, if necessary, to write a suitable ruleset to
517differentiate among the possible places.
518.Cm skipto
519rules can be useful here, as an example:
520.Bd -literal -offset indent
521# packets from ether_demux or bdg_forward
522ipfw add 10 skipto 1000 all from any to any layer2 in
523# packets from ip_input
524ipfw add 10 skipto 2000 all from any to any not layer2 in
525# packets from ip_output
526ipfw add 10 skipto 3000 all from any to any not layer2 out
527# packets from ether_output_frame
528ipfw add 10 skipto 4000 all from any to any layer2 out
529.Ed
530.Pp
531(yes, at the moment there is no way to differentiate between
532ether_demux and bdg_forward).
533.Pp
534Also note that only actions
535.Cm allow ,
536.Cm deny ,
537.Cm netgraph ,
538.Cm ngtee
539and related to
540.Cm dummynet
541are processed for
542.Cm layer2
543frames and all other actions act as if they were
544.Cm allow
545for such frames.
546Full set of actions is supported for IP packets without
547.Cm layer2
548headers only.
549For example,
550.Cm divert
551action does not divert
552.Cm layer2
553frames.
554.Sh SYNTAX
555In general, each keyword or argument must be provided as
556a separate command line argument, with no leading or trailing
557spaces.
558Keywords are case-sensitive, whereas arguments may
559or may not be case-sensitive depending on their nature
560(e.g.\& uid's are, hostnames are not).
561.Pp
562Some arguments (e.g., port or address lists) are comma-separated
563lists of values.
564In this case, spaces after commas ',' are allowed to make
565the line more readable.
566You can also put the entire
567command (including flags) into a single argument.
568E.g., the following forms are equivalent:
569.Bd -literal -offset indent
570ipfw -q add deny src-ip 10.0.0.0/24,127.0.0.1/8
571ipfw -q add deny src-ip 10.0.0.0/24, 127.0.0.1/8
572ipfw "-q add deny src-ip 10.0.0.0/24, 127.0.0.1/8"
573.Ed
574.Sh RULE FORMAT
575The format of firewall rules is the following:
576.Bd -ragged -offset indent
577.Bk -words
578.Op Ar rule_number
579.Op Cm set Ar set_number
580.Op Cm prob Ar match_probability
581.Ar action
582.Op Cm log Op Cm logamount Ar number
583.Op Cm altq Ar queue
584.Oo
585.Bro Cm tag | untag
586.Brc Ar number
587.Oc
588.Ar body
589.Ek
590.Ed
591.Pp
592where the body of the rule specifies which information is used
593for filtering packets, among the following:
594.Pp
595.Bl -tag -width "Source and dest. addresses and ports" -offset XXX -compact
596.It Layer2 header fields
597When available
598.It IPv4 and IPv6 Protocol
599SCTP, TCP, UDP, ICMP, etc.
600.It Source and dest. addresses and ports
601.It Direction
602See Section
603.Sx PACKET FLOW
604.It Transmit and receive interface
605By name or address
606.It Misc. IP header fields
607Version, type of service, datagram length, identification,
608fragmentation flags,
609Time To Live
610.It IP options
611.It IPv6 Extension headers
612Fragmentation, Hop-by-Hop options,
613Routing Headers, Source routing rthdr0, Mobile IPv6 rthdr2, IPSec options.
614.It IPv6 Flow-ID
615.It Misc. TCP header fields
616TCP flags (SYN, FIN, ACK, RST, etc.),
617sequence number, acknowledgment number,
618window
619.It TCP options
620.It ICMP types
621for ICMP packets
622.It ICMP6 types
623for ICMP6 packets
624.It User/group ID
625When the packet can be associated with a local socket.
626.It Divert status
627Whether a packet came from a divert socket (e.g.,
628.Xr natd 8 ) .
629.It Fib annotation state
630Whether a packet has been tagged for using a specific FIB (routing table)
631in future forwarding decisions.
632.El
633.Pp
634Note that some of the above information, e.g.\& source MAC or IP addresses and
635TCP/UDP ports, can be easily spoofed, so filtering on those fields
636alone might not guarantee the desired results.
637.Bl -tag -width indent
638.It Ar rule_number
639Each rule is associated with a
640.Ar rule_number
641in the range 1..65535, with the latter reserved for the
642.Em default
643rule.
644Rules are checked sequentially by rule number.
645Multiple rules can have the same number, in which case they are
646checked (and listed) according to the order in which they have
647been added.
648If a rule is entered without specifying a number, the kernel will
649assign one in such a way that the rule becomes the last one
650before the
651.Em default
652rule.
653Automatic rule numbers are assigned by incrementing the last
654non-default rule number by the value of the sysctl variable
655.Ar net.inet.ip.fw.autoinc_step
656which defaults to 100.
657If this is not possible (e.g.\& because we would go beyond the
658maximum allowed rule number), the number of the last
659non-default value is used instead.
660.It Cm set Ar set_number
661Each rule is associated with a
662.Ar set_number
663in the range 0..31.
664Sets can be individually disabled and enabled, so this parameter
665is of fundamental importance for atomic ruleset manipulation.
666It can be also used to simplify deletion of groups of rules.
667If a rule is entered without specifying a set number,
668set 0 will be used.
669.br
670Set 31 is special in that it cannot be disabled,
671and rules in set 31 are not deleted by the
672.Nm ipfw flush
673command (but you can delete them with the
674.Nm ipfw delete set 31
675command).
676Set 31 is also used for the
677.Em default
678rule.
679.It Cm prob Ar match_probability
680A match is only declared with the specified probability
681(floating point number between 0 and 1).
682This can be useful for a number of applications such as
683random packet drop or
684(in conjunction with
685.Nm dummynet )
686to simulate the effect of multiple paths leading to out-of-order
687packet delivery.
688.Pp
689Note: this condition is checked before any other condition, including
690ones such as
691.Cm keep-state
692or
693.Cm check-state
694which might have
695side effects.
696.It Cm log Op Cm logamount Ar number
697Packets matching a rule with the
698.Cm log
699keyword will be made available for logging in two ways:
700if the sysctl variable
701.Va net.inet.ip.fw.verbose
702is set to 0 (default), one can use
703.Xr bpf 4
704attached to the
705.Li ipfw0
706pseudo interface.
707This pseudo interface can be created manually after a system
708boot by using the following command:
709.Bd -literal -offset indent
710# ifconfig ipfw0 create
711.Ed
712.Pp
713Or, automatically at boot time by adding the following
714line to the
715.Xr rc.conf 5
716file:
717.Bd -literal -offset indent
718firewall_logif="YES"
719.Ed
720.Pp
721There is zero overhead when no
722.Xr bpf 4
723is attached to the pseudo interface.
724.Pp
725If
726.Va net.inet.ip.fw.verbose
727is set to 1, packets will be logged to
728.Xr syslogd 8
729with a
730.Dv LOG_SECURITY
731facility up to a maximum of
732.Cm logamount
733packets.
734If no
735.Cm logamount
736is specified, the limit is taken from the sysctl variable
737.Va net.inet.ip.fw.verbose_limit .
738In both cases, a value of 0 means unlimited logging.
739.Pp
740Once the limit is reached, logging can be re-enabled by
741clearing the logging counter or the packet counter for that entry, see the
742.Cm resetlog
743command.
744.Pp
745Note: logging is done after all other packet matching conditions
746have been successfully verified, and before performing the final
747action (accept, deny, etc.) on the packet.
748.It Cm tag Ar number
749When a packet matches a rule with the
750.Cm tag
751keyword, the numeric tag for the given
752.Ar number
753in the range 1..65534 will be attached to the packet.
754The tag acts as an internal marker (it is not sent out over
755the wire) that can be used to identify these packets later on.
756This can be used, for example, to provide trust between interfaces
757and to start doing policy-based filtering.
758A packet can have multiple tags at the same time.
759Tags are "sticky", meaning once a tag is applied to a packet by a
760matching rule it exists until explicit removal.
761Tags are kept with the packet everywhere within the kernel, but are
762lost when packet leaves the kernel, for example, on transmitting
763packet out to the network or sending packet to a
764.Xr divert 4
765socket.
766.Pp
767To check for previously applied tags, use the
768.Cm tagged
769rule option.
770To delete previously applied tag, use the
771.Cm untag
772keyword.
773.Pp
774Note: since tags are kept with the packet everywhere in kernelspace,
775they can be set and unset anywhere in the kernel network subsystem
776(using the
777.Xr mbuf_tags 9
778facility), not only by means of the
779.Xr ipfw 4
780.Cm tag
781and
782.Cm untag
783keywords.
784For example, there can be a specialized
785.Xr netgraph 4
786node doing traffic analyzing and tagging for later inspecting
787in firewall.
788.It Cm untag Ar number
789When a packet matches a rule with the
790.Cm untag
791keyword, the tag with the number
792.Ar number
793is searched among the tags attached to this packet and,
794if found, removed from it.
795Other tags bound to packet, if present, are left untouched.
796.It Cm altq Ar queue
797When a packet matches a rule with the
798.Cm altq
799keyword, the ALTQ identifier for the given
800.Ar queue
801(see
802.Xr altq 4 )
803will be attached.
804Note that this ALTQ tag is only meaningful for packets going "out" of IPFW,
805and not being rejected or going to divert sockets.
806Note that if there is insufficient memory at the time the packet is
807processed, it will not be tagged, so it is wise to make your ALTQ
808"default" queue policy account for this.
809If multiple
810.Cm altq
811rules match a single packet, only the first one adds the ALTQ classification
812tag.
813In doing so, traffic may be shaped by using
814.Cm count Cm altq Ar queue
815rules for classification early in the ruleset, then later applying
816the filtering decision.
817For example,
818.Cm check-state
819and
820.Cm keep-state
821rules may come later and provide the actual filtering decisions in
822addition to the fallback ALTQ tag.
823.Pp
824You must run
825.Xr pfctl 8
826to set up the queues before IPFW will be able to look them up by name,
827and if the ALTQ disciplines are rearranged, the rules in containing the
828queue identifiers in the kernel will likely have gone stale and need
829to be reloaded.
830Stale queue identifiers will probably result in misclassification.
831.Pp
832All system ALTQ processing can be turned on or off via
833.Nm
834.Cm enable Ar altq
835and
836.Nm
837.Cm disable Ar altq .
838The usage of
839.Va net.inet.ip.fw.one_pass
840is irrelevant to ALTQ traffic shaping, as the actual rule action is followed
841always after adding an ALTQ tag.
842.El
843.Ss RULE ACTIONS
844A rule can be associated with one of the following actions, which
845will be executed when the packet matches the body of the rule.
846.Bl -tag -width indent
847.It Cm allow | accept | pass | permit
848Allow packets that match rule.
849The search terminates.
850.It Cm check-state Op Ar :flowname | Cm :any
851Checks the packet against the dynamic ruleset.
852If a match is found, execute the action associated with
853the rule which generated this dynamic rule, otherwise
854move to the next rule.
855.br
856.Cm Check-state
857rules do not have a body.
858If no
859.Cm check-state
860rule is found, the dynamic ruleset is checked at the first
861.Cm keep-state
862or
863.Cm limit
864rule.
865The
866.Ar :flowname
867is symbolic name assigned to dynamic rule by
868.Cm keep-state
869opcode.
870The special flowname
871.Cm :any
872can be used to ignore states flowname when matching.
873The
874.Cm :default
875keyword is special name used for compatibility with old rulesets.
876.It Cm count
877Update counters for all packets that match rule.
878The search continues with the next rule.
879.It Cm deny | drop
880Discard packets that match this rule.
881The search terminates.
882.It Cm divert Ar port
883Divert packets that match this rule to the
884.Xr divert 4
885socket bound to port
886.Ar port .
887The search terminates.
888.It Cm fwd | forward Ar ipaddr | tablearg Ns Op , Ns Ar port
889Change the next-hop on matching packets to
890.Ar ipaddr ,
891which can be an IP address or a host name.
892The next hop can also be supplied by the last table
893looked up for the packet by using the
894.Cm tablearg
895keyword instead of an explicit address.
896The search terminates if this rule matches.
897.Pp
898If
899.Ar ipaddr
900is a local address, then matching packets will be forwarded to
901.Ar port
902(or the port number in the packet if one is not specified in the rule)
903on the local machine.
904.br
905If
906.Ar ipaddr
907is not a local address, then the port number
908(if specified) is ignored, and the packet will be
909forwarded to the remote address, using the route as found in
910the local routing table for that IP.
911.br
912A
913.Ar fwd
914rule will not match layer2 packets (those received
915on ether_input, ether_output, or bridged).
916.br
917The
918.Cm fwd
919action does not change the contents of the packet at all.
920In particular, the destination address remains unmodified, so
921packets forwarded to another system will usually be rejected by that system
922unless there is a matching rule on that system to capture them.
923For packets forwarded locally,
924the local address of the socket will be
925set to the original destination address of the packet.
926This makes the
927.Xr netstat 1
928entry look rather weird but is intended for
929use with transparent proxy servers.
930.It Cm nat Ar nat_nr | global | tablearg
931Pass packet to a
932nat instance
933(for network address translation, address redirect, etc.):
934see the
935.Sx NETWORK ADDRESS TRANSLATION (NAT)
936Section for further information.
937.It Cm nat64lsn Ar name
938Pass packet to a stateful NAT64 instance (for IPv6/IPv4 network address and
939protocol translation): see the
940.Sx IPv6/IPv4 NETWORK ADDRESS AND PROTOCOL TRANSLATION
941Section for further information.
942.It Cm nat64stl Ar name
943Pass packet to a stateless NAT64 instance (for IPv6/IPv4 network address and
944protocol translation): see the
945.Sx IPv6/IPv4 NETWORK ADDRESS AND PROTOCOL TRANSLATION
946Section for further information.
947.It Cm nat64clat Ar name
948Pass packet to a CLAT NAT64 instance (for client-side IPv6/IPv4 network address and
949protocol translation): see the
950.Sx IPv6/IPv4 NETWORK ADDRESS AND PROTOCOL TRANSLATION
951Section for further information.
952.It Cm nptv6 Ar name
953Pass packet to a NPTv6 instance (for IPv6-to-IPv6 network prefix translation):
954see the
955.Sx IPv6-to-IPv6 NETWORK PREFIX TRANSLATION (NPTv6)
956Section for further information.
957.It Cm pipe Ar pipe_nr
958Pass packet to a
959.Nm dummynet
960.Dq pipe
961(for bandwidth limitation, delay, etc.).
962See the
963.Sx TRAFFIC SHAPER (DUMMYNET) CONFIGURATION
964Section for further information.
965The search terminates; however, on exit from the pipe and if
966the
967.Xr sysctl 8
968variable
969.Va net.inet.ip.fw.one_pass
970is not set, the packet is passed again to the firewall code
971starting from the next rule.
972.It Cm queue Ar queue_nr
973Pass packet to a
974.Nm dummynet
975.Dq queue
976(for bandwidth limitation using WF2Q+).
977.It Cm reject
978(Deprecated).
979Synonym for
980.Cm unreach host .
981.It Cm reset
982Discard packets that match this rule, and if the
983packet is a TCP packet, try to send a TCP reset (RST) notice.
984The search terminates.
985.It Cm reset6
986Discard packets that match this rule, and if the
987packet is a TCP packet, try to send a TCP reset (RST) notice.
988The search terminates.
989.It Cm skipto Ar number | tablearg
990Skip all subsequent rules numbered less than
991.Ar number .
992The search continues with the first rule numbered
993.Ar number
994or higher.
995It is possible to use the
996.Cm tablearg
997keyword with a skipto for a
998.Em computed
999skipto.
1000Skipto may work either in O(log(N)) or in O(1) depending
1001on amount of memory and/or sysctl variables.
1002See the
1003.Sx SYSCTL VARIABLES
1004section for more details.
1005.It Cm call Ar number | tablearg
1006The current rule number is saved in the internal stack and
1007ruleset processing continues with the first rule numbered
1008.Ar number
1009or higher.
1010If later a rule with the
1011.Cm return
1012action is encountered, the processing returns to the first rule
1013with number of this
1014.Cm call
1015rule plus one or higher
1016(the same behaviour as with packets returning from
1017.Xr divert 4
1018socket after a
1019.Cm divert
1020action).
1021This could be used to make somewhat like an assembly language
1022.Dq subroutine
1023calls to rules with common checks for different interfaces, etc.
1024.Pp
1025Rule with any number could be called, not just forward jumps as with
1026.Cm skipto .
1027So, to prevent endless loops in case of mistakes, both
1028.Cm call
1029and
1030.Cm return
1031actions don't do any jumps and simply go to the next rule if memory
1032cannot be allocated or stack overflowed/underflowed.
1033.Pp
1034Internally stack for rule numbers is implemented using
1035.Xr mbuf_tags 9
1036facility and currently has size of 16 entries.
1037As mbuf tags are lost when packet leaves the kernel,
1038.Cm divert
1039should not be used in subroutines to avoid endless loops
1040and other undesired effects.
1041.It Cm return
1042Takes rule number saved to internal stack by the last
1043.Cm call
1044action and returns ruleset processing to the first rule
1045with number greater than number of corresponding
1046.Cm call
1047rule.
1048See description of the
1049.Cm call
1050action for more details.
1051.Pp
1052Note that
1053.Cm return
1054rules usually end a
1055.Dq subroutine
1056and thus are unconditional, but
1057.Nm
1058command-line utility currently requires every action except
1059.Cm check-state
1060to have body.
1061While it is sometimes useful to return only on some packets,
1062usually you want to print just
1063.Dq return
1064for readability.
1065A workaround for this is to use new syntax and
1066.Fl c
1067switch:
1068.Bd -literal -offset indent
1069# Add a rule without actual body
1070ipfw add 2999 return via any
1071
1072# List rules without "from any to any" part
1073ipfw -c list
1074.Ed
1075.Pp
1076This cosmetic annoyance may be fixed in future releases.
1077.It Cm tee Ar port
1078Send a copy of packets matching this rule to the
1079.Xr divert 4
1080socket bound to port
1081.Ar port .
1082The search continues with the next rule.
1083.It Cm unreach Ar code Op mtu
1084Discard packets that match this rule, and try to send an ICMP
1085unreachable notice with code
1086.Ar code ,
1087where
1088.Ar code
1089is a number from 0 to 255, or one of these aliases:
1090.Cm net , host , protocol , port ,
1091.Cm needfrag , srcfail , net-unknown , host-unknown ,
1092.Cm isolated , net-prohib , host-prohib , tosnet ,
1093.Cm toshost , filter-prohib , host-precedence
1094or
1095.Cm precedence-cutoff .
1096The
1097.Cm needfrag
1098code may have an optional
1099.Ar mtu
1100parameter.
1101If specified, the MTU value will be put into generated ICMP packet.
1102The search terminates.
1103.It Cm unreach6 Ar code
1104Discard packets that match this rule, and try to send an ICMPv6
1105unreachable notice with code
1106.Ar code ,
1107where
1108.Ar code
1109is a number from 0, 1, 3 or 4, or one of these aliases:
1110.Cm no-route, admin-prohib, address
1111or
1112.Cm port .
1113The search terminates.
1114.It Cm netgraph Ar cookie
1115Divert packet into netgraph with given
1116.Ar cookie .
1117The search terminates.
1118If packet is later returned from netgraph it is either
1119accepted or continues with the next rule, depending on
1120.Va net.inet.ip.fw.one_pass
1121sysctl variable.
1122.It Cm ngtee Ar cookie
1123A copy of packet is diverted into netgraph, original
1124packet continues with the next rule.
1125See
1126.Xr ng_ipfw 4
1127for more information on
1128.Cm netgraph
1129and
1130.Cm ngtee
1131actions.
1132.It Cm setfib Ar fibnum | tablearg
1133The packet is tagged so as to use the FIB (routing table)
1134.Ar fibnum
1135in any subsequent forwarding decisions.
1136In the current implementation, this is limited to the values 0 through 15, see
1137.Xr setfib 2 .
1138Processing continues at the next rule.
1139It is possible to use the
1140.Cm tablearg
1141keyword with setfib.
1142If the tablearg value is not within the compiled range of fibs,
1143the packet's fib is set to 0.
1144.It Cm setdscp Ar DSCP | number | tablearg
1145Set specified DiffServ codepoint for an IPv4/IPv6 packet.
1146Processing continues at the next rule.
1147Supported values are:
1148.Pp
1149.Cm cs0
1150.Pq Dv 000000 ,
1151.Cm cs1
1152.Pq Dv 001000 ,
1153.Cm cs2
1154.Pq Dv 010000 ,
1155.Cm cs3
1156.Pq Dv 011000 ,
1157.Cm cs4
1158.Pq Dv 100000 ,
1159.Cm cs5
1160.Pq Dv 101000 ,
1161.Cm cs6
1162.Pq Dv 110000 ,
1163.Cm cs7
1164.Pq Dv 111000 ,
1165.Cm af11
1166.Pq Dv 001010 ,
1167.Cm af12
1168.Pq Dv 001100 ,
1169.Cm af13
1170.Pq Dv 001110 ,
1171.Cm af21
1172.Pq Dv 010010 ,
1173.Cm af22
1174.Pq Dv 010100 ,
1175.Cm af23
1176.Pq Dv 010110 ,
1177.Cm af31
1178.Pq Dv 011010 ,
1179.Cm af32
1180.Pq Dv 011100 ,
1181.Cm af33
1182.Pq Dv 011110 ,
1183.Cm af41
1184.Pq Dv 100010 ,
1185.Cm af42
1186.Pq Dv 100100 ,
1187.Cm af43
1188.Pq Dv 100110 ,
1189.Cm ef
1190.Pq Dv 101110 ,
1191.Cm be
1192.Pq Dv 000000 .
1193Additionally, DSCP value can be specified by number (0..63).
1194It is also possible to use the
1195.Cm tablearg
1196keyword with setdscp.
1197If the tablearg value is not within the 0..63 range, lower 6 bits of supplied
1198value are used.
1199.It Cm tcp-setmss Ar mss
1200Set the Maximum Segment Size (MSS) in the TCP segment to value
1201.Ar mss .
1202The kernel module
1203.Cm ipfw_pmod
1204should be loaded or kernel should have
1205.Cm options IPFIREWALL_PMOD
1206to be able use this action.
1207This command does not change a packet if original MSS value is lower than
1208specified value.
1209Both TCP over IPv4 and over IPv6 are supported.
1210Regardless of matched a packet or not by the
1211.Cm tcp-setmss
1212rule, the search continues with the next rule.
1213.It Cm reass
1214Queue and reassemble IPv4 fragments.
1215If the packet is not fragmented, counters are updated and
1216processing continues with the next rule.
1217If the packet is the last logical fragment, the packet is reassembled and, if
1218.Va net.inet.ip.fw.one_pass
1219is set to 0, processing continues with the next rule.
1220Otherwise, the packet is allowed to pass and the search terminates.
1221If the packet is a fragment in the middle of a logical group of fragments,
1222it is consumed and
1223processing stops immediately.
1224.Pp
1225Fragment handling can be tuned via
1226.Va net.inet.ip.maxfragpackets
1227and
1228.Va net.inet.ip.maxfragsperpacket
1229which limit, respectively, the maximum number of processable
1230fragments (default: 800) and
1231the maximum number of fragments per packet (default: 16).
1232.Pp
1233NOTA BENE: since fragments do not contain port numbers,
1234they should be avoided with the
1235.Nm reass
1236rule.
1237Alternatively, direction-based (like
1238.Nm in
1239/
1240.Nm out
1241) and source-based (like
1242.Nm via
1243) match patterns can be used to select fragments.
1244.Pp
1245Usually a simple rule like:
1246.Bd -literal -offset indent
1247# reassemble incoming fragments
1248ipfw add reass all from any to any in
1249.Ed
1250.Pp
1251is all you need at the beginning of your ruleset.
1252.It Cm abort
1253Discard packets that match this rule, and if the packet is an SCTP packet,
1254try to send an SCTP packet containing an ABORT chunk.
1255The search terminates.
1256.It Cm abort6
1257Discard packets that match this rule, and if the packet is an SCTP packet,
1258try to send an SCTP packet containing an ABORT chunk.
1259The search terminates.
1260.El
1261.Ss RULE BODY
1262The body of a rule contains zero or more patterns (such as
1263specific source and destination addresses or ports,
1264protocol options, incoming or outgoing interfaces, etc.)
1265that the packet must match in order to be recognised.
1266In general, the patterns are connected by (implicit)
1267.Cm and
1268operators -- i.e., all must match in order for the
1269rule to match.
1270Individual patterns can be prefixed by the
1271.Cm not
1272operator to reverse the result of the match, as in
1273.Pp
1274.Dl "ipfw add 100 allow ip from not 1.2.3.4 to any"
1275.Pp
1276Additionally, sets of alternative match patterns
1277.Pq Em or-blocks
1278can be constructed by putting the patterns in
1279lists enclosed between parentheses ( ) or braces { }, and
1280using the
1281.Cm or
1282operator as follows:
1283.Pp
1284.Dl "ipfw add 100 allow ip from { x or not y or z } to any"
1285.Pp
1286Only one level of parentheses is allowed.
1287Beware that most shells have special meanings for parentheses
1288or braces, so it is advisable to put a backslash \\ in front of them
1289to prevent such interpretations.
1290.Pp
1291The body of a rule must in general include a source and destination
1292address specifier.
1293The keyword
1294.Ar any
1295can be used in various places to specify that the content of
1296a required field is irrelevant.
1297.Pp
1298The rule body has the following format:
1299.Bd -ragged -offset indent
1300.Op Ar proto Cm from Ar src Cm to Ar dst
1301.Op Ar options
1302.Ed
1303.Pp
1304The first part (proto from src to dst) is for backward
1305compatibility with earlier versions of
1306.Fx .
1307In modern
1308.Fx
1309any match pattern (including MAC headers, IP protocols,
1310addresses and ports) can be specified in the
1311.Ar options
1312section.
1313.Pp
1314Rule fields have the following meaning:
1315.Bl -tag -width indent
1316.It Ar proto : protocol | Cm { Ar protocol Cm or ... }
1317.It Ar protocol : Oo Cm not Oc Ar protocol-name | protocol-number
1318An IP protocol specified by number or name
1319(for a complete list see
1320.Pa /etc/protocols ) ,
1321or one of the following keywords:
1322.Bl -tag -width indent
1323.It Cm ip4 | ipv4
1324Matches IPv4 packets.
1325.It Cm ip6 | ipv6
1326Matches IPv6 packets.
1327.It Cm ip | all
1328Matches any packet.
1329.El
1330.Pp
1331The
1332.Cm ipv6
1333in
1334.Cm proto
1335option will be treated as inner protocol.
1336And, the
1337.Cm ipv4
1338is not available in
1339.Cm proto
1340option.
1341.Pp
1342The
1343.Cm { Ar protocol Cm or ... }
1344format (an
1345.Em or-block )
1346is provided for convenience only but its use is deprecated.
1347.It Ar src No and Ar dst : Bro Cm addr | Cm { Ar addr Cm or ... } Brc Op Oo Cm not Oc Ar ports
1348An address (or a list, see below)
1349optionally followed by
1350.Ar ports
1351specifiers.
1352.Pp
1353The second format
1354.Em ( or-block
1355with multiple addresses) is provided for convenience only and
1356its use is discouraged.
1357.It Ar addr : Oo Cm not Oc Bro
1358.Cm any | me | me6 |
1359.Cm table Ns Pq Ar name Ns Op , Ns Ar value
1360.Ar | addr-list | addr-set
1361.Brc
1362.Bl -tag -width indent
1363.It Cm any
1364Matches any IP address.
1365.It Cm me
1366Matches any IP address configured on an interface in the system.
1367.It Cm me6
1368Matches any IPv6 address configured on an interface in the system.
1369The address list is evaluated at the time the packet is
1370analysed.
1371.It Cm table Ns Pq Ar name Ns Op , Ns Ar value
1372Matches any IPv4 or IPv6 address for which an entry exists in the lookup table
1373.Ar number .
1374If an optional 32-bit unsigned
1375.Ar value
1376is also specified, an entry will match only if it has this value.
1377See the
1378.Sx LOOKUP TABLES
1379section below for more information on lookup tables.
1380.El
1381.It Ar addr-list : ip-addr Ns Op Ns , Ns Ar addr-list
1382.It Ar ip-addr :
1383A host or subnet address specified in one of the following ways:
1384.Bl -tag -width indent
1385.It Ar numeric-ip | hostname
1386Matches a single IPv4 address, specified as dotted-quad or a hostname.
1387Hostnames are resolved at the time the rule is added to the firewall list.
1388.It Ar addr Ns / Ns Ar masklen
1389Matches all addresses with base
1390.Ar addr
1391(specified as an IP address, a network number, or a hostname)
1392and mask width of
1393.Cm masklen
1394bits.
1395As an example, 1.2.3.4/25 or 1.2.3.0/25 will match
1396all IP numbers from 1.2.3.0 to 1.2.3.127 .
1397.It Ar addr Ns : Ns Ar mask
1398Matches all addresses with base
1399.Ar addr
1400(specified as an IP address, a network number, or a hostname)
1401and the mask of
1402.Ar mask ,
1403specified as a dotted quad.
1404As an example, 1.2.3.4:255.0.255.0 or 1.0.3.0:255.0.255.0 will match
14051.*.3.*.
1406This form is advised only for non-contiguous
1407masks.
1408It is better to resort to the
1409.Ar addr Ns / Ns Ar masklen
1410format for contiguous masks, which is more compact and less
1411error-prone.
1412.El
1413.It Ar addr-set : addr Ns Oo Ns / Ns Ar masklen Oc Ns Cm { Ns Ar list Ns Cm }
1414.It Ar list : Bro Ar num | num-num Brc Ns Op Ns , Ns Ar list
1415Matches all addresses with base address
1416.Ar addr
1417(specified as an IP address, a network number, or a hostname)
1418and whose last byte is in the list between braces { } .
1419Note that there must be no spaces between braces and
1420numbers (spaces after commas are allowed).
1421Elements of the list can be specified as single entries
1422or ranges.
1423The
1424.Ar masklen
1425field is used to limit the size of the set of addresses,
1426and can have any value between 24 and 32.
1427If not specified,
1428it will be assumed as 24.
1429.br
1430This format is particularly useful to handle sparse address sets
1431within a single rule.
1432Because the matching occurs using a
1433bitmask, it takes constant time and dramatically reduces
1434the complexity of rulesets.
1435.br
1436As an example, an address specified as 1.2.3.4/24{128,35-55,89}
1437or 1.2.3.0/24{128,35-55,89}
1438will match the following IP addresses:
1439.br
14401.2.3.128, 1.2.3.35 to 1.2.3.55, 1.2.3.89 .
1441.It Ar addr6-list : ip6-addr Ns Op Ns , Ns Ar addr6-list
1442.It Ar ip6-addr :
1443A host or subnet specified one of the following ways:
1444.Bl -tag -width indent
1445.It Ar numeric-ip | hostname
1446Matches a single IPv6 address as allowed by
1447.Xr inet_pton 3
1448or a hostname.
1449Hostnames are resolved at the time the rule is added to the firewall
1450list.
1451.It Ar addr Ns / Ns Ar masklen
1452Matches all IPv6 addresses with base
1453.Ar addr
1454(specified as allowed by
1455.Xr inet_pton 3
1456or a hostname)
1457and mask width of
1458.Cm masklen
1459bits.
1460.It Ar addr Ns / Ns Ar mask
1461Matches all IPv6 addresses with base
1462.Ar addr
1463(specified as allowed by
1464.Xr inet_pton 3
1465or a hostname)
1466and the mask of
1467.Ar mask ,
1468specified as allowed by
1469.Xr inet_pton 3 .
1470As an example, fe::640:0:0/ffff::ffff:ffff:0:0 will match
1471fe:*:*:*:0:640:*:*.
1472This form is advised only for non-contiguous
1473masks.
1474It is better to resort to the
1475.Ar addr Ns / Ns Ar masklen
1476format for contiguous masks, which is more compact and less
1477error-prone.
1478.El
1479.Pp
1480No support for sets of IPv6 addresses is provided because IPv6 addresses
1481are typically random past the initial prefix.
1482.It Ar ports : Bro Ar port | port Ns \&- Ns Ar port Ns Brc Ns Op , Ns Ar ports
1483For protocols which support port numbers (such as SCTP, TCP and UDP), optional
1484.Cm ports
1485may be specified as one or more ports or port ranges, separated
1486by commas but no spaces, and an optional
1487.Cm not
1488operator.
1489The
1490.Ql \&-
1491notation specifies a range of ports (including boundaries).
1492.Pp
1493Service names (from
1494.Pa /etc/services )
1495may be used instead of numeric port values.
1496The length of the port list is limited to 30 ports or ranges,
1497though one can specify larger ranges by using an
1498.Em or-block
1499in the
1500.Cm options
1501section of the rule.
1502.Pp
1503A backslash
1504.Pq Ql \e
1505can be used to escape the dash
1506.Pq Ql -
1507character in a service name (from a shell, the backslash must be
1508typed twice to avoid the shell itself interpreting it as an escape
1509character).
1510.Pp
1511.Dl "ipfw add count tcp from any ftp\e\e-data-ftp to any"
1512.Pp
1513Fragmented packets which have a non-zero offset (i.e., not the first
1514fragment) will never match a rule which has one or more port
1515specifications.
1516See the
1517.Cm frag
1518option for details on matching fragmented packets.
1519.El
1520.Ss RULE OPTIONS (MATCH PATTERNS)
1521Additional match patterns can be used within
1522rules.
1523Zero or more of these so-called
1524.Em options
1525can be present in a rule, optionally prefixed by the
1526.Cm not
1527operand, and possibly grouped into
1528.Em or-blocks .
1529.Pp
1530The following match patterns can be used (listed in alphabetical order):
1531.Bl -tag -width indent
1532.It Cm // this is a comment .
1533Inserts the specified text as a comment in the rule.
1534Everything following // is considered as a comment and stored in the rule.
1535You can have comment-only rules, which are listed as having a
1536.Cm count
1537action followed by the comment.
1538.It Cm bridged
1539Alias for
1540.Cm layer2 .
1541.It Cm defer-immediate-action | defer-action
1542A rule with this option will not perform normal action
1543upon a match.
1544This option is intended to be used with
1545.Cm record-state
1546or
1547.Cm keep-state
1548as the dynamic rule, created but ignored on match, will work
1549as intended.
1550Rules with both
1551.Cm record-state
1552and
1553.Cm defer-immediate-action
1554create a dynamic rule and continue with the next rule without actually
1555performing the action part of this rule.
1556When the rule is later activated via the state table, the action is
1557performed as usual.
1558.It Cm diverted
1559Matches only packets generated by a divert socket.
1560.It Cm diverted-loopback
1561Matches only packets coming from a divert socket back into the IP stack
1562input for delivery.
1563.It Cm diverted-output
1564Matches only packets going from a divert socket back outward to the IP
1565stack output for delivery.
1566.It Cm dst-ip Ar ip-address
1567Matches IPv4 packets whose destination IP is one of the address(es)
1568specified as argument.
1569.It Bro Cm dst-ip6 | dst-ipv6 Brc Ar ip6-address
1570Matches IPv6 packets whose destination IP is one of the address(es)
1571specified as argument.
1572.It Cm dst-port Ar ports
1573Matches IP packets whose destination port is one of the port(s)
1574specified as argument.
1575.It Cm established
1576Matches TCP packets that have the RST or ACK bits set.
1577.It Cm ext6hdr Ar header
1578Matches IPv6 packets containing the extended header given by
1579.Ar header .
1580Supported headers are:
1581.Pp
1582Fragment,
1583.Pq Cm frag ,
1584Hop-to-hop options
1585.Pq Cm hopopt ,
1586any type of Routing Header
1587.Pq Cm route ,
1588Source routing Routing Header Type 0
1589.Pq Cm rthdr0 ,
1590Mobile IPv6 Routing Header Type 2
1591.Pq Cm rthdr2 ,
1592Destination options
1593.Pq Cm dstopt ,
1594IPSec authentication headers
1595.Pq Cm ah ,
1596and IPsec encapsulated security payload headers
1597.Pq Cm esp .
1598.It Cm fib Ar fibnum
1599Matches a packet that has been tagged to use
1600the given FIB (routing table) number.
1601.It Cm flow Ar table Ns Pq Ar name Ns Op , Ns Ar value
1602Search for the flow entry in lookup table
1603.Ar name .
1604If not found, the match fails.
1605Otherwise, the match succeeds and
1606.Cm tablearg
1607is set to the value extracted from the table.
1608.Pp
1609This option can be useful to quickly dispatch traffic based on
1610certain packet fields.
1611See the
1612.Sx LOOKUP TABLES
1613section below for more information on lookup tables.
1614.It Cm flow-id Ar labels
1615Matches IPv6 packets containing any of the flow labels given in
1616.Ar labels .
1617.Ar labels
1618is a comma separated list of numeric flow labels.
1619.It Cm dst-mac Ar table Ns Pq Ar name Ns Op , Ns Ar value
1620Search for the destination MAC address entry in lookup table
1621.Ar name .
1622If not found, the match fails.
1623Otherwise, the match succeeds and
1624.Cm tablearg
1625is set to the value extracted from the table.
1626.It Cm src-mac Ar table Ns Pq Ar name Ns Op , Ns Ar value
1627Search for the source MAC address entry in lookup table
1628.Ar name .
1629If not found, the match fails.
1630Otherwise, the match succeeds and
1631.Cm tablearg
1632is set to the value extracted from the table.
1633.It Cm frag Ar spec
1634Matches IPv4 packets whose
1635.Cm ip_off
1636field contains the comma separated list of IPv4 fragmentation
1637options specified in
1638.Ar spec .
1639The recognized options are:
1640.Cm df
1641.Pq Dv don't fragment ,
1642.Cm mf
1643.Pq Dv more fragments ,
1644.Cm rf
1645.Pq Dv reserved fragment bit
1646.Cm offset
1647.Pq Dv non-zero fragment offset .
1648The absence of a particular options may be denoted
1649with a
1650.Ql \&! .
1651.Pp
1652Empty list of options defaults to matching on non-zero fragment offset.
1653Such rule would match all not the first fragment datagrams,
1654both IPv4 and IPv6.
1655This is a backward compatibility with older rulesets.
1656.It Cm gid Ar group
1657Matches all TCP or UDP packets sent by or received for a
1658.Ar group .
1659A
1660.Ar group
1661may be specified by name or number.
1662.It Cm jail Ar jail
1663Matches all TCP or UDP packets sent by or received for the
1664jail whose ID or name is
1665.Ar jail .
1666.It Cm icmptypes Ar types
1667Matches ICMP packets whose ICMP type is in the list
1668.Ar types .
1669The list may be specified as any combination of
1670individual types (numeric) separated by commas.
1671.Em Ranges are not allowed .
1672The supported ICMP types are:
1673.Pp
1674echo reply
1675.Pq Cm 0 ,
1676destination unreachable
1677.Pq Cm 3 ,
1678source quench
1679.Pq Cm 4 ,
1680redirect
1681.Pq Cm 5 ,
1682echo request
1683.Pq Cm 8 ,
1684router advertisement
1685.Pq Cm 9 ,
1686router solicitation
1687.Pq Cm 10 ,
1688time-to-live exceeded
1689.Pq Cm 11 ,
1690IP header bad
1691.Pq Cm 12 ,
1692timestamp request
1693.Pq Cm 13 ,
1694timestamp reply
1695.Pq Cm 14 ,
1696information request
1697.Pq Cm 15 ,
1698information reply
1699.Pq Cm 16 ,
1700address mask request
1701.Pq Cm 17
1702and address mask reply
1703.Pq Cm 18 .
1704.It Cm icmp6types Ar types
1705Matches ICMP6 packets whose ICMP6 type is in the list of
1706.Ar types .
1707The list may be specified as any combination of
1708individual types (numeric) separated by commas.
1709.Em Ranges are not allowed .
1710.It Cm in | out
1711Matches incoming or outgoing packets, respectively.
1712.Cm in
1713and
1714.Cm out
1715are mutually exclusive (in fact,
1716.Cm out
1717is implemented as
1718.Cm not in Ns No ).
1719.It Cm ipid Ar id-list
1720Matches IPv4 packets whose
1721.Cm ip_id
1722field has value included in
1723.Ar id-list ,
1724which is either a single value or a list of values or ranges
1725specified in the same way as
1726.Ar ports .
1727.It Cm iplen Ar len-list
1728Matches IP packets whose total length, including header and data, is
1729in the set
1730.Ar len-list ,
1731which is either a single value or a list of values or ranges
1732specified in the same way as
1733.Ar ports .
1734.It Cm ipoptions Ar spec
1735Matches packets whose IPv4 header contains the comma separated list of
1736options specified in
1737.Ar spec .
1738The supported IP options are:
1739.Pp
1740.Cm ssrr
1741(strict source route),
1742.Cm lsrr
1743(loose source route),
1744.Cm rr
1745(record packet route) and
1746.Cm ts
1747(timestamp).
1748The absence of a particular option may be denoted
1749with a
1750.Ql \&! .
1751.It Cm ipprecedence Ar precedence
1752Matches IPv4 packets whose precedence field is equal to
1753.Ar precedence .
1754.It Cm ipsec
1755Matches packets that have IPSEC history associated with them
1756(i.e., the packet comes encapsulated in IPSEC, the kernel
1757has IPSEC support, and can correctly decapsulate it).
1758.Pp
1759Note that specifying
1760.Cm ipsec
1761is different from specifying
1762.Cm proto Ar ipsec
1763as the latter will only look at the specific IP protocol field,
1764irrespective of IPSEC kernel support and the validity of the IPSEC data.
1765.Pp
1766Further note that this flag is silently ignored in kernels without
1767IPSEC support.
1768It does not affect rule processing when given and the
1769rules are handled as if with no
1770.Cm ipsec
1771flag.
1772.It Cm iptos Ar spec
1773Matches IPv4 packets whose
1774.Cm tos
1775field contains the comma separated list of
1776service types specified in
1777.Ar spec .
1778The supported IP types of service are:
1779.Pp
1780.Cm lowdelay
1781.Pq Dv IPTOS_LOWDELAY ,
1782.Cm throughput
1783.Pq Dv IPTOS_THROUGHPUT ,
1784.Cm reliability
1785.Pq Dv IPTOS_RELIABILITY ,
1786.Cm mincost
1787.Pq Dv IPTOS_MINCOST ,
1788.Cm congestion
1789.Pq Dv IPTOS_ECN_CE .
1790The absence of a particular type may be denoted
1791with a
1792.Ql \&! .
1793.It Cm dscp spec Ns Op , Ns Ar spec
1794Matches IPv4/IPv6 packets whose
1795.Cm DS
1796field value is contained in
1797.Ar spec
1798mask.
1799Multiple values can be specified via
1800the comma separated list.
1801Value can be one of keywords used in
1802.Cm setdscp
1803action or exact number.
1804.It Cm ipttl Ar ttl-list
1805Matches IPv4 packets whose time to live is included in
1806.Ar ttl-list ,
1807which is either a single value or a list of values or ranges
1808specified in the same way as
1809.Ar ports .
1810.It Cm ipversion Ar ver
1811Matches IP packets whose IP version field is
1812.Ar ver .
1813.It Cm keep-state Op Ar :flowname
1814Upon a match, the firewall will create a dynamic rule, whose
1815default behaviour is to match bidirectional traffic between
1816source and destination IP/port using the same protocol.
1817The rule has a limited lifetime (controlled by a set of
1818.Xr sysctl 8
1819variables), and the lifetime is refreshed every time a matching
1820packet is found.
1821The
1822.Ar :flowname
1823is used to assign additional to addresses, ports and protocol parameter
1824to dynamic rule.
1825It can be used for more accurate matching by
1826.Cm check-state
1827rule.
1828The
1829.Cm :default
1830keyword is special name used for compatibility with old rulesets.
1831.It Cm layer2
1832Matches only layer2 packets, i.e., those passed to
1833.Nm
1834from
1835.Fn ether_demux
1836and
1837.Fn ether_output_frame .
1838.It Cm limit Bro Cm src-addr | src-port | dst-addr | dst-port Brc Ar N Op Ar :flowname
1839The firewall will only allow
1840.Ar N
1841connections with the same
1842set of parameters as specified in the rule.
1843One or more
1844of source and destination addresses and ports can be
1845specified.
1846.It Cm lookup Bro Cm dst-ip | dst-port | dst-mac | src-ip | src-port | src-mac | uid | jail Brc Ar name
1847Search an entry in lookup table
1848.Ar name
1849that matches the field specified as argument.
1850If not found, the match fails.
1851Otherwise, the match succeeds and
1852.Cm tablearg
1853is set to the value extracted from the table.
1854.Pp
1855This option can be useful to quickly dispatch traffic based on
1856certain packet fields.
1857See the
1858.Sx LOOKUP TABLES
1859section below for more information on lookup tables.
1860.It Cm { MAC | mac } Ar dst-mac src-mac
1861Match packets with a given
1862.Ar dst-mac
1863and
1864.Ar src-mac
1865addresses, specified as the
1866.Cm any
1867keyword (matching any MAC address), or six groups of hex digits
1868separated by colons,
1869and optionally followed by a mask indicating the significant bits.
1870The mask may be specified using either of the following methods:
1871.Bl -enum -width indent
1872.It
1873A slash
1874.Pq /
1875followed by the number of significant bits.
1876For example, an address with 33 significant bits could be specified as:
1877.Pp
1878.Dl "MAC 10:20:30:40:50:60/33 any"
1879.It
1880An ampersand
1881.Pq &
1882followed by a bitmask specified as six groups of hex digits separated
1883by colons.
1884For example, an address in which the last 16 bits are significant could
1885be specified as:
1886.Pp
1887.Dl "MAC 10:20:30:40:50:60&00:00:00:00:ff:ff any"
1888.Pp
1889Note that the ampersand character has a special meaning in many shells
1890and should generally be escaped.
1891.El
1892Note that the order of MAC addresses (destination first,
1893source second) is
1894the same as on the wire, but the opposite of the one used for
1895IP addresses.
1896.It Cm mac-type Ar mac-type
1897Matches packets whose Ethernet Type field
1898corresponds to one of those specified as argument.
1899.Ar mac-type
1900is specified in the same way as
1901.Cm port numbers
1902(i.e., one or more comma-separated single values or ranges).
1903You can use symbolic names for known values such as
1904.Em vlan , ipv4, ipv6 .
1905Values can be entered as decimal or hexadecimal (if prefixed by 0x),
1906and they are always printed as hexadecimal (unless the
1907.Cm -N
1908option is used, in which case symbolic resolution will be attempted).
1909.It Cm proto Ar protocol
1910Matches packets with the corresponding IP protocol.
1911.It Cm record-state
1912Upon a match, the firewall will create a dynamic rule as if
1913.Cm keep-state
1914was specified.
1915However, this option doesn't imply an implicit
1916.Cm check-state
1917in contrast to
1918.Cm keep-state .
1919.It Cm recv | xmit | via Brq Ar ifX | Ar if Ns Cm * | Ar table Ns Po Ar name Ns Oo , Ns Ar value Oc Pc | Ar ipno | Ar any
1920Matches packets received, transmitted or going through,
1921respectively, the interface specified by exact name
1922.Po Ar ifX Pc ,
1923by device name
1924.Po Ar if* Pc ,
1925by IP address, or through some interface.
1926Table
1927.Ar name
1928may be used to match interface by its kernel ifindex.
1929See the
1930.Sx LOOKUP TABLES
1931section below for more information on lookup tables.
1932.Pp
1933The
1934.Cm via
1935keyword causes the interface to always be checked.
1936If
1937.Cm recv
1938or
1939.Cm xmit
1940is used instead of
1941.Cm via ,
1942then only the receive or transmit interface (respectively)
1943is checked.
1944By specifying both, it is possible to match packets based on
1945both receive and transmit interface, e.g.:
1946.Pp
1947.Dl "ipfw add deny ip from any to any out recv ed0 xmit ed1"
1948.Pp
1949The
1950.Cm recv
1951interface can be tested on either incoming or outgoing packets,
1952while the
1953.Cm xmit
1954interface can only be tested on outgoing packets.
1955So
1956.Cm out
1957is required (and
1958.Cm in
1959is invalid) whenever
1960.Cm xmit
1961is used.
1962.Pp
1963A packet might not have a receive or transmit interface: packets
1964originating from the local host have no receive interface,
1965while packets destined for the local host have no transmit
1966interface.
1967.It Cm set-limit Bro Cm src-addr | src-port | dst-addr | dst-port Brc Ar N
1968Works like
1969.Cm limit
1970but does not have an implicit
1971.Cm check-state
1972attached to it.
1973.It Cm setup
1974Matches TCP packets that have the SYN bit set but no ACK bit.
1975This is the short form of
1976.Dq Li tcpflags\ syn,!ack .
1977.It Cm sockarg
1978Matches packets that are associated to a local socket and
1979for which the SO_USER_COOKIE socket option has been set
1980to a non-zero value.
1981As a side effect, the value of the
1982option is made available as
1983.Cm tablearg
1984value, which in turn can be used as
1985.Cm skipto
1986or
1987.Cm pipe
1988number.
1989.It Cm src-ip Ar ip-address
1990Matches IPv4 packets whose source IP is one of the address(es)
1991specified as an argument.
1992.It Cm src-ip6 Ar ip6-address
1993Matches IPv6 packets whose source IP is one of the address(es)
1994specified as an argument.
1995.It Cm src-port Ar ports
1996Matches IP packets whose source port is one of the port(s)
1997specified as argument.
1998.It Cm tagged Ar tag-list
1999Matches packets whose tags are included in
2000.Ar tag-list ,
2001which is either a single value or a list of values or ranges
2002specified in the same way as
2003.Ar ports .
2004Tags can be applied to the packet using
2005.Cm tag
2006rule action parameter (see it's description for details on tags).
2007.It Cm tcpack Ar ack
2008TCP packets only.
2009Match if the TCP header acknowledgment number field is set to
2010.Ar ack .
2011.It Cm tcpdatalen Ar tcpdatalen-list
2012Matches TCP packets whose length of TCP data is
2013.Ar tcpdatalen-list ,
2014which is either a single value or a list of values or ranges
2015specified in the same way as
2016.Ar ports .
2017.It Cm tcpflags Ar spec
2018TCP packets only.
2019Match if the TCP header contains the comma separated list of
2020flags specified in
2021.Ar spec .
2022The supported TCP flags are:
2023.Pp
2024.Cm fin ,
2025.Cm syn ,
2026.Cm rst ,
2027.Cm psh ,
2028.Cm ack
2029and
2030.Cm urg .
2031The absence of a particular flag may be denoted
2032with a
2033.Ql \&! .
2034A rule which contains a
2035.Cm tcpflags
2036specification can never match a fragmented packet which has
2037a non-zero offset.
2038See the
2039.Cm frag
2040option for details on matching fragmented packets.
2041.It Cm tcpmss Ar tcpmss-list
2042Matches TCP packets whose MSS (maximum segment size) value is set to
2043.Ar tcpmss-list ,
2044which is either a single value or a list of values or ranges
2045specified in the same way as
2046.Ar ports .
2047.It Cm tcpseq Ar seq
2048TCP packets only.
2049Match if the TCP header sequence number field is set to
2050.Ar seq .
2051.It Cm tcpwin Ar tcpwin-list
2052Matches TCP packets whose  header window field is set to
2053.Ar tcpwin-list ,
2054which is either a single value or a list of values or ranges
2055specified in the same way as
2056.Ar ports .
2057.It Cm tcpoptions Ar spec
2058TCP packets only.
2059Match if the TCP header contains the comma separated list of
2060options specified in
2061.Ar spec .
2062The supported TCP options are:
2063.Pp
2064.Cm mss
2065(maximum segment size),
2066.Cm window
2067(tcp window advertisement),
2068.Cm sack
2069(selective ack),
2070.Cm ts
2071(rfc1323 timestamp) and
2072.Cm cc
2073(rfc1644 t/tcp connection count).
2074The absence of a particular option may be denoted
2075with a
2076.Ql \&! .
2077.It Cm uid Ar user
2078Match all TCP or UDP packets sent by or received for a
2079.Ar user .
2080A
2081.Ar user
2082may be matched by name or identification number.
2083.It Cm verrevpath
2084For incoming packets,
2085a routing table lookup is done on the packet's source address.
2086If the interface on which the packet entered the system matches the
2087outgoing interface for the route,
2088the packet matches.
2089If the interfaces do not match up,
2090the packet does not match.
2091All outgoing packets or packets with no incoming interface match.
2092.Pp
2093The name and functionality of the option is intentionally similar to
2094the Cisco IOS command:
2095.Pp
2096.Dl ip verify unicast reverse-path
2097.Pp
2098This option can be used to make anti-spoofing rules to reject all
2099packets with source addresses not from this interface.
2100See also the option
2101.Cm antispoof .
2102.It Cm versrcreach
2103For incoming packets,
2104a routing table lookup is done on the packet's source address.
2105If a route to the source address exists, but not the default route
2106or a blackhole/reject route, the packet matches.
2107Otherwise, the packet does not match.
2108All outgoing packets match.
2109.Pp
2110The name and functionality of the option is intentionally similar to
2111the Cisco IOS command:
2112.Pp
2113.Dl ip verify unicast source reachable-via any
2114.Pp
2115This option can be used to make anti-spoofing rules to reject all
2116packets whose source address is unreachable.
2117.It Cm antispoof
2118For incoming packets, the packet's source address is checked if it
2119belongs to a directly connected network.
2120If the network is directly connected, then the interface the packet
2121came on in is compared to the interface the network is connected to.
2122When incoming interface and directly connected interface are not the
2123same, the packet does not match.
2124Otherwise, the packet does match.
2125All outgoing packets match.
2126.Pp
2127This option can be used to make anti-spoofing rules to reject all
2128packets that pretend to be from a directly connected network but do
2129not come in through that interface.
2130This option is similar to but more restricted than
2131.Cm verrevpath
2132because it engages only on packets with source addresses of directly
2133connected networks instead of all source addresses.
2134.El
2135.Sh LOOKUP TABLES
2136Lookup tables are useful to handle large sparse sets of
2137addresses or other search keys (e.g., ports, jail IDs, interface names).
2138In the rest of this section we will use the term ``key''.
2139Table name needs to match the following spec:
2140.Ar table-name .
2141Tables with the same name can be created in different
2142.Ar sets .
2143However, rule links to the tables in
2144.Ar set 0
2145by default.
2146This behavior can be controlled by
2147.Va net.inet.ip.fw.tables_sets
2148variable.
2149See the
2150.Sx SETS OF RULES
2151section for more information.
2152There may be up to 65535 different lookup tables.
2153.Pp
2154The following table types are supported:
2155.Bl -tag -width indent
2156.It Ar table-type : Ar addr | iface | number | flow | mac
2157.It Ar table-key : Ar addr Ns Oo / Ns Ar masklen Oc | iface-name | number | flow-spec
2158.It Ar flow-spec : Ar flow-field Ns Op , Ns Ar flow-spec
2159.It Ar flow-field : src-ip | proto | src-port | dst-ip | dst-port
2160.It Cm addr
2161Matches IPv4 or IPv6 address.
2162Each entry is represented by an
2163.Ar addr Ns Op / Ns Ar masklen
2164and will match all addresses with base
2165.Ar addr
2166(specified as an IPv4/IPv6 address, or a hostname) and mask width of
2167.Ar masklen
2168bits.
2169If
2170.Ar masklen
2171is not specified, it defaults to 32 for IPv4 and 128 for IPv6.
2172When looking up an IP address in a table, the most specific
2173entry will match.
2174.It Cm iface
2175Matches interface names.
2176Each entry is represented by string treated as interface name.
2177Wildcards are not supported.
2178.It Cm number
2179Matches protocol ports, uids/gids or jail IDs.
2180Each entry is represented by 32-bit unsigned integer.
2181Ranges are not supported.
2182.It Cm flow
2183Matches packet fields specified by
2184.Ar flow
2185type suboptions with table entries.
2186.It Cm mac
2187Matches MAC address.
2188Each entry is represented by an
2189.Ar addr Ns Op / Ns Ar masklen
2190and will match all addresses with base
2191.Ar addr
2192and mask width of
2193.Ar masklen
2194bits.
2195If
2196.Ar masklen
2197is not specified, it defaults to 48.
2198When looking up an MAC address in a table, the most specific
2199entry will match.
2200.El
2201.Pp
2202Tables require explicit creation via
2203.Cm create
2204before use.
2205.Pp
2206The following creation options are supported:
2207.Bl -tag -width indent
2208.It Ar create-options : Ar create-option | create-options
2209.It Ar create-option : Cm type Ar table-type | Cm valtype Ar value-mask | Cm algo Ar algo-desc |
2210.Cm limit Ar number | Cm locked | Cm missing | Cm or-flush
2211.It Cm type
2212Table key type.
2213.It Cm valtype
2214Table value mask.
2215.It Cm algo
2216Table algorithm to use (see below).
2217.It Cm limit
2218Maximum number of items that may be inserted into table.
2219.It Cm locked
2220Restrict any table modifications.
2221.It Cm missing
2222Do not fail if table already exists and has exactly same options as new one.
2223.It Cm or-flush
2224Flush existing table with same name instead of returning error.
2225Implies
2226.Cm missing
2227so existing table must be compatible with new one.
2228.El
2229.Pp
2230Some of these options may be modified later via
2231.Cm modify
2232keyword.
2233The following options can be changed:
2234.Bl -tag -width indent
2235.It Ar modify-options : Ar modify-option | modify-options
2236.It Ar modify-option : Cm limit Ar number
2237.It Cm limit
2238Alter maximum number of items that may be inserted into table.
2239.El
2240.Pp
2241Additionally, table can be locked or unlocked using
2242.Cm lock
2243or
2244.Cm unlock
2245commands.
2246.Pp
2247Tables of the same
2248.Ar type
2249can be swapped with each other using
2250.Cm swap Ar name
2251command.
2252Swap may fail if tables limits are set and data exchange
2253would result in limits hit.
2254Operation is performed atomically.
2255.Pp
2256One or more entries can be added to a table at once using
2257.Cm add
2258command.
2259Addition of all items are performed atomically.
2260By default, error in addition of one entry does not influence
2261addition of other entries.
2262However, non-zero error code is returned in that case.
2263Special
2264.Cm atomic
2265keyword may be specified before
2266.Cm add
2267to indicate all-or-none add request.
2268.Pp
2269One or more entries can be removed from a table at once using
2270.Cm delete
2271command.
2272By default, error in removal of one entry does not influence
2273removing of other entries.
2274However, non-zero error code is returned in that case.
2275.Pp
2276It may be possible to check what entry will be found on particular
2277.Ar table-key
2278using
2279.Cm lookup
2280.Ar table-key
2281command.
2282This functionality is optional and may be unsupported in some algorithms.
2283.Pp
2284The following operations can be performed on
2285.Ar one
2286or
2287.Cm all
2288tables:
2289.Bl -tag -width indent
2290.It Cm list
2291List all entries.
2292.It Cm flush
2293Removes all entries.
2294.It Cm info
2295Shows generic table information.
2296.It Cm detail
2297Shows generic table information and algo-specific data.
2298.El
2299.Pp
2300The following lookup algorithms are supported:
2301.Bl -tag -width indent
2302.It Ar algo-desc : algo-name | "algo-name algo-data"
2303.It Ar algo-name : Ar addr: radix | addr: hash | iface: array | number: array | flow: hash | mac: radix
2304.It Cm addr: radix
2305Separate Radix trees for IPv4 and IPv6, the same way as the routing table (see
2306.Xr route 4 ) .
2307Default choice for
2308.Ar addr
2309type.
2310.It Cm addr:hash
2311Separate auto-growing hashes for IPv4 and IPv6.
2312Accepts entries with the same mask length specified initially via
2313.Cm "addr:hash masks=/v4,/v6"
2314algorithm creation options.
2315Assume /32 and /128 masks by default.
2316Search removes host bits (according to mask) from supplied address and checks
2317resulting key in appropriate hash.
2318Mostly optimized for /64 and byte-ranged IPv6 masks.
2319.It Cm iface:array
2320Array storing sorted indexes for entries which are presented in the system.
2321Optimized for very fast lookup.
2322.It Cm number:array
2323Array storing sorted u32 numbers.
2324.It Cm flow:hash
2325Auto-growing hash storing flow entries.
2326Search calculates hash on required packet fields and searches for matching
2327entries in selected bucket.
2328.It Cm mac: radix
2329Radix tree for MAC address
2330.El
2331.Pp
2332The
2333.Cm tablearg
2334feature provides the ability to use a value, looked up in the table, as
2335the argument for a rule action, action parameter or rule option.
2336This can significantly reduce number of rules in some configurations.
2337If two tables are used in a rule, the result of the second (destination)
2338is used.
2339.Pp
2340Each record may hold one or more values according to
2341.Ar value-mask .
2342This mask is set on table creation via
2343.Cm valtype
2344option.
2345The following value types are supported:
2346.Bl -tag -width indent
2347.It Ar value-mask : Ar value-type Ns Op , Ns Ar value-mask
2348.It Ar value-type : Ar skipto | pipe | fib | nat | dscp | tag | divert |
2349.Ar netgraph | limit | ipv4
2350.It Cm skipto
2351rule number to jump to.
2352.It Cm pipe
2353Pipe number to use.
2354.It Cm fib
2355fib number to match/set.
2356.It Cm nat
2357nat number to jump to.
2358.It Cm dscp
2359dscp value to match/set.
2360.It Cm tag
2361tag number to match/set.
2362.It Cm divert
2363port number to divert traffic to.
2364.It Cm netgraph
2365hook number to move packet to.
2366.It Cm limit
2367maximum number of connections.
2368.It Cm ipv4
2369IPv4 nexthop to fwd packets to.
2370.It Cm ipv6
2371IPv6 nexthop to fwd packets to.
2372.El
2373.Pp
2374The
2375.Cm tablearg
2376argument can be used with the following actions:
2377.Cm nat, pipe, queue, divert, tee, netgraph, ngtee, fwd, skipto, setfib ,
2378action parameters:
2379.Cm tag, untag ,
2380rule options:
2381.Cm limit, tagged .
2382.Pp
2383When used with the
2384.Cm skipto
2385action, the user should be aware that the code will walk the ruleset
2386up to a rule equal to, or past, the given number.
2387.Pp
2388See the
2389.Sx EXAMPLES
2390Section for example usage of tables and the tablearg keyword.
2391.Sh SETS OF RULES
2392Each rule or table belongs to one of 32 different
2393.Em sets
2394, numbered 0 to 31.
2395Set 31 is reserved for the default rule.
2396.Pp
2397By default, rules or tables are put in set 0, unless you use the
2398.Cm set N
2399attribute when adding a new rule or table.
2400Sets can be individually and atomically enabled or disabled,
2401so this mechanism permits an easy way to store multiple configurations
2402of the firewall and quickly (and atomically) switch between them.
2403.Pp
2404By default, tables from set 0 are referenced when adding rule with
2405table opcodes regardless of rule set.
2406This behavior can be changed by setting
2407.Va net.inet.ip.fw.tables_sets
2408variable to 1.
2409Rule's set will then be used for table references.
2410.Pp
2411The command to enable/disable sets is
2412.Bd -ragged -offset indent
2413.Nm
2414.Cm set Oo Cm disable Ar number ... Oc Op Cm enable Ar number ...
2415.Ed
2416.Pp
2417where multiple
2418.Cm enable
2419or
2420.Cm disable
2421sections can be specified.
2422Command execution is atomic on all the sets specified in the command.
2423By default, all sets are enabled.
2424.Pp
2425When you disable a set, its rules behave as if they do not exist
2426in the firewall configuration, with only one exception:
2427.Bd -ragged -offset indent
2428dynamic rules created from a rule before it had been disabled
2429will still be active until they expire.
2430In order to delete
2431dynamic rules you have to explicitly delete the parent rule
2432which generated them.
2433.Ed
2434.Pp
2435The set number of rules can be changed with the command
2436.Bd -ragged -offset indent
2437.Nm
2438.Cm set move
2439.Brq Cm rule Ar rule-number | old-set
2440.Cm to Ar new-set
2441.Ed
2442.Pp
2443Also, you can atomically swap two rulesets with the command
2444.Bd -ragged -offset indent
2445.Nm
2446.Cm set swap Ar first-set second-set
2447.Ed
2448.Pp
2449See the
2450.Sx EXAMPLES
2451Section on some possible uses of sets of rules.
2452.Sh STATEFUL FIREWALL
2453Stateful operation is a way for the firewall to dynamically
2454create rules for specific flows when packets that
2455match a given pattern are detected.
2456Support for stateful
2457operation comes through the
2458.Cm check-state , keep-state , record-state , limit
2459and
2460.Cm set-limit
2461options of
2462.Nm rules .
2463.Pp
2464Dynamic rules are created when a packet matches a
2465.Cm keep-state ,
2466.Cm record-state ,
2467.Cm limit
2468or
2469.Cm set-limit
2470rule, causing the creation of a
2471.Em dynamic
2472rule which will match all and only packets with
2473a given
2474.Em protocol
2475between a
2476.Em src-ip/src-port dst-ip/dst-port
2477pair of addresses
2478.Em ( src
2479and
2480.Em dst
2481are used here only to denote the initial match addresses, but they
2482are completely equivalent afterwards).
2483Rules created by
2484.Cm keep-state
2485option also have a
2486.Ar :flowname
2487taken from it.
2488This name is used in matching together with addresses, ports and protocol.
2489Dynamic rules will be checked at the first
2490.Cm check-state, keep-state
2491or
2492.Cm limit
2493occurrence, and the action performed upon a match will be the same
2494as in the parent rule.
2495.Pp
2496Note that no additional attributes other than protocol and IP addresses
2497and ports and :flowname are checked on dynamic rules.
2498.Pp
2499The typical use of dynamic rules is to keep a closed firewall configuration,
2500but let the first TCP SYN packet from the inside network install a
2501dynamic rule for the flow so that packets belonging to that session
2502will be allowed through the firewall:
2503.Pp
2504.Dl "ipfw add check-state :OUTBOUND"
2505.Dl "ipfw add allow tcp from my-subnet to any setup keep-state :OUTBOUND"
2506.Dl "ipfw add deny tcp from any to any"
2507.Pp
2508A similar approach can be used for UDP, where an UDP packet coming
2509from the inside will install a dynamic rule to let the response through
2510the firewall:
2511.Pp
2512.Dl "ipfw add check-state :OUTBOUND"
2513.Dl "ipfw add allow udp from my-subnet to any keep-state :OUTBOUND"
2514.Dl "ipfw add deny udp from any to any"
2515.Pp
2516Dynamic rules expire after some time, which depends on the status
2517of the flow and the setting of some
2518.Cm sysctl
2519variables.
2520See Section
2521.Sx SYSCTL VARIABLES
2522for more details.
2523For TCP sessions, dynamic rules can be instructed to periodically
2524send keepalive packets to refresh the state of the rule when it is
2525about to expire.
2526.Pp
2527See Section
2528.Sx EXAMPLES
2529for more examples on how to use dynamic rules.
2530.Sh TRAFFIC SHAPER (DUMMYNET) CONFIGURATION
2531.Nm
2532is also the user interface for the
2533.Nm dummynet
2534traffic shaper, packet scheduler and network emulator, a subsystem that
2535can artificially queue, delay or drop packets
2536emulating the behaviour of certain network links
2537or queueing systems.
2538.Pp
2539.Nm dummynet
2540operates by first using the firewall to select packets
2541using any match pattern that can be used in
2542.Nm
2543rules.
2544Matching packets are then passed to either of two
2545different objects, which implement the traffic regulation:
2546.Bl -hang -offset XXXX
2547.It Em pipe
2548A
2549.Em pipe
2550emulates a
2551.Em link
2552with given bandwidth and propagation delay,
2553driven by a FIFO scheduler and a single queue with programmable
2554queue size and packet loss rate.
2555Packets are appended to the queue as they come out from
2556.Nm ipfw ,
2557and then transferred in FIFO order to the link at the desired rate.
2558.It Em queue
2559A
2560.Em queue
2561is an abstraction used to implement packet scheduling
2562using one of several packet scheduling algorithms.
2563Packets sent to a
2564.Em queue
2565are first grouped into flows according to a mask on the 5-tuple.
2566Flows are then passed to the scheduler associated to the
2567.Em queue ,
2568and each flow uses scheduling parameters (weight and others)
2569as configured in the
2570.Em queue
2571itself.
2572A scheduler in turn is connected to an emulated link,
2573and arbitrates the link's bandwidth among backlogged flows according to
2574weights and to the features of the scheduling algorithm in use.
2575.El
2576.Pp
2577In practice,
2578.Em pipes
2579can be used to set hard limits to the bandwidth that a flow can use, whereas
2580.Em queues
2581can be used to determine how different flows share the available bandwidth.
2582.Pp
2583A graphical representation of the binding of queues,
2584flows, schedulers and links is below.
2585.Bd -literal -offset indent
2586                 (flow_mask|sched_mask)  sched_mask
2587         +---------+   weight Wx  +-------------+
2588         |         |->-[flow]-->--|             |-+
2589    -->--| QUEUE x |   ...        |             | |
2590         |         |->-[flow]-->--| SCHEDuler N | |
2591         +---------+              |             | |
2592             ...                  |             +--[LINK N]-->--
2593         +---------+   weight Wy  |             | +--[LINK N]-->--
2594         |         |->-[flow]-->--|             | |
2595    -->--| QUEUE y |   ...        |             | |
2596         |         |->-[flow]-->--|             | |
2597         +---------+              +-------------+ |
2598                                    +-------------+
2599.Ed
2600It is important to understand the role of the SCHED_MASK
2601and FLOW_MASK, which are configured through the commands
2602.Dl "ipfw sched N config mask SCHED_MASK ..."
2603and
2604.Dl "ipfw queue X config mask FLOW_MASK ..." .
2605.Pp
2606The SCHED_MASK is used to assign flows to one or more
2607scheduler instances, one for each
2608value of the packet's 5-tuple after applying SCHED_MASK.
2609As an example, using ``src-ip 0xffffff00'' creates one instance
2610for each /24 destination subnet.
2611.Pp
2612The FLOW_MASK, together with the SCHED_MASK, is used to split
2613packets into flows.
2614As an example, using
2615``src-ip 0x000000ff''
2616together with the previous SCHED_MASK makes a flow for
2617each individual source address.
2618In turn, flows for each /24
2619subnet will be sent to the same scheduler instance.
2620.Pp
2621The above diagram holds even for the
2622.Em pipe
2623case, with the only restriction that a
2624.Em pipe
2625only supports a SCHED_MASK, and forces the use of a FIFO
2626scheduler (these are for backward compatibility reasons;
2627in fact, internally, a
2628.Nm dummynet's
2629pipe is implemented exactly as above).
2630.Pp
2631There are two modes of
2632.Nm dummynet
2633operation:
2634.Dq normal
2635and
2636.Dq fast .
2637The
2638.Dq normal
2639mode tries to emulate a real link: the
2640.Nm dummynet
2641scheduler ensures that the packet will not leave the pipe faster than it
2642would on the real link with a given bandwidth.
2643The
2644.Dq fast
2645mode allows certain packets to bypass the
2646.Nm dummynet
2647scheduler (if packet flow does not exceed pipe's bandwidth).
2648This is the reason why the
2649.Dq fast
2650mode requires less CPU cycles per packet (on average) and packet latency
2651can be significantly lower in comparison to a real link with the same
2652bandwidth.
2653The default mode is
2654.Dq normal .
2655The
2656.Dq fast
2657mode can be enabled by setting the
2658.Va net.inet.ip.dummynet.io_fast
2659.Xr sysctl 8
2660variable to a non-zero value.
2661.Ss PIPE, QUEUE AND SCHEDULER CONFIGURATION
2662The
2663.Em pipe ,
2664.Em queue
2665and
2666.Em scheduler
2667configuration commands are the following:
2668.Bd -ragged -offset indent
2669.Cm pipe Ar number Cm config Ar pipe-configuration
2670.Pp
2671.Cm queue Ar number Cm config Ar queue-configuration
2672.Pp
2673.Cm sched Ar number Cm config Ar sched-configuration
2674.Ed
2675.Pp
2676The following parameters can be configured for a pipe:
2677.Pp
2678.Bl -tag -width indent -compact
2679.It Cm bw Ar bandwidth | device
2680Bandwidth, measured in
2681.Sm off
2682.Op Cm K | M | G
2683.Brq Cm bit/s | Byte/s .
2684.Sm on
2685.Pp
2686A value of 0 (default) means unlimited bandwidth.
2687The unit must immediately follow the number, as in
2688.Pp
2689.Dl "dnctl pipe 1 config bw 300Kbit/s"
2690.Pp
2691If a device name is specified instead of a numeric value, as in
2692.Pp
2693.Dl "dnctl pipe 1 config bw tun0"
2694.Pp
2695then the transmit clock is supplied by the specified device.
2696At the moment only the
2697.Xr tun 4
2698device supports this
2699functionality, for use in conjunction with
2700.Xr ppp 8 .
2701.Pp
2702.It Cm delay Ar ms-delay
2703Propagation delay, measured in milliseconds.
2704The value is rounded to the next multiple of the clock tick
2705(typically 10ms, but it is a good practice to run kernels
2706with
2707.Dq "options HZ=1000"
2708to reduce
2709the granularity to 1ms or less).
2710The default value is 0, meaning no delay.
2711.Pp
2712.It Cm burst Ar size
2713If the data to be sent exceeds the pipe's bandwidth limit
2714(and the pipe was previously idle), up to
2715.Ar size
2716bytes of data are allowed to bypass the
2717.Nm dummynet
2718scheduler, and will be sent as fast as the physical link allows.
2719Any additional data will be transmitted at the rate specified
2720by the
2721.Nm pipe
2722bandwidth.
2723The burst size depends on how long the pipe has been idle;
2724the effective burst size is calculated as follows:
2725MAX(
2726.Ar size
2727,
2728.Nm bw
2729* pipe_idle_time).
2730.Pp
2731.It Cm profile Ar filename
2732A file specifying the additional overhead incurred in the transmission
2733of a packet on the link.
2734.Pp
2735Some link types introduce extra delays in the transmission
2736of a packet, e.g., because of MAC level framing, contention on
2737the use of the channel, MAC level retransmissions and so on.
2738From our point of view, the channel is effectively unavailable
2739for this extra time, which is constant or variable depending
2740on the link type.
2741Additionally, packets may be dropped after this
2742time (e.g., on a wireless link after too many retransmissions).
2743We can model the additional delay with an empirical curve
2744that represents its distribution.
2745.Bd -literal -offset indent
2746      cumulative probability
2747      1.0 ^
2748          |
2749      L   +-- loss-level          x
2750          |                 ******
2751          |                *
2752          |           *****
2753          |          *
2754          |        **
2755          |       *
2756          +-------*------------------->
2757                      delay
2758.Ed
2759The empirical curve may have both vertical and horizontal lines.
2760Vertical lines represent constant delay for a range of
2761probabilities.
2762Horizontal lines correspond to a discontinuity in the delay
2763distribution: the pipe will use the largest delay for a
2764given probability.
2765.Pp
2766The file format is the following, with whitespace acting as
2767a separator and '#' indicating the beginning a comment:
2768.Bl -tag -width indent
2769.It Cm name Ar identifier
2770optional name (listed by "dnctl pipe show")
2771to identify the delay distribution;
2772.It Cm bw Ar value
2773the bandwidth used for the pipe.
2774If not specified here, it must be present
2775explicitly as a configuration parameter for the pipe;
2776.It Cm loss-level Ar L
2777the probability above which packets are lost.
2778(0.0 <= L <= 1.0, default 1.0 i.e., no loss);
2779.It Cm samples Ar N
2780the number of samples used in the internal
2781representation of the curve (2..1024; default 100);
2782.It Cm "delay prob" | "prob delay"
2783One of these two lines is mandatory and defines
2784the format of the following lines with data points.
2785.It Ar XXX Ar YYY
27862 or more lines representing points in the curve,
2787with either delay or probability first, according
2788to the chosen format.
2789The unit for delay is milliseconds.
2790Data points do not need to be sorted.
2791Also, the number of actual lines can be different
2792from the value of the "samples" parameter:
2793.Nm
2794utility will sort and interpolate
2795the curve as needed.
2796.El
2797.Pp
2798Example of a profile file:
2799.Bd -literal -offset indent
2800name    bla_bla_bla
2801samples 100
2802loss-level    0.86
2803prob    delay
28040       200	# minimum overhead is 200ms
28050.5     200
28060.5     300
28070.8     1000
28080.9     1300
28091       1300
2810#configuration file end
2811.Ed
2812.El
2813.Pp
2814The following parameters can be configured for a queue:
2815.Pp
2816.Bl -tag -width indent -compact
2817.It Cm pipe Ar pipe_nr
2818Connects a queue to the specified pipe.
2819Multiple queues (with the same or different weights) can be connected to
2820the same pipe, which specifies the aggregate rate for the set of queues.
2821.Pp
2822.It Cm weight Ar weight
2823Specifies the weight to be used for flows matching this queue.
2824The weight must be in the range 1..100, and defaults to 1.
2825.El
2826.Pp
2827The following case-insensitive parameters can be configured for a
2828scheduler:
2829.Pp
2830.Bl -tag -width indent -compact
2831.It Cm type Ar {fifo | wf2q+ | rr | qfq | fq_codel | fq_pie}
2832specifies the scheduling algorithm to use.
2833.Bl -tag -width indent -compact
2834.It Cm fifo
2835is just a FIFO scheduler (which means that all packets
2836are stored in the same queue as they arrive to the scheduler).
2837FIFO has O(1) per-packet time complexity, with very low
2838constants (estimate 60-80ns on a 2GHz desktop machine)
2839but gives no service guarantees.
2840.It Cm wf2q+
2841implements the WF2Q+ algorithm, which is a Weighted Fair Queueing
2842algorithm which permits flows to share bandwidth according to
2843their weights.
2844Note that weights are not priorities; even a flow
2845with a minuscule weight will never starve.
2846WF2Q+ has O(log N) per-packet processing cost, where N is the number
2847of flows, and is the default algorithm used by previous versions
2848dummynet's queues.
2849.It Cm rr
2850implements the Deficit Round Robin algorithm, which has O(1) processing
2851costs (roughly, 100-150ns per packet)
2852and permits bandwidth allocation according to weights, but
2853with poor service guarantees.
2854.It Cm qfq
2855implements the QFQ algorithm, which is a very fast variant of
2856WF2Q+, with similar service guarantees and O(1) processing
2857costs (roughly, 200-250ns per packet).
2858.It Cm fq_codel
2859implements the FQ-CoDel (FlowQueue-CoDel) scheduler/AQM algorithm, which
2860uses a modified Deficit Round Robin scheduler to manage two lists of sub-queues
2861(old sub-queues and new sub-queues) for providing brief periods of priority to
2862lightweight or short burst flows.
2863By default, the total number of sub-queues is 1024.
2864FQ-CoDel's internal, dynamically
2865created sub-queues are controlled by separate instances of CoDel AQM.
2866.It Cm fq_pie
2867implements the FQ-PIE (FlowQueue-PIE) scheduler/AQM algorithm, which similar to
2868.Cm fq_codel
2869but uses per sub-queue PIE AQM instance to control the queue delay.
2870.El
2871.Pp
2872.Cm fq_codel
2873inherits AQM parameters and options from
2874.Cm codel
2875(see below), and
2876.Cm fq_pie
2877inherits AQM parameters and options from
2878.Cm pie
2879(see below).
2880Additionally, both of
2881.Cm fq_codel
2882and
2883.Cm fq_pie
2884have shared scheduler parameters which are:
2885.Bl -tag -width indent
2886.It Cm quantum
2887.Ar m
2888specifies the quantum (credit) of the scheduler.
2889.Ar m
2890is the number of bytes a queue can serve before being moved to the tail
2891of old queues list.
2892The default is 1514 bytes, and the maximum acceptable value
2893is 9000 bytes.
2894.It Cm limit
2895.Ar m
2896specifies the hard size limit (in unit of packets) of all queues managed by an
2897instance of the scheduler.
2898The default value of
2899.Ar m
2900is 10240 packets, and the maximum acceptable value is 20480 packets.
2901.It Cm flows
2902.Ar m
2903specifies the total number of flow queues (sub-queues) that fq_*
2904creates and manages.
2905By default, 1024 sub-queues are created when an instance
2906of the fq_{codel/pie} scheduler is created.
2907The maximum acceptable value is
290865536.
2909.El
2910.Pp
2911Note that any token after
2912.Cm fq_codel
2913or
2914.Cm fq_pie
2915is considered a parameter for fq_{codel/pie}.
2916So, ensure all scheduler
2917configuration options not related to fq_{codel/pie} are written before
2918.Cm fq_codel/fq_pie
2919tokens.
2920.El
2921.Pp
2922In addition to the type, all parameters allowed for a pipe can also
2923be specified for a scheduler.
2924.Pp
2925Finally, the following parameters can be configured for both
2926pipes and queues:
2927.Pp
2928.Bl -tag -width XXXX -compact
2929.It Cm buckets Ar hash-table-size
2930Specifies the size of the hash table used for storing the
2931various queues.
2932Default value is 64 controlled by the
2933.Xr sysctl 8
2934variable
2935.Va net.inet.ip.dummynet.hash_size ,
2936allowed range is 16 to 65536.
2937.Pp
2938.It Cm mask Ar mask-specifier
2939Packets sent to a given pipe or queue by an
2940.Nm
2941rule can be further classified into multiple flows, each of which is then
2942sent to a different
2943.Em dynamic
2944pipe or queue.
2945A flow identifier is constructed by masking the IP addresses,
2946ports and protocol types as specified with the
2947.Cm mask
2948options in the configuration of the pipe or queue.
2949For each different flow identifier, a new pipe or queue is created
2950with the same parameters as the original object, and matching packets
2951are sent to it.
2952.Pp
2953Thus, when
2954.Em dynamic pipes
2955are used, each flow will get the same bandwidth as defined by the pipe,
2956whereas when
2957.Em dynamic queues
2958are used, each flow will share the parent's pipe bandwidth evenly
2959with other flows generated by the same queue (note that other queues
2960with different weights might be connected to the same pipe).
2961.br
2962Available mask specifiers are a combination of one or more of the following:
2963.Pp
2964.Cm dst-ip Ar mask ,
2965.Cm dst-ip6 Ar mask ,
2966.Cm src-ip Ar mask ,
2967.Cm src-ip6 Ar mask ,
2968.Cm dst-port Ar mask ,
2969.Cm src-port Ar mask ,
2970.Cm flow-id Ar mask ,
2971.Cm proto Ar mask
2972or
2973.Cm all ,
2974.Pp
2975where the latter means all bits in all fields are significant.
2976.Pp
2977.It Cm noerror
2978When a packet is dropped by a
2979.Nm dummynet
2980queue or pipe, the error
2981is normally reported to the caller routine in the kernel, in the
2982same way as it happens when a device queue fills up.
2983Setting this
2984option reports the packet as successfully delivered, which can be
2985needed for some experimental setups where you want to simulate
2986loss or congestion at a remote router.
2987.Pp
2988.It Cm plr Ar packet-loss-rate
2989Packet loss rate.
2990Argument
2991.Ar packet-loss-rate
2992is a floating-point number between 0 and 1, with 0 meaning no
2993loss, 1 meaning 100% loss.
2994The loss rate is internally represented on 31 bits.
2995.Pp
2996.It Cm queue Brq Ar slots | size Ns Cm Kbytes
2997Queue size, in
2998.Ar slots
2999or
3000.Cm KBytes .
3001Default value is 50 slots, which
3002is the typical queue size for Ethernet devices.
3003Note that for slow speed links you should keep the queue
3004size short or your traffic might be affected by a significant
3005queueing delay.
3006E.g., 50 max-sized Ethernet packets (1500 bytes) mean 600Kbit
3007or 20s of queue on a 30Kbit/s pipe.
3008Even worse effects can result if you get packets from an
3009interface with a much larger MTU, e.g.\& the loopback interface
3010with its 16KB packets.
3011The
3012.Xr sysctl 8
3013variables
3014.Em net.inet.ip.dummynet.pipe_byte_limit
3015and
3016.Em net.inet.ip.dummynet.pipe_slot_limit
3017control the maximum lengths that can be specified.
3018.Pp
3019.It Cm red | gred Ar w_q Ns / Ns Ar min_th Ns / Ns Ar max_th Ns / Ns Ar max_p
3020[ecn]
3021Make use of the RED (Random Early Detection) queue management algorithm.
3022.Ar w_q
3023and
3024.Ar max_p
3025are floating
3026point numbers between 0 and 1 (inclusive), while
3027.Ar min_th
3028and
3029.Ar max_th
3030are integer numbers specifying thresholds for queue management
3031(thresholds are computed in bytes if the queue has been defined
3032in bytes, in slots otherwise).
3033The two parameters can also be of the same value if needed.
3034The
3035.Nm dummynet
3036also supports the gentle RED variant (gred) and ECN (Explicit Congestion
3037Notification) as optional.
3038Three
3039.Xr sysctl 8
3040variables can be used to control the RED behaviour:
3041.Bl -tag -width indent
3042.It Va net.inet.ip.dummynet.red_lookup_depth
3043specifies the accuracy in computing the average queue
3044when the link is idle (defaults to 256, must be greater than zero)
3045.It Va net.inet.ip.dummynet.red_avg_pkt_size
3046specifies the expected average packet size (defaults to 512, must be
3047greater than zero)
3048.It Va net.inet.ip.dummynet.red_max_pkt_size
3049specifies the expected maximum packet size, only used when queue
3050thresholds are in bytes (defaults to 1500, must be greater than zero).
3051.El
3052.Pp
3053.It Cm codel Oo Cm target Ar time Oc Oo Cm interval Ar time Oc Oo Cm ecn |
3054.Cm noecn Oc
3055Make use of the CoDel (Controlled-Delay) queue management algorithm.
3056.Ar time
3057is interpreted as milliseconds by default but seconds (s), milliseconds (ms) or
3058microseconds (us) can be specified instead.
3059CoDel drops or marks (ECN) packets
3060depending on packet sojourn time in the queue.
3061.Cm target
3062.Ar time
3063(5ms by default) is the minimum acceptable persistent queue delay that CoDel
3064allows.
3065CoDel does not drop packets directly after packets sojourn time becomes
3066higher than
3067.Cm target
3068.Ar time
3069but waits for
3070.Cm interval
3071.Ar time
3072(100ms default) before dropping.
3073.Cm interval
3074.Ar time
3075should be set to maximum RTT for all expected connections.
3076.Cm ecn
3077enables (disabled by default) packet marking (instead of dropping) for
3078ECN-enabled TCP flows when queue delay becomes high.
3079.Pp
3080Note that any token after
3081.Cm codel
3082is considered a parameter for CoDel.
3083So, ensure all pipe/queue
3084configuration options are written before
3085.Cm codel
3086token.
3087.Pp
3088The
3089.Xr sysctl 8
3090variables
3091.Va net.inet.ip.dummynet.codel.target
3092and
3093.Va net.inet.ip.dummynet.codel.interval
3094can be used to set CoDel default parameters.
3095.Pp
3096.It Cm pie Oo Cm target Ar time Oc Oo Cm tupdate Ar time Oc Oo
3097.Cm alpha Ar n Oc Oo Cm beta Ar n Oc Oo Cm max_burst Ar time Oc Oo
3098.Cm max_ecnth Ar n Oc Oo Cm ecn | Cm noecn Oc Oo Cm capdrop |
3099.Cm nocapdrop Oc Oo Cm drand | Cm nodrand Oc Oo Cm onoff
3100.Oc Oo Cm dre | Cm ts Oc
3101Make use of the PIE (Proportional Integral controller Enhanced) queue management
3102algorithm.
3103PIE drops or marks packets depending on a calculated drop probability during
3104en-queue process, with the aim of achieving high throughput while keeping queue
3105delay low.
3106At regular time intervals of
3107.Cm tupdate
3108.Ar time
3109(15ms by default) a background process (re)calculates the probability based on queue delay
3110deviations from
3111.Cm target
3112.Ar time
3113(15ms by default) and queue delay trends.
3114PIE approximates current queue
3115delay by using a departure rate estimation method, or (optionally) by using a
3116packet timestamp method similar to CoDel.
3117.Ar time
3118is interpreted as milliseconds by default but seconds (s), milliseconds (ms) or
3119microseconds (us) can be specified instead.
3120The other PIE parameters and options are as follows:
3121.Bl -tag -width indent
3122.It Cm alpha Ar n
3123.Ar n
3124is a floating point number between 0 and 7 which specifies the weight of queue
3125delay deviations that is used in drop probability calculation.
31260.125 is the default.
3127.It Cm beta Ar n
3128.Ar n
3129is a floating point number between 0 and 7 which specifies is the weight of queue
3130delay trend that is used in drop probability calculation.
31311.25 is the default.
3132.It Cm max_burst Ar time
3133The maximum period of time that PIE does not drop/mark packets.
3134150ms is the
3135default and 10s is the maximum value.
3136.It Cm max_ecnth Ar n
3137Even when ECN is enabled, PIE drops packets instead of marking them when drop
3138probability becomes higher than ECN probability threshold
3139.Cm max_ecnth Ar n
3140, the default is 0.1 (i.e 10%) and 1 is the maximum value.
3141.It Cm ecn | noecn
3142enable or disable ECN marking for ECN-enabled TCP flows.
3143Disabled by default.
3144.It Cm capdrop | nocapdrop
3145enable or disable cap drop adjustment.
3146Cap drop adjustment is enabled by default.
3147.It Cm drand | nodrand
3148enable or disable drop probability de-randomisation.
3149De-randomisation eliminates
3150the problem of dropping packets too close or too far.
3151De-randomisation is enabled by default.
3152.It Cm onoff
3153enable turning PIE on and off depending on queue load.
3154If this option is enabled,
3155PIE turns on when over 1/3 of queue becomes full.
3156This option is disabled by
3157default.
3158.It Cm dre | ts
3159Calculate queue delay using departure rate estimation
3160.Cm dre
3161or timestamps
3162.Cm ts .
3163.Cm dre
3164is used by default.
3165.El
3166.Pp
3167Note that any token after
3168.Cm pie
3169is considered a parameter for PIE.
3170So ensure all pipe/queue
3171the configuration options are written before
3172.Cm pie
3173token.
3174.Xr sysctl 8
3175variables can be used to control the
3176.Cm pie
3177default parameters.
3178See the
3179.Sx SYSCTL VARIABLES
3180section for more details.
3181.El
3182.Pp
3183When used with IPv6 data,
3184.Nm dummynet
3185currently has several limitations.
3186Information necessary to route link-local packets to an
3187interface is not available after processing by
3188.Nm dummynet
3189so those packets are dropped in the output path.
3190Care should be taken to ensure that link-local packets are not passed to
3191.Nm dummynet .
3192.Sh CHECKLIST
3193Here are some important points to consider when designing your
3194rules:
3195.Bl -bullet
3196.It
3197Remember that you filter both packets going
3198.Cm in
3199and
3200.Cm out .
3201Most connections need packets going in both directions.
3202.It
3203Remember to test very carefully.
3204It is a good idea to be near the console when doing this.
3205If you cannot be near the console,
3206use an auto-recovery script such as the one in
3207.Pa /usr/share/examples/ipfw/change_rules.sh .
3208.It
3209Do not forget the loopback interface.
3210.El
3211.Sh FINE POINTS
3212.Bl -bullet
3213.It
3214There are circumstances where fragmented datagrams are unconditionally
3215dropped.
3216TCP packets are dropped if they do not contain at least 20 bytes of
3217TCP header, UDP packets are dropped if they do not contain a full 8
3218byte UDP header, and ICMP packets are dropped if they do not contain
32194 bytes of ICMP header, enough to specify the ICMP type, code, and
3220checksum.
3221These packets are simply logged as
3222.Dq pullup failed
3223since there may not be enough good data in the packet to produce a
3224meaningful log entry.
3225.It
3226Another type of packet is unconditionally dropped, a TCP packet with a
3227fragment offset of one.
3228This is a valid packet, but it only has one use, to try
3229to circumvent firewalls.
3230When logging is enabled, these packets are
3231reported as being dropped by rule -1.
3232.It
3233If you are logged in over a network, loading the
3234.Xr kld 4
3235version of
3236.Nm
3237is probably not as straightforward as you would think.
3238The following command line is recommended:
3239.Bd -literal -offset indent
3240kldload ipfw && \e
3241ipfw add 32000 allow ip from any to any
3242.Ed
3243.Pp
3244Along the same lines, doing an
3245.Bd -literal -offset indent
3246ipfw flush
3247.Ed
3248.Pp
3249in similar surroundings is also a bad idea.
3250.It
3251The
3252.Nm
3253filter list may not be modified if the system security level
3254is set to 3 or higher
3255(see
3256.Xr init 8
3257for information on system security levels).
3258.El
3259.Sh PACKET DIVERSION
3260A
3261.Xr divert 4
3262socket bound to the specified port will receive all packets
3263diverted to that port.
3264If no socket is bound to the destination port, or if the divert module is
3265not loaded, or if the kernel was not compiled with divert socket support,
3266the packets are dropped.
3267.Sh NETWORK ADDRESS TRANSLATION (NAT)
3268.Nm
3269support in-kernel NAT using the kernel version of
3270.Xr libalias 3 .
3271The kernel module
3272.Cm ipfw_nat
3273should be loaded or kernel should have
3274.Cm options IPFIREWALL_NAT
3275to be able use NAT.
3276.Pp
3277The nat configuration command is the following:
3278.Bd -ragged -offset indent
3279.Bk -words
3280.Cm nat
3281.Ar nat_number
3282.Cm config
3283.Ar nat-configuration
3284.Ek
3285.Ed
3286.Pp
3287The following parameters can be configured:
3288.Bl -tag -width indent
3289.It Cm ip Ar ip_address
3290Define an ip address to use for aliasing.
3291.It Cm if Ar nic
3292Use ip address of NIC for aliasing, dynamically changing
3293it if NIC's ip address changes.
3294.It Cm log
3295Enable logging on this nat instance.
3296.It Cm deny_in
3297Deny any incoming connection from outside world.
3298.It Cm same_ports
3299Try to leave the alias port numbers unchanged from
3300the actual local port numbers.
3301.It Cm unreg_only
3302Traffic on the local network not originating from a RFC 1918
3303unregistered address spaces will be ignored.
3304.It Cm unreg_cgn
3305Like unreg_only, but includes the RFC 6598 (Carrier Grade NAT)
3306address range.
3307.It Cm reset
3308Reset table of the packet aliasing engine on address change.
3309.It Cm reverse
3310Reverse the way libalias handles aliasing.
3311.It Cm proxy_only
3312Obey transparent proxy rules only, packet aliasing is not performed.
3313.It Cm skip_global
3314Skip instance in case of global state lookup (see below).
3315.It Cm port_range Ar lower-upper
3316Set the aliasing ports between the ranges given. Upper port has to be greater
3317than lower.
3318.El
3319.Pp
3320Some special values can be supplied instead of
3321.Va nat_number
3322in nat rule actions:
3323.Bl -tag -width indent
3324.It Cm global
3325Looks up translation state in all configured nat instances.
3326If an entry is found, packet is aliased according to that entry.
3327If no entry was found in any of the instances, packet is passed unchanged,
3328and no new entry will be created.
3329See section
3330.Sx MULTIPLE INSTANCES
3331in
3332.Xr natd 8
3333for more information.
3334.It Cm tablearg
3335Uses argument supplied in lookup table.
3336See
3337.Sx LOOKUP TABLES
3338section below for more information on lookup tables.
3339.El
3340.Pp
3341To let the packet continue after being (de)aliased, set the sysctl variable
3342.Va net.inet.ip.fw.one_pass
3343to 0.
3344For more information about aliasing modes, refer to
3345.Xr libalias 3 .
3346See Section
3347.Sx EXAMPLES
3348for some examples of nat usage.
3349.Ss REDIRECT AND LSNAT SUPPORT IN IPFW
3350Redirect and LSNAT support follow closely the syntax used in
3351.Xr natd 8 .
3352See Section
3353.Sx EXAMPLES
3354for some examples on how to do redirect and lsnat.
3355.Ss SCTP NAT SUPPORT
3356SCTP nat can be configured in a similar manner to TCP through the
3357.Nm
3358command line tool.
3359The main difference is that
3360.Nm sctp nat
3361does not do port translation.
3362Since the local and global side ports will be the same,
3363there is no need to specify both.
3364Ports are redirected as follows:
3365.Bd -ragged -offset indent
3366.Bk -words
3367.Cm nat
3368.Ar nat_number
3369.Cm config if
3370.Ar nic
3371.Cm redirect_port sctp
3372.Ar ip_address [,addr_list] {[port | port-port] [,ports]}
3373.Ek
3374.Ed
3375.Pp
3376Most
3377.Nm sctp nat
3378configuration can be done in real-time through the
3379.Xr sysctl 8
3380interface.
3381All may be changed dynamically, though the hash_table size will only
3382change for new
3383.Nm nat
3384instances.
3385See
3386.Sx SYSCTL VARIABLES
3387for more info.
3388.Sh IPv6/IPv4 NETWORK ADDRESS AND PROTOCOL TRANSLATION
3389.Ss Stateful translation
3390.Nm
3391supports in-kernel IPv6/IPv4 network address and protocol translation.
3392Stateful NAT64 translation allows IPv6-only clients to contact IPv4 servers
3393using unicast TCP, UDP or ICMP protocols.
3394One or more IPv4 addresses assigned to a stateful NAT64 translator are shared
3395among several IPv6-only clients.
3396When stateful NAT64 is used in conjunction with DNS64, no changes are usually
3397required in the IPv6 client or the IPv4 server.
3398The kernel module
3399.Cm ipfw_nat64
3400should be loaded or kernel should have
3401.Cm options IPFIREWALL_NAT64
3402to be able use stateful NAT64 translator.
3403.Pp
3404Stateful NAT64 uses a bunch of memory for several types of objects.
3405When IPv6 client initiates connection, NAT64 translator creates a host entry
3406in the states table.
3407Each host entry uses preallocated IPv4 alias entry.
3408Each alias entry has a number of ports group entries allocated on demand.
3409Ports group entries contains connection state entries.
3410There are several options to control limits and lifetime for these objects.
3411.Pp
3412NAT64 translator follows RFC7915 when does ICMPv6/ICMP translation,
3413unsupported message types will be silently dropped.
3414IPv6 needs several ICMPv6 message types to be explicitly allowed for correct
3415operation.
3416Make sure that ND6 neighbor solicitation (ICMPv6 type 135) and neighbor
3417advertisement (ICMPv6 type 136) messages will not be handled by translation
3418rules.
3419.Pp
3420After translation NAT64 translator by default sends packets through
3421corresponding netisr queue.
3422Thus translator host should be configured as IPv4 and IPv6 router.
3423Also this means, that a packet is handled by firewall twice.
3424First time an original packet is handled and consumed by translator,
3425and then it is handled again as translated packet.
3426This behavior can be changed by sysctl variable
3427.Va net.inet.ip.fw.nat64_direct_output .
3428Also translated packet can be tagged using
3429.Cm tag
3430rule action, and then matched by
3431.Cm tagged
3432opcode to avoid loops and extra overhead.
3433.Pp
3434The stateful NAT64 configuration command is the following:
3435.Bd -ragged -offset indent
3436.Bk -words
3437.Cm nat64lsn
3438.Ar name
3439.Cm create
3440.Ar create-options
3441.Ek
3442.Ed
3443.Pp
3444The following parameters can be configured:
3445.Bl -tag -width indent
3446.It Cm prefix4 Ar ipv4_prefix/plen
3447The IPv4 prefix with mask defines the pool of IPv4 addresses used as
3448source address after translation.
3449Stateful NAT64 module translates IPv6 source address of client to one
3450IPv4 address from this pool.
3451Note that incoming IPv4 packets that don't have corresponding state entry
3452in the states table will be dropped by translator.
3453Make sure that translation rules handle packets, destined to configured prefix.
3454.It Cm prefix6 Ar ipv6_prefix/length
3455The IPv6 prefix defines IPv4-embedded IPv6 addresses used by translator
3456to represent IPv4 addresses.
3457This IPv6 prefix should be configured in DNS64.
3458The translator implementation follows RFC6052, that restricts the length of
3459prefixes to one of following: 32, 40, 48, 56, 64, or 96.
3460The Well-Known IPv6 Prefix 64:ff9b:: must be 96 bits long.
3461The special
3462.Ar ::/length
3463prefix can be used to handle several IPv6 prefixes with one NAT64 instance.
3464The NAT64 instance will determine a destination IPv4 address from prefix
3465.Ar length .
3466.It Cm states_chunks Ar number
3467The number of states chunks in single ports group.
3468Each ports group by default can keep 64 state entries in single chunk.
3469The above value affects the maximum number of states that can be associated with single IPv4 alias address and port.
3470The value must be power of 2, and up to 128.
3471.It Cm host_del_age Ar seconds
3472The number of seconds until the host entry for a IPv6 client will be deleted
3473and all its resources will be released due to inactivity.
3474Default value is
3475.Ar 3600 .
3476.It Cm pg_del_age Ar seconds
3477The number of seconds until a ports group with unused state entries will
3478be released.
3479Default value is
3480.Ar 900 .
3481.It Cm tcp_syn_age Ar seconds
3482The number of seconds while a state entry for TCP connection with only SYN
3483sent will be kept.
3484If TCP connection establishing will not be finished,
3485state entry will be deleted.
3486Default value is
3487.Ar 10 .
3488.It Cm tcp_est_age Ar seconds
3489The number of seconds while a state entry for established TCP connection
3490will be kept.
3491Default value is
3492.Ar 7200 .
3493.It Cm tcp_close_age Ar seconds
3494The number of seconds while a state entry for closed TCP connection
3495will be kept.
3496Keeping state entries for closed connections is needed, because IPv4 servers
3497typically keep closed connections in a TIME_WAIT state for a several minutes.
3498Since translator's IPv4 addresses are shared among all IPv6 clients,
3499new connections from the same addresses and ports may be rejected by server,
3500because these connections are still in a TIME_WAIT state.
3501Keeping them in translator's state table protects from such rejects.
3502Default value is
3503.Ar 180 .
3504.It Cm udp_age Ar seconds
3505The number of seconds while translator keeps state entry in a waiting for
3506reply to the sent UDP datagram.
3507Default value is
3508.Ar 120 .
3509.It Cm icmp_age Ar seconds
3510The number of seconds while translator keeps state entry in a waiting for
3511reply to the sent ICMP message.
3512Default value is
3513.Ar 60 .
3514.It Cm log
3515Turn on logging of all handled packets via BPF through
3516.Ar ipfwlog0
3517interface.
3518.Ar ipfwlog0
3519is a pseudo interface and can be created after a boot manually with
3520.Cm ifconfig
3521command.
3522Note that it has different purpose than
3523.Ar ipfw0
3524interface.
3525Translators sends to BPF an additional information with each packet.
3526With
3527.Cm tcpdump
3528you are able to see each handled packet before and after translation.
3529.It Cm -log
3530Turn off logging of all handled packets via BPF.
3531.It Cm allow_private
3532Turn on processing private IPv4 addresses.
3533By default IPv6 packets with destinations mapped to private address ranges
3534defined by RFC1918 are not processed.
3535.It Cm -allow_private
3536Turn off private address handling in
3537.Nm nat64
3538instance.
3539.El
3540.Pp
3541To inspect a states table of stateful NAT64 the following command can be used:
3542.Bd -ragged -offset indent
3543.Bk -words
3544.Cm nat64lsn
3545.Ar name
3546.Cm show Cm states
3547.Ek
3548.Ed
3549.Pp
3550Stateless NAT64 translator doesn't use a states table for translation
3551and converts IPv4 addresses to IPv6 and vice versa solely based on the
3552mappings taken from configured lookup tables.
3553Since a states table doesn't used by stateless translator,
3554it can be configured to pass IPv4 clients to IPv6-only servers.
3555.Pp
3556The stateless NAT64 configuration command is the following:
3557.Bd -ragged -offset indent
3558.Bk -words
3559.Cm nat64stl
3560.Ar name
3561.Cm create
3562.Ar create-options
3563.Ek
3564.Ed
3565.Pp
3566The following parameters can be configured:
3567.Bl -tag -width indent
3568.It Cm prefix6 Ar ipv6_prefix/length
3569The IPv6 prefix defines IPv4-embedded IPv6 addresses used by translator
3570to represent IPv4 addresses.
3571This IPv6 prefix should be configured in DNS64.
3572.It Cm table4 Ar table46
3573The lookup table
3574.Ar table46
3575contains mapping how IPv4 addresses should be translated to IPv6 addresses.
3576.It Cm table6 Ar table64
3577The lookup table
3578.Ar table64
3579contains mapping how IPv6 addresses should be translated to IPv4 addresses.
3580.It Cm log
3581Turn on logging of all handled packets via BPF through
3582.Ar ipfwlog0
3583interface.
3584.It Cm -log
3585Turn off logging of all handled packets via BPF.
3586.It Cm allow_private
3587Turn on processing private IPv4 addresses.
3588By default IPv6 packets with destinations mapped to private address ranges
3589defined by RFC1918 are not processed.
3590.It Cm -allow_private
3591Turn off private address handling in
3592.Nm nat64
3593instance.
3594.El
3595.Pp
3596Note that the behavior of stateless translator with respect to not matched
3597packets differs from stateful translator.
3598If corresponding addresses was not found in the lookup tables, the packet
3599will not be dropped and the search continues.
3600.Ss XLAT464 CLAT translation
3601XLAT464 CLAT NAT64 translator implements client-side stateless translation as
3602defined in RFC6877 and is very similar to statless NAT64 translator
3603explained above.
3604Instead of lookup tables it uses one-to-one mapping between IPv4 and IPv6
3605addresses using configured prefixes.
3606This mode can be used as a replacement of DNS64 service for applications
3607that are not using it (e.g. VoIP) allowing them to access IPv4-only Internet
3608over IPv6-only networks with help of remote NAT64 translator.
3609.Pp
3610The CLAT NAT64 configuration command is the following:
3611.Bd -ragged -offset indent
3612.Bk -words
3613.Cm nat64clat
3614.Ar name
3615.Cm create
3616.Ar create-options
3617.Ek
3618.Ed
3619.Pp
3620The following parameters can be configured:
3621.Bl -tag -width indent
3622.It Cm clat_prefix Ar ipv6_prefix/length
3623The IPv6 prefix defines IPv4-embedded IPv6 addresses used by translator
3624to represent source IPv4 addresses.
3625.It Cm plat_prefix Ar ipv6_prefix/length
3626The IPv6 prefix defines IPv4-embedded IPv6 addresses used by translator
3627to represent destination IPv4 addresses.
3628This IPv6 prefix should be configured on a remote NAT64 translator.
3629.It Cm log
3630Turn on logging of all handled packets via BPF through
3631.Ar ipfwlog0
3632interface.
3633.It Cm -log
3634Turn off logging of all handled packets via BPF.
3635.It Cm allow_private
3636Turn on processing private IPv4 addresses.
3637By default
3638.Nm nat64clat
3639instance will not process IPv4 packets with destination address from private
3640ranges as defined in RFC1918.
3641.It Cm -allow_private
3642Turn off private address handling in
3643.Nm nat64clat
3644instance.
3645.El
3646.Pp
3647Note that the behavior of CLAT translator with respect to not matched
3648packets differs from stateful translator.
3649If corresponding addresses were not matched against prefixes configured,
3650the packet will not be dropped and the search continues.
3651.Sh IPv6-to-IPv6 NETWORK PREFIX TRANSLATION (NPTv6)
3652.Nm
3653supports in-kernel IPv6-to-IPv6 network prefix translation as described
3654in RFC6296.
3655The kernel module
3656.Cm ipfw_nptv6
3657should be loaded or kernel should has
3658.Cm options IPFIREWALL_NPTV6
3659to be able use NPTv6 translator.
3660.Pp
3661The NPTv6 configuration command is the following:
3662.Bd -ragged -offset indent
3663.Bk -words
3664.Cm nptv6
3665.Ar name
3666.Cm create
3667.Ar create-options
3668.Ek
3669.Ed
3670.Pp
3671The following parameters can be configured:
3672.Bl -tag -width indent
3673.It Cm int_prefix Ar ipv6_prefix
3674IPv6 prefix used in internal network.
3675NPTv6 module translates source address when it matches this prefix.
3676.It Cm ext_prefix Ar ipv6_prefix
3677IPv6 prefix used in external network.
3678NPTv6 module translates destination address when it matches this prefix.
3679.It Cm ext_if Ar nic
3680The NPTv6 module will use first global IPv6 address from interface
3681.Ar nic
3682as external prefix.
3683It can be useful when IPv6 prefix of external network is dynamically obtained.
3684.Cm ext_prefix
3685and
3686.Cm ext_if
3687options are mutually exclusive.
3688.It Cm prefixlen Ar length
3689The length of specified IPv6 prefixes.
3690It must be in range from 8 to 64.
3691.El
3692.Pp
3693Note that the prefix translation rules are silently ignored when IPv6 packet
3694forwarding is disabled.
3695To enable the packet forwarding, set the sysctl variable
3696.Va net.inet6.ip6.forwarding
3697to 1.
3698.Pp
3699To let the packet continue after being translated, set the sysctl variable
3700.Va net.inet.ip.fw.one_pass
3701to 0.
3702.Sh LOADER TUNABLES
3703Tunables can be set in
3704.Xr loader 8
3705prompt,
3706.Xr loader.conf 5
3707or
3708.Xr kenv 1
3709before ipfw module gets loaded.
3710.Bl -tag -width indent
3711.It Va net.inet.ip.fw.default_to_accept : No 0
3712Defines ipfw last rule behavior.
3713This value overrides
3714.Cd "options IPFW_DEFAULT_TO_(ACCEPT|DENY)"
3715from kernel configuration file.
3716.It Va net.inet.ip.fw.tables_max : No 128
3717Defines number of tables available in ipfw.
3718Number cannot exceed 65534.
3719.El
3720.Sh SYSCTL VARIABLES
3721A set of
3722.Xr sysctl 8
3723variables controls the behaviour of the firewall and
3724associated modules
3725.Pq Nm dummynet , bridge , sctp nat .
3726These are shown below together with their default value
3727(but always check with the
3728.Xr sysctl 8
3729command what value is actually in use) and meaning:
3730.Bl -tag -width indent
3731.It Va net.inet.ip.alias.sctp.accept_global_ootb_addip : No 0
3732Defines how the
3733.Nm nat
3734responds to receipt of global OOTB ASCONF-AddIP:
3735.Bl -tag -width indent
3736.It Cm 0
3737No response (unless a partially matching association exists -
3738ports and vtags match but global address does not)
3739.It Cm 1
3740.Nm nat
3741will accept and process all OOTB global AddIP messages.
3742.El
3743.Pp
3744Option 1 should never be selected as this forms a security risk.
3745An attacker can
3746establish multiple fake associations by sending AddIP messages.
3747.It Va net.inet.ip.alias.sctp.chunk_proc_limit : No 5
3748Defines the maximum number of chunks in an SCTP packet that will be
3749parsed for a
3750packet that matches an existing association.
3751This value is enforced to be greater or equal than
3752.Cm net.inet.ip.alias.sctp.initialising_chunk_proc_limit .
3753A high value is
3754a DoS risk yet setting too low a value may result in
3755important control chunks in
3756the packet not being located and parsed.
3757.It Va net.inet.ip.alias.sctp.error_on_ootb : No 1
3758Defines when the
3759.Nm nat
3760responds to any Out-of-the-Blue (OOTB) packets with ErrorM packets.
3761An OOTB packet is a packet that arrives with no existing association
3762registered in the
3763.Nm nat
3764and is not an INIT or ASCONF-AddIP packet:
3765.Bl -tag -width indent
3766.It Cm 0
3767ErrorM is never sent in response to OOTB packets.
3768.It Cm 1
3769ErrorM is only sent to OOTB packets received on the local side.
3770.It Cm 2
3771ErrorM is sent to the local side and on the global side ONLY if there is a
3772partial match (ports and vtags match but the source global IP does not).
3773This value is only useful if the
3774.Nm nat
3775is tracking global IP addresses.
3776.It Cm 3
3777ErrorM is sent in response to all OOTB packets on both
3778the local and global side
3779(DoS risk).
3780.El
3781.Pp
3782At the moment the default is 0, since the ErrorM packet is not yet
3783supported by most SCTP stacks.
3784When it is supported, and if not tracking
3785global addresses, we recommend setting this value to 1 to allow
3786multi-homed local hosts to function with the
3787.Nm nat .
3788To track global addresses, we recommend setting this value to 2 to
3789allow global hosts to be informed when they need to (re)send an
3790ASCONF-AddIP.
3791Value 3 should never be chosen (except for debugging) as the
3792.Nm nat
3793will respond to all OOTB global packets (a DoS risk).
3794.It Va net.inet.ip.alias.sctp.hashtable_size : No 2003
3795Size of hash tables used for
3796.Nm nat
3797lookups (100 < prime_number > 1000001).
3798This value sets the
3799.Nm hash table
3800size for any future created
3801.Nm nat
3802instance and therefore must be set prior to creating a
3803.Nm nat
3804instance.
3805The table sizes may be changed to suit specific needs.
3806If there will be few
3807concurrent associations, and memory is scarce, you may make these smaller.
3808If there will be many thousands (or millions) of concurrent associations, you
3809should make these larger.
3810A prime number is best for the table size.
3811The sysctl
3812update function will adjust your input value to the next highest prime number.
3813.It Va net.inet.ip.alias.sctp.holddown_time : No 0
3814Hold association in table for this many seconds after receiving a
3815SHUTDOWN-COMPLETE.
3816This allows endpoints to correct shutdown gracefully if a
3817shutdown_complete is lost and retransmissions are required.
3818.It Va net.inet.ip.alias.sctp.init_timer : No 15
3819Timeout value while waiting for (INIT-ACK|AddIP-ACK).
3820This value cannot be 0.
3821.It Va net.inet.ip.alias.sctp.initialising_chunk_proc_limit : No 2
3822Defines the maximum number of chunks in an SCTP packet that will be parsed when
3823no existing association exists that matches that packet.
3824Ideally this packet
3825will only be an INIT or ASCONF-AddIP packet.
3826A higher value may become a DoS
3827risk as malformed packets can consume processing resources.
3828.It Va net.inet.ip.alias.sctp.param_proc_limit : No 25
3829Defines the maximum number of parameters within a chunk that will be
3830parsed in a
3831packet.
3832As for other similar sysctl variables, larger values pose a DoS risk.
3833.It Va net.inet.ip.alias.sctp.log_level : No 0
3834Level of detail in the system log messages (0 \- minimal, 1 \- event,
38352 \- info, 3 \- detail, 4 \- debug, 5 \- max debug).
3836May be a good
3837option in high loss environments.
3838.It Va net.inet.ip.alias.sctp.shutdown_time : No 15
3839Timeout value while waiting for SHUTDOWN-COMPLETE.
3840This value cannot be 0.
3841.It Va net.inet.ip.alias.sctp.track_global_addresses : No 0
3842Enables/disables global IP address tracking within the
3843.Nm nat
3844and places an
3845upper limit on the number of addresses tracked for each association:
3846.Bl -tag -width indent
3847.It Cm 0
3848Global tracking is disabled
3849.It Cm >1
3850Enables tracking, the maximum number of addresses tracked for each
3851association is limited to this value
3852.El
3853.Pp
3854This variable is fully dynamic, the new value will be adopted for all newly
3855arriving associations, existing associations are treated
3856as they were previously.
3857Global tracking will decrease the number of collisions within the
3858.Nm nat
3859at a cost
3860of increased processing load, memory usage, complexity, and possible
3861.Nm nat
3862state
3863problems in complex networks with multiple
3864.Nm nats .
3865We recommend not tracking
3866global IP addresses, this will still result in a fully functional
3867.Nm nat .
3868.It Va net.inet.ip.alias.sctp.up_timer : No 300
3869Timeout value to keep an association up with no traffic.
3870This value cannot be 0.
3871.It Va net.inet.ip.dummynet.codel.interval : No 100000
3872Default
3873.Cm codel
3874AQM interval in microseconds.
3875The value must be in the range 1..5000000.
3876.It Va net.inet.ip.dummynet.codel.target : No 5000
3877Default
3878.Cm codel
3879AQM target delay time in microseconds (the minimum acceptable persistent queue
3880delay).
3881The value must be in the range 1..5000000.
3882.It Va net.inet.ip.dummynet.expire : No 1
3883Lazily delete dynamic pipes/queue once they have no pending traffic.
3884You can disable this by setting the variable to 0, in which case
3885the pipes/queues will only be deleted when the threshold is reached.
3886.It Va net.inet.ip.dummynet.fqcodel.flows : No 1024
3887Defines the default total number of flow queues (sub-queues) that
3888.Cm fq_codel
3889creates and manages.
3890The value must be in the range 1..65536.
3891.It Va net.inet.ip.dummynet.fqcodel.interval : No 100000
3892Default
3893.Cm fq_codel
3894scheduler/AQM interval in microseconds.
3895The value must be in the range 1..5000000.
3896.It Va net.inet.ip.dummynet.fqcodel.limit : No 10240
3897The default hard size limit (in unit of packet) of all queues managed by an
3898instance of the
3899.Cm fq_codel
3900scheduler.
3901The value must be in the range 1..20480.
3902.It Va net.inet.ip.dummynet.fqcodel.quantum : No 1514
3903The default quantum (credit) of the
3904.Cm fq_codel
3905in unit of byte.
3906The value must be in the range 1..9000.
3907.It Va net.inet.ip.dummynet.fqcodel.target : No 5000
3908Default
3909.Cm fq_codel
3910scheduler/AQM target delay time in microseconds (the minimum acceptable
3911persistent queue delay).
3912The value must be in the range 1..5000000.
3913.It Va net.inet.ip.dummynet.fqpie.alpha : No 125
3914The default
3915.Ar alpha
3916parameter (scaled by 1000) for
3917.Cm fq_pie
3918scheduler/AQM.
3919The value must be in the range 1..7000.
3920.It Va net.inet.ip.dummynet.fqpie.beta : No 1250
3921The default
3922.Ar beta
3923parameter (scaled by 1000) for
3924.Cm fq_pie
3925scheduler/AQM.
3926The value must be in the range 1..7000.
3927.It Va net.inet.ip.dummynet.fqpie.flows : No 1024
3928Defines the default total number of flow queues (sub-queues) that
3929.Cm fq_pie
3930creates and manages.
3931The value must be in the range 1..65536.
3932.It Va net.inet.ip.dummynet.fqpie.limit : No 10240
3933The default hard size limit (in unit of packet) of all queues managed by an
3934instance of the
3935.Cm fq_pie
3936scheduler.
3937The value must be in the range 1..20480.
3938.It Va net.inet.ip.dummynet.fqpie.max_burst : No 150000
3939The default maximum period of microseconds that
3940.Cm fq_pie
3941scheduler/AQM does not drop/mark packets.
3942The value must be in the range 1..10000000.
3943.It Va net.inet.ip.dummynet.fqpie.max_ecnth : No 99
3944The default maximum ECN probability threshold (scaled by 1000) for
3945.Cm fq_pie
3946scheduler/AQM.
3947The value must be in the range 1..7000.
3948.It Va net.inet.ip.dummynet.fqpie.quantum : No 1514
3949The default quantum (credit) of the
3950.Cm fq_pie
3951in unit of byte.
3952The value must be in the range 1..9000.
3953.It Va net.inet.ip.dummynet.fqpie.target : No 15000
3954The default
3955.Cm target
3956delay of the
3957.Cm fq_pie
3958in unit of microsecond.
3959The value must be in the range 1..5000000.
3960.It Va net.inet.ip.dummynet.fqpie.tupdate : No 15000
3961The default
3962.Cm tupdate
3963of the
3964.Cm fq_pie
3965in unit of microsecond.
3966The value must be in the range 1..5000000.
3967.It Va net.inet.ip.dummynet.hash_size : No 64
3968Default size of the hash table used for dynamic pipes/queues.
3969This value is used when no
3970.Cm buckets
3971option is specified when configuring a pipe/queue.
3972.It Va net.inet.ip.dummynet.io_fast : No 0
3973If set to a non-zero value,
3974the
3975.Dq fast
3976mode of
3977.Nm dummynet
3978operation (see above) is enabled.
3979.It Va net.inet.ip.dummynet.io_pkt
3980Number of packets passed to
3981.Nm dummynet .
3982.It Va net.inet.ip.dummynet.io_pkt_drop
3983Number of packets dropped by
3984.Nm dummynet .
3985.It Va net.inet.ip.dummynet.io_pkt_fast
3986Number of packets bypassed by the
3987.Nm dummynet
3988scheduler.
3989.It Va net.inet.ip.dummynet.max_chain_len : No 16
3990Target value for the maximum number of pipes/queues in a hash bucket.
3991The product
3992.Cm max_chain_len*hash_size
3993is used to determine the threshold over which empty pipes/queues
3994will be expired even when
3995.Cm net.inet.ip.dummynet.expire=0 .
3996.It Va net.inet.ip.dummynet.red_lookup_depth : No 256
3997.It Va net.inet.ip.dummynet.red_avg_pkt_size : No 512
3998.It Va net.inet.ip.dummynet.red_max_pkt_size : No 1500
3999Parameters used in the computations of the drop probability
4000for the RED algorithm.
4001.It Va net.inet.ip.dummynet.pie.alpha : No 125
4002The default
4003.Ar alpha
4004parameter (scaled by 1000) for
4005.Cm pie
4006AQM.
4007The value must be in the range 1..7000.
4008.It Va net.inet.ip.dummynet.pie.beta : No 1250
4009The default
4010.Ar beta
4011parameter (scaled by 1000) for
4012.Cm pie
4013AQM.
4014The value must be in the range 1..7000.
4015.It Va net.inet.ip.dummynet.pie.max_burst : No 150000
4016The default maximum period of microseconds that
4017.Cm pie
4018AQM does not drop/mark packets.
4019The value must be in the range 1..10000000.
4020.It Va net.inet.ip.dummynet.pie.max_ecnth : No 99
4021The default maximum ECN probability threshold (scaled by 1000) for
4022.Cm pie
4023AQM.
4024The value must be in the range 1..7000.
4025.It Va net.inet.ip.dummynet.pie.target : No 15000
4026The default
4027.Cm target
4028delay of
4029.Cm pie
4030AQM in unit of microsecond.
4031The value must be in the range 1..5000000.
4032.It Va net.inet.ip.dummynet.pie.tupdate : No 15000
4033The default
4034.Cm tupdate
4035of
4036.Cm pie
4037AQM in unit of microsecond.
4038The value must be in the range 1..5000000.
4039.It Va net.inet.ip.dummynet.pipe_byte_limit : No 1048576
4040.It Va net.inet.ip.dummynet.pipe_slot_limit : No 100
4041The maximum queue size that can be specified in bytes or packets.
4042These limits prevent accidental exhaustion of resources such as mbufs.
4043If you raise these limits,
4044you should make sure the system is configured so that sufficient resources
4045are available.
4046.It Va net.inet.ip.fw.autoinc_step : No 100
4047Delta between rule numbers when auto-generating them.
4048The value must be in the range 1..1000.
4049.It Va net.inet.ip.fw.curr_dyn_buckets : Va net.inet.ip.fw.dyn_buckets
4050The current number of buckets in the hash table for dynamic rules
4051(readonly).
4052.It Va net.inet.ip.fw.debug : No 1
4053Controls debugging messages produced by
4054.Nm .
4055.It Va net.inet.ip.fw.default_rule : No 65535
4056The default rule number (read-only).
4057By the design of
4058.Nm , the default rule is the last one, so its number
4059can also serve as the highest number allowed for a rule.
4060.It Va net.inet.ip.fw.dyn_buckets : No 256
4061The number of buckets in the hash table for dynamic rules.
4062Must be a power of 2, up to 65536.
4063It only takes effect when all dynamic rules have expired, so you
4064are advised to use a
4065.Cm flush
4066command to make sure that the hash table is resized.
4067.It Va net.inet.ip.fw.dyn_count : No 3
4068Current number of dynamic rules
4069(read-only).
4070.It Va net.inet.ip.fw.dyn_keepalive : No 1
4071Enables generation of keepalive packets for
4072.Cm keep-state
4073rules on TCP sessions.
4074A keepalive is generated to both
4075sides of the connection every 5 seconds for the last 20
4076seconds of the lifetime of the rule.
4077.It Va net.inet.ip.fw.dyn_max : No 8192
4078Maximum number of dynamic rules.
4079When you hit this limit, no more dynamic rules can be
4080installed until old ones expire.
4081.It Va net.inet.ip.fw.dyn_ack_lifetime : No 300
4082.It Va net.inet.ip.fw.dyn_syn_lifetime : No 20
4083.It Va net.inet.ip.fw.dyn_fin_lifetime : No 1
4084.It Va net.inet.ip.fw.dyn_rst_lifetime : No 1
4085.It Va net.inet.ip.fw.dyn_udp_lifetime : No 5
4086.It Va net.inet.ip.fw.dyn_short_lifetime : No 30
4087These variables control the lifetime, in seconds, of dynamic
4088rules.
4089Upon the initial SYN exchange the lifetime is kept short,
4090then increased after both SYN have been seen, then decreased
4091again during the final FIN exchange or when a RST is received.
4092Both
4093.Em dyn_fin_lifetime
4094and
4095.Em dyn_rst_lifetime
4096must be strictly lower than 5 seconds, the period of
4097repetition of keepalives.
4098The firewall enforces that.
4099.It Va net.inet.ip.fw.dyn_keep_states : No 0
4100Keep dynamic states on rule/set deletion.
4101States are relinked to default rule (65535).
4102This can be handly for ruleset reload.
4103Turned off by default.
4104.It Va net.inet.ip.fw.enable : No 1
4105Enables the firewall.
4106Setting this variable to 0 lets you run your machine without
4107firewall even if compiled in.
4108.It Va net.inet6.ip6.fw.enable : No 1
4109provides the same functionality as above for the IPv6 case.
4110.It Va net.inet.ip.fw.one_pass : No 1
4111When set, the packet exiting from the
4112.Nm dummynet
4113pipe or from
4114.Xr ng_ipfw 4
4115node is not passed though the firewall again.
4116Otherwise, after an action, the packet is
4117reinjected into the firewall at the next rule.
4118.It Va net.inet.ip.fw.tables_max : No 128
4119Maximum number of tables.
4120.It Va net.inet.ip.fw.verbose : No 1
4121Enables verbose messages.
4122.It Va net.inet.ip.fw.verbose_limit : No 0
4123Limits the number of messages produced by a verbose firewall.
4124.It Va net.inet6.ip6.fw.deny_unknown_exthdrs : No 1
4125If enabled packets with unknown IPv6 Extension Headers will be denied.
4126.It Va net.link.ether.ipfw : No 0
4127Controls whether layer2 packets are passed to
4128.Nm .
4129Default is no.
4130.It Va net.link.bridge.ipfw : No 0
4131Controls whether bridged packets are passed to
4132.Nm .
4133Default is no.
4134.It Va net.inet.ip.fw.nat64_debug : No 0
4135Controls debugging messages produced by
4136.Nm ipfw_nat64
4137module.
4138.It Va net.inet.ip.fw.nat64_direct_output : No 0
4139Controls the output method used by
4140.Nm ipfw_nat64
4141module:
4142.Bl -tag -width indent
4143.It Cm 0
4144A packet is handled by
4145.Nm ipfw
4146twice.
4147First time an original packet is handled by
4148.Nm ipfw
4149and consumed by
4150.Nm ipfw_nat64
4151translator.
4152Then translated packet is queued via netisr to input processing again.
4153.It Cm 1
4154A packet is handled by
4155.Nm ipfw
4156only once, and after translation it will be pushed directly to outgoing
4157interface.
4158.El
4159.El
4160.Sh INTERNAL DIAGNOSTICS
4161There are some commands that may be useful to understand current state
4162of certain subsystems inside kernel module.
4163These commands provide debugging output which may change without notice.
4164.Pp
4165Currently the following commands are available as
4166.Cm internal
4167sub-options:
4168.Bl -tag -width indent
4169.It Cm iflist
4170Lists all interface which are currently tracked by
4171.Nm
4172with their in-kernel status.
4173.It Cm talist
4174List all table lookup algorithms currently available.
4175.El
4176.Sh EXAMPLES
4177There are far too many possible uses of
4178.Nm
4179so this Section will only give a small set of examples.
4180.Ss BASIC PACKET FILTERING
4181This command adds an entry which denies all tcp packets from
4182.Em cracker.evil.org
4183to the telnet port of
4184.Em wolf.tambov.su
4185from being forwarded by the host:
4186.Pp
4187.Dl "ipfw add deny tcp from cracker.evil.org to wolf.tambov.su telnet"
4188.Pp
4189This one disallows any connection from the entire cracker's
4190network to my host:
4191.Pp
4192.Dl "ipfw add deny ip from 123.45.67.0/24 to my.host.org"
4193.Pp
4194A first and efficient way to limit access (not using dynamic rules)
4195is the use of the following rules:
4196.Pp
4197.Dl "ipfw add allow tcp from any to any established"
4198.Dl "ipfw add allow tcp from net1 portlist1 to net2 portlist2 setup"
4199.Dl "ipfw add allow tcp from net3 portlist3 to net3 portlist3 setup"
4200.Dl "..."
4201.Dl "ipfw add deny tcp from any to any"
4202.Pp
4203The first rule will be a quick match for normal TCP packets,
4204but it will not match the initial SYN packet, which will be
4205matched by the
4206.Cm setup
4207rules only for selected source/destination pairs.
4208All other SYN packets will be rejected by the final
4209.Cm deny
4210rule.
4211.Pp
4212If you administer one or more subnets, you can take advantage
4213of the address sets and or-blocks and write extremely
4214compact rulesets which selectively enable services to blocks
4215of clients, as below:
4216.Pp
4217.Dl "goodguys=\*q{ 10.1.2.0/24{20,35,66,18} or 10.2.3.0/28{6,3,11} }\*q"
4218.Dl "badguys=\*q10.1.2.0/24{8,38,60}\*q"
4219.Dl ""
4220.Dl "ipfw add allow ip from ${goodguys} to any"
4221.Dl "ipfw add deny ip from ${badguys} to any"
4222.Dl "... normal policies ..."
4223.Pp
4224The
4225.Cm verrevpath
4226option could be used to do automated anti-spoofing by adding the
4227following to the top of a ruleset:
4228.Pp
4229.Dl "ipfw add deny ip from any to any not verrevpath in"
4230.Pp
4231This rule drops all incoming packets that appear to be coming to the
4232system on the wrong interface.
4233For example, a packet with a source
4234address belonging to a host on a protected internal network would be
4235dropped if it tried to enter the system from an external interface.
4236.Pp
4237The
4238.Cm antispoof
4239option could be used to do similar but more restricted anti-spoofing
4240by adding the following to the top of a ruleset:
4241.Pp
4242.Dl "ipfw add deny ip from any to any not antispoof in"
4243.Pp
4244This rule drops all incoming packets that appear to be coming from another
4245directly connected system but on the wrong interface.
4246For example, a packet with a source address of
4247.Li 192.168.0.0/24 ,
4248configured on
4249.Li fxp0 ,
4250but coming in on
4251.Li fxp1
4252would be dropped.
4253.Pp
4254The
4255.Cm setdscp
4256option could be used to (re)mark user traffic,
4257by adding the following to the appropriate place in ruleset:
4258.Pp
4259.Dl "ipfw add setdscp be ip from any to any dscp af11,af21"
4260.Ss SELECTIVE MIRRORING
4261If your network has network traffic analyzer
4262connected to your host directly via dedicated interface
4263or remotely via RSPAN vlan, you can selectively mirror
4264some Ethernet layer2 frames to the analyzer.
4265.Pp
4266First, make sure your firewall is already configured and runs.
4267Then, enable layer2 processing if not already enabled:
4268.Pp
4269.Dl "sysctl net.link.ether.ipfw=1"
4270.Pp
4271Next, load needed additional kernel modules:
4272.Pp
4273.Dl "kldload ng_ether ng_ipfw"
4274.Pp
4275Optionally, make system load these modules automatically
4276at startup:
4277.Pp
4278.Dl sysrc kld_list+="ng_ether ng_ipfw"
4279.Pp
4280Next, configure
4281.Xr ng_ipfw 4
4282kernel module to transmit mirrored copies of layer2 frames
4283out via vlan900 interface:
4284.Pp
4285.Dl "ngctl connect ipfw: vlan900: 1 lower"
4286.Pp
4287Think of "1" here as of "mirroring instance index" and vlan900 is its
4288destination.
4289You can have arbitrary number of instances.
4290Refer to
4291.Xr ng_ipfw 4
4292for details.
4293.Pp
4294At last, actually start mirroring of selected frames using "instance 1".
4295For frames incoming from em0 interface:
4296.Pp
4297.Dl "ipfw add ngtee 1 ip from any to 192.168.0.1 layer2 in recv em0"
4298.Pp
4299For frames outgoing to em0 interface:
4300.Pp
4301.Dl "ipfw add ngtee 1 ip from any to 192.168.0.1 layer2 out xmit em0"
4302.Pp
4303For both incoming and outgoing frames while flowing through em0:
4304.Pp
4305.Dl "ipfw add ngtee 1 ip from any to 192.168.0.1 layer2 via em0"
4306.Pp
4307Make sure you do not perform mirroring for already duplicated frames
4308or kernel may hang as there is no safety net.
4309.Ss DYNAMIC RULES
4310In order to protect a site from flood attacks involving fake
4311TCP packets, it is safer to use dynamic rules:
4312.Pp
4313.Dl "ipfw add check-state"
4314.Dl "ipfw add deny tcp from any to any established"
4315.Dl "ipfw add allow tcp from my-net to any setup keep-state"
4316.Pp
4317This will let the firewall install dynamic rules only for
4318those connection which start with a regular SYN packet coming
4319from the inside of our network.
4320Dynamic rules are checked when encountering the first
4321occurrence of a
4322.Cm check-state ,
4323.Cm keep-state
4324or
4325.Cm limit
4326rule.
4327A
4328.Cm check-state
4329rule should usually be placed near the beginning of the
4330ruleset to minimize the amount of work scanning the ruleset.
4331Your mileage may vary.
4332.Pp
4333For more complex scenarios with dynamic rules
4334.Cm record-state
4335and
4336.Cm defer-action
4337can be used to precisely control creation and checking of dynamic rules.
4338Example of usage of these options are provided in
4339.Sx NETWORK ADDRESS TRANSLATION (NAT)
4340Section.
4341.Pp
4342To limit the number of connections a user can open
4343you can use the following type of rules:
4344.Pp
4345.Dl "ipfw add allow tcp from my-net/24 to any setup limit src-addr 10"
4346.Dl "ipfw add allow tcp from any to me setup limit src-addr 4"
4347.Pp
4348The former (assuming it runs on a gateway) will allow each host
4349on a /24 network to open at most 10 TCP connections.
4350The latter can be placed on a server to make sure that a single
4351client does not use more than 4 simultaneous connections.
4352.Pp
4353.Em BEWARE :
4354stateful rules can be subject to denial-of-service attacks
4355by a SYN-flood which opens a huge number of dynamic rules.
4356The effects of such attacks can be partially limited by
4357acting on a set of
4358.Xr sysctl 8
4359variables which control the operation of the firewall.
4360.Pp
4361Here is a good usage of the
4362.Cm list
4363command to see accounting records and timestamp information:
4364.Pp
4365.Dl ipfw -at list
4366.Pp
4367or in short form without timestamps:
4368.Pp
4369.Dl ipfw -a list
4370.Pp
4371which is equivalent to:
4372.Pp
4373.Dl ipfw show
4374.Pp
4375Next rule diverts all incoming packets from 192.168.2.0/24
4376to divert port 5000:
4377.Pp
4378.Dl ipfw divert 5000 ip from 192.168.2.0/24 to any in
4379.Ss TRAFFIC SHAPING
4380The following rules show some of the applications of
4381.Nm
4382and
4383.Nm dummynet
4384for simulations and the like.
4385.Pp
4386This rule drops random incoming packets with a probability
4387of 5%:
4388.Pp
4389.Dl "ipfw add prob 0.05 deny ip from any to any in"
4390.Pp
4391A similar effect can be achieved making use of
4392.Nm dummynet
4393pipes:
4394.Pp
4395.Dl "dnctl add pipe 10 ip from any to any"
4396.Dl "dnctl pipe 10 config plr 0.05"
4397.Pp
4398We can use pipes to artificially limit bandwidth, e.g.\& on a
4399machine acting as a router, if we want to limit traffic from
4400local clients on 192.168.2.0/24 we do:
4401.Pp
4402.Dl "ipfw add pipe 1 ip from 192.168.2.0/24 to any out"
4403.Dl "dnctl pipe 1 config bw 300Kbit/s queue 50KBytes"
4404.Pp
4405note that we use the
4406.Cm out
4407modifier so that the rule is not used twice.
4408Remember in fact that
4409.Nm
4410rules are checked both on incoming and outgoing packets.
4411.Pp
4412Should we want to simulate a bidirectional link with bandwidth
4413limitations, the correct way is the following:
4414.Pp
4415.Dl "ipfw add pipe 1 ip from any to any out"
4416.Dl "ipfw add pipe 2 ip from any to any in"
4417.Dl "dnctl pipe 1 config bw 64Kbit/s queue 10Kbytes"
4418.Dl "dnctl pipe 2 config bw 64Kbit/s queue 10Kbytes"
4419.Pp
4420The above can be very useful, e.g.\& if you want to see how
4421your fancy Web page will look for a residential user who
4422is connected only through a slow link.
4423You should not use only one pipe for both directions, unless
4424you want to simulate a half-duplex medium (e.g.\& AppleTalk,
4425Ethernet, IRDA).
4426It is not necessary that both pipes have the same configuration,
4427so we can also simulate asymmetric links.
4428.Pp
4429Should we want to verify network performance with the RED queue
4430management algorithm:
4431.Pp
4432.Dl "ipfw add pipe 1 ip from any to any"
4433.Dl "dnctl pipe 1 config bw 500Kbit/s queue 100 red 0.002/30/80/0.1"
4434.Pp
4435Another typical application of the traffic shaper is to
4436introduce some delay in the communication.
4437This can significantly affect applications which do a lot of Remote
4438Procedure Calls, and where the round-trip-time of the
4439connection often becomes a limiting factor much more than
4440bandwidth:
4441.Pp
4442.Dl "ipfw add pipe 1 ip from any to any out"
4443.Dl "ipfw add pipe 2 ip from any to any in"
4444.Dl "dnctl pipe 1 config delay 250ms bw 1Mbit/s"
4445.Dl "dnctl pipe 2 config delay 250ms bw 1Mbit/s"
4446.Pp
4447Per-flow queueing can be useful for a variety of purposes.
4448A very simple one is counting traffic:
4449.Pp
4450.Dl "ipfw add pipe 1 tcp from any to any"
4451.Dl "ipfw add pipe 1 udp from any to any"
4452.Dl "ipfw add pipe 1 ip from any to any"
4453.Dl "dnctl pipe 1 config mask all"
4454.Pp
4455The above set of rules will create queues (and collect
4456statistics) for all traffic.
4457Because the pipes have no limitations, the only effect is
4458collecting statistics.
4459Note that we need 3 rules, not just the last one, because
4460when
4461.Nm
4462tries to match IP packets it will not consider ports, so we
4463would not see connections on separate ports as different
4464ones.
4465.Pp
4466A more sophisticated example is limiting the outbound traffic
4467on a net with per-host limits, rather than per-network limits:
4468.Pp
4469.Dl "ipfw add pipe 1 ip from 192.168.2.0/24 to any out"
4470.Dl "ipfw add pipe 2 ip from any to 192.168.2.0/24 in"
4471.Dl "dnctl pipe 1 config mask src-ip 0x000000ff bw 200Kbit/s queue 20Kbytes"
4472.Dl "dnctl pipe 2 config mask dst-ip 0x000000ff bw 200Kbit/s queue 20Kbytes"
4473.Ss LOOKUP TABLES
4474In the following example, we need to create several traffic bandwidth
4475classes and we need different hosts/networks to fall into different classes.
4476We create one pipe for each class and configure them accordingly.
4477Then we create a single table and fill it with IP subnets and addresses.
4478For each subnet/host we set the argument equal to the number of the pipe
4479that it should use.
4480Then we classify traffic using a single rule:
4481.Pp
4482.Dl "dnctl pipe 1 config bw 1000Kbyte/s"
4483.Dl "dnctl pipe 4 config bw 4000Kbyte/s"
4484.Dl "..."
4485.Dl "ipfw table T1 create type addr"
4486.Dl "ipfw table T1 add 192.168.2.0/24 1"
4487.Dl "ipfw table T1 add 192.168.0.0/27 4"
4488.Dl "ipfw table T1 add 192.168.0.2 1"
4489.Dl "..."
4490.Dl "ipfw add pipe tablearg ip from 'table(T1)' to any"
4491.Pp
4492Using the
4493.Cm fwd
4494action, the table entries may include hostnames and IP addresses.
4495.Pp
4496.Dl "ipfw table T2 create type addr valtype ipv4"
4497.Dl "ipfw table T2 add 192.168.2.0/24 10.23.2.1"
4498.Dl "ipfw table T2 add 192.168.0.0/27 router1.dmz"
4499.Dl "..."
4500.Dl "ipfw add 100 fwd tablearg ip from any to 'table(T2)'"
4501.Pp
4502In the following example per-interface firewall is created:
4503.Pp
4504.Dl "ipfw table IN create type iface valtype skipto,fib"
4505.Dl "ipfw table IN add vlan20 12000,12"
4506.Dl "ipfw table IN add vlan30 13000,13"
4507.Dl "ipfw table OUT create type iface valtype skipto"
4508.Dl "ipfw table OUT add vlan20 22000"
4509.Dl "ipfw table OUT add vlan30 23000"
4510.Dl ".."
4511.Dl "ipfw add 100 setfib tablearg ip from any to any recv 'table(IN)' in"
4512.Dl "ipfw add 200 skipto tablearg ip from any to any recv 'table(IN)' in"
4513.Dl "ipfw add 300 skipto tablearg ip from any to any xmit 'table(OUT)' out"
4514.Pp
4515The following example illustrate usage of flow tables:
4516.Pp
4517.Dl "ipfw table fl create type flow:src-ip,proto,dst-ip,dst-port"
4518.Dl "ipfw table fl add 2a02:6b8:77::88,tcp,2a02:6b8:77::99,80 11"
4519.Dl "ipfw table fl add 10.0.0.1,udp,10.0.0.2,53 12"
4520.Dl ".."
4521.Dl "ipfw add 100 allow ip from any to any flow 'table(fl,11)' recv ix0"
4522.Ss SETS OF RULES
4523To add a set of rules atomically, e.g.\& set 18:
4524.Pp
4525.Dl "ipfw set disable 18"
4526.Dl "ipfw add NN set 18 ...         # repeat as needed"
4527.Dl "ipfw set enable 18"
4528.Pp
4529To delete a set of rules atomically the command is simply:
4530.Pp
4531.Dl "ipfw delete set 18"
4532.Pp
4533To test a ruleset and disable it and regain control if something goes wrong:
4534.Pp
4535.Dl "ipfw set disable 18"
4536.Dl "ipfw add NN set 18 ...         # repeat as needed"
4537.Dl "ipfw set enable 18; echo done; sleep 30 && ipfw set disable 18"
4538.Pp
4539Here if everything goes well, you press control-C before the "sleep"
4540terminates, and your ruleset will be left active.
4541Otherwise, e.g.\& if
4542you cannot access your box, the ruleset will be disabled after
4543the sleep terminates thus restoring the previous situation.
4544.Pp
4545To show rules of the specific set:
4546.Pp
4547.Dl "ipfw set 18 show"
4548.Pp
4549To show rules of the disabled set:
4550.Pp
4551.Dl "ipfw -S set 18 show"
4552.Pp
4553To clear a specific rule counters of the specific set:
4554.Pp
4555.Dl "ipfw set 18 zero NN"
4556.Pp
4557To delete a specific rule of the specific set:
4558.Pp
4559.Dl "ipfw set 18 delete NN"
4560.Ss NAT, REDIRECT AND LSNAT
4561First redirect all the traffic to nat instance 123:
4562.Pp
4563.Dl "ipfw add nat 123 all from any to any"
4564.Pp
4565Then to configure nat instance 123 to alias all the outgoing traffic with ip
4566192.168.0.123, blocking all incoming connections, trying to keep
4567same ports on both sides, clearing aliasing table on address change
4568and keeping a log of traffic/link statistics:
4569.Pp
4570.Dl "ipfw nat 123 config ip 192.168.0.123 log deny_in reset same_ports"
4571.Pp
4572Or to change address of instance 123, aliasing table will be cleared (see
4573reset option):
4574.Pp
4575.Dl "ipfw nat 123 config ip 10.0.0.1"
4576.Pp
4577To see configuration of nat instance 123:
4578.Pp
4579.Dl "ipfw nat 123 show config"
4580.Pp
4581To show logs of all instances:
4582.Pp
4583.Dl "ipfw nat show log"
4584.Pp
4585To see configurations of all instances:
4586.Pp
4587.Dl "ipfw nat show config"
4588.Pp
4589Or a redirect rule with mixed modes could looks like:
4590.Bd -literal -offset 2n
4591ipfw nat 123 config redirect_addr 10.0.0.1 10.0.0.66
4592			 redirect_port tcp 192.168.0.1:80 500
4593			 redirect_proto udp 192.168.1.43 192.168.1.1
4594			 redirect_addr 192.168.0.10,192.168.0.11
4595			 	    10.0.0.100	# LSNAT
4596			 redirect_port tcp 192.168.0.1:80,192.168.0.10:22
4597			 	    500		# LSNAT
4598.Ed
4599.Pp
4600or it could be split in:
4601.Bd -literal -offset 2n
4602ipfw nat 1 config redirect_addr 10.0.0.1 10.0.0.66
4603ipfw nat 2 config redirect_port tcp 192.168.0.1:80 500
4604ipfw nat 3 config redirect_proto udp 192.168.1.43 192.168.1.1
4605ipfw nat 4 config redirect_addr 192.168.0.10,192.168.0.11,192.168.0.12
4606				         10.0.0.100
4607ipfw nat 5 config redirect_port tcp
4608			192.168.0.1:80,192.168.0.10:22,192.168.0.20:25 500
4609.Ed
4610.Pp
4611Sometimes you may want to mix NAT and dynamic rules.
4612It could be achieved with
4613.Cm record-state
4614and
4615.Cm defer-action
4616options.
4617Problem is, you need to create dynamic rule before NAT and check it
4618after NAT actions (or vice versa) to have consistent addresses and ports.
4619Rule with
4620.Cm keep-state
4621option will trigger activation of existing dynamic state, and action of such
4622rule will be performed as soon as rule is matched.
4623In case of NAT and
4624.Cm allow
4625rule packet need to be passed to NAT, not allowed as soon is possible.
4626.Pp
4627There is example of set of rules to achieve this.
4628Bear in mind that this is example only and it is not very useful by itself.
4629.Pp
4630On way out, after all checks place this rules:
4631.Pp
4632.Dl "ipfw add allow record-state skip-action"
4633.Dl "ipfw add nat 1"
4634.Pp
4635And on way in there should be something like this:
4636.Pp
4637.Dl "ipfw add nat 1"
4638.Dl "ipfw add check-state"
4639.Pp
4640Please note, that first rule on way out doesn't allow packet and doesn't
4641execute existing dynamic rules.
4642All it does, create new dynamic rule with
4643.Cm allow
4644action, if it is not created yet.
4645Later, this dynamic rule is used on way in by
4646.Cm check-state
4647rule.
4648.Ss CONFIGURING CODEL, PIE, FQ-CODEL and FQ-PIE AQM
4649.Cm codel
4650and
4651.Cm pie
4652AQM can be configured for
4653.Nm dummynet
4654.Cm pipe
4655or
4656.Cm queue .
4657.Pp
4658To configure a
4659.Cm pipe
4660with
4661.Cm codel
4662AQM using default configuration for traffic from 192.168.0.0/24 and 1Mbits/s
4663rate limit, we do:
4664.Pp
4665.Dl "dnctl pipe 1 config bw 1mbits/s codel"
4666.Dl "ipfw add 100 pipe 1 ip from 192.168.0.0/24 to any"
4667.Pp
4668To configure a
4669.Cm queue
4670with
4671.Cm codel
4672AQM using different configurations parameters for traffic from
4673192.168.0.0/24 and 1Mbits/s rate limit, we do:
4674.Pp
4675.Dl "dnctl pipe 1 config bw 1mbits/s"
4676.Dl "dnctl queue 1 config pipe 1 codel target 8ms interval 160ms ecn"
4677.Dl "ipfw add 100 queue 1 ip from 192.168.0.0/24 to any"
4678.Pp
4679To configure a
4680.Cm pipe
4681with
4682.Cm pie
4683AQM using default configuration for traffic from 192.168.0.0/24 and 1Mbits/s
4684rate limit, we do:
4685.Pp
4686.Dl "dnctl pipe 1 config bw 1mbits/s pie"
4687.Dl "ipfw add 100 pipe 1 ip from 192.168.0.0/24 to any"
4688.Pp
4689To configure a
4690.Cm queue
4691with
4692.Cm pie
4693AQM using different configuration parameters for traffic from
4694192.168.0.0/24 and 1Mbits/s rate limit, we do:
4695.Pp
4696.Dl "dnctl pipe 1 config bw 1mbits/s"
4697.Dl "dnctl queue 1 config pipe 1 pie target 20ms tupdate 30ms ecn"
4698.Dl "ipfw add 100 queue 1 ip from 192.168.0.0/24 to any"
4699.Pp
4700.Cm fq_codel
4701and
4702.Cm fq_pie
4703AQM can be configured for
4704.Nm dummynet
4705schedulers.
4706.Pp
4707To configure
4708.Cm fq_codel
4709scheduler using different configurations parameters for traffic from
4710192.168.0.0/24 and 1Mbits/s rate limit, we do:
4711.Pp
4712.Dl "dnctl pipe 1 config bw 1mbits/s"
4713.Dl "dnctl sched 1 config pipe 1 type fq_codel"
4714.Dl "dnctl queue 1 config sched 1"
4715.Dl "ipfw add 100 queue 1 ip from 192.168.0.0/24 to any"
4716.Pp
4717To change
4718.Cm fq_codel
4719default configuration for a
4720.Cm sched
4721such as disable ECN and change the
4722.Ar target
4723to 10ms, we do:
4724.Pp
4725.Dl "dnctl sched 1 config pipe 1 type fq_codel target 10ms noecn"
4726.Pp
4727Similar to
4728.Cm fq_codel ,
4729to configure
4730.Cm fq_pie
4731scheduler using different configurations parameters for traffic from
4732192.168.0.0/24 and 1Mbits/s rate limit, we do:
4733.Pp
4734.Dl "dnctl pipe 1 config bw 1mbits/s"
4735.Dl "dnctl sched 1 config pipe 1 type fq_pie"
4736.Dl "dnctl queue 1 config sched 1"
4737.Dl "ipfw add 100 queue 1 ip from 192.168.0.0/24 to any"
4738.Pp
4739The configurations of
4740.Cm fq_pie
4741.Cm sched
4742can be changed in a similar way as for
4743.Cm fq_codel
4744.Sh SEE ALSO
4745.Xr cpp 1 ,
4746.Xr m4 1 ,
4747.Xr altq 4 ,
4748.Xr divert 4 ,
4749.Xr dummynet 4 ,
4750.Xr if_bridge 4 ,
4751.Xr ip 4 ,
4752.Xr ipfirewall 4 ,
4753.Xr ng_ether 4 ,
4754.Xr ng_ipfw 4 ,
4755.Xr protocols 5 ,
4756.Xr services 5 ,
4757.Xr init 8 ,
4758.Xr kldload 8 ,
4759.Xr reboot 8 ,
4760.Xr sysctl 8 ,
4761.Xr syslogd 8 ,
4762.Xr sysrc 8
4763.Sh HISTORY
4764The
4765.Nm
4766utility first appeared in
4767.Fx 2.0 .
4768.Nm dummynet
4769was introduced in
4770.Fx 2.2.8 .
4771Stateful extensions were introduced in
4772.Fx 4.0 .
4773.Nm ipfw2
4774was introduced in Summer 2002.
4775.Sh AUTHORS
4776.An Ugen J. S. Antsilevich ,
4777.An Poul-Henning Kamp ,
4778.An Alex Nash ,
4779.An Archie Cobbs ,
4780.An Luigi Rizzo ,
4781.An Rasool Al-Saadi .
4782.Pp
4783.An -nosplit
4784API based upon code written by
4785.An Daniel Boulet
4786for BSDI.
4787.Pp
4788Dummynet has been introduced by Luigi Rizzo in 1997-1998.
4789.Pp
4790Some early work (1999-2000) on the
4791.Nm dummynet
4792traffic shaper supported by Akamba Corp.
4793.Pp
4794The ipfw core (ipfw2) has been completely redesigned and
4795reimplemented by Luigi Rizzo in summer 2002.
4796Further
4797actions and
4798options have been added by various developers over the years.
4799.Pp
4800.An -nosplit
4801In-kernel NAT support written by
4802.An Paolo Pisati Aq Mt piso@FreeBSD.org
4803as part of a Summer of Code 2005 project.
4804.Pp
4805SCTP
4806.Nm nat
4807support has been developed by
4808.An The Centre for Advanced Internet Architectures (CAIA) Aq http://www.caia.swin.edu.au .
4809The primary developers and maintainers are David Hayes and Jason But.
4810For further information visit:
4811.Aq http://www.caia.swin.edu.au/urp/SONATA
4812.Pp
4813Delay profiles have been developed by Alessandro Cerri and
4814Luigi Rizzo, supported by the
4815European Commission within Projects Onelab and Onelab2.
4816.Pp
4817CoDel, PIE, FQ-CoDel and FQ-PIE AQM for Dummynet have been implemented by
4818.An The Centre for Advanced Internet Architectures (CAIA)
4819in 2016, supported by The Comcast Innovation Fund.
4820The primary developer is
4821Rasool Al-Saadi.
4822.Sh BUGS
4823The syntax has grown over the years and sometimes it might be confusing.
4824Unfortunately, backward compatibility prevents cleaning up mistakes
4825made in the definition of the syntax.
4826.Pp
4827.Em !!! WARNING !!!
4828.Pp
4829Misconfiguring the firewall can put your computer in an unusable state,
4830possibly shutting down network services and requiring console access to
4831regain control of it.
4832.Pp
4833Incoming packet fragments diverted by
4834.Cm divert
4835are reassembled before delivery to the socket.
4836The action used on those packet is the one from the
4837rule which matches the first fragment of the packet.
4838.Pp
4839Packets diverted to userland, and then reinserted by a userland process
4840may lose various packet attributes.
4841The packet source interface name
4842will be preserved if it is shorter than 8 bytes and the userland process
4843saves and reuses the sockaddr_in
4844(as does
4845.Xr natd 8 ) ;
4846otherwise, it may be lost.
4847If a packet is reinserted in this manner, later rules may be incorrectly
4848applied, making the order of
4849.Cm divert
4850rules in the rule sequence very important.
4851.Pp
4852Dummynet drops all packets with IPv6 link-local addresses.
4853.Pp
4854Rules using
4855.Cm uid
4856or
4857.Cm gid
4858may not behave as expected.
4859In particular, incoming SYN packets may
4860have no uid or gid associated with them since they do not yet belong
4861to a TCP connection, and the uid/gid associated with a packet may not
4862be as expected if the associated process calls
4863.Xr setuid 2
4864or similar system calls.
4865.Pp
4866Rule syntax is subject to the command line environment and some patterns
4867may need to be escaped with the backslash character
4868or quoted appropriately.
4869.Pp
4870Due to the architecture of
4871.Xr libalias 3 ,
4872ipfw nat is not compatible with the TCP segmentation offloading (TSO).
4873Thus, to reliably nat your network traffic, please disable TSO
4874on your NICs using
4875.Xr ifconfig 8 .
4876.Pp
4877ICMP error messages are not implicitly matched by dynamic rules
4878for the respective conversations.
4879To avoid failures of network error detection and path MTU discovery,
4880ICMP error messages may need to be allowed explicitly through static
4881rules.
4882.Pp
4883Rules using
4884.Cm call
4885and
4886.Cm return
4887actions may lead to confusing behaviour if ruleset has mistakes,
4888and/or interaction with other subsystems (netgraph, dummynet, etc.) is used.
4889One possible case for this is packet leaving
4890.Nm
4891in subroutine on the input pass, while later on output encountering unpaired
4892.Cm return
4893first.
4894As the call stack is kept intact after input pass, packet will suddenly
4895return to the rule number used on input pass, not on output one.
4896Order of processing should be checked carefully to avoid such mistakes.
4897