xref: /freebsd/share/doc/IPv6/IMPLEMENTATION (revision 4f29da19bd44f0e99f021510460a81bf754c21d2)
1	Implementation Note
2
3	KAME Project
4	http://www.kame.net/
5	$KAME: IMPLEMENTATION,v 1.216 2001/05/25 07:43:01 jinmei Exp $
6	$FreeBSD$
7
8NOTE: The document tries to describe behaviors/implementation choices
9of the latest KAME/*BSD stack (like KAME/NetBSD 1.5.1).  The description
10here may not be applicable to KAME-integrated *BSD releases (like stock
11NetBSD 1.5.1), as we have certain amount of changes between them.  Still,
12some of the content can be useful for KAME-integrated *BSD releases.
13
14Table of Contents
15
16	1. IPv6
17	1.1 Conformance
18	1.2 Neighbor Discovery
19	1.3 Scope Zone Index
20	1.3.1 Kernel internal
21	1.3.2 Interaction with API
22	1.3.3 Interaction with users (command line)
23	1.4 Plug and Play
24	1.4.1 Assignment of link-local, and special addresses
25	1.4.2 Stateless address autoconfiguration on hosts
26	1.4.3 DHCPv6
27	1.5 Generic tunnel interface
28	1.6 Address Selection
29	1.6.1 Source Address Selection
30	1.6.2 Destination Address Ordering
31	1.7 Jumbo Payload
32	1.8 Loop prevention in header processing
33	1.9 ICMPv6
34	1.10 Applications
35	1.11 Kernel Internals
36	1.12 IPv4 mapped address and IPv6 wildcard socket
37	1.12.1 KAME/BSDI3 and KAME/FreeBSD228
38	1.12.2 KAME/FreeBSD[34]x
39	1.12.2.1 KAME/FreeBSD[34]x, listening side
40	1.12.2.2 KAME/FreeBSD[34]x, initiating side
41	1.12.3 KAME/NetBSD
42	1.12.3.1 KAME/NetBSD, listening side
43	1.12.3.2 KAME/NetBSD, initiating side
44	1.12.4 KAME/BSDI4
45	1.12.4.1 KAME/BSDI4, listening side
46	1.12.4.2 KAME/BSDI4, initiating side
47	1.12.5 KAME/OpenBSD
48	1.12.5.1 KAME/OpenBSD, listening side
49	1.12.5.2 KAME/OpenBSD, initiating side
50	1.12.6 More issues
51	1.12.7 Interaction with SIIT translator
52	1.13 sockaddr_storage
53	1.14 Invalid addresses on the wire
54	1.15 Node's required addresses
55	1.15.1 Host case
56	1.15.2 Router case
57	1.16 Advanced API
58	1.17 DNS resolver
59	2. Network Drivers
60	2.1 FreeBSD 2.2.x-RELEASE
61	2.2 BSD/OS 3.x
62	2.3 NetBSD
63	2.4 FreeBSD 3.x-RELEASE
64	2.5 FreeBSD 4.x-RELEASE
65	2.6 OpenBSD 2.x
66	2.7 BSD/OS 4.x
67	3. Translator
68	3.1 FAITH TCP relay translator
69	3.2 IPv6-to-IPv4 header translator
70	4. IPsec
71	4.1 Policy Management
72	4.2 Key Management
73	4.3 AH and ESP handling
74	4.4 IPComp handling
75	4.5 Conformance to RFCs and IDs
76	4.6 ECN consideration on IPsec tunnels
77	4.7 Interoperability
78	4.8 Operations with IPsec tunnel mode
79	4.8.1 RFC2401 IPsec tunnel mode approach
80	4.8.2 draft-touch-ipsec-vpn approach
81	5. ALTQ
82	6. Mobile IPv6
83	6.1 KAME node as correspondent node
84	6.2 KAME node as home agent/mobile node
85	6.3 Old Mobile IPv6 code
86	7. Routing table extensions
87	7.1 ART routing table lookup algorithm
88	7.2 Multipath routing support
89	8. Coding style
90	9. Policy on technology with intellectual property right restriction
91
921. IPv6
93
941.1 Conformance
95
96The KAME kit conforms, or tries to conform, to the latest set of IPv6
97specifications.  For future reference we list some of the relevant documents
98below (NOTE: this is not a complete list - this is too hard to maintain...).
99For details please refer to specific chapter in the document, RFCs, manpages
100come with KAME, or comments in the source code.
101
102Conformance tests have been performed on past and latest KAME STABLE kit,
103at TAHI project.  Results can be viewed at http://www.tahi.org/report/KAME/.
104We also attended Univ. of New Hampshire IOL tests (http://www.iol.unh.edu/)
105in the past, with our past snapshots.
106
107RFC1639: FTP Operation Over Big Address Records (FOOBAR)
108    * RFC2428 is preferred over RFC1639.  ftp clients will first try RFC2428,
109      then RFC1639 if failed.
110RFC1886: DNS Extensions to support IPv6
111RFC1933: (see RFC2893)
112RFC1981: Path MTU Discovery for IPv6
113RFC2080: RIPng for IPv6
114    * KAME-supplied route6d, bgpd and hroute6d support this.
115RFC2283: Multiprotocol Extensions for BGP-4
116    * so-called "BGP4+".
117    * KAME-supplied bgpd supports this.
118RFC2292: Advanced Sockets API for IPv6
119    * see RFC3542
120RFC2362: Protocol Independent Multicast-Sparse Mode (PIM-SM)
121    * RFC2362 defines the packet formats and the protcol of PIM-SM.
122RFC2373: IPv6 Addressing Architecture
123    * KAME supports node required addresses, and conforms to the scope
124      requirement.
125RFC2374: An IPv6 Aggregatable Global Unicast Address Format
126    * KAME supports 64-bit length of Interface ID.
127RFC2375: IPv6 Multicast Address Assignments
128    * Userland applications use the well-known addresses assigned in the RFC.
129RFC2428: FTP Extensions for IPv6 and NATs
130    * RFC2428 is preferred over RFC1639.  ftp clients will first try RFC2428,
131      then RFC1639 if failed.
132RFC2460: IPv6 specification
133RFC2461: Neighbor discovery for IPv6
134    * See 1.2 in this document for details.
135RFC2462: IPv6 Stateless Address Autoconfiguration
136    * See 1.4 in this document for details.
137RFC2463: ICMPv6 for IPv6 specification
138    * See 1.9 in this document for details.
139RFC2464: Transmission of IPv6 Packets over Ethernet Networks
140RFC2465: MIB for IPv6: Textual Conventions and General Group
141    * Necessary statistics are gathered by the kernel.  Actual IPv6 MIB
142      support is provided as patchkit for ucd-snmp.
143RFC2466: MIB for IPv6: ICMPv6 group
144    * Necessary statistics are gathered by the kernel.  Actual IPv6 MIB
145      support is provided as patchkit for ucd-snmp.
146RFC2467: Transmission of IPv6 Packets over FDDI Networks
147RFC2472: IPv6 over PPP
148RFC2492: IPv6 over ATM Networks
149    * only PVC is supported.
150RFC2497: Transmission of IPv6 packet over ARCnet Networks
151RFC2545: Use of BGP-4 Multiprotocol Extensions for IPv6 Inter-Domain Routing
152RFC2553: (see RFC3493)
153RFC2671: Extension Mechanisms for DNS (EDNS0)
154    * see USAGE for how to use it.
155    * not supported on kame/freebsd4 and kame/bsdi4.
156RFC2673: Binary Labels in the Domain Name System
157    * KAME/bsdi4 supports A6, DNAME and binary label to some extent.
158    * KAME apps/bind8 repository has resolver library with partial A6, DNAME
159      and binary label support.
160RFC2675: IPv6 Jumbograms
161    * See 1.7 in this document for details.
162RFC2710: Multicast Listener Discovery for IPv6
163RFC2711: IPv6 router alert option
164RFC2732: Format for Literal IPv6 Addresses in URL's
165    * The spec is implemented in programs that handle URLs
166      (like freebsd ftpio(3) and fetch(1), or netbsd ftp(1))
167RFC2874: DNS Extensions to Support IPv6 Address Aggregation and Renumbering
168    * KAME/bsdi4 supports A6, DNAME and binary label to some extent.
169    * KAME apps/bind8 repository has resolver library with partial A6, DNAME
170      and binary label support.
171RFC2893: Transition Mechanisms for IPv6 Hosts and Routers
172    * IPv4 compatible address is not supported.
173    * automatic tunneling (4.3) is not supported.
174    * "gif" interface implements IPv[46]-over-IPv[46] tunnel in a generic way,
175      and it covers "configured tunnel" described in the spec.
176      See 1.5 in this document for details.
177RFC2894: Router renumbering for IPv6
178RFC3041: Privacy Extensions for Stateless Address Autoconfiguration in IPv6
179RFC3056: Connection of IPv6 Domains via IPv4 Clouds
180    * So-called "6to4".
181    * "stf" interface implements it.  Be sure to read
182      draft-itojun-ipv6-transition-abuse-01.txt
183      below before configuring it, there can be security issues.
184RFC3142: An IPv6-to-IPv4 transport relay translator
185    * FAITH tcp relay translator (faithd) implements this.  See 3.1 for more
186      details.
187RFC3152: Delegation of IP6.ARPA
188    * libinet6 resolvers contained in the KAME snaps support to use
189      the ip6.arpa domain (with the nibble format) for IPv6 reverse
190      lookups.
191RFC3484: Default Address Selection for IPv6
192    * the selection algorithm for both source and destination addresses
193      is implemented based on the RFC, though some rules are still omitted.
194RFC3493: Basic Socket Interface Extensions for IPv6
195    * IPv4 mapped address (3.7) and special behavior of IPv6 wildcard bind
196      socket (3.8) are,
197	- supported and turned on by default on KAME/FreeBSD[34]
198	  and KAME/BSDI4,
199	- supported but turned off by default on KAME/NetBSD and KAME/FreeBSD5,
200	- not supported on KAME/FreeBSD228, KAME/OpenBSD and KAME/BSDI3.
201      see 1.12 in this document for details.
202    * The AI_ALL and AI_V4MAPPED flags are not supported.
203RFC3542: Advanced Sockets API for IPv6 (revised)
204    * For supported library functions/kernel APIs, see sys/netinet6/ADVAPI.
205    * Some of the updates in the draft are not implemented yet.  See
206      TODO.2292bis for more details.
207RFC4007: IPv6 Scoped Address Architecture
208    * some part of the documentation (especially about the routing
209      model) is not supported yet.
210    * zone indices that contain scope types have not been supported yet.
211
212draft-ietf-ipngwg-icmp-name-lookups-09: IPv6 Name Lookups Through ICMP
213draft-ietf-ipv6-router-selection-07.txt:
214	Default Router Preferences and More-Specific Routes
215    * router-side: both router preference and specific routes are supported.
216    * host-side: only router preference is supported.
217draft-ietf-pim-sm-v2-new-02.txt
218	A revised version of RFC2362, which includes the IPv6 specific
219	packet format and protocol descriptions.
220draft-ietf-dnsext-mdns-00.txt: Multicast DNS
221    * kame/mdnsd has test implementation, which will not be built in
222      default compilation.  The draft will experience a major change in the
223      near future, so don't rely upon it.
224draft-ietf-ipngwg-icmp-v3-02.txt: ICMPv6 for IPv6 specification (revised)
225    * See 1.9 in this document for details.
226draft-itojun-ipv6-tcp-to-anycast-01.txt:
227	Disconnecting TCP connection toward IPv6 anycast address
228draft-ietf-ipv6-rfc2462bis-06.txt: IPv6 Stateless Address
229	Autoconfiguration (revised)
230draft-itojun-ipv6-transition-abuse-01.txt:
231	Possible abuse against IPv6 transition technologies (expired)
232    * KAME does not implement RFC1933/2893 automatic tunnel.
233    * "stf" interface implements some address filters.  Refer to stf(4)
234      for details.  Since there's no way to make 6to4 interface 100% secure,
235      we do not include "stf" interface into GENERIC.v6 compilation.
236    * kame/openbsd completely disables IPv4 mapped address support.
237    * kame/netbsd makes IPv4 mapped address support off by default.
238    * See section 1.12.6 and 1.14 for more details.
239draft-itojun-ipv6-flowlabel-api-01.txt: Socket API for IPv6 flow label field
240    * no consideration is made against the use of routing headers and such.
241
2421.2 Neighbor Discovery
243
244Our implementation of Neighbor Discovery is fairly stable.  Currently
245Address Resolution, Duplicated Address Detection, and Neighbor
246Unreachability Detection are supported.  In the near future we will be
247adding an Unsolicited Neighbor Advertisement transmission command as
248an administration tool.
249
250Duplicated Address Detection (DAD) will be performed when an IPv6 address
251is assigned to a network interface, or the network interface is enabled
252(ifconfig up).  It is documented in RFC2462 5.4.
253If DAD fails, the address will be marked "duplicated" and message will be
254generated to syslog (and usually to console).  The "duplicated" mark
255can be checked with ifconfig.  It is administrators' responsibility to check
256for and recover from DAD failures.  We may try to improve failure recovery
257in future KAME code.
258
259A successor version of RFC2462 (called rfc2462bis) clarifies the
260behavior when DAD fails (i.e., duplicate is detected): if the
261duplicate address is a link-local address formed from an interface
262identifier based on the hardware address which is supposed to be
263uniquely assigned (e.g., EUI-64 for an Ethernet interface), IPv6
264operation on the interface should be disabled.  The KAME
265implementation supports this as follows: if this type of duplicate is
266detected, the kernel marks "disabled" in the ND specific data
267structure for the interface.  Every IPv6 I/O operation in the kernel
268checks this mark, and the kernel will drop packets received on or
269being sent to the "disabled" interface.  Whether the IPv6 operation is
270disabled or not can be confirmed by the ndp(8) command.  See the man
271page for more details.
272
273DAD procedure may not be effective on certain network interfaces/drivers.
274If a network driver needs long initialization time (with wireless network
275interfaces this situation is popular), and the driver mistakingly raises
276IFF_RUNNING before the driver becomes ready, DAD code will try to transmit
277DAD probes to not-really-ready network driver and the packet will not go out
278from the interface.  In such cases, network drivers should be corrected.
279
280Some of network drivers loop multicast packets back to themselves,
281even if instructed not to do so (especially in promiscuous mode).  In
282such cases DAD may fail, because the DAD engine sees inbound NS packet
283(actually from the node itself) and considers it as a sign of
284duplicate.  In this case, drivers should be corrected to honor
285IFF_SIMPLEX behavior.  For example, you may need to check source MAC
286address on an inbound packet, and reject it if it is from the node
287itself.
288
289Neighbor Discovery specification (RFC2461) does not talk about neighbor
290cache handling in the following cases:
291(1) when there was no neighbor cache entry, node received unsolicited
292    RS/NS/NA/redirect packet without link-layer address
293(2) neighbor cache handling on medium without link-layer address
294    (we need a neighbor cache entry for IsRouter bit)
295For (1), we implemented workaround based on discussions on IETF ipngwg mailing
296list.  For more details, see the comments in the source code and email
297thread started from (IPng 7155), dated Feb 6 1999.
298
299IPv6 on-link determination rule (RFC2461) is quite different from
300assumptions in BSD IPv4 network code.  To implement the behavior in
301RFC2461 section 6.3.6 (3), the kernel needs to know the default
302outgoing interface.  To configure the default outgoing interface, use
303commands like "ndp -I de0" as root.  Then the kernel will have a
304"default" route to the interface with the cloning "C" bit being on.
305This default route will cause to make a neighbor cache entry for every
306destination that does not match an explicit route entry.
307
308Note that we intentionally disable configuring the default interface
309by default.  This is because we found it sometimes caused inconvenient
310situation while it was rarely useful in practical usage.  For example,
311consider a destination that has both IPv4 and IPv6 addresses but is
312only reachable via IPv4.  Since our getaddrinfo(3) prefers IPv6 by
313default, an (TCP) application using the library with PF_UNSPEC first
314tries to connect to the IPv6 address.  If we turn on RFC 2461 6.3.6
315(3), we have to wait for quite a long period before the first attempt
316to make a connection fails.  If we turn it off, the first attempt will
317immediately fail with EHOSTUNREACH, and then the application can try
318the next, reachable address.
319
320The notion of the default interface is also disabled when the node is
321acting as a router.  The reason is that routers tend to control all
322routes stored in the kernel and the default route automatically
323installed would rather confuse the routers.  Note that the spec misuse
324the word "host" and "node" in several places in Section 5.2 of RFC
3252461.  We basically read the word "node" in this section as "host,"
326and thus believe the implementation policy does not break the
327specification.
328
329To avoid possible DoS attacks and infinite loops, KAME stack will accept
330only 10 options on ND packet.  Therefore, if you have 20 prefix options
331attached to RA, only the first 10 prefixes will be recognized.
332If this troubles you, please contact the KAME team and/or modify
333nd6_maxndopt in sys/netinet6/nd6.c.  If there are high demands we may
334provide a sysctl knob for the variable.
335
336Proxy Neighbor Advertisement support is implemented in the kernel.
337For instance, you can configure it by using the following command:
338	# ndp -s fe80::1234%ne0 0:1:2:3:4:5 proxy
339where ne0 is the interface which attaches to the same link as the
340proxy target.
341There are certain limitations, though:
342- It does not send unsolicited multicast NA on configuration.  This is MAY
343  behavior in RFC2461.
344- It does not add random delay before transmission of solicited NA.  This is
345  SHOULD behavior in RFC2461.
346- We cannot configure proxy NDP for off-link address.  The target address for
347  proxying must be link-local address, or must be in prefixes configured to
348  node which does proxy NDP.
349- RFC2461 is unclear about if it is legal for a host to perform proxy ND.
350  We do not prohibit hosts from doing proxy ND, but there will be very limited
351  use in it.
352
353Starting mid March 2000, we support Neighbor Unreachability Detection
354(NUD) on p2p interfaces, including tunnel interfaces (gif).  NUD is
355turned on by default.  Before March 2000 the KAME stack did not
356perform NUD on p2p interfaces.  If the change raises any
357interoperability issues, you can turn off/on NUD by per-interface
358basis.  Use "ndp -i interface -nud" to turn it off.  Consult ndp(8)
359for details.
360
361RFC2461 specifies upper-layer reachability confirmation hint.  Whenever
362upper-layer reachability confirmation hint comes, ND process can use it
363to optimize neighbor discovery process - ND process can omit real ND exchange
364and keep the neighbor cache state in REACHABLE.
365We currently have two sources for hints: (1) setsockopt(IPV6_REACHCONF)
366defined by the RFC3542 API, and (2) hints from tcp(6)_input.
367
368It is questionable if they are really trustworthy.  For example, a
369rogue userland program can use IPV6_REACHCONF to confuse the ND
370process.  Neighbor cache is a system-wide information pool, and it is
371bad to allow a single process to affect others.  Also, tcp(6)_input
372can be hosed by hijack attempts.  It is wrong to allow hijack attempts
373to affect the ND process.
374
375Starting June 2000, the ND code has a protection mechanism against
376incorrect upper-layer reachability confirmation.  The ND code counts
377subsequent upper-layer hints.  If the number of hints reaches the
378maximum, the ND code will ignore further upper-layer hints and run
379real ND process to confirm reachability to the peer.  sysctl
380net.inet6.icmp6.nd6_maxnudhint defines the maximum # of subsequent
381upper-layer hints to be accepted.
382(from April 2000 to June 2000, we rejected setsockopt(IPV6_REACHCONF) from
383non-root process - after a local discussion, it looks that hints are not
384that trustworthy even if they are from privileged processes)
385
386If inbound ND packets carry invalid values, the KAME kernel will
387drop these packet and increment statistics variable.  See
388"netstat -sn", icmp6 section.  For detailed debugging session, you can
389turn on syslog output from the kernel on errors, by turning on sysctl MIB
390net.inet6.icmp6.nd6_debug.  nd6_debug can be turned on at bootstrap
391time, by defining ND6_DEBUG kernel compilation option (so you can
392debug behavior during bootstrap).  nd6_debug configuration should
393only be used for test/debug purposes - for a production environment,
394nd6_debug must be set to 0.  If you leave it to 1, malicious parties
395can inject broken packet and fill up /var/log partition.
396
3971.3 Scope Zone Index
398
399IPv6 uses scoped addresses.  It is therefore very important to
400specify the scope zone index (link index for a link-local address, or
401site index for a site-local address) with an IPv6 address.  Without a
402zone index, a scoped IPv6 address is ambiguous to the kernel, and
403the kernel would not be able to determine the outbound zone for a
404packet to the scoped address.  KAME code tries to address the issue in
405several ways.
406
407The entire architecture of scoped addresses is documented in RFC4007.
408One non-trivial point of the architecture is that the link scope is
409(theoretically) larger than the interface scope.  That is, two
410different interfaces can belong to a same single link.  However, in a
411normal operation, we can assume that there is 1-to-1 relationship
412between links and interfaces.  In other words, we can usually put
413links and interfaces in the same scope type.  The current KAME
414implementation assumes the 1-to-1 relationship.  In particular, we use
415interface names such as "ne1" as unique link identifiers.  This would
416be much more human-readable and intuitive than numeric identifiers,
417but please keep your mind on the theoretical difference between links
418and interfaces.
419
420Site-local addresses are very vaguely defined in the specs, and both
421the specification and the KAME code need tons of improvements to
422enable its actual use.  For example, it is still very unclear how we
423define a site, or how we resolve host names in a site.  There is work
424underway to define behavior of routers at site border, but, we have
425almost no code for site boundary node support (neither forwarding nor
426routing) and we bet almost noone has.  We recommend, at this moment,
427you to use global addresses for experiments - there are way too many
428pitfalls if you use site-local addresses.
429
4301.3.1 Kernel internal
431
432In the kernel, the link index for a link-local scope address is
433embedded into the 2nd 16bit-word (the 3rd and 4th bytes) in the IPv6
434address.
435For example, you may see something like:
436	fe80:1::200:f8ff:fe01:6317
437in the routing table and the interface address structure (struct
438in6_ifaddr).  The address above is a link-local unicast address which
439belongs to a network link whose link identifier is 1 (note that it
440eqauls to the interface index by the assumption of our
441implementation).  The embedded index enables us to identify IPv6
442link-local addresses over multiple links effectively and with only a
443little code change.
444
445The use of the internal format must be limited inside the kernel.  In
446particular, addresses sent by an application should not contain the
447embedded index (except via some very special APIs such as routing
448sockets).  Instead, the index should be specified in the sin6_scope_id
449field of a sockaddr_in6 structure.  Obviously, packets sent to or
450received from must not contain the embedded index either, since the
451index is meaningful only within the sending/receiving node.
452
453In order to deal with the differences, several kernel routines are
454provided.  These are available by including <netinet6/scope_var.h>.
455Typically, the following functions will be most generally used:
456
457- int sa6_embedscope(struct sockaddr_in6 *sa6, int defaultok);
458  Embed sa6->sin6_scope_id into sa6->sin6_addr.  If sin6_scope_id is
459  0, defaultok is non-0, and the default zone ID (see RFC4007) is
460  configured, the default ID will be used instead of the value of the
461  sin6_scope_id field.  On success, sa6->sin6_scope_id will be reset
462  to 0.
463
464  This function returns 0 on success, or a non-0 error code otherwise.
465
466- int sa6_recoverscope(struct sockaddr_in6 *sa6);
467  Extract embedded zone ID in sa6->sin6_addr and set
468  sa6->sin6_scope_id to that ID.  The embedded ID will be cleared with
469  0.
470
471  This function returns 0 on success, or a non-0 error code otherwise.
472
473- int in6_clearscope(struct in6_addr *in6);
474  Reset the embedded zone ID in 'in6' to 0.  This function never fails, and
475  returns 0 if the original address is intact or non 0 if the address is
476  modified.  The return value doesn't matter in most cases; currently, the
477  only point where we care about the return value is ip6_input() for checking
478  whether the source or destination addresses of the incoming packet is in
479  the embedded form.
480
481- int in6_setscope(struct in6_addr *in6, struct ifnet *ifp,
482                   u_int32_t *zoneidp);
483  Embed zone ID determined by the address scope type for 'in6' and the
484  interface 'ifp' into 'in6'.  If zoneidp is non NULL, *zoneidp will
485  also have the zone ID.
486
487  This function returns 0 on success, or a non-0 error code otherwise.
488
489The typical usage of these functions is as follows:
490
491sa6_embedscope() will be used at the socket or transport layer to
492convert a sockaddr_in6 structure passed by an application into the
493kernel-internal form.  In this usage, the second argument is often the
494'ip6_use_defzone' global variable.
495
496sa6_recoverscope() will also be used at the socket or transport layer
497to convert an in6_addr structure with the embedded zone ID into a
498sockaddr_in6 structure with the corresponding ID in the sin6_scope_id
499field (and without the embedded ID in sin6_addr).
500
501in6_clearscope() will be used just before sending a packet to the wire
502to remove the embedded ID.  In general, this must be done at the last
503stage of an output path, since otherwise the address would lose the ID
504and could be ambiguous with regard to scope.
505
506in6_setscope() will be used when the kernel receives a packet from the
507wire to construct the kernel internal form for each address field in
508the packet (typical examples are the source and destination addresses
509of the packet).  In the typical usage, the third argument 'zoneidp'
510will be NULL.  A non-NULL value will be used when the validity of the
511zone ID must be checked, e.g., when forwarding a packet to another
512link (see ip6_forward() for this usage).
513
514An application, when sending a packet, is basically assumed to specify
515the appropriate scope zone of the destination address by the
516sin6_scope_id field (this might be done transparently from the
517application with getaddrinfo() and the extended textual format - see
518below), or at least the default scope zone(s) must be configured as a
519last resort.  In some cases, however, an application could specify an
520ambiguous address with regard to scope, expecting it is disambiguated
521in the kernel by some other means.  A typical usage is to specify the
522outgoing interface through another API, which can disambiguate the
523unspecified scope zone.  Such a usage is not recommended, but the
524kernel implements some trick to deal with even this case.
525
526A rough sketch of the trick can be summarized as the following
527sequence.
528
529   sa6_embedscope(dst, ip6_use_defzone);
530   in6_selectsrc(dst, ..., &ifp, ...);
531   in6_setscope(&dst->sin6_addr, ifp, NULL);
532
533sa6_embedscope() first tries to convert sin6_scope_id (or the default
534zone ID) into the kernel-internal form.  This can fail with an
535ambiguous destination, but it still tries to get the outgoing
536interface (ifp) in the attempt of determining the source address of
537the outgoing packet using in6_selectsrc().  If the interface is
538detected, and the scope zone was originally ambiguous, in6_setscope()
539can finally determine the appropriate ID with the address itself and
540the interface, and construct the kernel-internal form.  See, for
541example, comments in udp6_output() for more concrete example.
542
543In any case, kernel routines except ones in netinet6/scope6.c MUST NOT
544directly refer to the embedded form.  They MUST use the above
545interface functions.  In particular, kernel routines MUST NOT have the
546following code fragment:
547
548	/* This is a bad practice.  Don't do this */
549	if (IN6_IS_ADDR_LINKLOCAL(&sin6->sin6_addr))
550		sin6->sin6_addr.s6_addr16[1] = htons(ifp->if_index);
551
552This is bad for several reasons.  First, address ambiguity is not
553specific to link-local addresses (any non-global multicast addresses
554are inherently ambiguous, and this is particularly true for
555interface-local addresses).  Secondly, this is vulnerable to future
556changes of the embedded form (the embedded position may change, or the
557zone ID may not actually be the interface index).  Only scope6.c
558routines should know the details.
559
560The above code fragment should thus actually be as follows:
561
562	/* This is correct. */
563	in6_setscope(&sin6->sin6_addr, ifp, NULL);
564	(and catch errors if possible and necessary)
565
5661.3.2 Interaction with API
567
568There are several candidates of API to deal with scoped addresses
569without ambiguity.
570
571The IPV6_PKTINFO ancillary data type or socket option defined in the
572advanced API (RFC2292 or RFC3542) can specify
573the outgoing interface of a packet.  Similarly, the IPV6_PKTINFO or
574IPV6_RECVPKTINFO socket options tell kernel to pass the incoming
575interface to user applications.
576
577These options are enough to disambiguate scoped addresses of an
578incoming packet, because we can uniquely identify the corresponding
579zone of the scoped address(es) by the incoming interface.  However,
580they are too strong for outgoing packets.  For example, consider a
581multi-sited node and suppose that more than one interface of the node
582belongs to a same site.  When we want to send a packet to the site,
583we can only specify one of the interfaces for the outgoing packet with
584these options; we cannot just say "send the packet to (one of the
585interfaces of) the site."
586
587Another kind of candidates is to use the sin6_scope_id member in the
588sockaddr_in6 structure, defined in RFC2553.  The KAME kernel
589interprets the sin6_scope_id field properly in order to disambiguate scoped
590addresses.  For example, if an application passes a sockaddr_in6
591structure that has a non-zero sin6_scope_id value to the sendto(2)
592system call, the kernel should send the packet to the appropriate zone
593according to the sin6_scope_id field.  Similarly, when the source or
594the destination address of an incoming packet is a scoped one, the
595kernel should detect the correct zone identifier based on the address
596and the receiving interface, fill the identifier in the sin6_scope_id
597field of a sockaddr_in6 structure, and then pass the packet to an
598application via the recvfrom(2) system call, etc.
599
600However, the semantics of the sin6_scope_id is still vague and on the
601way to standardization.  Additionally, not so many operating systems
602support the behavior above at this moment.
603
604In summary,
605- If your target system is limited to KAME based ones (i.e. BSD
606  variants and KAME snaps), use the sin6_scope_id field assuming the
607  kernel behavior described above.
608- Otherwise, (i.e. if your program should be portable on other systems
609  than BSDs)
610  + Use the advanced API to disambiguate scoped addresses of incoming
611    packets.
612  + To disambiguate scoped addresses of outgoing packets,
613    * if it is okay to just specify the outgoing interface, use the
614      advanced API.  This would be the case, for example, when you
615      should only consider link-local addresses and your system
616      assumes 1-to-1 relationship between links and interfaces.
617    * otherwise, sorry but you lose.  Please rush the IETF IPv6
618      community into standardizing the semantics of the sin6_scope_id
619      field.
620
621Routing daemons and configuration programs, like route6d and ifconfig,
622will need to manipulate the "embedded" zone index.  These programs use
623routing sockets and ioctls (like SIOCGIFADDR_IN6) and the kernel API
624will return IPv6 addresses with the 2nd 16bit-word filled in.  The
625APIs are for manipulating kernel internal structure.  Programs that
626use these APIs have to be prepared about differences in kernels
627anyway.
628
629getaddrinfo(3) and getnameinfo(3) support an extended numeric IPv6
630syntax, as documented in RFC4007.  You can specify the outgoing link,
631by using the name of the outgoing interface as the link, like
632"fe80::1%ne0" (again, note that we assume there is 1-to-1 relationship
633between links and interfaces.)  This way you will be able to specify a
634link-local scoped address without much trouble.
635
636Other APIs like inet_pton(3) and inet_ntop(3) are inherently
637unfriendly with scoped addresses, since they are unable to annotate
638addresses with zone identifier.
639
6401.3.3 Interaction with users (command line)
641
642Most of user applications now support the extended numeric IPv6
643syntax.  In this case, you can specify outgoing link, by using the name
644of the outgoing interface like "fe80::1%ne0" (sorry for the duplicated
645notice, but please recall again that we assume 1-to-1 relationship
646between links and interfaces).  This is even the case for some
647management tools such as route(8) or ndp(8).  For example, to install
648the IPv6 default route by hand, you can type like
649	# route add -inet6 default fe80::9876:5432:1234:abcd%ne0
650(Although we suggest you to run dynamic routing instead of static
651routes, in order to avoid configuration mistakes.)
652
653Some applications have command line options for specifying an
654appropriate zone of a scoped address (like "ping6 -I ne0 ff02::1" to
655specify the outgoing interface).  However, you can't always expect such
656options.  Additionally, specifying the outgoing "interface" is in
657theory an overspecification as a way to specify the outgoing "link"
658(see above).  Thus, we recommend you to use the extended format
659described above.  This should apply to the case where the outgoing
660interface is specified.
661
662In any case, when you specify a scoped address to the command line,
663NEVER write the embedded form (such as ff02:1::1 or fe80:2::fedc),
664which should only be used inside the kernel (see Section 1.3.1), and
665is not supposed to work.
666
6671.4 Plug and Play
668
669The KAME kit implements most of the IPv6 stateless address
670autoconfiguration in the kernel.
671Neighbor Discovery functions are implemented in the kernel as a whole.
672Router Advertisement (RA) input for hosts is implemented in the
673kernel.  Router Solicitation (RS) output for endhosts, RS input
674for routers, and RA output for routers are implemented in the
675userland.
676
6771.4.1 Assignment of link-local, and special addresses
678
679IPv6 link-local address is generated from IEEE802 address (ethernet MAC
680address).  Each of interface is assigned an IPv6 link-local address
681automatically, when the interface becomes up (IFF_UP).  Also, direct route
682for the link-local address is added to routing table.
683
684Here is an output of netstat command:
685
686Internet6:
687Destination                   Gateway                   Flags      Netif Expire
688fe80::%ed0/64                 link#1                    UC           ed0
689fe80::%ep0/64                 link#2                    UC           ep0
690
691Interfaces that has no IEEE802 address (pseudo interfaces like tunnel
692interfaces, or ppp interfaces) will borrow IEEE802 address from other
693interfaces, such as ethernet interfaces, whenever possible.
694If there is no IEEE802 hardware attached, last-resort pseudorandom value,
695which is from MD5(hostname), will be used as source of link-local address.
696If it is not suitable for your usage, you will need to configure the
697link-local address manually.
698
699If an interface is not capable of handling IPv6 (such as lack of multicast
700support), link-local address will not be assigned to that interface.
701See section 2 for details.
702
703Each interface joins the solicited multicast address and the
704link-local all-nodes multicast addresses (e.g.  fe80::1:ff01:6317
705and ff02::1, respectively, on the link the interface is attached).
706In addition to a link-local address, the loopback address (::1) will be
707assigned to the loopback interface.  Also, ::1/128 and ff01::/32 are
708automatically added to routing table, and loopback interface joins
709node-local multicast group ff01::1.
710
7111.4.2 Stateless address autoconfiguration on hosts
712
713In IPv6 specification, nodes are separated into two categories:
714routers and hosts.  Routers forward packets addressed to others, hosts does
715not forward the packets.  net.inet6.ip6.forwarding defines whether this
716node is a router or a host (router if it is 1, host if it is 0).
717
718It is NOT recommended to change net.inet6.ip6.forwarding while the node
719is in operation.  IPv6 specification defines behavior for "host" and "router"
720quite differently, and switching from one to another can cause serious
721troubles.  It is recommended to configure the variable at bootstrap time only.
722
723The first step in stateless address configuration is Duplicated Address
724Detection (DAD).  See 1.2 for more detail on DAD.
725
726When a host hears Router Advertisement from the router, a host may
727autoconfigure itself by stateless address autoconfiguration.  This
728behavior can be controlled by the net.inet6.ip6.accept_rtadv sysctl
729variable and a per-interface flag managed in the kernel.  The latter,
730which we call "if_accept_rtadv" here, can be changed by the ndp(8)
731command (see the manpage for more details).  When the sysctl variable
732is set to 1, and the flag is set, the host autoconfigures itself.  By
733autoconfiguration, network address prefixes for the receiving
734interface (usually global address prefix) are added.  The default
735route is also configured.
736
737Routers periodically generate Router Advertisement packets.  To
738request an adjacent router to generate RA packet, a host can transmit
739Router Solicitation.  To generate an RS packet at any time, use the
740"rtsol" command.  The "rtsold" daemon is also available. "rtsold"
741generates Router Solicitation whenever necessary, and it works greatly
742for nomadic usage (notebooks/laptops).  If one wishes to ignore Router
743Advertisements, use sysctl to set net.inet6.ip6.accept_rtadv to 0.
744Additionally, ndp(8) command can be used to control the behavior
745per-interface basis.
746
747To generate Router Advertisement from a router, use the "rtadvd" daemon.
748
749Note that the IPv6 specification assumes the following items and that
750nonconforming cases are left unspecified:
751- Only hosts will listen to router advertisements
752- Hosts have a single network interface (except loopback)
753This is therefore unwise to enable net.inet6.ip6.accept_rtadv on routers,
754or multi-interface hosts.  A misconfigured node can behave strange
755(KAME code allows nonconforming configuration, for those who would like
756to do some experiments).
757
758To summarize the sysctl knob:
759	accept_rtadv	forwarding	role of the node
760	---		---		---
761	0		0		host (to be manually configured)
762	0		1		router
763	1		0		autoconfigured host
764					(spec assumes that hosts have a single
765					interface only, autoconfigred hosts
766					with multiple interfaces are
767					out-of-scope)
768	1		1		invalid, or experimental
769					(out-of-scope of spec)
770
771The if_accept_rtadv flag is referred only when accept_rtadv is 1 (the
772latter two cases).  The flag does not have any effects when the sysctl
773variable is 0.
774
775See 1.2 in the document for relationship between DAD and autoconfiguration.
776
7771.4.3 DHCPv6
778
779We supply a tiny DHCPv6 server/client in kame/dhcp6. However, the
780implementation is premature (for example, this does NOT implement
781address lease/release), and it is not in default compilation tree on
782some platforms. If you want to do some experiment, compile it on your
783own.
784
785DHCPv6 and autoconfiguration also needs more work.  "Managed" and "Other"
786bits in RA have no special effect to stateful autoconfiguration procedure
787in DHCPv6 client program ("Managed" bit actually prevents stateless
788autoconfiguration, but no special action will be taken for DHCPv6 client).
789
7901.5 Generic tunnel interface
791
792GIF (Generic InterFace) is a pseudo interface for configured tunnel.
793Details are described in gif(4) manpage.
794Currently
795	v6 in v6
796	v6 in v4
797	v4 in v6
798	v4 in v4
799are available.  Use "gifconfig" to assign physical (outer) source
800and destination address to gif interfaces.
801Configuration that uses same address family for inner and outer IP
802header (v4 in v4, or v6 in v6) is dangerous.  It is very easy to
803configure interfaces and routing tables to perform infinite level
804of tunneling.  Please be warned.
805
806gif can be configured to be ECN-friendly.  See 4.5 for ECN-friendliness
807of tunnels, and gif(4) manpage for how to configure.
808
809If you would like to configure an IPv4-in-IPv6 tunnel with gif interface,
810read gif(4) carefully.  You may need to remove IPv6 link-local address
811automatically assigned to the gif interface.
812
8131.6 Address Selection
814
8151.6.1 Source Address Selection
816
817The KAME kernel chooses the source address for an outgoing packet
818sent from a user application as follows:
819
8201. if the source address is explicitly specified via an IPV6_PKTINFO
821   ancillary data item or the socket option of that name, just use it.
822   Note that this item/option overrides the bound address of the
823   corresponding (datagram) socket.
824
8252. if the corresponding socket is bound, use the bound address.
826
8273. otherwise, the kernel first tries to find the outgoing interface of
828   the packet.  If it fails, the source address selection also fails.
829   If the kernel can find an interface, choose the most appropriate
830   address based on the algorithm described in RFC3484.
831
832   The policy table used in this algorithm is stored in the kernel.
833   To install or view the policy, use the ip6addrctl(8) command.  The
834   kernel does not have pre-installed policy.  It is expected that the
835   default policy described in the draft should be installed at the
836   bootstrap time using this command.
837
838   This draft allows an implementation to add implementation-specific
839   rules with higher precedence than the rule "Use longest matching
840   prefix."  KAME's implementation has the following additional rules
841   (that apply in the appeared order):
842
843   - prefer addresses on alive interfaces, that is, interfaces with
844     the UP flag being on.  This rule is particularly useful for
845     routers, since some routing daemons stop advertising prefixes
846    (addresses) on interfaces that have become down.
847
848   - prefer addresses on "preferred" interfaces.  "Preferred"
849     interfaces can be specified by the ndp(8) command.  By default,
850     no interface is preferred, that is, this rule does not apply.
851     Again, this rule is particularly useful for routers, since there
852     is a convention, among router administrators, of assigning
853     "stable" addresses on a particular interface (typically a
854     loopback interface).
855
856   In any case, addresses that break the scope zone of the
857   destination, or addresses whose zone do not contain the outgoing
858   interface are never chosen.
859
860When the procedure above fails, the kernel usually returns
861EADDRNOTAVAIL to the application.
862
863In some cases, the specification explicitly requires the
864implementation to choose a particular source address.  The source
865address for a Neighbor Advertisement (NA) message is an example.
866Under the spec (RFC2461 7.2.2) NA's source should be the target
867address of the corresponding NS's target.  In this case we follow the
868spec rather than the above rule.
869
870If you would like to prohibit the use of deprecated address for some
871reason, configure net.inet6.ip6.use_deprecated to 0.  The issue
872related to deprecated address is described in RFC2462 5.5.4 (NOTE:
873there is some debate underway in IETF ipngwg on how to use
874"deprecated" address).
875
876As documented in the source address selection document, temporary
877addresses for privacy extension are less preferred to public addresses
878by default.  However, for administrators who are particularly aware of
879the privacy, there is a system-wide sysctl(3) variable
880"net.inet6.ip6.prefer_tempaddr".  When the variable is set to
881non-zero, the kernel will rather prefer temporary addresses.  The
882default value of this variable is 0.
883
8841.6.2 Destination Address Ordering
885
886KAME's getaddrinfo(3) supports the destination address ordering
887algorithm described in RFC3484.  Getaddrinfo(3) needs to know the
888source address for each destination address and policy entries
889(described in the previous section) for the source and destination
890addresses.  To get the source address, the library function opens a
891UDP socket and tries to connect(2) for the destination.  To get the
892policy entry, the function issues sysctl(3).
893
8941.7 Jumbo Payload
895
896KAME supports the Jumbo Payload hop-by-hop option used to send IPv6
897packets with payloads longer than 65,535 octets.  But since currently
898KAME does not support any physical interface whose MTU is more than
89965,535, such payloads can be seen only on the loopback interface(i.e.
900lo0).
901
902If you want to try jumbo payloads, you first have to reconfigure the
903kernel so that the MTU of the loopback interface is more than 65,535
904bytes; add the following to the kernel configuration file:
905	options		"LARGE_LOMTU"		#To test jumbo payload
906and recompile the new kernel.
907
908Then you can test jumbo payloads by the ping6 command with -b and -s
909options.  The -b option must be specified to enlarge the size of the
910socket buffer and the -s option specifies the length of the packet,
911which should be more than 65,535.  For example, type as follows;
912	% ping6 -b 70000 -s 68000 ::1
913
914The IPv6 specification requires that the Jumbo Payload option must not
915be used in a packet that carries a fragment header.  If this condition
916is broken, an ICMPv6 Parameter Problem message must be sent to the
917sender.  KAME kernel follows the specification, but you cannot usually
918see an ICMPv6 error caused by this requirement.
919
920If KAME kernel receives an IPv6 packet, it checks the frame length of
921the packet and compares it to the length specified in the payload
922length field of the IPv6 header or in the value of the Jumbo Payload
923option, if any.  If the former is shorter than the latter, KAME kernel
924discards the packet and increments the statistics.  You can see the
925statistics as output of netstat command with `-s -p ip6' option:
926	% netstat -s -p ip6
927	ip6:
928		(snip)
929		1 with data size < data length
930
931So, KAME kernel does not send an ICMPv6 error unless the erroneous
932packet is an actual Jumbo Payload, that is, its packet size is more
933than 65,535 bytes.  As described above, KAME kernel currently does not
934support physical interface with such a huge MTU, so it rarely returns an
935ICMPv6 error.
936
937TCP/UDP over jumbogram is not supported at this moment.  This is because
938we have no medium (other than loopback) to test this.  Contact us if you
939need this.
940
941IPsec does not work on jumbograms.  This is due to some specification twists
942in supporting AH with jumbograms (AH header size influences payload length,
943and this makes it real hard to authenticate inbound packet with jumbo payload
944option as well as AH).
945
946There are fundamental issues in *BSD support for jumbograms.  We would like to
947address those, but we need more time to finalize the task.  To name a few:
948- mbuf pkthdr.len field is typed as "int" in 4.4BSD, so it cannot hold
949  jumbogram with len > 2G on 32bit architecture CPUs.  If we would like to
950  support jumbogram properly, the field must be expanded to hold 4G +
951  IPv6 header + link-layer header.  Therefore, it must be expanded to at least
952  int64_t (u_int32_t is NOT enough).
953- We mistakingly use "int" to hold packet length in many places.  We need
954  to convert them into larger numeric type.  It needs a great care, as we may
955  experience overflow during packet length computation.
956- We mistakingly check for ip6_plen field of IPv6 header for packet payload
957  length in various places.  We should be checking mbuf pkthdr.len instead.
958  ip6_input() will perform sanity check on jumbo payload option on input,
959  and we can safely use mbuf pkthdr.len afterwards.
960- TCP code needs careful updates in bunch of places, of course.
961
9621.8 Loop prevention in header processing
963
964IPv6 specification allows arbitrary number of extension headers to
965be placed onto packets.  If we implement IPv6 packet processing
966code in the way BSD IPv4 code is implemented, kernel stack may
967overflow due to long function call chain.  KAME sys/netinet6 code
968is carefully designed to avoid kernel stack overflow.  Because of
969this, KAME sys/netinet6 code defines its own protocol switch
970structure, as "struct ip6protosw" (see netinet6/ip6protosw.h).
971
972In addition to this, we restrict the number of extension headers
973(including the IPv6 header) in each incoming packet, in order to
974prevent a DoS attack that tries to send packets with a massive number
975of extension headers.  The upper limit can be configured by the sysctl
976value net.inet6.ip6.hdrnestlimit.  In particular, if the value is 0,
977the node will allow an arbitrary number of headers. As of writing this
978document, the default value is 50.
979
980IPv4 part (sys/netinet) remains untouched for compatibility.
981Because of this, if you receive IPsec-over-IPv4 packet with massive
982number of IPsec headers, kernel stack may blow up.  IPsec-over-IPv6 is okay.
983
9841.9 ICMPv6
985
986After RFC2463 was published, IETF ipngwg has decided to disallow ICMPv6 error
987packet against ICMPv6 redirect, to prevent ICMPv6 storm on a network medium.
988KAME already implements this into the kernel.
989
990RFC2463 requires rate limitation for ICMPv6 error packets generated by a
991node, to avoid possible DoS attacks.  KAME kernel implements two rate-
992limitation mechanisms, tunable via sysctl:
993- Minimum time interval between ICMPv6 error packets
994	KAME kernel will generate no more than one ICMPv6 error packet,
995	during configured time interval.  net.inet6.icmp6.errratelimit
996	controls the interval (default: disabled).
997- Maximum ICMPv6 error packet-per-second
998	KAME kernel will generate no more than the configured number of
999	packets in one second.  net.inet6.icmp6.errppslimit controls the
1000	maximum packet-per-second value (default: 200pps)
1001Basically, we need to pick values that are suitable against the bandwidth
1002of link layer devices directly attached to the node.  In some cases the
1003default values may not fit well.  We are still unsure if the default value
1004is sane or not.  Comments are welcome.
1005
10061.10 Applications
1007
1008For userland programming, we support IPv6 socket API as specified in
1009RFC2553/3493, RFC3542 and upcoming internet drafts.
1010
1011TCP/UDP over IPv6 is available and quite stable.  You can enjoy "telnet",
1012"ftp", "rlogin", "rsh", "ssh", etc.  These applications are protocol
1013independent.  That is, they automatically chooses IPv4 or IPv6
1014according to DNS.
1015
10161.11 Kernel Internals
1017
1018 (*) TCP/UDP part is handled differently between operating system platforms.
1019     See 1.12 for details.
1020
1021The current KAME has escaped from the IPv4 netinet logic.  While
1022ip_forward() calls ip_output(), ip6_forward() directly calls
1023if_output() since routers must not divide IPv6 packets into fragments.
1024
1025ICMPv6 should contain the original packet as long as possible up to
10261280.  UDP6/IP6 port unreach, for instance, should contain all
1027extension headers and the *unchanged* UDP6 and IP6 headers.
1028So, all IP6 functions except TCP6 never convert network byte
1029order into host byte order, to save the original packet.
1030
1031tcp6_input(), udp6_input() and icmp6_input() can't assume that IP6
1032header is preceding the transport headers due to extension
1033headers.  So, in6_cksum() was implemented to handle packets whose IP6
1034header and transport header is not continuous.  TCP/IP6 nor UDP/IP6
1035header structure don't exist for checksum calculation.
1036
1037To process IP6 header, extension headers and transport headers easily,
1038KAME requires network drivers to store packets in one internal mbuf or
1039one or more external mbufs.  A typical old driver prepares two
1040internal mbufs for 100 - 208 bytes data, however, KAME's reference
1041implementation stores it in one external mbuf.
1042
1043"netstat -s -p ip6" tells you whether or not your driver conforms
1044KAME's requirement.  In the following example, "cce0" violates the
1045requirement. (For more information, refer to Section 2.)
1046
1047        Mbuf statistics:
1048                317 one mbuf
1049                two or more mbuf::
1050                        lo0 = 8
1051			cce0 = 10
1052                3282 one ext mbuf
1053                0 two or more ext mbuf
1054
1055Each input function calls IP6_EXTHDR_CHECK in the beginning to check
1056if the region between IP6 and its header is
1057continuous.  IP6_EXTHDR_CHECK calls m_pullup() only if the mbuf has
1058M_LOOP flag, that is, the packet comes from the loopback
1059interface.  m_pullup() is never called for packets coming from physical
1060network interfaces.
1061
1062TCP6 reassembly makes use of IP6 header to store reassemble
1063information.  IP6 is not supposed to be just before TCP6, so
1064ip6tcpreass structure has a pointer to TCP6 header.  Of course, it has
1065also a pointer back to mbuf to avoid m_pullup().
1066
1067Like TCP6, both IP and IP6 reassemble functions never call m_pullup().
1068
1069xxx_ctlinput() calls in_mrejoin() on PRC_IFNEWADDR.  We think this is
1070one of 4.4BSD implementation flaws.  Since 4.4BSD keeps ia_multiaddrs
1071in in_ifaddr{}, it can't use multicast feature if the interface has no
1072unicast address.  So, if an application joins to an interface and then
1073all unicast addresses are removed from the interface, the application
1074can't send/receive any multicast packets.  Moreover, if a new unicast
1075address is assigned to the interface, in_mrejoin() must be called.
1076KAME's interfaces, however, have ALWAYS one link-local unicast
1077address.  These extensions have thus not been implemented in KAME.
1078
10791.12 IPv4 mapped address and IPv6 wildcard socket
1080
1081RFC2553/3493 describes IPv4 mapped address (3.7) and special behavior
1082of IPv6 wildcard bind socket (3.8).  The spec allows you to:
1083- Accept IPv4 connections by AF_INET6 wildcard bind socket.
1084- Transmit IPv4 packet over AF_INET6 socket by using special form of
1085  the address like ::ffff:10.1.1.1.
1086but the spec itself is very complicated and does not specify how the
1087socket layer should behave.
1088Here we call the former one "listening side" and the latter one "initiating
1089side", for reference purposes.
1090
1091Almost all KAME implementations treat tcp/udp port number space separately
1092between IPv4 and IPv6.  You can perform wildcard bind on both of the address
1093families, on the same port.
1094
1095There are some OS-platform differences in KAME code, as we use tcp/udp
1096code from different origin.  The following table summarizes the behavior.
1097
1098		listening side		initiating side
1099		(AF_INET6 wildcard	(connection to ::ffff:10.1.1.1)
1100		socket gets IPv4 conn.)
1101		---			---
1102KAME/BSDI3	not supported		not supported
1103KAME/FreeBSD228	not supported		not supported
1104KAME/FreeBSD3x	configurable		supported
1105		default: enabled
1106KAME/FreeBSD4x	configurable		supported
1107		default: enabled
1108KAME/NetBSD	configurable		supported
1109		default: disabled
1110KAME/BSDI4	enabled			supported
1111KAME/OpenBSD	not supported		not supported
1112
1113The following sections will give you more details, and how you can
1114configure the behavior.
1115
1116Comments on listening side:
1117
1118It looks that RFC2553/3493 talks too little on wildcard bind issue,
1119specifically on (1) port space issue, (2) failure mode, (3) relationship
1120between AF_INET/INET6 wildcard bind like ordering constraint, and (4) behavior
1121when conflicting socket is opened/closed.  There can be several separate
1122interpretation for this RFC which conform to it but behaves differently.
1123So, to implement portable application you should assume nothing
1124about the behavior in the kernel.  Using getaddrinfo() is the safest way.
1125Port number space and wildcard bind issues were discussed in detail
1126on ipv6imp mailing list, in mid March 1999 and it looks that there's
1127no concrete consensus (means, up to implementers).  You may want to
1128check the mailing list archives.
1129We supply a tool called "bindtest" that explores the behavior of
1130kernel bind(2).  The tool will not be compiled by default.
1131
1132If a server application would like to accept IPv4 and IPv6 connections,
1133it should use AF_INET and AF_INET6 socket (you'll need two sockets).
1134Use getaddrinfo() with AI_PASSIVE into ai_flags, and socket(2) and bind(2)
1135to all the addresses returned.
1136By opening multiple sockets, you can accept connections onto the socket with
1137proper address family.  IPv4 connections will be accepted by AF_INET socket,
1138and IPv6 connections will be accepted by AF_INET6 socket (NOTE: KAME/BSDI4
1139kernel sometimes violate this - we will fix it).
1140
1141If you try to support IPv6 traffic only and would like to reject IPv4
1142traffic, always check the peer address when a connection is made toward
1143AF_INET6 listening socket.  If the address is IPv4 mapped address, you may
1144want to reject the connection.  You can check the condition by using
1145IN6_IS_ADDR_V4MAPPED() macro.  This is one of the reasons the author of
1146the section (itojun) dislikes special behavior of AF_INET6 wildcard bind.
1147
1148Comments on initiating side:
1149
1150Advise to application implementers: to implement a portable IPv6 application
1151(which works on multiple IPv6 kernels), we believe that the following
1152is the key to the success:
1153- NEVER hardcode AF_INET nor AF_INET6.
1154- Use getaddrinfo() and getnameinfo() throughout the system.
1155  Never use gethostby*(), getaddrby*(), inet_*() or getipnodeby*().
1156- If you would like to connect to destination, use getaddrinfo() and try
1157  all the destination returned, like telnet does.
1158- Some of the IPv6 stack is shipped with buggy getaddrinfo().  Ship a minimal
1159  working version with your application and use that as last resort.
1160
1161If you would like to use AF_INET6 socket for both IPv4 and IPv6 outgoing
1162connection, you will need tweaked implementation in DNS support libraries,
1163as documented in RFC2553/3493 6.1.  KAME libinet6 includes the tweak in
1164getipnodebyname().  Note that getipnodebyname() itself is not recommended as
1165it does not handle scoped IPv6 addresses at all.  For IPv6 name resolution
1166getaddrinfo() is the preferred API.  getaddrinfo() does not implement the
1167tweak.
1168
1169When writing applications that make outgoing connections, story goes much
1170simpler if you treat AF_INET and AF_INET6 as totally separate address family.
1171{set,get}sockopt issue goes simpler, DNS issue will be made simpler.  We do
1172not recommend you to rely upon IPv4 mapped address.
1173
11741.12.1 KAME/BSDI3 and KAME/FreeBSD228
1175
1176The platforms do not support IPv4 mapped address at all (both listening side
1177and initiating side).  AF_INET6 and AF_INET sockets are totally separated.
1178
1179Port number space is totally separate between AF_INET and AF_INET6 sockets.
1180
1181It should be noted that KAME/BSDI3 and KAME/FreeBSD228 are not conformant
1182to RFC2553/3493 section 3.7 and 3.8.  It is due to code sharing reasons.
1183
11841.12.2 KAME/FreeBSD[34]x
1185
1186KAME/FreeBSD3x and KAME/FreeBSD4x use shared tcp4/6 code (from
1187sys/netinet/tcp*) and shared udp4/6 code (from sys/netinet/udp*).
1188They use unified inpcb/in6pcb structure.
1189
11901.12.2.1 KAME/FreeBSD[34]x, listening side
1191
1192The platform can be configured to support IPv4 mapped address/special
1193AF_INET6 wildcard bind (enabled by default).  There is no kernel compilation
1194option to disable it.  You can enable/disable the behavior with sysctl
1195(per-node), or setsockopt (per-socket).
1196
1197Wildcard AF_INET6 socket grabs IPv4 connection if and only if the following
1198conditions are satisfied:
1199- there's no AF_INET socket that matches the IPv4 connection
1200- the AF_INET6 socket is configured to accept IPv4 traffic, i.e.
1201  getsockopt(IPV6_V6ONLY) returns 0.
1202
1203(XXX need checking)
1204
12051.12.2.2 KAME/FreeBSD[34]x, initiating side
1206
1207KAME/FreeBSD3x supports outgoing connection to IPv4 mapped address
1208(::ffff:10.1.1.1), if the node is configured to accept IPv4 connections
1209by AF_INET6 socket.
1210
1211(XXX need checking)
1212
12131.12.3 KAME/NetBSD
1214
1215KAME/NetBSD uses shared tcp4/6 code (from sys/netinet/tcp*) and shared
1216udp4/6 code (from sys/netinet/udp*).  The implementation is made differently
1217from KAME/FreeBSD[34]x.  KAME/NetBSD uses separate inpcb/in6pcb structures,
1218while KAME/FreeBSD[34]x uses merged inpcb structure.
1219
1220It should be noted that the default configuration of KAME/NetBSD is not
1221conformant to RFC2553/3493 section 3.8.  It is intentionally turned off by
1222default for security reasons.
1223
1224The platform can be configured to support IPv4 mapped address/special AF_INET6
1225wildcard bind (disabled by default).  Kernel behavior can be summarized as
1226follows:
1227- default: special support code will be compiled in, but is disabled by
1228  default.  It can be controlled by sysctl (net.inet6.ip6.v6only),
1229  or setsockopt(IPV6_V6ONLY).
1230- add "INET6_BINDV6ONLY": No special support code for AF_INET6 wildcard socket
1231  will be compiled in.  AF_INET6 sockets and AF_INET sockets are totally
1232  separate.  The behavior is similar to what described in 1.12.1.
1233
1234sysctl setting will affect per-socket configuration at in6pcb creation time
1235only.  In other words, per-socket configuration will be copied from sysctl
1236configuration at in6pcb creation time.  To change per-socket behavior, you
1237must perform setsockopt or reopen the socket.  Change in sysctl configuration
1238will not change the behavior or sockets that are already opened.
1239
12401.12.3.1 KAME/NetBSD, listening side
1241
1242Wildcard AF_INET6 socket grabs IPv4 connection if and only if the following
1243conditions are satisfied:
1244- there's no AF_INET socket that matches the IPv4 connection
1245- the AF_INET6 socket is configured to accept IPv4 traffic, i.e.
1246  getsockopt(IPV6_V6ONLY) returns 0.
1247
1248You cannot bind(2) with IPv4 mapped address.  This is a workaround for port
1249number duplicate and other twists.
1250
12511.12.3.2 KAME/NetBSD, initiating side
1252
1253When getsockopt(IPV6_V6ONLY) is 0 for a socket, you can make an outgoing
1254traffic to IPv4 destination over AF_INET6 socket, using IPv4 mapped
1255address destination (::ffff:10.1.1.1).
1256
1257When getsockopt(IPV6_V6ONLY) is 1 for a socket, you cannot use IPv4 mapped
1258address for outgoing traffic.
1259
12601.12.4 KAME/BSDI4
1261
1262KAME/BSDI4 uses NRL-based TCP/UDP stack and inpcb source code,
1263which was derived from NRL IPv6/IPsec stack.  We guess it supports IPv4 mapped
1264address and speical AF_INET6 wildcard bind.  The implementation is, again,
1265different from other KAME/*BSDs.
1266
12671.12.4.1 KAME/BSDI4, listening side
1268
1269NRL inpcb layer supports special behavior of AF_INET6 wildcard socket.
1270There is no way to disable the behavior.
1271
1272Wildcard AF_INET6 socket grabs IPv4 connection if and only if the following
1273condition is satisfied:
1274- there's no AF_INET socket that matches the IPv4 connection
1275
12761.12.4.2 KAME/BSDI4, initiating side
1277
1278KAME/BSDi4 supports connection initiation to IPv4 mapped address
1279(like ::ffff:10.1.1.1).
1280
12811.12.5 KAME/OpenBSD
1282
1283KAME/OpenBSD uses NRL-based TCP/UDP stack and inpcb source code,
1284which was derived from NRL IPv6/IPsec stack.
1285
1286It should be noted that KAME/OpenBSD is not conformant to RFC2553/3493 section
12873.7 and 3.8.  It is intentionally omitted for security reasons.
1288
12891.12.5.1 KAME/OpenBSD, listening side
1290
1291KAME/OpenBSD disables special behavior on AF_INET6 wildcard bind for
1292security reasons (if IPv4 traffic toward AF_INET6 wildcard bind is allowed,
1293access control will become much harder).  KAME/BSDI4 uses NRL-based TCP/UDP
1294stack as well, however, the behavior is different due to OpenBSD's security
1295policy.
1296
1297As a result the behavior of KAME/OpenBSD is similar to KAME/BSDI3 and
1298KAME/FreeBSD228 (see 1.12.1 for more detail).
1299
13001.12.5.2 KAME/OpenBSD, initiating side
1301
1302KAME/OpenBSD does not support connection initiation to IPv4 mapped address
1303(like ::ffff:10.1.1.1).
1304
13051.12.6 More issues
1306
1307IPv4 mapped address support adds a big requirement to EVERY userland codebase.
1308Every userland code should check if an AF_INET6 sockaddr contains IPv4
1309mapped address or not.  This adds many twists:
1310
1311- Access controls code becomes harder to write.
1312  For example, if you would like to reject packets from 10.0.0.0/8,
1313  you need to reject packets to AF_INET socket from 10.0.0.0/8,
1314  and to AF_INET6 socket from ::ffff:10.0.0.0/104.
1315- If a protocol on top of IPv4 is defined differently with IPv6, we need to be
1316  really careful when we determine which protocol to use.
1317  For example, with FTP protocol, we can not simply use sa_family to determine
1318  FTP command sets.  The following example is incorrect:
1319	if (sa_family == AF_INET)
1320		use EPSV/EPRT or PASV/PORT;	/*IPv4*/
1321	else if (sa_family == AF_INET6)
1322		use EPSV/EPRT or LPSV/LPRT;	/*IPv6*/
1323	else
1324		error;
1325  The correct code, with consideration to IPv4 mapped address, would be:
1326	if (sa_family == AF_INET)
1327		use EPSV/EPRT or PASV/PORT;	/*IPv4*/
1328	else if (sa_family == AF_INET6 && IPv4 mapped address)
1329		use EPSV/EPRT or PASV/PORT;	/*IPv4 command set on AF_INET6*/
1330	else if (sa_family == AF_INET6 && !IPv4 mapped address)
1331		use EPSV/EPRT or LPSV/LPRT;	/*IPv6*/
1332	else
1333		error;
1334  It is too much to ask for every body to be careful like this.
1335  The problem is, we are not sure if the above code fragment is perfect for
1336  all situations.
1337- By enabling kernel support for IPv4 mapped address (outgoing direction),
1338  servers on the kernel can be hosed by IPv6 native packet that has IPv4
1339  mapped address in IPv6 header source, and can generate unwanted IPv4 packets.
1340  draft-itojun-ipv6-transition-abuse-01.txt, draft-cmetz-v6ops-v4mapped-api-
1341  harmful-00.txt, and draft-itojun-v6ops-v4mapped-harmful-01.txt
1342  has more on this scenario.
1343
1344Due to the above twists, some of KAME userland programs has restrictions on
1345the use of IPv4 mapped addresses:
1346- rshd/rlogind do not accept connections from IPv4 mapped address.
1347  This is to avoid malicious use of IPv4 mapped address in IPv6 native
1348  packet, to bypass source-address based authentication.
1349- ftp/ftpd assume that you are on dual stack network.  IPv4 mapped address
1350  will be decoded in userland, and will be passed to AF_INET sockets
1351  (in other words, ftp/ftpd do not support SIIT environment).
1352
13531.12.7 Interaction with SIIT translator
1354
1355SIIT translator is specified in RFC2765.  KAME node cannot become a SIIT
1356translator box, nor SIIT end node (a node in SIIT cloud).
1357
1358To become a SIIT translator box, we need to put additional code for that.
1359We do not have the code in our tree at this moment.
1360
1361There are multiple reasons that we are unable to become SIIT end node.
1362(1) SIIT translators require end nodes in the SIIT cloud to be IPv6-only.
1363Since we are unable to compile INET-less kernel, we are unable to become
1364SIIT end node.  (2) As presented in 1.12.6, some of our userland code assumes
1365dual stack network.  (3) KAME stack filters out IPv6 packets with IPv4
1366mapped address in the header, to secure non-SIIT case (which is much more
1367common).  Effectively KAME node will reject any packets via SIIT translator
1368box.  See section 1.14 for more detail about the last item.
1369
1370There are documentation issues too - SIIT document requires very strange
1371things.  For example, SIIT document asks IPv6-only (meaning no IPv4 code)
1372node to be able to construct IPv4 IPsec headers.  If a node knows how to
1373construct IPv4 IPsec headers, that is not an IPv6-only node, it is a dual-stack
1374node.  The requirements imposed in SIIT document contradict with the other
1375part of the document itself.
1376
13771.13 sockaddr_storage
1378
1379When RFC2553 was about to be finalized, there was discussion on how struct
1380sockaddr_storage members are named.  One proposal is to prepend "__" to the
1381members (like "__ss_len") as they should not be touched.  The other proposal
1382was that don't prepend it (like "ss_len") as we need to touch those members
1383directly.  There was no clear consensus on it.
1384
1385As a result, RFC2553 defines struct sockaddr_storage as follows:
1386	struct sockaddr_storage {
1387		u_char	__ss_len;	/* address length */
1388		u_char	__ss_family;	/* address family */
1389		/* and bunch of padding */
1390	};
1391On the contrary, XNET draft defines as follows:
1392	struct sockaddr_storage {
1393		u_char	ss_len;		/* address length */
1394		u_char	ss_family;	/* address family */
1395		/* and bunch of padding */
1396	};
1397
1398In December 1999, it was agreed that RFC2553bis (RFC3493) should pick the
1399latter (XNET) definition.
1400
1401KAME kit prior to December 1999 used RFC2553 definition.  KAME kit after
1402December 1999 (including December) will conform to XNET definition,
1403based on RFC3493 discussion.
1404
1405If you look at multiple IPv6 implementations, you will be able to see
1406both definitions.  As an userland programmer, the most portable way of
1407dealing with it is to:
1408(1) ensure ss_family and/or ss_len are available on the platform, by using
1409    GNU autoconf,
1410(2) have -Dss_family=__ss_family to unify all occurences (including header
1411    file) into __ss_family, or
1412(3) never touch __ss_family.  cast to sockaddr * and use sa_family like:
1413	struct sockaddr_storage ss;
1414	family = ((struct sockaddr *)&ss)->sa_family
1415
14161.14 Invalid addresses on the wire
1417
1418Some of IPv6 transition technologies embed IPv4 address into IPv6 address.
1419These specifications themselves are fine, however, there can be certain
1420set of attacks enabled by these specifications.  Recent speicifcation
1421documents covers up those issues, however, there are already-published RFCs
1422that does not have protection against those (like using source address of
1423::ffff:127.0.0.1 to bypass "reject packet from remote" filter).
1424
1425To name a few, these address ranges can be used to hose an IPv6 implementation,
1426or bypass security controls:
1427- IPv4 mapped address that embeds unspecified/multicast/loopback/broadcast
1428  IPv4 address (if they are in IPv6 native packet header, they are malicious)
1429	::ffff:0.0.0.0/104	::ffff:127.0.0.0/104
1430	::ffff:224.0.0.0/100	::ffff:255.0.0.0/104
1431- 6to4 (RFC3056) prefix generated from unspecified/multicast/loopback/
1432  broadcast/private IPv4 address
1433	2002:0000::/24		2002:7f00::/24		2002:e000::/24
1434	2002:ff00::/24		2002:0a00::/24		2002:ac10::/28
1435	2002:c0a8::/32
1436- IPv4 compatible address that embeds unspecified/multicast/loopback/broadcast
1437  IPv4 address (if they are in IPv6 native packet header, they are malicious).
1438  Note that, since KAME doe snot support RFC1933/2893 auto tunnels, KAME nodes
1439  are not vulnerable to these packets.
1440	::0.0.0.0/104	::127.0.0.0/104	::224.0.0.0/100	::255.0.0.0/104
1441
1442Also, since KAME does not support RFC1933/2893 auto tunnels, seeing IPv4
1443compatible is very rare.  You should take caution if you see those on the wire.
1444
1445If we see IPv6 packets with IPv4 mapped address (::ffff:0.0.0.0/96) in the
1446header in dual-stack environment (not in SIIT environment), they indicate
1447that someone is trying to inpersonate IPv4 peer.  The packet should be dropped.
1448
1449IPv6 specifications do not talk very much about IPv6 unspecified address (::)
1450in the IPv6 source address field.  Clarification is in progress.
1451Here are couple of comments:
1452- IPv6 unspecified address can be used in IPv6 source address field, if and
1453  only if we have no legal source address for the node.  The legal situations
1454  include, but may not be limited to, (1) MLD while no IPv6 address is assigned
1455  to the node and (2) DAD.
1456- If IPv6 TCP packet has IPv6 unspecified address, it is an attack attempt.
1457  The form can be used as a trigger for TCP DoS attack.  KAME code already
1458  filters them out.
1459- The following examples are seemingly illegal.  It seems that there's general
1460  consensus among ipngwg for those.  (1) Mobile IPv6 home address option,
1461  (2) offlink packets (so routers should not forward them).
1462  KAME implmements (2) already.
1463
1464KAME code is carefully written to avoid such incidents.  More specifically,
1465KAME kernel will reject packets with certain source/dstination address in IPv6
1466base header, or IPv6 routing header.  Also, KAME default configuration file
1467is written carefully, to avoid those attacks.
1468
1469draft-itojun-ipv6-transition-abuse-01.txt, draft-cmetz-v6ops-v4mapped-api-
1470harmful-00.txt and draft-itojun-v6ops-v4mapped-harmful-01.txt has more on
1471this issue.
1472
14731.15 Node's required addresses
1474
1475RFC2373 section 2.8 talks about required addresses for an IPv6
1476node.  The section talks about how KAME stack manages those required
1477addresses.
1478
14791.15.1 Host case
1480
1481The following items are automatically assigned to the node (or the node will
1482automatically joins the group), at bootstrap time:
1483- Loopback address
1484- All-nodes multicast addresses (ff01::1)
1485
1486The following items will be automatically handled when the interface becomes
1487IFF_UP:
1488- Its link-local address for each interface
1489- Solicited-node multicast address for link-local addresses
1490- Link-local allnodes multicast address (ff02::1)
1491
1492The following items need to be configured manually by ifconfig(8) or prefix(8).
1493Alternatively, these can be autoconfigured by using stateless address
1494autoconfiguration.
1495- Assigned unicast/anycast addresses
1496- Solicited-Node multicast address for assigned unicast address
1497
1498Users can join groups by using appropriate system calls like setsockopt(2).
1499
15001.15.2 Router case
1501
1502In addition to the above, routers needs to handle the following items.
1503
1504The following items need to be configured manually by using ifconfig(8).
1505o The subnet-router anycast addresses for the interfaces it is configured
1506  to act as a router on (prefix::/64)
1507o All other anycast addresses with which the router has been configured
1508
1509The router will join the following multicast group when rtadvd(8) is available
1510for the interface.
1511o All-Routers Multicast Addresses (ff02::2)
1512
1513Routing daemons will join appropriate multicast groups, as necessary,
1514like ff02::9 for RIPng.
1515
1516Users can join groups by using appropriate system calls like setsockopt(2).
1517
15181.16 Advanced API
1519
1520Current KAME kernel implements RFC3542 API.  It also implements RFC2292 API,
1521for backward compatibility purposes with *BSD-integrated codebase.
1522KAME tree ships with RFC3542 headers.
1523*BSD-integrated codebase implements either RFC2292, or RFC3542, API.
1524see "COVERAGE" document for detailed implementation status.
1525
1526Here are couple of issues to mention:
1527- *BSD-integrated binaries, compiled for RFC2292, will work on KAME kernel.
1528  For example, OpenBSD 2.7 /sbin/rtsol will work on KAME/openbsd kernel.
1529- KAME binaries, compiled using RFC3542, will not work on *BSD-integrated
1530  kenrel.  For example, KAME /usr/local/v6/sbin/rtsol will not work on
1531  OpenBSD 2.7 kernel.
1532- RFC3542 API is not compatible with RFC2292 API.  RFC3542 #define symbols
1533  conflict with RFC2292 symbols.  Therefore, if you compile programs that
1534  assume RFC2292 API, the compilation itself goes fine, however, the compiled
1535  binary will not work correctly.  The problem is not KAME issue, but API
1536  issue.  For example, Solaris 8 implements RFC3542 API.  If you compile
1537  RFC2292-based code on Solaris 8, the binary can behave strange.
1538
1539There are few (or couple of) incompatible behavior in RFC2292 binary backward
1540compatibility support in KAME tree.  To enumerate:
1541- Type 0 routing header lacks support for strict/loose bitmap.
1542  Even if we see packets with "strict" bit set, those bits will not be made
1543  visible to the userland.
1544  Background: RFC2292 document is based on RFC1883 IPv6, and it uses
1545  strict/loose bitmap.  RFC3542 document is based on RFC2460 IPv6, and it has
1546  no strict/loose bitmap (it was removed from RFC2460).  KAME tree obeys
1547  RFC2460 IPv6, and lacks support for strict/loose bitmap.
1548
1549The RFC3542 documents leave some particular cases unspecified.  The
1550KAME implementation treats them as follows:
1551- The IPV6_DONTFRAG and IPV6_RECVPATHMTU socket options for TCP
1552  sockets are ignored.  That is, the setsocktopt() call will succeed
1553  but the specified value will have no effect.
1554
15551.17 DNS resolver
1556
1557KAME ships with modified DNS resolver, in libinet6.a.
1558libinet6.a has a comple of extensions against libc DNS resolver:
1559- Can take "options insecure1" and "options insecure2" in /etc/resolv.conf,
1560  which toggles RES_INSECURE[12] option flag bit.
1561- EDNS0 receive buffer size notification support.  It can be enabled by
1562  "options edns0" in /etc/resolv.conf.  See USAGE for details.
1563- IPv6 transport support (queries/responses over IPv6).  Most of BSD official
1564  releases now has it already.
1565- Partial A6 chain chasing/DNAME/bit string label support (KAME/BSDI4).
1566
1567
15682. Network Drivers
1569
1570KAME requires three items to be added into the standard drivers:
1571
1572(1) (freebsd[234] and bsdi[34] only) mbuf clustering requirement.
1573    In this stable release, we changed MINCLSIZE into MHLEN+1 for all the
1574    operating systems in order to make all the drivers behave as we expect.
1575
1576(2) multicast.  If "ifmcstat" yields no multicast group for a
1577    interface, that interface has to be patched.
1578
1579To avoid troubles, we suggest you to comment out the device drivers
1580for unsupported/unnecessary cards, from the kernel configuration file.
1581If you accidentally enable unsupported drivers, some of the userland
1582tools may not work correctly (routing daemons are typical example).
1583
1584In the following sections, "official support" means that KAME developers
1585are using that ethernet card/driver frequently.
1586
1587(NOTE: In the past we required all pcmcia drivers to have a call to
1588in6_ifattach().  We have no such requirement any more)
1589
15902.1 FreeBSD 2.2.x-RELEASE
1591
1592Here is a list of FreeBSD 2.2.x-RELEASE drivers and its conditions:
1593
1594	driver	mbuf(1)		multicast(2)	official support?
1595	---	---		---		---
1596	(Ethernet)
1597	ar	looks ok	-		-
1598	cnw	ok		ok		yes (*)
1599	ed	ok		ok		yes
1600	ep	ok		ok		yes
1601	fe	ok		ok		yes
1602	sn	looks ok	-		-   (*)
1603	vx	looks ok	-		-
1604	wlp	ok		ok		-   (*)
1605	xl	ok		ok		yes
1606	zp	ok		ok		-
1607	(FDDI)
1608	fpa	looks ok	?		-
1609	(ATM)
1610	en	ok		ok		yes
1611	(Serial)
1612	lp	?		-		not work
1613	sl	?		-		not work
1614	sr	looks ok	ok		-   (**)
1615
1616You may want to add an invocation of "rtsol" in "/etc/pccard_ether",
1617if you are using notebook computers and PCMCIA ethernet card.
1618
1619(*) These drivers are distributed with PAO (http://www.jp.freebsd.org/PAO/).
1620
1621(**) There was some report says that, if you make sr driver up and down and
1622then up, the kernel may hang up.  We have disabled frame-relay support from
1623sr driver and after that this looks to be working fine.  If you need
1624frame-relay support to come back, please contact KAME developers.
1625
16262.2 BSD/OS 3.x
1627
1628The following lists BSD/OS 3.x device drivers and its conditions:
1629
1630	driver	mbuf(1)		multicast(2)	official support?
1631	---	---		---		---
1632	(Ethernet)
1633	cnw	ok		ok		yes
1634	de	ok		ok		-
1635	df	ok		ok		-
1636	eb	ok		ok		-
1637	ef	ok		ok		yes
1638	exp	ok		ok		-
1639	mz	ok		ok		yes
1640	ne	ok		ok		yes
1641	we	ok		ok		-
1642	(FDDI)
1643	fpa	ok		ok		-
1644	(ATM)
1645	en	maybe		ok		-
1646	(Serial)
1647	ntwo	ok		ok		yes
1648	sl	?		-		not work
1649	appp	?		-		not work
1650
1651You may want to use "@insert" directive in /etc/pccard.conf to invoke
1652"rtsol" command right after dynamic insertion of PCMCIA ethernet cards.
1653
16542.3 NetBSD
1655
1656The following table lists the network drivers we have tried so far.
1657
1658	driver		mbuf(1)	multicast(2)	official support?
1659	---		---	---		---
1660	(Ethernet)
1661	awi pcmcia/i386	ok	ok		-
1662	bah zbus/amiga	NG(*)
1663	cnw pcmcia/i386	ok	ok		yes
1664	ep pcmcia/i386	ok	ok		-
1665	fxp pci/i386	ok(*2)	ok		-
1666	tlp pci/i386	ok	ok		-
1667	le sbus/sparc	ok	ok		yes
1668	ne pci/i386	ok	ok		yes
1669	ne pcmcia/i386	ok	ok		yes
1670	rtk pci/i386	ok	ok		-
1671	wi pcmcia/i386	ok	ok		yes
1672	(ATM)
1673	en pci/i386	ok	ok		-
1674
1675(*) This may need some fix, but I'm not sure what arcnet interfaces assume...
1676
16772.4 FreeBSD 3.x-RELEASE
1678
1679Here is a list of FreeBSD 3.x-RELEASE drivers and its conditions:
1680
1681	driver	mbuf(1)		multicast(2)	official support?
1682	---	---		---		---
1683	(Ethernet)
1684	cnw	ok		ok		-(*)
1685	ed	?		ok		-
1686	ep	ok		ok		-
1687	fe	ok		ok		yes
1688	fxp	?(**)
1689	lnc	?		ok		-
1690	sn	?		?		-(*)
1691	wi	ok		ok		yes
1692	xl	?		ok		-
1693
1694(*) These drivers are distributed with PAO as PAO3
1695    (http://www.jp.freebsd.org/PAO/).
1696(**) there were trouble reports with multicast filter initialization.
1697
1698More drivers will just simply work on KAME FreeBSD 3.x-RELEASE but have not
1699been checked yet.
1700
17012.5 FreeBSD 4.x-RELEASE
1702
1703Here is a list of FreeBSD 4.x-RELEASE drivers and its conditions:
1704
1705	driver		multicast
1706	---		---
1707	(Ethernet)
1708	lnc/vmware	ok
1709
17102.6 OpenBSD 2.x
1711
1712Here is a list of OpenBSD 2.x drivers and its conditions:
1713
1714	driver		mbuf(1)		multicast(2)	official support?
1715	---		---		---		---
1716	(Ethernet)
1717	de pci/i386	ok		ok		yes
1718	fxp pci/i386	?(*)
1719	le sbus/sparc	ok		ok		yes
1720	ne pci/i386	ok		ok		yes
1721	ne pcmcia/i386	ok		ok		yes
1722	wi pcmcia/i386	ok		ok		yes
1723
1724(*) There seem to be some problem in driver, with multicast filter
1725configuration.  This happens with certain revision of chipset on the card.
1726Should be fixed by now by workaround in sys/net/if.c, but still not sure.
1727
17282.7 BSD/OS 4.x
1729
1730The following lists BSD/OS 4.x device drivers and its conditions:
1731
1732	driver	mbuf(1)		multicast(2)	official support?
1733	---	---		---		---
1734	(Ethernet)
1735	de	ok		ok		yes
1736	exp	(*)
1737
1738You may want to use "@insert" directive in /etc/pccard.conf to invoke
1739"rtsol" command right after dynamic insertion of PCMCIA ethernet cards.
1740
1741(*) exp driver has serious conflict with KAME initialization sequence.
1742A workaround is committed into sys/i386/pci/if_exp.c, and should be okay by now.
1743
1744
17453. Translator
1746
1747We categorize IPv4/IPv6 translator into 4 types.
1748
1749Translator A --- It is used in the early stage of transition to make
1750it possible to establish a connection from an IPv6 host in an IPv6
1751island to an IPv4 host in the IPv4 ocean.
1752
1753Translator B --- It is used in the early stage of transition to make
1754it possible to establish a connection from an IPv4 host in the IPv4
1755ocean to an IPv6 host in an IPv6 island.
1756
1757Translator C --- It is used in the late stage of transition to make it
1758possible to establish a connection from an IPv4 host in an IPv4 island
1759to an IPv6 host in the IPv6 ocean.
1760
1761Translator D --- It is used in the late stage of transition to make it
1762possible to establish a connection from an IPv6 host in the IPv6 ocean
1763to an IPv4 host in an IPv4 island.
1764
1765KAME provides an TCP relay translator for category A.  This is called
1766"FAITH".  We also provide IP header translator for category A.
1767
17683.1 FAITH TCP relay translator
1769
1770FAITH system uses TCP relay daemon called "faithd" helped by the KAME kernel.
1771FAITH will reserve an IPv6 address prefix, and relay TCP connection
1772toward that prefix to IPv4 destination.
1773
1774For example, if the reserved IPv6 prefix is 3ffe:0501:0200:ffff::, and
1775the IPv6 destination for TCP connection is 3ffe:0501:0200:ffff::163.221.202.12,
1776the connection will be relayed toward IPv4 destination 163.221.202.12.
1777
1778	destination IPv4 node (163.221.202.12)
1779	  ^
1780	  | IPv4 tcp toward 163.221.202.12
1781	FAITH-relay dual stack node
1782	  ^
1783	  | IPv6 TCP toward 3ffe:0501:0200:ffff::163.221.202.12
1784	source IPv6 node
1785
1786faithd must be invoked on FAITH-relay dual stack node.
1787
1788For more details, consult kame/kame/faithd/README and RFC3142.
1789
17903.2 IPv6-to-IPv4 header translator
1791
1792(to be written)
1793
1794
17954. IPsec
1796
1797IPsec is implemented as the following three components.
1798
1799(1) Policy Management
1800(2) Key Management
1801(3) AH, ESP and IPComp handling in kernel
1802
1803Note that KAME/OpenBSD does NOT include support for KAME IPsec code,
1804as OpenBSD team has their home-brew IPsec stack and they have no plan
1805to replace it.  IPv6 support for IPsec is, therefore, lacking on KAME/OpenBSD.
1806
1807http://www.netbsd.org/Documentation/network/ipsec/ has more information
1808including usage examples.
1809
18104.1 Policy Management
1811
1812The kernel implements experimental policy management code.  There are two ways
1813to manage security policy.  One is to configure per-socket policy using
1814setsockopt(3).  In this cases, policy configuration is described in
1815ipsec_set_policy(3).  The other is to configure kernel packet filter-based
1816policy using PF_KEY interface, via setkey(8).
1817
1818The policy entry will be matched in order.  The order of entries makes
1819difference in behavior.
1820
18214.2 Key Management
1822
1823The key management code implemented in this kit (sys/netkey) is a
1824home-brew PFKEY v2 implementation.  This conforms to RFC2367.
1825
1826The home-brew IKE daemon, "racoon" is included in the kit (kame/kame/racoon,
1827or usr.sbin/racoon).
1828Basically you'll need to run racoon as daemon, then setup a policy
1829to require keys (like ping -P 'out ipsec esp/transport//use').
1830The kernel will contact racoon daemon as necessary to exchange keys.
1831
1832In IKE spec, there's ambiguity about interpretation of "tunnel" proposal.
1833For example, if we would like to propose the use of following packet:
1834	IP AH ESP IP payload
1835some implementation proposes it as "AH transport and ESP tunnel", since
1836this is more logical from packet construction point of view.  Some
1837implementation proposes it as "AH tunnel and ESP tunnel".
1838Racoon follows the latter route (previously it followed the former, and
1839the latter interpretation seems to be popular/consensus).
1840This raises real interoperability issue.  We hope this to be resolved quickly.
1841
1842racoon does not implement byte lifetime for both phase 1 and phase 2
1843(RFC2409 page 35, Life Type = kilobytes).
1844
18454.3 AH and ESP handling
1846
1847IPsec module is implemented as "hooks" to the standard IPv4/IPv6
1848processing.  When sending a packet, ip{,6}_output() checks if ESP/AH
1849processing is required by checking if a matching SPD (Security
1850Policy Database) is found.  If ESP/AH is needed,
1851{esp,ah}{4,6}_output() will be called and mbuf will be updated
1852accordingly.  When a packet is received, {esp,ah}4_input() will be
1853called based on protocol number, i.e. (*inetsw[proto])().
1854{esp,ah}4_input() will decrypt/check authenticity of the packet,
1855and strips off daisy-chained header and padding for ESP/AH.  It is
1856safe to strip off the ESP/AH header on packet reception, since we
1857will never use the received packet in "as is" form.
1858
1859By using ESP/AH, TCP4/6 effective data segment size will be affected by
1860extra daisy-chained headers inserted by ESP/AH.  Our code takes care of
1861the case.
1862
1863Basic crypto functions can be found in directory "sys/crypto".  ESP/AH
1864transform are listed in {esp,ah}_core.c with wrapper functions.  If you
1865wish to add some algorithm, add wrapper function in {esp,ah}_core.c, and
1866add your crypto algorithm code into sys/crypto.
1867
1868Tunnel mode works basically fine, but comes with the following restrictions:
1869- You cannot run routing daemon across IPsec tunnel, since we do not model
1870  IPsec tunnel as pseudo interfaces.
1871- Authentication model for AH tunnel must be revisited.  We'll need to
1872  improve the policy management engine, eventually.
1873- Path MTU discovery does not work across IPv6 IPsec tunnel gateway due to
1874  insufficient code.
1875
1876AH specificaton does not talk much about "multiple AH on a packet" case.
1877We incrementally compute AH checksum, from inside to outside.  Also, we
1878treat inner AH to be immutable.
1879For example, if we are to create the following packet:
1880	IP AH1 AH2 AH3 payload
1881we do it incrementally.  As a result, we get crypto checksums like below:
1882	AH3 has checksum against "IP AH3' payload".
1883		where AH3' = AH3 with checksum field filled with 0.
1884	AH2 has checksum against "IP AH2' AH3 payload".
1885	AH1 has checksum against "IP AH1' AH2 AH3 payload",
1886Also note that AH3 has the smallest sequence number, and AH1 has the largest
1887sequence number.
1888
1889To avoid traffic analysis on shorter packets, ESP output logic supports
1890random length padding.  By setting net.inet.ipsec.esp_randpad (or
1891net.inet6.ipsec6.esp_randpad) to positive value N, you can ask the kernel
1892to randomly pad packets shorter than N bytes, to random length smaller than
1893or equal to N.  Note that N does not include ESP authentication data length.
1894Also note that the random padding is not included in TCP segment
1895size computation.  Negative value will turn off the functionality.
1896Recommeded value for N is like 128, or 256.  If you use a too big number
1897as N, you may experience inefficiency due to fragmented packtes.
1898
18994.4 IPComp handling
1900
1901IPComp stands for IP payload compression protocol.  This is aimed for
1902payload compression, not the header compression like PPP VJ compression.
1903This may be useful when you are using slow serial link (say, cell phone)
1904with powerful CPU (well, recent notebook PCs are really powerful...).
1905The protocol design of IPComp is very similar to IPsec, though it was
1906defined separately from IPsec itself.
1907
1908Here are some points to be noted:
1909- IPComp is treated as part of IPsec protocol suite, and SPI and
1910  CPI space is unified.  Spec says that there's no relationship
1911  between two so they are assumed to be separate in specs.
1912- IPComp association (IPCA) is kept in SAD.
1913- It is possible to use well-known CPI (CPI=2 for DEFLATE for example),
1914  for outbound/inbound packet, but for indexing purposes one element from
1915  SPI/CPI space will be occupied anyway.
1916- pfkey is modified to support IPComp.  However, there's no official
1917  SA type number assignment yet.  Portability with other IPComp
1918  stack is questionable (anyway, who else implement IPComp on UN*X?).
1919- Spec says that IPComp output processing must be performed before AH/ESP
1920  output processing, to achieve better compression ratio and "stir" data
1921  stream before encryption.  The most meaningful processing order is:
1922  (1) compress payload by IPComp, (2) encrypt payload by ESP, then (3) attach
1923  authentication data by AH.
1924  However, with manual SPD setting, you are able to violate the ordering
1925  (KAME code is too generic, maybe).  Also, it is just okay to use IPComp
1926  alone, without AH/ESP.
1927- Though the packet size can be significantly decreased by using IPComp, no
1928  special consideration is made about path MTU (spec talks nothing about MTU
1929  consideration).  IPComp is designed for serial links, not ethernet-like
1930  medium, it seems.
1931- You can change compression ratio on outbound packet, by changing
1932  deflate_policy in sys/netinet6/ipcomp_core.c.  You can also change outbound
1933  history buffer size by changing deflate_window_out in the same source code.
1934  (should it be sysctl accessible, or per-SAD configurable?)
1935- Tunnel mode IPComp is not working right.  KAME box can generate tunnelled
1936  IPComp packet, however, cannot accept tunneled IPComp packet.
1937- You can negotiate IPComp association with racoon IKE daemon.
1938- KAME code does not attach Adler32 checksum to compressed data.
1939  see ipsec wg mailing list discussion in Jan 2000 for details.
1940
19414.5 Conformance to RFCs and IDs
1942
1943The IPsec code in the kernel conforms (or, tries to conform) to the
1944following standards:
1945    "old IPsec" specification documented in rfc182[5-9].txt
1946    "new IPsec" specification documented in:
1947	rfc240[1-6].txt rfc241[01].txt rfc2451.txt rfc3602.txt
1948    IPComp:
1949	RFC2393: IP Payload Compression Protocol (IPComp)
1950IKE specifications (rfc240[7-9].txt) are implemented in userland
1951as "racoon" IKE daemon.
1952
1953Currently supported algorithms are:
1954    old IPsec AH
1955	null crypto checksum (no document, just for debugging)
1956	keyed MD5 with 128bit crypto checksum (rfc1828.txt)
1957	keyed SHA1 with 128bit crypto checksum (no document)
1958	HMAC MD5 with 128bit crypto checksum (rfc2085.txt)
1959	HMAC SHA1 with 128bit crypto checksum (no document)
1960	HMAC RIPEMD160 with 128bit crypto checksum (no document)
1961    old IPsec ESP
1962	null encryption (no document, similar to rfc2410.txt)
1963	DES-CBC mode (rfc1829.txt)
1964    new IPsec AH
1965	null crypto checksum (no document, just for debugging)
1966	keyed MD5 with 96bit crypto checksum (no document)
1967	keyed SHA1 with 96bit crypto checksum (no document)
1968	HMAC MD5 with 96bit crypto checksum (rfc2403.txt
1969	HMAC SHA1 with 96bit crypto checksum (rfc2404.txt)
1970	HMAC SHA2-256 with 96bit crypto checksum (draft-ietf-ipsec-ciph-sha-256-00.txt)
1971	HMAC SHA2-384 with 96bit crypto checksum (no document)
1972	HMAC SHA2-512 with 96bit crypto checksum (no document)
1973	HMAC RIPEMD160 with 96bit crypto checksum (RFC2857)
1974	AES XCBC MAC with 96bit crypto checksum (RFC3566)
1975    new IPsec ESP
1976	null encryption (rfc2410.txt)
1977	DES-CBC with derived IV
1978		(draft-ietf-ipsec-ciph-des-derived-01.txt, draft expired)
1979	DES-CBC with explicit IV (rfc2405.txt)
1980	3DES-CBC with explicit IV (rfc2451.txt)
1981	BLOWFISH CBC (rfc2451.txt)
1982	CAST128 CBC (rfc2451.txt)
1983	RIJNDAEL/AES CBC (rfc3602.txt)
1984	AES counter mode (rfc3686.txt)
1985
1986	each of the above can be combined with new IPsec AH schemes for
1987	ESP authentication.
1988    IPComp
1989	RFC2394: IP Payload Compression Using DEFLATE
1990
1991The following algorithms are NOT supported:
1992    old IPsec AH
1993	HMAC MD5 with 128bit crypto checksum + 64bit replay prevention
1994		(rfc2085.txt)
1995	keyed SHA1 with 160bit crypto checksum + 32bit padding (rfc1852.txt)
1996
1997The key/policy management API is based on the following document, with fair
1998amount of extensions:
1999	RFC2367: PF_KEY key management API
2000
20014.6 ECN consideration on IPsec tunnels
2002
2003KAME IPsec implements ECN-friendly IPsec tunnel, described in
2004draft-ietf-ipsec-ecn-02.txt.
2005Normal IPsec tunnel is described in RFC2401.  On encapsulation,
2006IPv4 TOS field (or, IPv6 traffic class field) will be copied from inner
2007IP header to outer IP header.  On decapsulation outer IP header
2008will be simply dropped.  The decapsulation rule is not compatible
2009with ECN, since ECN bit on the outer IP TOS/traffic class field will be
2010lost.
2011To make IPsec tunnel ECN-friendly, we should modify encapsulation
2012and decapsulation procedure.  This is described in
2013draft-ietf-ipsec-ecn-02.txt, chapter 3.3.
2014
2015KAME IPsec tunnel implementation can give you three behaviors, by setting
2016net.inet.ipsec.ecn (or net.inet6.ipsec6.ecn) to some value:
2017- RFC2401: no consideration for ECN (sysctl value -1)
2018- ECN forbidden (sysctl value 0)
2019- ECN allowed (sysctl value 1)
2020Note that the behavior is configurable in per-node manner, not per-SA manner
2021(draft-ietf-ipsec-ecn-02 wants per-SA configuration, but it looks too much
2022for me).
2023
2024The behavior is summarized as follows (see source code for more detail):
2025
2026		encapsulate			decapsulate
2027		---				---
2028RFC2401		copy all TOS bits		drop TOS bits on outer
2029		from inner to outer.		(use inner TOS bits as is)
2030
2031ECN forbidden	copy TOS bits except for ECN	drop TOS bits on outer
2032		(masked with 0xfc) from inner	(use inner TOS bits as is)
2033		to outer.  set ECN bits to 0.
2034
2035ECN allowed	copy TOS bits except for ECN	use inner TOS bits with some
2036		CE (masked with 0xfe) from	change.  if outer ECN CE bit
2037		inner to outer.			is 1, enable ECN CE bit on
2038		set ECN CE bit to 0.		the inner.
2039
2040General strategy for configuration is as follows:
2041- if both IPsec tunnel endpoint are capable of ECN-friendly behavior,
2042  you'd better configure both end to "ECN allowed" (sysctl value 1).
2043- if the other end is very strict about TOS bit, use "RFC2401"
2044  (sysctl value -1).
2045- in other cases, use "ECN forbidden" (sysctl value 0).
2046The default behavior is "ECN forbidden" (sysctl value 0).
2047
2048For more information, please refer to:
2049	draft-ietf-ipsec-ecn-02.txt
2050	RFC2481 (Explicit Congestion Notification)
2051	KAME sys/netinet6/{ah,esp}_input.c
2052
2053(Thanks goes to Kenjiro Cho <kjc@csl.sony.co.jp> for detailed analysis)
2054
20554.7 Interoperability
2056
2057IPsec, IPComp (in kernel) and IKE (in userland as "racoon") has been tested
2058at several interoperability test events, and it is known to interoperate
2059with many other implementations well.  Also, KAME IPsec has quite wide
2060coverage for IPsec crypto algorithms documented in RFC (we do not cover
2061algorithms with intellectual property issues, though).
2062
2063Here are (some of) platforms we have tested IPsec/IKE interoperability
2064in the past, no particular order.  Note that both ends (KAME and
2065others) may have modified their implementation, so use the following
2066list just for reference purposes.
2067	6WIND, ACC, Allied-telesis, Altiga, Ashley-laurent (vpcom.com),
2068	BlueSteel, CISCO IOS, Checkpoint FW-1, Compaq Tru54 UNIX
2069	X5.1B-BL4, Cryptek, Data Fellows (F-Secure), Ericsson,
2070	F-Secure VPN+ 5.40, Fitec, Fitel, FreeS/WAN, HITACHI, HiFn,
2071	IBM AIX 5.1, III, IIJ (fujie stack), Intel Canada, Intel
2072	Packet Protect, MEW NetCocoon, MGCS, Microsoft WinNT/2000/XP,
2073	NAI PGPnet, NEC IX5000, NIST (linux IPsec + plutoplus),
2074	NetLock, Netoctave, Netopia, Netscreen, Nokia EPOC, Nortel
2075	GatewayController/CallServer 2000 (not released yet),
2076	NxNetworks, OpenBSD isakmpd on OpenBSD, Oullim information
2077	technologies SECUREWORKS VPN gateway 3.0, Pivotal, RSA,
2078	Radguard, RapidStream, RedCreek, Routerware, SSH, SecGo
2079	CryptoIP v3, Secure Computing, Soliton, Sun Solaris 8,
2080	TIS/NAI Gauntret, Toshiba, Trilogy AdmitOne 2.6, Trustworks
2081	TrustedClient v3.2, USAGI linux, VPNet, Yamaha RT series,
2082	ZyXEL
2083
2084Here are (some of) platforms we have tested IPComp/IKE interoperability
2085in the past, in no particular order.
2086	Compaq, IRE, SSH, NetLock, FreeS/WAN, F-Secure VPN+ 5.40
2087
2088VPNC (vpnc.org) provides IPsec conformance tests, using KAME and OpenBSD
2089IPsec/IKE implementations.  Their test results are available at
2090http://www.vpnc.org/conformance.html, and it may give you more idea
2091about which implementation interoperates with KAME IPsec/IKE implementation.
2092
20934.8 Operations with IPsec tunnel mode
2094
2095First of all, IPsec tunnel is a very hairy thing.  It seems to do a neat thing
2096like VPN configuration or secure remote accesses, however, it comes with lots
2097of architectural twists.
2098
2099RFC2401 defines IPsec tunnel mode, within the context of IPsec.  RFC2401
2100defines tunnel mode packet encapsulation/decapsulation on its own, and
2101does not refer other tunnelling specifications.  Since RFC2401 advocates
2102filter-based SPD database matches, it would be natural for us to implement
2103IPsec IPsec tunnel mode as filters - not as pseudo interfaces.
2104
2105There are some people who are trying to separate IPsec "tunnel mode" from
2106the IPsec itself.  They would like to implement IPsec transport mode only,
2107and combine it with tunneling pseudo devices.  The prime example is found
2108in draft-touch-ipsec-vpn-01.txt.  However, if you really define pseudo
2109interfaces separately from IPsec, IKE daemons would need to negotiate
2110transport mode SAs, instead of tunnel mode SAs.  Therefore, we cannot
2111really mix RFC2401-based interpretation and draft-touch-ipsec-vpn-01.txt
2112interpretation.
2113
2114The KAME stack implements can be configured in two ways.  You may need
2115to recompile your kernel to switch the behavior.
2116- RFC2401 IPsec tunnel mode appraoch (4.8.1)
2117- draft-touch-ipsec-vpn approach (4.8.2)
2118	Works in all kernel configuration, but racoon(8) may not interoperate.
2119
2120There are pros and cons on these approaches:
2121
2122RFC2401 IPsec tunnel mode (filter-like) approach
2123	PRO: SPD lookup fits nicely with packet filters (if you integrate them)
2124	CON: cannot run routing daemons across IPsec tunnels
2125	CON: it is very hard to control source address selection on originating
2126		cases
2127	???: IPv6 scope zone is kept the same
2128draft-touch-ipsec-vpn (transportmode + Pseudo-interface) approach
2129	PRO: run routing daemons across IPsec tunnels
2130	PRO: source address selection can be done normally, by looking at
2131		IPsec tunnel pseudo devices
2132	CON: on outbound, possibility of infinite loops if routing setup
2133		is wrong
2134	CON: due to differences in encap/decap logic from RFC2401, it may not
2135		interoperate with very picky RFC2401 implementations
2136		(those who check TOS bits, for example)
2137	CON: cannot negotiate IKE with other IPsec tunnel-mode devices
2138		(the other end has to implement
2139	???: IPv6 scope zone is likely to be different from the real ethernet
2140		interface
2141
2142The recommendation is different depending on the situation you have:
2143- use draft-touch-ipsec-vpn if you have the control over the other end.
2144  this one is the best in terms of simplicity.
2145- if the other end is normal IPsec device with RFC2401 implementation,
2146  you need to use RFC2401, otherwise you won't be able to run IKE.
2147- use RFC2401 approach if you just want to forward packets back and forth
2148  and there's no plan to use IPsec gateway itself as an originating device.
2149
21504.8.1 RFC2401 IPsec tunnel mode approach
2151
2152To configure your device as RFC2401 IPsec tunnel mode endpoint, you will
2153use "tunnel" keyword in setkey(8) "spdadd" directives.  Let us assume the
2154following topology (A and B could be a network, like prefix/length):
2155
2156	((((((((((((The internet))))))))))))
2157	  |			  |
2158	  |C (global)		  |D
2159	your device		peer's device
2160	  |A (private)		  |B
2161	==+===== VPN net	==+===== VPN net
2162
2163The policy configuration directive is like this.  You will need manual
2164SAs, or IKE daemon, for actual encryption:
2165
2166	# setkey -c <<EOF
2167	spdadd A B any -P out ipsec esp/tunnel/C-D/use;
2168	spdadd B A any -P in ipsec esp/tunnel/D-C/use;
2169	^D
2170
2171The inbound/outbound traffic is monitored/captured by SPD engine, which works
2172just like packet filters.
2173
2174With this, forwarding case should work flawlessly.  However, troubles arise
2175when you have one of the following requirements:
2176- When you originate traffic from your VPN gateway device to VPN net on the
2177  other end (like B), you want your source address to be A (private side)
2178  so that the traffic would be protected by the policy.
2179  With this approach, however, the source address selection logic follows
2180  normal routing table, and C (global side) will be picked for any outgoing
2181  traffic, even if the destination is B.  The resulting packet will be like
2182  this:
2183	IP[C -> B] payload
2184  and will not match the policy (= sent in clear).
2185- When you want to run routing protocols on top of the IPsec tunnel, it is
2186  not possible.  As there is no pseudo device that identifies the IPsec tunnel,
2187  you cannot identify where the routing information came from.  As a result,
2188  you can't run routing daemons.
2189
21904.8.2 draft-touch-ipsec-vpn approach
2191
2192With this approach, you will configure gif(4) tunnel interfaces, as well as
2193IPsec transport mode SAs.
2194
2195	# gifconfig gif0 C D
2196	# ifconfig gif0 A B
2197	# setkey -c <<EOF
2198	spdadd C D any -P out ipsec esp/transport//use;
2199	spdadd D C any -P in ipsec esp/transport//use;
2200	^D
2201
2202Since we have a pseudo-interface "gif0", and it affects the routes and
2203the source address selection logic, we can have source address A, for
2204packets originated by the VPN gateway to B (and the VPN cloud).
2205We can also exchange routing information over the tunnel (gif0), as the tunnel
2206is represented as a pseudo interface (dynamic routes points to the
2207pseudo interface).
2208
2209There is a big drawbacks, however; with this, you can use IKE if and only if
2210the other end is using draft-touch-ipsec-vpn approach too.  Since racoon(8)
2211grabs phase 2 IKE proposals from the kernel SPD database, you will be
2212negotiating IPsec transport-mode SAs with the other end, not tunnel-mode SAs.
2213Also, since the encapsulation mechanism is different from RFC2401, you may not
2214be able to interoperate with a picky RFC2401 implementations - if the other
2215end checks certain outer IP header fields (like TOS), you will not be able to
2216interoperate.
2217
2218
22195. ALTQ
2220
2221KAME kit includes ALTQ, which supports FreeBSD3, FreeBSD4, FreeBSD5
2222NetBSD.  OpenBSD has ALTQ merged into pf and its ALTQ code is not
2223compatible with other platforms so that KAME's ALTQ is not used for
2224OpenBSD.  For BSD/OS, ALTQ does not work.
2225ALTQ in KAME supports IPv6.
2226(actually, ALTQ is developed on KAME repository since ALTQ 2.1 - Jan 2000)
2227
2228ALTQ occupies single character device number.  For FreeBSD, it is officially
2229allocated.  For OpenBSD and NetBSD, we use the number which is not
2230currently allocated (will eventually get an official number).
2231The character device is enabled for i386 architecture only.  To enable and
2232compile ALTQ-ready kernel for other archititectures, take the following steps:
2233- assume that your architecture is FOOBAA.
2234- modify sys/arch/FOOBAA/FOOBAA/conf.c (or somewhere that defines cdevsw),
2235  to include a line for ALTQ.  look at sys/arch/i386/i386/conf.c for
2236  example.  The major number must be same as i386 case.
2237- copy kernel configuration file (like ALTQ.v6 or GENERIC.v6) from i386,
2238  and modify accordingly.
2239- build a kernel.
2240- before building userland, change netbsd/{lib,usr.sbin,usr.bin}/Makefile
2241  (or openbsd/foobaa) so that it will visit altq-related sub directories.
2242
2243
22446. Mobile IPv6
2245
22466.1 KAME node as correspondent node
2247
2248Default installation recognizes home address option (in destination
2249options header).  No sub-options are supported.  interaction with
2250IPsec, and/or 2292bis API, needs further study.
2251
22526.2 KAME node as home agent/mobile node
2253
2254KAME kit includes Ericsson mobile-ip6 code.  The integration is just started
2255(in Feb 2000), and we will need some more time to integrate it better.
2256
2257See kame/mip6config/{QUICKSTART,README_MIP6.txt} for more details.
2258
2259The Ericsson code implements revision 09 of the mobile-ip6 draft.  There
2260are other implementations available:
2261	NEC: http://www.6bone.nec.co.jp/mipv6/internal-dist/ (-13 draft)
2262	SFC: http://neo.sfc.wide.ad.jp/~mip6/ (-13 draft)
2263
22647. Coding style
2265
2266The KAME developers basically do not make a bother about coding
2267style.  However, there is still some agreement on the style, in order
2268to make the distributed develoment smooth.
2269
2270- follow *BSD KNF where possible.  note: there are multiple KNF standards.
2271- the tab character should be 8 columns wide (tabstops are at 8, 16, 24, ...
2272  column).  With vi, use ":set ts=8 sw=8".
2273  With GNU Emacs 20 and later, the easiest way is to use the "bsd" style of
2274  cc-mode with the variable "c-basic-offset" being 8;
2275  (add-hook 'c-mode-common-hook
2276	    (function
2277	     (lambda ()
2278	       (c-set-style "bsd")
2279	       (setq c-basic-offset 8)  ; XXX for Emacs 20 only
2280	       )))
2281  The "bsd" style in GNU Emacs 21 sets the variable to 8 by default,
2282  so the line marked by "XXX" is not necessary if you only use GNU
2283  Emacs 21.
2284- each line should be within 80 characters.
2285- keep a single open/close bracket in a comment such as in the following
2286  line:
2287	putchar('(');	/* ) */
2288  without this, some vi users would have a hard time to match a pair of
2289  brackets.  Although this type of bracket seems clumsy and is even
2290  harmful for some other type of vi users and Emacs users, the
2291  agreement in the KAME developers is to allow it.
2292- add the following line to the head of every KAME-derived file:
2293  /*	(dollar)KAME(dollar)	*/
2294  where "(dollar)" is the dollar character ($), and around "$" are tabs.
2295  (this is for C.  For other language, you should use its own comment
2296  line.)
2297  Once commited to the CVS repository, this line will contain its
2298  version number (see, for example, at the top of this file).  This
2299  would make it easy to report a bug.
2300- when creating a new file with the WIDE copyright, tap "make copyright.c" at
2301  the top-level, and use copyright.c as a template.  KAME RCS tag will be
2302  included automatically.
2303- when editting a third-party package, keep its own coding style as
2304  much as possible, even if the style does not follow the items above.
2305- it is recommended to always wrap an expression containing
2306  bitwise operators by parentheses, especially when the expression is
2307  combined with relational operators, in order to avoid unintentional
2308  mismatch of operators.  Thus, we should write
2309	if ((a & b) == 0)	/* (A) */
2310  or
2311	if (a & (b == 0))	/* (B) */
2312  instead of
2313	if (a & b == 0)		/* (C) */
2314  even if the programmer's intention was (C), which is equivalent to
2315  (B) according to the grammar of the language C.
2316  Thus, we should write a code to test if a bit-flag is set for a
2317  given variable as follows:
2318	if ((flag & FLAG_A) == 0)	/* (D) the FLAG_A is NOT set */
2319	if ((flag & FLAG_A) != 0)	/* (E) the FLAG_A is set */
2320  Some developers in the KAME project rather prefer the following style:
2321	if (!(flag & FLAG_A))	/* (F) the FLAG_A is NOT set */
2322	if ((flag & FLAG_A))	/* (G) the FLAG_A is set */
2323  because it would be more intuitive in terms of the relationship
2324  between the negation operator (!) and the semantics of the
2325  condition.  The KAME developers have discussed the style, and have
2326  agreed that all the styles from (D) to (G) are valid.  So, when you
2327  see styles like (D) and (E) in the KAME code and feel a bit strange,
2328  please just keep them.  They are intentional.
2329- When inserting a separate block just to define some intra-block
2330  variables, add the level of indentation as if the block was in a
2331  control statement such as if-else, for, or while.  For example,
2332	foo ()
2333	{
2334		int a;
2335
2336		{
2337			int internal_a;
2338			...
2339		}
2340	}
2341  should be used, instead of
2342	foo ()
2343	{
2344		int a;
2345
2346	    {
2347		int internal_a;
2348		...
2349	     }
2350	}
2351- Do not use printf() or log() in the packet input path of the kernel code.
2352  They can make the system vulnerable to packet flooding attacks (results in
2353  /var overflow).
2354- (not a style issue)
2355  To disable a module that is mistakenly imported (by CVS), just
2356  remove the source tree in the repository.  Note, however, that the
2357  removal might annoy other developers who have already checked the
2358  module out, so you should announce the removal as soon as possible.
2359  Also, be 100% sure not to remove other modules.
2360
2361When you want to contribute something to the KAME project, and if *you
2362do not mind* the agreement, it would be helpful for the project to
2363keep these rules.  Note, however, that we would never intend to force
2364you to adopt our rules.  We would rather regard your own style,
2365especially when you have a policy about the style.
2366
2367
23689. Policy on technology with intellectual property right restriction
2369
2370There are quite a few IETF documents/whatever which has intellectual property
2371right (IPR) restriction.  KAME's stance is stated below.
2372
2373    The goal of KAME is to provide freely redistributable, BSD-licensed,
2374    implementation of Internet protocol technologies.
2375    For this purpose, we implement protocols that (1) do not need license
2376    contract with IPR holder, and (2) are royalty-free.
2377    The reason for (1) is, even if KAME contracts with the IPR holder in
2378    question, the users of KAME stack (usually implementers of some other
2379    codebase) would need to make a license contract with the IPR holder.
2380    It would damage the "freely redistributable" status of KAME codebase.
2381
2382    By doing so KAME is (implicitly) trying to advocate no-license-contract,
2383    royalty-free, release of IPRs.
2384
2385Note however, as documented in README, we do not guarantee that KAME code
2386is free of IPR infringement, you MUST check it if you are to integrate
2387KAME into your product (or whatever):
2388    READ CAREFULLY: Several countries have legal enforcement for
2389    export/import/use of cryptographic software.  Check it before playing
2390    with the kit.  We do not intend to be your legalease clearing house
2391    (NO WARRANTY).  If you intend to include KAME stack into your product,
2392    you'll need to check if the licenses on each file fit your situations,
2393    and/or possible intellectual property right issues.
2394
2395						 <end of IMPLEMENTATION>
2396