1.\" Copyright (c) 2001 John H. Baldwin <jhb@FreeBSD.org> 2.\" All rights reserved. 3.\" 4.\" Redistribution and use in source and binary forms, with or without 5.\" modification, are permitted provided that the following conditions 6.\" are met: 7.\" 1. Redistributions of source code must retain the above copyright 8.\" notice, this list of conditions and the following disclaimer. 9.\" 2. Redistributions in binary form must reproduce the above copyright 10.\" notice, this list of conditions and the following disclaimer in the 11.\" documentation and/or other materials provided with the distribution. 12.\" 13.\" THIS SOFTWARE IS PROVIDED BY THE AUTHOR AND CONTRIBUTORS ``AS IS'' AND 14.\" ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE 15.\" IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE 16.\" ARE DISCLAIMED. IN NO EVENT SHALL THE AUTHOR OR CONTRIBUTORS BE LIABLE 17.\" FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL 18.\" DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS 19.\" OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) 20.\" HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT 21.\" LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY 22.\" OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF 23.\" SUCH DAMAGE. 24.\" 25.\" $FreeBSD$ 26.\" 27.Dd February 16, 2001 28.Dt KTR 4 29.Os 30.Sh NAME 31.Nm ktr 32.Nd kernel tracing facility 33.Sh SYNOPSIS 34.Cd options KTR 35.Cd options KTR_COMPILE=(KTR_LOCK|KTR_INTR|KTR_PROC) 36.Cd options KTR_CPUMASK=0x3 37.Cd options KTR_ENTRIES=8192 38.Cd options KTR_EXTEND 39.Cd options KTR_MASK=(KTR_INTR|KTR_PROC) 40.Cd options KTR_VERBOSE 41.Sh DESCRIPTION 42The 43.Nm 44facility allows kernel events to be logged while the kernel executes so that 45they can be examined later when debugging. 46The only mandatory option to enable 47.Nm 48is 49.Dq Li options KTR . 50.Pp 51The 52.Dv KTR_ENTRIES 53option sets the size of the buffer of events. 54It should be a power of two. 55The size of the buffer in the currently running kernel can be found via the 56read-only sysctl 57.Va debug.ktr.entries . 58By default the buffer contains 1024 entries. 59.Ss Event Masking 60Event levels can be enabled or disabled to trim excessive and overly verbose 61logging. 62First, a mask of events is specified at compile time via the 63.Dv KTR_COMPILE 64option to limit which events are actually compiled into the kernel. 65The default value for this option is for all events to be enabled. 66.Pp 67Secondly, the actual events logged while the kernel runs can be further 68masked via the run time event mask. 69The 70.Dv KTR_MASK 71option sets the default value of the run time event mask. 72The runtime event mask can also be set by the 73.Xr loader 8 74via the 75.Va debug.ktr.mask 76environment variable. 77It can also be examined and set after booting via the 78.Va debug.ktr.mask 79sysctl. 80By default the run time mask is set to log only 81.Dv KTR_GEN 82events. 83The definitions of the event mask bits can be found in 84.Aq Pa sys/ktr.h . 85.Ss Extensions 86The kernel can be configured to compile with several extensions to the base 87functionality via the 88.Dv KTR_EXTEND 89option. 90These extensions can be checked for via the 91.Va debug.ktr.extend 92read-only sysctl. 93It will be set to zero if the extensions are not compiled in and non-zero 94if they are compiled in. 95If the extensions are compiled in, then each event entry includes the filename 96and line number that the event was logged from as well as the CPU on which 97the current thread was executing when the event was logged. 98.Pp 99One extension is a CPU event mask whose default value can be changed via 100the 101.Dv KTR_CPUMASK 102option. 103A CPU must have the bit corresponding to its logical id set in this bitmask 104for events that occur on it to be logged. 105This mask can be set by the 106.Xr loader 8 107via the 108.Va debug.ktr.cpumask 109environment variable. 110It can also be examined and set after booting via the 111.Va debug.ktr.cpumask 112sysctl. 113By default events on all CPUs are enabled. 114.Pp 115The log messages go through more processing at log time when the extensions 116are enabled as well. 117In the basic mode, the format string and arguments are stored directly in 118the event entry. 119In the extended mode, 120.Xr snprintf 9 121is invoked and the resulting string is stored directly in the event entry. 122This extra processing is more expensive in terms of execution but produces 123events that are arguably more readable and easier to parse for some utilities 124such as 125.Xr ddb 4 . 126.Pp 127By default, events are only logged to the internal buffer for examination 128later, but if the verbose flag is set then they are dumped to the kernel 129console as well. 130This flag can also be set from the loader via the 131.Va debug.ktr.verbose 132environment variable, or it can be examined and set after booting via the 133.Va debug.ktr.verbose 134sysctl. 135If the flag is set to zero, which is the default, then verbose output is 136disabled. 137If the flag is set to one, then the contents of the log message and the CPU 138number are printed to the kernel console. 139If the flag is greater than one, then the filename and line number of the 140event are output to the console in addition to the log message and the CPU 141number. 142The 143.Dv KTR_VERBOSE 144option sets the flag to one. 145.Ss Examining the Events 146The KTR buffer can be examined from within 147.Xr ddb 4 148via the 149.Ic show ktr Op Cm /v 150command. 151This command displays the contents of the trace buffer one page at a time. 152At the 153.Dq Li --more-- 154prompt, the Enter key displays one more entry and prompts again. 155The spacebar displays another page of entries. 156Any other key quits. 157By default the timestamp, filename, and line number are not displayed with 158each log entry. 159If the 160.Cm /v 161modifier is specified, then they are displayed in addition to the normal 162output. 163Note that the events are displayed in reverse chronological order. 164That is, the most recent events are displayed first. 165.Sh SEE ALSO 166.Xr ktr 9 167.Sh HISTORY 168The KTR kernel tracing facility first appeared in 169.Bsx 3.0 170and was imported into 171.Fx 5.0 . 172.Sh BUGS 173Currently there is no userland utility outside of a gdb script to extract 174the event buffer from a kernel crash dump or a running kernel. 175