Use ZFSTOP more broadly

Reviewed by: brooks
Obtained from: CheriBSD
Differential Revision: https://reviews.freebsd.org/D53791

zfs: fix cross-build after openzfs/zfs@e63d026b9d

Workaround multiple cross-build issues in OpenZFS code

TBD: discuss long-term fix with OpenZFS

zfs: fix build after openzfs/zfs@e63d026b9

Fix Makefiles
Update zfs_config.h and zfs_gitrev.h

packages: Use LIB_PACKAGE for zfs and ufs packages

Commit f9513c334ff7 moved the shared libraries for ZFS and UFS into
separate packages (libzfs and libufs), which resulted in a rather
large number

packages: Use LIB_PACKAGE for zfs and ufs packages

Commit f9513c334ff7 moved the shared libraries for ZFS and UFS into
separate packages (libzfs and libufs), which resulted in a rather
large number of packages being created, e.g. for ZFS:

FreeBSD-libzfs
FreeBSD-libzfs-dbg
FreeBSD-libzfs-dbg-lib32
FreeBSD-libzfs-dev
FreeBSD-libzfs-dev-lib32
FreeBSD-libzfs-lib32
FreeBSD-zfs
FreeBSD-zfs-dbg
FreeBSD-zfs-dbg-lib32
FreeBSD-zfs-dev
FreeBSD-zfs-dev-lib32
FreeBSD-zfs-lib32
FreeBSD-zfs-man

Use LIB_PACKAGE instead, which significantly reduces the number of
packages:

FreeBSD-zfs
FreeBSD-zfs-dbg
FreeBSD-zfs-dbg-lib32
FreeBSD-zfs-dev
FreeBSD-zfs-dev-lib32
FreeBSD-zfs-lib
FreeBSD-zfs-lib32
FreeBSD-zfs-man

MFC after: 3 days
Reviewed by: bapt
Differential Revision: https://reviews.freebsd.org/D52416

show more ...

libspl: Don't build tunables.c when bootstrapping

The upstream source (which we've currently hacked downstream to make it
compile, even though it won't work) assumes ELF for its hand-rolled
linker s

libspl: Don't build tunables.c when bootstrapping

The upstream source (which we've currently hacked downstream to make it
compile, even though it won't work) assumes ELF for its hand-rolled
linker set implementation, and macOS's Mach-O is sufficiently different
for it to not even compile there. However, we don't actually need this
file at all, since we only use the bootstrap libspl for DTrace tools, so
just add it to the set of files we don't build when bootstrapping.

Fixes: df58e8b1506f ("zfs: merge openzfs/zfs@8302b6e32")

show more ...

zfs: merge openzfs/zfs@8302b6e32

Notable upstream pull request merges:
#16853 894edd084 Add TXG timestamp database
#17004 -multiple Implement dynamic gang header sizes
#17405 dea0fc969 ZVOL: Retu

zfs: merge openzfs/zfs@8302b6e32

Notable upstream pull request merges:
#16853 894edd084 Add TXG timestamp database
#17004 -multiple Implement dynamic gang header sizes
#17405 dea0fc969 ZVOL: Return early, if volmode is ZFS_VOLMODE_NONE
on FreeBSD side
#17455 cf146460c Default to zfs_bclone_wait_dirty=1
#17481 523d9d600 Validate mountpoint on path-based unmount using statx
#17482 92da9e0e9 ZVOL: Implement zvol_alloc() function on FreeBSD side
#17489 dee62e074 spa: ZIO_TASKQ_ISSUE: Use symbolic priority
#17496 bf846dcb7 Release topology restrictions on special/dedup
#17497 4e92aee23 Relax special_small_blocks restrictions
#17503 ea38787f2 Revert "Fix incorrect expected error in ztest"
#17505 be1e991a1 Allow and prefer special vdevs as ZIL
#17506 ee0cb4cb8 ztest: Fix false positive of ENOSPC handling
#17507 92d3b4ee2 zio: rename `io_reexecute` as `io_post`;
use it for the direct IO checksum error flag
#17508 6af8db61b metaslab: don't pass whole zio to throttle reserve APIs
#17518 4c2a7f85d FreeBSD: Add support for _PC_HAS_HIDDENSYSTEM
#17521 d7ab07dfb ZIL: Force writing of open LWB on suspend
#17524 b6e8db509 zpool/zfs: Add '-a|--all' option to scrub, trim,
initialize
#17531 c1e51c55f Correct weight recalculation of space-based metaslabs
#17533 d323fbf49 FreeBSD: zfs_putpages: don't undirty pages until
after write completes
#17536 b21e04e8d Fix zdb pool/ with -k
#17537 -multiple Userspace tunables
#17540 2957eabbe Add support for FreeBSD's Solaris style extended
attribute interface
#17547 4bd7a2eaa zdb: fix checksum calculation for decompressed blocks
#17551 -multiple cleanup: remove var init/update
#17561 0f8a1105e Skip dbuf_evict_one() from dbuf_evict_notify()
for reclaim thread
#17563 10a78e264 Faster checksum benchmark on system boot
#17564 00ce064d8 spa: update blkptr diagram to include vdev padding
on encrypted blocks
#17565 -multiple Physical rewrite
#17566 fc885f308 Don't use wrong weight when passivating group
#17572 f70c85086 BRT: Fix ZAP entry endianness
#17575 0b6fd024a ZVOL: Unify zvol minors operations and improve error
handling
#17581 cb5e7e097 range_tree: Provide more debug details upon unexpected
add/remove
#17587 -multiple Fix two issues with dynamic gang headers

Obtained from: OpenZFS
OpenZFS commit: 8302b6e32bb153a6f402b106484d5736f082abcc

show more ...

add packages for libufs, libzfs

currently FreeBSD-utilities depends on both FreeBSD-ufs and FreeBSD-zfs.
this is not desirable, because those are both relatively large packages
and the user may want

add packages for libufs, libzfs

currently FreeBSD-utilities depends on both FreeBSD-ufs and FreeBSD-zfs.
this is not desirable, because those are both relatively large packages
and the user may want to remove one or the other – or perhaps both, e.g.
in a jail or embedded system.

the reason for this dependency is that fstyp(8), which is in
FreeBSD-utilities, links both libufs and libzfs. FreeBSD-utilities is
the correct place for fstyp, so we don't want to move that.

instead, add two new packages: libufs contains libufs, and libzfs
contains libzfs plus the ZFS libraries it depends on: libavl, libnvpair,
libspl, libtpool, libumem, libuutil, libzfs_core and libzutil.

with this change, it is possible to remove FreeBSD-ufs and/or
FreeBSD-zfs while leaving FreeBSD-libufs, FreeBSD-libzfs and
FreeBSD-utilities installed.

Reviewed by: manu, des
Approved by: des (mentor)
Differential Revision: https://reviews.freebsd.org/D50148

show more ...

Remove residual blank line at start of Makefile

This is a residual of the $FreeBSD$ removal.

MFC After: 3 days (though I'll just run the command on the branches)
Sponsored by: Netflix

zfs: merge openzfs/zfs@e2357561b

Notable upstream pull request merges:
#15940 41ae864b6 Replace P2ALIGN with P2ALIGN_TYPED and delete P2ALIGN
#16128 5137c132a zpool import output is not formated p

zfs: merge openzfs/zfs@e2357561b

Notable upstream pull request merges:
#15940 41ae864b6 Replace P2ALIGN with P2ALIGN_TYPED and delete P2ALIGN
#16128 5137c132a zpool import output is not formated properly
#16138 efbef9e6c FreeBSD: Add zfs_link_create() error handling
#16146 04bae5ec9 Disable high priority ZIO threads on FreeBSD and Linux
#16151 cc3869153 zfs_ioc_send: use a dedicated taskq thread for send
#16151 adda768e3 spa: remove spa_taskq_dispatch_sync()
#16151 515c4dd21 spa: flatten spa_taskq_dispatch_ent()
#16151 0a543db37 spa_taskq_dispatch_ent: simplify arguments
#16153 975a13259 Add support for parallel pool exports
#16153 89acef992 Simplified the scope of the namespace lock
#16159 136c05321 ZAP: Fix leaf references on zap_expand_leaf() errors
#16162 af5dbed31 Fix scn_queue races on very old pools
#16165 3400127a7 Fix ZIL clone records for legacy holes
#16167 414acbd37 Unbreak FreeBSD cross-build on MacOS broken in 051460b8b
#16172 eced2e2f1 libzfs: Fix mounting datasets under thread limit pressure
#16178 b64afa41d Better control the thread pool size when mounting datasets
#16181 fa99d9cd9 zfs_dbgmsg_print: make FreeBSD and Linux consistent
#16191 e675852bc dbuf: separate refcount calls for dbuf and dbuf_user
#16198 a043b60f1 Correct level handling in zstream recompress
#16204 34906f8bb zap: reuse zap_leaf_t on dbuf reuse after shrink
#16206 d0aa9dbcc Use memset to zero stack allocations containing unions
#16207 8865dfbca Fix assertion in Persistent L2ARC
#16208 08648cf0d Allow block cloning to be interrupted by a signal
#16210 e2357561b FreeBSD: Add const qualifier to members of struct
opensolaris_utsname
#16214 800d59d57 Some improvements to metaslabs eviction
#16216 02c5aa9b0 Destroy ARC buffer in case of fill error
#16225 01c8efdd5 Simplify issig()

Obtained from: OpenZFS
OpenZFS commit: e2357561b9499296bff758afe4868dbc39735675

show more ...

Remove $FreeBSD$: one-line sh pattern

Remove /^\s*#[#!]?\s*\$FreeBSD\$.*$\n/

pkgbase: Put zfs utilities and lib in their own package

It is useful to have zfs utilities and lib in a separate package as
it allow users to create image that can support ZFS (i.e. not with
WITHOUT

pkgbase: Put zfs utilities and lib in their own package

It is useful to have zfs utilities and lib in a separate package as
it allow users to create image that can support ZFS (i.e. not with
WITHOUT_ZFS in src.conf set) without bloating the default image with
all zfs tools (for example for jails).

Differential Revision: https://reviews.freebsd.org/D36225

show more ...

spl: Unbreak crossbuild after f20893853e8e

Summary:
f20893853e8e made getexecname no longer guarded by BOOTSTRAPPING, but it
does not build on non-FreeBSD as it tries to use KERN_PROC_PATHNAME and
r

spl: Unbreak crossbuild after f20893853e8e

Summary:
f20893853e8e made getexecname no longer guarded by BOOTSTRAPPING, but it
does not build on non-FreeBSD as it tries to use KERN_PROC_PATHNAME and
related constants.

Reviewers: mm, imp

Reviewed By: imp

Subscribers: imp

Differential Revision: https://reviews.freebsd.org/D30763

show more ...

spl: Fix gcc6 build

-Wno-error= is only a clang flag, restrict its use to only clang.

Sponsored by: Netflix

zfs: unbreak build with clang 12

Change -Wno-error-atomic-alignment to -Wno-error=atomic-alignment
in the Makefile of libspl.

Reported by: Ed Maste <emaste@FreeBSD.org>
Fix by: Alexander Richardso

zfs: unbreak build with clang 12

Change -Wno-error-atomic-alignment to -Wno-error=atomic-alignment
in the Makefile of libspl.

Reported by: Ed Maste <emaste@FreeBSD.org>
Fix by: Alexander Richardson <arichardson@FreeBSD.org>

show more ...

zfs: unbreak build broken in 160388166

Fix dtrace tools bootstrap on non-FreeBSD after OpenZFS import

This required surprisingly few build system changes and only two changes to the
openZFS compat headers which have been upstreamed as
ht

Fix dtrace tools bootstrap on non-FreeBSD after OpenZFS import

This required surprisingly few build system changes and only two changes to the
openZFS compat headers which have been upstreamed as
https://github.com/openzfs/zfs/pull/10863

Reviewed By: #zfs, freqlabs
Differential Revision: https://reviews.freebsd.org/D26193

show more ...

MFH

Sponsored by: Rubicon Communications, LLC (netgate.com)

Merge OpenZFS support in to HEAD.

The primary benefit is maintaining a completely shared
code base with the community allowing FreeBSD to receive
new features sooner and with less effort.

I would a

Merge OpenZFS support in to HEAD.

The primary benefit is maintaining a completely shared
code base with the community allowing FreeBSD to receive
new features sooner and with less effort.

I would advise against doing 'zpool upgrade'
or creating indispensable pools using new
features until this change has had a month+
to soak.

Work on merging FreeBSD support in to what was
at the time "ZFS on Linux" began in August 2018.
I first publicly proposed transitioning FreeBSD
to (new) OpenZFS on December 18th, 2018. FreeBSD
support in OpenZFS was finally completed in December
2019. A CFT for downstreaming OpenZFS support in
to FreeBSD was first issued on July 8th. All issues
that were reported have been addressed or, for
a couple of less critical matters there are
pull requests in progress with OpenZFS. iXsystems
has tested and dogfooded extensively internally.
The TrueNAS 12 release is based on OpenZFS with
some additional features that have not yet made
it upstream.

Improvements include:
project quotas, encrypted datasets,
allocation classes, vectorized raidz,
vectorized checksums, various command line
improvements, zstd compression.

Thanks to those who have helped along the way:
Ryan Moeller, Allan Jude, Zack Welch, and many
others.

Sponsored by: iXsystems, Inc.
Differential Revision: https://reviews.freebsd.org/D25872

show more ...