11 - Fixed a segfault when reporting errors under musl ([`d40eb87`])
13 [`d40eb87`]: https://github.com/tavianator/bfs/commit/d40eb87cc00f50a5debb8899eacb7fcf1065badf
23 - Iterative deepening modes (`-S {ids,eds}`) were optimized by delaying teardown until the very end ([`5f16169`])
25 - Parallel depth-first search (`-S dfs`) was optimized to avoid enqueueing every file separately ([`2572273`])
29 - Iterative deepening modes (`-S {ids,eds}`) were performing iterative *breadth*-first searches since `bfs` 3.0, negating any advantages they may have had over normal breadth-first search.
30 They now do iterative *depth*-first searches as expected.
33 - Fixed a linked-list corruption that could lead to an infinite loop on macOS and other non-Linux, non-FreeBSD platforms ([`773f4a4`])
35 [`5f16169`]: https://github.com/tavianator/bfs/commit/5f1616912ba3a7a23ce6bce02df3791b73da38ab
36 [`2572273`]: https://github.com/tavianator/bfs/commit/257227326fe60fe70e80433fd34d1ebcb2f9f623
37 [`a029d95`]: https://github.com/tavianator/bfs/commit/a029d95b5736a74879f32089514a5a6b63d6efbc
38 [`773f4a4`]: https://github.com/tavianator/bfs/commit/773f4a446f03da62d88e6d17be49fdc0a3e38465
48 - `-files0-from` now allows an empty set of paths to be given, matching GNU findutils 4.9.0
50 - Reduced memory consumption in multi-threaded searches
52 - Many man page updates
56 - Fixed an out-of-bounds memory read that could occur when escaping a string containing an incomplete multi-byte character
66 - Traversal fixes that mostly affect large directory trees ([#107])
68 - `bfs` could encounter `EMFILE`, close a file, and retry many times, particularly with `-j1`
70 - Breadth-first search could become highly unbalanced, negating many of the benefits of `bfs`
72 - On non-{Linux,FreeBSD} plaforms, directories could stay open longer than necessary, consuming extra memory
74 [#107]: https://github.com/tavianator/bfs/pull/107
84 - `bfs` now reads directories asynchronously and in parallel ([#101]).
85 Performance is significantly improved as a result.
86 Parallelism is controlled by the new `-j` flag, e.g. `-j1`, `-j2`, etc.
88 [#101]: https://github.com/tavianator/bfs/issues/101
92 - `bfs` now uses the [C17] standard version, up from C11
94 - Due to [#101], `bfs` now requires some additional C and POSIX features:
95 - [Standard C atomics] (`<stdatomic.h>`)
96 - [POSIX threads] (`<pthread.h>`)
98 - `$LS_COLORS` extensions written in different cases (e.g. `*.jpg=35:*.JPG=01;35`) are now matched case-sensitively, to match the new behaviour of GNU ls since coreutils version 9.2
100 - Added a warning/error if `$LS_COLORS` can't be parsed, depending on whether `-color` is requested explicitly
102 - Filenames with control characters are now escaped when printing with `-color`
104 - Build flags like `WITH_ONIGURUMA` have been renamed to `USE_ONIGURUMA`
106 [C17]: https://en.cppreference.com/w/c/17
107 [Standard C atomics]: https://en.cppreference.com/w/c/atomic
108 [POSIX threads]: https://pubs.opengroup.org/onlinepubs/9699919799/idx/threads.html
112 - Fixed handling of the "normal text" color (`no` in `$LS_COLORS`) to match GNU ls
123 - Fixed running the tests as root on Linux [`8b24de3`]
125 - Fixed some tests on Android [`2724dfb`] [`0a5a80c`]
127 - Stopped relying on non-POSIX touch(1) features in the tests.
128 This should fix the tests on at least OpenBSD.
131 - User/group caches are now filled lazily instead of eagerly [`b41dca5`]
133 - More caches and I/O streams are flushed before -exec/-ok [`f98a1c4`]
135 - Fixed various memory safety issues found by fuzzing \
136 [`712b137`] [`5ce883d`] [`da02def`] [`c55e855`]
138 - Fixed a test failure on certain macOS versions [`8b24de3`]
140 - Mitigated a race condition when determining filesystem types ([#97])
142 - Lots of refactoring and optimization
144 [`8b24de3`]: https://github.com/tavianator/bfs/commit/8b24de3882ff5a3e33b82ab20bb4eadf134cf559
145 [`2724dfb`]: https://github.com/tavianator/bfs/commit/2724dfbd17552f892a0d8b39b96cbe9e49d66fdb
146 [`0a5a80c`]: https://github.com/tavianator/bfs/commit/0a5a80c98cc7e5d8735b615fa197a6cff2bb08cc
147 [`2d5edb3`]: https://github.com/tavianator/bfs/commit/2d5edb37b924715b4fbee4d917ac334c773fca61
148 [`b41dca5`]: https://github.com/tavianator/bfs/commit/b41dca52762c5188638236ae81b9f4597bb29ac9
149 [`f98a1c4`]: https://github.com/tavianator/bfs/commit/f98a1c4a1cf61ff7d6483388ca1fac365fb0b31b
150 [`712b137`]: https://github.com/tavianator/bfs/commit/712b13756a09014ef730c8f9b96da4dc2f09b762
151 [`5ce883d`]: https://github.com/tavianator/bfs/commit/5ce883daaafc69f83b01dac5db0647e9662a6e87
152 [`da02def`]: https://github.com/tavianator/bfs/commit/da02defb91c3a1bda0ea7e653d81f997f1c8884a
153 [`c55e855`]: https://github.com/tavianator/bfs/commit/c55e85580df10c5afdc6fc0710e756a456aa8e93
154 [`8b24de3`]: https://github.com/tavianator/bfs/commit/8b24de3882ff5a3e33b82ab20bb4eadf134cf559
155 [#97]: https://github.com/tavianator/bfs/issues/97
163 - Fixed use of uninitialized memory on parsing errors involving `-fprintf`
165 - Fixed Android build issues ([#96])
167 - Refactored the test suite
169 [#96]: https://github.com/tavianator/bfs/issues/96
177 - Fix `stat()` errors on GNU Hurd systems with glibc older than 2.35
179 - Added fish shell tab completion ([#94]).
182 [#94]: https://github.com/tavianator/bfs/pull/94
190 - Fixed deleting large NFS directories on FreeBSD ([#67]).
192 - Added support for a `bfs`-specific `BFS_COLORS` environment variable.
194 - Refactored the build system, directory structure, and documentation ([#88], [#89], [#91]).
195 Thanks @ElectronicsArchiver!
197 - Added `zsh` completion ([#86]).
200 - Updated the default color scheme to match GNU coreutils 9.1.
201 Files with capabilities set are no longer colored differently by default, resulting in a significant performance improvement.
203 - Became less aggressive at triggering automounts
205 - Added support for out-of-tree builds with `BUILDDIR`
207 [#67]: https://github.com/tavianator/bfs/issues/67
208 [#86]: https://github.com/tavianator/bfs/issues/86
209 [#88]: https://github.com/tavianator/bfs/issues/88
210 [#89]: https://github.com/tavianator/bfs/issues/89
211 [#91]: https://github.com/tavianator/bfs/issues/91
219 - Added compiler-style context for errors and warnings.
220 Errors look like this:
223 bfs: error: bfs -nam needle
225 bfs: error: Unknown argument; did you mean -name?
227 and warnings look like this:
229 $ bfs -print -name 'needle'
230 bfs: warning: bfs -print -name needle
231 bfs: warning: ~~~~~~~~~~~~
232 bfs: warning: The result of this expression is ignored.
234 - Updated from C99 to C11
236 - Fixed the tests when built against musl
238 - Fixed a build error reported on Manjaro
244 **February 24, 2022**
246 - Fixed the build when Oniguruma is not installed in the default search paths ([#82])
248 - Fixed string encoding bugs with Oniguruma enabled
250 - Fixed regex error reporting bugs
252 [#82]: https://github.com/tavianator/bfs/issues/82
258 **February 22, 2022**
260 - Added the Oniguruma regular expression library as an (optional, but enabled by default) dependency ([#81]).
261 Oniguruma supports more regular expression syntax types than the POSIX regex API, and often performs better.
262 To build `bfs` without this new dependency, do `make WITH_ONIGURUMA=` to disable it.
265 - Added support for the `ed`, `emacs`, `grep`, and `sed` regular expression types ([#21])
267 - Before executing a process with `-exec[dir]`/`-ok[dir]`, `bfs` now ensures all output streams are flushed.
268 Previously, I/O from subprocesses could be interleaved unpredictably with buffered I/O from `bfs` itself.
270 [#81]: https://github.com/tavianator/bfs/pull/81
271 [#21]: https://github.com/tavianator/bfs/issues/21
279 - Fixed the build on Debian kFreeBSD
281 - Fixed a crash on GNU Hurd when piping bfs's output
283 - Fixed a double-`close()` on non-Linux platforms if `fdopendir()` fails
285 - Reduced memory allocations on startup
291 **November 25, 2021**
293 - More tweaks to `PAGER` and `LESS` handling for `bfs -help` ([#76])
295 - Use 512-byte blocks for `-ls` when `POSIXLY_CORRECT` is set ([#77])
297 - Implemented `-files0-from FILE` to take a list of `'\0'`-separated starting paths.
298 GNU find will implement the same feature in an upcoming release.
300 - Added colors to `-printf` output ([#62])
302 - Faster recovery from `E2BIG` during `-exec`
304 [#76]: https://github.com/tavianator/bfs/issues/76
305 [#77]: https://github.com/tavianator/bfs/issues/77
306 [#62]: https://github.com/tavianator/bfs/issues/62
314 - Fixed some incorrect coloring of broken links when links are being followed (`-L`)
316 - Made the tests work when run as root by dropping privileges.
317 This may be helpful for certain packaging or CI environments, but is not recommended.
319 - Treat empty `PAGER` and `LESS` environment variables like they're unset, for `bfs -help` ([#71]).
320 Thanks @markus-oberhumer!
322 - The soft `RLIMIT_NOFILE` is now raised automatically to a fairly large value when possible.
323 This provides a minor performance benefit for large directory trees.
325 - Implemented time units for `-mtime` as found in FreeBSD find ([#75])
327 [#71]: https://github.com/tavianator/bfs/issues/71
328 [#75]: https://github.com/tavianator/bfs/issues/75
336 - Fixed `-hidden` on hidden start paths
338 - Added a Bash completion script.
341 - Fixed rounding in `-used`.
342 Corresponding fixes were made to GNU find in version 4.8.0.
344 - Optimized the open directory representation.
345 On Linux, much libc overhead is bypassed by issuing syscalls directly.
346 On all platforms, a few fewer syscalls and open file descriptors will be used.
348 - Implemented `-flags` from BSD find
354 **November 11, 2020**
356 - Added a new `-status` option that displays the search progress in a bar at the bottom of the terminal
358 - Fixed an optimizer bug introduced in version 2.0 that affected some combinations of `-user`/`-group` and `-nouser`/`-nogroup`
366 - [#8]: New `-exclude <expression>` syntax to more easily and reliably filter out paths.
369 bfs -name config -exclude -name .git
371 will find all files named `config`, without searching any directories (or files) named `.git`.
372 In this case, the same effect could have been achieved (more awkwardly) with `-prune`:
374 bfs ! \( -name .git -prune \) -name config
376 But `-exclude` will work in more cases:
378 # -exclude works with -depth, while -prune doesn't:
379 bfs -depth -name config -exclude -name .git
381 # -exclude applies even to paths below the minimum depth:
382 bfs -mindepth 3 -name config -exclude -name .git
384 - [#30]: `-nohidden` is now equivalent to `-exclude -hidden`.
385 This changes the behavior of command lines like
387 bfs -type f -nohidden
389 to do what was intended.
391 - Optimized the iterative deepening (`-S ids`) implementation
393 - Added a new search strategy: exponential deepening search (`-S eds`).
394 This strategy provides many of the benefits of iterative deepening, but much faster due to fewer re-traversals.
396 - Fixed an optimizer bug that could skip `-empty`/`-xtype` if they didn't always lead to an action
398 - Implemented `-xattrname` to find files with a particular extended attribute (from macOS find)
400 - Made `-printf %l` still respect the width specifier (e.g. `%10l`) for non-links, to match GNU find
402 - Made `bfs` fail if `-color` is given explicitly and `LS_COLORS` can't be parsed, rather than falling back to non-colored output
404 [#8]: https://github.com/tavianator/bfs/issues/8
405 [#30]: https://github.com/tavianator/bfs/issues/30
416 - Fixed `-ls` printing numeric IDs instead of user/group names in large directory trees
417 - Cached the user and group tables for a performance boost
418 - Fixed interpretation of "default" ACLs
419 - Implemented `-s` flag to sort results
425 **February 25, 2020**
427 - Implemented `-newerXt` (explicit reference times), `-since`, `-asince`, etc.
428 - Fixed `-empty` to skip special files (pipes, devices, sockets, etc.)
436 - Fixed the build on NetBSD
437 - Added support for NFSv4 ACLs on FreeBSD
438 - Added a `+` after the file mode for files with ACLs in `-ls`
439 - Supported more file types (whiteouts, doors) in symbolic modes for `-ls`/`-printf %M`
440 - Implemented `-xattr` on FreeBSD
446 **September 14, 2019**
448 - Added a warning to `-mount`, since it will change behaviour in the next POSIX revision
449 - Added a workaround for environments that block `statx()` with `seccomp()`, like older Docker
450 - Fixed coloring of nonexistent leading directories
451 - Avoided calling `stat()` on all mount points at startup
459 - New `-xattr` predicate to find files with extended attributes
460 - Fixed the `-acl` implementation on macOS
461 - Implemented depth-first (`-S dfs`) and iterative deepening search (`-S ids`)
462 - Piped `-help` output into `$PAGER` by default
463 - Fixed crashes on some invalid `LS_COLORS` values
471 - Added a nicer error message when the tests are run as root
472 - Fixed detection of comparison expressions with signs, to match GNU find for things like `-uid ++10`
473 - Added support for https://no-color.org/
474 - Decreased the number of `stat()` calls necessary in some cases
482 - New `-unique` option that filters out duplicate files ([#48])
483 - Optimized the file coloring implementation
484 - Fixed the coloring implementation to match GNU ls more closely in many corner cases
485 - Implemented escape sequence parsing for `LS_COLORS`
486 - Implemented `ln=target` for coloring links like their targets
487 - Fixed the order of fallbacks used when some color keys are unset
488 - Add a workaround for incorrect file types for bind-mounted files on Linux ([#37])
490 [#48]: https://github.com/tavianator/bfs/issues/48
491 [#37]: https://github.com/tavianator/bfs/issues/37
497 **February 10, 2019**
499 - Fixed unpredictable behaviour for empty responses to `-ok`/`-okdir` caused by an uninitialized string
500 - Writing to standard output now causes `bfs` to fail if the descriptor was closed
501 - Fixed incomplete file coloring in error messages
502 - Added some data flow optimizations
503 - Fixed `-nogroup`/`-nouser` in big directory trees
504 - Added `-type w` for whiteouts, as supported by FreeBSD `find`
505 - Re-wrote the `-help` message and manual page
513 - Fixed an out-of-bounds read if LS_COLORS doesn't end with a `:`
514 - Allowed multiple debug flags to be specified like `-D opt,tree`
522 - Fixed some portability problems affecting FreeBSD
532 - `-acl` finds files with non-trivial Access Control Lists (from FreeBSD)
533 - `-capable` finds files with capabilities set
534 - `-D all` turns on all debugging flags at once
538 - `LS_COLORS` handling has been improved:
539 - Extension colors are now case-insensitive like GNU `ls`
540 - `or` (orphan) and `mi` (missing) files are now treated differently
541 - Default colors can be unset with `di=00` or similar
542 - Specific colors fall back to more general colors when unspecified in more places
543 - `LS_COLORS` no longer needs a trailing colon
544 - `-ls`/`-fls` now prints the major/minor numbers for device nodes
545 - `-exec ;` is rejected rather than segfaulting
546 - `bfs` now builds on old Linux versions that require `-lrt` for POSIX timers
547 - For files whose access/change/modification times can't be read, `bfs` no longer fails unless those times are needed for tests
548 - The testsuite is now more correct and portable
554 **September 24, 2018**
556 - GNU find compatibility fixes for `-printf`:
557 - `%Y` now prints `?` if an error occurs resolving the link
558 - `%B` is now supported for birth/creation time (as well as `%W`/`%w`)
559 - All standard `strftime()` formats are supported, not just the ones from the GNU find manual
560 - Optimizations are now re-run if any expressions are reordered
561 - `-exec` and friends no longer leave zombie processes around when `exec()` fails
569 - Fixed `test_depth_error` on filesystems that don't fill in `d_type`
570 - Fixed the build on Linux architectures that don't have the `statx()` syscall (ia64, sh4)
571 - Fixed use of AT_EMPTY_PATH for fstatat on systems that don't support it (Hurd)
572 - Fixed `ARG_MAX` accounting on architectures with large pages (ppc64le)
573 - Fixed the build against the upcoming glibc 2.28 release that includes its own `statx()` wrapper
582 - Fixed `-exec ... '{}' +` argument size tracking after recovering from `E2BIG`
583 - Fixed `-fstype` if `/proc` is available but `/etc/mtab` is not
584 - Fixed an uninitialized variable when given `-perm +rw...`
585 - Fixed some potential "error: 'path': Success" messages
586 - Reduced reliance on GNU coreutils in the testsuite
587 - Refactored and simplified the internals of `bftw()`
595 - Performance optimizations
603 - Added support for the `-perm +7777` syntax deprecated by GNU find (equivalent to `-perm /7777`), for compatibility with BSD finds
604 - Added support for file birth/creation times on platforms that report it
605 - `-Bmin`/`-Btime`/`-Bnewer`
606 - `B` flag for `-newerXY`
607 - `%w` and `%Wk` directives for `-printf`
608 - Uses the `statx(2)` system call on new enough Linux kernels
609 - More robustness to `E2BIG` added to the `-exec` implementation
618 - Fixed cases where multiple actions write to the same file
619 - Report errors that occur when closing files/flushing streams
620 - Fixed "argument list too long" errors with `-exec ... '{}' +`
628 - Refactored the optimizer
629 - Implemented data flow optimizations
635 **September 10, 2017**
637 - Fixed `-samefile` and similar predicates when passed broken symbolic links
638 - Implemented `-fstype` on Solaris
639 - Fixed `-fstype` under musl
640 - Implemented `-D search`
641 - Implemented a cost-based optimizer
649 - Re-licensed under the BSD Zero Clause License
650 - Fixed some corner cases with `-exec` and `-ok` parsing
658 - Implemented some primaries from NetBSD `find`:
659 - `-exit [STATUS]` (like `-quit`, but with an optional explicit exit status)
660 - `-printx` (escape special characters for `xargs`)
661 - `-rm` (alias for `-delete`)
662 - Warn if `-prune` will have no effect due to `-depth`
663 - Handle y/n prompts according to the user's locale
664 - Prompt the user to correct typos without having to re-run `bfs`
665 - Fixed handling of paths longer than `PATH_MAX`
666 - Fixed spurious "Inappropriate ioctl for device" errors when redirecting `-exec ... +` output
667 - Fixed the handling of paths that treat a file as a directory (e.g. `a/b/c` where `a/b` is a regular file)
668 - Fixed an expression optimizer bug that broke command lines like `bfs -name '*' -o -print`
678 - Fixed handling of \0 inside -printf format strings
679 - Fixed `-perm` interpretation of permcopy actions (e.g. `u=rw,g=r`)
689 - Portability fixes that mostly affect GNU Hurd
690 - Implemented `-D exec`
691 - Made `-quit` not disable the implicit `-print`
699 This is the first release of bfs with support for all of GNU find's primitives.
703 - Implemented `-fstype`
704 - Implemented `-exec/-execdir ... +`
705 - Implemented BSD's `-X`
706 - Fixed the tests under Bash 3 (mostly for macOS)
707 - Some minor optimizations and fixes
719 73/76 GNU find features supported.
721 - Implemented -nouser and -nogroup
722 - Implemented -printf and -fprintf
723 - Implemented -ls and -fls
724 - Implemented -type with multiple types at once (e.g. -type f,d,l)
725 - Fixed 32-bit builds
726 - Fixed -lname on "symlinks" in Linux /proc
727 - Fixed -quit to take effect as soon as it's reached
728 - Stopped redirecting standard input from /dev/null for -ok and -okdir, as that violates POSIX
729 - Many test suite improvements
735 **December 20, 2016**
737 67/76 GNU find features supported.
739 - Fixed the build on macOS, and some other UNIXes
740 - Implemented `-regex`, `-iregex`, `-regextype`, and BSD's `-E`
741 - Implemented `-x` (same as `-mount`/`-xdev`) from BSD
742 - Implemented `-mnewer` (same as `-newer`) from BSD
743 - Implemented `-depth N` from BSD
744 - Implemented `-sparse` from FreeBSD
745 - Implemented the `T` and `P` suffices for `-size`, for BSD compatibility
746 - Added support for `-gid NAME` and `-uid NAME` as in BSD
752 **November 24, 2016**
757 - Like GNU find, don't print warnings by default if standard input is not a terminal
758 - Redirect standard input from /dev/null for -ok and -okdir
759 - Skip . when -delete'ing
760 - Fixed -execdir when the root path has no slashes
761 - Fixed -execdir in /
762 - Support -perm +MODE for symbolic modes
763 - Fixed the build on FreeBSD
765 [#7]: https://github.com/tavianator/bfs/issues/7
773 64/76 GNU find features supported.
775 - Spelling suggestion improvements
777 - (Untested) support for exotic file types like doors, ports, and whiteouts
778 - Improved robustness in the face of closed std{in,out,err}
779 - Fixed the build on macOS
780 - Implement `-ignore_readdir_race`, `-noignore_readdir_race`
787 **September 4, 2016**
789 62/76 GNU find features supported.
791 - Rework optimization levels
793 - Simple boolean simplification
795 - Purity-based optimizations, allowing side-effect-free tests like `-name` or `-type` to be moved or removed
796 - `-O3` (**default**):
797 - Re-order tests to reduce the expected cost (TODO)
799 - Aggressive optimizations that may have surprising effects on warning/error messages and runtime, but should not otherwise affect the results
801 - Always the highest level, currently the same as `-O4`
802 - Color files with multiple hard links correctly
803 - Treat `-`, `)`, and `,` as paths when required to by POSIX
804 - `)` and `,` are only supported before the expression begins
806 - Implement `-D rates`
807 - Implement `-fprint`
808 - Implement `-fprint0`
809 - Implement BSD's `-f`
810 - Suggest fixes for typo'd arguments
817 60/76 GNU find features supported.
819 - Remove an errant debug `printf()` from `-used`
820 - Implement the `{} ;` variants of `-exec`, `-execdir`, `-ok`, and `-okdir`
828 56/76 GNU find features supported.
830 - Color broken symlinks correctly
832 - Fix `-daystart`'s rounding of midnight
833 - Implement (most of) `-newerXY`
837 [#7]: https://github.com/tavianator/bfs/issues/7
843 **February 23, 2016**
845 53/76 GNU find features supported.
847 - New `make install` and `make uninstall` targets
848 - Squelch non-positional warnings for `-follow`
849 - Reduce memory footprint by as much as 64% by closing `DIR*`s earlier
850 - Speed up `bfs` by ~5% by using a better FD cache eviction policy
851 - Fix infinite recursion when evaluating `! expr`
852 - Optimize unused pure expressions (e.g. `-empty -a -false`)
853 - Optimize double-negation (e.g. `! ! -name foo`)
854 - Implement `-D stat` and `-D tree`
861 **February 14, 2016**
865 51/76 GNU find features supported.