]> Sergey Matveev's repositories - btrtrc.git/log
btrtrc.git
3 weeks agoRejigger library search paths for possum tests
Matt Joiner [Thu, 21 Aug 2025 04:24:54 +0000 (14:24 +1000)]
Rejigger library search paths for possum tests

3 weeks agoAdd git ignores for Sintel test in fs directory
Matt Joiner [Thu, 21 Aug 2025 02:22:12 +0000 (12:22 +1000)]
Add git ignores for Sintel test in fs directory

3 weeks agoAdd a test for seek data right after writing to mmap and not syncing
Matt Joiner [Wed, 20 Aug 2025 01:43:05 +0000 (11:43 +1000)]
Add a test for seek data right after writing to mmap and not syncing

3 weeks agoGive webseed request goroutines readable names
Matt Joiner [Wed, 20 Aug 2025 01:42:33 +0000 (11:42 +1000)]
Give webseed request goroutines readable names

3 weeks agoAvoid buffering to write zeroes
Matt Joiner [Wed, 20 Aug 2025 01:41:25 +0000 (11:41 +1000)]
Avoid buffering to write zeroes

3 weeks agoSpecialize the limited write for hashing in file storage
Matt Joiner [Tue, 19 Aug 2025 07:44:37 +0000 (17:44 +1000)]
Specialize the limited write for hashing in file storage

3 weeks agoSkip holes with mmapFileIo
Matt Joiner [Tue, 19 Aug 2025 07:49:00 +0000 (17:49 +1000)]
Skip holes with mmapFileIo

4 weeks agoRemove possum storage replace master v1.59.1
Matt Joiner [Mon, 18 Aug 2025 05:07:58 +0000 (15:07 +1000)]
Remove possum storage replace

Fixes #1020.

4 weeks agoSync to tagged deps v1.59.0
Matt Joiner [Fri, 15 Aug 2025 01:28:25 +0000 (11:28 +1000)]
Sync to tagged deps

4 weeks agoAdd TODO on SEEK_DATA
Matt Joiner [Fri, 15 Aug 2025 01:10:28 +0000 (11:10 +1000)]
Add TODO on SEEK_DATA

4 weeks agoMerge branch 'erigon'
Matt Joiner [Fri, 15 Aug 2025 01:06:01 +0000 (11:06 +1000)]
Merge branch 'erigon'

4 weeks agoSet default webseed host request concurrency to 25
Matt Joiner [Fri, 15 Aug 2025 01:04:48 +0000 (11:04 +1000)]
Set default webseed host request concurrency to 25

4 weeks agoSet default file IO implementation to mmap
Matt Joiner [Fri, 15 Aug 2025 01:04:35 +0000 (11:04 +1000)]
Set default file IO implementation to mmap

4 weeks agoSmall improvements to cmd/torrent2 metainfo pprint
Matt Joiner [Thu, 14 Aug 2025 07:13:48 +0000 (17:13 +1000)]
Small improvements to cmd/torrent2 metainfo pprint

4 weeks agoBlock Torrent.Complete on hashing
Matt Joiner [Thu, 14 Aug 2025 07:13:05 +0000 (17:13 +1000)]
Block Torrent.Complete on hashing

4 weeks agoUpdate webseed requests if queue is completely drained
Matt Joiner [Thu, 14 Aug 2025 02:46:10 +0000 (12:46 +1000)]
Update webseed requests if queue is completely drained

4 weeks agoRebuke webseed peers for a minute on bad responses
Matt Joiner [Thu, 14 Aug 2025 02:45:51 +0000 (12:45 +1000)]
Rebuke webseed peers for a minute on bad responses

4 weeks agoAdd webseed.ReadRequestPartError
Matt Joiner [Thu, 14 Aug 2025 02:41:57 +0000 (12:41 +1000)]
Add webseed.ReadRequestPartError

4 weeks agoSkip unnecessary peer iteration when there's no peers to ban
Matt Joiner [Thu, 14 Aug 2025 02:39:59 +0000 (12:39 +1000)]
Skip unnecessary peer iteration when there's no peers to ban

4 weeks agoRemove pprof labels for webseed request read routine
Matt Joiner [Thu, 14 Aug 2025 02:40:18 +0000 (12:40 +1000)]
Remove pprof labels for webseed request read routine

4 weeks agoDon't close webseed peers for bad data
Matt Joiner [Thu, 14 Aug 2025 02:30:34 +0000 (12:30 +1000)]
Don't close webseed peers for bad data

4 weeks agoDon't issue webseed requests that clobber pending cancels
Matt Joiner [Thu, 14 Aug 2025 02:27:23 +0000 (12:27 +1000)]
Don't issue webseed requests that clobber pending cancels

4 weeks agoTrack activeWebseedRequests in Client too
Matt Joiner [Thu, 14 Aug 2025 02:36:12 +0000 (12:36 +1000)]
Track activeWebseedRequests in Client too

4 weeks agoMaybe partial file for existing webseed requests that are finished would panic
Matt Joiner [Thu, 14 Aug 2025 02:25:54 +0000 (12:25 +1000)]
Maybe partial file for existing webseed requests that are finished would panic

4 weeks agoFix out of bounds in mmap WriteTo
Matt Joiner [Thu, 14 Aug 2025 02:15:23 +0000 (12:15 +1000)]
Fix out of bounds in mmap WriteTo

4 weeks agoLog source fetch fail when not retrying
Matt Joiner [Thu, 14 Aug 2025 02:14:56 +0000 (12:14 +1000)]
Log source fetch fail when not retrying

4 weeks agoUse msync flushing in mmap file io
Matt Joiner [Thu, 14 Aug 2025 02:13:49 +0000 (12:13 +1000)]
Use msync flushing in mmap file io

4 weeks agoMerge aprioriWebseedRequestKey and webseedUniqueRequestKey
Matt Joiner [Wed, 13 Aug 2025 02:12:18 +0000 (12:12 +1000)]
Merge aprioriWebseedRequestKey and webseedUniqueRequestKey

4 weeks agoFix some tests that didn't hold lock while deferring actions
Matt Joiner [Wed, 13 Aug 2025 01:57:26 +0000 (11:57 +1000)]
Fix some tests that didn't hold lock while deferring actions

4 weeks agogorond
Matt Joiner [Wed, 13 Aug 2025 01:57:03 +0000 (11:57 +1000)]
gorond

4 weeks agoFix some lints
Matt Joiner [Wed, 13 Aug 2025 01:56:43 +0000 (11:56 +1000)]
Fix some lints

4 weeks agoRework existing webseed requests for unique slice indexes
Matt Joiner [Wed, 13 Aug 2025 01:42:12 +0000 (11:42 +1000)]
Rework existing webseed requests for unique slice indexes

4 weeks agoTry harder to pass useful error on webseed read chunks cancellation
Matt Joiner [Tue, 12 Aug 2025 14:32:59 +0000 (00:32 +1000)]
Try harder to pass useful error on webseed read chunks cancellation

4 weeks agoWait 1-2 mins between failed metainfo fetches
Matt Joiner [Tue, 12 Aug 2025 14:31:09 +0000 (00:31 +1000)]
Wait 1-2 mins between failed metainfo fetches

4 weeks agoUse ignorePieceForRequests instead of shady pending pieces
Matt Joiner [Tue, 12 Aug 2025 14:28:21 +0000 (00:28 +1000)]
Use ignorePieceForRequests instead of shady pending pieces

4 weeks agoAdd mmap alternative IO system for file storage
Matt Joiner [Tue, 12 Aug 2025 14:27:26 +0000 (00:27 +1000)]
Add mmap alternative IO system for file storage

4 weeks agoAllow args to just test
Matt Joiner [Tue, 12 Aug 2025 14:26:17 +0000 (00:26 +1000)]
Allow args to just test

4 weeks agoDon't assign DisallowData* being assigned in Torrent.MergeSpec
Matt Joiner [Tue, 12 Aug 2025 13:40:59 +0000 (23:40 +1000)]
Don't assign DisallowData* being assigned in Torrent.MergeSpec

This was masking an ancient bug in SetInfoBytes, and AllowDataDownload!

4 weeks agoFix AllowDataDownload not triggering piece request state
Matt Joiner [Tue, 12 Aug 2025 13:31:18 +0000 (23:31 +1000)]
Fix AllowDataDownload not triggering piece request state

4 weeks agoAdd checks that defers only occur on write locks
Matt Joiner [Tue, 12 Aug 2025 13:29:42 +0000 (23:29 +1000)]
Add checks that defers only occur on write locks

4 weeks agoAdd MetainfoSourcesMerger
Matt Joiner [Tue, 12 Aug 2025 13:27:36 +0000 (23:27 +1000)]
Add MetainfoSourcesMerger

5 weeks agoBreak out file IO abstraction
Matt Joiner [Mon, 11 Aug 2025 06:09:47 +0000 (16:09 +1000)]
Break out file IO abstraction

5 weeks agoDon't panic on non-zero chunk sizes in Client.AddTorrentSpec
Matt Joiner [Mon, 11 Aug 2025 01:19:13 +0000 (11:19 +1000)]
Don't panic on non-zero chunk sizes in Client.AddTorrentSpec

5 weeks agoFix build on Windows
Matt Joiner [Fri, 8 Aug 2025 03:29:22 +0000 (13:29 +1000)]
Fix build on Windows

5 weeks agoMove assertion back to proper place
Matt Joiner [Fri, 8 Aug 2025 02:09:23 +0000 (12:09 +1000)]
Move assertion back to proper place

5 weeks agoImprove webseed part request log message for identifying cache boundaries
Matt Joiner [Thu, 7 Aug 2025 05:48:30 +0000 (15:48 +1000)]
Improve webseed part request log message for identifying cache boundaries

5 weeks agoTODO on stat atomics being out of sync
Matt Joiner [Thu, 7 Aug 2025 05:48:06 +0000 (15:48 +1000)]
TODO on stat atomics being out of sync

5 weeks agoConvert cmd/torrent2 to bargle/v2
Matt Joiner [Thu, 7 Aug 2025 05:47:44 +0000 (15:47 +1000)]
Convert cmd/torrent2 to bargle/v2

5 weeks agoLower webseed read chunks log level when peer is closed
Matt Joiner [Wed, 6 Aug 2025 12:56:36 +0000 (22:56 +1000)]
Lower webseed read chunks log level when peer is closed

5 weeks agoFix proposed and existing cancelled webseed requests colliding in priority heap
Matt Joiner [Wed, 6 Aug 2025 10:36:29 +0000 (20:36 +1000)]
Fix proposed and existing cancelled webseed requests colliding in priority heap

5 weeks agoClear pprof labels in spawned webseed requests
Matt Joiner [Wed, 6 Aug 2025 10:34:56 +0000 (20:34 +1000)]
Clear pprof labels in spawned webseed requests

5 weeks agoProbably fix a nasty buffer size performance issue with rate limited readers
Matt Joiner [Wed, 6 Aug 2025 10:34:40 +0000 (20:34 +1000)]
Probably fix a nasty buffer size performance issue with rate limited readers

5 weeks agoSkip download rate limited reader wrapping if DownloadRateLimiter is nil
Matt Joiner [Wed, 6 Aug 2025 10:34:08 +0000 (20:34 +1000)]
Skip download rate limited reader wrapping if DownloadRateLimiter is nil

5 weeks agoFix new warning in piece hashing due to new file piece WriteTo
Matt Joiner [Wed, 6 Aug 2025 10:25:27 +0000 (20:25 +1000)]
Fix new warning in piece hashing due to new file piece WriteTo

5 weeks agoFix Torrent.close race in test
Matt Joiner [Wed, 6 Aug 2025 10:22:01 +0000 (20:22 +1000)]
Fix Torrent.close race in test

5 weeks agoSupport setting the Type-Of-Service field to 'throughput' for sockets (#1017)
Victor [Tue, 5 Aug 2025 16:20:08 +0000 (19:20 +0300)]
Support setting the Type-Of-Service field to 'throughput' for sockets (#1017)

5 weeks agoFix chansync dep
Matt Joiner [Tue, 5 Aug 2025 14:42:29 +0000 (00:42 +1000)]
Fix chansync dep

5 weeks agoTry to show context cancellation cause after io.ReadFull
Matt Joiner [Tue, 5 Aug 2025 14:00:32 +0000 (00:00 +1000)]
Try to show context cancellation cause after io.ReadFull

5 weeks agoSort webseed request heap deterministically
Matt Joiner [Tue, 5 Aug 2025 13:59:44 +0000 (23:59 +1000)]
Sort webseed request heap deterministically

5 weeks agoCode comments
Matt Joiner [Tue, 5 Aug 2025 12:52:10 +0000 (22:52 +1000)]
Code comments

5 weeks agoRemove debug log showing up in profiling
Matt Joiner [Tue, 5 Aug 2025 12:51:53 +0000 (22:51 +1000)]
Remove debug log showing up in profiling

5 weeks agoPedantic optimization of Torrent.AllowDataDownload and AllowDataUpload
Matt Joiner [Tue, 5 Aug 2025 12:51:28 +0000 (22:51 +1000)]
Pedantic optimization of Torrent.AllowDataDownload and AllowDataUpload

5 weeks agoSet cached piece completion directly on piece hashed
Matt Joiner [Tue, 5 Aug 2025 12:50:08 +0000 (22:50 +1000)]
Set cached piece completion directly on piece hashed

5 weeks agoFix premature return from GetRequestablePieces iterator
Matt Joiner [Tue, 5 Aug 2025 12:45:56 +0000 (22:45 +1000)]
Fix premature return from GetRequestablePieces iterator

Was missed in earlier refactor

5 weeks agoSimplify part file promotion and demotion
Matt Joiner [Tue, 5 Aug 2025 12:45:13 +0000 (22:45 +1000)]
Simplify part file promotion and demotion

5 weeks agoReplace nasty SI file size prefix
Matt Joiner [Tue, 5 Aug 2025 12:43:41 +0000 (22:43 +1000)]
Replace nasty SI file size prefix

5 weeks agoPropagate better webseed cancellation errors and cancel requests on peer context
Matt Joiner [Tue, 5 Aug 2025 12:42:59 +0000 (22:42 +1000)]
Propagate better webseed cancellation errors and cancel requests on peer context

5 weeks agoFix pointless double open on unhandled open for write errors
Matt Joiner [Tue, 5 Aug 2025 12:41:13 +0000 (22:41 +1000)]
Fix pointless double open on unhandled open for write errors

5 weeks agoExpose TORRENT_WEBSEED_REQUEST_CHUNK_SIZE
Matt Joiner [Tue, 5 Aug 2025 12:40:18 +0000 (22:40 +1000)]
Expose TORRENT_WEBSEED_REQUEST_CHUNK_SIZE

5 weeks agoFix very rare double Torrent close panic
Matt Joiner [Tue, 5 Aug 2025 12:38:40 +0000 (22:38 +1000)]
Fix very rare double Torrent close panic

5 weeks agoExtract webseed end request calculation and avoid bug for now
Matt Joiner [Tue, 5 Aug 2025 10:02:18 +0000 (20:02 +1000)]
Extract webseed end request calculation and avoid bug for now

5 weeks agoMake webseedUrlKey more ergonomic to use
Matt Joiner [Tue, 5 Aug 2025 10:01:13 +0000 (20:01 +1000)]
Make webseedUrlKey more ergonomic to use

5 weeks agoEnsure Torrent.pieceCompletionChanged always runs on piece init
Matt Joiner [Tue, 5 Aug 2025 09:59:32 +0000 (19:59 +1000)]
Ensure Torrent.pieceCompletionChanged always runs on piece init

5 weeks agoIgnore pieces with unknown completion for requests
Matt Joiner [Tue, 5 Aug 2025 09:56:39 +0000 (19:56 +1000)]
Ignore pieces with unknown completion for requests

5 weeks agoSet deferred unique actions map to nil rather than clear
Matt Joiner [Tue, 5 Aug 2025 09:55:16 +0000 (19:55 +1000)]
Set deferred unique actions map to nil rather than clear

5 weeks agoAdd TORRENT_MAX_ACTIVE_PIECE_HASHERS
Matt Joiner [Tue, 5 Aug 2025 09:54:51 +0000 (19:54 +1000)]
Add TORRENT_MAX_ACTIVE_PIECE_HASHERS

5 weeks agoExtra pedantry in chunkIndexSpec
Matt Joiner [Tue, 5 Aug 2025 05:49:34 +0000 (15:49 +1000)]
Extra pedantry in chunkIndexSpec

5 weeks agoAdd request-strategy.Btree.Contains
Matt Joiner [Tue, 5 Aug 2025 05:49:09 +0000 (15:49 +1000)]
Add request-strategy.Btree.Contains

We'll need it later when we use piece request order instead of Torrent._pendingPieces.

5 weeks agoConvert GetRequestablePieces to an iterator
Matt Joiner [Tue, 5 Aug 2025 02:32:30 +0000 (12:32 +1000)]
Convert GetRequestablePieces to an iterator

5 weeks agoFix panic in piece request order length status
Matt Joiner [Tue, 5 Aug 2025 02:30:40 +0000 (12:30 +1000)]
Fix panic in piece request order length status

5 weeks agoUse unique.Handle for webseedUrlKey
Matt Joiner [Mon, 4 Aug 2025 23:55:05 +0000 (09:55 +1000)]
Use unique.Handle for webseedUrlKey

Should greatly improve apriori map lookup performance.

5 weeks agoInclude webseed update reason and some extra debug stuff
Matt Joiner [Mon, 4 Aug 2025 12:15:41 +0000 (22:15 +1000)]
Include webseed update reason and some extra debug stuff

6 weeks agoInclude CF-Cache-Status in webseed debug
Matt Joiner [Mon, 4 Aug 2025 10:27:59 +0000 (20:27 +1000)]
Include CF-Cache-Status in webseed debug

6 weeks agoTons of webseed optimizations
Matt Joiner [Fri, 1 Aug 2025 13:51:28 +0000 (23:51 +1000)]
Tons of webseed optimizations

Avoid extra allocation in firstDirtyChunk
Allow multiple requests per file (now called slices or webseed chunks)
Reduce many allocations and extra work in webseed heap ordering
Add webseed request update pprof labels
Use a larger buffer for copying webseed response parts

6 weeks agoSwitch segments to use iterators
Matt Joiner [Fri, 1 Aug 2025 08:20:13 +0000 (18:20 +1000)]
Switch segments to use iterators

Trying to reduce allocations

6 weeks agoSwitch to segments.Index.LocateIter everywhere
Matt Joiner [Fri, 1 Aug 2025 06:11:50 +0000 (16:11 +1000)]
Switch to segments.Index.LocateIter everywhere

6 weeks agoAvoid Iterator allocation
Matt Joiner [Fri, 1 Aug 2025 05:51:52 +0000 (15:51 +1000)]
Avoid Iterator allocation

6 weeks agoUse unique.Handle for piece order infohashes
Matt Joiner [Fri, 1 Aug 2025 03:38:51 +0000 (13:38 +1000)]
Use unique.Handle for piece order infohashes

6 weeks agoMake Client.Close more responsive
Matt Joiner [Fri, 1 Aug 2025 03:04:30 +0000 (13:04 +1000)]
Make Client.Close more responsive

Stop updating webseed requests ASAP.
Set the Client closed event outside of the Client lock.
Make Client initialization more consistent for Close.

6 weeks agogorond
Matt Joiner [Thu, 31 Jul 2025 13:18:44 +0000 (23:18 +1000)]
gorond

6 weeks agoUpdate missinggo/v2 to fix stm test errors
Matt Joiner [Thu, 31 Jul 2025 13:18:33 +0000 (23:18 +1000)]
Update missinggo/v2 to fix stm test errors

6 weeks agoTruncate webseed requests to response body cache boundaries
Matt Joiner [Thu, 31 Jul 2025 01:54:39 +0000 (11:54 +1000)]
Truncate webseed requests to response body cache boundaries

6 weeks agoRejigger the webseed debug logging
Matt Joiner [Thu, 31 Jul 2025 01:54:06 +0000 (11:54 +1000)]
Rejigger the webseed debug logging

6 weeks agoPrevent webseed requests when torrent data download disallowed
Matt Joiner [Thu, 31 Jul 2025 01:52:19 +0000 (11:52 +1000)]
Prevent webseed requests when torrent data download disallowed

6 weeks agoTidy
Matt Joiner [Thu, 31 Jul 2025 01:50:52 +0000 (11:50 +1000)]
Tidy

6 weeks agoDrop torrents on Client.Close not just close them
Matt Joiner [Thu, 31 Jul 2025 01:49:14 +0000 (11:49 +1000)]
Drop torrents on Client.Close not just close them

6 weeks agoAdd separate MetainfoSourcesClient
Matt Joiner [Thu, 31 Jul 2025 01:16:27 +0000 (11:16 +1000)]
Add separate MetainfoSourcesClient

6 weeks agoExpose TORRENT_WEBSEED_HOST_REQUEST_CONCURRENCY
Matt Joiner [Wed, 30 Jul 2025 07:47:31 +0000 (17:47 +1000)]
Expose TORRENT_WEBSEED_HOST_REQUEST_CONCURRENCY

6 weeks agoAggregate connection stats by peer implementation
Matt Joiner [Wed, 30 Jul 2025 07:46:57 +0000 (17:46 +1000)]
Aggregate connection stats by peer implementation

6 weeks agoFix panicif.Nil not working correctly
Matt Joiner [Tue, 29 Jul 2025 04:03:48 +0000 (14:03 +1000)]
Fix panicif.Nil not working correctly