Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Problem getting magnet metadata on large files #888

Open
sbs1990 opened this issue Jan 9, 2024 · 6 comments
Open

Problem getting magnet metadata on large files #888

sbs1990 opened this issue Jan 9, 2024 · 6 comments

Comments

@sbs1990
Copy link

sbs1990 commented Jan 9, 2024

I use the utility https://github.com/fbdtemme/torrenttools under Ubuntu Linux to create torrent files.

Example launch for creating a torrent:

$ ls -l t/
total 16188932
-rw-rw-r-- 1 sbs sbs 16577458723 jan  9 11:22 Taxi.Driver.1976.1080p.BluRay.DTS.x264-EbP.mkv


/opt/torrentools/torrenttools create "t" --include ".*t/Taxi.Driver.1976.1080p.BluRay.DTS.x264-EbP.mkv" --piece-size 16M --announce "http://192.168.1.100:2710/announce" --output taxi-diver.torrent

For seeding I use rtorrent v0.9.8-r16 https://github.com/jesec/rtorrent

Problem:
For files of about 15GB or more size, projects using the anacrolix/torrent library cannot receive magnet metadata when adding content via magnet URL.
I tested with https://github.com/YouROK/TorrServer and https://github.com/anacrolix/confluence

If i run the torrent file, there is no problem.

Another client, qBittorrent, receives metadata without any problems.

Traffic dump examples:
anacrolix - https://drive.google.com/file/d/1cYpwLi7oVZbwbjTEdX0qGUFa3BJufIfb/view?usp=sharing
qBittorrent - https://drive.google.com/file/d/1pL02zladqigEyOfGVJGApNAAQZGM3Cab/view?usp=sharing

@anacrolix
Copy link
Owner

A quick guess this is likely the check that the torrent info is not too large. I think anacrolix/torrent rejects infos larger than 10MB or so but it should be configurable.

Can you provide the magnet links?

@sbs1990
Copy link
Author

sbs1990 commented Jan 10, 2024

Magnet link - magnet:?xt=urn:btih:a5462fdae73e6feae7a88febc28279159073240f&dn=t&tr=http%3A%2F%2F109.126.53.58%3A6969%2Fannounce

@anacrolix
Copy link
Owner

torrent/global.go

Lines 14 to 19 in c202126

// Arbitrary maximum of "metadata_size" (see https://www.bittorrent.org/beps/bep_0009.html)
// libtorrent-rasterbar uses 4MiB at last check. TODO: Add links to values used by other
// implementations here. I saw 14143527 in the metainfo for
// 3597f16e239aeb8f8524a1a1c4e4725a0a96b470. Large values for legitimate torrents should be
// recorded here for consideration.
maxMetadataSize uint32 = 16 * 1024 * 1024

I had no luck finding any peers for the provided magnet link. Perhaps you could share the metainfo, or a more popular torrent instead?

@sbs1990
Copy link
Author

sbs1990 commented Jan 14, 2024

I can share torrent file - http://109.126.53.58/taxi-16.torrent

@anacrolix
Copy link
Owner

Sorry, a public torrent is required. There's no point testing against a torrent with no other peers.

@sbs1990
Copy link
Author

sbs1990 commented Jan 14, 2024

I apologize, perhaps I initially asked the question incorrectly.

In my case, I'm creating a torrent on my local network.
I am the first seeder.

The first client that start seeding the torrent is rtorrent.
And TorrServer cannot get metadata from it (rtorrent), if file size is about 15GB.
There are no problems with small files.

There are also NO problems with large PUBLIC torrents.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants