Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
choosing file system to a seedbox
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Gentoo Chat
View previous topic :: View next topic  
Author Message
simonbcn
n00b
n00b


Joined: 01 Aug 2011
Posts: 63
Location: Terrassa, Barcelona, Spain

PostPosted: Thu Dec 31, 2015 9:31 am    Post subject: choosing file system to a seedbox Reply with quote

I going to install Gentoo in a server to use like seedbox (torrent and FTP will be the main services). I've thought in use ext4 to root system and the other disks (2) with LVM2/XFS. The main problem is the fragmentation and the speed in read/write data to/from discs where the files are downloaded. Is XFS the best option?
Back to top
View user's profile Send private message
eccerr0r
Watchman
Watchman


Joined: 01 Jul 2004
Posts: 5711
Location: almost Mile High in the USA

PostPosted: Thu Dec 31, 2015 4:14 pm    Post subject: Reply with quote

All filesystems can fragment if you give it a bad allocation order, and bittorrent is about the worst real world example.

If you completely preallocate the files (and not sparse file allocate), fragmentation won't be a problem. Some torrent applications can make an intermediate file and rebuild the file after all chunks are received, this also helps against fragmentation. You can tell this if you see the client writing out the file again and using double disk space temporarily after a download.

Rtorrent by default will fragment your downloads readily - you'll see it at most just do a full file hash check but not rewrite the file. I don't know about Transmission, etc.
_________________
Intel Core i7 2700K@ 4.1GHz/HD3000 graphics/8GB DDR3/180GB SSD
What am I supposed watching?
Back to top
View user's profile Send private message
Naib
Advocate
Advocate


Joined: 21 May 2004
Posts: 4921
Location: Removed by Neddy

PostPosted: Thu Dec 31, 2015 4:20 pm    Post subject: Reply with quote

Some bittorrent clients can "preallocate" to mitigate too much corruption
_________________
The best argument against democracy is a five-minute conversation with the average voter
Great Britain is a republic, with a hereditary president, while the United States is a monarchy with an elective king
Back to top
View user's profile Send private message
szatox
Veteran
Veteran


Joined: 27 Aug 2013
Posts: 1350

PostPosted: Thu Dec 31, 2015 7:04 pm    Post subject: Reply with quote

Well, if you're worried about fragmentation, you can consider triggering "shake" every now and then. That's what cron is for :roll:
Back to top
View user's profile Send private message
simonbcn
n00b
n00b


Joined: 01 Aug 2011
Posts: 63
Location: Terrassa, Barcelona, Spain

PostPosted: Thu Dec 31, 2015 7:16 pm    Post subject: Reply with quote

I'll use Transmission. It's a good client torrent and it has preallocation.
Back to top
View user's profile Send private message
eccerr0r
Watchman
Watchman


Joined: 01 Jul 2004
Posts: 5711
Location: almost Mile High in the USA

PostPosted: Thu Dec 31, 2015 8:31 pm    Post subject: Reply with quote

There's an option to fallocate in rtorrent, but you'll need a filesystem that supports fallocate and is Linux specific.

I forgot which bittorrent client I used in the past that downloaded everything into a temporary file, and rewrite the file once all chunks are received. This method has the advantage of quick hash checks of incomplete downloads, no slow file creation on startup, as well as not having to have all disk space available upon startup - just like sparse file allocation. However this does require times again the amount of diskspace free at download completion, and having an extent based filesystem is a must if you're downloading more than one torrent at a time.

Anyway, http://vleu.net/shake/ is indeed a workaround... Make sure you have plenty of extra space and backup. I was planning to write something like that, but I guess I won't need to anymore, alas, I don't fragment my hard disks enough to need it.
_________________
Intel Core i7 2700K@ 4.1GHz/HD3000 graphics/8GB DDR3/180GB SSD
What am I supposed watching?
Back to top
View user's profile Send private message
Naib
Advocate
Advocate


Joined: 21 May 2004
Posts: 4921
Location: Removed by Neddy

PostPosted: Thu Dec 31, 2015 8:52 pm    Post subject: Reply with quote

NOTE if the drive is ssd... don't worry
_________________
The best argument against democracy is a five-minute conversation with the average voter
Great Britain is a republic, with a hereditary president, while the United States is a monarchy with an elective king
Back to top
View user's profile Send private message
P.Kosunen
Tux's lil' helper
Tux's lil' helper


Joined: 21 Nov 2005
Posts: 134
Location: Finland

PostPosted: Mon Jan 04, 2016 5:02 pm    Post subject: Reply with quote

What kind of hardware is it running on and how fast is network?

I would go with ext4 almost in any case, never had any problems with it.
Back to top
View user's profile Send private message
eccerr0r
Watchman
Watchman


Joined: 01 Jul 2004
Posts: 5711
Location: almost Mile High in the USA

PostPosted: Mon Jan 04, 2016 11:06 pm    Post subject: Reply with quote

P.Kosunen, what BT client do you use, and do you preallocate?
_________________
Intel Core i7 2700K@ 4.1GHz/HD3000 graphics/8GB DDR3/180GB SSD
What am I supposed watching?
Back to top
View user's profile Send private message
P.Kosunen
Tux's lil' helper
Tux's lil' helper


Joined: 21 Nov 2005
Posts: 134
Location: Finland

PostPosted: Tue Jan 05, 2016 12:08 pm    Post subject: Reply with quote

Transmission and yes preallocate.
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Gentoo Chat All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum