Post Reply 
 
Thread Rating:
  • 0 Votes - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
display rescan duration
03-04-2017, 17:15
Post: #1
display rescan duration
My library is >1tb and I have no good grasp on how long rescans take.
Is there a possibility to view the duration of a rescan easily?
Find all posts by this user
Quote this message in a reply
03-04-2017, 17:41
Post: #2
RE: display rescan duration
This depends on the speed of the computer or NAS that you are using to run MinimServer and the speed of the disk on which your library is held.

The first scan takes longer because MinimServer is building a cache that it uses to make subsequent scans go quicker.

I would expect it to take less than 5 minutes to scan 1 TB if not much has changed from the previous scan.
Find all posts by this user
Quote this message in a reply
28-08-2017, 22:22
Post: #3
RE: display rescan duration
Seeing very long rescans - an hour at least even if adding only one album. The library is about 1tb and 10k albums on a Synology 212j with 2tb Seagates. Perhaps the NAS is to slow? Any suggestions how to get a better grasp on the situation are welcome. Thx!
Find all posts by this user
Quote this message in a reply
28-08-2017, 22:39
Post: #4
RE: display rescan duration
This is a slow NAS and a large library but even so, an hour seems too long. What is your setting for the startupScan property?
Find all posts by this user
Quote this message in a reply
29-08-2017, 08:03
Post: #5
RE: display rescan duration
(28-08-2017 22:39)simoncn Wrote:  This is a slow NAS and a large library but even so, an hour seems too long. What is your setting for the startupScan property?

Thx Simon,

startupScan = true

Minimserver restarts every night at 4:15. I usually add new albums in the evening and its all there the next day. Occasionally I want to add a new album and get to listening right away and that's when long rescan durations get in the way.

Minimserver 0.8.4.2 update 104 and DSM 6.0.2-8451 Update 6. I so far did not update to 6.1 since users reported issues outside of Minimserver. The system is airgapped anyways and runs nothing but Minimserver.
Find all posts by this user
Quote this message in a reply
29-08-2017, 10:02 (This post was last modified: 29-08-2017 10:03 by simoncn.)
Post: #6
RE: display rescan duration
Your startupScan setting is correct and doesn't explain the very long rescan time.

Please try the following:

1) On the System tab of the Properties window, set the .logPrefix property to milliTime
2) In the log window, set the logging level to Verbose
3) In the log window, click Clear
4) Leave the log widow open and do a rescan

You will see a timestamp in the log window for each rescanned folder. How long approximately does each folder take? On my QNAP TS119 (should be the same speed as your NAS), I am seeing an average time of about 50ms per folder (20 folders per second).
Find all posts by this user
Quote this message in a reply
01-09-2017, 15:11
Post: #7
RE: display rescan duration
Numbers are fluctuating widely, sometimes up to 10 folders/sec, but often 2-3. Here's a snippet of the log:

16:43:32.687 Scanning directory Sun Ship
16:43:33.044 Scanning directory The Complete 1961 Village Vanguard Recordings (Disc 3)
16:43:33.093 Scanning directory The Complete 1961 Village Vanguard Recordings (Disc 4 of 4)
16:43:33.366 Scanning directory The Major Works of John Coltrane
16:43:33.717 Scanning directory Transition
16:43:34.069 Scanning directory Giant Steps (Japanese 24 Bit Remaster)
16:43:34.408 Scanning directory Boards of Canada
16:43:34.420 Scanning directory A Few Old Tunes Vol. 2
16:43:36.174 Scanning directory Aquarius 7_
16:43:36.216 Scanning directory Boards of Canada
16:43:36.636 Scanning directory Boc Maxima
16:43:37.829 Scanning directory Demo Tape
16:43:38.574 Scanning directory Geogaddi
16:43:39.788 Scanning directory Hi Scores (EP)
16:43:40.126 Scanning directory In a Beautiful Place Out in the Country
16:43:40.453 Scanning directory music has the right to children
16:43:41.317 Scanning directory Peel Sessions
16:43:41.642 Scanning directory Rarieties and Remixes
16:43:42.264 Scanning directory telephasic workshop
16:43:42.346 Scanning directory The Campfire Headphase
16:43:43.184 Scanning directory Tomorrow's Harvest
16:43:43.743 Scanning directory Twoism
16:43:44.164 Scanning directory Christoph De Babalon
16:43:44.173 Scanning directory Scylla & Charybdis
16:43:44.257 Scanning directory Ott
Find all posts by this user
Quote this message in a reply
01-09-2017, 21:51
Post: #8
RE: display rescan duration
Please post a list of the contents of "A Few Old Tunes Vol. 2" (takes 1.75 seconds to scan) and "Boards of Canada" (takes 0.01 seconds to scan). This will enable me to see if there is something in the folder contents that is causing the difference.

Are the elapsed time numbers that you posted consistent if you do another rescan?

Do the folders with a long rescan time produce any error or warning messages in the MinimServer log?
Find all posts by this user
Quote this message in a reply
04-09-2017, 09:51
Post: #9
RE: display rescan duration
The numbers stay fairly consistent. No error warnings on these particular folders, but on some others - see below.

As for the contents of the "A Few Old Tunes Vol. 2" and "Boards of Canada" (the second one on the list) folders:

"A Few Old Tunes Vol. 2":

01 Solarium.mp3
02 Sequoia.mp3
03 Boqurant.mp3
04 5-9-78.mp3
05 Statue of Liberty.mp3
06 Finity.mp3
07 Forest Moon.mp3
08 Devil.mp3
09 Mansel.mp3
10 She is P.mp3
11 Davie Addison.mp3
12 On A Rolling Sea.mp3
13 Iced Cooly Beatnik.mp3
14 To the Wind.mp3
15 Magic Teens.mp3
16 Apparatus.mp3
17 Music for Pylons.mp3
19 Northern Plastics.mp3
20 Dave (I'm A Real Traditionalis.mp3
21 Sir Prancelot Brainfire.mp3
22 Fly in the Pool.mp3
23 Mukinabaht.mp3
24 Kiteracer 2.mp3
25 Buckie High.mp3
26 I Love My New Shears.mp3
28 Blockbusters.mp3
29 I Will Get it Tattooed.mp3
30 Up the March Bank.mp3
33 House of Adin'adab.mp3

"Boards of Canada":

everything you do is a balloon.mp3
Happy Cycling.mp3
hi scores.mp3
june 9th.mp3
nlogax.mp3
seeya later.mp3
turquoise hexagon sun.mp3

Here is another snipped of today's log with some error messages:

05:19:57.741 Scanning directory Out From Out Where
05:19:57.781 Warning: unexpected image item class 0 at offset 5604885 in file iTunes Perceps/iTunes Media/Music/Amon Tobin/Out From Out Where/02 Verbal.mp4 (length 5606066)
05:19:57.826 Warning: unexpected image item class 0 at offset 8867441 in file iTunes Perceps/iTunes Media/Music/Amon Tobin/Out From Out Where/03 Chronic Tronic.mp4 (length 8868622)
05:19:57.884 Warning: unexpected image item class 0 at offset 8760534 in file iTunes Perceps/iTunes Media/Music/Amon Tobin/Out From Out Where/04 Searchers.mp4 (length 8761715)
05:19:57.909 Warning: unexpected image item class 0 at offset 6834324 in file iTunes Perceps/iTunes Media/Music/Amon Tobin/Out From Out Where/05 Hey Blondie.mp4 (length 6835505)
05:19:57.963 Warning: unexpected image item class 0 at offset 8299937 in file iTunes Perceps/iTunes Media/Music/Amon Tobin/Out From Out Where/06 Rosies.mp4 (length 8301118)
05:19:57.987 Warning: unexpected image item class 0 at offset 6449401 in file iTunes Perceps/iTunes Media/Music/Amon Tobin/Out From Out Where/07 Cosmo Retro Intro Outro.mp4 (length 6450582)
05:19:57.999 Warning: unexpected image item class 0 at offset 7703041 in file iTunes Perceps/iTunes Media/Music/Amon Tobin/Out From Out Where/08 Triple Science.mp4 (length 7704223)
05:19:58.040 Warning: unexpected image item class 0 at offset 9032221 in file iTunes Perceps/iTunes Media/Music/Amon Tobin/Out From Out Where/09 El Wraith.mp4 (length 9033402)
05:19:58.065 Warning: unexpected image item class 0 at offset 8266159 in file iTunes Perceps/iTunes Media/Music/Amon Tobin/Out From Out Where/10 Proper Hoodidge.mp4 (length 8267340)
05:19:58.079 Warning: unexpected image item class 0 at offset 8567105 in file iTunes Perceps/iTunes Media/Music/Amon Tobin/Out From Out Where/11 Mighty Micro People.mp4 (length 8568286)
05:19:58.082 Scanning directory Permutation
05:19:58.816 Scanning directory Supermodified
05:19:58.851 Warning: unexpected image item class 0 at offset 6263141 in file iTunes Perceps/iTunes Media/Music/Amon Tobin/Supermodified/01 Get Your Snack On.mp4 (length 6264314)
05:19:58.870 Warning: unexpected image item class 0 at offset 6749671 in file iTunes Perceps/iTunes Media/Music/Amon Tobin/Supermodified/02 Four Ton Mantis.mp4 (length 6750844)
05:19:58.897 Warning: unexpected image item class 0 at offset 8258267 in file iTunes Perceps/iTunes Media/Music/Amon Tobin/Supermodified/03 Slowly.mp4 (length 8259440)
05:19:58.948 Warning: unexpected image item class 0 at offset 8934026 in file iTunes Perceps/iTunes Media/Music/Amon Tobin/Supermodified/04 Marine Machines.mp4 (length 8935199)
05:19:58.960 Warning: unexpected image item class 0 at offset 9629271 in file iTunes Perceps/iTunes Media/Music/Amon Tobin/Supermodified/05 Golfer vrs Boxer.mp4 (length 9630444)
05:19:58.966 Warning: unexpected image item class 0 at offset 8829129 in file iTunes Perceps/iTunes Media/Music/Amon Tobin/Supermodified/06 Deo.mp4 (length 8830302)
05:19:58.990 Warning: unexpected image item class 0 at offset 7116679 in file iTunes Perceps/iTunes Media/Music/Amon Tobin/Supermodified/07 Precursor (featuring Quadraceptor).mp4 (length 7117852)
05:19:59.008 Warning: unexpected image item class 0 at offset 8128028 in file iTunes Perceps/iTunes Media/Music/Amon Tobin/Supermodified/08 Saboteur.mp4 (length 8129201)
05:19:59.062 Warning: unexpected image item class 0 at offset 8724710 in file iTunes Perceps/iTunes Media/Music/Amon Tobin/Supermodified/09 Chocolate Lovely.mp4 (length 8725883)
05:19:59.077 Warning: unexpected image item class 0 at offset 10522983 in file iTunes Perceps/iTunes Media/Music/Amon Tobin/Supermodified/10 Rhino Jockey.mp4 (length 10524156)
05:19:59.140 Warning: unexpected image item class 0 at offset 8806059 in file iTunes Perceps/iTunes Media/Music/Amon Tobin/Supermodified/12 Natureland.mp4 (length 8807232)
05:19:59.155 Scanning directory Chilly Uptown

Thx!
Find all posts by this user
Quote this message in a reply
04-09-2017, 11:31
Post: #10
RE: display rescan duration
The 'image item class 0' warning is a different issue but I would like to fix it. Can you upload one of these mp4 files to my FTP server? I will send you a PM with instructions.

The long rescan for the mp3 folder is puzzling me. There is nothing in the folder contents that would explain a long rescan time if the contents haven't changed. I wonder if you are close to the RAM limit of 256 MB on your NAS and getting into memory/disk paging which would make things much slower. Can you use Resource Monitor in DSM to check the RAM and CPU usage during a rescan?
Find all posts by this user
Quote this message in a reply
Post Reply 


Forum Jump:


User(s) browsing this thread: 1 Guest(s)