brunob - Project Hosting on Google Code

User Profile		Updates

Older Nov 02, 2009 chromium issue 25336 (Safe browsing updates should be throttled) commented on - I saw this problem on Windows. For the original report, it was thrashing for an hour but I'm not clear on the "thrash share" of Chrome compared to the virus scan for example. I'll get a better number next time. Here's the SB internal numbers: Histogram: SB.QueueDepth recorded 1 samples, average = 0.0, standard deviation = 0.0 0 ------------------------------------------------------------------------O (1 = 100.0%) 1 ... Histogram: SB2.AddPrefixes recorded 8 samples, average = 811701.8, standard deviation = 126.9 (flags = 0x1) 0 ... 759255 ------------------------------------------------------------------------O (8 = 100.0%) {0.0%} 1000000 O (0 = 0.0%) {100.0%} Histogram: SB2.BuildFilter recorded 8 samples, average = 37771.3, standard deviation = 31100.0 (flags = 0x1) 0 ... 8289 ------------------------------------------------------------------------O (2 = 25.0%) {0.0%} 11230 ------------------------------------O (1 = 12.5%) {25.0%} 15215 O (0 = 0.0%) {37.5%} 20614 ------------------------------------------------------------------------O (2 = 25.0%) {37.5%} 27929 O (0 = 0.0%) {62.5%} 37840 ------------------------------------O (1 = 12.5%) {62.5%} 51267 ------------------------------------O (1 = 12.5%) {75.0%} 69459 O (0 = 0.0%) {87.5%} 94106 ------------------------------------O (1 = 12.5%) {87.5%} 127499 ... Histogram: SB2.BuildReadBytes recorded 8 samples, average = 50397058.4, standard deviation = 116878.4 (flags = 0x1) 0 ... 1000000 ------------------------------------------------------------------------O (8 = 100.0%) {0.0%} Histogram: SB2.BuildReadOperations recorded 8 samples, average = 50546.4, standard deviation = 3127.0 (flags = 0x1) 0 ... 48336 ------------------------------------------------------------------------O (8 = 100.0%) {0.0%} 63662 ... Histogram: SB2.BuildWriteBytes recorded 8 samples, average = 41038247.3, standard deviation = 3061309.4 (flags = 0x1) 0 ... 1000000 ------------------------------------------------------------------------O (8 = 100.0%) {0.0%} Histogram: SB2.BuildWriteOperations recorded 8 samples, average = 64998.6, standard deviation = 5293.7 (flags = 0x1) 0 ... 48336 ------------------------------------------------------------------------O (7 = 87.5%) {0.0%} 63662 ----------O (1 = 12.5%) {87.5%} 83848 ... Histogram: SB2.ChunkInsert recorded 25 samples, average = 32.0, standard deviation = 71.6 (flags = 0x1) 0 --------------------------------O (4 = 16.0%) 1 ------------------------------------------------------------------------O (9 = 36.0%) {16.0%} 2 ------------------------O (3 = 12.0%) {52.0%} 3 ... 24 ---O (2 = 8.0%) {64.0%} 29 --O (1 = 4.0%) {72.0%} 34 --O (1 = 4.0%) {76.0%} 40 O (0 = 0.0%) {80.0%} 48 --O (1 = 4.0%) {80.0%} 57 --O (1 = 4.0%) {84.0%} 68 --O (1 = 4.0%) {88.0%} 81 ... 114 --O (1 = 4.0%) {92.0%} 135 ... 318 --O (1 = 4.0%) {96.0%} 378 ... Histogram: SB2.ChunkRequest recorded 25 samples, average = 166.8, standard deviation = 174.8 (flags = 0x1) 0 ... 2 ------------------------O (2 = 8.0%) {0.0%} 3 ------------------------------------------------------------------------O (6 = 24.0%) {8.0%} 4 ------------O (1 = 4.0%) {32.0%} 5 ------------O (1 = 4.0%) {36.0%} 6 ------------O (1 = 4.0%) {40.0%} 7 ... 17 ----O (1 = 4.0%) {44.0%} 20 ... 190 -------O (3 = 12.0%) {48.0%} 226 --O (1 = 4.0%) {60.0%} 268 -----------------O (7 = 28.0%) {64.0%} 318 ... 449 --O (1 = 4.0%) {92.0%} 533 --O (1 = 4.0%) {96.0%} 633 ... Histogram: SB2.ChunkSize recorded 25 samples, average = 1618.4, standard deviation = 2618.4 (flags = 0x1) 0 ... 21 ------------------------------------O (1 = 4.0%) {0.0%} 28 O (0 = 0.0%) {4.0%} 37 ------------------------------------------------------------------------O (2 = 8.0%) {4.0%} 49 O (0 = 0.0%) {12.0%} 65 ------------------------------------O (1 = 4.0%) {12.0%} 86 O (0 = 0.0%) {16.0%} 113 ------------------------------------O (1 = 4.0%) {16.0%} 149 ------------------------------------------------------------------------O (2 = 8.0%) {20.0%} 196 O (0 = 0.0%) {28.0%} 258 ------------------------------------------------------------------------O (2 = 8.0%) {28.0%} 340 ------------------------------------------------------------------------O (2 = 8.0%) {36.0%} 448 ------------------------------------O (1 = 4.0%) {44.0%} 590 ------------------------------------------------------------------------O (2 = 8.0%) {48.0%} 777 ------------------------------------O (1 = 4.0%) {56.0%} 1023 ------------------------------------------------------------------------O (2 = 8.0%) {60.0%} 1347 ------------------------------------------------------------------------O (2 = 8.0%) {68.0%} 1774 ------------------------------------O (1 = 4.0%) {76.0%} 2336 ------------------------------------O (1 = 4.0%) {80.0%} 3077 ------------------------------------------------------------------------O (2 = 8.0%) {84.0%} 4053 ... 7031 ------------------------------------O (1 = 4.0%) {92.0%} 9260 ------------------------------------O (1 = 4.0%) {96.0%} 12196 ... Histogram: SB2.DatabaseBytes recorded 8 samples, average = 14235648.0, standard deviation = 0.0 (flags = 0x1) 0 ... 1000000 ------------------------------------------------------------------------O (8 = 100.0%) {0.0%} Histogram: SB2.Delay recorded 5479 samples, average = 0.0, standard deviation = 0.1 (flags = 0x1) 0 ------------------------------------------------------------------------O (5478 = 100.0%) 1 ... 10 O (1 = 0.0%) {100.0%} 14 ... Histogram: SB2.FilterCheck recorded 5479 samples, average = 0.1, standard deviation = 0.4 (flags = 0x1) 0 ------------------------------------------------------------------------O (5148 = 94.0%) 1 -----O (329 = 6.0%) {94.0%} 2 O (1 = 0.0%) {100.0%} 3 ... 24 O (1 = 0.0%) {100.0%} 29 ... Histogram: SB2.FilterReadFail recorded 1 samples, average = 1.0, standard deviation = 0.0 (flags = 0x1) 0 O (0 = 0.0%) 1 ------------------------------------------------------------------------O (1 = 100.0%) {0.0%} 2 ... Histogram: SB2.FilterSize recorded 8 samples, average = 2097153.0, standard deviation = 0.0 (flags = 0x1) 0 ... 1000000 ------------------------------------------------------------------------O (8 = 100.0%) {0.0%} Histogram: SB2.GetHash200 recorded 1 samples, average = 1.0, standard deviation = 0.0 (flags = 0x1) 0 O (0 = 0.0%) 1 ------------------------------------------------------------------------O (1 = 100.0%) {0.0%} 2 ... Histogram: SB2.GetHash204 recorded 1 samples, average = 1.0, standard deviation = 0.0 (flags = 0x1) 0 O (0 = 0.0%) 1 ------------------------------------------------------------------------O (1 = 100.0%) {0.0%} 2 ... Histogram: SB2.GetHashServerMiss recorded 2 samples, average = 1.0, standard deviation = 0.0 (flags = 0x1) 0 O (0 = 0.0%) 1 ------------------------------------------------------------------------O (2 = 100.0%) {0.0%} 2 ... Histogram: SB2.Network recorded 2 samples, average = 175.0, standard deviation = 13.0 (flags = 0x1) 0 ... 160 ------------------------------------------------------------------------O (2 = 100.0%) {0.0%} 217 ... Histogram: SB2.SubPrefixes recorded 8 samples, average = 650.3, standard deviation = 33.3 (flags = 0x1) 0 ... 590 ------------------------------------------------------------------------O (8 = 100.0%) {0.0%} 777 ... Histogram: SB2.Update recorded 8 samples, average = 624.4, standard deviation = 609.8 (flags = 0x1) 0 ... 4 ------------------------------------------------------------------------O (1 = 12.5%) {0.0%} 5 ... 87 --------------O (1 = 12.5%) {12.5%} 118 --------------O (1 = 12.5%) {25.0%} 160 ... 294 --------------O (1 = 12.5%) {37.5%} 398 O (0 = 0.0%) {50.0%} 539 -----------------------------O (2 = 25.0%) {50.0%} 730 O (0 = 0.0%) {75.0%} 989 --------------O (1 = 12.5%) {75.0%} 1340 O (0 = 0.0%) {87.5%} 1816 --------------O (1 = 12.5%) {87.5%} 2460 ... Histogram: SB2.UpdateSize recorded 8 samples, average = 5057.5, standard deviation = 6339.4 (flags = 0x1) 0 ... 149 ------------------------------------------------------------------------O (1 = 12.5%) {0.0%} 196 O (0 = 0.0%) {12.5%} 258 ------------------------------------------------------------------------O (1 = 12.5%) {12.5%} 340 ... 590 ------------------------------------------------------------------------O (1 = 12.5%) {25.0%} 777 O (0 = 0.0%) {37.5%} 1023 ------------------------------------------------------------------------O (1 = 12.5%) {37.5%} 1347 ... 4053 ------------------------------------------------------------------------O (1 = 12.5%) {50.0%} 5338 ------------------------------------------------------------------------O (1 = 12.5%) {62.5%} 7031 ------------------------------------------------------------------------O (1 = 12.5%) {75.0%} 9260 ... 16063 ------------------------------------------------------------------------O (1 = 12.5%) {87.5%} 21156 ... Histogram: SB2.UpdateUrls recorded 8 samples, average = 3.1, standard deviation = 1.8 (flags = 0x1) 0 O (0 = 0.0%) 1 ------------------------------------------------------------------------O (2 = 25.0%) {0.0%} 2 ------------------------------------------------------------------------O (2 = 25.0%) {25.0%} 3 O (0 = 0.0%) {50.0%} 4 ------------------------------------------------------------------------O (2 = 25.0%) {50.0%} 5 ------------------------------------O (2 = 25.0%) {75.0%} 7 ... I saw this problem on Windows. For the original report, it was thrashing for an hour but I'm not clear on the "thrash share" of Chrome compared to the virus scan for example. I'll get a better number next time. Here's the SB internal numbers: Histogram: SB.QueueDepth recorded 1 samples, average = 0.0, standard deviation = 0.0 0 ------------------------------------------------------------------------O (1 = 100.0%) 1 ... Histogram: SB2.AddPrefixes recorded 8 samples, average = 811701.8, standard deviation = 126.9 (flags = 0x1) 0 ... 759255 ------------------------------------------------------------------------O (8 = 100.0%) {0.0%} 1000000 O (0 = 0.0%) {100.0%} Histogram: SB2.BuildFilter recorded 8 samples, average = 37771.3, standard deviation = 31100.0 (flags = 0x1) 0 ... 8289 ------------------------------------------------------------------------O (2 = 25.0%) {0.0%} 11230 ------------------------------------O (1 = 12.5%) {25.0%} 15215 O (0 = 0.0%) {37.5%} 20614 ------------------------------------------------------------------------O (2 = 25.0%) {37.5%} 27929 O (0 = 0.0%) {62.5%} 37840 ------------------------------------O (1 = 12.5%) {62.5%} 51267 ------------------------------------O (1 = 12.5%) {75.0%} 69459 O (0 = 0.0%) {87.5%} 94106 ------------------------------------O (1 = 12.5%) {87.5%} 127499 ... Histogram: SB2.BuildReadBytes recorded 8 samples, average = 50397058.4, standard deviation = 116878.4 (flags = 0x1) 0 ... 1000000 ------------------------------------------------------------------------O (8 = 100.0%) {0.0%} Histogram: SB2.BuildReadOperations recorded 8 samples, average = 50546.4, standard deviation = 3127.0 (flags = 0x1) 0 ... 48336 ------------------------------------------------------------------------O (8 = 100.0%) {0.0%} 63662 ... Histogram: SB2.BuildWriteBytes recorded 8 samples, average = 41038247.3, standard deviation = 3061309.4 (flags = 0x1) 0 ... 1000000 ------------------------------------------------------------------------O (8 = 100.0%) {0.0%} Histogram: SB2.BuildWriteOperations recorded 8 samples, average = 64998.6, standard deviation = 5293.7 (flags = 0x1) 0 ... 48336 ------------------------------------------------------------------------O (7 = 87.5%) {0.0%} 63662 ----------O (1 = 12.5%) {87.5%} 83848 ... Histogram: SB2.ChunkInsert recorded 25 samples, average = 32.0, standard deviation = 71.6 (flags = 0x1) 0 --------------------------------O (4 = 16.0%) 1 ------------------------------------------------------------------------O (9 = 36.0%) {16.0%} 2 ------------------------O (3 = 12.0%) {52.0%} 3 ... 24 ---O (2 = 8.0%) {64.0%} 29 --O (1 = 4.0%) {72.0%} 34 --O (1 = 4.0%) {76.0%} 40 O (0 = 0.0%) {80.0%} 48 --O (1 = 4.0%) {80.0%} 57 --O (1 = 4.0%) {84.0%} 68 --O (1 = 4.0%) {88.0%} 81 ... 114 --O (1 = 4.0%) {92.0%} 135 ... 318 --O (1 = 4.0%) {96.0%} 378 ... Histogram: SB2.ChunkRequest recorded 25 samples, average = 166.8, standard deviation = 174.8 (flags = 0x1) 0 ... 2 ------------------------O (2 = 8.0%) {0.0%} 3 ------------------------------------------------------------------------O (6 = 24.0%) {8.0%} 4 ------------O (1 = 4.0%) {32.0%} 5 ------------O (1 = 4.0%) {36.0%} 6 ------------O (1 = 4.0%) {40.0%} 7 ... 17 ----O (1 = 4.0%) {44.0%} 20 ... 190 -------O (3 = 12.0%) {48.0%} 226 --O (1 = 4.0%) {60.0%} 268 -----------------O (7 = 28.0%) {64.0%} 318 ... 449 --O (1 = 4.0%) {92.0%} 533 --O (1 = 4.0%) {96.0%} 633 ... Histogram: SB2.ChunkSize recorded 25 samples, average = 1618.4, standard deviation = 2618.4 (flags = 0x1) 0 ... 21 ------------------------------------O (1 = 4.0%) {0.0%} 28 O (0 = 0.0%) {4.0%} 37 ------------------------------------------------------------------------O (2 = 8.0%) {4.0%} 49 O (0 = 0.0%) {12.0%} 65 ------------------------------------O (1 = 4.0%) {12.0%} 86 O (0 = 0.0%) {16.0%} 113 ------------------------------------O (1 = 4.0%) {16.0%} 149 ------------------------------------------------------------------------O (2 = 8.0%) {20.0%} 196 O (0 = 0.0%) {28.0%} 258 ------------------------------------------------------------------------O (2 = 8.0%) {28.0%} 340 ------------------------------------------------------------------------O (2 = 8.0%) {36.0%} 448 ------------------------------------O (1 = 4.0%) {44.0%} 590 ------------------------------------------------------------------------O (2 = 8.0%) {48.0%} 777 ------------------------------------O (1 = 4.0%) {56.0%} 1023 ------------------------------------------------------------------------O (2 = 8.0%) {60.0%} 1347 ------------------------------------------------------------------------O (2 = 8.0%) {68.0%} 1774 ------------------------------------O (1 = 4.0%) {76.0%} 2336 ------------------------------------O (1 = 4.0%) {80.0%} 3077 ------------------------------------------------------------------------O (2 = 8.0%) {84.0%} 4053 ... 7031 ------------------------------------O (1 = 4.0%) {92.0%} 9260 ------------------------------------O (1 = 4.0%) {96.0%} 12196 ... Histogram: SB2.DatabaseBytes recorded 8 samples, average = 14235648.0, standard deviation = 0.0 (flags = 0x1) 0 ... 1000000 ------------------------------------------------------------------------O (8 = 100.0%) {0.0%} Histogram: SB2.Delay recorded 5479 samples, average = 0.0, standard deviation = 0.1 (flags = 0x1) 0 ------------------------------------------------------------------------O (5478 = 100.0%) 1 ... 10 O (1 = 0.0%) {100.0%} 14 ... Histogram: SB2.FilterCheck recorded 5479 samples, average = 0.1, standard deviation = 0.4 (flags = 0x1) 0 ------------------------------------------------------------------------O (5148 = 94.0%) 1 -----O (329 = 6.0%) {94.0%} 2 O (1 = 0.0%) {100.0%} 3 ... 24 O (1 = 0.0%) {100.0%} 29 ... Histogram: SB2.FilterReadFail recorded 1 samples, average = 1.0, standard deviation = 0.0 (flags = 0x1) 0 O (0 = 0.0%) 1 ------------------------------------------------------------------------O (1 = 100.0%) {0.0%} 2 ... Histogram: SB2.FilterSize recorded 8 samples, average = 2097153.0, standard deviation = 0.0 (flags = 0x1) 0 ... 1000000 ------------------------------------------------------------------------O (8 = 100.0%) {0.0%} Histogram: SB2.GetHash200 recorded 1 samples, average = 1.0, standard deviation = 0.0 (flags = 0x1) 0 O (0 = 0.0%) 1 ------------------------------------------------------------------------O (1 = 100.0%) {0.0%} 2 ... Histogram: SB2.GetHash204 recorded 1 samples, average = 1.0, standard deviation = 0.0 (flags = 0x1) 0 O (0 = 0.0%) 1 ------------------------------------------------------------------------O (1 = 100.0%) {0.0%} 2 ... Histogram: SB2.GetHashServerMiss recorded 2 samples, average = 1.0, standard deviation = 0.0 (flags = 0x1) 0 O (0 = 0.0%) 1 ------------------------------------------------------------------------O (2 = 100.0%) {0.0%} 2 ... Histogram: SB2.Network recorded 2 samples, average = 175.0, standard deviation = 13.0 (flags = 0x1) 0 ... 160 ------------------------------------------------------------------------O (2 = 100.0%) {0.0%} 217 ... Histogram: SB2.SubPrefixes recorded 8 samples, average = 650.3, standard deviation = 33.3 (flags = 0x1) 0 ... 590 ------------------------------------------------------------------------O (8 = 100.0%) {0.0%} 777 ... Histogram: SB2.Update recorded 8 samples, average = 624.4, standard deviation = 609.8 (flags = 0x1) 0 ... 4 ------------------------------------------------------------------------O (1 = 12.5%) {0.0%} 5 ... 87 --------------O (1 = 12.5%) {12.5%} 118 --------------O (1 = 12.5%) {25.0%} 160 ... 294 --------------O (1 = 12.5%) {37.5%} 398 O (0 = 0.0%) {50.0%} 539 -----------------------------O (2 = 25.0%) {50.0%} 730 O (0 = 0.0%) {75.0%} 989 --------------O (1 = 12.5%) {75.0%} 1340 O (0 = 0.0%) {87.5%} 1816 --------------O (1 = 12.5%) {87.5%} 2460 ... Histogram: SB2.UpdateSize recorded 8 samples, average = 5057.5, standard deviation = 6339.4 (flags = 0x1) 0 ... 149 ------------------------------------------------------------------------O (1 = 12.5%) {0.0%} 196 O (0 = 0.0%) {12.5%} 258 ------------------------------------------------------------------------O (1 = 12.5%) {12.5%} 340 ... 590 ------------------------------------------------------------------------O (1 = 12.5%) {25.0%} 777 O (0 = 0.0%) {37.5%} 1023 ------------------------------------------------------------------------O (1 = 12.5%) {37.5%} 1347 ... 4053 ------------------------------------------------------------------------O (1 = 12.5%) {50.0%} 5338 ------------------------------------------------------------------------O (1 = 12.5%) {62.5%} 7031 ------------------------------------------------------------------------O (1 = 12.5%) {75.0%} 9260 ... 16063 ------------------------------------------------------------------------O (1 = 12.5%) {87.5%} 21156 ... Histogram: SB2.UpdateUrls recorded 8 samples, average = 3.1, standard deviation = 1.8 (flags = 0x1) 0 O (0 = 0.0%) 1 ------------------------------------------------------------------------O (2 = 25.0%) {0.0%} 2 ------------------------------------------------------------------------O (2 = 25.0%) {25.0%} 3 O (0 = 0.0%) {50.0%} 4 ------------------------------------------------------------------------O (2 = 25.0%) {50.0%} 5 ------------------------------------O (2 = 25.0%) {75.0%} 7 ... Oct 31, 2009 chromium issue 25336 (Safe browsing updates should be throttled) commented on - 2990 file operations per second for Chrome. A large number of them must have been cached but still it's an obscenely high number, hammered my disk and made the computer temporarily unusable. The pattern is very reliable though: All the file operations are a repeated batch of 6 file operations: 1 read and 5 writes. Here's a summarized set of 2 sets constituting 12 sequential operations: ReadFile C:\...\Safe Browsing Bloom SUCCESS Offset: 1,821,696, Length: 1,024 WriteFile C:\...\Safe Browsing Bloom-journal SUCCESS Offset: 9,158,056, Length: 4 WriteFile C:\...\Safe Browsing Bloom-journal SUCCESS Offset: 9,158,060, Length: 1,024 WriteFile C:\...\Safe Browsing Bloom-journal SUCCESS Offset: 9,159,084, Length: 4 WriteFile C:\...\Safe Browsing Bloom FAST IO DISALLOWED Offset: 9,947,136, Length: 1,024 WriteFile C:\...\Safe Browsing Bloom SUCCESS Offset: 9,947,136, Length: 1,024 ReadFile C:\...\Safe Browsing Bloom SUCCESS Offset: 4,664,320, Length: 1,024 WriteFile C:\...\Safe Browsing Bloom-journal SUCCESS Offset: 9,159,088, Length: 4 WriteFile C:\...\Safe Browsing Bloom-journal SUCCESS Offset: 9,159,092, Length: 1,024 WriteFile C:\...\Safe Browsing Bloom-journal SUCCESS Offset: 9,160,116, Length: 4 WriteFile C:\...\Safe Browsing Bloom FAST IO DISALLOWED Offset: 3,346,432, Length: 1,024 WriteFile C:\...\Safe Browsing Bloom SUCCESS Offset: 3,346,432, Length: 1,024 Also note that there of the write operations are entirely sequential - could that not be combined into single write? For example steps 2-4 and 8-10 from the above list: WriteFile Offset: 9,158,056, Length: 4 WriteFile Offset: 9,158,060, Length: 1,024 WriteFile Offset: 9,159,084, Length: 4 2990 file operations per second for Chrome. A large number of them must have been cached but still it's an obscenely high number, hammered my disk and made the computer temporarily unusable. The pattern is very reliable though: All the file operations are a repeated batch of 6 file operations: 1 read and 5 writes. Here's a summarized set of 2 sets constituting 12 sequential operations: ReadFile C:\...\Safe Browsing Bloom SUCCESS Offset: 1,821,696, Length: 1,024 WriteFile C:\...\Safe Browsing Bloom-journal SUCCESS Offset: 9,158,056, Length: 4 WriteFile C:\...\Safe Browsing Bloom-journal SUCCESS Offset: 9,158,060, Length: 1,024 WriteFile C:\...\Safe Browsing Bloom-journal SUCCESS Offset: 9,159,084, Length: 4 WriteFile C:\...\Safe Browsing Bloom FAST IO DISALLOWED Offset: 9,947,136, Length: 1,024 WriteFile C:\...\Safe Browsing Bloom SUCCESS Offset: 9,947,136, Length: 1,024 ReadFile C:\...\Safe Browsing Bloom SUCCESS Offset: 4,664,320, Length: 1,024 WriteFile C:\...\Safe Browsing Bloom-journal SUCCESS Offset: 9,159,088, Length: 4 WriteFile C:\...\Safe Browsing Bloom-journal SUCCESS Offset: 9,159,092, Length: 1,024 WriteFile C:\...\Safe Browsing Bloom-journal SUCCESS Offset: 9,160,116, Length: 4 WriteFile C:\...\Safe Browsing Bloom FAST IO DISALLOWED Offset: 3,346,432, Length: 1,024 WriteFile C:\...\Safe Browsing Bloom SUCCESS Offset: 3,346,432, Length: 1,024 Also note that there of the write operations are entirely sequential - could that not be combined into single write? For example steps 2-4 and 8-10 from the above list: WriteFile Offset: 9,158,056, Length: 4 WriteFile Offset: 9,158,060, Length: 1,024 WriteFile Offset: 9,159,084, Length: 4 Oct 22, 2009 chromium issue 25336 (Safe browsing updates should be throttled) commented on - I think the throttling at startup is key. I've found a big improvement already by deleting the chromium source tree from my hard which had an enormous number of files. So far most of the problems that I'm seeing are AV related but procmon definitely showed at least one occasion with streams of 100 disk I/O per second that were all touching the safe browsing file. I think the throttling at startup is key. I've found a big improvement already by deleting the chromium source tree from my hard which had an enormous number of files. So far most of the problems that I'm seeing are AV related but procmon definitely showed at least one occasion with streams of 100 disk I/O per second that were all touching the safe browsing file. Oct 20, 2009 chromium issue 25336 (Safe browsing updates should be throttled) commented on - I see in excess of 100 disk I/O operations per second in procmon. Often my computer slows to a crawl and occasionally my mouse pointer doesn't even update. Possible solutions: either throttle disk access as "Ian" mentioned. Alternatively be strategic about keeping a smaller malware list but then query Google more often for rarely seen sites. This trades off prefetching a large database compared to higher latency for rarely seen sites. I see in excess of 100 disk I/O operations per second in procmon. Often my computer slows to a crawl and occasionally my mouse pointer doesn't even update. Possible solutions: either throttle disk access as "Ian" mentioned. Alternatively be strategic about keeping a smaller malware list but then query Google more often for rarely seen sites. This trades off prefetching a large database compared to higher latency for rarely seen sites.

issue 25336 (Safe browsing updates should be throttled) commented on - I saw this problem on Windows. For the original report, it was thrashing for an hour but I'm not clear on the "thrash share" of Chrome compared to the virus scan for example. I'll get a better number next time. Here's the SB internal numbers: Histogram: SB.QueueDepth recorded 1 samples, average = 0.0, standard deviation = 0.0 0 ------------------------------------------------------------------------O (1 = 100.0%) 1 ... Histogram: SB2.AddPrefixes recorded 8 samples, average = 811701.8, standard deviation = 126.9 (flags = 0x1) 0 ... 759255 ------------------------------------------------------------------------O (8 = 100.0%) {0.0%} 1000000 O (0 = 0.0%) {100.0%} Histogram: SB2.BuildFilter recorded 8 samples, average = 37771.3, standard deviation = 31100.0 (flags = 0x1) 0 ... 8289 ------------------------------------------------------------------------O (2 = 25.0%) {0.0%} 11230 ------------------------------------O (1 = 12.5%) {25.0%} 15215 O (0 = 0.0%) {37.5%} 20614 ------------------------------------------------------------------------O (2 = 25.0%) {37.5%} 27929 O (0 = 0.0%) {62.5%} 37840 ------------------------------------O (1 = 12.5%) {62.5%} 51267 ------------------------------------O (1 = 12.5%) {75.0%} 69459 O (0 = 0.0%) {87.5%} 94106 ------------------------------------O (1 = 12.5%) {87.5%} 127499 ... Histogram: SB2.BuildReadBytes recorded 8 samples, average = 50397058.4, standard deviation = 116878.4 (flags = 0x1) 0 ... 1000000 ------------------------------------------------------------------------O (8 = 100.0%) {0.0%} Histogram: SB2.BuildReadOperations recorded 8 samples, average = 50546.4, standard deviation = 3127.0 (flags = 0x1) 0 ... 48336 ------------------------------------------------------------------------O (8 = 100.0%) {0.0%} 63662 ... Histogram: SB2.BuildWriteBytes recorded 8 samples, average = 41038247.3, standard deviation = 3061309.4 (flags = 0x1) 0 ... 1000000 ------------------------------------------------------------------------O (8 = 100.0%) {0.0%} Histogram: SB2.BuildWriteOperations recorded 8 samples, average = 64998.6, standard deviation = 5293.7 (flags = 0x1) 0 ... 48336 ------------------------------------------------------------------------O (7 = 87.5%) {0.0%} 63662 ----------O (1 = 12.5%) {87.5%} 83848 ... Histogram: SB2.ChunkInsert recorded 25 samples, average = 32.0, standard deviation = 71.6 (flags = 0x1) 0 --------------------------------O (4 = 16.0%) 1 ------------------------------------------------------------------------O (9 = 36.0%) {16.0%} 2 ------------------------O (3 = 12.0%) {52.0%} 3 ... 24 ---O (2 = 8.0%) {64.0%} 29 --O (1 = 4.0%) {72.0%} 34 --O (1 = 4.0%) {76.0%} 40 O (0 = 0.0%) {80.0%} 48 --O (1 = 4.0%) {80.0%} 57 --O (1 = 4.0%) {84.0%} 68 --O (1 = 4.0%) {88.0%} 81 ... 114 --O (1 = 4.0%) {92.0%} 135 ... 318 --O (1 = 4.0%) {96.0%} 378 ... Histogram: SB2.ChunkRequest recorded 25 samples, average = 166.8, standard deviation = 174.8 (flags = 0x1) 0 ... 2 ------------------------O (2 = 8.0%) {0.0%} 3 ------------------------------------------------------------------------O (6 = 24.0%) {8.0%} 4 ------------O (1 = 4.0%) {32.0%} 5 ------------O (1 = 4.0%) {36.0%} 6 ------------O (1 = 4.0%) {40.0%} 7 ... 17 ----O (1 = 4.0%) {44.0%} 20 ... 190 -------O (3 = 12.0%) {48.0%} 226 --O (1 = 4.0%) {60.0%} 268 -----------------O (7 = 28.0%) {64.0%} 318 ... 449 --O (1 = 4.0%) {92.0%} 533 --O (1 = 4.0%) {96.0%} 633 ... Histogram: SB2.ChunkSize recorded 25 samples, average = 1618.4, standard deviation = 2618.4 (flags = 0x1) 0 ... 21 ------------------------------------O (1 = 4.0%) {0.0%} 28 O (0 = 0.0%) {4.0%} 37 ------------------------------------------------------------------------O (2 = 8.0%) {4.0%} 49 O (0 = 0.0%) {12.0%} 65 ------------------------------------O (1 = 4.0%) {12.0%} 86 O (0 = 0.0%) {16.0%} 113 ------------------------------------O (1 = 4.0%) {16.0%} 149 ------------------------------------------------------------------------O (2 = 8.0%) {20.0%} 196 O (0 = 0.0%) {28.0%} 258 ------------------------------------------------------------------------O (2 = 8.0%) {28.0%} 340 ------------------------------------------------------------------------O (2 = 8.0%) {36.0%} 448 ------------------------------------O (1 = 4.0%) {44.0%} 590 ------------------------------------------------------------------------O (2 = 8.0%) {48.0%} 777 ------------------------------------O (1 = 4.0%) {56.0%} 1023 ------------------------------------------------------------------------O (2 = 8.0%) {60.0%} 1347 ------------------------------------------------------------------------O (2 = 8.0%) {68.0%} 1774 ------------------------------------O (1 = 4.0%) {76.0%} 2336 ------------------------------------O (1 = 4.0%) {80.0%} 3077 ------------------------------------------------------------------------O (2 = 8.0%) {84.0%} 4053 ... 7031 ------------------------------------O (1 = 4.0%) {92.0%} 9260 ------------------------------------O (1 = 4.0%) {96.0%} 12196 ... Histogram: SB2.DatabaseBytes recorded 8 samples, average = 14235648.0, standard deviation = 0.0 (flags = 0x1) 0 ... 1000000 ------------------------------------------------------------------------O (8 = 100.0%) {0.0%} Histogram: SB2.Delay recorded 5479 samples, average = 0.0, standard deviation = 0.1 (flags = 0x1) 0 ------------------------------------------------------------------------O (5478 = 100.0%) 1 ... 10 O (1 = 0.0%) {100.0%} 14 ... Histogram: SB2.FilterCheck recorded 5479 samples, average = 0.1, standard deviation = 0.4 (flags = 0x1) 0 ------------------------------------------------------------------------O (5148 = 94.0%) 1 -----O (329 = 6.0%) {94.0%} 2 O (1 = 0.0%) {100.0%} 3 ... 24 O (1 = 0.0%) {100.0%} 29 ... Histogram: SB2.FilterReadFail recorded 1 samples, average = 1.0, standard deviation = 0.0 (flags = 0x1) 0 O (0 = 0.0%) 1 ------------------------------------------------------------------------O (1 = 100.0%) {0.0%} 2 ... Histogram: SB2.FilterSize recorded 8 samples, average = 2097153.0, standard deviation = 0.0 (flags = 0x1) 0 ... 1000000 ------------------------------------------------------------------------O (8 = 100.0%) {0.0%} Histogram: SB2.GetHash200 recorded 1 samples, average = 1.0, standard deviation = 0.0 (flags = 0x1) 0 O (0 = 0.0%) 1 ------------------------------------------------------------------------O (1 = 100.0%) {0.0%} 2 ... Histogram: SB2.GetHash204 recorded 1 samples, average = 1.0, standard deviation = 0.0 (flags = 0x1) 0 O (0 = 0.0%) 1 ------------------------------------------------------------------------O (1 = 100.0%) {0.0%} 2 ... Histogram: SB2.GetHashServerMiss recorded 2 samples, average = 1.0, standard deviation = 0.0 (flags = 0x1) 0 O (0 = 0.0%) 1 ------------------------------------------------------------------------O (2 = 100.0%) {0.0%} 2 ... Histogram: SB2.Network recorded 2 samples, average = 175.0, standard deviation = 13.0 (flags = 0x1) 0 ... 160 ------------------------------------------------------------------------O (2 = 100.0%) {0.0%} 217 ... Histogram: SB2.SubPrefixes recorded 8 samples, average = 650.3, standard deviation = 33.3 (flags = 0x1) 0 ... 590 ------------------------------------------------------------------------O (8 = 100.0%) {0.0%} 777 ... Histogram: SB2.Update recorded 8 samples, average = 624.4, standard deviation = 609.8 (flags = 0x1) 0 ... 4 ------------------------------------------------------------------------O (1 = 12.5%) {0.0%} 5 ... 87 --------------O (1 = 12.5%) {12.5%} 118 --------------O (1 = 12.5%) {25.0%} 160 ... 294 --------------O (1 = 12.5%) {37.5%} 398 O (0 = 0.0%) {50.0%} 539 -----------------------------O (2 = 25.0%) {50.0%} 730 O (0 = 0.0%) {75.0%} 989 --------------O (1 = 12.5%) {75.0%} 1340 O (0 = 0.0%) {87.5%} 1816 --------------O (1 = 12.5%) {87.5%} 2460 ... Histogram: SB2.UpdateSize recorded 8 samples, average = 5057.5, standard deviation = 6339.4 (flags = 0x1) 0 ... 149 ------------------------------------------------------------------------O (1 = 12.5%) {0.0%} 196 O (0 = 0.0%) {12.5%} 258 ------------------------------------------------------------------------O (1 = 12.5%) {12.5%} 340 ... 590 ------------------------------------------------------------------------O (1 = 12.5%) {25.0%} 777 O (0 = 0.0%) {37.5%} 1023 ------------------------------------------------------------------------O (1 = 12.5%) {37.5%} 1347 ... 4053 ------------------------------------------------------------------------O (1 = 12.5%) {50.0%} 5338 ------------------------------------------------------------------------O (1 = 12.5%) {62.5%} 7031 ------------------------------------------------------------------------O (1 = 12.5%) {75.0%} 9260 ... 16063 ------------------------------------------------------------------------O (1 = 12.5%) {87.5%} 21156 ... Histogram: SB2.UpdateUrls recorded 8 samples, average = 3.1, standard deviation = 1.8 (flags = 0x1) 0 O (0 = 0.0%) 1 ------------------------------------------------------------------------O (2 = 25.0%) {0.0%} 2 ------------------------------------------------------------------------O (2 = 25.0%) {25.0%} 3 O (0 = 0.0%) {50.0%} 4 ------------------------------------------------------------------------O (2 = 25.0%) {50.0%} 5 ------------------------------------O (2 = 25.0%) {75.0%} 7 ...

I saw this problem on Windows. For the original report, it was thrashing for an hour but I'm not clear on the "thrash share" of Chrome compared to the virus scan for example. I'll get a better number next time. Here's the SB internal numbers: Histogram: SB.QueueDepth recorded 1 samples, average = 0.0, standard deviation = 0.0 0 ------------------------------------------------------------------------O (1 = 100.0%) 1 ... Histogram: SB2.AddPrefixes recorded 8 samples, average = 811701.8, standard deviation = 126.9 (flags = 0x1) 0 ... 759255 ------------------------------------------------------------------------O (8 = 100.0%) {0.0%} 1000000 O (0 = 0.0%) {100.0%} Histogram: SB2.BuildFilter recorded 8 samples, average = 37771.3, standard deviation = 31100.0 (flags = 0x1) 0 ... 8289 ------------------------------------------------------------------------O (2 = 25.0%) {0.0%} 11230 ------------------------------------O (1 = 12.5%) {25.0%} 15215 O (0 = 0.0%) {37.5%} 20614 ------------------------------------------------------------------------O (2 = 25.0%) {37.5%} 27929 O (0 = 0.0%) {62.5%} 37840 ------------------------------------O (1 = 12.5%) {62.5%} 51267 ------------------------------------O (1 = 12.5%) {75.0%} 69459 O (0 = 0.0%) {87.5%} 94106 ------------------------------------O (1 = 12.5%) {87.5%} 127499 ... Histogram: SB2.BuildReadBytes recorded 8 samples, average = 50397058.4, standard deviation = 116878.4 (flags = 0x1) 0 ... 1000000 ------------------------------------------------------------------------O (8 = 100.0%) {0.0%} Histogram: SB2.BuildReadOperations recorded 8 samples, average = 50546.4, standard deviation = 3127.0 (flags = 0x1) 0 ... 48336 ------------------------------------------------------------------------O (8 = 100.0%) {0.0%} 63662 ... Histogram: SB2.BuildWriteBytes recorded 8 samples, average = 41038247.3, standard deviation = 3061309.4 (flags = 0x1) 0 ... 1000000 ------------------------------------------------------------------------O (8 = 100.0%) {0.0%} Histogram: SB2.BuildWriteOperations recorded 8 samples, average = 64998.6, standard deviation = 5293.7 (flags = 0x1) 0 ... 48336 ------------------------------------------------------------------------O (7 = 87.5%) {0.0%} 63662 ----------O (1 = 12.5%) {87.5%} 83848 ... Histogram: SB2.ChunkInsert recorded 25 samples, average = 32.0, standard deviation = 71.6 (flags = 0x1) 0 --------------------------------O (4 = 16.0%) 1 ------------------------------------------------------------------------O (9 = 36.0%) {16.0%} 2 ------------------------O (3 = 12.0%) {52.0%} 3 ... 24 ---O (2 = 8.0%) {64.0%} 29 --O (1 = 4.0%) {72.0%} 34 --O (1 = 4.0%) {76.0%} 40 O (0 = 0.0%) {80.0%} 48 --O (1 = 4.0%) {80.0%} 57 --O (1 = 4.0%) {84.0%} 68 --O (1 = 4.0%) {88.0%} 81 ... 114 --O (1 = 4.0%) {92.0%} 135 ... 318 --O (1 = 4.0%) {96.0%} 378 ... Histogram: SB2.ChunkRequest recorded 25 samples, average = 166.8, standard deviation = 174.8 (flags = 0x1) 0 ... 2 ------------------------O (2 = 8.0%) {0.0%} 3 ------------------------------------------------------------------------O (6 = 24.0%) {8.0%} 4 ------------O (1 = 4.0%) {32.0%} 5 ------------O (1 = 4.0%) {36.0%} 6 ------------O (1 = 4.0%) {40.0%} 7 ... 17 ----O (1 = 4.0%) {44.0%} 20 ... 190 -------O (3 = 12.0%) {48.0%} 226 --O (1 = 4.0%) {60.0%} 268 -----------------O (7 = 28.0%) {64.0%} 318 ... 449 --O (1 = 4.0%) {92.0%} 533 --O (1 = 4.0%) {96.0%} 633 ... Histogram: SB2.ChunkSize recorded 25 samples, average = 1618.4, standard deviation = 2618.4 (flags = 0x1) 0 ... 21 ------------------------------------O (1 = 4.0%) {0.0%} 28 O (0 = 0.0%) {4.0%} 37 ------------------------------------------------------------------------O (2 = 8.0%) {4.0%} 49 O (0 = 0.0%) {12.0%} 65 ------------------------------------O (1 = 4.0%) {12.0%} 86 O (0 = 0.0%) {16.0%} 113 ------------------------------------O (1 = 4.0%) {16.0%} 149 ------------------------------------------------------------------------O (2 = 8.0%) {20.0%} 196 O (0 = 0.0%) {28.0%} 258 ------------------------------------------------------------------------O (2 = 8.0%) {28.0%} 340 ------------------------------------------------------------------------O (2 = 8.0%) {36.0%} 448 ------------------------------------O (1 = 4.0%) {44.0%} 590 ------------------------------------------------------------------------O (2 = 8.0%) {48.0%} 777 ------------------------------------O (1 = 4.0%) {56.0%} 1023 ------------------------------------------------------------------------O (2 = 8.0%) {60.0%} 1347 ------------------------------------------------------------------------O (2 = 8.0%) {68.0%} 1774 ------------------------------------O (1 = 4.0%) {76.0%} 2336 ------------------------------------O (1 = 4.0%) {80.0%} 3077 ------------------------------------------------------------------------O (2 = 8.0%) {84.0%} 4053 ... 7031 ------------------------------------O (1 = 4.0%) {92.0%} 9260 ------------------------------------O (1 = 4.0%) {96.0%} 12196 ... Histogram: SB2.DatabaseBytes recorded 8 samples, average = 14235648.0, standard deviation = 0.0 (flags = 0x1) 0 ... 1000000 ------------------------------------------------------------------------O (8 = 100.0%) {0.0%} Histogram: SB2.Delay recorded 5479 samples, average = 0.0, standard deviation = 0.1 (flags = 0x1) 0 ------------------------------------------------------------------------O (5478 = 100.0%) 1 ... 10 O (1 = 0.0%) {100.0%} 14 ... Histogram: SB2.FilterCheck recorded 5479 samples, average = 0.1, standard deviation = 0.4 (flags = 0x1) 0 ------------------------------------------------------------------------O (5148 = 94.0%) 1 -----O (329 = 6.0%) {94.0%} 2 O (1 = 0.0%) {100.0%} 3 ... 24 O (1 = 0.0%) {100.0%} 29 ... Histogram: SB2.FilterReadFail recorded 1 samples, average = 1.0, standard deviation = 0.0 (flags = 0x1) 0 O (0 = 0.0%) 1 ------------------------------------------------------------------------O (1 = 100.0%) {0.0%} 2 ... Histogram: SB2.FilterSize recorded 8 samples, average = 2097153.0, standard deviation = 0.0 (flags = 0x1) 0 ... 1000000 ------------------------------------------------------------------------O (8 = 100.0%) {0.0%} Histogram: SB2.GetHash200 recorded 1 samples, average = 1.0, standard deviation = 0.0 (flags = 0x1) 0 O (0 = 0.0%) 1 ------------------------------------------------------------------------O (1 = 100.0%) {0.0%} 2 ... Histogram: SB2.GetHash204 recorded 1 samples, average = 1.0, standard deviation = 0.0 (flags = 0x1) 0 O (0 = 0.0%) 1 ------------------------------------------------------------------------O (1 = 100.0%) {0.0%} 2 ... Histogram: SB2.GetHashServerMiss recorded 2 samples, average = 1.0, standard deviation = 0.0 (flags = 0x1) 0 O (0 = 0.0%) 1 ------------------------------------------------------------------------O (2 = 100.0%) {0.0%} 2 ... Histogram: SB2.Network recorded 2 samples, average = 175.0, standard deviation = 13.0 (flags = 0x1) 0 ... 160 ------------------------------------------------------------------------O (2 = 100.0%) {0.0%} 217 ... Histogram: SB2.SubPrefixes recorded 8 samples, average = 650.3, standard deviation = 33.3 (flags = 0x1) 0 ... 590 ------------------------------------------------------------------------O (8 = 100.0%) {0.0%} 777 ... Histogram: SB2.Update recorded 8 samples, average = 624.4, standard deviation = 609.8 (flags = 0x1) 0 ... 4 ------------------------------------------------------------------------O (1 = 12.5%) {0.0%} 5 ... 87 --------------O (1 = 12.5%) {12.5%} 118 --------------O (1 = 12.5%) {25.0%} 160 ... 294 --------------O (1 = 12.5%) {37.5%} 398 O (0 = 0.0%) {50.0%} 539 -----------------------------O (2 = 25.0%) {50.0%} 730 O (0 = 0.0%) {75.0%} 989 --------------O (1 = 12.5%) {75.0%} 1340 O (0 = 0.0%) {87.5%} 1816 --------------O (1 = 12.5%) {87.5%} 2460 ... Histogram: SB2.UpdateSize recorded 8 samples, average = 5057.5, standard deviation = 6339.4 (flags = 0x1) 0 ... 149 ------------------------------------------------------------------------O (1 = 12.5%) {0.0%} 196 O (0 = 0.0%) {12.5%} 258 ------------------------------------------------------------------------O (1 = 12.5%) {12.5%} 340 ... 590 ------------------------------------------------------------------------O (1 = 12.5%) {25.0%} 777 O (0 = 0.0%) {37.5%} 1023 ------------------------------------------------------------------------O (1 = 12.5%) {37.5%} 1347 ... 4053 ------------------------------------------------------------------------O (1 = 12.5%) {50.0%} 5338 ------------------------------------------------------------------------O (1 = 12.5%) {62.5%} 7031 ------------------------------------------------------------------------O (1 = 12.5%) {75.0%} 9260 ... 16063 ------------------------------------------------------------------------O (1 = 12.5%) {87.5%} 21156 ... Histogram: SB2.UpdateUrls recorded 8 samples, average = 3.1, standard deviation = 1.8 (flags = 0x1) 0 O (0 = 0.0%) 1 ------------------------------------------------------------------------O (2 = 25.0%) {0.0%} 2 ------------------------------------------------------------------------O (2 = 25.0%) {25.0%} 3 O (0 = 0.0%) {50.0%} 4 ------------------------------------------------------------------------O (2 = 25.0%) {50.0%} 5 ------------------------------------O (2 = 25.0%) {75.0%} 7 ...

Older