651-700 of 10000 results (17ms)
2013-12-26 §
21:18 <aaron> finished scap [production]
21:07 <MaxSem> Recreating GeoData index [production]
21:03 <aaron> started scap [production]
20:52 <andrewbogott> restarting parsoid cluster via salt [production]
20:50 <subbu> updated localsettings.js to unbreak VE on wikis with "-" in their name (ex: nds-nl) [production]
14:29 <akosiaris> killed stuck puppet agent on db9 and forced manual puppet run. [production]
02:35 <LocalisationUpdate> ResourceLoader cache refresh completed at Thu Dec 26 02:35:43 UTC 2013 [production]
02:18 <LocalisationUpdate> completed (1.23wmf8) at Thu Dec 26 02:18:37 UTC 2013 [production]
02:10 <LocalisationUpdate> completed (1.23wmf7) at Thu Dec 26 02:10:16 UTC 2013 [production]
2013-12-25 §
02:40 <LocalisationUpdate> ResourceLoader cache refresh completed at Wed Dec 25 02:40:35 UTC 2013 [production]
02:14 <LocalisationUpdate> completed (1.23wmf8) at Wed Dec 25 02:14:49 UTC 2013 [production]
02:14 <LocalisationUpdate> completed (1.23wmf7) at Wed Dec 25 02:14:05 UTC 2013 [production]
02:01 <aaron> finished scap [production]
01:53 <aaron> started scap [production]
01:53 <aaron> finished scap [production]
01:32 <aaron> started scap [production]
01:06 <ori> finished scap [production]
01:02 <ori> started scap [production]
01:00 <aaron> finished scap [production]
00:57 <aaron> started scap [production]
00:51 <aaron> started scap [production]
00:45 <aaron> started scap [production]
00:43 <aaron> started scap [production]
00:40 <aaron> started scap [production]
00:14 <aaron> finished scap [production]
00:07 <aaron> started scap [production]
2013-12-24 §
13:31 <reedy> synchronized php-1.23wmf7/extensions/GlobalBlocking 'bug 58934 Icc47a2d6367c0b906e40e068635c9fda07108e0f' [production]
03:08 <springle> synchronized wmf-config/db-eqiad.php 's1 db1033 to full steam' [production]
02:28 <LocalisationUpdate> ResourceLoader cache refresh completed at Tue Dec 24 02:28:42 UTC 2013 [production]
02:14 <LocalisationUpdate> completed (1.23wmf8) at Tue Dec 24 02:14:09 UTC 2013 [production]
02:08 <LocalisationUpdate> completed (1.23wmf7) at Tue Dec 24 02:08:04 UTC 2013 [production]
2013-12-23 §
22:15 <awight> updated crm from ce73eaa0ea6019f76c63d0cca097bf828eb933e2 to 87dea8afb964d0622f3ee92b6e120915846fde56 [production]
20:06 <paravoid> cr1-eqiad/cr1-sdtpa: new BGP policy to reset MED for XO [production]
16:59 <cmjohnson1> dns update [production]
15:30 <cmjohnson1> labnet1001 relocating racks C4 to B3 eqiad [production]
13:24 <springle_> starting xtrabackup clone db1001 to db1016 [production]
10:39 <akosiaris> uploaded php5_5.3.10-1ubuntu3.9+wmf1 to apt.wikimedia.org [production]
09:54 <paravoid> rebooting cp1065 with Linux 3.2 [production]
07:43 <springle> taking down db1016 for xfs_check, locked up and: XFS (dm-0): xlog_space_left: head behind tail [production]
05:57 <springle> synchronized wmf-config/db-eqiad.php 'warm up db1033 in s1' [production]
02:26 <LocalisationUpdate> ResourceLoader cache refresh completed at Mon Dec 23 02:26:35 UTC 2013 [production]
02:13 <LocalisationUpdate> completed (1.23wmf8) at Mon Dec 23 02:13:09 UTC 2013 [production]
02:07 <LocalisationUpdate> completed (1.23wmf7) at Mon Dec 23 02:07:23 UTC 2013 [production]
00:50 <springle> xtrabackup clone db1049 to db1033 [production]
00:37 <springle> synchronized wmf-config/db-eqiad.php 'rebalance group loads while db1050 out' [production]
2013-12-22 §
19:35 <apergos> db1050 boot: (during fsck) hung at "The disk drive for /a is not ready yet or not present. Continue waiting, S to skip.." etc [production]
19:34 <apergos> db1050 boot: "[ 65.625950] device-mapper: table: 252:3: snapshot: Snapshot cow pairing for exception table handover failed" [production]
19:33 <ori> synchronized wmf-config/db-eqiad.php 'Depool db1050' [production]
19:32 <ori> updated /a/common to {{Gerrit|If33894260}}: Depool db1050; unresponsive [production]
19:27 <apergos> powrcycling db1050, inaccessible [production]