551-600 of 10000 results (10ms)
2014-01-13 §
14:45 <akosiaris> revoked hooper.wikimedia.org in puppetCA, Salt, stored configs in puppet cleaned [production]
14:00 <akosiaris> powering off hooper [production]
13:47 <mark> synchronized wmf-config/PoolCounterSettings-eqiad.php 'Raise ArticleView pool queue size by 50%' [production]
13:47 <mark> updated /a/common to {{Gerrit|I0442878ea}}: Raise ArticleView pool size by 50% [production]
12:47 <akosiaris> started poolcounter on potassium [production]
12:46 <mutante> starting poolcounter on heloum [production]
12:45 <MaxSem> that was https://bugzilla.wikimedia.org/show_bug.cgi?id=59993 [production]
12:44 <akosiaris> restarted poolcounter on potassium, helium after MaxSem's request [production]
10:26 <hashar> upgrading packages on gallium and lanthanum [production]
05:18 <^d> enwiki reporting lsearchd hasn't updated in days. Cursory investigation says this is right. Nothing in searchidx1001's logs seems telling, yet. [production]
02:39 <LocalisationUpdate> ResourceLoader cache refresh completed at Mon Jan 13 02:39:15 UTC 2014 [production]
02:21 <LocalisationUpdate> completed (1.23wmf10) at Mon Jan 13 02:21:29 UTC 2014 [production]
02:11 <LocalisationUpdate> completed (1.23wmf9) at Mon Jan 13 02:11:41 UTC 2014 [production]
2014-01-12 §
19:53 <ori> gerrit intermittently unresponsive; restarting. [production]
19:51 <ori> gerrit lockup on ytterbium - dozens of gerrit procs busy-waiting on futex [production]
02:42 <LocalisationUpdate> ResourceLoader cache refresh completed at Sun Jan 12 02:42:38 UTC 2014 [production]
02:23 <LocalisationUpdate> completed (1.23wmf10) at Sun Jan 12 02:23:36 UTC 2014 [production]
02:12 <LocalisationUpdate> completed (1.23wmf9) at Sun Jan 12 02:12:44 UTC 2014 [production]
00:04 <reedy> synchronized wmf-config/ '//gerrit.wikimedia.org/r/107008' [production]
00:01 <reedy> updated /a/common to {{Gerrit|I54a2246d7}}: db1060 to full steam [production]
2014-01-11 §
21:19 <ori> ytterbium: CPU %user spike starting 19:40, gerrit very slow. [production]
05:27 <springle> xtrabackup clone db1022 to db1023 [production]
05:11 <springle> synchronized wmf-config/db-eqiad.php 'db1060 to full steam' [production]
03:21 <Krinkle> Reloading zuul to deploy I1053812d8acfe9 [production]
02:48 <LocalisationUpdate> ResourceLoader cache refresh completed at Sat Jan 11 02:47:58 UTC 2014 [production]
02:28 <LocalisationUpdate> completed (1.23wmf10) at Sat Jan 11 02:28:04 UTC 2014 [production]
02:14 <LocalisationUpdate> completed (1.23wmf9) at Sat Jan 11 02:14:21 UTC 2014 [production]
01:29 <springle> synchronized wmf-config/db-eqiad.php 'warm up db1060 in s2' [production]
2014-01-10 §
21:09 <RobH> cp1043/1044 both updated and back online [production]
21:01 <RobH> stopping nginx on cp1043 and tinkering with its star.wikimedia.org certificate stuff, cp1044 is still online to handle misc-web-lb [production]
19:06 <aaron> synchronized wmf-config/filebackend.php 'Setup and enabled redisLockManager for all file backends in use' [production]
13:56 <hashar> Gerrit: adding WikidataJenkins user to groups "Non-Interactive Users" and "Wikidata" [production]
11:52 <mutante> welcome new software deployer Kartik from Language Engineering [production]
07:58 <springle> xtrabackup clone db1018 to db1060 [production]
05:56 <springle> xtrabackup clone db1050 to db1055 [production]
03:32 <LocalisationUpdate> ResourceLoader cache refresh completed at Fri Jan 10 03:32:03 UTC 2014 [production]
03:01 <spage> synchronized php-1.23wmf10/extensions/Flow/includes/Repository/TreeRepository.php 'Flow cache key fix to 1.23wmf10' [production]
01:46 <paravoid> swift: set_weight 0 to ms-be11/sde1, disk failed [production]
01:45 <maxsem> synchronized php-1.23wmf10/extensions/MobileFrontend/ 'https://gerrit.wikimedia.org/r/#/c/106639/' [production]
01:41 <maxsem> synchronized php-1.23wmf9/extensions/MobileFrontend/ 'https://gerrit.wikimedia.org/r/#/c/106639/' [production]
01:34 <springle> synchronized wmf-config/db-eqiad.php 'Reduce LB general traffic during reindexing/partitioning on groupLoadsBySection slaves' [production]
01:21 <paravoid> restoring RT's mail interface; expect delayed RT email to arrive soon [production]
01:19 <paravoid> apt: installing trusty's libio-socket-ssl-perl into precise-wikimedia; SNI-capable [production]
01:06 <RobH> gerrit seems faster again for now [production]
01:02 <RobH> gerrit is slowed down and memory is maxed out on system, restarting gerrit to see if it helps [production]
00:08 <maxsem> synchronized wmf-config/InitialiseSettings.php 'https://gerrit.wikimedia.org/r/106629' [production]
2014-01-09 §
22:29 <ori> synchronized php-1.23wmf10/extensions/VisualEditor/ApiVisualEditor.php 'Update VisualEditor for cherry pick I5cc44c5ef35 (bug 59867)' [production]
22:19 <aaron> synchronized php-1.23wmf10/includes/libs '1a5ac00f8991905d8fd643d53cb744024143c558' [production]
20:51 <aaron> synchronized php-1.23wmf10/includes/filebackend '94cb6f164ed2b9f7dbdf809e2d861ae04ab1df21' [production]
20:20 <aaron> synchronized php-1.23wmf10/includes/filebackend 'e45db51adeddcc71a97e6547a6f4ecaf5f320a8c' [production]