2851-2900 of 10000 results (26ms)
2013-02-20 §
21:18 <RobH> forced puppet run on lardner, was tired of it showing error for no runs [production]
21:13 <RobH> mw112-125 now in service as api apaches in tampa [production]
20:58 <reedy> synchronized wmf-config/CommonSettings.php [production]
20:38 <RobH> mw86-mw111 tested ok, pushing into apache service in pmtpa [production]
20:32 <RobH> mw86-mw111 being added to nodelists, ignore errors on them for next few minutes [production]
19:40 <reedy> rebuilt wikiversions.cdb and synchronized wikiversions files: wikibooks to 1.21wmf10 [production]
19:37 <reedy> rebuilt wikiversions.cdb and synchronized wikiversions files: wikiversity, wikisource and wikiquote to 1.21wmf10 [production]
19:29 <reedy> rebuilt wikiversions.cdb and synchronized wikiversions files: wikivoyage, wikinews and wiktionary to 1.21wmf10 [production]
19:25 <reedy> rebuilt wikiversions.cdb and synchronized wikiversions files: closed, special, wikimedia, private and fishbowl to 1.21wmf10 [production]
05:34 <tstarling> synchronized wmf-config/CommonSettings.php 're-enable Scribunto profiler' [production]
04:32 <Tim> updating luasandbox to version 1.2, with profiler bug fixes [production]
02:53 <LocalisationUpdate> completed (1.21wmf10) at Wed Feb 20 02:53:32 UTC 2013 [production]
02:29 <LocalisationUpdate> completed (1.21wmf9) at Wed Feb 20 02:29:11 UTC 2013 [production]
01:28 <RobH> mw1161-1208 have wrong power setting, changing all to system.power.hotspare.enable 0 [production]
01:00 <notpeter> do-release-upgrade-ing on db58 [production]
00:57 <py> synchronized wmf-config/db-pmtpa.php 'removing db58 from db-secondary for upgrades and maria, replacing db43' [production]
2013-02-19 §
23:47 <notpeter> do-release-upgrade-ing on db43 [production]
23:38 <py> synchronized wmf-config/db-pmtpa.php 'removing db43 from db-secondary for upgrades and maria' [production]
23:21 <maxsem> synchronized wmf-config 'https://gerrit.wikimedia.org/r/#/c/49946/' [production]
23:04 <maxsem> Finished syncing Wikimedia installation... : Weekly mobile deployment [production]
23:03 <maxsem> synchronized php-1.21wmf9/extensions/MobileFrontend/ [production]
22:49 <maxsem> Started syncing Wikimedia installation... : Weekly mobile deployment [production]
22:41 <preilly> synchronized php-1.21wmf9/extensions/ArticleFeedback 'fix MAX call with GREATEST' [production]
22:29 <RobH> sq41 offline, rt 4550 [production]
22:20 <RobH> sq41 puppet freshness bad, wont accept ssh connections, serial redirection results in no output. will need to reboot it [production]
22:17 <RobH> sq41 not allowing ssh, drac resetting [production]
22:15 <sbernardin> taking down ms-be12 for hardware replacement per: https://rt.wikimedia.org/Ticket/Display.html?id=4546 [production]
22:15 <RobH> sq79/80 puppet in locked state, manually restarted puppet, removed lock file, ran manually [production]
22:11 <preilly> synchronized php-1.21wmf9/extensions/ArticleFeedback 'fix mysql 5.5 / ansi sql incompatibility' [production]
21:54 <RobH> mw48 was set to puppet agent disabled, re-enabled and fired puppet run [production]
20:04 <mflaschen> synchronized . 'Syncing GuidedTour submodule omitted when new branch cut was first cloned.' [production]
19:59 <Ryan_Lane> disabling project storage volumes for all labs projects with no instances [production]
15:02 <hashar> restarting jenkins to enable some startup setting [production]
14:58 <hashar> manganese CPU spike ongoing. Started roughly at 14:40 UTC [production]
13:29 <mutante> wikimedia.jp.net now redirects to wikimedia.org | wikimediacommons.jp.net now redirects to commons.wm [production]
13:27 <mutante> DNS update - adding wikimedia.jp.net [production]
13:25 <dzahn> gracefulled all apaches [production]
13:20 <mutante> gracefulling eqiad Apaches via dsh to push redirect change for .jp.net domains [production]
12:39 <apergos> powercycling ms-be7 (unresponsive to ping or from console) [production]
11:29 <mutante> installing package upgrads on neon/icinga [production]
02:49 <LocalisationUpdate> completed (1.21wmf10) at Tue Feb 19 02:49:32 UTC 2013 [production]
02:28 <LocalisationUpdate> completed (1.21wmf9) at Tue Feb 19 02:28:25 UTC 2013 [production]
01:12 <anomie> synchronized php-1.21wmf10/includes/api/ApiQuerySiteinfo.php 'Backport fix for ugly API bug' [production]
00:42 <reedy> rebuilt wikiversions.cdb and synchronized wikiversions files: [production]
00:30 <tstarling> synchronized wmf-config/InitialiseSettings.php [production]
2013-02-18 §
23:51 <tstarling> synchronized php-1.21wmf9/extensions/Scribunto [production]
23:51 <tstarling> synchronized php-1.21wmf10/extensions/Scribunto [production]
23:46 <tstarling> synchronized wmf-config/InitialiseSettings.php [production]
23:25 <Tim> on snapshot1002 -- fixed incorrect owner on some MW files, killed broken apt-get and upgraded wikimedia-task-appserver [production]
23:24 <Tim> fixed rsyncd.conf on scap proxies to allow connections from new apaches [production]