6551-6600 of 10000 results (33ms)
2013-05-06 §
22:47 <mutante> apache-graceful-all, add iegcom virtual host [production]
21:00 <mutante> blog is back up [production]
20:59 <mutante> holmium: bring up interface lo, comment "search" line in resolv.conf, restart varnish, ... [production]
20:46 <paravoid> swift replication scripts running on ms-fe1002 under screen -- kill if they have any effect on production [production]
20:14 <mutante> DNS update - sync with ns2 [production]
20:04 <mutante> restarting parsoid on wtp1001 [production]
20:02 <mutante> restarting pdns on ns0 [production]
20:00 <mutante> killing parsoid server.js on wtp1001 [production]
19:59 <aaron> synchronized multiversion/MWMultiVersion.php 'f257ddac39194f8bfcfd145104999fdba83d33f5' [production]
19:58 <mutante> DNS update - switch all blog cnames over to holmium [production]
19:29 <reedy> synchronized php-1.22wmf3/extensions/ZeroRatedMobileAccess/ [production]
19:24 <LeslieCarr> moved gateway from csw1-esams to cr1-esams [production]
19:18 <Krinkle> Reloading Zuul to deploy I259585e78ee [production]
19:17 <LeslieCarr> rebooting ns2 [production]
19:15 <reedy> synchronized wmf-config/ [production]
19:13 <binasher> rebuilt db1016 from hotbackup of db1001; pmtpa side of m1 needs to be rebuilt as well [production]
18:41 <RobH> ns2/nescio appears offline, investigating [production]
18:37 <RobH> ns2 appears offline [production]
18:36 <RobH> authdns-update crashed on ns2, rerunning [production]
18:33 <RobH> holmium [production]
18:33 <RobH> authdns-update for new server homium [production]
18:07 <reedy> rebuilt wikiversions.cdb and synchronized wikiversions files: enwiki to 1.22wmf3 [production]
17:17 <LeslieCarr> marmontel's interface is now in the sandbox vlan [production]
17:15 <LeslieCarr> turned off marmontel's network port [production]
16:11 <reedy> synchronized docroot [production]
13:54 <hashar> gallium: installed manually libcidr0-dev libanon0-dev . Puppet change is {{gerrit|62434}} [production]
09:51 <paravoid> upgrading Ganglia Web to 3.5.7 [production]
08:25 <hashar> Zuul upgrading to upstream version 7191ee8 + 1 wmf hack. [production]
06:45 <Nemo_bis> Translate search on vanadium keeps being broken https://toolserver.org/~nemobis/tmp/SearchTranslations.log [production]
06:14 <paravoid> pushing new swift rings: ms-be1 weight 50->0, ms-be2 33->75 [production]
02:18 <paravoid> restarting gerrit [production]
02:18 <LocalisationUpdate> failed: git pull of extensions failed [production]
2013-05-05 §
10:56 <Nemo_bis> "Search service is temporarily unavailable" since unknown time https://meta.wikimedia.org/wiki/Special:SearchTranslations?query=amen&uselang=en [production]
03:36 <LocalisationUpdate> ResourceLoader cache refresh completed at Sun May 5 03:36:17 UTC 2013 [production]
02:25 <LocalisationUpdate> completed (1.22wmf2) at Sun May 5 02:25:44 UTC 2013 [production]
02:17 <LocalisationUpdate> completed (1.22wmf3) at Sun May 5 02:17:22 UTC 2013 [production]
2013-05-04 §
22:41 <reedy> synchronized wmf-config/interwiki.cdb 'Updating interwiki cache' [production]
21:44 <Reedy> Manually force ran TorBlock/loadExitNodes.php [production]
21:42 <reedy> synchronized php-1.22wmf3/extensions/TorBlock/ [production]
16:02 <reedy> synchronized wmf-config/ [production]
16:02 <reedy> synchronized docroot/bits/WikipediaMobileFirefoxOS/ [production]
04:36 <LocalisationUpdate> ResourceLoader cache refresh completed at Sat May 4 04:36:09 UTC 2013 [production]
02:20 <LocalisationUpdate> completed (1.22wmf2) at Sat May 4 02:20:30 UTC 2013 [production]
02:12 <LocalisationUpdate> completed (1.22wmf3) at Sat May 4 02:12:01 UTC 2013 [production]
01:17 <Krinkle> binasher restarted gerrit [production]
00:48 <Krinkle> as of an hour ago Gerrit is completely unresponsive. Filed details at https://bugzilla.wikimedia.org/show_bug.cgi?id=48061 [production]
2013-05-03 §
22:19 <py> synchronized wmf-config/db-pmtpa.php 'adding new pmtpa slave' [production]
21:09 <cmjohnson1> db10 is decommissioned...powering down for the final time [production]
20:03 <maxsem> synchronized php-1.22wmf2/extensions/MobileFrontend/includes/MobileFrontend.hooks.php [production]
19:54 <maxsem> synchronized php-1.22wmf3/extensions/MobileFrontend/includes/MobileFrontend.hooks.php [production]