1651-1700 of 10000 results (31ms)
2016-03-29 §
03:29 <bblack> cr1/2-eqiad: re-activating static routes for ns0/ns1 (ipv4/ipv6) pointing to radon - [production]
02:45 <Krinkle> mwscript deleteEqualMessages.php --wiki zhwikisource [production]
02:45 <Krinkle> mwscript deleteEqualMessages.php --wiki zhwikinews [production]
02:36 <l10nupdate@tin> ResourceLoader cache refresh completed at Tue Mar 29 02:36:39 UTC 2016 (duration 8m 46s) [production]
02:27 <mwdeploy@tin> sync-l10n completed (1.27.0-wmf.18) (duration: 11m 34s) [production]
01:07 <Pchelolo> restbase finish update to 3ea08751a8 [production]
01:00 <Pchelolo> restbase start update to 3ea08751a8 [production]
00:15 <krinkle@tin> Synchronized docroot/wikipedia.org/speed-tests/: (no message) (duration: 00m 32s) [production]
00:12 <mutante> mw2090 - reinstalled, re-signed puppet/salt [production]
2016-03-28 §
23:38 <maxsem@tin> Synchronized php-1.27.0-wmf.18/includes/api/ApiUpload.php: https://gerrit.wikimedia.org/r/#/c/280092/ (duration: 02m 26s) [production]
23:34 <mutante> mw2090 - reboot, reinstall as regular appserver [production]
23:27 <maxsem@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/280115/ (duration: 00m 35s) [production]
23:18 <maxsem@tin> Synchronized php-1.27.0-wmf.18/extensions/Echo/: https://gerrit.wikimedia.org/r/#/c/280112/ (duration: 00m 43s) [production]
23:16 <maxsem@tin> Synchronized php-1.27.0-wmf.18/extensions/MobileApp/: https://gerrit.wikimedia.org/r/#q,279980,n,z (duration: 01m 07s) [production]
22:03 <mutante> mw2090 - disable puppet/cron, crons now on wasat [production]
21:46 <mutante> mw1119 restarted hhvm [production]
21:26 <bblack> http/2 enabled on pinkunicorn.wikimedia.org for testing - T96848 [production]
21:26 <bblack> http/2 enabled on pinkunicorn.wikimedia.org for testing [production]
21:12 <Pchelolo> restbase finised deploy of 78e6eab37c [production]
21:04 <Pchelolo> restbase start deploy of 78e6eab37c [production]
21:04 <mdholloway> mobileapps deployed 90cfdcd [production]
20:37 <Pchelolo> restbase canary deploy of 78e6eab37c to restbase1005 [production]
20:35 <mdholloway> starting mobileapps deployment [production]
18:30 <andrewbogott> labs public DNS will remain in a transitional state until MarkMonitor updates their records and the TTL expires. DNS resolution should proceed as usual in the meantime. [production]
18:03 <mutante> mw1140 restart hhvm [production]
17:52 <cmjohnson1> shutting down radon to re-apply thermal paste: [production]
17:45 <mutante> mw1152,mw2090,terbium apt-get remove python-mysqldb (T84075) [production]
17:44 <legoktm> manually fixed T129881 rename [production]
17:20 <paravoid> cr1/2-eqiad: deactivating static routes for ns0/ns1 (ipv4/ipv6) pointing to radon [production]
17:18 <bblack> rebooting radon again [production]
15:31 <thcipriani@tin> Synchronized php-1.27.0-wmf.18/extensions/OpenStackManager/OpenStackManager.php: SWAT: Wikitech: Remove address, domain, proxy special pages [[gerrit:279569]] (duration: 00m 31s) [production]
13:32 <bblack> rebooting radon (unresponsive console) [production]
08:44 <paravoid> force-rebooting ms-be2008 to fix hundreds of unkillable mkfs.xfs stuck due to a hosed disk [production]
08:21 <paravoid> powercycling ms-be2016, down for ~1d, unresponsive on console [production]
02:35 <l10nupdate@tin> ResourceLoader cache refresh completed at Mon Mar 28 02:35:00 UTC 2016 (duration 8m 26s) [production]
02:26 <mwdeploy@tin> sync-l10n completed (1.27.0-wmf.18) (duration: 11m 32s) [production]
2016-03-27 §
22:21 <ori@tin> Synchronized wmf-config/StartProfiler.php: I1b5c620b85: Better request profiling via XWD header (duration: 00m 33s) [production]
20:11 <elukey> restarted hhvm on mw1123 [production]
20:04 <elukey> Increased nf_conntrack_max to ~528k for the kafka brokers (https://gerrit.wikimedia.org/r/279776) [production]
02:57 <jzerebecki> disabling 2fa for Dereckson T130892 [labswiki]> delete from oathauth_users where id=402; [production]
02:31 <l10nupdate@tin> ResourceLoader cache refresh completed at Sun Mar 27 02:31:03 UTC 2016 (duration 8m 35s) [production]
02:22 <mwdeploy@tin> sync-l10n completed (1.27.0-wmf.18) (duration: 10m 06s) [production]
01:51 <jzerebecki> disabling 2fa for Hym411 T130994 [labswiki]> delete from oathauth_users where id=1363; [production]
2016-03-26 §
21:11 <csteipp_ooo> removed 2FA from wikitech accounts that looked to be affected by T130892 [production]
16:21 <krenair@tin> Synchronized php-1.27.0-wmf.18/extensions/SemanticForms: https://gerrit.wikimedia.org/r/#/c/279701/ (duration: 00m 32s) [production]
13:46 <urandom> Cassandra on restbase2004.codfw.wmnet shut down, hardware failure; Down for the weekend : T130990 [production]
13:26 <urandom> Stopping Cassandra on restbase2004.codfw.wmnet [production]
02:31 <l10nupdate@tin> ResourceLoader cache refresh completed at Sat Mar 26 02:31:13 UTC 2016 (duration 8m 34s) [production]
02:22 <mwdeploy@tin> sync-l10n completed (1.27.0-wmf.18) (duration: 10m 06s) [production]
00:11 <mutante|away> scb[12]00[12] - delete changeprop main.log per request [production]