6751-6800 of 10000 results (43ms)
2015-09-22 §
10:03 <godog> finished stressdisk on restbase200[123] no errors reported [production]
10:03 <moritzm> enabled ferm on mw1259 (videoscaler) [production]
04:35 <l10nupdate@tin> ResourceLoader cache refresh completed at Tue Sep 22 04:35:46 UTC 2015 (duration 35m 45s) [production]
02:22 <l10nupdate@tin> LocalisationUpdate completed (1.26wmf23) at 2015-09-22 02:22:56+00:00 [production]
02:19 <l10nupdate@tin> Synchronized php-1.26wmf23/cache/l10n: l10nupdate for 1.26wmf23 (duration: 06m 00s) [production]
01:53 <mutante> sodium - deleted salt key, revoked puppet cert, rm from icinga .. [production]
00:32 <ori> Disabled Puppet for 24h on hafnium and stopped ganglia-monitor. gmond was saturating CPU. [production]
2015-09-21 §
23:29 <krinkle@tin> Synchronized php-1.26wmf23/extensions/NavigationTiming/modules/ext.navigationTiming.js: T112593 (duration: 00m 14s) [production]
23:21 <krenair@tin> Synchronized php-1.26wmf22/extensions/Wikidata: https://gerrit.wikimedia.org/r/#/c/239828/ (duration: 00m 21s) [production]
23:07 <krenair@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/238357/ (duration: 00m 13s) [production]
22:26 <mutante> restarting gerrit for ssh config change [production]
20:41 <mdholloway> MobileApps deployed sha1 013044e [production]
20:39 <chasemp> banning elastic1005 for T112559 [production]
20:29 <subbu> deployed parsoid version 9984d221 [production]
19:40 <urandom> temporarily stopping codfw restbase cassandra nodes to test quorum auth [production]
19:15 <ori@tin> Synchronized wmf-config/CommonSettings.php: Ieccb23f: Enable async secondary writes for mysql-multiwrite cache (on testwiki) (duration: 00m 13s) [production]
18:16 <cmjohnson1> disabling puppet on mw1031 [production]
17:58 <chasemp> banning 1030 from eqiad elastic cluster for T112559#1660068 [production]
15:22 <thcipriani@tin> Synchronized php-1.26wmf23/extensions/ContentTranslation/modules/entrypoint/ext.cx.interlanguagelink.js: SWAT: Revert "Do not call cxserver to display gray interwiki link" [[gerrit:239819]] (duration: 00m 11s) [production]
15:10 <thcipriani@tin> Synchronized robots.txt: SWAT: Remove redundant entries from robots.txt [[gerrit:239403]] (duration: 00m 12s) [production]
14:33 <ottomata> restart eventlogging with mysql consumer replace=True (AKA INSERT IGNORE) [production]
14:09 <godog> rolling restart restbase in production after cassandra credentials change [production]
12:53 <godog> rolling restart cassandra after enabling dc encryption, no nodes in codfw yet [production]
12:01 <moritzm> repooled mw1160 (for T104969) [production]
11:54 <moritzm> depooled mw1160 (for T104969) [production]
11:51 <moritzm> repooled mw1158, mw1159 (for T104969) [production]
11:39 <moritzm> depooled mw1158, mw1159 (for T104969) [production]
11:37 <moritzm> depooled and repooled mw1156, mw1157 (for T104969) [production]
11:26 <moritzm> repooled mw1154, mw1155 (for T104969) [production]
11:21 <moritzm> depooled mw1154, mw1155 (for T104969) [production]
10:39 <moritzm> repooled mw1026-mw1029 and mw1110-mw1113 (for T104968) [production]
10:24 <moritzm> depooled mw1026-mw1029 and mw1110-mw1113 (for T104968) [production]
10:17 <moritzm> repooled mw1100-mw1109 (for T104968) [production]
10:17 <godog> create restbase user on cassandra cluster [production]
10:06 <moritzm> depooled mw1100-mw1109 (for T104968) [production]
09:56 <moritzm> repooled mw1140 and mw1142-mw1148 (for T104968) [production]
09:41 <moritzm> depooled mw1140 and mw1142-mw1148 (for T104968) [production]
09:36 <moritzm> repooled mw1130-mw1139 (for T104968) [production]
09:22 <moritzm> depooled mw1130-mw1139 (for T104968) [production]
09:14 <moritzm> repooled mw1120-mw1129 (for T104968) [production]
09:02 <moritzm> depooled mw1120-mw1129 (for T104968) [production]
08:48 <moritzm> repooled mw1189 and mw1200-mw1208 (for T104968) [production]
08:33 <moritzm> depooled mw1189 and mw1200-mw1208 (for T104968) [production]
08:29 <godog> switch to 'restbase' cassandra user on restbase test cluster [production]
08:29 <moritzm> repooled mw1190-mw1195 and mw1197-mw1199 (for T104968) [production]
08:21 <_joe_> restarted the logstash agent on logstash1003, OOM'd [production]
08:18 <moritzm> depooled mw1190-mw1195 and mw1197-mw1199 (for T104968) [production]
08:07 <_joe_> installing the new HHVM package on the api canaries [production]
08:04 <moritzm> repooled mw1221-mw1229 (for T104968) [production]
07:53 <moritzm> depooled mw1221-mw1229 (for T104968) [production]