7751-7800 of 10000 results (67ms)
2018-05-07 §
09:30 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1084 for alter table (duration: 01m 03s) [production]
09:25 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1081 after alter table (duration: 01m 02s) [production]
09:02 <moritzm> reimaging mw1275 (T192902) [production]
08:58 <mobrovac@tin> Started restart [recommendation-api/deploy@ac66089]: Use the internal WDQS cluster LVS - T190266 [production]
08:56 <elukey> drain + reimage analytics103[7,8] to Debian Stretch [production]
08:30 <godog> eqiad-prod: more weight to ms-be104[0-3] - T190081 [production]
08:19 <moritzm> rolling restart of logstash to pick up Java security updates [production]
08:19 <marostegui> Reload haproxy on dbproxy1010 to depool labsdb1010 - https://phabricator.wikimedia.org/T174047 [production]
08:04 <gehel> restart cassandra on maps* for JVM upgrade [production]
07:59 <gehel> restart cassandra on maps-test* for JVM upgrade [production]
07:53 <moritzm> installing libdatetime-timezone-perl stable update for jessie/stretch [production]
07:38 <gehel> restart elasticsearch on relforge for JVM upgrade [production]
07:37 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: db1074 is now db1102's master - T193732 (duration: 00m 59s) [production]
07:32 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1074 - T193732 (duration: 00m 59s) [production]
07:28 <marostegui> Change master from db1102:s2 from db1060 to db1074 [production]
07:19 <marostegui> Stop replication in sync on db1060 and db1074 - T193732 [production]
07:19 <moritzm> reimaging mw1303, mw1304 (job runners) to stretch [production]
07:18 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1074 - T193732 (duration: 00m 59s) [production]
07:06 <moritzm> reimaging mw1233, mw1234, mw1235 (API servers) to stretch [production]
07:02 <moritzm> reimaging mw1327, mw1328, mw1329 (app servers) to stretch [production]
05:37 <marostegui> Unused databases devwikiinternal and rel13testwiki from s3 - T118764 [production]
05:27 <marostegui> Deploy schema change on db1081 - T191519 T188299 T190148 [production]
05:24 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1081 for alter table (duration: 01m 01s) [production]
05:15 <marostegui> Deploy schema change on s6 primary master db1061 - T191519 T188299 T190148 [production]
03:06 <l10nupdate@tin> scap sync-l10n completed (1.32.0-wmf.2) (duration: 11m 22s) [production]
2018-05-05 §
03:36 <XioNoX> commenting rigel out from smokeping [production]
02:16 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2191.codfw.wmnet [production]
02:03 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2193.codfw.wmnet [production]
01:37 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2187.codfw.wmnet [production]
00:35 <Krinkle> Delete navtiming 'mediaWikiLoadComplete' metrics (T160315) [production]
00:26 <Krinkle> Purging values for navtiming 'mediaWikiLoadEnd' sub-properties from 2018-04-21 to 2018-05-04T04:40:00 (T160315) [production]
2018-05-04 §
22:50 <mutante> mwmaint1001 - now using mw-maintenance role, upcoming terbium replacement [production]
22:49 <mutante> mw2187 - scap proxy - reinstalling with stretch [production]
22:46 <mutante> mw2191, mw2193 - wmf-auto-reimage with --no-verify because puppet certs didnt exist [production]
22:02 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2199.codfw.wmnet [production]
22:00 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2198.codfw.wmnet [production]
21:55 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2197.codfw.wmnet [production]
19:50 <bblack> rebooting lvs1016 (downtimed, also new and not in service!) [production]
19:02 <sbisson@tin> Finished deploy [kartotherian/deploy@8e6b35b]: Use new keyspace (v4) for both i18n and non-i18n sources (duration: 03m 57s) [production]
18:58 <sbisson@tin> Started deploy [kartotherian/deploy@8e6b35b]: Use new keyspace (v4) for both i18n and non-i18n sources [production]
18:38 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2196.codfw.wmnet [production]
18:36 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2194.codfw.wmnet [production]
18:35 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2195.codfw.wmnet [production]
18:16 <mutante> mw2197,mw2198,mw2199 - reinstall with stretch [production]
18:12 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2192.codfw.wmnet [production]
18:05 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2190.codfw.wmnet [production]
18:03 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2189.codfw.wmnet [production]
17:16 <XioNoX> depolled eqsin [production]
16:57 <bawolff> adjusted login throttling code (T193762) [production]
16:50 <dzahn@neodymium> conftool action : set/pooled=inactive; selector: name=mw2196.codfw.wmnet [production]