2201-2250 of 10000 results (75ms)
2018-05-07 §
13:35 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:431564|Set wgKartographerEnableMapFrame to true for mrwiki (T193371)]] (duration: 01m 00s) [production]
13:16 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:431561|Make test and test2 using maps i18n correctly (T191655)]] (duration: 01m 00s) [production]
12:55 <sbisson@tin> Finished deploy [kartotherian/deploy@425f279]: Kartotherian: stop using tilerator_storage_id; Add babel upstream of osm-intl (duration: 05m 41s) [production]
12:50 <sbisson@tin> Started deploy [kartotherian/deploy@425f279]: Kartotherian: stop using tilerator_storage_id; Add babel upstream of osm-intl [production]
12:27 <moritzm> reimaging mw1333 to stretch (last app server in eqiad) [production]
11:28 <moritzm> installing Java security updates on elastic* hosts [production]
10:59 <moritzm> reimaging mw1330, mw1331, mw1332 (app servers) to stretch [production]
10:50 <moritzm> depooled service nginx for mw1221-mw1231 (API servers) [production]
10:10 <jdrewniak@tin> Synchronized portals: Wikimedia Portals Update: [[gerrit:431543|Bumping portals to master (T128546)]] (duration: 00m 59s) [production]
10:09 <jdrewniak@tin> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:431543|Bumping portals to master (T128546)]] (duration: 01m 00s) [production]
09:52 <moritzm> reimaging mw1305, mw1306 (job runners) to stretch [production]
09:52 <elukey> stop graphite cassandra-metrics-collector on aqs* (touch /etc/cassandra-metrics-collector/disable) [production]
09:46 <moritzm> rolling restart of Kibana logstash nodes to pick up Java security updates [production]
09:41 <marostegui> Manually enable innodb_strict_mode on db1084 - T150949 [production]
09:30 <ema> cp-text/upload: start varnish upgrades to 5.1.3-1wm8 T192368 [production]
09:30 <marostegui> Deploy schema change on db1084 - T191519 T188299 T190148 [production]
09:30 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1084 for alter table (duration: 01m 03s) [production]
09:25 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1081 after alter table (duration: 01m 02s) [production]
09:02 <moritzm> reimaging mw1275 (T192902) [production]
08:58 <mobrovac@tin> Started restart [recommendation-api/deploy@ac66089]: Use the internal WDQS cluster LVS - T190266 [production]
08:56 <elukey> drain + reimage analytics103[7,8] to Debian Stretch [production]
08:30 <godog> eqiad-prod: more weight to ms-be104[0-3] - T190081 [production]
08:19 <moritzm> rolling restart of logstash to pick up Java security updates [production]
08:19 <marostegui> Reload haproxy on dbproxy1010 to depool labsdb1010 - https://phabricator.wikimedia.org/T174047 [production]
08:04 <gehel> restart cassandra on maps* for JVM upgrade [production]
07:59 <gehel> restart cassandra on maps-test* for JVM upgrade [production]
07:53 <moritzm> installing libdatetime-timezone-perl stable update for jessie/stretch [production]
07:38 <gehel> restart elasticsearch on relforge for JVM upgrade [production]
07:37 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: db1074 is now db1102's master - T193732 (duration: 00m 59s) [production]
07:32 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1074 - T193732 (duration: 00m 59s) [production]
07:28 <marostegui> Change master from db1102:s2 from db1060 to db1074 [production]
07:19 <marostegui> Stop replication in sync on db1060 and db1074 - T193732 [production]
07:19 <moritzm> reimaging mw1303, mw1304 (job runners) to stretch [production]
07:18 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1074 - T193732 (duration: 00m 59s) [production]
07:06 <moritzm> reimaging mw1233, mw1234, mw1235 (API servers) to stretch [production]
07:02 <moritzm> reimaging mw1327, mw1328, mw1329 (app servers) to stretch [production]
05:37 <marostegui> Unused databases devwikiinternal and rel13testwiki from s3 - T118764 [production]
05:27 <marostegui> Deploy schema change on db1081 - T191519 T188299 T190148 [production]
05:24 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1081 for alter table (duration: 01m 01s) [production]
05:15 <marostegui> Deploy schema change on s6 primary master db1061 - T191519 T188299 T190148 [production]
03:06 <l10nupdate@tin> scap sync-l10n completed (1.32.0-wmf.2) (duration: 11m 22s) [production]
2018-05-05 §
03:36 <XioNoX> commenting rigel out from smokeping [production]
02:16 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2191.codfw.wmnet [production]
02:03 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2193.codfw.wmnet [production]
01:37 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2187.codfw.wmnet [production]
00:35 <Krinkle> Delete navtiming 'mediaWikiLoadComplete' metrics (T160315) [production]
00:26 <Krinkle> Purging values for navtiming 'mediaWikiLoadEnd' sub-properties from 2018-04-21 to 2018-05-04T04:40:00 (T160315) [production]
2018-05-04 §
22:50 <mutante> mwmaint1001 - now using mw-maintenance role, upcoming terbium replacement [production]
22:49 <mutante> mw2187 - scap proxy - reinstalling with stretch [production]
22:46 <mutante> mw2191, mw2193 - wmf-auto-reimage with --no-verify because puppet certs didnt exist [production]