7101-7150 of 10000 results (57ms)
2018-11-26 §
17:53 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Fully repool db1122 (duration: 00m 46s) [production]
17:44 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1122 (duration: 00m 46s) [production]
17:35 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1122 (duration: 00m 46s) [production]
17:26 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1122 (duration: 00m 45s) [production]
17:22 <jdrewniak@deploy1001> Synchronized portals: Wikimedia Portals Update: [[gerrit:475791|Reverting: Bumping portals to master (T128546)]] (duration: 00m 46s) [production]
17:22 <jdrewniak@deploy1001> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:475791|Reverting: Bumping portals to master (T128546)]] (duration: 00m 46s) [production]
17:16 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1090:3312 and db1122 (duration: 00m 46s) [production]
16:01 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1090:3312 to clone db1122 (duration: 00m 46s) [production]
16:00 <marostegui> Stop MySQL on db1090:3312 to clone db1122 [production]
15:57 <marostegui> Stop MySQL on db1122 - it will be recloned [production]
15:50 <ppchelko@deploy1001> Finished deploy [changeprop/deploy@77be2c6]: Change schema for revision-score events and start emitting again T197000 (duration: 01m 24s) [production]
15:48 <ppchelko@deploy1001> Started deploy [changeprop/deploy@77be2c6]: Change schema for revision-score events and start emitting again T197000 [production]
15:32 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1122 - actor table missing (duration: 00m 46s) [production]
15:27 <ppchelko@deploy1001> Finished deploy [changeprop/deploy@b97e8eb]: Temporary stop emitting revision-score events for schema change T197000 (duration: 01m 21s) [production]
15:26 <ppchelko@deploy1001> Started deploy [changeprop/deploy@b97e8eb]: Temporary stop emitting revision-score events for schema change T197000 [production]
15:24 <anomie@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Setting actor migration to write-both/read-old on group 1 (T188327) (duration: 00m 46s) [production]
13:47 <moritzm> rebooting releases1001 [production]
13:36 <moritzm> rebooting releases2001 [production]
13:33 <moritzm> rebooting netmon1003 [production]
12:04 <_joe_> uploaded php-excimer for component thirdparty/php72 to stretch-wikimedia T205059 [production]
12:00 <kartik@deploy1001> Finished deploy [cxserver/deploy@da41227]: Disable Youdao MT until service is back (duration: 04m 01s) [production]
11:56 <kartik@deploy1001> Started deploy [cxserver/deploy@da41227]: Disable Youdao MT until service is back [production]
11:41 <arturo> icinga downtime cloudcontrol1004 for some systemd slice tests [production]
11:01 <jdrewniak@deploy1001> Synchronized portals: Wikimedia Portals Update: [[gerrit:475721|Bumping portals to master (T128546)]] (duration: 00m 46s) [production]
11:00 <jdrewniak@deploy1001> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:475721|Bumping portals to master (T128546)]] (duration: 00m 47s) [production]
10:32 <moritzm> rebooting boron [production]
09:58 <banyek> performing schema change on s6 master - db1061 for frwiki (T85757) [production]
09:51 <banyek> performing schema change on s6 master - db1061 for ruwiki (T85757) [production]
09:44 <banyek> performing schema change on s6 master - db1061 for jawiki (T85757) [production]
08:35 <moritzm> removed labvirt1015 from debmonitor DB (got renamed to cloudvirt1015) [production]
08:22 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1096:3316 - T202167 (duration: 00m 46s) [production]
08:16 <marostegui> Deploy schema change on db1096:3316 - T202167 [production]
08:16 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1096:3316 - T202167 (duration: 00m 47s) [production]
08:10 <moritzm> installing pixman security updates [production]
07:36 <elukey> restart memcached on mc1021 (cache wipe) to add -R 200 - T208844 [production]
07:10 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1088 - T86338 (duration: 00m 46s) [production]
07:00 <marostegui> Deploy schema change on db1088 - T86338 [production]
06:59 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1088 - T86338 (duration: 00m 46s) [production]
06:46 <marostegui> Deploy schema change on db2067 - T86338 [production]
06:36 <marostegui> Deploy schema change on s3 master (db1075) - T86339 [production]
06:28 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1077 - T86339 (duration: 00m 46s) [production]
06:22 <marostegui> Reload haproxy on dbproxy1005 [production]
06:21 <marostegui> Deploy schema change on db1077 (s3 sanitarium master) with replication - T86339 [production]
06:21 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1077 - T86339 (duration: 00m 50s) [production]
06:02 <kartik@deploy1001> Finished deploy [cxserver/deploy@d2173ca]: Update cxserver to 218a543 (duration: 04m 21s) [production]
05:58 <kartik@deploy1001> Started deploy [cxserver/deploy@d2173ca]: Update cxserver to 218a543 [production]
2018-11-25 §
10:40 <_joe_> restarting pdfrender on scb1002, flapping since 3:00 UTC [production]
2018-11-23 §
21:15 <bawolff> deploy patch for T210192 [production]
16:53 <bblack> cleaned up remnants of globalsign-2017 unified cert (OCSP cache/config, unmanaged cert files, etc) on all cpNNNN - T206804 [production]
14:02 <gehel> restor wdqs-updater heap to 2G - T210235 [production]