|
2018-11-26
§
|
| 17:22 |
<jdrewniak@deploy1001> |
Synchronized portals: Wikimedia Portals Update: [[gerrit:475791|Reverting: Bumping portals to master (T128546)]] (duration: 00m 46s) |
[production] |
| 17:22 |
<jdrewniak@deploy1001> |
Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:475791|Reverting: Bumping portals to master (T128546)]] (duration: 00m 46s) |
[production] |
| 17:16 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1090:3312 and db1122 (duration: 00m 46s) |
[production] |
| 16:01 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1090:3312 to clone db1122 (duration: 00m 46s) |
[production] |
| 16:00 |
<marostegui> |
Stop MySQL on db1090:3312 to clone db1122 |
[production] |
| 15:57 |
<marostegui> |
Stop MySQL on db1122 - it will be recloned |
[production] |
| 15:50 |
<ppchelko@deploy1001> |
Finished deploy [changeprop/deploy@77be2c6]: Change schema for revision-score events and start emitting again T197000 (duration: 01m 24s) |
[production] |
| 15:48 |
<ppchelko@deploy1001> |
Started deploy [changeprop/deploy@77be2c6]: Change schema for revision-score events and start emitting again T197000 |
[production] |
| 15:32 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1122 - actor table missing (duration: 00m 46s) |
[production] |
| 15:27 |
<ppchelko@deploy1001> |
Finished deploy [changeprop/deploy@b97e8eb]: Temporary stop emitting revision-score events for schema change T197000 (duration: 01m 21s) |
[production] |
| 15:26 |
<ppchelko@deploy1001> |
Started deploy [changeprop/deploy@b97e8eb]: Temporary stop emitting revision-score events for schema change T197000 |
[production] |
| 15:24 |
<anomie@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Setting actor migration to write-both/read-old on group 1 (T188327) (duration: 00m 46s) |
[production] |
| 13:47 |
<moritzm> |
rebooting releases1001 |
[production] |
| 13:36 |
<moritzm> |
rebooting releases2001 |
[production] |
| 13:33 |
<moritzm> |
rebooting netmon1003 |
[production] |
| 12:04 |
<_joe_> |
uploaded php-excimer for component thirdparty/php72 to stretch-wikimedia T205059 |
[production] |
| 12:00 |
<kartik@deploy1001> |
Finished deploy [cxserver/deploy@da41227]: Disable Youdao MT until service is back (duration: 04m 01s) |
[production] |
| 11:56 |
<kartik@deploy1001> |
Started deploy [cxserver/deploy@da41227]: Disable Youdao MT until service is back |
[production] |
| 11:41 |
<arturo> |
icinga downtime cloudcontrol1004 for some systemd slice tests |
[production] |
| 11:01 |
<jdrewniak@deploy1001> |
Synchronized portals: Wikimedia Portals Update: [[gerrit:475721|Bumping portals to master (T128546)]] (duration: 00m 46s) |
[production] |
| 11:00 |
<jdrewniak@deploy1001> |
Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:475721|Bumping portals to master (T128546)]] (duration: 00m 47s) |
[production] |
| 10:32 |
<moritzm> |
rebooting boron |
[production] |
| 09:58 |
<banyek> |
performing schema change on s6 master - db1061 for frwiki (T85757) |
[production] |
| 09:51 |
<banyek> |
performing schema change on s6 master - db1061 for ruwiki (T85757) |
[production] |
| 09:44 |
<banyek> |
performing schema change on s6 master - db1061 for jawiki (T85757) |
[production] |
| 08:35 |
<moritzm> |
removed labvirt1015 from debmonitor DB (got renamed to cloudvirt1015) |
[production] |
| 08:22 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1096:3316 - T202167 (duration: 00m 46s) |
[production] |
| 08:16 |
<marostegui> |
Deploy schema change on db1096:3316 - T202167 |
[production] |
| 08:16 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1096:3316 - T202167 (duration: 00m 47s) |
[production] |
| 08:10 |
<moritzm> |
installing pixman security updates |
[production] |
| 07:36 |
<elukey> |
restart memcached on mc1021 (cache wipe) to add -R 200 - T208844 |
[production] |
| 07:10 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1088 - T86338 (duration: 00m 46s) |
[production] |
| 07:00 |
<marostegui> |
Deploy schema change on db1088 - T86338 |
[production] |
| 06:59 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1088 - T86338 (duration: 00m 46s) |
[production] |
| 06:46 |
<marostegui> |
Deploy schema change on db2067 - T86338 |
[production] |
| 06:36 |
<marostegui> |
Deploy schema change on s3 master (db1075) - T86339 |
[production] |
| 06:28 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1077 - T86339 (duration: 00m 46s) |
[production] |
| 06:22 |
<marostegui> |
Reload haproxy on dbproxy1005 |
[production] |
| 06:21 |
<marostegui> |
Deploy schema change on db1077 (s3 sanitarium master) with replication - T86339 |
[production] |
| 06:21 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1077 - T86339 (duration: 00m 50s) |
[production] |
| 06:02 |
<kartik@deploy1001> |
Finished deploy [cxserver/deploy@d2173ca]: Update cxserver to 218a543 (duration: 04m 21s) |
[production] |
| 05:58 |
<kartik@deploy1001> |
Started deploy [cxserver/deploy@d2173ca]: Update cxserver to 218a543 |
[production] |
|
2018-11-23
§
|
| 21:15 |
<bawolff> |
deploy patch for T210192 |
[production] |
| 16:53 |
<bblack> |
cleaned up remnants of globalsign-2017 unified cert (OCSP cache/config, unmanaged cert files, etc) on all cpNNNN - T206804 |
[production] |
| 14:02 |
<gehel> |
restor wdqs-updater heap to 2G - T210235 |
[production] |
| 13:32 |
<moritzm> |
installing confuse security updates |
[production] |
| 12:04 |
<gehel> |
manually increasing wdqs-updater heap to 4G - T210235 |
[production] |
| 11:37 |
<gehel> |
restarting updater on all wdqs ndoes |
[production] |
| 08:41 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: dc=.*,service=zotero,cluster=kubernetes,name=.* |
[production] |