|
2019-09-20
§
|
| 16:35 |
<krinkle@deploy1001> |
Synchronized vendor/: ead70240892e9 (duration: 00m 59s) |
[production] |
| 16:14 |
<XioNoX> |
update eqiad firewall filters - T233268 |
[production] |
| 16:11 |
<XioNoX> |
update esams firewall filters - T233268 |
[production] |
| 15:17 |
<Urbanecm> |
mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=bgwiki --logwiki=metawiki 'Newrdkter' 'NRdk' (T233313) |
[production] |
| 15:03 |
<XioNoX> |
remove AS-PATH prepending in ams |
[production] |
| 11:29 |
<@> |
helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . |
[production] |
| 11:22 |
<@> |
helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . |
[production] |
| 11:22 |
<@> |
helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . |
[production] |
| 11:22 |
<@> |
helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . |
[production] |
| 11:16 |
<@> |
helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . |
[production] |
| 11:15 |
<@> |
helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . |
[production] |
| 10:17 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.ipmi-password-reset (exit_code=0) |
[production] |
| 10:17 |
<jbond@cumin1001> |
Updating IPMI password on 1 hosts - jbond@cumin1001 |
[production] |
| 10:17 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.ipmi-password-reset |
[production] |
| 10:17 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.ipmi-password-reset (exit_code=0) |
[production] |
| 10:17 |
<jbond@cumin1001> |
Updating IPMI password on 1 hosts - jbond@cumin1001 |
[production] |
| 10:17 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.ipmi-password-reset |
[production] |
| 10:17 |
<jbond@cumin1001> |
END (FAIL) - Cookbook sre.hosts.ipmi-password-reset (exit_code=99) |
[production] |
| 10:17 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.ipmi-password-reset |
[production] |
| 09:31 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.ipmi-password-reset (exit_code=0) |
[production] |
| 09:31 |
<jbond@cumin1001> |
Updating IPMI password on 1 hosts - jbond@cumin1001 |
[production] |
| 09:31 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.ipmi-password-reset |
[production] |
| 09:30 |
<jbond@cumin1001> |
END (ERROR) - Cookbook sre.hosts.ipmi-password-reset (exit_code=97) |
[production] |
| 09:30 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.ipmi-password-reset |
[production] |
| 09:30 |
<jbond@cumin1001> |
END (FAIL) - Cookbook sre.hosts.ipmi-password-reset (exit_code=99) |
[production] |
| 09:30 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.ipmi-password-reset |
[production] |
| 08:52 |
<jynus> |
creating new database on m1 "bacula9" T229209 |
[production] |
| 08:28 |
<hashar> |
Killed zuul-server process on contint2001 which was establishing connections to Gerrit and filling the pool of allowed ssh connections # T233390 |
[production] |
| 08:23 |
<hashar> |
CI in default since it is somehow no more able to fetch from Gerrit T233390 |
[production] |
| 08:20 |
<hashar> |
contint1001: upgrade zuul to 2.5.1-wmf10 # T203846 |
[production] |
| 08:12 |
<hashar> |
contint2001: upgrade zuul to 2.5.1-wmf10 # T203846 |
[production] |
| 07:46 |
<jmm@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=False) |
[production] |
| 07:46 |
<jmm@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 07:46 |
<jmm@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=False) |
[production] |
| 07:45 |
<jmm@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 07:29 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=False) |
[production] |
| 07:28 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 07:14 |
<godog> |
eqiad-prod: start ms-be1027 decom - T233289 |
[production] |
| 05:29 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Remove db1089 from logpager and contributions after testing, repool back with normal weight on main traffic T223151', diff saved to https://phabricator.wikimedia.org/P9136 and previous config saved to /var/cache/conftool/dbconfig/20190920-052902-marostegui.json |
[production] |
| 05:27 |
<marostegui> |
Analyze table enwiki.logging on db2102 - T223151 |
[production] |
| 05:07 |
<marostegui> |
Remove temporary index on hiwikisource views T219374 |
[production] |
| 05:07 |
<marostegui> |
Remove temporary index on hiwikisource views /usr/local/sbin/maintain-views --databases $a --replace-all --clean |
[production] |
| 01:06 |
<mholloway-shell@deploy1001> |
Finished deploy [recommendation-api/deploy@a29da76]: Rolling back deployment due to alerts beginning after 0:00 UTC (duration: 02m 51s) |
[production] |
| 01:05 |
<jforrester@deploy1001> |
Synchronized php-1.34.0-wmf.23/extensions/TimedMediaHandler/: T233360 Fix Safari 13.0 regression in video playback with audio (duration: 00m 58s) |
[production] |
| 01:03 |
<mholloway-shell@deploy1001> |
Started deploy [recommendation-api/deploy@a29da76]: Rolling back deployment due to alerts beginning after 0:00 UTC |
[production] |