2017-09-11
§
|
09:40 |
<godog> |
roll-restart thumbor to apply changes for gif max animated area - T173580 |
[production] |
09:39 |
<mobrovac@tin> |
Finished deploy [cpjobqueue/deploy@e73a10f]: Initial deploy of cpjobqueue - T175281 (duration: 00m 20s) |
[production] |
09:39 |
<mobrovac@tin> |
Started deploy [cpjobqueue/deploy@e73a10f]: Initial deploy of cpjobqueue - T175281 |
[production] |
08:44 |
<mobrovac@tin> |
Finished deploy [zotero/translators@a0c41c3]: Update translators to upstream e03695273 - T174992 (duration: 00m 07s) |
[production] |
08:44 |
<mobrovac@tin> |
Started deploy [zotero/translators@a0c41c3]: Update translators to upstream e03695273 - T174992 |
[production] |
08:16 |
<volans> |
reimage script tests continue on mc100[1-2] T166300 |
[production] |
07:59 |
<moritzm> |
installing systemd updates from stretch point update |
[production] |
07:41 |
<moritzm> |
installing remaining libonig security updates |
[production] |
02:41 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Mon Sep 11 02:41:43 UTC 2017 (duration 7m 0s) |
[production] |
02:34 |
<l10nupdate@tin> |
scap sync-l10n completed (1.30.0-wmf.17) (duration: 08m 10s) |
[production] |
2017-09-08
§
|
23:46 |
<ebernhardson@tin> |
Synchronized wmf-config/CirrusSearch-rel-survey.php: T171740: Fix inverted sampling rates for human relevance survey (duration: 00m 47s) |
[production] |
23:38 |
<mutante> |
netmon1002 - terminated unused screen session |
[production] |
23:09 |
<mutante> |
phab1001, phab2001 - terminating 3 unused screen processes that were from iridium migration / data sync |
[production] |
21:54 |
<mutante> |
gerrit2001 - restarting gerrit to test logstash config change (while not touching "live" gerrit) |
[production] |
20:24 |
<demon@tin> |
Synchronized php-1.30.0-wmf.17/extensions/Flow/includes/: bugs and stuff (duration: 00m 54s) |
[production] |
20:14 |
<mutante> |
heze - rebooting for firmware upgrade |
[production] |
20:10 |
<mutante> |
heze (bacula storage) - installing BIOS upgrade (T162850) |
[production] |
20:10 |
<demon@tin> |
Synchronized scap/scap.cfg: drop git_repo for now, T175041 (duration: 00m 46s) |
[production] |
19:43 |
<mutante> |
zosma.codfw.wmnet - delete salt key, puppet node clean, puppet node deactivate, remove from Icinga,... (T138650) |
[production] |
19:37 |
<mutante> |
removing ganeti instance 'zosma' on ganeti2001 (T138650) |
[production] |
18:17 |
<demon@tin> |
Synchronized wmf-config/FeaturedFeedsWMF.php: no-op (duration: 00m 46s) |
[production] |
16:04 |
<demon@tin> |
Synchronized php-1.30.0-wmf.17/extensions/AbuseFilter/includes/Views/AbuseFilterViewExamine.php: T175338, followup (duration: 00m 46s) |
[production] |
16:03 |
<demon@tin> |
Synchronized php-1.30.0-wmf.17/includes/revisiondelete/RevDelLogList.php: typofix (duration: 00m 46s) |
[production] |
15:53 |
<bblack@neodymium> |
conftool action : set/pooled=yes; selector: name=cp4027.* |
[production] |
15:47 |
<ejegg> |
increased cURL timeout for PayPal IPN confirmation to 14 sec |
[production] |
15:07 |
<akosiaris@tin> |
Finished deploy [librenms/librenms@5554213]: Testing new scap keyholder_key config (duration: 00m 04s) |
[production] |
15:06 |
<akosiaris@tin> |
Started deploy [librenms/librenms@5554213]: Testing new scap keyholder_key config |
[production] |
15:02 |
<bblack@neodymium> |
conftool action : set/pooled=yes; selector: name=cp4021.* |
[production] |
14:58 |
<volans> |
testing wmf-auto-reimage also on mc1002 T166300 T164341 |
[production] |
12:36 |
<_joe_> |
restarting a check of the md2 devices on conf200* T162013 after reducing sync speed |
[production] |
12:36 |
<_joe_> |
reduced raid resync max speed of raid devices on conf200* to 20000 |
[production] |
10:35 |
<hashar@tin> |
Synchronized php-1.30.0-wmf.17/extensions/ProofreadPage: Restore page status buttons - T175304 (duration: 00m 50s) |
[production] |
10:12 |
<_joe_> |
stopped all md devices syncs on conf200* machines |
[production] |
10:09 |
<_joe_> |
etcd cluster lost consensus T162013 |
[production] |
10:07 |
<volans> |
testing wmf-auto-reimage on mc1001 T166300 T164341 |
[production] |
09:58 |
<_joe_> |
running the same command on conf2002 too |
[production] |
09:48 |
<_joe_> |
running `/usr/share/mdadm/checkarray --cron --all --idle --quiet` on conf2001 and conf2003 trying to reproduce consensus issues in T162013 |
[production] |
09:25 |
<moritzm> |
restarting apache on tegmen/einsteinium to pick up security update |
[production] |