|
2018-08-16
§
|
| 13:05 |
<gehel> |
restarting blazegraph on wdqs[12]003 |
[production] |
| 12:44 |
<moritzm> |
upgrading wikidiff to 1.7.2 on labweb* (HHVM bytecode cache is pruned during update) |
[production] |
| 12:08 |
<arturo> |
T201473 install a new version of `prometheus-pdns-exporter` (0.3) into jessie-wikimedia, due to errors in the postinst script |
[production] |
| 12:06 |
<gehel> |
depooling wdqs[12]003 to catchup on updates |
[production] |
| 12:00 |
<moritzm> |
installing ruby2.3 security updates |
[production] |
| 11:37 |
<arturo> |
T201473 copy `prometheus-pdns-exporter` from trusty-wikimedia to jessie-wikimedia in reprepro |
[production] |
| 11:34 |
<Amir1> |
EU mid-day SWAT is done |
[production] |
| 11:31 |
<ladsgroup@deploy1001> |
Synchronized php-1.32.0-wmf.16/maintenance/populateChangeTagDef.php: SWAT: [[gerrit:452950|Add option to populateChangeTagDef not to update the count]] (duration: 00m 53s) |
[production] |
| 11:12 |
<jynus> |
stopping db2042 for maintenance T202051 |
[production] |
| 11:09 |
<moritzm> |
upgrading wikidiff to 1.7.2 on mw1339-mw1348 (HHVM bytecode cache is pruned during update) |
[production] |
| 11:03 |
<arturo> |
manually delete glance rsync image cronjob from the glancesync user in labcontrol1001.wikimedia.org (leftover after glance merge in main/eqiad1) |
[production] |
| 10:43 |
<moritzm> |
upgrading wikidiff to 1.7.2 on mw1285-mw1290 and mw1312-mw1317 (HHVM bytecode cache is pruned during update) |
[production] |
| 10:30 |
<_joe_> |
restarting changeprop on scb1002, not listening on its tcp port |
[production] |
| 10:27 |
<_joe_> |
restarting cpjobqueue on scb1002, not listening on its tcp port |
[production] |
| 10:00 |
<volans> |
add jiji to the 'ops' LDAP group - T201849 |
[production] |
| 09:46 |
<gehel> |
all elasticsearch nodes reimaged (except elastic1029, waiting on memory issue) - T198391 / T193649 / T201991 |
[production] |
| 09:16 |
<gehel> |
reimaging elastic1022 |
[production] |
| 08:40 |
<moritzm> |
upgrading wikidiff to 1.7.2 on mw1319-mw1333 (HHVM bytecode cache is pruned during update) |
[production] |
| 08:37 |
<ema> |
reboot cp2009 for kernel upgrade |
[production] |
| 08:35 |
<vgutierrez> |
Reimaging radon as spare system - T202040 |
[production] |
| 08:32 |
<moritzm> |
uploaded jenkins 2.121.3 to apt.wikimedia.org (for jessie and stretch) |
[production] |
| 08:16 |
<moritzm> |
upgrading wikidiff to 1.7.2 on mw1334-mw1338/mw1307/mw1318/ (HHVM bytecode cache is pruned during update) |
[production] |
| 07:49 |
<gehel> |
reimaging elastic10(23|24) |
[production] |
| 07:45 |
<volans@deploy1001> |
Finished deploy [debmonitor/deploy@1f01fd1]: Release v0.1.8 (duration: 00m 31s) |
[production] |
| 07:45 |
<volans@deploy1001> |
Started deploy [debmonitor/deploy@1f01fd1]: Release v0.1.8 |
[production] |
| 07:27 |
<moritzm> |
rebooting install1002 for kernel security update |
[production] |
| 07:24 |
<moritzm> |
rebooting install2002 for kernel security update |
[production] |
| 05:12 |
<_joe_> |
moving away corrupted commitlog file on aqs1007 cassandra-a instance, trying to restart it |
[production] |
| 02:38 |
<l10nupdate@deploy1001> |
ResourceLoader cache refresh completed at Thu Aug 16 02:38:46 UTC 2018 (duration 10m 17s) |
[production] |
| 02:28 |
<l10nupdate@deploy1001> |
scap sync-l10n completed (1.32.0-wmf.16) (duration: 08m 38s) |
[production] |
|
2018-08-15
§
|
| 22:43 |
<krinkle@deploy1001> |
Finished scap: rm StartProfiler.php - T201782 (duration: 31m 46s) |
[production] |
| 22:33 |
<XioNoX> |
update old eqiad recdns IPs in cr1/2-eqiad bgp group Anycast4 with dns1001/2 |
[production] |
| 22:11 |
<krinkle@deploy1001> |
Started scap: rm StartProfiler.php - T201782 |
[production] |
| 21:57 |
<krinkle@deploy1001> |
Synchronized php-1.32.0-wmf.10: rm StartProfiler.php - T201782 (duration: 03m 01s) |
[production] |
| 21:48 |
<krinkle@deploy1001> |
Synchronized wmf-config/: I173a02910c (duration: 00m 50s) |
[production] |
| 21:46 |
<krinkle@deploy1001> |
Synchronized scap/plugins/: I173a02910c (duration: 00m 50s) |
[production] |
| 20:49 |
<krinkle@deploy1001> |
Synchronized wmf-config/CommonSettings.php: I207421c87eb6d2f1 (duration: 00m 57s) |
[production] |
| 19:07 |
<gehel> |
reimaging elastic10(18|19|20) |
[production] |
| 17:20 |
<XioNoX> |
Rollback: redirect ns2 to authdns1001 - T201608 |
[production] |
| 17:16 |
<moritzm> |
reboot eeden for kernel security update |
[production] |
| 17:07 |
<XioNoX> |
redirect ns2 to authdns1001 - T201608 |
[production] |
| 17:00 |
<moritzm> |
reboot radon for kernel security update |
[production] |
| 16:50 |
<XioNoX> |
redirect ns0 to authdns1001 - T201608 |
[production] |
| 16:42 |
<XioNoX> |
rollback: redirect ns1 to radon - T201608 |
[production] |
| 16:35 |
<moritzm> |
reboot authdns2001 for kernel security update |
[production] |
| 16:27 |
<XioNoX> |
redirect ns1 to radon - T201608 |
[production] |
| 14:58 |
<gehel> |
reimaging elastic1028 |
[production] |
| 14:50 |
<ejegg> |
disabled CiviCRM dedupe jobs |
[production] |
| 14:47 |
<ejegg> |
updated SmashPig free-standing deployment from 2736e41045 to 3603e191a3 |
[production] |
| 14:13 |
<gehel> |
reimaging elastic102[567] |
[production] |