6001-6050 of 10000 results (37ms)
2020-05-18 §
07:00 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
06:58 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime [production]
06:41 <marostegui> Stop MySQL on db2088 [production]
06:24 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2088 for upgrade', diff saved to https://phabricator.wikimedia.org/P11213 and previous config saved to /var/cache/conftool/dbconfig/20200518-062452-marostegui.json [production]
05:55 <_joe_> installing purged 0.12 on cp2027 [production]
05:54 <_joe_> uploaded purged 0.12 to apt.w.o [production]
05:00 <marostegui> Stop MySQL on labsdb1011 to copy its content to backup1001 T249188 [production]
2020-05-16 §
22:04 <Krinkle> krinkle@mc1022 Pruning the old `echo:seen:` Redis keys that didn't have a ttl yet [production]
21:56 <Krinkle> krinkle@mc1019 Pruning the old `echo:seen:` Redis keys that didn't have a ttl yet [production]
20:23 <Krinkle> krinkle@mc1034,mc1035,mc1036 Pruning the old `echo:seen:` Redis keys that didn't have a ttl yet [production]
20:04 <Krinkle> krinkle@mc1033 Pruning the old `echo:seen:` Redis keys that didn't have a ttl yet [production]
19:57 <Krinkle> krinkle@mc1032 Pruning the old `echo:seen:` Redis keys that didn't have a ttl yet [production]
19:51 <Krinkle> krinkle@mc1031 Pruning the old `echo:seen:` Redis keys that didn't have a ttl yet [production]
19:42 <Krinkle> krinkle@mc1030 Pruning the old `echo:seen:` Redis keys that didn't have a ttl yet [production]
19:25 <Krinkle> krinkle@mc1029 Pruning the old `echo:seen:` Redis keys that didn't have a ttl yet [production]
19:10 <Krinkle> krinkle@mc1028 Pruning the old `echo:seen:` Redis keys that didn't have a ttl yet [production]
18:58 <Krinkle> krinkle@mc1027 Pruning the old `echo:seen:` Redis keys that didn't have a ttl yet, ref T252945 [production]
18:54 <Krinkle> krinkle@mc1026 Pruning the old `echo:seen:` Redis keys that didn't have a ttl yet, ref T252945 [production]
18:30 <Krinkle> krinkle@mc1024 Pruning the old `echo:seen:` Redis keys that didn't have a ttl yet, ref T252945 [production]
18:24 <Krinkle> krinkle@mc1025 Pruning the old `echo:seen:` Redis keys that didn't have a ttl yet, ref T252945 [production]
17:56 <Krinkle> krinkle@mc1023 Pruning old echo:seen: Redis keys that didn't use a ttl yet, ref T252945 [production]
17:49 <Krinkle> krinkle@mwmaint1002: Running cleanupRemovedModules.php to prune old module_deps rows T113916 [production]
17:24 <Krinkle> krinkle@mc1020 Prune old echo:seen: keys that have ttl:-1 from Redis main stash, ref T252945 [production]
15:16 <Krinkle> krinkle@mc1020 Looking at why there are still over 2M echo:seen keys in redis main stash [production]
00:55 <krinkle@deploy1001> Synchronized wmf-config/logging.php: I046868190b472 (duration: 01m 13s) [production]
00:24 <ryankemper@cumin1001> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
00:21 <ryankemper@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
00:21 <ryankemper@cumin1001> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
00:18 <ryankemper@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
00:18 <ryankemper@cumin1001> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
00:16 <ryankemper@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
00:16 <ryankemper@cumin1001> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
00:13 <ryankemper@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
00:13 <ryankemper@cumin1001> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
00:10 <ryankemper@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
00:10 <ryankemper@cumin1001> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
00:08 <ryankemper@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
00:06 <ryankemper@cumin2001> END (FAIL) - Cookbook sre.wdqs.data-transfer (exit_code=99) [production]
00:06 <ryankemper@cumin2001> START - Cookbook sre.wdqs.data-transfer [production]
00:05 <ryankemper@cumin2001> END (FAIL) - Cookbook sre.wdqs.data-transfer (exit_code=99) [production]
00:05 <ryankemper@cumin2001> START - Cookbook sre.wdqs.data-transfer [production]
2020-05-15 §
23:50 <ryankemper@cumin2001> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
23:47 <ryankemper@cumin2001> START - Cookbook sre.wdqs.data-transfer [production]
23:46 <ryankemper@cumin2001> END (FAIL) - Cookbook sre.wdqs.data-transfer (exit_code=99) [production]
23:46 <ryankemper@cumin2001> START - Cookbook sre.wdqs.data-transfer [production]
23:46 <ryankemper@cumin2001> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
23:43 <ryankemper@cumin2001> START - Cookbook sre.wdqs.data-transfer [production]
23:43 <ryankemper@cumin2001> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
23:37 <ryankemper@cumin2001> START - Cookbook sre.wdqs.data-transfer [production]
23:35 <ryankemper> Pooled wdqs2007 following successful query tests (all data transfers are done now) [production]