6251-6300 of 10000 results (33ms)
2020-11-03 ยง
13:53 <moritzm> imported php-mongodb/php-wmerrors/wikidiff2 to component/php72 for buster-wikimedia [production]
13:43 <sobanski> Removing db1091 from tendril and zarcillo T267088 [production]
13:34 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:34 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
13:33 <lsobanski@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
13:24 <lsobanski@cumin1001> START - Cookbook sre.hosts.decommission [production]
13:22 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:22 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
13:02 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:02 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
12:40 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
12:40 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:58 <moritzm> imported php-apcu/php-geoip/php-imagick/php-mailparse to component/php72 for buster-wikimedia [production]
11:57 <moritzm> running "reprepro clearvanished" to prune thirdparty/orchestrator [production]
11:51 <gilles@deploy1001> Finished deploy [performance/asoranking@2a2cb05]: T266985 (duration: 00m 03s) [production]
11:51 <gilles@deploy1001> Started deploy [performance/asoranking@2a2cb05]: T266985 [production]
11:29 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:29 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:23 <hnowlan@cumin1001> END (FAIL) - Cookbook sre.postgresql.postgres-init (exit_code=99) [production]
11:23 <hnowlan@cumin1001> START - Cookbook sre.postgresql.postgres-init [production]
11:23 <hnowlan> resyncing postgres replica maps1001 [production]
11:03 <Amir1> rolling restart of ores [production]
10:59 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:59 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:45 <gilles@deploy1001> Finished deploy [performance/asoranking@2a2cb05]: T266985 (duration: 00m 07s) [production]
10:45 <gilles@deploy1001> Started deploy [performance/asoranking@2a2cb05]: T266985 [production]
10:39 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:39 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:22 <gilles@deploy1001> Finished deploy [performance/asoranking@2a2cb05]: T266985 (duration: 00m 26s) [production]
10:21 <gilles@deploy1001> Started deploy [performance/asoranking@2a2cb05]: T266985 [production]
10:16 <elukey@deploy1001> Finished deploy [analytics/refinery@cf5db74] (hadoop-test): (no justification provided) (duration: 02m 15s) [production]
10:14 <elukey@deploy1001> Started deploy [analytics/refinery@cf5db74] (hadoop-test): (no justification provided) [production]
10:13 <elukey@deploy1001> Finished deploy [analytics/refinery@cf5db74] (hadoop-test): (no justification provided) (duration: 01m 45s) [production]
10:11 <elukey@deploy1001> Started deploy [analytics/refinery@cf5db74] (hadoop-test): (no justification provided) [production]
10:08 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:08 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
09:57 <kormat> uploaded orchestrator 3.2.3-2 to apt [production]
09:54 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:54 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
09:49 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:49 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
09:18 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:18 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
09:12 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:12 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
09:06 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:06 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
09:05 <kormat@cumin1001> dbctl commit (dc=all): 'Repooling after reboot. T261389', diff saved to https://phabricator.wikimedia.org/P13139 and previous config saved to /var/cache/conftool/dbconfig/20201103-090523-kormat.json [production]
09:00 <kormat@cumin1001> dbctl commit (dc=all): 'Rebooting for T261389', diff saved to https://phabricator.wikimedia.org/P13138 and previous config saved to /var/cache/conftool/dbconfig/20201103-090013-kormat.json [production]
09:00 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]