1201-1250 of 10000 results (37ms)
2021-10-14 §
09:19 <volans@cumin2002> END (PASS) - Cookbook sre.debmonitor.remove-hosts (exit_code=0) for 1 hosts: sretest1001.eqiad.wmnet [production]
09:19 <volans@cumin2002> START - Cookbook sre.debmonitor.remove-hosts for 1 hosts: sretest1001.eqiad.wmnet [production]
09:19 <volans@cumin2002> END (PASS) - Cookbook sre.debmonitor.remove-hosts (exit_code=0) for 1 hosts: sretest1001.eqiad.wmnet [production]
09:19 <volans@cumin2002> START - Cookbook sre.debmonitor.remove-hosts for 1 hosts: sretest1001.eqiad.wmnet [production]
09:18 <volans@deploy1002> Finished deploy [debmonitor/deploy@ab62ac5]: Release v0.3.1 (duration: 00m 50s) [production]
09:17 <volans@deploy1002> Started deploy [debmonitor/deploy@ab62ac5]: Release v0.3.1 [production]
09:04 <volans@deploy1002> Finished deploy [debmonitor/deploy@444b931]: Release v0.3.1 (duration: 00m 45s) [production]
09:03 <volans@deploy1002> Started deploy [debmonitor/deploy@444b931]: Release v0.3.1 [production]
09:02 <volans@deploy1002> Finished deploy [debmonitor/deploy@444b931]: Release v0.3.1 (duration: 00m 23s) [production]
09:02 <volans@deploy1002> Started deploy [debmonitor/deploy@444b931]: Release v0.3.1 [production]
08:52 <volans@cumin2002> END (PASS) - Cookbook sre.debmonitor.remove-hosts (exit_code=0) for 1 hosts: sretest1001.eqiad.wmnet [production]
08:52 <volans@cumin2002> START - Cookbook sre.debmonitor.remove-hosts for 1 hosts: sretest1001.eqiad.wmnet [production]
08:51 <volans@cumin2002> END (PASS) - Cookbook sre.debmonitor.remove-hosts (exit_code=0) for 1 hosts: sretest1001.eqiad.wmnet [production]
08:51 <volans@cumin2002> START - Cookbook sre.debmonitor.remove-hosts for 1 hosts: sretest1001.eqiad.wmnet [production]
08:22 <volans> rolling out debmonitor-client upgrade to 0.3.1 across the fleet [production]
07:25 <oblivian@cumin1001> END (FAIL) - Cookbook sre.discovery.service-route (exit_code=99) [production]
07:25 <oblivian@cumin1001> START - Cookbook sre.discovery.service-route [production]
07:25 <oblivian@cumin1001> END (FAIL) - Cookbook sre.discovery.service-route (exit_code=99) [production]
07:25 <oblivian@cumin1001> START - Cookbook sre.discovery.service-route [production]
07:24 <oblivian@cumin1001> END (FAIL) - Cookbook sre.discovery.service-route (exit_code=99) [production]
07:24 <oblivian@cumin1001> START - Cookbook sre.discovery.service-route [production]
07:18 <filippo@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=swift-ro,name=eqiad [production]
07:18 <filippo@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=swift,name=eqiad [production]
07:17 <oblivian@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
06:37 <oblivian@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
01:52 <bd808@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'toolhub' for release 'main' . [production]
01:50 <foks> changing user email for "Region of Peel Archives" [production]
01:41 <ejegg> updated payments-wiki from b329d2dea2 to 19d18c1852 [production]
01:35 <bd808@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'toolhub' for release 'main' . [production]
01:31 <bd808@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'toolhub' for release 'main' . [production]
2021-10-13 §
23:37 <dzahn@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'miscweb' for release 'main' . [production]
23:36 <eileen> civicrm revision changed from 946dfb6c5a to 018d3b19fe, config revision is 85277466ed [production]
23:36 <tgr@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:730575|Create an alias for the project namespace on kswiki (T291740)]] (duration: 01m 05s) [production]
22:30 <dzahn@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'miscweb' for release 'main' . [production]
22:01 <dancy@deploy1002> Synchronized php-1.38.0-wmf.3/extensions/Collection/includes/Specials/SpecialCollection.php: Backport: [[gerrit:730578|Api: Avoid trying to access undefined offset in a user's collection (T293261)]] (duration: 01m 04s) [production]
21:50 <dancy@deploy1002> Synchronized php-1.38.0-wmf.4/extensions/Collection: Backport: [[gerrit:730577|Api: Avoid trying to access undefined offset in a user's collection (T293261)]] (duration: 01m 04s) [production]
21:47 <foks> removing 8 files for legal compliance [production]
21:03 <foks> removing 2 files for legal compliance [production]
21:00 <mbsantos@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'tegola-vector-tiles' for release 'main' . [production]
20:50 <bd808@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'toolhub' for release 'main' . [production]
20:48 <brennen@deploy1002> Synchronized php-1.38.0-wmf.4/extensions/Collection/includes/Api/ApiGetBookCreatorBoxContent.php: Backport: [[gerrit:730574|Fall back to main page if given title is invalid (T293299)]] (duration: 01m 04s) [production]
20:46 <bd808@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'toolhub' for release 'main' . [production]
20:40 <bd808@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'toolhub' for release 'main' . [production]
20:31 <mbsantos@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'tegola-vector-tiles' for release 'main' . [production]
20:27 <robh@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host kubernetes1021.eqiad.wmnet with OS stretch [production]
20:04 <robh@cumin1001> START - Cookbook sre.hosts.reimage for host kubernetes1021.eqiad.wmnet with OS stretch [production]
20:03 <robh@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host kubernetes1021.eqiad.wmnet with OS stretch [production]
20:01 <robh@cumin1001> START - Cookbook sre.hosts.reimage for host kubernetes1021.eqiad.wmnet with OS stretch [production]
19:18 <dzahn@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'miscweb' for release 'main' . [production]
19:16 <mutante> gitlab2001 - status before was that "gitlab-ctl status" showed components "gitlab-workhorse" and "postgres-exporter" as "down". this was either pre-broken or caused by the restore process. after manually 'gitlab-ctl start gitlab-workhorse' all of the components are in "run" and https://gitlab-replica.wikimedia.org is up ( T285867) [production]