1151-1200 of 10000 results (78ms)
2019-12-19 ยง
13:41 <phamhi@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:41 <phamhi@cumin1001> START - Cookbook sre.hosts.downtime [production]
13:35 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1136', diff saved to https://phabricator.wikimedia.org/P9979 and previous config saved to /var/cache/conftool/dbconfig/20191219-133525-marostegui.json [production]
13:34 <ema> pool cp1089 with ATS backend T227432 [production]
13:33 <ema> pool cp2023 with ATS backend T227432 [production]
13:18 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1136', diff saved to https://phabricator.wikimedia.org/P9978 and previous config saved to /var/cache/conftool/dbconfig/20191219-131832-marostegui.json [production]
13:17 <ema@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:15 <James_F> mwscript emptyUserGroup.php --wiki=mediawikiwiki oauthadmin T241142 [production]
13:15 <ema@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:12 <ema@cumin1001> START - Cookbook sre.hosts.downtime [production]
13:12 <ema@cumin1001> START - Cookbook sre.hosts.downtime [production]
13:08 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1136', diff saved to https://phabricator.wikimedia.org/P9977 and previous config saved to /var/cache/conftool/dbconfig/20191219-130832-marostegui.json [production]
13:02 <jforrester@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.35.0-wmf.11 [production]
12:57 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1136', diff saved to https://phabricator.wikimedia.org/P9976 and previous config saved to /var/cache/conftool/dbconfig/20191219-125748-marostegui.json [production]
12:53 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1136, s7 candidate master, for upgrade', diff saved to https://phabricator.wikimedia.org/P9975 and previous config saved to /var/cache/conftool/dbconfig/20191219-125314-marostegui.json [production]
12:52 <moritzm> failover ganeti master in ulsfo to ganeti4002 for a test [production]
12:52 <jforrester@deploy1001> Synchronized php-1.35.0-wmf.11/extensions/WikiLove/includes/ApiWikiLove.php: T241094 ApiWikiLove: Don't pass null to implode(), but fall back to [] (duration: 01m 02s) [production]
12:52 <ema> depool cp2023 and cp1089 for ATS reimages T227432. Reimaged together because of T238817 [production]
12:37 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: Cleanup: Remove CLI 'display_errors=stderr' setting (duration: 01m 01s) [production]
12:37 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
12:35 <jiji@cumin1001> START - Cookbook sre.hosts.downtime [production]
12:32 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: Cleanup: Remove very old 'error_append_string' INI override (duration: 01m 02s) [production]
12:30 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: Cleanup: Move core DB/SQL-related config closer together (duration: 01m 02s) [production]
12:03 <moritzm> installing netflow4001 [production]
11:43 <addshore> addshore@mwmaint1002:~$ mwscript extensions/Wikibase/repo/maintenance/rebuildPropertyTerms.php --wiki=wikidatawiki --batch-size=5 --from-id=4089887 # T237984 - Will stop after P433 [production]
11:28 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:26 <jiji@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:05 <moritzm> removing kubestagetcd1001-1003 from debmonitor T224568 [production]
11:04 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1104', diff saved to https://phabricator.wikimedia.org/P9974 and previous config saved to /var/cache/conftool/dbconfig/20191219-110404-marostegui.json [production]
10:50 <ema> pool cp3064 with ATS backend T227432 [production]
10:40 <effie> pool mw1320 [production]
10:23 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1104', diff saved to https://phabricator.wikimedia.org/P9973 and previous config saved to /var/cache/conftool/dbconfig/20191219-102316-marostegui.json [production]
10:21 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:18 <jiji@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:10 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1104', diff saved to https://phabricator.wikimedia.org/P9972 and previous config saved to /var/cache/conftool/dbconfig/20191219-101024-marostegui.json [production]
10:09 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1093', diff saved to https://phabricator.wikimedia.org/P9971 and previous config saved to /var/cache/conftool/dbconfig/20191219-100938-marostegui.json [production]
10:00 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1104', diff saved to https://phabricator.wikimedia.org/P9970 and previous config saved to /var/cache/conftool/dbconfig/20191219-095959-marostegui.json [production]
09:56 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1093', diff saved to https://phabricator.wikimedia.org/P9969 and previous config saved to /var/cache/conftool/dbconfig/20191219-095559-marostegui.json [production]
09:53 <effie> depool mw1320 [production]
09:51 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1104, s8 candidate master, for upgrade', diff saved to https://phabricator.wikimedia.org/P9968 and previous config saved to /var/cache/conftool/dbconfig/20191219-095158-marostegui.json [production]
09:50 <ema@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:49 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1093', diff saved to https://phabricator.wikimedia.org/P9967 and previous config saved to /var/cache/conftool/dbconfig/20191219-094945-marostegui.json [production]
09:49 <jmm@deploy1001> Finished deploy [debmonitor/deploy@c056c3c]: debmonitor release v0.2.1 - T237978 (duration: 02m 24s) [production]
09:48 <ema@cumin1001> START - Cookbook sre.hosts.downtime [production]
09:47 <jmm@deploy1001> Started deploy [debmonitor/deploy@c056c3c]: debmonitor release v0.2.1 - T237978 [production]
09:41 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2084:3314, db2084:3315 T241103', diff saved to https://phabricator.wikimedia.org/P9966 and previous config saved to /var/cache/conftool/dbconfig/20191219-094135-marostegui.json [production]
09:40 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1093', diff saved to https://phabricator.wikimedia.org/P9965 and previous config saved to /var/cache/conftool/dbconfig/20191219-093959-marostegui.json [production]
09:39 <ema> pool cp1087 with ATS backend T227432 [production]
09:31 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1093, s6 candidate master, for upgrade', diff saved to https://phabricator.wikimedia.org/P9964 and previous config saved to /var/cache/conftool/dbconfig/20191219-093116-marostegui.json [production]
09:29 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1081', diff saved to https://phabricator.wikimedia.org/P9963 and previous config saved to /var/cache/conftool/dbconfig/20191219-092920-marostegui.json [production]