|
2021-02-01
ยง
|
| 15:46 |
<XioNoX> |
failover RG1 back to node0 on pfw3-eqiad - T263833 |
[production] |
| 15:46 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1147 (re)pooling @ 80%: Repool db1147 after a restart', diff saved to https://phabricator.wikimedia.org/P14109 and previous config saved to /var/cache/conftool/dbconfig/20210201-154618-root.json |
[production] |
| 15:31 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1147 (re)pooling @ 60%: Repool db1147 after a restart', diff saved to https://phabricator.wikimedia.org/P14108 and previous config saved to /var/cache/conftool/dbconfig/20210201-153115-root.json |
[production] |
| 15:16 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1147 (re)pooling @ 40%: Repool db1147 after a restart', diff saved to https://phabricator.wikimedia.org/P14107 and previous config saved to /var/cache/conftool/dbconfig/20210201-151611-root.json |
[production] |
| 15:01 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1147 (re)pooling @ 20%: Repool db1147 after a restart', diff saved to https://phabricator.wikimedia.org/P14106 and previous config saved to /var/cache/conftool/dbconfig/20210201-150107-root.json |
[production] |
| 14:53 |
<oblivian@cumin1001> |
conftool action : set/pooled=true; selector: dnsdisc=swift,name=codfw |
[production] |
| 14:53 |
<oblivian@cumin1001> |
conftool action : set/pooled=true; selector: dnsdisc=swift-ro,name=codfw |
[production] |
| 14:46 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1147 (re)pooling @ 10%: Repool db1147 after a restart', diff saved to https://phabricator.wikimedia.org/P14105 and previous config saved to /var/cache/conftool/dbconfig/20210201-144604-root.json |
[production] |
| 14:40 |
<marostegui> |
Restart mysql on db1147 T266483 |
[production] |
| 14:39 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1147 T266483', diff saved to https://phabricator.wikimedia.org/P14104 and previous config saved to /var/cache/conftool/dbconfig/20210201-143925-marostegui.json |
[production] |
| 14:12 |
<ladsgroup@deploy1001> |
Finished scap: [[gerrit:660796|Add Multilingual Wikisource to list of Wikidata's special sites]] (T138332) (duration: 21m 52s) |
[production] |
| 13:50 |
<ladsgroup@deploy1001> |
Started scap: [[gerrit:660796|Add Multilingual Wikisource to list of Wikidata's special sites]] (T138332) |
[production] |
| 13:47 |
<ladsgroup@deploy1001> |
scap sync-l10n completed (1.36.0-wmf.28) (duration: 00m 58s) |
[production] |
| 13:27 |
<hashar@deploy1001> |
Synchronized php: group1 wikis to 1.36.0-wmf.28 (duration: 01m 03s) |
[production] |
| 13:26 |
<hashar@deploy1001> |
rebuilt and synchronized wikiversions files: group1 wikis to 1.36.0-wmf.28 |
[production] |
| 12:43 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1166 (re)pooling @ 100%: Slowly pooling db1166 for the first time', diff saved to https://phabricator.wikimedia.org/P14102 and previous config saved to /var/cache/conftool/dbconfig/20210201-124308-root.json |
[production] |
| 12:42 |
<urbanecm@deploy1001> |
Synchronized wmf-config/logos.php: d70e8ac549145872c9d251cc78e6e40355029fc7: Update ombudsmenwiki logo (3/3) (duration: 01m 05s) |
[production] |
| 12:42 |
<Urbanecm> |
Purge 'https://en.wikipedia.org/static/images/project-logos/ombudsmenwiki.png' (T273323) |
[production] |
| 12:41 |
<urbanecm@deploy1001> |
Synchronized logos/config.yaml: d70e8ac549145872c9d251cc78e6e40355029fc7: Update ombudsmenwiki logo (2/3) (duration: 01m 04s) |
[production] |
| 12:40 |
<urbanecm@deploy1001> |
Synchronized static/images/project-logos/: d70e8ac549145872c9d251cc78e6e40355029fc7: Update ombudsmenwiki logo (1/3) (duration: 01m 05s) |
[production] |
| 12:38 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: cf349361b392f1831fe5ebce8fb544b035a83835: ombudsmenwiki: Set sitename to "Ombuds Commission" (T273323) (duration: 01m 06s) |
[production] |
| 12:35 |
<urbanecm@deploy1001> |
Synchronized static/images/project-logos/: Regenerate a couple of logos from Commons (2/2) (duration: 01m 08s) |
[production] |
| 12:34 |
<urbanecm@deploy1001> |
Synchronized logos/config.yaml: Regenerate a couple of logos from Commons (1/2) (duration: 01m 07s) |
[production] |
| 12:28 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1166 (re)pooling @ 75%: Slowly pooling db1166 for the first time', diff saved to https://phabricator.wikimedia.org/P14100 and previous config saved to /var/cache/conftool/dbconfig/20210201-122804-root.json |
[production] |
| 12:25 |
<urbanecm@deploy1001> |
Synchronized docroot/noc/createTxtFileSymlinks.sh: ec5b6d221b50d0b3807242d7a8869f97e6cbdbef: Publish logos.php at noc.wikimedia.org (2/2; T273330) (duration: 01m 05s) |
[production] |
| 12:24 |
<urbanecm@deploy1001> |
Synchronized docroot/noc/conf/logos.php.txt: ec5b6d221b50d0b3807242d7a8869f97e6cbdbef: Publish logos.php at noc.wikimedia.org (1/2; T273330) (duration: 01m 04s) |
[production] |
| 12:20 |
<Lucas_WMDE> |
EU backport&config window done |
[production] |
| 12:19 |
<lucaswerkmeister-wmde@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:660774|wikidata: post edit constraint jobs on 40% of edits (T204031)]] (duration: 01m 03s) |
[production] |
| 12:13 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1166 (re)pooling @ 60%: Slowly pooling db1166 for the first time', diff saved to https://phabricator.wikimedia.org/P14099 and previous config saved to /var/cache/conftool/dbconfig/20210201-121301-root.json |
[production] |
| 12:12 |
<mlitn@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: 9836287e0, 424efdcdb: [WikibaseMediaInfo] Set wgMediaInfoMediaSearchHasLtrPlugin & wgMediaInfoMediaSearchConceptChipsSimpleHeuristics (duration: 01m 10s) |
[production] |
| 11:57 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1166 (re)pooling @ 50%: Slowly pooling db1166 for the first time', diff saved to https://phabricator.wikimedia.org/P14098 and previous config saved to /var/cache/conftool/dbconfig/20210201-115757-root.json |
[production] |
| 11:50 |
<oblivian@cumin1001> |
conftool action : set/pooled=false; selector: dnsdisc=swift-ro,name=codfw |
[production] |
| 11:49 |
<oblivian@cumin1001> |
conftool action : set/pooled=false; selector: dnsdisc=^swift,name=codfw |
[production] |
| 11:47 |
<jdrewniak@deploy1001> |
Synchronized portals: Wikimedia Portals Update: [[gerrit:660807| Bumping portals to master (T128546)]] (duration: 01m 04s) |
[production] |
| 11:46 |
<jdrewniak@deploy1001> |
Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:660807| Bumping portals to master (T128546)]] (duration: 01m 14s) |
[production] |
| 11:42 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1166 (re)pooling @ 30%: Slowly pooling db1166 for the first time', diff saved to https://phabricator.wikimedia.org/P14097 and previous config saved to /var/cache/conftool/dbconfig/20210201-114254-root.json |
[production] |
| 11:28 |
<XioNoX> |
push pfw policies - T272073 |
[production] |
| 11:27 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1166 (re)pooling @ 25%: Slowly pooling db1166 for the first time', diff saved to https://phabricator.wikimedia.org/P14096 and previous config saved to /var/cache/conftool/dbconfig/20210201-112750-root.json |
[production] |
| 11:12 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1166 (re)pooling @ 20%: Slowly pooling db1166 for the first time', diff saved to https://phabricator.wikimedia.org/P14095 and previous config saved to /var/cache/conftool/dbconfig/20210201-111246-root.json |
[production] |
| 11:04 |
<hashar@deploy1001> |
rebuilt and synchronized wikiversions files: group0 wikis to 1.36.0-wmf.28 |
[production] |
| 11:01 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1175 (re)pooling @ 100%: Slowly pooling db1175 for the first time', diff saved to https://phabricator.wikimedia.org/P14094 and previous config saved to /var/cache/conftool/dbconfig/20210201-110102-root.json |
[production] |
| 10:57 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1166 (re)pooling @ 15%: Slowly pooling db1166 for the first time', diff saved to https://phabricator.wikimedia.org/P14093 and previous config saved to /var/cache/conftool/dbconfig/20210201-105743-root.json |
[production] |
| 10:54 |
<hashar@deploy1001> |
Finished scap: testwikis wikis to 1.36.0-wmf.28 (duration: 07m 48s) |
[production] |
| 10:46 |
<hashar@deploy1001> |
Started scap: testwikis wikis to 1.36.0-wmf.28 |
[production] |
| 10:45 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1175 (re)pooling @ 75%: Slowly pooling db1175 for the first time', diff saved to https://phabricator.wikimedia.org/P14092 and previous config saved to /var/cache/conftool/dbconfig/20210201-104559-root.json |
[production] |
| 10:45 |
<filippo@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on ms-be1047.eqiad.wmnet with reason: reboot |
[production] |
| 10:45 |
<filippo@cumin1001> |
START - Cookbook sre.hosts.downtime for 1:00:00 on ms-be1047.eqiad.wmnet with reason: reboot |
[production] |
| 10:42 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1166 (re)pooling @ 12%: Slowly pooling db1166 for the first time', diff saved to https://phabricator.wikimedia.org/P14091 and previous config saved to /var/cache/conftool/dbconfig/20210201-104240-root.json |
[production] |
| 10:42 |
<urbanecm@deploy1001> |
Synchronized php-1.36.0-wmf.28/includes/: Fixing T273317 T273296 (duration: 01m 01s) |
[production] |
| 10:41 |
<urbanecm@deploy1001> |
sync-file aborted: Fixing T273317 T273296 (duration: 00m 12s) |
[production] |