2025-03-31
ยง
|
23:13 |
<btullis@cumin1002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1173.eqiad.wmnet |
[production] |
23:06 |
<btullis@cumin1002> |
START - Cookbook sre.hosts.reboot-single for host an-worker1173.eqiad.wmnet |
[production] |
23:05 |
<btullis@cumin1002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1172.eqiad.wmnet |
[production] |
22:57 |
<btullis@cumin1002> |
START - Cookbook sre.hosts.reboot-single for host an-worker1172.eqiad.wmnet |
[production] |
22:49 |
<btullis@cumin1002> |
END (ERROR) - Cookbook sre.hosts.reboot-single (exit_code=97) for host an-worker1174.eqiad.wmnet |
[production] |
22:38 |
<btullis@cumin1002> |
START - Cookbook sre.hosts.reboot-single for host an-worker1174.eqiad.wmnet |
[production] |
22:35 |
<btullis@cumin1002> |
END (PASS) - Cookbook sre.hadoop.init-hadoop-workers (exit_code=0) for hosts an-worker[1173-1174].eqiad.wmnet |
[production] |
22:33 |
<btullis@cumin1002> |
START - Cookbook sre.hadoop.init-hadoop-workers for hosts an-worker[1173-1174].eqiad.wmnet |
[production] |
22:27 |
<btullis@cumin1002> |
END (PASS) - Cookbook sre.hadoop.init-hadoop-workers (exit_code=0) for hosts an-worker1172.eqiad.wmnet |
[production] |
22:25 |
<btullis@cumin1002> |
START - Cookbook sre.hadoop.init-hadoop-workers for hosts an-worker1172.eqiad.wmnet |
[production] |
22:13 |
<reedy@deploy1003> |
Synchronized php-1.44.0-wmf.22/includes/libs/filebackend/FileBackend.php: T384851 (duration: 02m 14s) |
[production] |
22:02 |
<tgr_> |
UTC late deploys done |
[production] |
22:01 |
<tgr@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1132763|Add EmailAuth provider to local domain exclusion list (T390437)]] (duration: 15m 37s) |
[production] |
21:54 |
<tgr@deploy1003> |
tgr: Continuing with sync |
[production] |
21:51 |
<tgr@deploy1003> |
tgr: Backport for [[gerrit:1132763|Add EmailAuth provider to local domain exclusion list (T390437)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
21:45 |
<tgr@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1132763|Add EmailAuth provider to local domain exclusion list (T390437)]] |
[production] |
21:29 |
<tgr@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1132408|EmailAuth: Prepare config for enabling in log-only mode (T390437)]], [[gerrit:1132755|EmailAuth: Enable info level logging (T390437)]] (duration: 26m 08s) |
[production] |
21:22 |
<tgr@deploy1003> |
kharlan, tgr: Continuing with sync |
[production] |
21:08 |
<tgr@deploy1003> |
kharlan, tgr: Backport for [[gerrit:1132408|EmailAuth: Prepare config for enabling in log-only mode (T390437)]], [[gerrit:1132755|EmailAuth: Enable info level logging (T390437)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
21:03 |
<tgr@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1132408|EmailAuth: Prepare config for enabling in log-only mode (T390437)]], [[gerrit:1132755|EmailAuth: Enable info level logging (T390437)]] |
[production] |
21:01 |
<tgr@deploy1003> |
Sync cancelled. |
[production] |
20:53 |
<tgr@deploy1003> |
tgr, kharlan: Backport for [[gerrit:1132408|EmailAuth: Prepare config for enabling in log-only mode (T390437)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
20:48 |
<tgr@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1132408|EmailAuth: Prepare config for enabling in log-only mode (T390437)]] |
[production] |
20:46 |
<tgr@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1131483|Deploy dark mode and Vector 2022 to German Wikipedia (T387155)]], [[gerrit:1131484|Enable Vector 2022 for Russian Wikimedia and arbcom_ruwiki (T390112)]] (duration: 17m 56s) |
[production] |
20:39 |
<tgr@deploy1003> |
jdlrobson, tgr: Continuing with sync |
[production] |
20:33 |
<tgr@deploy1003> |
jdlrobson, tgr: Backport for [[gerrit:1131483|Deploy dark mode and Vector 2022 to German Wikipedia (T387155)]], [[gerrit:1131484|Enable Vector 2022 for Russian Wikimedia and arbcom_ruwiki (T390112)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
20:28 |
<tgr@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1131483|Deploy dark mode and Vector 2022 to German Wikipedia (T387155)]], [[gerrit:1131484|Enable Vector 2022 for Russian Wikimedia and arbcom_ruwiki (T390112)]] |
[production] |
20:26 |
<tgr@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1132645|REST: enable Specs module on certain wikis, adjust Sandbox modules (T389407)]], [[gerrit:1132197|Throttle exemption for Editathon at Universidad Nacional de La Plata - 9 April 2025 (T390290)]], [[gerrit:1132745|EmailAuth: Add EmailAuthRequireToken hook implementation (T390437)]] (duration: 12m 59s) |
[production] |
20:26 |
<brett@cumin2002> |
END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on P{cp1114.eqiad.wmnet} and A:cp |
[production] |
20:26 |
<brett@cumin2002> |
END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on P{cp1115.eqiad.wmnet} and A:cp |
[production] |
20:22 |
<brett@cumin2002> |
START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on P{cp1115.eqiad.wmnet} and A:cp |
[production] |
20:20 |
<brett@cumin2002> |
START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on P{cp1114.eqiad.wmnet} and A:cp |
[production] |
20:19 |
<tgr@deploy1003> |
superpes, bpirkle, tgr, kharlan: Continuing with sync |
[production] |
20:18 |
<tgr@deploy1003> |
superpes, bpirkle, tgr, kharlan: Backport for [[gerrit:1132645|REST: enable Specs module on certain wikis, adjust Sandbox modules (T389407)]], [[gerrit:1132197|Throttle exemption for Editathon at Universidad Nacional de La Plata - 9 April 2025 (T390290)]], [[gerrit:1132745|EmailAuth: Add EmailAuthRequireToken hook implementation (T390437)]] synced to the testservers (https://wikitech.wikimedia.org/wiki |
[production] |
20:13 |
<tgr@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1132645|REST: enable Specs module on certain wikis, adjust Sandbox modules (T389407)]], [[gerrit:1132197|Throttle exemption for Editathon at Universidad Nacional de La Plata - 9 April 2025 (T390290)]], [[gerrit:1132745|EmailAuth: Add EmailAuthRequireToken hook implementation (T390437)]] |
[production] |
20:06 |
<dancy@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1132727|.gitmodules: Add extensions/EmailAuth (T390437)]], [[gerrit:1132729|extension-list: Add EmailAuth (T390437)]] (duration: 20m 53s) |
[production] |
19:55 |
<dancy@deploy1003> |
dancy: Continuing with sync |
[production] |
19:53 |
<dancy@deploy1003> |
dancy: Backport for [[gerrit:1132727|.gitmodules: Add extensions/EmailAuth (T390437)]], [[gerrit:1132729|extension-list: Add EmailAuth (T390437)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
19:51 |
<brett@cumin2002> |
END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on P{cp1112.eqiad.wmnet} and A:cp |
[production] |
19:51 |
<brett@cumin2002> |
END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on P{cp1113.eqiad.wmnet} and A:cp |
[production] |
19:46 |
<brett@cumin2002> |
START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on P{cp1113.eqiad.wmnet} and A:cp |
[production] |
19:46 |
<brett@cumin2002> |
START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on P{cp1112.eqiad.wmnet} and A:cp |
[production] |
19:45 |
<dancy@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1132727|.gitmodules: Add extensions/EmailAuth (T390437)]], [[gerrit:1132729|extension-list: Add EmailAuth (T390437)]] |
[production] |
19:22 |
<kamila@deploy1003> |
helmfile [aux-k8s-codfw] DONE helmfile.d/admin 'apply'. |
[production] |
19:22 |
<kamila@deploy1003> |
helmfile [aux-k8s-codfw] START helmfile.d/admin 'apply'. |
[production] |
19:20 |
<kamila@deploy1003> |
helmfile [aux-k8s-codfw] DONE helmfile.d/admin 'apply'. |
[production] |
19:19 |
<kamila@deploy1003> |
helmfile [aux-k8s-codfw] START helmfile.d/admin 'apply'. |
[production] |
19:17 |
<dzahn@deploy1003> |
helmfile [aux-k8s-eqiad] DONE helmfile.d/admin 'apply'. |
[production] |
19:16 |
<dzahn@deploy1003> |
helmfile [aux-k8s-eqiad] START helmfile.d/admin 'apply'. |
[production] |
19:14 |
<dzahn@deploy1003> |
helmfile [aux-k8s-codfw] DONE helmfile.d/admin 'apply'. |
[production] |