1-50 of 10000 results (97ms)
2025-03-31 ยง
23:13 <btullis@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1173.eqiad.wmnet [production]
23:06 <btullis@cumin1002> START - Cookbook sre.hosts.reboot-single for host an-worker1173.eqiad.wmnet [production]
23:05 <btullis@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1172.eqiad.wmnet [production]
22:57 <btullis@cumin1002> START - Cookbook sre.hosts.reboot-single for host an-worker1172.eqiad.wmnet [production]
22:49 <btullis@cumin1002> END (ERROR) - Cookbook sre.hosts.reboot-single (exit_code=97) for host an-worker1174.eqiad.wmnet [production]
22:38 <btullis@cumin1002> START - Cookbook sre.hosts.reboot-single for host an-worker1174.eqiad.wmnet [production]
22:35 <btullis@cumin1002> END (PASS) - Cookbook sre.hadoop.init-hadoop-workers (exit_code=0) for hosts an-worker[1173-1174].eqiad.wmnet [production]
22:33 <btullis@cumin1002> START - Cookbook sre.hadoop.init-hadoop-workers for hosts an-worker[1173-1174].eqiad.wmnet [production]
22:27 <btullis@cumin1002> END (PASS) - Cookbook sre.hadoop.init-hadoop-workers (exit_code=0) for hosts an-worker1172.eqiad.wmnet [production]
22:25 <btullis@cumin1002> START - Cookbook sre.hadoop.init-hadoop-workers for hosts an-worker1172.eqiad.wmnet [production]
22:13 <reedy@deploy1003> Synchronized php-1.44.0-wmf.22/includes/libs/filebackend/FileBackend.php: T384851 (duration: 02m 14s) [production]
22:02 <tgr_> UTC late deploys done [production]
22:01 <tgr@deploy1003> Finished scap sync-world: Backport for [[gerrit:1132763|Add EmailAuth provider to local domain exclusion list (T390437)]] (duration: 15m 37s) [production]
21:54 <tgr@deploy1003> tgr: Continuing with sync [production]
21:51 <tgr@deploy1003> tgr: Backport for [[gerrit:1132763|Add EmailAuth provider to local domain exclusion list (T390437)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
21:45 <tgr@deploy1003> Started scap sync-world: Backport for [[gerrit:1132763|Add EmailAuth provider to local domain exclusion list (T390437)]] [production]
21:29 <tgr@deploy1003> Finished scap sync-world: Backport for [[gerrit:1132408|EmailAuth: Prepare config for enabling in log-only mode (T390437)]], [[gerrit:1132755|EmailAuth: Enable info level logging (T390437)]] (duration: 26m 08s) [production]
21:22 <tgr@deploy1003> kharlan, tgr: Continuing with sync [production]
21:08 <tgr@deploy1003> kharlan, tgr: Backport for [[gerrit:1132408|EmailAuth: Prepare config for enabling in log-only mode (T390437)]], [[gerrit:1132755|EmailAuth: Enable info level logging (T390437)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
21:03 <tgr@deploy1003> Started scap sync-world: Backport for [[gerrit:1132408|EmailAuth: Prepare config for enabling in log-only mode (T390437)]], [[gerrit:1132755|EmailAuth: Enable info level logging (T390437)]] [production]
21:01 <tgr@deploy1003> Sync cancelled. [production]
20:53 <tgr@deploy1003> tgr, kharlan: Backport for [[gerrit:1132408|EmailAuth: Prepare config for enabling in log-only mode (T390437)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:48 <tgr@deploy1003> Started scap sync-world: Backport for [[gerrit:1132408|EmailAuth: Prepare config for enabling in log-only mode (T390437)]] [production]
20:46 <tgr@deploy1003> Finished scap sync-world: Backport for [[gerrit:1131483|Deploy dark mode and Vector 2022 to German Wikipedia (T387155)]], [[gerrit:1131484|Enable Vector 2022 for Russian Wikimedia and arbcom_ruwiki (T390112)]] (duration: 17m 56s) [production]
20:39 <tgr@deploy1003> jdlrobson, tgr: Continuing with sync [production]
20:33 <tgr@deploy1003> jdlrobson, tgr: Backport for [[gerrit:1131483|Deploy dark mode and Vector 2022 to German Wikipedia (T387155)]], [[gerrit:1131484|Enable Vector 2022 for Russian Wikimedia and arbcom_ruwiki (T390112)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:28 <tgr@deploy1003> Started scap sync-world: Backport for [[gerrit:1131483|Deploy dark mode and Vector 2022 to German Wikipedia (T387155)]], [[gerrit:1131484|Enable Vector 2022 for Russian Wikimedia and arbcom_ruwiki (T390112)]] [production]
20:26 <tgr@deploy1003> Finished scap sync-world: Backport for [[gerrit:1132645|REST: enable Specs module on certain wikis, adjust Sandbox modules (T389407)]], [[gerrit:1132197|Throttle exemption for Editathon at Universidad Nacional de La Plata - 9 April 2025 (T390290)]], [[gerrit:1132745|EmailAuth: Add EmailAuthRequireToken hook implementation (T390437)]] (duration: 12m 59s) [production]
20:26 <brett@cumin2002> END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on P{cp1114.eqiad.wmnet} and A:cp [production]
20:26 <brett@cumin2002> END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on P{cp1115.eqiad.wmnet} and A:cp [production]
20:22 <brett@cumin2002> START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on P{cp1115.eqiad.wmnet} and A:cp [production]
20:20 <brett@cumin2002> START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on P{cp1114.eqiad.wmnet} and A:cp [production]
20:19 <tgr@deploy1003> superpes, bpirkle, tgr, kharlan: Continuing with sync [production]
20:18 <tgr@deploy1003> superpes, bpirkle, tgr, kharlan: Backport for [[gerrit:1132645|REST: enable Specs module on certain wikis, adjust Sandbox modules (T389407)]], [[gerrit:1132197|Throttle exemption for Editathon at Universidad Nacional de La Plata - 9 April 2025 (T390290)]], [[gerrit:1132745|EmailAuth: Add EmailAuthRequireToken hook implementation (T390437)]] synced to the testservers (https://wikitech.wikimedia.org/wiki [production]
20:13 <tgr@deploy1003> Started scap sync-world: Backport for [[gerrit:1132645|REST: enable Specs module on certain wikis, adjust Sandbox modules (T389407)]], [[gerrit:1132197|Throttle exemption for Editathon at Universidad Nacional de La Plata - 9 April 2025 (T390290)]], [[gerrit:1132745|EmailAuth: Add EmailAuthRequireToken hook implementation (T390437)]] [production]
20:06 <dancy@deploy1003> Finished scap sync-world: Backport for [[gerrit:1132727|.gitmodules: Add extensions/EmailAuth (T390437)]], [[gerrit:1132729|extension-list: Add EmailAuth (T390437)]] (duration: 20m 53s) [production]
19:55 <dancy@deploy1003> dancy: Continuing with sync [production]
19:53 <dancy@deploy1003> dancy: Backport for [[gerrit:1132727|.gitmodules: Add extensions/EmailAuth (T390437)]], [[gerrit:1132729|extension-list: Add EmailAuth (T390437)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
19:51 <brett@cumin2002> END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on P{cp1112.eqiad.wmnet} and A:cp [production]
19:51 <brett@cumin2002> END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on P{cp1113.eqiad.wmnet} and A:cp [production]
19:46 <brett@cumin2002> START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on P{cp1113.eqiad.wmnet} and A:cp [production]
19:46 <brett@cumin2002> START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on P{cp1112.eqiad.wmnet} and A:cp [production]
19:45 <dancy@deploy1003> Started scap sync-world: Backport for [[gerrit:1132727|.gitmodules: Add extensions/EmailAuth (T390437)]], [[gerrit:1132729|extension-list: Add EmailAuth (T390437)]] [production]
19:22 <kamila@deploy1003> helmfile [aux-k8s-codfw] DONE helmfile.d/admin 'apply'. [production]
19:22 <kamila@deploy1003> helmfile [aux-k8s-codfw] START helmfile.d/admin 'apply'. [production]
19:20 <kamila@deploy1003> helmfile [aux-k8s-codfw] DONE helmfile.d/admin 'apply'. [production]
19:19 <kamila@deploy1003> helmfile [aux-k8s-codfw] START helmfile.d/admin 'apply'. [production]
19:17 <dzahn@deploy1003> helmfile [aux-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
19:16 <dzahn@deploy1003> helmfile [aux-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
19:14 <dzahn@deploy1003> helmfile [aux-k8s-codfw] DONE helmfile.d/admin 'apply'. [production]