1-50 of 10000 results (19ms)
2024-09-19 ยง
23:17 <wmbot~raymondndibe@wmf3402> END (ERROR) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=97) (T359641) [tools]
23:17 <wmbot~raymondndibe@wmf3402> Updating container image docker-registry.tools.wmflabs.org/metrics-server:v0.7.10 (T359641) [tools]
23:17 <wmbot~raymondndibe@wmf3402> START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (T359641) [tools]
23:12 <wmbot~raymondndibe@wmf3402> END (PASS) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=0) (T359641) [tools]
23:11 <wmbot~raymondndibe@wmf3402> Updating container image docker-registry.tools.wmflabs.org/kube-state-metrics:v2.10.1 (T359641) [tools]
23:11 <wmbot~raymondndibe@wmf3402> START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (T359641) [tools]
22:38 <wmbot~raymondndibe@wmf3402> END (PASS) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=0) (T359641) [tools]
22:37 <wmbot~raymondndibe@wmf3402> Updating container image docker-registry.tools.wmflabs.org/metrics-server:v0.7.1 (T359641) [tools]
22:37 <wmbot~raymondndibe@wmf3402> START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (T359641) [tools]
22:36 <wmbot~raymondndibe@wmf3402> END (FAIL) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=99) (T359641) [tools]
22:36 <wmbot~raymondndibe@wmf3402> Updating container image docker-registry.tools.wmflabs.org/metrics-server:v0.7.1 (T359641) [tools]
22:36 <wmbot~raymondndibe@wmf3402> START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (T359641) [tools]
22:35 <wmbot~raymondndibe@wmf3402> END (ERROR) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=97) (T359641) [tools]
22:35 <wmbot~raymondndibe@wmf3402> Updating container image docker-registry.tools.wmflabs.org/docker-registry.tools.wmflabs.org/metrics-server:v0.7.1 (T359641) [tools]
22:35 <wmbot~raymondndibe@wmf3402> START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (T359641) [tools]
21:15 <Dreamy_Jazz> Evening UTC backport window done [production]
21:15 <dreamyjazz@deploy1003> Finished scap sync-world: Backport for [[gerrit:1073871|Re-order arguments to DataAccess::addTrackingCategory]], [[gerrit:1074253|Add a "duplicate-ids" lint category (T200517)]] (duration: 29m 20s) [production]
21:02 <dreamyjazz@deploy1003> dreamyjazz, cscott: Continuing with sync [production]
21:00 <dreamyjazz@deploy1003> dreamyjazz, cscott: Backport for [[gerrit:1073871|Re-order arguments to DataAccess::addTrackingCategory]], [[gerrit:1074253|Add a "duplicate-ids" lint category (T200517)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:45 <dreamyjazz@deploy1003> Started scap sync-world: Backport for [[gerrit:1073871|Re-order arguments to DataAccess::addTrackingCategory]], [[gerrit:1074253|Add a "duplicate-ids" lint category (T200517)]] [production]
20:36 <Dreamy_Jazz> Running `foreachwikiindblist group1.dblist extensions/CheckUser/maintenance/populateCentralCheckUserIndexTables.php` on a tmux session for T375203 [production]
20:34 <dreamyjazz@deploy1003> Finished scap sync-world: Backport for [[gerrit:1074241|Add ::caller to queries in populateCentralCheckUserIndexTables.php (T375221)]] (duration: 06m 50s) [production]
20:29 <dreamyjazz@deploy1003> kharlan, dreamyjazz: Continuing with sync [production]
20:29 <dreamyjazz@deploy1003> kharlan, dreamyjazz: Backport for [[gerrit:1074241|Add ::caller to queries in populateCentralCheckUserIndexTables.php (T375221)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:27 <dreamyjazz@deploy1003> Started scap sync-world: Backport for [[gerrit:1074241|Add ::caller to queries in populateCentralCheckUserIndexTables.php (T375221)]] [production]
20:27 <aqu@deploy1003> Finished deploy [airflow-dags/analytics@e0d8d78]: Fix canary events generation schedule [airflow-dags/analytics@e0d8d78a] (duration: 00m 42s) [production]
20:26 <aqu@deploy1003> Started deploy [airflow-dags/analytics@e0d8d78]: Fix canary events generation schedule [airflow-dags/analytics@e0d8d78a] [production]
20:12 <toyofuku@deploy1003> Finished scap sync-world: Backport for [[gerrit:1073297|Deploy new donate link location to pilot wikis (take 2) (T373585)]] (duration: 08m 35s) [production]
20:08 <toyofuku@deploy1003> toyofuku: Continuing with sync [production]
20:06 <toyofuku@deploy1003> toyofuku: Backport for [[gerrit:1073297|Deploy new donate link location to pilot wikis (take 2) (T373585)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:04 <toyofuku@deploy1003> Started scap sync-world: Backport for [[gerrit:1073297|Deploy new donate link location to pilot wikis (take 2) (T373585)]] [production]
18:38 <jnuche@deploy1003> Finished scap sync-world: Backport for [[gerrit:1074209|DiscussionParser: Do not create User objects from subpages (T375212)]] (duration: 06m 38s) [production]
18:33 <jnuche@deploy1003> jnuche, kharlan: Continuing with sync [production]
18:33 <jnuche@deploy1003> jnuche, kharlan: Backport for [[gerrit:1074209|DiscussionParser: Do not create User objects from subpages (T375212)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
18:31 <jnuche@deploy1003> Started scap sync-world: Backport for [[gerrit:1074209|DiscussionParser: Do not create User objects from subpages (T375212)]] [production]
18:23 <cmooney@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:23 <cmooney@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: remove entries for sretest2002 - cmooney@cumin1002" [production]
18:23 <cmooney@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: remove entries for sretest2002 - cmooney@cumin1002" [production]
18:20 <cmooney@cumin1002> START - Cookbook sre.dns.netbox [production]
18:02 <swfrench-wmf> scaling down mw-api-ext in eqiad after pre-switchover testing - T371273 [production]
18:02 <swfrench@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mw-api-ext: apply [production]
18:02 <swfrench@deploy1003> helmfile [eqiad] START helmfile.d/services/mw-api-ext: apply [production]
18:02 <swfrench-wmf> scaling down mw-web in eqiad after pre-switchover testing - T371273 [production]
18:01 <swfrench@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mw-web: apply [production]
18:01 <swfrench@deploy1003> helmfile [eqiad] START helmfile.d/services/mw-web: apply [production]
18:01 <aokoth@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on vrts1001.eqiad.wmnet with reason: Migration [production]
18:01 <aokoth@cumin1002> START - Cookbook sre.hosts.downtime for 7 days, 0:00:00 on vrts1001.eqiad.wmnet with reason: Migration [production]
17:53 <swfrench@cumin2002> conftool action : set/pooled=true; selector: dnsdisc=mw-web-ro,name=codfw [reason: Reverting pre-switchover capacity validation - T371273] [production]
17:51 <brett@cumin2002> conftool action : set/pooled=yes; selector: name=cp5024.eqsin.wmnet [production]
17:49 <swfrench@cumin2002> conftool action : set/pooled=true; selector: dnsdisc=mw-api-ext-ro,name=codfw [reason: Reverting pre-switchover capacity validation - T371273] [production]