551-600 of 10000 results (74ms)
2023-08-17 §
01:58 <fab@deploy1002> Started deploy [airflow-dags/research@ff0a21b]: (no justification provided) [production]
01:55 <fab@deploy1002> Finished deploy [airflow-dags/research@ff0a21b]: (no justification provided) (duration: 00m 19s) [production]
01:55 <fab@deploy1002> Started deploy [airflow-dags/research@ff0a21b]: (no justification provided) [production]
01:54 <fab@deploy1002> Finished deploy [airflow-dags/research@ff0a21b]: (no justification provided) (duration: 00m 20s) [production]
01:53 <fab@deploy1002> Started deploy [airflow-dags/research@ff0a21b]: (no justification provided) [production]
00:10 <eileen> civicrm upgraded from 5e631101 to 0f981bc4 - add email custom fields [production]
2023-08-16 §
21:52 <bking@cumin1001> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) for new host flink-zk2002.codfw.wmnet [production]
21:52 <bking@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host flink-zk2002.codfw.wmnet with OS bookworm [production]
21:49 <ryankemper> T343124 [WDQS] Pooled `wdqs1012` and `wdqs1013` (passing checks after reimage/data transfer) [production]
20:37 <bking@cumin1001> START - Cookbook sre.hosts.reimage for host flink-zk2002.codfw.wmnet with OS bookworm [production]
20:36 <bking@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM flink-zk2002.codfw.wmnet - bking@cumin1001" [production]
20:35 <bking@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM flink-zk2002.codfw.wmnet - bking@cumin1001" [production]
20:35 <bking@cumin1001> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) flink-zk2002.codfw.wmnet on all recursors [production]
20:35 <bking@cumin1001> START - Cookbook sre.dns.wipe-cache flink-zk2002.codfw.wmnet on all recursors [production]
20:35 <bking@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
20:35 <bking@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM flink-zk2002.codfw.wmnet - bking@cumin1001" [production]
20:34 <bking@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM flink-zk2002.codfw.wmnet - bking@cumin1001" [production]
20:32 <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:949183|Some initial configurations for suwikisource (T344314)]] (duration: 12m 11s) [production]
20:32 <bking@cumin1001> START - Cookbook sre.dns.netbox [production]
20:32 <bking@cumin1001> START - Cookbook sre.ganeti.makevm for new host flink-zk2002.codfw.wmnet [production]
20:25 <urbanecm@deploy1002> urbanecm and anzx: Continuing with sync [production]
20:22 <urbanecm@deploy1002> urbanecm and anzx: Backport for [[gerrit:949183|Some initial configurations for suwikisource (T344314)]] synced to the testservers mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option) [production]
20:20 <urbanecm@deploy1002> Started scap: Backport for [[gerrit:949183|Some initial configurations for suwikisource (T344314)]] [production]
20:14 <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:949592|Remove unusual VisualEditor config for Wikitech (T241961)]], [[gerrit:949545|Disable upcoming wgMFShowEditNotices in production (T312587)]], [[gerrit:943558|Explicitly set DiscussionToolsAutoTopicSubEditor to discussiontoolsapi]] (duration: 09m 27s) [production]
20:07 <urbanecm@deploy1002> esanders and urbanecm and matmarex: Continuing with sync [production]
20:06 <urbanecm@deploy1002> esanders and urbanecm and matmarex: Backport for [[gerrit:949592|Remove unusual VisualEditor config for Wikitech (T241961)]], [[gerrit:949545|Disable upcoming wgMFShowEditNotices in production (T312587)]], [[gerrit:943558|Explicitly set DiscussionToolsAutoTopicSubEditor to discussiontoolsapi]] synced to the testservers mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwde [production]
20:04 <urbanecm@deploy1002> Started scap: Backport for [[gerrit:949592|Remove unusual VisualEditor config for Wikitech (T241961)]], [[gerrit:949545|Disable upcoming wgMFShowEditNotices in production (T312587)]], [[gerrit:943558|Explicitly set DiscussionToolsAutoTopicSubEditor to discussiontoolsapi]] [production]
19:48 <dancy@deploy1002> Synchronized php: group1 wikis to 1.41.0-wmf.22 refs T343724 (duration: 07m 14s) [production]
19:40 <dancy@deploy1002> rebuilt and synchronized wikiversions files: group1 wikis to 1.41.0-wmf.22 refs T343724 [production]
18:10 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts lvs[3005-3007].esams.wmnet [production]
18:10 <sukhe@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:10 <sukhe@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: lvs[3005-3007].esams.wmnet decommissioned, removing all IPs except the asset tag one - sukhe@cumin2002" [production]
18:10 <dancy@deploy1002> rebuilt and synchronized wikiversions files: group0 wikis to 1.41.0-wmf.22 refs T343724 [production]
18:09 <sukhe@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: lvs[3005-3007].esams.wmnet decommissioned, removing all IPs except the asset tag one - sukhe@cumin2002" [production]
18:06 <sukhe@cumin2002> START - Cookbook sre.dns.netbox [production]
17:58 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts cp[3062-3065].esams.wmnet [production]
17:58 <brett@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:58 <brett@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cp[3062-3065].esams.wmnet decommissioned, removing all IPs except the asset tag one - brett@cumin2002" [production]
17:58 <sukhe@cumin2002> START - Cookbook sre.hosts.decommission for hosts lvs[3005-3007].esams.wmnet [production]
17:56 <brett@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cp[3062-3065].esams.wmnet decommissioned, removing all IPs except the asset tag one - brett@cumin2002" [production]
17:54 <brett@cumin2002> START - Cookbook sre.dns.netbox [production]
17:52 <fabfur> restart ntp on A:dns-rec and A:edges' [production]
17:50 <fabfur> run puppet-agent on A:dns-rec to restart ntp service [production]
17:45 <brett@cumin2002> START - Cookbook sre.hosts.decommission for hosts cp[3062-3065].esams.wmnet [production]
17:43 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts cp[3058-3061].esams.wmnet [production]
17:43 <brett@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:43 <brett@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cp[3058-3061].esams.wmnet decommissioned, removing all IPs except the asset tag one - brett@cumin2002" [production]
17:40 <brett@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cp[3058-3061].esams.wmnet decommissioned, removing all IPs except the asset tag one - brett@cumin2002" [production]
17:38 <brett@cumin2002> START - Cookbook sre.dns.netbox [production]
17:26 <brett@cumin2002> START - Cookbook sre.hosts.decommission for hosts cp[3058-3061].esams.wmnet [production]