2651-2700 of 10000 results (93ms)
2023-01-11 ยง
14:46 <btullis@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - btullis@cumin1001" [production]
14:46 <lucaswerkmeister-wmde@deploy1002> Synchronized php-1.40.0-wmf.18/extensions/Wikibase/repo/tests/jest/wikibase.vector.searchClient.spec.js: Backport: [[gerrit:877972|Add missing parentheses to vector search match text (T326633)]] (2/2) (duration: 06m 46s) [production]
14:42 <btullis@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - btullis@cumin1001" [production]
14:39 <lucaswerkmeister-wmde@deploy1002> Synchronized php-1.40.0-wmf.18/extensions/Wikibase/repo/resources/wikibase.vector.searchClient.js: Backport: [[gerrit:877972|Add missing parentheses to vector search match text (T326633)]] (1/2) (duration: 07m 09s) [production]
14:28 <lucaswerkmeister-wmde@deploy1002> Finished scap: Backport for [[gerrit:877983|Fix test constructing HTMLFormField without parent (T326621)]] (duration: 08m 38s) [production]
14:25 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cephosd1005.eqiad.wmnet with reason: host reimage [production]
14:22 <btullis@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cephosd1005.eqiad.wmnet with reason: host reimage [production]
14:21 <lucaswerkmeister-wmde@deploy1002> lucaswerkmeister-wmde and lucaswerkmeister-wmde: Backport for [[gerrit:877983|Fix test constructing HTMLFormField without parent (T326621)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet [production]
14:19 <lucaswerkmeister-wmde@deploy1002> Started scap: Backport for [[gerrit:877983|Fix test constructing HTMLFormField without parent (T326621)]] [production]
14:14 <jelto@cumin1001> END (FAIL) - Cookbook sre.gitlab.upgrade (exit_code=99) [production]
14:10 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cephosd1001.eqiad.wmnet [production]
14:10 <moritzm> installing postgresql 11 security updates on maps/eqiad [production]
14:06 <btullis@cumin1001> START - Cookbook sre.hosts.reimage for host cephosd1005.eqiad.wmnet with OS bullseye [production]
14:02 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cephosd1004.eqiad.wmnet with OS bullseye [production]
14:02 <btullis@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - btullis@cumin1001" [production]
14:01 <btullis@cumin1001> START - Cookbook sre.hosts.reboot-single for host cephosd1001.eqiad.wmnet [production]
13:55 <btullis@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - btullis@cumin1001" [production]
13:47 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 37002 [production]
13:47 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 37002 [production]
13:46 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 3302 [production]
13:45 <jelto@cumin1001> START - Cookbook sre.gitlab.upgrade [production]
13:45 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 3302 [production]
13:45 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 9584 [production]
13:44 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 9584 [production]
13:44 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 35753 [production]
13:42 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 35753 [production]
13:38 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cephosd1004.eqiad.wmnet with reason: host reimage [production]
13:35 <btullis@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cephosd1004.eqiad.wmnet with reason: host reimage [production]
13:31 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host bast6002.wikimedia.org [production]
13:21 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc1038.eqiad.wmnet with reason: host reimage [production]
13:18 <jiji@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mc1038.eqiad.wmnet with reason: host reimage [production]
13:12 <jmm@cumin2002> END (FAIL) - Cookbook sre.dns.wipe-cache (exit_code=99) bast6002.wikimedia.org on all recursors [production]
13:11 <jmm@cumin2002> START - Cookbook sre.dns.wipe-cache bast6002.wikimedia.org on all recursors [production]
13:11 <jmm@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:11 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM bast6002.wikimedia.org - jmm@cumin2002" [production]
13:11 <jmm@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM bast6002.wikimedia.org - jmm@cumin2002" [production]
13:07 <jiji@cumin1001> START - Cookbook sre.hosts.reimage for host mc1038.eqiad.wmnet with OS bullseye [production]
13:03 <jiji@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host mc1038.eqiad.wmnet with OS bullseye [production]
13:01 <jmm@cumin2002> START - Cookbook sre.dns.netbox [production]
13:01 <jmm@cumin2002> START - Cookbook sre.ganeti.makevm for new host bast6002.wikimedia.org [production]
12:53 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host bast4004.wikimedia.org [production]
12:42 <moritzm> installing postgresql 11 security updates on maps/codfw [production]
12:40 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 8849 [production]
12:36 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'configure' for AS: 8849 [production]
12:35 <jmm@cumin2002> END (FAIL) - Cookbook sre.dns.wipe-cache (exit_code=99) bast4004.wikimedia.org on all recursors [production]
12:34 <jmm@cumin2002> START - Cookbook sre.dns.wipe-cache bast4004.wikimedia.org on all recursors [production]
12:34 <jmm@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
12:34 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM bast4004.wikimedia.org - jmm@cumin2002" [production]
12:33 <jmm@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM bast4004.wikimedia.org - jmm@cumin2002" [production]
12:31 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 56630 [production]