8651-8700 of 10000 results (104ms)
2023-10-23 ยง
14:05 <jayme@deploy2002> helmfile [eqiad] [main] START helmfile.d/services/mw-jobrunner : sync [production]
13:53 <urbanecm@deploy2002> Finished scap: Backport for [[gerrit:967302|Stop writing to $wgCentralAuthCookieDomain in 'EnterMobileMode' hook]] (duration: 15m 50s) [production]
13:52 <moritzm> installing batik security updates [production]
13:48 <urbanecm@deploy2002> urbanecm and matmarex: Continuing with sync [production]
13:38 <urbanecm@deploy2002> urbanecm and matmarex: Backport for [[gerrit:967302|Stop writing to $wgCentralAuthCookieDomain in 'EnterMobileMode' hook]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:37 <urbanecm@deploy2002> Started scap: Backport for [[gerrit:967302|Stop writing to $wgCentralAuthCookieDomain in 'EnterMobileMode' hook]] [production]
13:37 <urbanecm@deploy2002> Finished scap: Backport for [[gerrit:965610|New stream for Android Patroller tasks feature (T348816)]] (duration: 06m 54s) [production]
13:31 <urbanecm@deploy2002> urbanecm and sharvaniharan: Continuing with sync [production]
13:31 <urbanecm@deploy2002> urbanecm and sharvaniharan: Backport for [[gerrit:965610|New stream for Android Patroller tasks feature (T348816)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:30 <urbanecm@deploy2002> Started scap: Backport for [[gerrit:965610|New stream for Android Patroller tasks feature (T348816)]] [production]
13:29 <urbanecm@deploy2002> Finished scap: Backport for [[gerrit:967195|Remove 'currentProto'/'finalProto'/'proto' business (T348852)]], [[gerrit:966915|Remove unused $wgIncludeLegacyJavaScript]], [[gerrit:966919|Remove $wgApiFrameOptions override for enwiki and zhwiki (T131183)]] (duration: 11m 56s) [production]
13:23 <urbanecm@deploy2002> matmarex and urbanecm: Continuing with sync [production]
13:18 <urbanecm@deploy2002> matmarex and urbanecm: Backport for [[gerrit:967195|Remove 'currentProto'/'finalProto'/'proto' business (T348852)]], [[gerrit:966915|Remove unused $wgIncludeLegacyJavaScript]], [[gerrit:966919|Remove $wgApiFrameOptions override for enwiki and zhwiki (T131183)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:17 <urbanecm@deploy2002> Started scap: Backport for [[gerrit:967195|Remove 'currentProto'/'finalProto'/'proto' business (T348852)]], [[gerrit:966915|Remove unused $wgIncludeLegacyJavaScript]], [[gerrit:966919|Remove $wgApiFrameOptions override for enwiki and zhwiki (T131183)]] [production]
13:16 <urbanecm@deploy2002> Finished scap: Backport for [[gerrit:967429|wikidatawiki: Switch property for determining Lexeme language code (T348923)]] (duration: 12m 50s) [production]
13:11 <urbanecm@deploy2002> migr and urbanecm: Continuing with sync [production]
13:05 <urbanecm@deploy2002> migr and urbanecm: Backport for [[gerrit:967429|wikidatawiki: Switch property for determining Lexeme language code (T348923)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:04 <moritzm> installing libxpm security updates on buster [production]
13:04 <urbanecm@deploy2002> Started scap: Backport for [[gerrit:967429|wikidatawiki: Switch property for determining Lexeme language code (T348923)]] [production]
12:41 <jayme@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-web: apply [production]
12:40 <jayme> switched mw-web (mw-on-k8s) to certmanager certificates - T300033 [production]
12:40 <jayme@deploy2002> helmfile [codfw] START helmfile.d/services/mw-web: apply [production]
12:40 <jayme@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-web: apply [production]
12:39 <jayme@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-web: apply [production]
12:33 <moritzm> installing libx11 security updates [production]
12:16 <arnaudb@cumin1001> END (PASS) - Cookbook sre.mysql.clone (exit_code=0) of db1131.eqiad.wmnet onto db1231.eqiad.wmnet [production]
11:49 <jnuche@deploy2002> Finished deploy [releng/jenkins-deploy@054e07d] (releasing): (no justification provided) (duration: 00m 42s) [production]
11:49 <jnuche@deploy2002> Started deploy [releng/jenkins-deploy@054e07d] (releasing): (no justification provided) [production]
11:49 <moritzm> added Balthazar to pwstore [production]
11:33 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on an-airflow1007.eqiad.wmnet with reason: Server not yet in productin use [production]
11:33 <btullis@cumin1001> START - Cookbook sre.hosts.downtime for 3 days, 0:00:00 on an-airflow1007.eqiad.wmnet with reason: Server not yet in productin use [production]
10:51 <brouberol@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts kafka-jumbo1001.eqiad.wmnet [production]
10:51 <brouberol@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
10:51 <brouberol@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: kafka-jumbo1001.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - brouberol@cumin1001" [production]
10:51 <arnaudb@cumin1001> START - Cookbook sre.mysql.clone of db1131.eqiad.wmnet onto db1231.eqiad.wmnet [production]
10:50 <arnaudb@cumin1001> dbctl commit (dc=all): 'Depool db1131 T344036', diff saved to https://phabricator.wikimedia.org/P53025 and previous config saved to /var/cache/conftool/dbconfig/20231023-105036-arnaudb.json [production]
10:50 <brouberol@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: kafka-jumbo1001.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - brouberol@cumin1001" [production]
10:41 <jayme> switched mw-debug (mw-on-k8s) to certmanager certificates - T300033 [production]
10:40 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-test-client1002.eqiad.wmnet [production]
10:40 <brouberol@cumin1001> START - Cookbook sre.dns.netbox [production]
10:37 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1131.eqiad.wmnet with reason: provisionning - T344036 [production]
10:37 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1131.eqiad.wmnet with reason: provisionning - T344036 [production]
10:37 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1231.eqiad.wmnet with reason: provisionning - T344036 [production]
10:37 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1231.eqiad.wmnet with reason: provisionning - T344036 [production]
10:36 <btullis@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-test-client1002.eqiad.wmnet [production]
10:35 <jayme@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-debug: apply [production]
10:34 <jayme@deploy2002> helmfile [codfw] START helmfile.d/services/mw-debug: apply [production]
10:34 <jayme@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-debug: apply [production]
10:34 <jayme@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-debug: apply [production]
10:32 <brouberol@cumin1001> START - Cookbook sre.hosts.decommission for hosts kafka-jumbo1001.eqiad.wmnet [production]