451-500 of 10000 results (89ms)
2023-12-19 §
13:45 <jgiannelos@deploy2002> Finished deploy [restbase/deploy@40c15b1]: (no justification provided) (duration: 27m 26s) [production]
13:36 <ayounsi@cumin1001> END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) homer to cumin2002.codfw.wmnet with reason: Release v0.6.5 - ayounsi@cumin1001 [production]
13:35 <ayounsi@cumin1001> START - Cookbook sre.deploy.python-code homer to cumin2002.codfw.wmnet with reason: Release v0.6.5 - ayounsi@cumin1001 [production]
13:33 <ayounsi@cumin1001> END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) homer to cumin1001.eqiad.wmnet with reason: Release v0.6.5 - ayounsi@cumin1001 [production]
13:32 <ayounsi@cumin1001> START - Cookbook sre.deploy.python-code homer to cumin1001.eqiad.wmnet with reason: Release v0.6.5 - ayounsi@cumin1001 [production]
13:17 <jgiannelos@deploy2002> Started deploy [restbase/deploy@40c15b1]: (no justification provided) [production]
13:12 <jgiannelos@deploy2002> helmfile [staging] DONE helmfile.d/services/proton: apply [production]
13:08 <pfischer@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
13:08 <pfischer@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
13:05 <pfischer@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
13:05 <pfischer@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
13:02 <jgiannelos@deploy2002> helmfile [staging] START helmfile.d/services/proton: apply [production]
12:24 <hnowlan@deploy2002> helmfile [staging] DONE helmfile.d/services/changeprop-jobqueue: apply [production]
12:24 <hnowlan@deploy2002> helmfile [staging] START helmfile.d/services/changeprop-jobqueue: apply [production]
12:21 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 30 days, 0:00:00 on ldap-rw[1001,2001].wikimedia.org with reason: WIP [production]
12:21 <jmm@cumin2002> START - Cookbook sre.hosts.downtime for 30 days, 0:00:00 on ldap-rw[1001,2001].wikimedia.org with reason: WIP [production]
11:31 <aikochou@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'articletopic-outlink' for release 'main' . [production]
10:46 <moritzm> installing perl security updates on bookworm [production]
10:19 <kevinbazira@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
10:14 <elukey@deploy2002> helmfile [staging] DONE helmfile.d/services/recommendation-api: sync [production]
10:14 <elukey@deploy2002> helmfile [staging] START helmfile.d/services/recommendation-api: sync [production]
09:45 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/spark-history: apply [production]
09:45 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/spark-history: apply [production]
09:23 <elukey> reload thanos-rule on titan2001 [production]
08:27 <jmm@cumin1002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts lists1003.wikimedia.org [production]
08:27 <jmm@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
08:27 <jmm@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: lists1003.wikimedia.org decommissioned, removing all IPs except the asset tag one - jmm@cumin1002" [production]
08:26 <jmm@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: lists1003.wikimedia.org decommissioned, removing all IPs except the asset tag one - jmm@cumin1002" [production]
08:22 <jmm@cumin1002> START - Cookbook sre.dns.netbox [production]
08:17 <jmm@cumin1002> START - Cookbook sre.hosts.decommission for hosts lists1003.wikimedia.org [production]
06:13 <pfischer@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
06:07 <pfischer@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
05:10 <kart_> Updated MinT to 2023-12-12-065316-production [production]
04:56 <kartik@deploy2002> helmfile [eqiad] DONE helmfile.d/services/machinetranslation: apply [production]
04:54 <mwpresync@deploy2002> Finished scap: testwikis wikis to 1.42.0-wmf.10 refs T350086 (duration: 51m 03s) [production]
04:49 <kartik@deploy2002> helmfile [eqiad] START helmfile.d/services/machinetranslation: apply [production]
04:49 <kartik@deploy2002> helmfile [codfw] DONE helmfile.d/services/machinetranslation: apply [production]
04:43 <kartik@deploy2002> helmfile [codfw] START helmfile.d/services/machinetranslation: apply [production]
04:40 <kartik@deploy2002> helmfile [staging] DONE helmfile.d/services/machinetranslation: apply [production]
04:36 <kartik@deploy2002> helmfile [staging] START helmfile.d/services/machinetranslation: apply [production]
04:09 <cstone> civicrm upgraded from e2d49d10 to c3cc80c7 [production]
04:03 <mwpresync@deploy2002> Started scap: testwikis wikis to 1.42.0-wmf.10 refs T350086 [production]
2023-12-18 §
23:40 <taavi> conftool codfw/appserver/nginx/mw2448.codfw.wmnet: pooled changed yes => inactive # T353679, not sure why it was not logged automatically [production]
22:35 <maryum> Deployed patch for T347704 [production]
22:08 <dancy> UTC late backport window completed. [production]
22:07 <dancy@deploy2002> Finished scap: Backport for [[gerrit:983745|Revert "Fix English Gboard backspace over aliens" (T353578 T325129)]], [[gerrit:983906|Revert "Put zero-width space after inline focusable nodes" (T353578 T330284)]], [[gerrit:983911|Update VE core submodule to wmf.9 (6bada65) (T353578 T330284 T325129)]] (duration: 13m 34s) [production]
21:57 <dancy@deploy2002> dancy and kemayo: Continuing with sync [production]
21:56 <dancy@deploy2002> dancy and kemayo: Backport for [[gerrit:983745|Revert "Fix English Gboard backspace over aliens" (T353578 T325129)]], [[gerrit:983906|Revert "Put zero-width space after inline focusable nodes" (T353578 T330284)]], [[gerrit:983911|Update VE core submodule to wmf.9 (6bada65) (T353578 T330284 T325129)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
21:54 <dancy@deploy2002> Started scap: Backport for [[gerrit:983745|Revert "Fix English Gboard backspace over aliens" (T353578 T325129)]], [[gerrit:983906|Revert "Put zero-width space after inline focusable nodes" (T353578 T330284)]], [[gerrit:983911|Update VE core submodule to wmf.9 (6bada65) (T353578 T330284 T325129)]] [production]
21:17 <dancy@deploy2002> Finished scap: Backport for [[gerrit:983928|Undeploy Reader Demographics 2 survey (T344393)]] (duration: 08m 30s) [production]