551-600 of 10000 results (89ms)
2023-12-27 §
22:40 <pfischer@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
2023-12-23 §
20:22 <_joe_> downgraded vopsbot on alert1001, hopefully should not keep panicing in this unexpected situation [production]
15:40 <taavi> fix date-time on mw2448 (which thought it is the year 2098) by manually setting it once and then restarting systemd-timesyncd.service after bios was reset in T353679 [production]
01:19 <rzl@deploy2002> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
01:19 <rzl@deploy2002> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
2023-12-22 §
17:28 <krinkle@deploy2002> Synchronized php-1.42.0-wmf.10/includes/skins/Skin.php: Ice6d6cfb442e4b3edb7f3002799780c76d7e0b0e (duration: 06m 25s) [production]
15:16 <jgiannelos@deploy2002> Finished deploy [restbase/deploy@5f2756a]: (no justification provided) (duration: 17m 36s) [production]
14:58 <jgiannelos@deploy2002> Started deploy [restbase/deploy@5f2756a]: (no justification provided) [production]
14:57 <jgiannelos@deploy2002> Finished deploy [restbase/deploy@f0c9f9f]: (no justification provided) (duration: 09m 32s) [production]
14:48 <jgiannelos@deploy2002> Started deploy [restbase/deploy@f0c9f9f]: (no justification provided) [production]
14:01 <jgiannelos@deploy2002> Finished deploy [restbase/deploy@4f56fff]: (no justification provided) (duration: 16m 57s) [production]
13:45 <reedy@deploy2002> Finished scap: T353920 (duration: 08m 02s) [production]
13:44 <jgiannelos@deploy2002> Started deploy [restbase/deploy@4f56fff]: (no justification provided) [production]
13:37 <reedy@deploy2002> Started scap: T353920 [production]
11:31 <vgutierrez> upload golang-github-intel-go-cpuid_0.0~git20210602.5747e5c-2+deb12u1 to apt.wm.o (bookworm) [production]
10:42 <isaranto@deploy2002> helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revertrisk' for release 'main' . [production]
10:42 <isaranto@deploy2002> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revertrisk' for release 'main' . [production]
10:39 <isaranto@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revertrisk' for release 'main' . [production]
09:57 <isaranto@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'readability' for release 'main' . [production]
2023-12-21 §
21:42 <wfan> payment-wiki revision 1c96980a -> 3b281d10 [production]
19:31 <reedy@deploy2002> Synchronized wmf-config/CommonSettings.php: T346919 (duration: 06m 26s) [production]
19:14 <dancy@deploy2002> rebuilt and synchronized wikiversions files: group2 wikis to 1.42.0-wmf.10 refs T350086 [production]
18:39 <mutante> releases1003 - sudo chmod -R g+w /srv/org/wikimedia/releases/mediawiki/1.* [production]
17:26 <mutante> mirror1001 - when syncing tails mirror - @ERROR: max connections (23) reached -- try again later [production]
17:23 <mutante> [mirror1001:~] $ sudo systemctl start update-tails-mirror [production]
17:04 <cgoubert@deploy2002> helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: apply [production]
17:03 <cgoubert@deploy2002> helmfile [codfw] START helmfile.d/services/changeprop-jobqueue: apply [production]
17:03 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/changeprop-jobqueue: apply [production]
17:03 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/changeprop-jobqueue: apply [production]
17:02 <cgoubert@deploy2002> helmfile [staging] DONE helmfile.d/services/changeprop-jobqueue: apply [production]
17:02 <cgoubert@deploy2002> helmfile [staging] START helmfile.d/services/changeprop-jobqueue: apply [production]
16:27 <akosiaris@deploy2002> helmfile [staging] DONE helmfile.d/services/changeprop: apply [production]
16:27 <akosiaris@deploy2002> helmfile [staging] START helmfile.d/services/changeprop: apply [production]
16:26 <akosiaris@deploy2002> helmfile [eqiad] DONE helmfile.d/services/changeprop: apply [production]
16:26 <akosiaris@deploy2002> helmfile [eqiad] START helmfile.d/services/changeprop: apply [production]
16:18 <akosiaris@deploy2002> helmfile [codfw] DONE helmfile.d/services/changeprop: apply [production]
16:17 <akosiaris@deploy2002> helmfile [codfw] START helmfile.d/services/changeprop: apply [production]
16:10 <volans@cumin1002> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) for hosts wdqs1008.eqiad.wmnet [production]
16:10 <volans@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:08 <volans@cumin1002> START - Cookbook sre.dns.netbox [production]
16:03 <volans@cumin1002> START - Cookbook sre.hosts.decommission for hosts wdqs1008.eqiad.wmnet [production]
15:59 <isaranto@deploy2002> helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revertrisk' for release 'main' . [production]
15:58 <isaranto@deploy2002> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revertrisk' for release 'main' . [production]
15:54 <volans@cumin1002> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) for hosts wdqs1007.eqiad.wmnet [production]
15:54 <volans@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:53 <volans@cumin1002> START - Cookbook sre.dns.netbox [production]
15:47 <volans@cumin1002> START - Cookbook sre.hosts.decommission for hosts wdqs1007.eqiad.wmnet [production]
15:44 <pfischer@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
15:44 <pfischer@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
15:38 <kharlan@deploy2002> Finished scap: Backport for [[gerrit:984502|Use username for lookup for non-existing user as the vague target]] (duration: 10m 37s) [production]