1601-1650 of 10000 results (83ms)
2022-09-26 §
09:44 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1099.eqiad.wmnet with reason: Maintenance [production]
09:44 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2097.codfw.wmnet with reason: Maintenance [production]
09:44 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1099.eqiad.wmnet with reason: Maintenance [production]
09:39 <btullis@cumin1001> START - Cookbook sre.ganeti.reboot-vm for VM matomo1002.eqiad.wmnet [production]
08:58 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 033ab75917932a6b6e1cda8cc26f5f069448e3b9: arwiki: Properly grant enrollasmentor to editor (T310905) (duration: 03m 46s) [production]
08:58 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
08:56 <btullis> adding 80GB of virtual disk to matomo1002 [production]
08:55 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
08:55 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
08:54 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
08:49 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
08:48 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
08:48 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
08:47 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
08:47 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 0a5486780a0543d7fb1c637d2abe48855e753d13: arwiki: Grant enrollasmentor to editor (T310905) (duration: 03m 40s) [production]
08:39 <elukey@deploy1002> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. [production]
08:38 <elukey@deploy1002> helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. [production]
08:07 <godog> upgrade grafana to 8.5.13 [production]
08:04 <godog> add 20G to prometheus/analytics in codfw [production]
07:31 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
07:31 <oblivian@deploy1002> Finished scap: Backport for [[gerrit:823681|Move 100% of cookie-accepting clients to php 7.4 (T271736)]] (duration: 05m 31s) [production]
07:29 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
07:29 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
07:28 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
07:26 <oblivian@deploy1002> oblivian and oblivian: Backport for [[gerrit:823681|Move 100% of cookie-accepting clients to php 7.4 (T271736)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet [production]
07:26 <oblivian@deploy1002> Started scap: Backport for [[gerrit:823681|Move 100% of cookie-accepting clients to php 7.4 (T271736)]] [production]
07:23 <urbanecm@deploy1002> Synchronized wmf-config/InterwikiSortOrders.php: 620bb80e3534c812d7f4de25547d92104b8609a0: Add ami, bjn, blk, dag, guw, ig, kcg, lmo, pcm, pwn, and shi to InterwikiSortOrders (duration: 03m 40s) [production]
07:23 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
07:20 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
07:20 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
07:18 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
07:12 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
07:11 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 81f66621e923cd2ee3aac6f8b5be0ba2e85fb51d: Add wordmark and tagline for mnwiki (T318478) (duration: 03m 46s) [production]
07:08 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
07:08 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
07:07 <urbanecm@deploy1002> Synchronized static/images/mobile/copyright/: 81f66621e923cd2ee3aac6f8b5be0ba2e85fb51d: Add wordmark and tagline for mnwiki (T318478; 1/2) (duration: 03m 40s) [production]
07:04 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
06:49 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
06:45 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
06:45 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
06:41 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
06:36 <elukey> clean up my old home dir on matomo1002, ran `apt-get clean` + some other clean up steps on matomo1002 to free space on the root partition [production]
06:32 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: d2d2c08fc6e0dd5c0c85fbe31f85201721871aa9: eswiki: Enable structured mentor list (T310905) (duration: 04m 30s) [production]
06:31 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
06:30 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
06:30 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
06:29 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
2022-09-25 §
17:29 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt1053.eqiad.wmnet with OS bullseye [production]
17:08 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1053.eqiad.wmnet with reason: host reimage [production]
17:05 <andrew@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1053.eqiad.wmnet with reason: host reimage [production]