2251-2300 of 10000 results (88ms)
2023-12-21 ยง
19:14 <dancy@deploy2002> rebuilt and synchronized wikiversions files: group2 wikis to 1.42.0-wmf.10 refs T350086 [production]
18:39 <mutante> releases1003 - sudo chmod -R g+w /srv/org/wikimedia/releases/mediawiki/1.* [production]
17:26 <mutante> mirror1001 - when syncing tails mirror - @ERROR: max connections (23) reached -- try again later [production]
17:23 <mutante> [mirror1001:~] $ sudo systemctl start update-tails-mirror [production]
17:04 <cgoubert@deploy2002> helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: apply [production]
17:03 <cgoubert@deploy2002> helmfile [codfw] START helmfile.d/services/changeprop-jobqueue: apply [production]
17:03 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/changeprop-jobqueue: apply [production]
17:03 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/changeprop-jobqueue: apply [production]
17:02 <cgoubert@deploy2002> helmfile [staging] DONE helmfile.d/services/changeprop-jobqueue: apply [production]
17:02 <cgoubert@deploy2002> helmfile [staging] START helmfile.d/services/changeprop-jobqueue: apply [production]
16:27 <akosiaris@deploy2002> helmfile [staging] DONE helmfile.d/services/changeprop: apply [production]
16:27 <akosiaris@deploy2002> helmfile [staging] START helmfile.d/services/changeprop: apply [production]
16:26 <akosiaris@deploy2002> helmfile [eqiad] DONE helmfile.d/services/changeprop: apply [production]
16:26 <akosiaris@deploy2002> helmfile [eqiad] START helmfile.d/services/changeprop: apply [production]
16:18 <akosiaris@deploy2002> helmfile [codfw] DONE helmfile.d/services/changeprop: apply [production]
16:17 <akosiaris@deploy2002> helmfile [codfw] START helmfile.d/services/changeprop: apply [production]
16:10 <volans@cumin1002> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) for hosts wdqs1008.eqiad.wmnet [production]
16:10 <volans@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:08 <volans@cumin1002> START - Cookbook sre.dns.netbox [production]
16:03 <volans@cumin1002> START - Cookbook sre.hosts.decommission for hosts wdqs1008.eqiad.wmnet [production]
15:59 <isaranto@deploy2002> helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revertrisk' for release 'main' . [production]
15:58 <isaranto@deploy2002> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revertrisk' for release 'main' . [production]
15:54 <volans@cumin1002> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) for hosts wdqs1007.eqiad.wmnet [production]
15:54 <volans@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:53 <volans@cumin1002> START - Cookbook sre.dns.netbox [production]
15:47 <volans@cumin1002> START - Cookbook sre.hosts.decommission for hosts wdqs1007.eqiad.wmnet [production]
15:44 <pfischer@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
15:44 <pfischer@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
15:38 <kharlan@deploy2002> Finished scap: Backport for [[gerrit:984502|Use username for lookup for non-existing user as the vague target]] (duration: 10m 37s) [production]
15:36 <btullis@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
15:35 <btullis@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
15:32 <kharlan@deploy2002> kharlan and dreamyjazz: Continuing with sync [production]
15:30 <kharlan@deploy2002> kharlan and dreamyjazz: Backport for [[gerrit:984502|Use username for lookup for non-existing user as the vague target]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
15:28 <kharlan@deploy2002> Started scap: Backport for [[gerrit:984502|Use username for lookup for non-existing user as the vague target]] [production]
15:24 <kharlan@deploy2002> Finished scap: Backport for [[gerrit:984503|Use username for lookup for non-existing user as the vague target]] (duration: 11m 38s) [production]
15:20 <pfischer@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
15:19 <pfischer@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
15:18 <kharlan@deploy2002> kharlan and dreamyjazz: Continuing with sync [production]
15:15 <kharlan@deploy2002> kharlan and dreamyjazz: Backport for [[gerrit:984503|Use username for lookup for non-existing user as the vague target]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
15:13 <kharlan@deploy2002> Started scap: Backport for [[gerrit:984503|Use username for lookup for non-existing user as the vague target]] [production]
15:11 <pfischer@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
15:10 <pfischer@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
14:52 <lucaswerkmeister-wmde@deploy2002> Finished scap: Backport for [[gerrit:984501|Fix showing units and limits in NewPP limit report (T353793)]] (duration: 09m 27s) [production]
14:46 <lucaswerkmeister-wmde@deploy2002> matmarex and lucaswerkmeister-wmde: Continuing with sync [production]
14:44 <lucaswerkmeister-wmde@deploy2002> matmarex and lucaswerkmeister-wmde: Backport for [[gerrit:984501|Fix showing units and limits in NewPP limit report (T353793)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:43 <lucaswerkmeister-wmde@deploy2002> Started scap: Backport for [[gerrit:984501|Fix showing units and limits in NewPP limit report (T353793)]] [production]
14:37 <pfischer@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
14:36 <pfischer@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
14:31 <jclark@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
14:29 <jclark@cumin1002> START - Cookbook sre.dns.netbox [production]