1801-1850 of 10000 results (107ms)
2023-12-12 §
07:16 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'configure' for AS: 4800 [production]
06:46 <marostegui@deploy2002> Finished scap: Backport for [[gerrit:982226|Revert "ProductionServices.php: Promote pc2014 as master of pc1"]] (duration: 09m 00s) [production]
06:38 <marostegui@deploy2002> marostegui: Continuing with sync [production]
06:38 <marostegui@deploy2002> marostegui: Backport for [[gerrit:982226|Revert "ProductionServices.php: Promote pc2014 as master of pc1"]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
06:37 <marostegui@deploy2002> Started scap: Backport for [[gerrit:982226|Revert "ProductionServices.php: Promote pc2014 as master of pc1"]] [production]
06:35 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host pc2011.codfw.wmnet with OS bookworm [production]
06:21 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on pc2011.codfw.wmnet with reason: host reimage [production]
06:18 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on pc2011.codfw.wmnet with reason: host reimage [production]
06:00 <marostegui@cumin1001> START - Cookbook sre.hosts.reimage for host pc2011.codfw.wmnet with OS bookworm [production]
05:59 <marostegui@deploy2002> Finished scap: Backport for [[gerrit:982206|ProductionServices.php: Promote pc2014 as master of pc1 (T351787)]] (duration: 08m 35s) [production]
05:52 <marostegui@deploy2002> marostegui: Continuing with sync [production]
05:52 <marostegui@deploy2002> marostegui: Backport for [[gerrit:982206|ProductionServices.php: Promote pc2014 as master of pc1 (T351787)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
05:50 <marostegui@deploy2002> Started scap: Backport for [[gerrit:982206|ProductionServices.php: Promote pc2014 as master of pc1 (T351787)]] [production]
05:47 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on pc[2011,2014].codfw.wmnet,pc[1011,1014].eqiad.wmnet with reason: pc1 master switch T351787 [production]
05:47 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on pc[2011,2014].codfw.wmnet,pc[1011,1014].eqiad.wmnet with reason: pc1 master switch T351787 [production]
04:58 <mwpresync@deploy2002> Pruned MediaWiki: 1.42.0-wmf.5 (duration: 02m 17s) [production]
04:55 <mwpresync@deploy2002> Finished scap: testwikis wikis to 1.42.0-wmf.9 refs T350085 (duration: 53m 03s) [production]
04:02 <mwpresync@deploy2002> Started scap: testwikis wikis to 1.42.0-wmf.9 refs T350085 [production]
2023-12-11 §
22:39 <jdrewniak@deploy2002> Finished scap: Backport for [[gerrit:982162|[Vector] Deploy the Zebra CSS refactor under feature flag (T353008)]] (duration: 12m 14s) [production]
22:32 <jdrewniak@deploy2002> jdrewniak: Continuing with sync [production]
22:28 <jdrewniak@deploy2002> jdrewniak: Backport for [[gerrit:982162|[Vector] Deploy the Zebra CSS refactor under feature flag (T353008)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
22:26 <jdrewniak@deploy2002> Started scap: Backport for [[gerrit:982162|[Vector] Deploy the Zebra CSS refactor under feature flag (T353008)]] [production]
22:23 <ladsgroup@deploy2002> Finished scap: Backport for [[gerrit:981737|api: Add support for pagelinks migration in ApiQueryBacklinks::runSecondQuery (T351237)]] (duration: 10m 42s) [production]
22:15 <ladsgroup@deploy2002> jforrester and ladsgroup: Continuing with sync [production]
22:13 <ladsgroup@deploy2002> jforrester and ladsgroup: Backport for [[gerrit:981737|api: Add support for pagelinks migration in ApiQueryBacklinks::runSecondQuery (T351237)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
22:12 <ladsgroup@deploy2002> Started scap: Backport for [[gerrit:981737|api: Add support for pagelinks migration in ApiQueryBacklinks::runSecondQuery (T351237)]] [production]
22:09 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 18:00:00 on wdqs1015.eqiad.wmnet with reason: T347355 [production]
22:09 <bking@cumin2002> START - Cookbook sre.hosts.downtime for 18:00:00 on wdqs1015.eqiad.wmnet with reason: T347355 [production]
18:34 <claime> Raised replicas for mw-web [production]
18:32 <cgoubert@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-web: apply [production]
18:32 <cgoubert@deploy2002> helmfile [codfw] START helmfile.d/services/mw-web: apply [production]
18:32 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-web: apply [production]
18:32 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-web: apply [production]
18:32 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-web: apply [production]
18:31 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-web: apply [production]
17:48 <jayme@deploy2002> helmfile [aux-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
17:47 <jayme@deploy2002> helmfile [aux-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
17:47 <jayme@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
17:45 <jayme@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
17:45 <jayme@deploy2002> helmfile [ml-serve-codfw] DONE helmfile.d/admin 'apply'. [production]
17:43 <jayme@deploy2002> helmfile [ml-serve-codfw] START helmfile.d/admin 'apply'. [production]
17:43 <jayme@deploy2002> helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'apply'. [production]
17:42 <jayme@deploy2002> helmfile [ml-serve-eqiad] START helmfile.d/admin 'apply'. [production]
17:04 <jdrewniak@deploy2002> Synchronized portals: Wikimedia Portals Update: [[gerrit:982110| Bumping portals to master (T128546)]] (duration: 08m 15s) [production]
17:01 <jclark@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host sessionstore2004.codfw.wmnet with OS bullseye [production]
17:00 <jclark@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1001" [production]
16:57 <jclark@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1001" [production]
16:56 <jdrewniak@deploy2002> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:982110| Bumping portals to master (T128546)]] (duration: 10m 12s) [production]
16:50 <cgoubert@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host kubernetes1060.eqiad.wmnet with OS bullseye [production]
16:49 <cgoubert@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host kubernetes1061.eqiad.wmnet with OS bullseye [production]