4251-4300 of 10000 results (105ms)
2023-06-27 ยง
18:41 <brennen@deploy1002> rebuilt and synchronized wikiversions files: group0 wikis to 1.41.0-wmf.15 refs T340243 [production]
18:40 <btullis@deploy1002> helmfile [staging] DONE helmfile.d/services/datahub: sync on main [production]
18:31 <brennen@deploy1002> Finished scap: Backport for [[gerrit:933154|Display the language button on pages without languages (T315036)]] (duration: 08m 53s) [production]
18:29 <jhathaway> puppet re-enabled, enjoy! [production]
18:28 <btullis@deploy1002> helmfile [staging] START helmfile.d/services/datahub: apply on main [production]
18:27 <btullis@deploy1002> helmfile [staging] START helmfile.d/services/datahub: apply on main [production]
18:26 <btullis@deploy1002> helmfile [staging] START helmfile.d/services/datahub: apply on main [production]
18:25 <btullis@deploy1002> helmfile [staging] START helmfile.d/services/datahub: apply on main [production]
18:25 <btullis@deploy1002> helmfile [staging] START helmfile.d/services/datahub: apply on main [production]
18:24 <brennen@deploy1002> abi and brennen: Backport for [[gerrit:933154|Display the language button on pages without languages (T315036)]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet [production]
18:22 <brennen@deploy1002> Started scap: Backport for [[gerrit:933154|Display the language button on pages without languages (T315036)]] [production]
18:18 <jhathaway> disabling puppet to test stdlib upgrade patch [production]
17:45 <gmodena@deploy1002> helmfile [staging] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
17:45 <gmodena@deploy1002> helmfile [staging] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
17:45 <gmodena@deploy1002> helmfile [staging] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
17:45 <gmodena@deploy1002> helmfile [staging] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
17:44 <gmodena@deploy1002> helmfile [staging] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
17:44 <gmodena@deploy1002> helmfile [staging] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
17:22 <brennen@deploy1002> Pruned MediaWiki: 1.41.0-wmf.12 (duration: 02m 05s) [production]
17:20 <brennen@deploy1002> Finished scap: testwikis wikis to 1.41.0-wmf.15 refs T340243 (duration: 42m 56s) [production]
16:49 <mutante> webperf1003/2003 restarted apache after deploying gerrit:932441 [production]
16:37 <brennen@deploy1002> Started scap: testwikis wikis to 1.41.0-wmf.15 refs T340243 [production]
16:36 <brennen> train 1.41.0-wmf.15: re-running scap stage-train (T340243) [production]
16:03 <btullis@deploy1002> helmfile [staging] DONE helmfile.d/services/datahub: sync on main [production]
15:51 <btullis@deploy1002> helmfile [staging] START helmfile.d/services/datahub: apply on main [production]
15:36 <jbond> puppet-merge fixed again [production]
15:35 <root@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti-test2001.codfw.wmnet [production]
15:34 <root@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti-test2001.codfw.wmnet [production]
15:34 <jmm@cumin2002> END (FAIL) - Cookbook sre.ganeti.drain-node (exit_code=99) for draining ganeti node ganeti-test2002.codfw.wmnet [production]
15:34 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti-test2002.codfw.wmnet [production]
15:33 <root@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti-test2001.codfw.wmnet [production]
15:33 <root@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti-test2001.codfw.wmnet [production]
15:32 <root@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti-test2001.codfw.wmnet [production]
15:32 <root@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti-test2001.codfw.wmnet [production]
15:24 <root@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti-test2001.codfw.wmnet [production]
15:24 <root@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti-test2001.codfw.wmnet [production]
15:24 <jbond> puppet-merge temprrarily broken [production]
15:23 <jbond> hi all fyi i have temporarily broken puppet-merge, fix is being done [production]
15:23 <root@cumin2002> END (FAIL) - Cookbook sre.ganeti.drain-node (exit_code=99) for draining ganeti node ganeti-test2001.codfw.wmnet [production]
15:23 <root@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti-test2001.codfw.wmnet [production]
15:21 <root@cumin2002> END (FAIL) - Cookbook sre.ganeti.drain-node (exit_code=99) for draining ganeti node ganeti-test2001.codfw.wmnet [production]
15:20 <root@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti-test2001.codfw.wmnet [production]
15:01 <btullis@deploy1002> helmfile [staging] START helmfile.d/services/datahub: apply on main [production]
14:53 <mforns@deploy1002> Finished deploy [airflow-dags/analytics@5e77b01]: (no justification provided) (duration: 00m 10s) [production]
14:52 <mforns@deploy1002> Started deploy [airflow-dags/analytics@5e77b01]: (no justification provided) [production]
14:47 <root@cumin2002> END (FAIL) - Cookbook sre.ganeti.drain-node (exit_code=99) for draining ganeti node ganeti-test2001.codfw.wmnet [production]
14:46 <root@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti-test2001.codfw.wmnet [production]
14:41 <elukey@cumin1001> END (PASS) - Cookbook sre.cassandra.roll-restart (exit_code=0) for nodes matching A:ml-cache-eqiad: Roll restart to pick up new certs and openjdk version - elukey@cumin1001 [production]
14:27 <btullis@deploy1002> helmfile [staging] START helmfile.d/services/datahub: apply on main [production]
14:24 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti-test2002.codfw.wmnet [production]