51-100 of 10000 results (99ms)
2024-08-12 ยง
16:59 <urbanecm@deploy1003> Finished scap: Backport for [[gerrit:1062056|Revert "[Growth] dewiki: Enable frontend for Add Link"]] (duration: 06m 39s) [production]
16:57 <pt1979@cumin2002> START - Cookbook sre.hosts.reimage for host testhost2001.codfw.wmnet with OS bookworm [production]
16:55 <urbanecm@deploy1003> urbanecm, trainbranchbot: Continuing with sync [production]
16:55 <urbanecm@deploy1003> urbanecm, trainbranchbot: Backport for [[gerrit:1062056|Revert "[Growth] dewiki: Enable frontend for Add Link"]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
16:53 <urbanecm@deploy1003> Started scap sync-world: Backport for [[gerrit:1062056|Revert "[Growth] dewiki: Enable frontend for Add Link"]] [production]
16:51 <urbanecm@deploy1003> Sync cancelled. [production]
16:50 <urbanecm@deploy1003> urbanecm: Backport for [[gerrit:1060148|[Growth] dewiki: Enable frontend for Add Link (T371597)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
16:48 <urbanecm@deploy1003> Started scap sync-world: Backport for [[gerrit:1060148|[Growth] dewiki: Enable frontend for Add Link (T371597)]] [production]
16:36 <ebernhardson@deploy1003> helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
16:36 <ebernhardson@deploy1003> helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
16:33 <bking@cumin2002> END (PASS) - Cookbook sre.elasticsearch.rolling-operation (exit_code=0) Operation.RESTART (3 nodes at a time) for ElasticSearch cluster search_codfw: security update - bking@cumin2002 - T371874 [production]
16:32 <ebernhardson@deploy1003> helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
16:32 <ebernhardson@deploy1003> helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
16:13 <ayounsi@cumin1002> END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling restart_daemons on A:netbox-canary [production]
16:13 <ayounsi@cumin1002> START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox-canary [production]
16:10 <ebernhardson@deploy1003> helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
16:09 <ebernhardson@deploy1003> helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
16:00 <ebernhardson@deploy1003> helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
16:00 <ebernhardson@deploy1003> helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
15:56 <cdanis@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mobileapps: apply [production]
15:56 <milimetric@deploy1003> Finished deploy [airflow-dags/analytics@416511b]: (no justification provided) (duration: 00m 40s) [production]
15:55 <milimetric@deploy1003> Started deploy [airflow-dags/analytics@416511b]: (no justification provided) [production]
15:54 <cdanis@deploy1003> helmfile [eqiad] START helmfile.d/services/mobileapps: apply [production]
15:54 <cdanis@deploy1003> helmfile [codfw] DONE helmfile.d/services/mobileapps: apply [production]
15:54 <cdanis@deploy1003> helmfile [codfw] START helmfile.d/services/mobileapps: apply [production]
15:54 <cdanis@deploy1003> helmfile [eqiad] DONE helmfile.d/services/cxserver: apply [production]
15:53 <cdanis@deploy1003> helmfile [eqiad] START helmfile.d/services/cxserver: apply [production]
15:53 <cdanis@deploy1003> helmfile [codfw] DONE helmfile.d/services/cxserver: apply [production]
15:53 <cdanis@deploy1003> helmfile [codfw] START helmfile.d/services/cxserver: apply [production]
15:53 <cdanis@deploy1003> helmfile [eqiad] DONE helmfile.d/services/citoid: apply [production]
15:52 <cdanis@deploy1003> helmfile [eqiad] START helmfile.d/services/citoid: apply [production]
15:52 <cdanis@deploy1003> helmfile [codfw] DONE helmfile.d/services/citoid: apply [production]
15:52 <cdanis@deploy1003> helmfile [codfw] START helmfile.d/services/citoid: apply [production]
15:52 <cdanis@deploy1003> helmfile [eqiad] DONE helmfile.d/services/apertium: apply [production]
15:51 <cdanis@deploy1003> helmfile [eqiad] START helmfile.d/services/apertium: apply [production]
15:51 <cdanis@deploy1003> helmfile [codfw] DONE helmfile.d/services/apertium: apply [production]
15:50 <cdanis@deploy1003> helmfile [codfw] START helmfile.d/services/apertium: apply [production]
15:36 <hnowlan@deploy1003> helmfile [codfw] DONE helmfile.d/services/shellbox-video: apply [production]
15:35 <hnowlan@deploy1003> helmfile [codfw] START helmfile.d/services/shellbox-video: apply [production]
15:34 <hnowlan@deploy1003> helmfile [eqiad] DONE helmfile.d/services/shellbox-video: apply [production]
15:34 <hnowlan@deploy1003> helmfile [eqiad] START helmfile.d/services/shellbox-video: apply [production]
15:23 <urbanecm@deploy1003> Finished scap: Backport for [[gerrit:1061965|noc: Fix list of databases in db.php (T372249)]] (duration: 08m 22s) [production]
15:15 <urbanecm@deploy1003> Started scap sync-world: Backport for [[gerrit:1061965|noc: Fix list of databases in db.php (T372249)]] [production]
15:07 <isaranto@deploy1003> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'articletopic-outlink' for release 'main' . [production]
15:06 <isaranto@deploy1003> helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'articletopic-outlink' for release 'main' . [production]
14:46 <jgiannelos@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mobileapps: apply [production]
14:45 <jgiannelos@deploy1003> helmfile [eqiad] START helmfile.d/services/mobileapps: apply [production]
14:44 <bking@cumin2002> START - Cookbook sre.elasticsearch.rolling-operation Operation.RESTART (3 nodes at a time) for ElasticSearch cluster search_codfw: security update - bking@cumin2002 - T371874 [production]
14:42 <elukey> powercycle ms-be1078 - causing frontend errors in swift-eqiad, network link is down (if down/up didn't work, nothing in the dmesg/syslog) [production]
14:42 <jgiannelos@deploy1003> helmfile [codfw] DONE helmfile.d/services/mobileapps: apply [production]