101-150 of 10000 results (65ms)
2022-11-17 ยง
16:31 <jnuche@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-debug: apply [production]
16:31 <jnuche@deploy1002> helmfile [codfw] START helmfile.d/services/mw-debug: apply [production]
16:31 <jnuche@deploy1002> Started scap: testing k8s deploys [production]
16:23 <jnuche@deploy1002> Installing scap version "4.28.2" for 559 hosts [production]
16:12 <moritzm> active CAS instance has been switched to CAS 6.6.2 (from 6.4.6.3) T311235 [production]
16:10 <ebernhardson@deploy1002> Finished deploy [wikimedia/discovery/analytics@d33ab6c]: implement incoming_links update as a batch job (duration: 02m 26s) [production]
16:08 <ladsgroup@deploy1002> Finished scap: Backport for [[gerrit:857794|Get rid of extract2.php (T273179)]] (duration: 05m 51s) [production]
16:08 <ebernhardson@deploy1002> Started deploy [wikimedia/discovery/analytics@d33ab6c]: implement incoming_links update as a batch job [production]
16:03 <ladsgroup@deploy1002> ladsgroup and ladsgroup: Backport for [[gerrit:857794|Get rid of extract2.php (T273179)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet [production]
16:02 <ladsgroup@deploy1002> Started scap: Backport for [[gerrit:857794|Get rid of extract2.php (T273179)]] [production]
16:01 <mforns@deploy1002> Finished deploy [analytics/refinery@d7388a6] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@d7388a6] (duration: 01m 13s) [production]
16:00 <mforns@deploy1002> Started deploy [analytics/refinery@d7388a6] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@d7388a6] [production]
16:00 <jnuche@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-api-int: apply [production]
15:59 <jnuche@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-web: apply [production]
15:59 <jnuche@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-jobrunner: apply [production]
15:59 <jnuche@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-api-ext: apply [production]
15:59 <jnuche@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-web: apply [production]
15:59 <mforns@deploy1002> Finished deploy [analytics/refinery@d7388a6] (thin): Regular analytics weekly train THIN [analytics/refinery@d7388a6] (duration: 00m 08s) [production]
15:59 <jnuche@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-api-ext: apply [production]
15:59 <jnuche@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-jobrunner: apply [production]
15:59 <mforns@deploy1002> Started deploy [analytics/refinery@d7388a6] (thin): Regular analytics weekly train THIN [analytics/refinery@d7388a6] [production]
15:57 <mforns@deploy1002> Finished deploy [analytics/refinery@d7388a6]: Regular analytics weekly train [analytics/refinery@d7388a6] (duration: 05m 15s) [production]
15:56 <jnuche@deploy1002> helmfile [codfw] START helmfile.d/services/mw-api-ext: apply [production]
15:56 <jnuche@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-api-ext: apply [production]
15:55 <jnuche@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-jobrunner: apply [production]
15:55 <jnuche@deploy1002> helmfile [codfw] START helmfile.d/services/mw-jobrunner: apply [production]
15:55 <jnuche@deploy1002> helmfile [codfw] START helmfile.d/services/mw-api-int: apply [production]
15:55 <jnuche@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-api-int: apply [production]
15:55 <jnuche@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-web: apply [production]
15:55 <jnuche@deploy1002> helmfile [codfw] START helmfile.d/services/mw-web: apply [production]
15:52 <mforns@deploy1002> Started deploy [analytics/refinery@d7388a6]: Regular analytics weekly train [analytics/refinery@d7388a6] [production]
15:49 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on dbstore1007.eqiad.wmnet with reason: Maintenance [production]
15:49 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on dbstore1007.eqiad.wmnet with reason: Maintenance [production]
15:48 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1197 (T323214)', diff saved to https://phabricator.wikimedia.org/P40117 and previous config saved to /var/cache/conftool/dbconfig/20221117-154855-ladsgroup.json [production]
15:45 <jnuche@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-api-int: apply [production]
15:45 <jnuche@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-api-int: apply [production]
15:45 <jnuche@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-web: apply [production]
15:45 <jnuche@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-web: apply [production]
15:45 <jnuche@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-jobrunner: apply [production]
15:43 <hnowlan@cumin1001> START - Cookbook sre.postgresql.postgres-init [production]
15:42 <jnuche@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-api-ext: apply [production]
15:42 <jnuche@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-api-ext: apply [production]
15:42 <jnuche@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-jobrunner: apply [production]
15:42 <jnuche@deploy1002> helmfile [codfw] START helmfile.d/services/mw-jobrunner: apply [production]
15:42 <jnuche@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-jobrunner: apply [production]
15:42 <jnuche@deploy1002> helmfile [codfw] START helmfile.d/services/mw-api-int: apply [production]
15:42 <jnuche@deploy1002> helmfile [codfw] START helmfile.d/services/mw-api-ext: apply [production]
15:42 <jnuche@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-api-ext: apply [production]
15:42 <jnuche@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-api-int: apply [production]
15:42 <jnuche@deploy1002> helmfile [codfw] START helmfile.d/services/mw-web: apply [production]