4251-4300 of 10000 results (44ms)
2021-08-06 §
12:22 <oblivian@deploy1002> helmfile [eqiad] START helmfile.d/admin 'sync'. [production]
12:22 <oblivian@deploy1002> helmfile [eqiad] DONE helmfile.d/admin 'sync'. [production]
12:22 <oblivian@deploy1002> helmfile [eqiad] START helmfile.d/admin 'sync'. [production]
12:21 <oblivian@deploy1002> helmfile [eqiad] DONE helmfile.d/admin 'sync'. [production]
12:21 <oblivian@deploy1002> helmfile [eqiad] START helmfile.d/admin 'sync'. [production]
12:20 <oblivian@deploy1002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
12:20 <oblivian@deploy1002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
11:45 <jayme> enabling dragonfly dfdaemon on kubernetes200* [production]
11:16 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on maps1006.eqiad.wmnet with reason: REIMAGE [production]
11:14 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on maps1006.eqiad.wmnet with reason: REIMAGE [production]
10:16 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1181.eqiad.wmnet with reason: REIMAGE [production]
10:14 <kormat@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on db1181.eqiad.wmnet with reason: REIMAGE [production]
09:58 <kormat> reimaging db1181 (s7) to buster T288244 [production]
09:15 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on maps2005.codfw.wmnet with reason: Rebuilding as buster replica of maps1009 [production]
09:15 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on maps2005.codfw.wmnet with reason: Rebuilding as buster replica of maps1009 [production]
09:15 <hnowlan@puppetmaster1001> conftool action : set/pooled=no; selector: name=maps2005.codfw.wmnet [production]
09:14 <dcausse@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'rdf-streaming-updater' for release 'main' . [production]
08:38 <elukey@deploy1002> helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. [production]
08:38 <elukey@deploy1002> helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. [production]
08:31 <elukey@deploy1002> helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. [production]
08:30 <elukey@deploy1002> helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. [production]
08:10 <elukey@deploy1002> helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. [production]
08:09 <elukey@deploy1002> helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. [production]
07:58 <godog> test thanos 0.21 on thanos-fe2001 - T288326 [production]
07:48 <elukey@deploy1002> helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. [production]
07:48 <elukey@deploy1002> helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. [production]
07:42 <elukey@deploy1002> helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. [production]
07:36 <dcausse@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'rdf-streaming-updater' for release 'main' . [production]
07:32 <elukey@deploy1002> helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. [production]
07:15 <dcausse@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'rdf-streaming-updater' for release 'main' . [production]
07:02 <dcausse@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'rdf-streaming-updater' for release 'main' . [production]
06:43 <marostegui> Reboot db1107 to upgrade its kernel [production]
05:47 <marostegui> Optimize commonswiki.image on db1160 T288273 [production]
05:44 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1160 T288273', diff saved to https://phabricator.wikimedia.org/P16965 and previous config saved to /var/cache/conftool/dbconfig/20210806-054433-marostegui.json [production]
05:44 <eileen> civicrm revision changed from 931b3defbe to c132d2f943, config revision is 3696499932 [production]
04:03 <TimStarling> on mwmaint1002 mwscript extensions/SecurePoll/cli/wm-scripts/makeGlobalVoterList.php --wiki=mediawikiwiki --edit-count-table=bv2021_edits --list-name=board-vote-2021 --short-min-edits=20 --long-min-edits=300 [production]
04:00 <eileen> civicrm revision changed from e52f569991 to 931b3defbe, config revision is 3696499932 [production]
03:54 <tstarling@deploy1002> Synchronized php-1.37.0-wmf.17/extensions/SecurePoll/cli/wm-scripts/makeGlobalVoterList.php: need to run this script T288025 (duration: 00m 57s) [production]
03:32 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
03:30 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
01:01 <pt1979@cumin2002> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on ms-be2065.codfw.wmnet with reason: REIMAGE [production]
00:58 <pt1979@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be2065.codfw.wmnet with reason: REIMAGE [production]
00:14 <pt1979@cumin2002> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on ms-be2064.codfw.wmnet with reason: REIMAGE [production]
00:12 <pt1979@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be2064.codfw.wmnet with reason: REIMAGE [production]
00:03 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
00:03 <egardner@deploy1002> Synchronized php-1.37.0-wmf.17/extensions/MediaSearch: Backport: [[gerrit:710387|Revert "Open search result links in-place"]] (duration: 00m 58s) [production]
00:01 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
2021-08-05 §
23:39 <pt1979@cumin2002> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on ms-be2063.codfw.wmnet with reason: REIMAGE [production]
23:37 <pt1979@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be2063.codfw.wmnet with reason: REIMAGE [production]
23:17 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]