301-350 of 10000 results (44ms)
2022-03-21 ยง
21:43 <rzl@deploy1002> helmfile [eqiad] START helmfile.d/services/rdf-streaming-updater: apply [production]
21:43 <rzl@deploy1002> helmfile [eqiad] DONE helmfile.d/services/proton: apply [production]
21:41 <rzl@deploy1002> helmfile [eqiad] START helmfile.d/services/proton: apply [production]
21:41 <rzl@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mobileapps: apply [production]
21:41 <rzl@deploy1002> helmfile [eqiad] START helmfile.d/services/mobileapps: apply [production]
21:41 <rzl@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mathoid: apply [production]
21:40 <rzl@deploy1002> helmfile [eqiad] START helmfile.d/services/mathoid: apply [production]
21:36 <rzl@deploy1002> helmfile [eqiad] START helmfile.d/services/eventstreams-internal: apply [production]
21:33 <rzl@deploy1002> helmfile [eqiad] START helmfile.d/services/eventstreams: apply [production]
21:33 <rzl@deploy1002> helmfile [eqiad] DONE helmfile.d/services/eventgate-main: apply [production]
21:31 <rzl@deploy1002> helmfile [eqiad] START helmfile.d/services/eventgate-main: apply [production]
21:31 <rzl@deploy1002> helmfile [eqiad] DONE helmfile.d/services/eventgate-logging-external: apply [production]
21:30 <rzl@deploy1002> helmfile [eqiad] START helmfile.d/services/eventgate-logging-external: apply [production]
21:30 <rzl@deploy1002> helmfile [eqiad] DONE helmfile.d/services/eventgate-analytics: apply [production]
21:28 <rzl@deploy1002> helmfile [eqiad] START helmfile.d/services/eventgate-analytics: apply [production]
21:28 <rzl@deploy1002> helmfile [eqiad] DONE helmfile.d/services/eventgate-analytics-external: apply [production]
21:27 <rzl@deploy1002> helmfile [eqiad] START helmfile.d/services/eventgate-analytics-external: apply [production]
21:27 <rzl@deploy1002> helmfile [eqiad] DONE helmfile.d/services/cxserver: apply [production]
21:26 <rzl@deploy1002> helmfile [eqiad] START helmfile.d/services/cxserver: apply [production]
21:25 <rzl@deploy1002> helmfile [eqiad] DONE helmfile.d/services/blubberoid: apply [production]
21:25 <rzl@deploy1002> helmfile [eqiad] START helmfile.d/services/blubberoid: apply [production]
21:25 <rzl@deploy1002> helmfile [eqiad] DONE helmfile.d/services/apertium: apply [production]
21:24 <rzl@deploy1002> helmfile [eqiad] START helmfile.d/services/apertium: apply [production]
21:10 <pt1979@cumin1001> START - Cookbook sre.hosts.reimage for host cloudvirt1024.eqiad.wmnet with OS bullseye [production]
21:03 <pt1979@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cloudvirt1024.eqiad.wmnet with OS bullseye [production]
20:56 <dduvall@deploy1002> rebuilt and synchronized wikiversions files: all wikis to 1.39.0-wmf.2 refs T300203 [production]
20:52 <pt1979@cumin1001> START - Cookbook sre.hosts.reimage for host cloudvirt1024.eqiad.wmnet with OS bullseye [production]
20:49 <dduvall@deploy1002> Synchronized php: group1 wikis to 1.39.0-wmf.2 refs T300203 (duration: 00m 51s) [production]
20:49 <dduvall@deploy1002> rebuilt and synchronized wikiversions files: group1 wikis to 1.39.0-wmf.2 refs T300203 [production]
20:31 <urbanecm> UTC late backport window completed [production]
20:29 <urbanecm@deploy1002> Synchronized docroot/noc/db.php: 3bcccdc: Migrate away from $wmfDbconfigFromEtcd (T45956; 2/2) (duration: 00m 50s) [production]
20:28 <urbanecm@deploy1002> Synchronized wmf-config/etcd.php: 3bcccdc: Migrate away from $wmfDbconfigFromEtcd (T45956; 1/2) (duration: 00m 50s) [production]
20:19 <urbanecm@deploy1002> Synchronized wmf-config/CommonSettings.php: 8347de5: ExtensionDistributor: Add REL1_38 (T304185) (duration: 00m 51s) [production]
19:48 <brennen> mw1416: sudo -i /usr/local/sbin/restart-php7.2-fpm [production]
19:42 <brennen@deploy1002> rebuilt and synchronized wikiversions files: group0 wikis to 1.39.0-wmf.2 refs T300203 [production]
19:26 <brennen@deploy1002> Finished scap: testwikis wikis to 1.39.0-wmf.2 refs T300203 (duration: 64m 33s) [production]
18:54 <ebernhardson> T303548 start commonswiki reindexing on eqiad codfw and cloudelastic cirrus clusters [production]
18:50 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3312 (T298557)', diff saved to https://phabricator.wikimedia.org/P22906 and previous config saved to /var/cache/conftool/dbconfig/20220321-185042-marostegui.json [production]
18:35 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3312', diff saved to https://phabricator.wikimedia.org/P22905 and previous config saved to /var/cache/conftool/dbconfig/20220321-183537-marostegui.json [production]
18:22 <brennen@deploy1002> Started scap: testwikis wikis to 1.39.0-wmf.2 refs T300203 [production]
18:20 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3312', diff saved to https://phabricator.wikimedia.org/P22904 and previous config saved to /var/cache/conftool/dbconfig/20220321-182032-marostegui.json [production]
18:19 <otto@deploy1002> Finished deploy [analytics/refinery@2175d63]: gobblin prometheus metrics for all jobs - T294420 (duration: 04m 41s) [production]
18:19 <brennen> trainsperiment (T300203): 1.39.0-wmf.1 on all wikis; starting prep of wmf.2, will abort if needed [production]
18:15 <otto@deploy1002> Started deploy [analytics/refinery@2175d63]: gobblin prometheus metrics for all jobs - T294420 [production]
18:05 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3312 (T298557)', diff saved to https://phabricator.wikimedia.org/P22903 and previous config saved to /var/cache/conftool/dbconfig/20220321-180526-marostegui.json [production]
18:04 <brennen@deploy1002> rebuilt and synchronized wikiversions files: all wikis to 1.39.0-wmf.1 refs T300203 [production]
18:03 <otto@deploy1002> Finished deploy [analytics/refinery@2175d63] (hadoop-test): gobblin prometheus metrics for all jobs - T294420 (duration: 07m 19s) [production]
17:59 <razzi> `sudo maintain-views --all-databases --replace-all --table flaggedrevs` on clouddb1021 for T302233 [production]
17:59 <razzi> `sudo maintain-views --all-databases --replace-all --table flaggedrevs` on clouddb1020 for T302233 [production]
17:57 <razzi> `sudo maintain-views --all-databases --replace-all --table flaggedrevs` on clouddb1016 for T302233 [production]