1351-1400 of 10000 results (76ms)
2023-05-30 ยง
19:36 <bking@deploy1002> Finished deploy [wdqs/wdqs@dff41b7]: 0.3.124 (duration: 04m 02s) [production]
19:32 <bking@deploy1002> Started deploy [wdqs/wdqs@dff41b7]: 0.3.124 [production]
19:29 <bking@deploy1002> Finished deploy [wdqs/wdqs@dff41b7]: 0.3.124 (duration: 00m 54s) [production]
19:29 <bking@deploy1002> Started deploy [wdqs/wdqs@dff41b7]: 0.3.124 [production]
19:29 <bking@deploy1002> Finished deploy [wdqs/wdqs@dff41b7]: 0.3.124 (duration: 16m 36s) [production]
19:24 <ryankemper@puppetmaster1001> conftool action : set/weight=0:pooled=inactive; selector: name=wdqs2021.* [production]
19:12 <inflatador> [WDQS Deploy] Deploying version 0.3.124 [production]
19:11 <bking@deploy1002> Started deploy [wdqs/wdqs@dff41b7]: 0.3.124 [production]
18:27 <dduvall@deploy1002> rebuilt and synchronized wikiversions files: group0 wikis to 1.41.0-wmf.11 refs T337525 [production]
17:45 <mutante> re-enabling puppet on contint2001 [production]
16:20 <rzl> rzl@mwmaint1002:~$ sudo systemctl start mediawiki_job_growthexperiments-userImpactUpdateRecentlyEdited [production]
16:19 <rzl> rzl@mwmaint1002:~$ sudo systemctl start mediawiki_job_growthexperiments-userImpactUpdateRecentlyRegistered [production]
16:14 <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:924053|[Growth] Enable user impact refresh on 10 more wikis (T336203)]] (duration: 07m 08s) [production]
16:07 <urbanecm@deploy1002> Started scap: Backport for [[gerrit:924053|[Growth] Enable user impact refresh on 10 more wikis (T336203)]] [production]
16:00 <otto@deploy1002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
16:00 <otto@deploy1002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
15:58 <otto@deploy1002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
15:58 <otto@deploy1002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
15:57 <otto@deploy1002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
15:56 <otto@deploy1002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
15:56 <otto@deploy1002> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
15:55 <otto@deploy1002> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
15:54 <otto@deploy1002> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
15:54 <otto@deploy1002> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
15:54 <otto@deploy1002> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
15:53 <otto@deploy1002> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
15:51 <herron@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mwlog2002.codfw.wmnet with OS bullseye [production]
15:51 <otto@deploy1002> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
15:51 <otto@deploy1002> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
15:49 <otto@deploy1002> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
15:49 <otto@deploy1002> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
15:15 <aborrero@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcontrol2005-dev.codfw.wmnet with OS bullseye [production]
15:15 <aborrero@cumin2002> END (FAIL) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=99) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - aborrero@cumin2002" [production]
15:14 <aborrero@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - aborrero@cumin2002" [production]
15:10 <tgr_> UTC evening deploys done [production]
15:08 <tgr@deploy1002> Finished scap: Backport for [[gerrit:924160|ve.ui.MWGalleryDialog: Fix showing the search panel (T337638)]], [[gerrit:924456|Hide 'editnotice-notext' message in VE (and mobile apps) (T337633)]], [[gerrit:924458|ve.ui.MWGalleryDialog: Fix showing the search panel (T337638)]] (duration: 08m 08s) [production]
15:05 <bking@deploy1002> helmfile [codfw] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
15:03 <bking@deploy1002> helmfile [codfw] START helmfile.d/services/rdf-streaming-updater: apply [production]
15:02 <tgr@deploy1002> tgr and matmarex: Backport for [[gerrit:924160|ve.ui.MWGalleryDialog: Fix showing the search panel (T337638)]], [[gerrit:924456|Hide 'editnotice-notext' message in VE (and mobile apps) (T337633)]], [[gerrit:924458|ve.ui.MWGalleryDialog: Fix showing the search panel (T337638)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet [production]
15:00 <tgr@deploy1002> Started scap: Backport for [[gerrit:924160|ve.ui.MWGalleryDialog: Fix showing the search panel (T337638)]], [[gerrit:924456|Hide 'editnotice-notext' message in VE (and mobile apps) (T337633)]], [[gerrit:924458|ve.ui.MWGalleryDialog: Fix showing the search panel (T337638)]] [production]
14:50 <moritzm> installing texlive-bin security updates [production]
14:49 <herron@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mwlog2002.codfw.wmnet with reason: host reimage [production]
14:46 <herron@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mwlog2002.codfw.wmnet with reason: host reimage [production]
14:35 <tgr@deploy1002> Finished scap: Backport for [[gerrit:924159|Hide 'editnotice-notext' message in VE (and mobile apps) (T337633)]] (duration: 08m 01s) [production]
14:29 <tgr@deploy1002> matmarex and tgr: Backport for [[gerrit:924159|Hide 'editnotice-notext' message in VE (and mobile apps) (T337633)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet [production]
14:28 <herron@cumin1001> START - Cookbook sre.hosts.reimage for host mwlog2002.codfw.wmnet with OS bullseye [production]
14:27 <tgr@deploy1002> Started scap: Backport for [[gerrit:924159|Hide 'editnotice-notext' message in VE (and mobile apps) (T337633)]] [production]
14:16 <herron@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host mwlog2002.codfw.wmnet with OS bullseye [production]
14:16 <jmm@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host puppetdb1003.eqiad.wmnet with OS bookworm [production]
14:14 <gmodena@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply [production]