5101-5150 of 10000 results (99ms)
2023-06-02 §
07:21 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host bast1003.wikimedia.org [production]
01:53 <ejegg> fundraising python tools upgraded from 759d4c89 to 2ca83336 [production]
01:22 <cstone> civicrm upgraded from 3819d6d1 to bcc8fccc [production]
2023-06-01 §
21:06 <samtar@deploy1002> Finished scap: Backport for [[gerrit:925858|Remove deleted config wgVectorStickyHeaderEdit (T337955)]] (duration: 08m 30s) [production]
20:59 <samtar@deploy1002> esanders and samtar: Backport for [[gerrit:925858|Remove deleted config wgVectorStickyHeaderEdit (T337955)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet [production]
20:57 <samtar@deploy1002> Started scap: Backport for [[gerrit:925858|Remove deleted config wgVectorStickyHeaderEdit (T337955)]] [production]
20:54 <samtar@deploy1002> Finished scap: Backport for [[gerrit:925792|Remove config and AB test code for edit buttons in sticky header (T337955)]] (duration: 10m 29s) [production]
20:45 <samtar@deploy1002> samtar and ksarabia: Backport for [[gerrit:925792|Remove config and AB test code for edit buttons in sticky header (T337955)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet [production]
20:44 <samtar@deploy1002> Started scap: Backport for [[gerrit:925792|Remove config and AB test code for edit buttons in sticky header (T337955)]] [production]
20:21 <samtar@deploy1002> Finished scap: Backport for [[gerrit:917863|Deploy Research Incentive survey on enwiki (T336092)]] (duration: 07m 56s) [production]
20:15 <samtar@deploy1002> dani and samtar: Backport for [[gerrit:917863|Deploy Research Incentive survey on enwiki (T336092)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet [production]
20:13 <samtar@deploy1002> Started scap: Backport for [[gerrit:917863|Deploy Research Incentive survey on enwiki (T336092)]] [production]
20:12 <samtar@deploy1002> Finished scap: Backport for [[gerrit:886370|Always collapse by default the CheckUserHelper on loginwiki (T328726)]] (duration: 08m 20s) [production]
20:05 <samtar@deploy1002> samtar and dreamyjazz: Backport for [[gerrit:886370|Always collapse by default the CheckUserHelper on loginwiki (T328726)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet [production]
20:03 <samtar@deploy1002> Started scap: Backport for [[gerrit:886370|Always collapse by default the CheckUserHelper on loginwiki (T328726)]] [production]
19:51 <ejegg> fundraising python tools upgraded from 72570bdd to 759d4c89 [production]
19:12 <mforns@deploy1002> Finished deploy [airflow-dags/analytics@21e7354]: (no justification provided) (duration: 02m 42s) [production]
19:11 <mforns@deploy1002> Started deploy [airflow-dags/analytics@21e7354]: (no justification provided) [production]
19:11 <bblack@deploy1002> Unlocked for deployment [ALL REPOSITORIES]: temporary lock for LVS/pybal upgrade work (duration: 03m 27s) [production]
19:09 <bblack> lvs1* (eqiad): upgrade pybal to 1.15.13 - T334703 [production]
19:08 <bblack@deploy1002> Locking from deployment [ALL REPOSITORIES]: temporary lock for LVS/pybal upgrade work [production]
18:45 <bblack> lvs6* (drmrs): upgrade pybal to 1.15.13 - T334703 [production]
18:33 <bblack> lvs3* (esams): upgrade pybal to 1.15.13 - T334703 [production]
18:32 <dduvall@deploy1002> rebuilt and synchronized wikiversions files: group2 wikis to 1.41.0-wmf.11 refs T337525 [production]
17:50 <mforns@deploy1002> Finished deploy [airflow-dags/analytics@03ca1c1]: (no justification provided) (duration: 00m 10s) [production]
17:50 <fabfur@cumin1001> END (PASS) - Cookbook sre.cdn.run-puppet-restart-varnish (exit_code=0) rolling custom on A:cp-upload_drmrs and A:cp [production]
17:50 <mforns@deploy1002> Started deploy [airflow-dags/analytics@03ca1c1]: (no justification provided) [production]
17:49 <hnowlan@deploy1002> helmfile [codfw] DONE helmfile.d/services/device-analytics: apply [production]
17:48 <hnowlan@deploy1002> helmfile [codfw] START helmfile.d/services/device-analytics: apply [production]
17:48 <fabfur@cumin1001> END (PASS) - Cookbook sre.cdn.run-puppet-restart-varnish (exit_code=0) rolling custom on A:cp-text_drmrs and A:cp [production]
17:47 <hnowlan@deploy1002> helmfile [eqiad] DONE helmfile.d/services/device-analytics: apply [production]
17:47 <hnowlan@deploy1002> helmfile [eqiad] START helmfile.d/services/device-analytics: apply [production]
17:45 <hnowlan@deploy1002> helmfile [staging] DONE helmfile.d/services/device-analytics: apply [production]
17:45 <hnowlan@deploy1002> helmfile [staging] START helmfile.d/services/device-analytics: apply [production]
17:05 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cloudswift1002.eqiad.wmnet with OS bullseye [production]
17:05 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host cloudswift1002.eqiad.wmnet with OS bullseye [production]
16:55 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cloudswift1002.eqiad.wmnet with OS bullseye [production]
16:55 <otto@deploy1002> Synchronized wmf-config/InitialiseSettings.php: revert: Remove undeeded wgEventBusStreamNamesMap override setting. Recent EventBus changes are not deployed yet? - T336817 (duration: 07m 24s) [production]
16:55 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host cloudswift1002.eqiad.wmnet with OS bullseye [production]
16:53 <aborrero@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcontrol2004-dev.codfw.wmnet with OS bullseye [production]
16:53 <aborrero@cumin2002> END (FAIL) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=99) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - aborrero@cumin2002" [production]
16:52 <aborrero@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - aborrero@cumin2002" [production]
16:44 <otto@deploy1002> Synchronized wmf-config/InitialiseSettings.php: no-op: Remove undeeded wgEventBusStreamNamesMap override setting - T336817 (duration: 08m 18s) [production]
16:42 <bblack> lvs2* (codfw): upgrade pybal to 1.15.13 - T334703 [production]
16:40 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cloudswift1002.eqiad.wmnet with OS bullseye [production]
16:40 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host cloudswift1002.eqiad.wmnet with OS bullseye [production]
16:35 <bblack> lvs5* (eqsin): upgrade pybal to 1.15.13 - T334703 [production]
16:32 <bblack> lvs400[89]: upgrade pybal to 1.15.13 - T334703 (round 2!) [production]
16:23 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudswift1001.eqiad.wmnet with OS bullseye [production]
16:23 <jhancock@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]