1201-1250 of 10000 results (95ms)
2024-07-01 ยง
22:10 <sbassett@deploy1002> Synchronized private/PrivateSettings.php: Un-deployed a PS.php mitigation for T341908 (duration: 07m 24s) [production]
21:59 <bking@cumin2002> END (PASS) - Cookbook sre.elasticsearch.ban (exit_code=0) Banning hosts: elastic1089*,elastic1090*,elastic1104* for T348977 - bking@cumin2002 [production]
21:59 <bking@cumin2002> START - Cookbook sre.elasticsearch.ban Banning hosts: elastic1089*,elastic1090*,elastic1104* for T348977 - bking@cumin2002 [production]
21:58 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on elastic[1089-1090,1104].eqiad.wmnet with reason: T348977 [production]
21:58 <bking@cumin2002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on elastic[1089-1090,1104].eqiad.wmnet with reason: T348977 [production]
21:55 <maryum> deployed patch for T366991 [production]
21:39 <eileen> civicrm upgraded from f8b1f5c4 to 52dc4f1d [production]
21:39 <eileen> tools upgraded from c51f6e62 to 95f10b20 [production]
21:32 <zabe> zabe@mwmaint1002:/tmp/upload$ mwscript importImages.php --wiki=commonswiki --comment-ext=txt --sleep=3600 --user=Yann . # T368703 [production]
21:24 <cjming> end of UTC late backport window [production]
21:23 <cjming@deploy1002> Finished scap: Backport for [[gerrit:1046710|extension-list: Add Metrics Platform (T366234)]] (duration: 28m 16s) [production]
21:16 <cjming@deploy1002> cjming: Continuing with sync [production]
21:16 <cjming@deploy1002> cjming: Backport for [[gerrit:1046710|extension-list: Add Metrics Platform (T366234)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
21:05 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2146 (T364069)', diff saved to https://phabricator.wikimedia.org/P65604 and previous config saved to /var/cache/conftool/dbconfig/20240701-210534-marostegui.json [production]
21:05 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2146.codfw.wmnet with reason: Maintenance [production]
21:05 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2146.codfw.wmnet with reason: Maintenance [production]
21:05 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2145 (T364069)', diff saved to https://phabricator.wikimedia.org/P65603 and previous config saved to /var/cache/conftool/dbconfig/20240701-210512-marostegui.json [production]
21:04 <ejegg> fundraising civicrm upgraded from f9782670 to f8b1f5c4 [production]
20:55 <cjming@deploy1002> Started scap sync-world: Backport for [[gerrit:1046710|extension-list: Add Metrics Platform (T366234)]] [production]
20:53 <cjming@deploy1002> Finished scap: Backport for [[gerrit:1051170|Missing.php: don't redirect to unprefixed nan incubator (T86915)]] (duration: 09m 03s) [production]
20:50 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2145', diff saved to https://phabricator.wikimedia.org/P65602 and previous config saved to /var/cache/conftool/dbconfig/20240701-205003-marostegui.json [production]
20:47 <cjming@deploy1002> cjming, pppery: Continuing with sync [production]
20:47 <cjming@deploy1002> cjming, pppery: Backport for [[gerrit:1051170|Missing.php: don't redirect to unprefixed nan incubator (T86915)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:44 <cjming@deploy1002> Started scap sync-world: Backport for [[gerrit:1051170|Missing.php: don't redirect to unprefixed nan incubator (T86915)]] [production]
20:42 <cjming@deploy1002> Finished scap: Backport for [[gerrit:1050084|[July 1st] Mobile: Enable dark mode for all tier 1 wikis (logged in) (T367151)]], [[gerrit:1051184|Change color of notification icon in dark-mode (T368120)]], [[gerrit:1051186|Do not invert images that have been tagged with no invert classes (T368483)]] (duration: 10m 39s) [production]
20:36 <cjming@deploy1002> cjming, jdlrobson: Continuing with sync [production]
20:35 <ejegg> standalone SmashPig upgraded from c8993ec6 to 565c61e4 [production]
20:34 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2145', diff saved to https://phabricator.wikimedia.org/P65601 and previous config saved to /var/cache/conftool/dbconfig/20240701-203456-marostegui.json [production]
20:34 <cjming@deploy1002> cjming, jdlrobson: Backport for [[gerrit:1050084|[July 1st] Mobile: Enable dark mode for all tier 1 wikis (logged in) (T367151)]], [[gerrit:1051184|Change color of notification icon in dark-mode (T368120)]], [[gerrit:1051186|Do not invert images that have been tagged with no invert classes (T368483)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:31 <cjming@deploy1002> Started scap sync-world: Backport for [[gerrit:1050084|[July 1st] Mobile: Enable dark mode for all tier 1 wikis (logged in) (T367151)]], [[gerrit:1051184|Change color of notification icon in dark-mode (T368120)]], [[gerrit:1051186|Do not invert images that have been tagged with no invert classes (T368483)]] [production]
20:30 <cjming@deploy1002> Sync cancelled. [production]
20:28 <cjming@deploy1002> jdlrobson, cjming: Backport for [[gerrit:1050084|[July 1st] Mobile: Enable dark mode for all tier 1 wikis (logged in) (T367151)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:26 <cjming@deploy1002> Started scap sync-world: Backport for [[gerrit:1050084|[July 1st] Mobile: Enable dark mode for all tier 1 wikis (logged in) (T367151)]] [production]
20:23 <cjming@deploy1002> Sync cancelled. [production]
20:23 <cjming@deploy1002> jdlrobson, cjming: Backport for [[gerrit:1050084|[July 1st] Mobile: Enable dark mode for all tier 1 wikis (logged in) (T367151)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:19 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2145 (T364069)', diff saved to https://phabricator.wikimedia.org/P65600 and previous config saved to /var/cache/conftool/dbconfig/20240701-201949-marostegui.json [production]
20:03 <cjming@deploy1002> Started scap sync-world: Backport for [[gerrit:1050084|[July 1st] Mobile: Enable dark mode for all tier 1 wikis (logged in) (T367151)]] [production]
19:33 <jclark@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1002" [production]
19:19 <dancy@deploy1002> Installation of scap version "4.91.0" completed for 233 hosts [production]
19:19 <dancy@deploy1002> Installing scap version "4.91.0" for 233 hosts [production]
19:16 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcephosd1041.eqiad.wmnet with reason: host reimage [production]
19:15 <dancy@deploy1002> Installing scap version "4.91.0" for 234 hosts [production]
19:14 <dancy@deploy1002> Installing scap version "4.91.0" for 234 hosts [production]
19:13 <jclark@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcephosd1041.eqiad.wmnet with reason: host reimage [production]
18:57 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host cloudcephosd1041.eqiad.wmnet with OS bullseye [production]
18:56 <jclark@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cloudcephosd1041 [production]
18:56 <jclark@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host cloudcephosd1041 [production]
17:49 <jclark@cumin1002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cloudcephosd1041 [production]
17:49 <jclark@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host cloudcephosd1041 [production]
17:49 <jclark@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]