4001-4050 of 10000 results (39ms)
2022-03-28 ยง
20:39 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:38 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:34 <urbanecm@deploy1002> Synchronized php-1.39.0-wmf.4/extensions/VisualEditor/modules/ve-mw/ui/ve.ui.MWSequenceRegistry.js: f32ae21f2456b69d615c0d63fc12cff097ba3e31: Disable backtick sequence in ve-mw while conflict with Catalan is investigated (T304804) (duration: 00m 57s) [production]
20:28 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:26 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:25 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:25 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:22 <urbanecm@deploy1002> Synchronized wmf-config/CommonSettings.php: dfa963895f39760b647be5507c7f74ec3489cd22: Stop writing to $wmfAllServices (T45956) (duration: 00m 55s) [production]
20:19 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:19 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:19 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:18 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: e8a5b3b662db6780c0ed9a33e07e54e84295d1dd: GrowthExperiments: Add more expanded topics for GLAM campaign (T301029) (duration: 00m 50s) [production]
20:18 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:14 <herron> pruned /var/log/apache2/puppetmaster.puppet.log.[123]* on puppetmaster1001 T304898 [production]
19:20 <dzahn@cumin2002> conftool action : set/pooled=yes; selector: dc=codfw,name=phab2001-vcs.codfw.wmnet [production]
19:09 <dzahn@cumin2002> conftool action : set/pooled=no; selector: dc=codfw,name=phab2001-vcs.codfw.wmnet [production]
19:08 <dzahn@cumin2002> conftool action : set/pooled=no; selector: dc=eqiad,name=phab2001-vcs.codfw.wmnet [production]
19:07 <dzahn@cumin2002> conftool action : set/pooled=no; selector: dc=eqiad,name=phab2001.codfw.wmnet [production]
18:53 <dzahn@cumin2002> conftool action : set/pooled=yes; selector: dc=eqiad,name=phab2001.codfw.wmnet [production]
18:50 <dzahn@cumin2002> conftool action : set/pooled=no; selector: dc=eqiad,name=phab2001.codfw.wmnet [production]
17:33 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3314 (T298556)', diff saved to https://phabricator.wikimedia.org/P23426 and previous config saved to /var/cache/conftool/dbconfig/20220328-173340-marostegui.json [production]
17:18 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3314', diff saved to https://phabricator.wikimedia.org/P23425 and previous config saved to /var/cache/conftool/dbconfig/20220328-171835-marostegui.json [production]
17:05 <cmjohnson@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host an-worker1142.eqiad.wmnet with OS buster [production]
17:03 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3314', diff saved to https://phabricator.wikimedia.org/P23424 and previous config saved to /var/cache/conftool/dbconfig/20220328-170330-marostegui.json [production]
16:59 <cmjohnson@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host ml-cache1002.eqiad.wmnet with OS bullseye [production]
16:48 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3314 (T298556)', diff saved to https://phabricator.wikimedia.org/P23423 and previous config saved to /var/cache/conftool/dbconfig/20220328-164825-marostegui.json [production]
16:44 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host an-worker1142.eqiad.wmnet with OS buster [production]
16:39 <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db1164 (T300775)', diff saved to https://phabricator.wikimedia.org/P23422 and previous config saved to /var/cache/conftool/dbconfig/20220328-163903-marostegui.json [production]
16:39 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1164.eqiad.wmnet with reason: Maintenance [production]
16:39 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db1164.eqiad.wmnet with reason: Maintenance [production]
16:38 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1169 (T300775)', diff saved to https://phabricator.wikimedia.org/P23421 and previous config saved to /var/cache/conftool/dbconfig/20220328-163855-marostegui.json [production]
16:31 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host ml-cache1002.eqiad.wmnet with OS bullseye [production]
16:29 <pt1979@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:26 <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db1146:3314 (T298556)', diff saved to https://phabricator.wikimedia.org/P23420 and previous config saved to /var/cache/conftool/dbconfig/20220328-162644-marostegui.json [production]
16:26 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db1146.eqiad.wmnet with reason: Maintenance [production]
16:26 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 8:00:00 on db1146.eqiad.wmnet with reason: Maintenance [production]
16:26 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on dbstore1007.eqiad.wmnet with reason: Maintenance [production]
16:26 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 8:00:00 on dbstore1007.eqiad.wmnet with reason: Maintenance [production]
16:26 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1160 (T298556)', diff saved to https://phabricator.wikimedia.org/P23419 and previous config saved to /var/cache/conftool/dbconfig/20220328-162633-marostegui.json [production]
16:24 <jayme@deploy1002> helmfile [eqiad] DONE helmfile.d/services/miscweb: apply [production]
16:23 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1169', diff saved to https://phabricator.wikimedia.org/P23418 and previous config saved to /var/cache/conftool/dbconfig/20220328-162350-marostegui.json [production]
16:22 <pt1979@cumin2002> START - Cookbook sre.dns.netbox [production]
16:20 <jayme@deploy1002> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
16:19 <jayme@deploy1002> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
16:16 <jayme@deploy1002> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
16:14 <jayme@deploy1002> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
16:13 <jayme@deploy1002> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
16:11 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1160', diff saved to https://phabricator.wikimedia.org/P23417 and previous config saved to /var/cache/conftool/dbconfig/20220328-161128-marostegui.json [production]
16:08 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1169', diff saved to https://phabricator.wikimedia.org/P23416 and previous config saved to /var/cache/conftool/dbconfig/20220328-160845-marostegui.json [production]
15:56 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1160', diff saved to https://phabricator.wikimedia.org/P23415 and previous config saved to /var/cache/conftool/dbconfig/20220328-155622-marostegui.json [production]