3601-3650 of 10000 results (48ms)
2021-12-10 §
08:53 <jayme@deploy1002> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
08:40 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1101:3317', diff saved to https://phabricator.wikimedia.org/P18090 and previous config saved to /var/cache/conftool/dbconfig/20211210-084024-marostegui.json [production]
08:25 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1101:3317 (T277354)', diff saved to https://phabricator.wikimedia.org/P18089 and previous config saved to /var/cache/conftool/dbconfig/20211210-082520-marostegui.json [production]
08:20 <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db1101:3317 (T277354)', diff saved to https://phabricator.wikimedia.org/P18088 and previous config saved to /var/cache/conftool/dbconfig/20211210-082041-marostegui.json [production]
08:20 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1101.eqiad.wmnet with reason: Maintenance [production]
08:20 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 4:00:00 on db1101.eqiad.wmnet with reason: Maintenance [production]
08:20 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1170:3317 (T277354)', diff saved to https://phabricator.wikimedia.org/P18087 and previous config saved to /var/cache/conftool/dbconfig/20211210-082034-marostegui.json [production]
08:13 <moritzm> drain primary/secondary instance off ganeti2008 T296622 [production]
08:05 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1170:3317', diff saved to https://phabricator.wikimedia.org/P18086 and previous config saved to /var/cache/conftool/dbconfig/20211210-080529-marostegui.json [production]
07:50 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1170:3317', diff saved to https://phabricator.wikimedia.org/P18085 and previous config saved to /var/cache/conftool/dbconfig/20211210-075024-marostegui.json [production]
07:35 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1170:3317 (T277354)', diff saved to https://phabricator.wikimedia.org/P18084 and previous config saved to /var/cache/conftool/dbconfig/20211210-073520-marostegui.json [production]
07:33 <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db1170:3317 (T277354)', diff saved to https://phabricator.wikimedia.org/P18083 and previous config saved to /var/cache/conftool/dbconfig/20211210-073342-marostegui.json [production]
07:33 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1170.eqiad.wmnet with reason: Maintenance [production]
07:33 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 4:00:00 on db1170.eqiad.wmnet with reason: Maintenance [production]
07:33 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1171.eqiad.wmnet with reason: Maintenance [production]
07:33 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 4:00:00 on db1171.eqiad.wmnet with reason: Maintenance [production]
07:32 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on dbstore1003.eqiad.wmnet with reason: Maintenance [production]
07:32 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 4:00:00 on dbstore1003.eqiad.wmnet with reason: Maintenance [production]
06:21 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on 11 hosts with reason: Maintenance [production]
06:21 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 4:00:00 on 11 hosts with reason: Maintenance [production]
05:55 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1139.eqiad.wmnet with reason: Maintenance [production]
05:55 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 4:00:00 on db1139.eqiad.wmnet with reason: Maintenance [production]
05:54 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1102.eqiad.wmnet with reason: Maintenance [production]
05:54 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 4:00:00 on db1102.eqiad.wmnet with reason: Maintenance [production]
01:54 <eileen> civicrm revision c47cf762 -> a88cd178 [production]
00:36 <cjming> end of UTC late backport & config window [production]
00:34 <cjming@deploy1002> Synchronized php-1.38.0-wmf.12/extensions/MediaSearch/resources/components/QuickView.vue: Backport: [[gerrit:745646|Search_result_page_id should be integer (T297400)]] (duration: 00m 55s) [production]
00:33 <cjming@deploy1002> Synchronized php-1.38.0-wmf.12/skins/Vector: Backport: [[gerrit:745607|Update A/B test enrollment name (T292587)]] (duration: 00m 56s) [production]
00:31 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
00:30 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
00:23 <cjming@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:745385|Revert "VE on zh.wiki: Enable single-edit-tab mode" (T296269)]] (duration: 00m 56s) [production]
00:23 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
00:22 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
00:17 <cjming@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:745598|Update WebABTestEnrollment name (T295972)]] (duration: 00m 57s) [production]
00:11 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
00:09 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
2021-12-09 §
22:14 <dancy@deploy1002> Synchronized README: testing https://gerrit.wikimedia.org/r/745572 (duration: 00m 55s) [production]
22:07 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
22:06 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
22:05 <ladsgroup@deploy1002> Synchronized php-1.38.0-wmf.12/extensions/FlaggedRevs/maintenance/pruneRevData.php: Backport: [[gerrit:745383|Fix the mistake in passing parameter (T296380)]] (duration: 02m 11s) [production]
21:15 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
20:58 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
20:09 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
20:07 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
20:04 <dancy@deploy1002> rebuilt and synchronized wikiversions files: group2 wikis to 1.38.0-wmf.12 refs T293953 [production]
19:54 <legoktm> deployed patch for T297416 [production]
19:40 <majavah> deployed patch for T297416 [production]
19:29 <filippo@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host graphite2003.codfw.wmnet [production]
19:23 <filippo@cumin1001> START - Cookbook sre.hosts.reboot-single for host graphite2003.codfw.wmnet [production]
19:21 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 4e6cba0d3590446bb02815b65ba1c4ae9ed7bfac: VE on zh.wiki: Enable single-edit-tab mode (T296269) (duration: 01m 05s) [production]