5551-5600 of 10000 results (59ms)
2019-12-19 §
08:21 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
08:18 <jiji@cumin1001> START - Cookbook sre.hosts.downtime [production]
08:17 <marostegui> Restart mysql on labsdb1010 (after depooling it) [production]
08:11 <ema@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
08:09 <ema@cumin1001> START - Cookbook sre.hosts.downtime [production]
08:05 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool es1014', diff saved to https://phabricator.wikimedia.org/P9956 and previous config saved to /var/cache/conftool/dbconfig/20191219-080519-marostegui.json [production]
07:53 <ema> depool cp1085 and reimage as text_ats T227432 [production]
07:48 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool es1014', diff saved to https://phabricator.wikimedia.org/P9955 and previous config saved to /var/cache/conftool/dbconfig/20191219-074840-marostegui.json [production]
07:48 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1076', diff saved to https://phabricator.wikimedia.org/P9954 and previous config saved to /var/cache/conftool/dbconfig/20191219-074800-marostegui.json [production]
07:41 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool es1014', diff saved to https://phabricator.wikimedia.org/P9953 and previous config saved to /var/cache/conftool/dbconfig/20191219-074122-marostegui.json [production]
07:39 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1076', diff saved to https://phabricator.wikimedia.org/P9952 and previous config saved to /var/cache/conftool/dbconfig/20191219-073907-marostegui.json [production]
07:34 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool es1014', diff saved to https://phabricator.wikimedia.org/P9951 and previous config saved to /var/cache/conftool/dbconfig/20191219-073430-marostegui.json [production]
07:31 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1076', diff saved to https://phabricator.wikimedia.org/P9950 and previous config saved to /var/cache/conftool/dbconfig/20191219-073151-marostegui.json [production]
07:30 <ema> cp: rolling ats-backend-restart to disable compress plugin everywhere T238494 [production]
07:27 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool es1014 for upgrade', diff saved to https://phabricator.wikimedia.org/P9949 and previous config saved to /var/cache/conftool/dbconfig/20191219-072728-marostegui.json [production]
07:24 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1076', diff saved to https://phabricator.wikimedia.org/P9948 and previous config saved to /var/cache/conftool/dbconfig/20191219-072413-marostegui.json [production]
07:19 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
07:17 <jiji@cumin1001> START - Cookbook sre.hosts.downtime [production]
07:15 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1076, s2 candidate master, for upgrade', diff saved to https://phabricator.wikimedia.org/P9947 and previous config saved to /var/cache/conftool/dbconfig/20191219-071514-marostegui.json [production]
07:10 <marostegui> Upgrade db1115 (this will make dbtree fail for a few minutes) [production]
06:51 <XioNoX> cr2-eqdfw:delete chassis alarm management-ethernet - T241105 [production]
06:49 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool pc1008 after upgrade (duration: 01m 02s) [production]
06:37 <marostegui> Upgrade pc1008 [production]
06:36 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool pc1008 for upgrade (duration: 01m 03s) [production]
06:15 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
06:13 <jiji@cumin1001> START - Cookbook sre.hosts.downtime [production]
06:13 <marostegui> Upgrade db2122, db2084 [production]
05:09 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
05:07 <jiji@cumin1001> START - Cookbook sre.hosts.downtime [production]
05:02 <herron@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
05:00 <herron@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
04:59 <herron@cumin1001> START - Cookbook sre.hosts.downtime [production]
04:58 <herron@cumin1001> START - Cookbook sre.hosts.downtime [production]
04:29 <kart_> Update cxserver to 2019-12-11-144337-production (T233405, T238118) [production]
04:25 <kartik@deploy1001> helmfile [EQIAD] Ran 'apply' command on namespace 'cxserver' for release 'production' . [production]
04:21 <kartik@deploy1001> helmfile [CODFW] Ran 'apply' command on namespace 'cxserver' for release 'production' . [production]
04:19 <kartik@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'cxserver' for release 'staging' . [production]
04:12 <herron@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
04:10 <herron@cumin1001> START - Cookbook sre.hosts.downtime [production]
04:03 <mutante> LDAP - added mstyles to archiva-deployers (T240865) [production]
03:48 <volker-e@deploy1001> Finished deploy [design/style-guide@5cecb37]: Deploy design/style-guide: (duration: 00m 07s) [production]
03:48 <volker-e@deploy1001> Started deploy [design/style-guide@5cecb37]: Deploy design/style-guide: [production]
01:58 <eileen> - civicrm revision changed from 93037d6e35 to 6062da3ab5, config revision is 2e9bf6308b mostly eoy_summary stuff [production]
01:57 <twentyafterfour> phabricator update completed [production]
01:44 <twentyafterfour> deploying phabricator update (tagged release/2019-12-19/1) [production]
00:36 <twentyafterfour@deploy1001> Synchronized php-1.35.0-wmf.11/skins/MinervaNeue/resources/skins.minerva.scripts/menu/MainMenu.js: sync https://gerrit.wikimedia.org/r/c/mediawiki/skins/MinervaNeue/+/559226 for SWAT (duration: 01m 02s) [production]
2019-12-18 §
23:44 <krinkle@deploy1001> Synchronized php-1.35.0-wmf.11/includes/libs/objectcache/MemcachedPeclBagOStuff.php: Iacbc9ebda681 (duration: 01m 01s) [production]
23:27 <krinkle@deploy1001> Synchronized php-1.35.0-wmf.11/includes/resourceloader/ResourceLoaderFileModule.php: I3fe9f0a9ddc (duration: 01m 02s) [production]
23:17 <krinkle@deploy1001> Synchronized wmf-config/CommonSettings.php: If465c0ef cleanup (duration: 01m 01s) [production]
21:33 <mholloway-shell@deploy1001> Finished deploy [mobileapps/deploy@9dd8227]: Update mobileapps to cf2bb3b (duration: 05m 51s) [production]