401-450 of 10000 results (36ms)
2020-01-09 §
10:09 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1106', diff saved to https://phabricator.wikimedia.org/P10104 and previous config saved to /var/cache/conftool/dbconfig/20200109-100948-marostegui.json [production]
10:05 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1106', diff saved to https://phabricator.wikimedia.org/P10103 and previous config saved to /var/cache/conftool/dbconfig/20200109-100552-marostegui.json [production]
09:56 <filippo@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:54 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1106', diff saved to https://phabricator.wikimedia.org/P10102 and previous config saved to /var/cache/conftool/dbconfig/20200109-095433-marostegui.json [production]
09:53 <filippo@cumin1001> START - Cookbook sre.hosts.downtime [production]
09:52 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1106', diff saved to https://phabricator.wikimedia.org/P10101 and previous config saved to /var/cache/conftool/dbconfig/20200109-095249-marostegui.json [production]
09:48 <marostegui> Upgrade db1106 [production]
09:47 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1106 for upgrade', diff saved to https://phabricator.wikimedia.org/P10100 and previous config saved to /var/cache/conftool/dbconfig/20200109-094748-marostegui.json [production]
09:39 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1118', diff saved to https://phabricator.wikimedia.org/P10099 and previous config saved to /var/cache/conftool/dbconfig/20200109-093946-marostegui.json [production]
09:32 <marostegui> Deploy schema change on db1106, this will generate a bit of lag on s1 labs [production]
09:31 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1118', diff saved to https://phabricator.wikimedia.org/P10098 and previous config saved to /var/cache/conftool/dbconfig/20200109-093119-marostegui.json [production]
08:22 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1118', diff saved to https://phabricator.wikimedia.org/P10097 and previous config saved to /var/cache/conftool/dbconfig/20200109-082243-marostegui.json [production]
08:16 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1118', diff saved to https://phabricator.wikimedia.org/P10096 and previous config saved to /var/cache/conftool/dbconfig/20200109-081629-marostegui.json [production]
07:40 <XioNoX> enable traceoptions for BFD on cr2-eqdfw - T240659 [production]
07:37 <marostegui> Upgrade db1118 [production]
07:37 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1118', diff saved to https://phabricator.wikimedia.org/P10094 and previous config saved to /var/cache/conftool/dbconfig/20200109-073713-marostegui.json [production]
06:27 <marostegui> Remove revision partitions from db2088:3312 T239453 [production]
06:26 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2088:3312 T239453', diff saved to https://phabricator.wikimedia.org/P10093 and previous config saved to /var/cache/conftool/dbconfig/20200109-062608-marostegui.json [production]
06:21 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1096:3315 db1096:3316 T239453', diff saved to https://phabricator.wikimedia.org/P10092 and previous config saved to /var/cache/conftool/dbconfig/20200109-062157-marostegui.json [production]
00:33 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: (no-op) set config page for newcomer tasks (T233465) (duration: 01m 05s) [production]
2020-01-08 §
23:44 <jhuneidi@deploy1001> rebuilt and synchronized wikiversions files: Roll commonswiki forward to 1.35.0-wmf.14 [production]
23:34 <jforrester@deploy1001> Synchronized php-1.35.0-wmf.14/extensions/WikibaseMediaInfo/resources/statements/StatementWidget.js: T242286 Update StatementWidget initialization logic (duration: 01m 05s) [production]
23:14 <XenoRyet> updated civicrm from 42e88f92a9 to 9ac771a913 [production]
23:08 <mutante> LDAP - added moushirael to 'wmf' (T242000) [production]
22:39 <mutante> restarted zuul on contint1001 [production]
21:55 <arlolra> Updated Parsoid to f963e51 (T238934, T237318, T238022, T228217) [production]
21:46 <XenoRyet> updated civicrm from 2468d85f95 to 42e88f92a9 [production]
21:46 <arlolra@deploy1001> Finished deploy [parsoid/deploy@45a4245]: Updating Parsoid to f963e51 (duration: 08m 00s) [production]
21:38 <arlolra@deploy1001> Started deploy [parsoid/deploy@45a4245]: Updating Parsoid to f963e51 [production]
21:30 <mutante> phab1003 - running decom cookbook - shutdown host, removed from puppetmaster, debmonitor etc (T238957) [production]
21:30 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
21:29 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
21:28 <jhuneidi@deploy1001> rebuilt and synchronized wikiversions files: Revert "commonswiki to 1.35.0-wmf.11" [production]
21:21 <halfak@deploy1001> Finished deploy [ores/deploy@039251f]: T242035 (duration: 16m 32s) [production]
21:07 <otto@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-main' for release 'main' . [production]
21:04 <halfak@deploy1001> Started deploy [ores/deploy@039251f]: T242035 [production]
21:03 <otto@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'logging-external' . [production]
21:00 <otto@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics' for release 'analytics' . [production]
20:53 <XenoRyet> updated civicrm from 51b6fca9b2 to 2468d85f95 [production]
20:51 <jhuneidi@deploy1001> Synchronized php: group1 wikis to 1.35.0-wmf.14 refs T233862 (duration: 01m 04s) [production]
20:50 <jhuneidi@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.35.0-wmf.14 refs T233862 [production]
20:40 <mutante> contint1001 - restarting zuul service [production]
20:00 <otto@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics' for release 'analytics' . [production]
19:31 <otto@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'logging-external' . [production]
19:16 <mutante> LDAP - added 'sihe' to 'wmde' and 'nda' (T242080) [production]
19:15 <otto@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'logging-external' . [production]
19:13 <joal@deploy1001> Finished deploy [analytics/refinery@c205576] (thin): Regular analytics weekly deploy train [thin] (duration: 00m 07s) [production]
19:13 <joal@deploy1001> Started deploy [analytics/refinery@c205576] (thin): Regular analytics weekly deploy train [thin] [production]
19:13 <joal@deploy1001> Finished deploy [analytics/refinery@c205576]: Regular analytics weekly deploy train (duration: 08m 36s) [production]
19:04 <joal@deploy1001> Started deploy [analytics/refinery@c205576]: Regular analytics weekly deploy train [production]