3001-3050 of 10000 results (50ms)
2020-01-09 §
15:25 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1078', diff saved to https://phabricator.wikimedia.org/P10110 and previous config saved to /var/cache/conftool/dbconfig/20200109-152545-marostegui.json [production]
15:21 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1078', diff saved to https://phabricator.wikimedia.org/P10109 and previous config saved to /var/cache/conftool/dbconfig/20200109-152157-marostegui.json [production]
15:14 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1078', diff saved to https://phabricator.wikimedia.org/P10108 and previous config saved to /var/cache/conftool/dbconfig/20200109-151434-marostegui.json [production]
15:03 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1078', diff saved to https://phabricator.wikimedia.org/P10107 and previous config saved to /var/cache/conftool/dbconfig/20200109-150333-marostegui.json [production]
14:38 <papaul> upgrading Firmware on backup2001 [production]
14:27 <marostegui> Upgrade db1078 [production]
14:27 <ema> cp3054: varnish-frontend-restart to clear things up after child crash yesterday [production]
14:10 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1078', diff saved to https://phabricator.wikimedia.org/P10105 and previous config saved to /var/cache/conftool/dbconfig/20200109-141057-marostegui.json [production]
14:04 <moritzm> imported PHP 7.2.26 to component/php72 for stretch-wikimedia [production]
13:48 <moritzm> upgrading mwdebug2002 to PHP 7.2.26 T241224 [production]
13:47 <moritzm> upgrading mwdebug2002 to PHP 7.2.26 [production]
12:41 <marostegui> Deploy schema change on s3 codfw, lag will appear on s3 codfw - T234052 [production]
12:25 <jynus> shutting down backup2001 T240177 [production]
12:22 <Urbanecm> EU SWAT done [production]
12:19 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: ed0357a: Set $wgArticleCountMethod to any for minwiktionary (T241694) (duration: 01m 08s) [production]
12:17 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 06394ea: Add ipblock-exempt and extendedconfirmed to bot group on fawiki (T241904) (duration: 01m 05s) [production]
12:11 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:562504|Set wmgUseEntitySourceBasedFederation for test.wikidata.org (T241973)]] (duration: 01m 07s) [production]
11:23 <moritzm> installing cyrus-sasl security updates [production]
11:04 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:04 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
10:09 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1106', diff saved to https://phabricator.wikimedia.org/P10104 and previous config saved to /var/cache/conftool/dbconfig/20200109-100948-marostegui.json [production]
10:05 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1106', diff saved to https://phabricator.wikimedia.org/P10103 and previous config saved to /var/cache/conftool/dbconfig/20200109-100552-marostegui.json [production]
09:56 <filippo@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:54 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1106', diff saved to https://phabricator.wikimedia.org/P10102 and previous config saved to /var/cache/conftool/dbconfig/20200109-095433-marostegui.json [production]
09:53 <filippo@cumin1001> START - Cookbook sre.hosts.downtime [production]
09:52 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1106', diff saved to https://phabricator.wikimedia.org/P10101 and previous config saved to /var/cache/conftool/dbconfig/20200109-095249-marostegui.json [production]
09:48 <marostegui> Upgrade db1106 [production]
09:47 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1106 for upgrade', diff saved to https://phabricator.wikimedia.org/P10100 and previous config saved to /var/cache/conftool/dbconfig/20200109-094748-marostegui.json [production]
09:39 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1118', diff saved to https://phabricator.wikimedia.org/P10099 and previous config saved to /var/cache/conftool/dbconfig/20200109-093946-marostegui.json [production]
09:32 <marostegui> Deploy schema change on db1106, this will generate a bit of lag on s1 labs [production]
09:31 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1118', diff saved to https://phabricator.wikimedia.org/P10098 and previous config saved to /var/cache/conftool/dbconfig/20200109-093119-marostegui.json [production]
08:22 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1118', diff saved to https://phabricator.wikimedia.org/P10097 and previous config saved to /var/cache/conftool/dbconfig/20200109-082243-marostegui.json [production]
08:16 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1118', diff saved to https://phabricator.wikimedia.org/P10096 and previous config saved to /var/cache/conftool/dbconfig/20200109-081629-marostegui.json [production]
07:40 <XioNoX> enable traceoptions for BFD on cr2-eqdfw - T240659 [production]
07:37 <marostegui> Upgrade db1118 [production]
07:37 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1118', diff saved to https://phabricator.wikimedia.org/P10094 and previous config saved to /var/cache/conftool/dbconfig/20200109-073713-marostegui.json [production]
06:27 <marostegui> Remove revision partitions from db2088:3312 T239453 [production]
06:26 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2088:3312 T239453', diff saved to https://phabricator.wikimedia.org/P10093 and previous config saved to /var/cache/conftool/dbconfig/20200109-062608-marostegui.json [production]
06:21 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1096:3315 db1096:3316 T239453', diff saved to https://phabricator.wikimedia.org/P10092 and previous config saved to /var/cache/conftool/dbconfig/20200109-062157-marostegui.json [production]
00:33 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: (no-op) set config page for newcomer tasks (T233465) (duration: 01m 05s) [production]
2020-01-08 §
23:44 <jhuneidi@deploy1001> rebuilt and synchronized wikiversions files: Roll commonswiki forward to 1.35.0-wmf.14 [production]
23:34 <jforrester@deploy1001> Synchronized php-1.35.0-wmf.14/extensions/WikibaseMediaInfo/resources/statements/StatementWidget.js: T242286 Update StatementWidget initialization logic (duration: 01m 05s) [production]
23:14 <XenoRyet> updated civicrm from 42e88f92a9 to 9ac771a913 [production]
23:08 <mutante> LDAP - added moushirael to 'wmf' (T242000) [production]
22:39 <mutante> restarted zuul on contint1001 [production]
21:55 <arlolra> Updated Parsoid to f963e51 (T238934, T237318, T238022, T228217) [production]
21:46 <XenoRyet> updated civicrm from 2468d85f95 to 42e88f92a9 [production]
21:46 <arlolra@deploy1001> Finished deploy [parsoid/deploy@45a4245]: Updating Parsoid to f963e51 (duration: 08m 00s) [production]
21:38 <arlolra@deploy1001> Started deploy [parsoid/deploy@45a4245]: Updating Parsoid to f963e51 [production]
21:30 <mutante> phab1003 - running decom cookbook - shutdown host, removed from puppetmaster, debmonitor etc (T238957) [production]