|
2017-07-10
§
|
| 12:02 |
<moritzm> |
installing bind security updates (we only have client libs/tools installed) |
[production] |
| 11:39 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Restore original weight for db1097 - T168661 (duration: 00m 42s) |
[production] |
| 11:36 |
<marostegui> |
Stop MySQL on db1102 for maintenance - T153743 |
[production] |
| 11:18 |
<TabbyCat> |
Restarted the bots due to excess flood |
[tools.stewardbots] |
| 11:16 |
<moritzm> |
installing libgcrypt and expat security updates |
[production] |
| 11:16 |
<kartik@tin> |
Finished deploy [cxserver/deploy@c209bec]: Update cxserver to 3375da5 (duration: 02m 49s) |
[production] |
| 11:13 |
<kartik@tin> |
Started deploy [cxserver/deploy@c209bec]: Update cxserver to 3375da5 |
[production] |
| 10:28 |
<addshore> |
WMDE Summer campaign deploy slot DONE |
[production] |
| 10:28 |
<addshore@tin> |
Synchronized wmf-config/InitialiseSettings.php: [[gerrit:364184|WMDE Summer campaign - Add logging]] (fix spacing) NOOP (duration: 00m 43s) |
[production] |
| 10:22 |
<addshore@tin> |
Synchronized php-1.30.0-wmf.7/extensions/WikimediaEvents: [[gerrit:364172|WMDE Summer campaign - Add hook]] (duration: 00m 42s) |
[production] |
| 10:21 |
<addshore@tin> |
Synchronized php-1.30.0-wmf.7/extensions/CentralAuth: CentralAuth (undeployed patches) [[gerrit:363892]], [[gerrit:363893]], [[gerrit:363891]] & revert [[gerrit:364182]] T169261 (duration: 00m 47s) |
[production] |
| 10:13 |
<addshore> |
reverting https://gerrit.wikimedia.org/r/#/c/363891 as it is sitting on tin undeployed T169261 |
[production] |
| 09:59 |
<moritzm> |
rebooting mc2* servers for kernel update |
[production] |
| 09:54 |
<addshore@tin> |
Synchronized wmf-config/InitialiseSettings.php: [[gerrit:362380|WMDE Summer campaign - Add logging]] (duration: 00m 45s) |
[production] |
| 09:10 |
<marostegui> |
Compress innodb on wikidata on dbstore2001 |
[production] |
| 09:00 |
<moritzm> |
rebooting mw1168 (video scaler) for kernel update |
[production] |
| 08:52 |
<moritzm> |
rebooting mwlog2001 for kernel update |
[production] |
| 08:35 |
<moritzm> |
rebooting ms1001 for kernel update |
[production] |
| 08:29 |
<moritzm> |
rebooting francium for kernel update |
[production] |
| 08:17 |
<marostegui> |
Deploy alter table on db1097 - T168661 |
[production] |
| 08:17 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1097 - T168661 (duration: 00m 46s) |
[production] |
| 08:16 |
<marostegui@tin> |
scap failed: average error rate on 2/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/3888cca979647b9381a7739b0bdbc88e for details) |
[production] |
| 08:03 |
<marostegui> |
Drop database l10nwiki on s2 - T119811 |
[production] |
| 07:53 |
<moritzm> |
rebooting hafnium for kernel update |
[production] |
| 07:18 |
<oblivian@puppetmaster1001> |
conftool action : set/pooled=inactive; selector: name=cp3009.* |
[production] |
| 07:13 |
<moritzm> |
reboot netmon1001 for kernel update |
[production] |
| 06:11 |
<marostegui> |
Deploy alter table on s1 - db1080 and db1067 - T166204 |
[production] |
| 06:00 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1080, depool db1067 - T166204 (duration: 00m 42s) |
[production] |
| 05:59 |
<marostegui@tin> |
scap failed: average error rate on 1/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/3888cca979647b9381a7739b0bdbc88e for details) |
[production] |
| 02:27 |
<l10nupdate@tin> |
scap failed: average error rate on 2/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/3888cca979647b9381a7739b0bdbc88e for details) |
[production] |
|
2017-07-07
§
|
| 21:54 |
<legoktm@tin> |
Synchronized php-1.30.0-wmf.7/extensions/CentralAuth/: Fix handling of password hash upgrade on login - T169261 (duration: 00m 45s) |
[production] |
| 21:52 |
<demon@tin> |
Synchronized wmf-config/interwiki.php: Updating interwiki cache, T169979 (duration: 00m 43s) |
[production] |
| 19:18 |
<halfak> |
deploying wikilabels-wmflabs-deploy:c386dac |
[wikilabels] |
| 19:17 |
<halfak> |
staging wikilabels-wmflabs-deploy:c386dac |
[wikilabels] |
| 18:26 |
<bd808> |
Forced puppet runs on tools-redis-* for security fix |
[tools] |
| 15:07 |
<marostegui> |
Stop MySQL on db1102 for MariaDB upgrade |
[production] |
| 15:00 |
<dcausse> |
deleting commonswiki_file_1499379383 on elastic@eqiad (failed reindex) |
[production] |
| 14:53 |
<hashar> |
deployment-prep: change webproxy http://recommendation-api-beta.wmflabs.org/ to deployment-sca02 (has the proper security rule) - T148129 |
[releng] |
| 14:53 |
<hashar> |
deployment-prep: add port 9632 to security group "sca" https://horizon.wikimedia.org/project/access_and_security/security_groups/593/ - T148129 |
[releng] |
| 14:03 |
<hashar> |
Image snapshot-ci-trusty-1499435837 in wmflabs-eqiad is ready |
[releng] |
| 13:57 |
<hashar> |
Nodepool: updating snapshot-ci-trusty |
[releng] |
| 13:56 |
<hashar> |
Nodepool: uploaded new Ubuntu Trusty image |
[releng] |
| 12:20 |
<elukey> |
restart mysql on dbstore1002 - high swap used |
[production] |
| 11:40 |
<moritzm> |
rebooting rdb* servers in codfw for kernel update |
[production] |
| 10:30 |
<gehel> |
restarting elastic1043 (corrupted statistics) |
[production] |
| 09:42 |
<gehel> |
unbanning elastic1020 and 1026 from elasticsearch eqiad |
[production] |