|
2017-07-12
§
|
| 10:45 |
<moritzm> |
upgrading nginx on meitnerium/archiva.wikimedia.org |
[production] |
| 10:31 |
<jynus> |
stopping all mysql instances on dbstore2002 and doing an in-place upgrade |
[production] |
| 10:04 |
<moritzm> |
installing nginx security updates on mw* canaries |
[production] |
| 09:19 |
<oblivian@puppetmaster1001> |
conftool action : set/pooled=false; selector: name=eqiad,dnsdisc=(citoid|restbase-async) |
[production] |
| 08:58 |
<moritzm> |
uploading nginx 1.11.10-1+wmf3 for jessie-wikimedia/stretch-wikimedia |
[production] |
| 08:32 |
<XioNoX> |
asw-b-codfw back up - T169345 |
[production] |
| 08:20 |
<XioNoX> |
restarting asw-b-codfw for upgrade |
[production] |
| 08:11 |
<marostegui> |
Stop MySQL on db2033 (x1) - T169510 |
[production] |
| 07:54 |
<oblivian@puppetmaster1001> |
conftool action : set/pooled=true; selector: name=eqiad,dnsdisc=(citoid|restbase-async) |
[production] |
| 07:39 |
<XioNoX> |
depooled codfw for T169345 |
[production] |
| 07:34 |
<marostegui> |
Rename table migrateuser_medium on db1094 and db1079 - T170310 |
[production] |
| 07:29 |
<marostegui> |
Drop table localisation_file_hash from testwiki and drop database l10nwiki on s3 - T119811 |
[production] |
| 07:27 |
<marostegui> |
Drop table localisation_file_hash from enwiki - T119811 |
[production] |
| 07:04 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1064 - T168661 (duration: 00m 44s) |
[production] |
| 06:49 |
<_joe_> |
saved the current state of mediawiki-staging (in detached head) in the branch "wtf-live"; saved what is in master on tin in "wtf-master"; reset master to the latest commit in origin/master |
[production] |
| 03:10 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Wed Jul 12 03:10:42 UTC 2017 (duration 6m 54s) |
[production] |
| 03:03 |
<l10nupdate@tin> |
scap sync-l10n completed (1.30.0-wmf.9) (duration: 13m 57s) |
[production] |
| 02:29 |
<l10nupdate@tin> |
scap sync-l10n completed (1.30.0-wmf.7) (duration: 09m 25s) |
[production] |
|
2017-07-11
§
|
| 23:25 |
<dereckson@tin> |
Synchronized wmf-config/CommonSettings.php: Config changes for LoginNotify (T107707) (duration: 00m 47s) |
[production] |
| 21:20 |
<bblack> |
varnish backend restart on cp1072 (mailbox lag) |
[production] |
| 20:25 |
<thcipriani@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group0 to 1.30.0-wmf.9 |
[production] |
| 20:23 |
<thcipriani@tin> |
Synchronized wmf-config/CommonSettings.php: [[gerrit:364516|Can't use NS_MODULE constant]] T170317 (duration: 00m 43s) |
[production] |
| 19:54 |
<thcipriani@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: revert group0 to 1.30.0-wmf.9 |
[production] |
| 19:53 |
<thcipriani@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group0 to 1.30.0-wmf.9 |
[production] |
| 19:32 |
<cmjohnson1> |
powering off mw1199 to reset idrac |
[production] |
| 19:29 |
<thcipriani@tin> |
Finished scap: testwiki to php-1.30.0-wmf.9 and rebuild l10n cache (duration: 25m 11s) |
[production] |
| 19:17 |
<paravoid> |
shutting down sodium for iDRAC reset (T169360) |
[production] |
| 19:17 |
<ejegg> |
updated payments-wiki from f935c06b566aa7c54c74a1e41c31c9e669eb0c9b to bdc52265d78c55cfc6a732f14519f5f79c9d2d94 |
[production] |
| 19:04 |
<thcipriani@tin> |
Started scap: testwiki to php-1.30.0-wmf.9 and rebuild l10n cache |
[production] |
| 18:47 |
<dzahn@neodymium> |
conftool action : set/pooled=yes; selector: name=mw2154.codfw.wmnet |
[production] |
| 18:43 |
<thcipriani@tin> |
Pruned MediaWiki: 1.30.0-wmf.6 [keeping static files] (duration: 06m 28s) |
[production] |
| 18:28 |
<dcausse> |
T169498: elastic@eqiad huge but short load spike on 24+ nodes (despite the workaround on token_count_router deployed) |
[production] |
| 18:27 |
<dzahn@neodymium> |
conftool action : set/pooled=no; selector: name=mw2154.codfw.wmnet |
[production] |
| 18:25 |
<mutante> |
mw2154 - depool for attempting IPMI fix |
[production] |
| 18:17 |
<mutante> |
ms2202 - repooled |
[production] |
| 18:09 |
<mutante> |
mw2201 - repooled |
[production] |
| 17:20 |
<mutante> |
mw2201, mw2202 - depool appservers for T169360 (drain flea power) |
[production] |
| 17:19 |
<thcipriani> |
starting branch cut for 1.30.0-wmf.9 T167893 |
[production] |
| 16:32 |
<bblack> |
restarting varnish backend on cp1074 (mailbox lag) |
[production] |
| 16:16 |
<tzatziki> |
Removed 2FA for Arsog1985 SUL account (T168779) |
[production] |
| 15:56 |
<dcausse> |
restarting elastic on relforge100*.eqiad.wmnet to pickup a new version of the ltr plugin |
[production] |
| 15:36 |
<moritzm> |
rolling restart of thumbor to pick up tiff and expat security updates |
[production] |
| 15:29 |
<marostegui> |
Stop replication labsdb1010 for maintenance - T153743 |
[production] |
| 15:25 |
<marostegui> |
Stop replication labsdb1009 for maintenance - T153743 |
[production] |
| 15:24 |
<elukey> |
restart burrow on krypton |
[production] |
| 15:21 |
<moritzm> |
rebooting uranium for kernel update |
[production] |
| 14:31 |
<marostegui> |
Deploy alter table on db1064 - commonswiki and let it replicate to db1095 and labsdb1009, 1010 and 1011 - T168661 |
[production] |
| 14:28 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1064 - T168661 (duration: 00m 43s) |
[production] |
| 14:26 |
<moritzm> |
installing apache security updates on mw2* |
[production] |
| 14:24 |
<jmm@puppetmaster1001> |
conftool action : set/pooled=yes; selector: mw2118.codfw.wmnet |
[production] |