4351-4400 of 10000 results (50ms)
2017-07-12 §
10:54 <moritzm> installing nginx updates on ms1001/dataset1001 [production]
10:46 <_joe_> running namespaceDupes.php on eswiki, T170176 [production]
10:45 <moritzm> upgrading nginx on meitnerium/archiva.wikimedia.org [production]
10:31 <jynus> stopping all mysql instances on dbstore2002 and doing an in-place upgrade [production]
10:04 <moritzm> installing nginx security updates on mw* canaries [production]
09:19 <oblivian@puppetmaster1001> conftool action : set/pooled=false; selector: name=eqiad,dnsdisc=(citoid|restbase-async) [production]
08:58 <moritzm> uploading nginx 1.11.10-1+wmf3 for jessie-wikimedia/stretch-wikimedia [production]
08:32 <XioNoX> asw-b-codfw back up - T169345 [production]
08:20 <XioNoX> restarting asw-b-codfw for upgrade [production]
08:11 <marostegui> Stop MySQL on db2033 (x1) - T169510 [production]
07:54 <oblivian@puppetmaster1001> conftool action : set/pooled=true; selector: name=eqiad,dnsdisc=(citoid|restbase-async) [production]
07:39 <XioNoX> depooled codfw for T169345 [production]
07:34 <marostegui> Rename table migrateuser_medium on db1094 and db1079 - T170310 [production]
07:29 <marostegui> Drop table localisation_file_hash from testwiki and drop database l10nwiki on s3 - T119811 [production]
07:27 <marostegui> Drop table localisation_file_hash from enwiki - T119811 [production]
07:04 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1064 - T168661 (duration: 00m 44s) [production]
06:49 <_joe_> saved the current state of mediawiki-staging (in detached head) in the branch "wtf-live"; saved what is in master on tin in "wtf-master"; reset master to the latest commit in origin/master [production]
03:10 <l10nupdate@tin> ResourceLoader cache refresh completed at Wed Jul 12 03:10:42 UTC 2017 (duration 6m 54s) [production]
03:03 <l10nupdate@tin> scap sync-l10n completed (1.30.0-wmf.9) (duration: 13m 57s) [production]
02:29 <l10nupdate@tin> scap sync-l10n completed (1.30.0-wmf.7) (duration: 09m 25s) [production]
2017-07-11 §
23:25 <dereckson@tin> Synchronized wmf-config/CommonSettings.php: Config changes for LoginNotify (T107707) (duration: 00m 47s) [production]
21:20 <bblack> varnish backend restart on cp1072 (mailbox lag) [production]
20:25 <thcipriani@tin> rebuilt wikiversions.php and synchronized wikiversions files: group0 to 1.30.0-wmf.9 [production]
20:23 <thcipriani@tin> Synchronized wmf-config/CommonSettings.php: [[gerrit:364516|Can't use NS_MODULE constant]] T170317 (duration: 00m 43s) [production]
19:54 <thcipriani@tin> rebuilt wikiversions.php and synchronized wikiversions files: revert group0 to 1.30.0-wmf.9 [production]
19:53 <thcipriani@tin> rebuilt wikiversions.php and synchronized wikiversions files: group0 to 1.30.0-wmf.9 [production]
19:32 <cmjohnson1> powering off mw1199 to reset idrac [production]
19:29 <thcipriani@tin> Finished scap: testwiki to php-1.30.0-wmf.9 and rebuild l10n cache (duration: 25m 11s) [production]
19:17 <paravoid> shutting down sodium for iDRAC reset (T169360) [production]
19:17 <ejegg> updated payments-wiki from f935c06b566aa7c54c74a1e41c31c9e669eb0c9b to bdc52265d78c55cfc6a732f14519f5f79c9d2d94 [production]
19:04 <thcipriani@tin> Started scap: testwiki to php-1.30.0-wmf.9 and rebuild l10n cache [production]
18:47 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2154.codfw.wmnet [production]
18:43 <thcipriani@tin> Pruned MediaWiki: 1.30.0-wmf.6 [keeping static files] (duration: 06m 28s) [production]
18:28 <dcausse> T169498: elastic@eqiad huge but short load spike on 24+ nodes (despite the workaround on token_count_router deployed) [production]
18:27 <dzahn@neodymium> conftool action : set/pooled=no; selector: name=mw2154.codfw.wmnet [production]
18:25 <mutante> mw2154 - depool for attempting IPMI fix [production]
18:17 <mutante> ms2202 - repooled [production]
18:09 <mutante> mw2201 - repooled [production]
17:20 <mutante> mw2201, mw2202 - depool appservers for T169360 (drain flea power) [production]
17:19 <thcipriani> starting branch cut for 1.30.0-wmf.9 T167893 [production]
16:32 <bblack> restarting varnish backend on cp1074 (mailbox lag) [production]
16:16 <tzatziki> Removed 2FA for Arsog1985 SUL account (T168779) [production]
15:56 <dcausse> restarting elastic on relforge100*.eqiad.wmnet to pickup a new version of the ltr plugin [production]
15:36 <moritzm> rolling restart of thumbor to pick up tiff and expat security updates [production]
15:29 <marostegui> Stop replication labsdb1010 for maintenance - T153743 [production]
15:25 <marostegui> Stop replication labsdb1009 for maintenance - T153743 [production]
15:24 <elukey> restart burrow on krypton [production]
15:21 <moritzm> rebooting uranium for kernel update [production]
14:31 <marostegui> Deploy alter table on db1064 - commonswiki and let it replicate to db1095 and labsdb1009, 1010 and 1011 - T168661 [production]
14:28 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1064 - T168661 (duration: 00m 43s) [production]