|
2016-01-22
ยง
|
| 22:23 |
<twentyafterfour@tin> |
Finished scap: deploy https://gerrit.wikimedia.org/r/#/c/263415/ and clean up old branches (duration: 07m 02s) |
[production] |
| 22:16 |
<twentyafterfour@tin> |
Started scap: deploy https://gerrit.wikimedia.org/r/#/c/263415/ and clean up old branches |
[production] |
| 22:06 |
<bblack> |
upgrading vhtcpd on all caches |
[production] |
| 21:49 |
<anomie@tin> |
Synchronized php-1.27.0-wmf.11/includes/: Fix T124468, for real this time (duration: 00m 36s) |
[production] |
| 21:48 |
<anomie@tin> |
Synchronized php-1.27.0-wmf.11/includes/: Fix T124468 (duration: 00m 38s) |
[production] |
| 21:17 |
<legoktm> |
running migrateAccount.php --attachbroken over list of all unattached users (T74791) |
[production] |
| 20:04 |
<mutante> |
ruthenium - rebooting for reinstall |
[production] |
| 19:42 |
<aaron@tin> |
Synchronized wmf-config/CommonSettings.php: Revert "Bump $wgJobBackoffThrottling to lower the htmlcacheupdate backlog" (duration: 00m 32s) |
[production] |
| 18:51 |
<jynus> |
"repairing" enwiki.oldtable on dbstore1001 |
[production] |
| 18:40 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Aborting pc1001 maintenance (duration: 00m 31s) |
[production] |
| 18:15 |
<legoktm> |
running CentralAuth's resetGlobalUserTokens.php to force session resets for all users T124440 |
[production] |
| 18:02 |
<anomie@tin> |
Synchronized php-1.27.0-wmf.11/includes/user/User.php: Fix T124414 (duration: 00m 33s) |
[production] |
| 17:53 |
<legoktm> |
manually attaching User:Mower Genetics and User:Themeetingplace because they made edits somehow (T74791) |
[production] |
| 17:46 |
<ebernhardson@tin> |
Synchronized wmf-config/InitialiseSettings.php: Stop logging the CirrusSearchRequests channel (duration: 00m 32s) |
[production] |
| 17:44 |
<legoktm> |
running migrateAccount.php --attachbroken over lists on T74791 |
[production] |
| 17:39 |
<_joe_> |
removed an archived CirrusSearchRequests.log on fluorine, now we have enough room for the weekend |
[production] |
| 17:29 |
<anomie@tin> |
Synchronized php-1.27.0-wmf.11/extensions/CentralAuth/includes: Fix T124406 (duration: 00m 35s) |
[production] |
| 17:04 |
<mobrovac> |
mobileapps deploying bba45456 |
[production] |
| 17:00 |
<reedy@tin> |
Synchronized docroot and w: Extra noc symlinks (duration: 00m 32s) |
[production] |
| 16:58 |
<jynus@tin> |
Synchronized wmf-config/InitialiseSettings.php: monolog: reduce on-disk logging of DBPerformance to warning (duration: 00m 32s) |
[production] |
| 16:47 |
<jynus> |
truncating 100GB DBPerformance.log on fluorine, compressed backup available |
[production] |
| 16:46 |
<anomie@tin> |
Synchronized php-1.27.0-wmf.11/extensions/CentralAuth/includes/session/CentralAuthSessionProvider.php: Fix T124409, part 2 (duration: 00m 32s) |
[production] |
| 16:46 |
<anomie@tin> |
Synchronized php-1.27.0-wmf.11/includes/session/SessionBackend.php: Fix T124409, part 1 (duration: 00m 33s) |
[production] |
| 16:41 |
<cmjohnson1> |
Troubleshooting mw1228 |
[production] |
| 16:36 |
<_joe_> |
all api appservers in eqiad have been restarted |
[production] |
| 16:21 |
<ori> |
restarted statsv on hafnium |
[production] |
| 15:53 |
<ema> |
Finished migrating mobile traffic to text cluster in codfw (Mexico + green US states on this map https://phabricator.wikimedia.org/T114659) |
[production] |
| 15:39 |
<gwicke> |
aqs: increased compression block size on per-article table from 128k to 256k; expectation is to further increase compression ratio & reduce seeks on rotating disks |
[production] |
| 15:22 |
<Reedy> |
created translate tables on ruwikimedia T121766 |
[production] |
| 14:18 |
<paravoid> |
cr1-eqord: turning up BGP with Zayo |
[production] |
| 13:08 |
<ori@tin> |
Synchronized php-1.27.0-wmf.10/extensions/MobileFrontend: I08cdf37a1: Use TitleSquidURLs hook to purge mobile URLs directly (Bug: T124165) (duration: 00m 33s) |
[production] |
| 13:05 |
<ori@tin> |
Synchronized wmf-config/InitialiseSettings.php: If443f3c80: monolog: explicitly declare logstash as debug for sessions (duration: 00m 34s) |
[production] |
| 12:31 |
<ema> |
Starting migration of mobile traffic to text cluster https://phabricator.wikimedia.org/T109286 |
[production] |
| 11:35 |
<oblivian@tin> |
Synchronized wmf-config/InitialiseSettings.php: Re-synching (duration: 00m 31s) |
[production] |
| 11:25 |
<oblivian@tin> |
Synchronized wmf-config/InitialiseSettings.php: Stop writing session logs to fluorine (duration: 01m 25s) |
[production] |
| 11:17 |
<bblack> |
codfw LVS under etcd/conftool control now, like ulsfo |
[production] |
| 10:57 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Depool pc1001 for maintenance (duration: 02m 48s) |
[production] |
| 10:45 |
<_joe_> |
rolling restarting the API cluster in eqiad |
[production] |
| 10:34 |
<_joe_> |
rolling restart of all api appservers in eqiad |
[production] |
| 10:07 |
<_joe_> |
dropping api logs from 2015 on fluorine |
[production] |
| 09:10 |
<_joe_> |
rolling restart of imagescalers in eqiad |
[production] |
| 08:48 |
<_joe_> |
powercycling ms-be1002, blank console, down |
[production] |
| 08:46 |
<_joe_> |
rebooting mw1001 with a new kernel |
[production] |
| 08:07 |
<_joe_> |
upgrading kernel on all mw hosts in eqiad |
[production] |
| 05:07 |
<tstarling@tin> |
Synchronized php-1.27.0-wmf.11/includes/parser/ParserCache.php: (no message) (duration: 01m 28s) |
[production] |
| 02:42 |
<tstarling@tin> |
Synchronized php-1.27.0-wmf.11/includes/parser/ParserCache.php: (no message) (duration: 01m 28s) |
[production] |
| 02:40 |
<tstarling@tin> |
Synchronized php-1.27.0-wmf.11/includes/OutputPage.php: (no message) (duration: 01m 32s) |
[production] |
| 02:30 |
<mwdeploy@tin> |
sync-l10n completed (1.27.0-wmf.11) (duration: 09m 31s) |
[production] |
| 01:44 |
<catrope@tin> |
Finished scap: Deploying OATHAuth and WikimediaMessages i18n changes (duration: 30m 52s) |
[production] |
| 01:37 |
<gwicke> |
restbase cassandra: increased compression chunk size from 256 to 512k on wikimedia and wikipedia html and data-parsoid |
[production] |