2301-2350 of 10000 results (24ms)
2016-01-23 §
02:32 <l10nupdate@tin> ResourceLoader cache refresh completed at Sat Jan 23 02:32:15 UTC 2016 (duration 7m 3s) [production]
02:25 <mwdeploy@tin> sync-l10n completed (1.27.0-wmf.10) (duration: 09m 09s) [production]
01:33 <bd808@tin> rebuilt wikiversions.php and synchronized wikiversions files: Back to 1.27.0-wmf10 again after fixking l10n cache problems [production]
01:28 <bd808@tin> rebuilt wikiversions.php and synchronized wikiversions files: Temporarily back to 1.27.0-wmf11; need to rebuild l10n cache [production]
01:16 <bd808@tin> rebuilt wikiversions.php and synchronized wikiversions files: Revert all wikis to 1.27.0-wmf.10 [production]
00:08 <bd808@tin> Synchronized php-1.27.0-wmf.11/extensions/CentralAuth/includes/session/CentralAuthSessionProvider.php: https://gerrit.wikimedia.org/r/#/c/265872/ (duration: 00m 25s) [production]
00:07 <bd808@tin> Synchronized php-1.27.0-wmf.11/includes/session/CookieSessionProvider.php: https://gerrit.wikimedia.org/r/#/c/265871/ (duration: 00m 25s) [production]
2016-01-22 §
23:43 <legoktm@tin> Synchronized php-1.27.0-wmf.11/extensions/CentralAuth/includes/session/CentralAuthSessionProvider.php: https://gerrit.wikimedia.org/r/#/c/265870/ (duration: 00m 26s) [production]
23:42 <legoktm@tin> Synchronized php-1.27.0-wmf.11/includes/session/CookieSessionProvider.php: https://gerrit.wikimedia.org/r/#/c/265869/ (duration: 00m 26s) [production]
23:22 <mobrovac> restbase cassandra truncating local_group_wiktionary_T_term_definition.data [production]
22:33 <mdholloway> mobileapps deployed 2900faa [production]
22:23 <twentyafterfour@tin> Finished scap: deploy https://gerrit.wikimedia.org/r/#/c/263415/ and clean up old branches (duration: 07m 02s) [production]
22:16 <twentyafterfour@tin> Started scap: deploy https://gerrit.wikimedia.org/r/#/c/263415/ and clean up old branches [production]
22:06 <bblack> upgrading vhtcpd on all caches [production]
21:49 <anomie@tin> Synchronized php-1.27.0-wmf.11/includes/: Fix T124468, for real this time (duration: 00m 36s) [production]
21:48 <anomie@tin> Synchronized php-1.27.0-wmf.11/includes/: Fix T124468 (duration: 00m 38s) [production]
21:17 <legoktm> running migrateAccount.php --attachbroken over list of all unattached users (T74791) [production]
20:04 <mutante> ruthenium - rebooting for reinstall [production]
19:42 <aaron@tin> Synchronized wmf-config/CommonSettings.php: Revert "Bump $wgJobBackoffThrottling to lower the htmlcacheupdate backlog" (duration: 00m 32s) [production]
18:51 <jynus> "repairing" enwiki.oldtable on dbstore1001 [production]
18:40 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Aborting pc1001 maintenance (duration: 00m 31s) [production]
18:15 <legoktm> running CentralAuth's resetGlobalUserTokens.php to force session resets for all users T124440 [production]
18:02 <anomie@tin> Synchronized php-1.27.0-wmf.11/includes/user/User.php: Fix T124414 (duration: 00m 33s) [production]
17:53 <legoktm> manually attaching User:Mower Genetics and User:Themeetingplace because they made edits somehow (T74791) [production]
17:46 <ebernhardson@tin> Synchronized wmf-config/InitialiseSettings.php: Stop logging the CirrusSearchRequests channel (duration: 00m 32s) [production]
17:44 <legoktm> running migrateAccount.php --attachbroken over lists on T74791 [production]
17:39 <_joe_> removed an archived CirrusSearchRequests.log on fluorine, now we have enough room for the weekend [production]
17:29 <anomie@tin> Synchronized php-1.27.0-wmf.11/extensions/CentralAuth/includes: Fix T124406 (duration: 00m 35s) [production]
17:04 <mobrovac> mobileapps deploying bba45456 [production]
17:00 <reedy@tin> Synchronized docroot and w: Extra noc symlinks (duration: 00m 32s) [production]
16:58 <jynus@tin> Synchronized wmf-config/InitialiseSettings.php: monolog: reduce on-disk logging of DBPerformance to warning (duration: 00m 32s) [production]
16:47 <jynus> truncating 100GB DBPerformance.log on fluorine, compressed backup available [production]
16:46 <anomie@tin> Synchronized php-1.27.0-wmf.11/extensions/CentralAuth/includes/session/CentralAuthSessionProvider.php: Fix T124409, part 2 (duration: 00m 32s) [production]
16:46 <anomie@tin> Synchronized php-1.27.0-wmf.11/includes/session/SessionBackend.php: Fix T124409, part 1 (duration: 00m 33s) [production]
16:41 <cmjohnson1> Troubleshooting mw1228 [production]
16:36 <_joe_> all api appservers in eqiad have been restarted [production]
16:21 <ori> restarted statsv on hafnium [production]
15:53 <ema> Finished migrating mobile traffic to text cluster in codfw (Mexico + green US states on this map https://phabricator.wikimedia.org/T114659) [production]
15:39 <gwicke> aqs: increased compression block size on per-article table from 128k to 256k; expectation is to further increase compression ratio & reduce seeks on rotating disks [production]
15:22 <Reedy> created translate tables on ruwikimedia T121766 [production]
14:18 <paravoid> cr1-eqord: turning up BGP with Zayo [production]
13:08 <ori@tin> Synchronized php-1.27.0-wmf.10/extensions/MobileFrontend: I08cdf37a1: Use TitleSquidURLs hook to purge mobile URLs directly (Bug: T124165) (duration: 00m 33s) [production]
13:05 <ori@tin> Synchronized wmf-config/InitialiseSettings.php: If443f3c80: monolog: explicitly declare logstash as debug for sessions (duration: 00m 34s) [production]
12:31 <ema> Starting migration of mobile traffic to text cluster https://phabricator.wikimedia.org/T109286 [production]
11:35 <oblivian@tin> Synchronized wmf-config/InitialiseSettings.php: Re-synching (duration: 00m 31s) [production]
11:25 <oblivian@tin> Synchronized wmf-config/InitialiseSettings.php: Stop writing session logs to fluorine (duration: 01m 25s) [production]
11:17 <bblack> codfw LVS under etcd/conftool control now, like ulsfo [production]
10:57 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Depool pc1001 for maintenance (duration: 02m 48s) [production]
10:45 <_joe_> rolling restarting the API cluster in eqiad [production]
10:34 <_joe_> rolling restart of all api appservers in eqiad [production]