701-750 of 10000 results (28ms)
2016-01-27 §
22:36 <robh> restarting parsoid-rt-client service on ruthenium [production]
22:29 <ottomata> starting mysqldump of MobileWebSectionUsage_14321266 from db1047 into m4-master [production]
21:45 <yurik> updated graphoid on scb* [production]
21:29 <mdholloway> mobileapps deployed 6f35859 [production]
21:26 <cscott> updated OCG to version 64050af0456a43344b32e3e93561a79207565eaf [production]
21:26 <ori@mira> Synchronized docroot and w: (no message) (duration: 02m 26s) [production]
19:48 <YuviPanda> started nfs-exports daemon on labstore1001, had been dead for a few days [production]
19:31 <mutante> stat1002 - redis.exceptions.ConnectionError: Error connecting to mira.codfw.wmnet:6379. timed out. [production]
19:31 <mutante> stat1002 - running puppet, was reported as last run about 4 hours ago but not deactivated [production]
19:14 <dduvall@mira> rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.27.0-wmf.11 [production]
18:49 <jynus@mira> Synchronized wmf-config/db-eqiad.php: Repool pc1006 after cloning (duration: 02m 25s) [production]
18:48 <bd808> HHVM on mw1019 still dying on a regular basis with "Lost parent, LightProcess exiting" [production]
18:00 <csteipp> deploy patch for T103239 [production]
17:50 <csteipp> deploy patch for T97157 [production]
17:46 <jynus> migrating ruthenium parsoid-test database to m5-master [production]
17:27 <elukey> rebooting analytics105* hosts to upgrade their kernel [production]
17:16 <elukey> rebooting analytics1035.eqiad.wmnet for kernel upgrade [production]
16:22 <thcipriani@mira> Synchronized php-1.27.0-wmf.11/extensions/CentralAuth/includes/CentralAuthUtils.php: SWAT: Preserve certain keys when updating central session [[gerrit:266672]] (duration: 02m 28s) [production]
16:11 <thcipriani@mira> Synchronized php-1.27.0-wmf.11/extensions/CentralAuth/includes/session/CentralAuthSessionProvider.php: SWAT: Avoid forceHTTPS cookie flapping if core and CA are setting the same cookie [[gerrit:266671]] (duration: 02m 26s) [production]
16:03 <elukey> rebooting analytics 1043 -> 1050 for kernel upgrade. [production]
15:47 <elukey> rebooting analytics 1026, 1040 -> 1042 due to kernel upgrade. [production]
14:58 <jynus> cloning persercache contents from pc1003 to pc1006 [production]
14:45 <elukey> rebooting analytics 1036 to 1039 for kernel upgrade [production]
14:35 <elukey> analytics 1035 hasn't been rebooted because it is a Hadoop Journal Node (will be restarted in the end) [production]
14:04 <elukey> rebooting analytics 1032 to 1035 for kernel upgrades [production]
14:03 <jynus@mira> Synchronized wmf-config/db-eqiad.php: Depool pc1003 for cloning to pc1006 (duration: 02m 30s) [production]
13:59 <jynus> about to going new hardware/OS/mariadb-only for parsercache service [production]
13:32 <elukey> rebooting analytics1030/1031 for kernel upgrade [production]
13:15 <akosiaris> rebooting fermium for kernel upgrades [production]
13:10 <elukey> rebooting analytics1029 for kernel upgrade [production]
12:29 <moritzm> rebooting analytics1028 for kernel update [production]
10:25 <ema> restarting apache2 and hhvm on mw1119 [production]
03:19 <ebernhardson@mira> Synchronized wmf-config/CirrusSearch-production.php: Correct invalid cirrus shard configuration (duration: 02m 59s) [production]
02:55 <l10nupdate@tin> ResourceLoader cache refresh completed at Wed Jan 27 02:55:21 UTC 2016 (duration 7m 13s) [production]
02:48 <mwdeploy@tin> sync-l10n completed (1.27.0-wmf.11) (duration: 10m 25s) [production]
02:23 <mwdeploy@tin> sync-l10n completed (1.27.0-wmf.10) (duration: 09m 51s) [production]
01:59 <ori@mira> Synchronized docroot and w: Icc4f6134b0: Add a speed experiment which inlines the top stylesheet (duration: 02m 28s) [production]
01:29 <MaxSem> on terbium: ran mwscript namespaceDupes.php --wiki=wuuwiki --source-pseudo-namespace='' --add-suffix=/renamed --fix [production]
01:26 <MaxSem> Fail, trying something else... [production]
01:21 <MaxSem> running mwscript namespaceDupes.php --wiki=wuuwiki --move-talk --fix [production]
00:52 <krenair@mira> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/266497/ (duration: 02m 26s) [production]
00:48 <krenair@mira> Synchronized w/static/images/project-logos/ukwikinews.png: https://gerrit.wikimedia.org/r/#/c/266497/ (duration: 02m 29s) [production]
00:44 <krenair@mira> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/266161/ (duration: 02m 27s) [production]
00:15 <ebernhardson@mira> Synchronized php-1.27.0-wmf.11/extensions/CirrusSearch/: Allow pointing morelike queries at a specific datacenter (duration: 03m 04s) [production]
00:10 <ebernhardson@mira> Synchronized wmf-config/CirrusSearch-production.php: point morelike queries back at the eqiad cluster (duration: 05m 41s) [production]
00:02 <chasemp> enable puppet and codify the 192 thread count for nfsd [production]
2016-01-26 §
22:25 <dduvall@mira> rebuilt wikiversions.php and synchronized wikiversions files: group0 to 1.27.0-wmf.11, for real this time [production]
22:17 <dduvall@mira> rebuilt wikiversions.php and synchronized wikiversions files: group0 to 1.27.0-wmf.11 [production]
22:15 <dduvall@mira> Synchronized php-1.27.0-wmf.11: syncing wmf.11 backports of session fixes (duration: 03m 55s) [production]
21:55 <ori@mira> Synchronized docroot and w: I9b054d847a: New set of speed experiments (duration: 01m 29s) [production]