4151-4200 of 10000 results (51ms)
2016-08-10 ยง
23:44 <mutante> mw2086 - removing node from cluster failed - backend error, request requires authentication [production]
23:40 <reedy@tin> Synchronized php-1.28.0-wmf.14/extensions/VipsScaler: Remove old broken config causing T142638 (duration: 00m 50s) [production]
23:39 <yuvipanda> restarted rabbitmq on labcontrol1001 [production]
23:22 <mutante> connected to mw2086.mgmt (which icinga said was down since a couple hours). i saw it booting up..it came back but i did not powercyle or reboot, just view console [production]
23:17 <reedy@tin> rebuilt wikiversions.php and synchronized wikiversions files: Revert to .13 to attempt to fix T142638 [production]
22:36 <andrewbogott> restarting rabbitmq-server on labvirt1001 [production]
21:42 <mutante> added tbayer(HaeB) to wmf LDAP group [production]
21:30 <eileen> updated civicrm from 024a7ef2badb02743659ffed9856571d96604fd2 to cad2c59081e53b877f51be4c853f307f3c4d4949 [production]
20:21 <Amir1> deploygin 7aad8e9 for ores in all nodes [production]
20:18 <Amir1> deploygin 7aad8e9 for ores in canary (scb2001.codfw.wmnet) [production]
20:17 <mattflaschen@tin> Synchronized wmf-config/CommonSettings-labs.php: Re-enable thank-you-edit (milestone notifications for 1st, 10th, 100th, etc. edits) on Beta Cluster (duration: 02m 45s) [production]
20:11 <subbu> finished deploying parsoid sha 4de49e26 [production]
20:07 <subbu> finished syncing code; restarted parsoid on wtp1001 as canary [production]
20:05 <subbu> starting parsoid deploy [production]
19:34 <twentyafterfour@tin> rebuilt wikiversions.php and synchronized wikiversions files: (no message) [production]
19:31 <twentyafterfour> sync-wikiversions failed for mw2086.codfw.wmnet [production]
19:30 <twentyafterfour@tin> rebuilt wikiversions.php and synchronized wikiversions files: (no message) [production]
17:15 <otto@palladium> conftool action : set/pooled=yes; selector: kafka1002.eqiad.wmnet [production]
17:14 <otto@palladium> conftool action : set/pooled=no; selector: kafka1002.eqiad.wmnet [production]
17:14 <otto@palladium> conftool action : set/pooled=yes; selector: kafka1001.eqiad.wmnet [production]
17:12 <otto@palladium> conftool action : set/pooled=no; selector: kafka1001.eqiad.wmnet [production]
17:12 <ottomata> restarting eventbus in eqiad to apply error_output change [production]
16:13 <hoo@tin> Synchronized wmf-config/InitialiseSettings.php: Enable the ArticlePlaceholder on knwiki (T142468) (duration: 02m 55s) [production]
16:08 <hoo@tin> Synchronized wmf-config/InitialiseSettings.php: Enable the ArticlePlaceholder on cywiki (T140725) (duration: 02m 49s) [production]
15:50 <_joe_> restarting parsoid for T137878 [production]
15:41 <andrewbogott> rebooting labvirt1014 to 3.16.0-77-generic for testing secgroup issues [production]
15:30 <elukey> correct version installed on mw1261 is 2.4.10-10+deb8u6+wmf2 [production]
15:22 <thcipriani> mw2086 ssh from tin as mwdeploy user failing. Will need to run 'scap pull' when it comes back online [production]
15:20 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:303003|Promote new language switcher to all wikis (T129505)]] (duration: 01m 12s) [production]
15:14 <thcipriani@tin> Synchronized dblists/visualeditor-nondefault.dblist: SWAT: [[gerrit:303586|Enable VisualEditor by default for logged-in users on Arabic-script Wikipedias (T93387)]] PART II]] (duration: 01m 40s) [production]
15:11 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:303586|Enable VisualEditor by default for logged-in users on Arabic-script Wikipedias (T93387)]] PART I]] (duration: 02m 49s) [production]
14:40 <elukey> depooling mw1261 to install/test apache2_2.4.10-10+deb8u6+wmf1_amd64.deb (T73487). After basic checks the host will get back into service with weight 5. [production]
13:54 <moritzm> depooling image scaler mw1298 for some local tests with huge SVGs [production]
13:48 <otto@palladium> conftool action : set/pooled=yes; selector: kafka1002.eqiad.wmnet [production]
13:43 <otto@palladium> conftool action : set/pooled=no; selector: kafka1002.eqiad.wmnet [production]
13:42 <otto@palladium> conftool action : set/pooled=yes; selector: kafka1001.eqiad.wmnet [production]
13:38 <otto@palladium> conftool action : set/pooled=no; selector: kafka1001.eqiad.wmnet [production]
13:38 <ottomata> deploying eventbus service to kafka100[12], depooling, deploying, and repooling each one at at time [production]
12:57 <moritzm> reboot rdb2001-rdb2004 for updates to Linux 4.4 [production]
12:19 <akosiaris> T140443 uploaded to apt.wikimedia.org trusty-wikimedia: php-wikidiff2_1.4.1 [production]
11:29 <akosiaris> T140443 uploaded to apt.wikimedia.org trusty-wikimedia: php-wikidiff2_1.4.0 [production]
09:55 <moritzm> rebooting dubnium for kernel update to 4.4 [production]
09:44 <moritzm> rebooting pollux for kernel update to 4.4 [production]
09:41 <_joe_> uploaded puppetdb deb packages for jessie (T142363) [production]
09:09 <moritzm> rebooting hafnium for kernel update to 4.4 [production]
03:22 <l10nupdate@tin> ResourceLoader cache refresh completed at Wed Aug 10 03:22:29 UTC 2016 (duration 7m 26s) [production]
03:15 <mwdeploy@tin> scap sync-l10n completed (1.28.0-wmf.14) (duration: 18m 02s) [production]
02:40 <mwdeploy@tin> scap sync-l10n completed (1.28.0-wmf.13) (duration: 17m 50s) [production]
00:42 <reedy@tin> Synchronized php-1.28.0-wmf.14/extensions/timeline/Timeline.body.php: (no message) (duration: 00m 48s) [production]
00:41 <maxsem@tin> Synchronized php-1.28.0-wmf.13/extensions/timeline: (no message) (duration: 00m 47s) [production]