|
2014-03-05
§
|
| 23:21 |
<bd808> |
Finished scap: no-diff scap to test script changes (duration: 27m 25s) |
[production] |
| 22:53 |
<bd808> |
Started scap: no-diff scap to test script changes |
[production] |
| 22:22 |
<bd808> |
scap broken; working on a fix |
[production] |
| 22:21 |
<bd808> |
scap failed: AttributeError 'int' object has no attribute 'find' (duration: 00m 00s) |
[production] |
| 21:23 |
<mutante> |
killing rhodium from puppet stored configs and icinga, was already removed from site.pp in change 115638 |
[production] |
| 20:48 |
<mutante> |
starting NTP on analytics1004 |
[production] |
| 20:46 |
<demon> |
synchronized wmf-config/InitialiseSettings.php 'Wikiquote Cirrus indexes done building, Beta for all!' |
[production] |
| 20:10 |
<mutante> |
installing php and security upgrades on bast1001 |
[production] |
| 20:09 |
<mutante> |
installing security upgrades on iron |
[production] |
| 18:27 |
<ori> |
synchronized wmf-config/CommonSettings.php 'Ic410bd788a: CentralNotice: set $wgCentralGeoScriptURL to false' |
[production] |
| 18:26 |
<ori> |
updated /a/common to {{Gerrit|Ic410bd788}}: CentralNotice: set $wgCentralGeoScriptURL to false |
[production] |
| 18:24 |
<awight> |
updated crm from from aa3cd54e1ebf21bc7b2c34e2431a4af32dac3b32 to f06bd7920921205e97a142cec19f1096b9761768 |
[production] |
| 18:24 |
<awight> |
updated crm from 648337cad8d465b2e03421aac59bc1117a797fd0 to aa3cd54e1ebf21bc7b2c34e2431a4af32dac3b32 |
[production] |
| 18:19 |
<ori> |
Cookie-based geolocation deployed to all text varnishes |
[production] |
| 17:20 |
<demon> |
synchronized wmf-config/InitialiseSettings.php 'Cirrus for all the wikiquotes' |
[production] |
| 16:31 |
<cmjohnson1> |
carbon going down |
[production] |
| 16:16 |
<akosiaris> |
upgraded php5 packages, php5-wmerrors and libmemcached packages on beta in preparation for full cluster upgrade. This will make puppet unhappy. |
[production] |
| 16:04 |
<cmjohnson1> |
shutting down mw1165 swapping DIMM |
[production] |
| 14:40 |
<ottomata> |
starting controlled shutdown (and restart) of kafka broker analytics1022 to bring in new replica.lag settings |
[production] |
| 14:31 |
<ottomata> |
starting controlled shutdown of kafka broker an21 to reload new replica.lag settings |
[production] |
| 11:12 |
<hashar> |
jenkins back |
[production] |
| 11:11 |
<ori> |
updated /a/common to {{Gerrit|I5277d2451}}: Update Schema:Echo revision to 7731316 |
[production] |
| 11:08 |
<hashar> |
restarting Jenkins which has starving threads |
[production] |
| 10:03 |
<hashar> |
Jenkins: gallium overloaded with a few java threads taking 100% CPU starving the box :( |
[production] |
| 05:21 |
<Ryan_Lane> |
finished switch from the perl git-deploy to trigger |
[production] |
| 04:17 |
<Ryan_Lane> |
switching out git-deploy perl frontend for trebuchet trigger |
[production] |
| 03:41 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at 2014-03-05 03:41:14+00:00 |
[production] |
| 03:37 |
<springle> |
messing with innodb compression on db1007 |
[production] |
| 02:54 |
<LocalisationUpdate> |
completed (1.23wmf16) at 2014-03-05 02:54:00+00:00 |
[production] |
| 02:27 |
<LocalisationUpdate> |
completed (1.23wmf15) at 2014-03-05 02:27:46+00:00 |
[production] |
| 00:24 |
<ori> |
synchronized php-1.23wmf15/extensions/CentralNotice 'Update CentralNotice to tip of wmf_deploy for I7d8259fc4' |
[production] |
| 00:17 |
<ori> |
synchronized php-1.23wmf16/extensions/CentralNotice 'Update CentralNotice to tip of wmf_deploy for I7d8259fc4' |
[production] |
|
2014-03-04
§
|
| 23:09 |
<mutante|away> |
DNS update - removing 'zhen' |
[production] |
| 23:07 |
<bsitu> |
synchronized wmf-config/CommonSettings.php 'Update Flow cache key to 3.0' |
[production] |
| 23:06 |
<bsitu> |
updated /a/common to {{Gerrit|I566e00bcc}}: Update flow cache version number |
[production] |
| 22:58 |
<ebernhardson> |
synchronized php-1.23wmf15/extensions/Flow/ |
[production] |
| 22:55 |
<ebernhardson> |
synchronized php-1.23wmf16/extensions/Flow/ |
[production] |
| 22:31 |
<ori> |
GeoIP cookie enabled on text frontend varnish on cp1066. Appears to work well. If it causes issues, roll back by reverting I7e5ca8e54 and running 'service varnish-frontend restart'. |
[production] |
| 22:14 |
<ori> |
synchronized wmf-config/CommonSettings-labs.php 'Syncing lab config change I5ca0adf39 to prod for cluster consistency' |
[production] |
| 22:12 |
<ori> |
updated /a/common to {{Gerrit|I5ca0adf39}}: Labs: set $wgCentralGeoScriptURL to false for GeoIP cookie testing |
[production] |
| 20:45 |
<hashar> |
operations/apache-config.git now has a "betacluster" branch to host the beta cluster apache configuration files {{bug|56395}} |
[production] |
| 20:39 |
<catrope> |
synchronized wmf-config/CommonSettings.php 'Actually fix VE on officewiki this time' |
[production] |
| 20:38 |
<catrope> |
updated /a/common to {{Gerrit|I7ff564e4a}}: Really actually fix VE on private wikis |
[production] |
| 19:22 |
<bd808> |
rebuilt wikiversions.cdb and synchronized wikiversions files: group1 to 1.23wmf16 |
[production] |
| 19:09 |
<ottomata> |
depooled elastic1007 and elastic1013-1016 per request from manybubbles |
[production] |
| 19:02 |
<bd808> |
updated /a/common to {{Gerrit|I62b32888b}}: Create an autopatrolled group on itwikiquote |
[production] |
| 18:47 |
<ottomata> |
s/analytics/elastic in previous log message |
[production] |
| 18:46 |
<ottomata> |
bringing analytics1007 and analytics1013-1016 into elasticsearch cluster |
[production] |
| 17:21 |
<manybubbles> |
rebuilding the search index on commons after failing yesterday now that I've deployed a fix to the timeout issue |
[production] |