|
2015-05-06
ยง
|
| 20:14 |
<twentyafterfour> |
ignore all rumors of scap failures, the scaps were successful, with the exception of snapshot1004.eqiad.wmnet which hangs every time |
[production] |
| 20:14 |
<twentyafterfour> |
Synchronized php-1.26wmf4/extensions/MobileFrontend/javascripts/modules/search/init.js: Temporarily disable MobileWebSearch logging (duration: 00m 37s) |
[production] |
| 20:12 |
<twentyafterfour> |
scap failed: OSError [Errno 2] No such file or directory: '/var/lock/scap' (duration: 27m 49s) |
[production] |
| 19:44 |
<twentyafterfour> |
Started scap: testwiki to php-1.26wmf5 and rebuild l10n cache |
[production] |
| 18:39 |
<mutante> |
restarting apache on rhodium |
[production] |
| 18:34 |
<bblack> |
rebooting cp3030 |
[production] |
| 18:14 |
<andrewbogott> |
restarted gmetad on uranium |
[production] |
| 17:41 |
<andrewbogott> |
powering down virt1005 and virt1006 |
[production] |
| 17:38 |
<andrewbogott> |
depuppeting and decommissioning virt1005 and virt1006 |
[production] |
| 17:24 |
<aude> |
Synchronized wmf-config/InitialiseSettings.php: Enable Wikibase usage tracking on enwikivoyage, fawiki and hewiki (duration: 00m 18s) |
[production] |
| 17:03 |
<jgage> |
hadoop active namenode switched back to analytics1001 after rack C4 switch replacement |
[production] |
| 16:43 |
<apergos> |
done with all trusty salt updates in pro except for labcontrol1002 (?), doing jessie now in very tiny batches, it's being trouble |
[production] |
| 15:29 |
<bd808> |
Stashed uncommitted change to scap on tin that disabled php opening tag check for sync-file |
[production] |
| 15:27 |
<bd808> |
Updated scap to 57036d2 (Update statsd events) |
[production] |
| 15:27 |
<bd808> |
trebuchet checkout for scap/scap failed for mw1113.eqiad.wmnet, mw1222.eqiad.wmnet, mw1104.eqiad.wmnet |
[production] |
| 15:25 |
<bd808> |
trebuchet fetch for scap/scap failed on mw1222.eqiad.wmnet |
[production] |
| 15:04 |
<bd808> |
Synchronized wmf-config/InitialiseSettings.php: Send group0 + group1 MediaWiki events to logstash {{gerrit|209170}} (duration: 00m 16s) |
[production] |
| 14:32 |
<cmjohnson1> |
shutting down db1054 for maintenance |
[production] |
| 14:22 |
<_joe_> |
depooling the HHVM imagescaler |
[production] |
| 14:20 |
<Nemo_bis> |
phabricator went down again for some minutes, seems ok now? |
[production] |
| 14:17 |
<_joe_> |
pooling the HHVM imagescalers to test if the issues are solved now. |
[production] |
| 14:15 |
<andrewbogott> |
rebooting labvirt1009 one last time |
[production] |
| 13:53 |
<_joe_> |
upgrading the hhvm imagescaler (mw1152) to HHVM 3.6.1 |
[production] |
| 13:47 |
<springle> |
Synchronized wmf-config/db-eqiad.php: repool db1021 in s2, warm up (duration: 00m 27s) |
[production] |
| 13:42 |
<apergos> |
all precise hosts are upgraded to salt except for tin and virt1000; in the middle of trusty updates now, in batches |
[production] |
| 13:38 |
<_joe_> |
uploading HHVM 3.6.1 and all the related extensions to apt.wikimedia.org |
[production] |
| 13:01 |
<paravoid> |
replacing asw-c4-eqiad (T93730) |
[production] |
| 12:45 |
<krenair> |
Synchronized php-1.26wmf4/extensions/SemanticMediaWiki/specials/QueryPages/SMW_QueryPage.php: https://gerrit.wikimedia.org/r/#/c/209212/ (duration: 00m 21s) |
[production] |
| 08:12 |
<legoktm> |
Synchronized wmf-config/CommonSettings-labs.php: no-op (duration: 00m 24s) |
[production] |
| 07:20 |
<ori> |
Synchronized wmf-config/CommonSettings.php: I019944f42: Change EventLogging endpoint to /beacon/event (duration: 00m 14s) |
[production] |
| 06:51 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Wed May 6 06:50:27 UTC 2015 (duration 50m 26s) |
[production] |
| 03:14 |
<LocalisationUpdate> |
completed (1.26wmf4) at 2015-05-06 03:13:28+00:00 |
[production] |
| 03:09 |
<l10nupdate> |
Synchronized php-1.26wmf4/cache/l10n: (no message) (duration: 08m 46s) |
[production] |
| 02:46 |
<LocalisationUpdate> |
completed (1.26wmf3) at 2015-05-06 02:45:26+00:00 |
[production] |
| 02:36 |
<l10nupdate> |
Synchronized php-1.26wmf3/cache/l10n: (no message) (duration: 10m 46s) |
[production] |
| 02:27 |
<springle> |
xtrabackup clone db1060 to db1021 |
[production] |
| 02:04 |
<ori> |
Synchronized wmf-config/CommonSettings.php: I83ad6d060: Remove wmgUseBits setting, now that the migration is complete (duration: 00m 18s) |
[production] |
| 02:02 |
<aude> |
Synchronized php-1.26wmf4/extensions/Wikidata: Fix Wikibase api error output bug - update submoduled (duration: 00m 28s) |
[production] |
| 01:59 |
<aude> |
Synchronized php-1.26wmf4/extensions/Wikidata: Fix Wikibase api error output bug (duration: 01m 08s) |
[production] |
| 01:52 |
<ori> |
Synchronized multiversion/MWWikiversions.php: Ib08e36901: MWWikiversions::readDbListFile: allow single-line ("#" or "//") comments (duration: 00m 18s) |
[production] |
| 01:40 |
<springle> |
upgrade db1021 trusty |
[production] |
| 00:51 |
<springle> |
schema change running T95179 wikidata, bit unusual, dropping a not-null field |
[production] |
| 00:46 |
<bd808> |
Synchronized wmf-config/CommonSettings.php: Add AffCom user group application contact page on meta {{gerrit|207332}} (duration: 00m 20s) |
[production] |
| 00:45 |
<bd808> |
Synchronized docroot/noc/createTxtFileSymlinks.sh: Add AffCom user group application contact page on meta {{gerrit|207332}} (duration: 00m 17s) |
[production] |
| 00:45 |
<bd808> |
Synchronized docroot/noc/conf/AffComContactPages.php.txt: Add AffCom user group application contact page on meta {{gerrit|207332}} (duration: 00m 15s) |
[production] |
| 00:44 |
<bd808> |
Synchronized wmf-config/AffComContactPages.php: Add AffCom user group application contact page on meta {{gerrit|207332}} (duration: 00m 33s) |
[production] |
| 00:15 |
<catrope> |
Synchronized php-1.26wmf3/extensions/Flow: SWAT (duration: 00m 23s) |
[production] |
| 00:15 |
<catrope> |
Synchronized php-1.26wmf3/extensions/WikiEditor: SWAT (duration: 00m 33s) |
[production] |
| 00:13 |
<bd808> |
Aborted sync-common on snapshot1004; host is starved for RAM and using swap heavily |
[production] |
| 00:06 |
<catrope> |
Synchronized php-1.26wmf4/extensions/CirrusSearch: SWAT (duration: 00m 28s) |
[production] |