|
2014-07-31
§
|
| 23:05 |
<mwalker> |
Synchronized wmf-config: Updating configuration for {{gerrit|150145}} (duration: 00m 05s) |
[production] |
| 22:41 |
<bd808> |
Restarted hhvm on -mediawiki{01,02}. Brett looked at 01 before I did and said "it's the same as before" |
[releng] |
| 21:17 |
<RobH> |
blog.wikimedia.org cname changed to migrate over to wp servers |
[production] |
| 20:22 |
<AaronSchulz> |
Started populateBacklinkNamespace.php on s1-s3,s5-s7 (commons already running) |
[production] |
| 20:13 |
<cscott> |
updated OCG to version d2919c59eb09e09fc87777696411a070620aef45 |
[production] |
| 20:09 |
<cscott> |
updated OCG to version d2919c59eb09e09fc87777696411a070620aef45 |
[releng] |
| 19:59 |
<hashar> |
Granted sudo right to cscott (under NDA). Will let him reboot OCG service |
[releng] |
| 19:40 |
<hashar> |
Jenkins build its first hhvm extension \\O/ https://integration.wikimedia.org/ci/job/php-FastStringSearch-hhvm-build/2/console |
[production] |
| 19:24 |
<Coren_away> |
labsdb1005 had to blow away the postgres slave: was using all the space on / because DB at wrong spot (should have been /srv/postgres) |
[production] |
| 18:58 |
<ori> |
re-enabled puppet on deployment-mediawiki{01,02} |
[releng] |
| 18:40 |
<reedy> |
Synchronized wmf-config/: (no message) (duration: 00m 15s) |
[production] |
| 18:27 |
<reedy> |
Synchronized wmf-config/: (no message) (duration: 00m 15s) |
[production] |
| 18:09 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: group0 to 1.24wmf16 |
[production] |
| 18:02 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: wikipedias to 1.24wmf15 |
[production] |
| 17:47 |
<aaron> |
Synchronized wmf-config/CommonSettings.php: Increased "htmlCacheUpdate" throttle limit (duration: 00m 07s) |
[production] |
| 17:46 |
<reedy> |
Finished scap: testwiki to 1.24wmf16 and build l10n cache (duration: 22m 35s) |
[production] |
| 17:23 |
<reedy> |
Started scap: testwiki to 1.24wmf16 and build l10n cache |
[production] |
| 14:57 |
<bblack> |
added labstore1003 to filter labs-in4 terms allow-labstore-(udp|tcp)4 on cr[12]-eqiad |
[production] |
| 14:34 |
<reedy> |
Synchronized wmf-config/InitialiseSettings.php: Allow sysops and 'crats on wikimania2014wiki to grant confirmed (duration: 00m 15s) |
[production] |
| 14:12 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: Wikivoyages to 1.24wmf15 |
[production] |
| 14:12 |
<reedy> |
Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 14s) |
[production] |
| 14:10 |
<reedy> |
Finished scap: Rebuild 1.24wmf15 l10n cache for WikimediaMessages updates (duration: 22m 40s) |
[production] |
| 14:06 |
<bblack> |
removed labs-in4 and labs-in6 filters on vlan 1117 (labs-hosts1-a-eqiad) on cr[12]-eqiad |
[production] |
| 13:47 |
<reedy> |
Started scap: Rebuild 1.24wmf15 l10n cache for WikimediaMessages updates |
[production] |
| 13:44 |
<reedy> |
Synchronized php-1.24wmf15/extensions/RelatedSites/: (no message) (duration: 00m 15s) |
[production] |
| 13:44 |
<reedy> |
Synchronized php-1.24wmf15/extensions/WikimediaMessages: (no message) (duration: 00m 14s) |
[production] |
| 12:10 |
<hashar> |
stopping Jenkins and restarting it |
[production] |
| 12:04 |
<hashar> |
reloading Jenkins configuration |
[production] |
| 11:37 |
<hashar> |
Jenkins: upgrading almost all jobs to use a new label 'UbuntuPrecise' {{bug|68340}} {{gerrit|150785}} |
[production] |
| 10:49 |
<hashar> |
Jenkins: attempting to poll a Trusty slave (integration-slave1004-trusty [10.68.17.148] with label <tt>UbuntuTrusty</tt>). |
[production] |
| 10:41 |
<hashar> |
Taking gdb traces of hhvm on mediawiki01 and mediawiki02. Restarting hhvm |
[releng] |
| 10:32 |
<hashar> |
Jenkins: tweaking jobs labels, that might eventually screw up Zuul/Jenkins entirely. |
[production] |
| 08:43 |
<_joe_> |
start rolling reload of nginx to catch up with the new ssl config |
[production] |
| 06:50 |
<springle> |
labsdb1001 migration complete, should be all systems go |
[production] |
| 05:08 |
<bd808> |
HHVM hung on both boxes. Grabbed core and backtrace before restarting |
[releng] |
| 03:19 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Thu Jul 31 03:18:07 UTC 2014 (duration 18m 6s) |
[production] |
| 02:36 |
<LocalisationUpdate> |
completed (1.24wmf15) at 2014-07-31 02:35:29+00:00 |
[production] |
| 02:20 |
<LocalisationUpdate> |
completed (1.24wmf14) at 2014-07-31 02:19:17+00:00 |
[production] |
| 02:06 |
<springle> |
labsdb1001 migrating to mariadb 10, expect read-only and downtime, see labs-l |
[production] |
|
2014-07-30
§
|
| 23:27 |
<maxsem> |
Synchronized php-1.24wmf15/extensions/MwEmbedSupport/: (no message) (duration: 00m 03s) |
[production] |
| 23:27 |
<maxsem> |
Synchronized php-1.24wmf15/extensions/Wikidata/: (no message) (duration: 00m 08s) |
[production] |
| 23:27 |
<maxsem> |
Synchronized php-1.24wmf15/extensions/SyntaxHighlight_GeSHi/: (no message) (duration: 00m 05s) |
[production] |
| 23:24 |
<maxsem> |
Synchronized php-1.24wmf14/extensions/Wikidata: (no message) (duration: 00m 11s) |
[production] |
| 23:13 |
<maxsem> |
Synchronized wmf-config: (no message) (duration: 00m 05s) |
[production] |
| 21:04 |
<AaronSchulz> |
Started populateBacklinkNamespace.php on wikidata and commons |
[production] |
| 21:02 |
<bblack> |
turned icinga email/sms back on |
[production] |
| 20:24 |
<bblack> |
icinga back online again |
[production] |
| 19:59 |
<bd808> |
Created local commit 7d56b79 in puppet to work around bugs in Ia463120718dceab087ad3f8e3f35917fa879f387 |
[releng] |
| 19:58 |
<bblack> |
shutting off icinga to make some optimizations |
[production] |
| 19:46 |
<bd808> |
Restored prior /etc/hhvm/php.ini from puppet filebucket archive on deployment-mediawiki0[12] |
[releng] |