|
2013-10-23
§
|
| 07:43 |
<apergos> |
mw125: stopped apache shortly after adding back to dns, (needed to wait for an hour for the update to reach the pmtpa recursors so puppet could run), at first successful puppet run mw-sync completed so this host should be good to go now |
[production] |
| 05:54 |
<ori-l> |
sync-file: 'Could not resolve hostname mw125: Name or service not known' |
[production] |
| 05:53 |
<ori> |
synchronized wmf-config/InitialiseSettings.php 'I11c90ed5a: Added some purge/thumbnail rate limits' |
[production] |
| 05:30 |
<apergos> |
powercycled srv291, unresponsive to ping, no login at mgmt console |
[production] |
| 02:47 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Wed Oct 23 02:47:16 UTC 2013 |
[production] |
| 02:24 |
<LocalisationUpdate> |
completed (1.22wmf21) at Wed Oct 23 02:24:39 UTC 2013 |
[production] |
| 02:16 |
<LocalisationUpdate> |
completed (1.22wmf22) at Wed Oct 23 02:16:06 UTC 2013 |
[production] |
| 00:30 |
<springle> |
synchronized wmf-config/db-eqiad.php 'warmup db1034' |
[production] |
|
2013-10-22
§
|
| 23:52 |
<mwalker> |
actually updating payments listeners... 243ec9ca483993386aa99a10f872c8afa097a548 to 15b4723be940299ddd6604f996a19364fa89416b |
[production] |
| 23:28 |
<catrope> |
synchronized php-1.22wmf22/extensions/VisualEditor 'Update VisualEditor for cherry-picks' |
[production] |
| 23:28 |
<catrope> |
synchronized php-1.22wmf21/extensions/VisualEditor 'Update VisualEditor for cherry-picks' |
[production] |
| 23:20 |
<mwalker> |
updating listeners from 243ec9ca483993386aa99a10f872c8afa097a548 for smashpig recovery |
[production] |
| 23:06 |
<paravoid> |
powercycling ms-be1011, locked up, no messages in console |
[production] |
| 23:05 |
<mwalker> |
synchronized php-1.22wmf22/extensions/CentralNotice 'Updating CentralNotice to masterish' |
[production] |
| 22:51 |
<K4-713> |
updated payments cluster to 300fa32 |
[production] |
| 22:24 |
<ori> |
synchronized php-1.22wmf22/resources/mediawiki/mediawiki.inspect.js 'I0e7a47b5a: mediawiki.inspect: add CSS report (4/4)' |
[production] |
| 22:23 |
<ori> |
synchronized php-1.22wmf22/resources/mediawiki/mediawiki.js 'I0e7a47b5a: mediawiki.inspect: add CSS report (3/4)' |
[production] |
| 22:23 |
<ori> |
synchronized php-1.22wmf21/resources/mediawiki/mediawiki.inspect.js 'I0e7a47b5a: mediawiki.inspect: add CSS report (2/4)' |
[production] |
| 22:23 |
<ori> |
synchronized php-1.22wmf21/resources/mediawiki/mediawiki.js 'I0e7a47b5a: mediawiki.inspect: add CSS report (1/4)' |
[production] |
| 22:09 |
<ori> |
synchronized wmf-config/CommonSettings.php 'I6f6e0ffa3: Update beta to use loginwiki for SUL (bug 55760)' |
[production] |
| 22:07 |
<ori-l> |
during previous sync-file: could not resolve mw125; time out connecting to srv291 |
[production] |
| 22:07 |
<ori> |
synchronized wmf-config/Bug54847.php 'Ide07296c5: Fix error message for recycled passwords (Bug 56002)' |
[production] |
| 21:38 |
<reedy> |
synchronized php-1.22wmf22/extensions/Wikibase |
[production] |
| 21:37 |
<reedy> |
synchronized php-1.22wmf22/extensions/RelatedSites |
[production] |
| 21:08 |
<Ryan_Lane> |
pushed git deployment changes 91151 and 91155 to production |
[production] |
| 20:30 |
<bblack> |
varnish: banned 'obj.http.content-length == 33518' on text varnishes everywhere (extract2.php leakage) |
[production] |
| 19:54 |
<Ryan_Lane> |
updating git deployment system with change 90277 (0424d6f7) |
[production] |
| 19:23 |
<cmjohnson1> |
dns update |
[production] |
| 18:42 |
<bsitu> |
synchronized php-1.22wmf21/extensions/Echo/modules/overlay 'touch' |
[production] |
| 18:35 |
<bsitu> |
synchronized wmf-config/InitialiseSettings.php 'touch' |
[production] |
| 18:09 |
<bsitu> |
synchronized echowikis.dblist 'Enable Echo and Thanks on all wikis except dewiki and itwiki' |
[production] |
| 18:08 |
<bsitu> |
synchronized wmf-config/InitialiseSettings.php 'Enable Echo and Thanks on all wikis except dewiki and itwiki' |
[production] |
| 18:01 |
<mutante> |
restarting a few Apaches that didnt get restarted by graceful-all (hrmmpf) |
[production] |
| 17:51 |
<awight> |
civicrm updated 41b621ab759fbafc9dcc9cf8323d1bdd973dfb72 to 6f370cccad7f963dd1cfbc2fdd9c68a5b2288836 |
[production] |
| 17:23 |
<mark> |
Banned Content-Type == "application/x-httpd-php" in text Varnish (eqiad) |
[production] |
| 17:19 |
<mutante> |
apache graceful-all |
[production] |
| 17:06 |
<mutante> |
sync-apache, graceful to unify www portal docroots |
[production] |
| 16:31 |
<demon> |
synchronized wmf-config/InitialiseSettings.php 'Touch' |
[production] |
| 16:26 |
<demon> |
synchronized cirrus.dblist 'foundationwiki gets cirrus' |
[production] |
| 16:19 |
<reedy> |
synchronized docroot/wwwportal |
[production] |
| 10:09 |
<apergos> |
powercycled sq80, hung on mgmt console |
[production] |
| 09:42 |
<hashar> |
Zuul: no more voting on code-review label {{bug|55757}} {{gerrit|91157}}. Will make the database happier I guess |
[production] |
| 09:30 |
<springle> |
synchronized wmf-config/db-eqiad.php 'repool db1018' |
[production] |
| 03:46 |
<springle> |
synchronized wmf-config/db-eqiad.php 'repool db1007, warm up db1041' |
[production] |
| 03:06 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Tue Oct 22 03:06:46 UTC 2013 |
[production] |
| 03:00 |
<springle> |
upgrading db1017 to precise |
[production] |
| 02:39 |
<LocalisationUpdate> |
completed (1.22wmf21) at Tue Oct 22 02:39:32 UTC 2013 |
[production] |
| 02:25 |
<LocalisationUpdate> |
completed (1.22wmf22) at Tue Oct 22 02:25:12 UTC 2013 |
[production] |
| 01:41 |
<springle> |
start xtrabackup clone db1007 to db1041 |
[production] |
| 01:26 |
<springle> |
start xtrabackup clone db1018 to db1034 |
[production] |