|
2015-10-05
§
|
| 17:27 |
<gwicke> |
rolling restart of restbase cluster to rule out driver issues causing the increased p99 read lacenty |
[production] |
| 17:19 |
<robh> |
analytics1035 pegged out, ssh unresponsive and raid failures, and then fixed itself 5 minutes later |
[production] |
| 16:32 |
<legoktm> |
running backPopulateRenameQueueLogs.php ([[gerrit:237169]]) on metawiki |
[production] |
| 16:05 |
<hoo> |
Updated Wikidata's property suggester with data from today's json dump |
[production] |
| 15:19 |
<thcipriani@tin> |
Synchronized php-1.27.0-wmf.1/extensions/Flow: SWAT: Fix exception on board and topic history pages [[gerrit:243337]] (duration: 00m 20s) |
[production] |
| 14:41 |
<hashar> |
puppet-lint Jenkins job is now strict and will -1 on errors as well as warnings https://gerrit.wikimedia.org/r/#/c/243185/ |
[production] |
| 10:25 |
<godog> |
roll-restart cassandra in restbase eqiad |
[production] |
| 09:58 |
<_joe_> |
installing the new HHVM package to appservers |
[production] |
| 09:50 |
<_joe_> |
rebooted mw1153, soft lockup due to bnx2 failure |
[production] |
| 09:50 |
<godog> |
roll-restart cassandra in restbase codfw |
[production] |
| 09:18 |
<godog> |
roll-restart cassandra on restbase test cluster |
[production] |
| 09:15 |
<godog> |
stop puppet on restbase and maps in preparation for https://gerrit.wikimedia.org/r/#/c/242896/1 |
[production] |
| 08:07 |
<_joe_> |
upgrading HHVM on all API appservers |
[production] |
| 05:33 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Mon Oct 5 05:33:18 UTC 2015 (duration 33m 17s) |
[production] |
| 02:33 |
<l10nupdate@tin> |
LocalisationUpdate completed (1.27.0-wmf.1) at 2015-10-05 02:33:57+00:00 |
[production] |
| 02:29 |
<l10nupdate@tin> |
Synchronized php-1.27.0-wmf.1/cache/l10n: l10nupdate for 1.27.0-wmf.1 (duration: 08m 25s) |
[production] |
|
2015-10-02
§
|
| 22:46 |
<mutante> |
holmium: apt-get clean for a little disk space - /var/log/designate/designate-mdns.log is more than half the size of / - needs logrotate |
[production] |
| 21:33 |
<Krinkle> |
mwscript cleanupRemovedModules.php --wiki zhwiktionary |
[production] |
| 21:21 |
<Krinkle> |
mwscript cleanupRemovedModules.php --wiki testwikidatawiki |
[production] |
| 21:15 |
<Krinkle> |
mwscript cleanupRemovedModules.php --wiki dewiki |
[production] |
| 21:15 |
<Krinkle> |
mwscript cleanupRemovedModules.php --wiki nlwiki |
[production] |
| 21:15 |
<Krinkle> |
mwscript cleanupRemovedModules.php --wiki test2wiki |
[production] |
| 21:06 |
<ori@tin> |
Synchronized wmf-config/CommonSettings.php: (no message) (duration: 00m 17s) |
[production] |
| 18:39 |
<ottomata> |
kafka preferred-replica-election |
[production] |
| 17:53 |
<ori@tin> |
Synchronized php-1.27.0-wmf.1/includes/resourceloader: I680f3fda66c5: Configure ResourceLoader-specific ObjectCache instance (duration: 00m 17s) |
[production] |
| 17:53 |
<ottomata> |
rolling restart of all hadoop-yarn-nodemanagers to pick up python3 + spark fix |
[production] |
| 17:12 |
<ori@tin> |
Synchronized wmf-config/CommonSettings.php: I8318fe892: Configure MultiWriteBagOStuff for ResourceLoader (duration: 00m 17s) |
[production] |
| 16:29 |
<ori> |
deployed grafana 8e92884bae (with backport of upstream fb9f9548829f2d4cecf35cda933700e5c2fa1bd6) |
[production] |
| 15:13 |
<ori@tin> |
Synchronized php-1.27.0-wmf.1/resources/src/mediawiki/mediawiki.js: I8029208: Don't clobber existing styles when adding more in IE9 (duration: 00m 17s) |
[production] |
| 14:37 |
<jynus> |
providing extra grants to wiki db users for heartbeat monitoring |
[production] |
| 14:32 |
<Coren> |
Change of NFS mount options in labs pushed - puppet may report failures to refresh the mounts (once) on instances; expected and harmless. |
[production] |
| 11:03 |
<moritzm> |
installed rpcbind security updates on all Ubuntu servers which runs it (jessie was already updated, since the DSA was released earlier) |
[production] |
| 10:53 |
<jynus> |
restarting HHVM on mw1130 |
[production] |
| 08:45 |
<hashar> |
restarting Nodepool to take in account changes made to the logging configuration https://gerrit.wikimedia.org/r/#/c/240986/ |
[production] |
| 06:07 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Fri Oct 2 06:07:05 UTC 2015 (duration 7m 4s) |
[production] |
| 02:42 |
<tstarling@tin> |
Synchronized php-1.27.0-wmf.1/extensions/ParsoidBatchAPI: stats (duration: 00m 17s) |
[production] |
| 02:41 |
<l10nupdate@tin> |
LocalisationUpdate completed (1.27.0-wmf.1) at 2015-10-02 02:41:33+00:00 |
[production] |
| 02:36 |
<l10nupdate@tin> |
Synchronized php-1.27.0-wmf.1/cache/l10n: l10nupdate for 1.27.0-wmf.1 (duration: 08m 04s) |
[production] |