|
2015-10-05
§
|
| 17:27 |
<gwicke> |
rolling restart of restbase cluster to rule out driver issues causing the increased p99 read lacenty |
[production] |
| 17:19 |
<robh> |
analytics1035 pegged out, ssh unresponsive and raid failures, and then fixed itself 5 minutes later |
[production] |
| 16:32 |
<legoktm> |
running backPopulateRenameQueueLogs.php ([[gerrit:237169]]) on metawiki |
[production] |
| 16:05 |
<hoo> |
Updated Wikidata's property suggester with data from today's json dump |
[production] |
| 15:28 |
<hashar> |
integration-slave-jessie-1001 ssh reacheable |
[releng] |
| 15:28 |
<hashar> |
integration-slave-jessie-1001 pass puppet again. Caused by a conflict with the 'zip' package, solved by cherry picking https://gerrit.wikimedia.org/r/#/c/243674/ |
[releng] |
| 15:21 |
<jzerebecki> |
reloading zuul for d944bbb..1272657 |
[releng] |
| 15:19 |
<thcipriani@tin> |
Synchronized php-1.27.0-wmf.1/extensions/Flow: SWAT: Fix exception on board and topic history pages [[gerrit:243337]] (duration: 00m 20s) |
[production] |
| 14:48 |
<hashar> |
integration-slave-jessie-1001 fails ssh auth with: error: AuthorizedKeysCommand /usr/sbin/ssh-key-ldap-lookup returned status 1 |
[releng] |
| 14:45 |
<hashar> |
rebooting integration-slave-jessie-1001.integration.eqiad.wmflabs , does not reply to ssh |
[releng] |
| 14:41 |
<hashar> |
puppet-lint Jenkins job is now strict and will -1 on errors as well as warnings https://gerrit.wikimedia.org/r/#/c/243185/ |
[production] |
| 14:34 |
<hashar> |
nodepool image-update wmflabs-eqiad ci-jessie-wikimedia |
[releng] |
| 13:45 |
<hashar> |
lets funk it https://soundcloud.com/professorkliq/wire-flashing-lights?in=professorkliq/sets/wire-and-flashing-lights-ep |
[releng] |
| 13:40 |
<hashar> |
stopping puppetmaster on integration. Out of memory |
[releng] |
| 10:25 |
<godog> |
roll-restart cassandra in restbase eqiad |
[production] |
| 09:58 |
<_joe_> |
installing the new HHVM package to appservers |
[production] |
| 09:50 |
<_joe_> |
rebooted mw1153, soft lockup due to bnx2 failure |
[production] |
| 09:50 |
<godog> |
roll-restart cassandra in restbase codfw |
[production] |
| 09:18 |
<godog> |
roll-restart cassandra on restbase test cluster |
[production] |
| 09:15 |
<godog> |
stop puppet on restbase and maps in preparation for https://gerrit.wikimedia.org/r/#/c/242896/1 |
[production] |
| 08:07 |
<_joe_> |
upgrading HHVM on all API appservers |
[production] |
| 05:33 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Mon Oct 5 05:33:18 UTC 2015 (duration 33m 17s) |
[production] |
| 02:33 |
<l10nupdate@tin> |
LocalisationUpdate completed (1.27.0-wmf.1) at 2015-10-05 02:33:57+00:00 |
[production] |
| 02:29 |
<l10nupdate@tin> |
Synchronized php-1.27.0-wmf.1/cache/l10n: l10nupdate for 1.27.0-wmf.1 (duration: 08m 25s) |
[production] |
|
2015-10-03
§
|
| 18:29 |
<jzerebecki> |
reloading zuul for 4aa5d22..d609dad |
[releng] |
| 15:33 |
<jynus> |
stopping temporarily labsdb1004 mariadb to complete clone process |
[production] |
| 09:38 |
<_joe_> |
rolling restarting all parsoids in eqiad |
[production] |
| 09:14 |
<_joe_> |
restarting parsoid on wtp1021 |
[production] |
| 05:28 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Sat Oct 3 05:28:54 UTC 2015 (duration 28m 53s) |
[production] |
| 03:12 |
<ori> |
done; graphite-web back up; url shortening will now work. |
[production] |
| 03:11 |
<ori> |
shutting down graphite-web for brief sqlite database schema update |
[production] |
| 02:36 |
<l10nupdate@tin> |
LocalisationUpdate completed (1.27.0-wmf.1) at 2015-10-03 02:36:33+00:00 |
[production] |
| 02:31 |
<l10nupdate@tin> |
Synchronized php-1.27.0-wmf.1/cache/l10n: l10nupdate for 1.27.0-wmf.1 (duration: 08m 22s) |
[production] |
| 01:05 |
<Krinkle> |
Clean up spurious remotes/origin/review/markahershberger/207722 branch in mediawiki/core |
[releng] |
|
2015-10-02
§
|
| 22:46 |
<mutante> |
holmium: apt-get clean for a little disk space - /var/log/designate/designate-mdns.log is more than half the size of / - needs logrotate |
[production] |
| 21:33 |
<Krinkle> |
mwscript cleanupRemovedModules.php --wiki zhwiktionary |
[production] |
| 21:21 |
<Krinkle> |
mwscript cleanupRemovedModules.php --wiki testwikidatawiki |
[production] |
| 21:15 |
<Krinkle> |
mwscript cleanupRemovedModules.php --wiki dewiki |
[production] |
| 21:15 |
<Krinkle> |
mwscript cleanupRemovedModules.php --wiki nlwiki |
[production] |
| 21:15 |
<Krinkle> |
mwscript cleanupRemovedModules.php --wiki test2wiki |
[production] |
| 21:06 |
<ori@tin> |
Synchronized wmf-config/CommonSettings.php: (no message) (duration: 00m 17s) |
[production] |
| 18:39 |
<ottomata> |
kafka preferred-replica-election |
[production] |
| 17:53 |
<ori@tin> |
Synchronized php-1.27.0-wmf.1/includes/resourceloader: I680f3fda66c5: Configure ResourceLoader-specific ObjectCache instance (duration: 00m 17s) |
[production] |
| 17:53 |
<ottomata> |
rolling restart of all hadoop-yarn-nodemanagers to pick up python3 + spark fix |
[production] |