1751-1800 of 10000 results (33ms)
2015-10-05 §
09:50 <_joe_> rebooted mw1153, soft lockup due to bnx2 failure [production]
09:50 <godog> roll-restart cassandra in restbase codfw [production]
09:18 <godog> roll-restart cassandra on restbase test cluster [production]
09:15 <godog> stop puppet on restbase and maps in preparation for https://gerrit.wikimedia.org/r/#/c/242896/1 [production]
08:07 <_joe_> upgrading HHVM on all API appservers [production]
05:33 <l10nupdate@tin> ResourceLoader cache refresh completed at Mon Oct 5 05:33:18 UTC 2015 (duration 33m 17s) [production]
02:33 <l10nupdate@tin> LocalisationUpdate completed (1.27.0-wmf.1) at 2015-10-05 02:33:57+00:00 [production]
02:29 <l10nupdate@tin> Synchronized php-1.27.0-wmf.1/cache/l10n: l10nupdate for 1.27.0-wmf.1 (duration: 08m 25s) [production]
2015-10-04 §
23:36 <ori@tin> Synchronized php-1.27.0-wmf.1/extensions/ContentTranslation/extension.json: 8c80ec1273: Updated mediawiki/core Project: mediawiki/extensions/ContentTranslation (duration: 00m 17s) [production]
05:13 <l10nupdate@tin> ResourceLoader cache refresh completed at Sun Oct 4 05:13:32 UTC 2015 (duration 13m 31s) [production]
02:31 <l10nupdate@tin> LocalisationUpdate completed (1.27.0-wmf.1) at 2015-10-04 02:31:56+00:00 [production]
02:27 <l10nupdate@tin> Synchronized php-1.27.0-wmf.1/cache/l10n: l10nupdate for 1.27.0-wmf.1 (duration: 08m 06s) [production]
2015-10-03 §
15:33 <jynus> stopping temporarily labsdb1004 mariadb to complete clone process [production]
09:38 <_joe_> rolling restarting all parsoids in eqiad [production]
09:14 <_joe_> restarting parsoid on wtp1021 [production]
05:28 <l10nupdate@tin> ResourceLoader cache refresh completed at Sat Oct 3 05:28:54 UTC 2015 (duration 28m 53s) [production]
03:12 <ori> done; graphite-web back up; url shortening will now work. [production]
03:11 <ori> shutting down graphite-web for brief sqlite database schema update [production]
02:36 <l10nupdate@tin> LocalisationUpdate completed (1.27.0-wmf.1) at 2015-10-03 02:36:33+00:00 [production]
02:31 <l10nupdate@tin> Synchronized php-1.27.0-wmf.1/cache/l10n: l10nupdate for 1.27.0-wmf.1 (duration: 08m 22s) [production]
2015-10-02 §
22:46 <mutante> holmium: apt-get clean for a little disk space - /var/log/designate/designate-mdns.log is more than half the size of / - needs logrotate [production]
21:33 <Krinkle> mwscript cleanupRemovedModules.php --wiki zhwiktionary [production]
21:21 <Krinkle> mwscript cleanupRemovedModules.php --wiki testwikidatawiki [production]
21:15 <Krinkle> mwscript cleanupRemovedModules.php --wiki dewiki [production]
21:15 <Krinkle> mwscript cleanupRemovedModules.php --wiki nlwiki [production]
21:15 <Krinkle> mwscript cleanupRemovedModules.php --wiki test2wiki [production]
21:06 <ori@tin> Synchronized wmf-config/CommonSettings.php: (no message) (duration: 00m 17s) [production]
18:39 <ottomata> kafka preferred-replica-election [production]
17:53 <ori@tin> Synchronized php-1.27.0-wmf.1/includes/resourceloader: I680f3fda66c5: Configure ResourceLoader-specific ObjectCache instance (duration: 00m 17s) [production]
17:53 <ottomata> rolling restart of all hadoop-yarn-nodemanagers to pick up python3 + spark fix [production]
17:12 <ori@tin> Synchronized wmf-config/CommonSettings.php: I8318fe892: Configure MultiWriteBagOStuff for ResourceLoader (duration: 00m 17s) [production]
16:29 <ori> deployed grafana 8e92884bae (with backport of upstream fb9f9548829f2d4cecf35cda933700e5c2fa1bd6) [production]
15:13 <ori@tin> Synchronized php-1.27.0-wmf.1/resources/src/mediawiki/mediawiki.js: I8029208: Don't clobber existing styles when adding more in IE9 (duration: 00m 17s) [production]
14:37 <jynus> providing extra grants to wiki db users for heartbeat monitoring [production]
14:32 <Coren> Change of NFS mount options in labs pushed - puppet may report failures to refresh the mounts (once) on instances; expected and harmless. [production]
11:03 <moritzm> installed rpcbind security updates on all Ubuntu servers which runs it (jessie was already updated, since the DSA was released earlier) [production]
10:53 <jynus> restarting HHVM on mw1130 [production]
08:45 <hashar> restarting Nodepool to take in account changes made to the logging configuration https://gerrit.wikimedia.org/r/#/c/240986/ [production]
06:07 <l10nupdate@tin> ResourceLoader cache refresh completed at Fri Oct 2 06:07:05 UTC 2015 (duration 7m 4s) [production]
02:42 <tstarling@tin> Synchronized php-1.27.0-wmf.1/extensions/ParsoidBatchAPI: stats (duration: 00m 17s) [production]
02:41 <l10nupdate@tin> LocalisationUpdate completed (1.27.0-wmf.1) at 2015-10-02 02:41:33+00:00 [production]
02:36 <l10nupdate@tin> Synchronized php-1.27.0-wmf.1/cache/l10n: l10nupdate for 1.27.0-wmf.1 (duration: 08m 04s) [production]
00:44 <ori@tin> Synchronized php-1.27.0-wmf.1/includes/resourceloader: I21bb3f08e7f and follow-ups (duration: 00m 18s) [production]
00:43 <ori@tin> Synchronized php-1.27.0-wmf.1/vendor: Add wikimedia/relpath 1.0.3 (duration: 00m 21s) [production]
2015-10-01 §
22:04 <RoanKattouw> Running FlowFixLinks.php on all wikis [production]
20:33 <subbu> deployed parsoid version 62971510b [production]
19:33 <twentyafterfour> re-deployed robots.txt patch and restarted apache on iridium (to expand the phabricator robots.txt) [production]
18:22 <ori@tin> Synchronized php-1.27.0-wmf.1/includes/resourceloader: Ic1d802ee2: ResourceLoader: cache minified user and site modules (duration: 00m 17s) [production]
18:04 <twentyafterfour@tin> rebuilt wikiversions.cdb and synchronized wikiversions files: wikipedia wikis to 1.27.0-wmf.1 [production]
16:40 <ottomata> brought analytics1049 back into hadoop after missing a disk since sept. 25th [production]