201-250 of 10000 results (21ms)
2015-09-23 §
13:56 <godog> force puppet run on restbase2001 to deploy new cassandra config [production]
13:28 <godog> reboot ms-be1012, xfs hosed [production]
13:22 <paravoid> upgrading cr1-codfw with newer junos [production]
07:43 <demon@tin> Synchronized wmf-config/CommonSettings.php: semver the special:version hook (duration: 00m 12s) [production]
03:05 <l10nupdate@tin> Synchronized php-1.26wmf24/cache/l10n: l10nupdate for 1.26wmf24 (duration: 10m 12s) [production]
02:38 <l10nupdate@tin> LocalisationUpdate completed (1.26wmf23) at 2015-09-23 02:38:44+00:00 [production]
02:35 <l10nupdate@tin> Synchronized php-1.26wmf23/cache/l10n: l10nupdate for 1.26wmf23 (duration: 06m 21s) [production]
00:56 <legoktm@tin> Synchronized php-1.26wmf24/extensions/Echo/Hooks.php: Remove duplicate 'MediaWiki' prefix from echo.unseen stats (duration: 00m 12s) [production]
00:03 <RoanKattouw> Running FlowFixLinks.php on testwiki [production]
2015-09-22 §
23:40 <mutante> renaming search mailing lists to discovery mailing lists [production]
23:35 <krenair@tin> Synchronized php-1.26wmf24/extensions/Echo: https://gerrit.wikimedia.org/r/#/c/240283/ and https://gerrit.wikimedia.org/r/#/c/240281/ (duration: 00m 13s) [production]
23:18 <krenair@tin> Synchronized wmf-config/abusefilter.php: https://gerrit.wikimedia.org/r/#/c/240278/ (duration: 00m 12s) [production]
23:16 <krenair@tin> Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/240259/ (duration: 00m 12s) [production]
23:14 <krenair@tin> Synchronized w/static/images/sul/wikimania.png: https://gerrit.wikimedia.org/r/#/c/239308/ (duration: 00m 11s) [production]
23:14 <krenair@tin> Synchronized w/static/images/sul/commons.png: https://gerrit.wikimedia.org/r/#/c/239308/ (duration: 00m 12s) [production]
22:43 <catrope@tin> Synchronized wmf-config/CommonSettings.php: Set $wgFlowMigrateReferenceWiki to false in production (duration: 00m 12s) [production]
22:38 <catrope@tin> Synchronized wmf-config/InitialiseSettings.php: Enable Flow opt-in on testwiki for testing (duration: 00m 12s) [production]
21:49 <chasemp> unban elastic1030 from T112559 [production]
21:33 <twentyafterfour@tin> rebuilt wikiversions.cdb and synchronized wikiversions files: group0 wikis to 1.26wmf24 [production]
21:13 <twentyafterfour@tin> Finished scap: Test 1.26wmf24 (duration: 50m 34s) [production]
20:44 <mutante> cancel backup job of bast1001 on helium because running low on disk [production]
20:22 <twentyafterfour@tin> Started scap: Test 1.26wmf24 [production]
16:50 <robh> all mw servers returned to puppet enabled, puppet swat window over [production]
16:23 <robh> re-enabled puppet on mw hosts, as both redirection changes are good [production]
16:14 <robh> re-enabling puppet on mw hosts, as the new patchset 239278 deployed and tested fine on a single host, deploying to rest [production]
16:04 <robh> disabling puppet across mw hosts for new configuration deployment [production]
15:46 <godog> running puppet on restbase2001 [production]
15:41 <godog> stop puppet on restbase2* pending codfw expansion [production]
14:42 <cmjohnson1> shutting down elastic1005 and elastic1030 to move around within the data center [production]
14:19 <bblack> starting slow restart of varnish + varnish-frontend daemon processes on global text, upload, and mobile clusters for shm_reclen (all randomly blended, no parallelism, ~5 minute spacing, will take ~9 hours - FEs will lose cache data, BEs will not) [production]
14:14 <chasemp> depool elastic nodes for T112559 [production]
11:18 <aude@tin> Synchronized php-1.26wmf23/extensions/Wikidata: Fix autocomment and change handling bugs (duration: 00m 21s) [production]
10:42 <aude@tin> Synchronized arbitraryaccess.dblist: Enable arbitrary access for Wikibooks (duration: 00m 12s) [production]
10:42 <aude@tin> Synchronized wmf-config/InitialiseSettings.php: Enable data access for Wikibooks - try again for snapshot hosts (duration: 00m 12s) [production]
10:35 <aude@tin> Synchronized wmf-config/InitialiseSettings.php: Enable data access for Wikibooks (duration: 01m 12s) [production]
10:17 <moritzm> enabled ferm on mw1152 (videoscaler) [production]
10:03 <godog> finished stressdisk on restbase200[123] no errors reported [production]
10:03 <moritzm> enabled ferm on mw1259 (videoscaler) [production]
04:35 <l10nupdate@tin> ResourceLoader cache refresh completed at Tue Sep 22 04:35:46 UTC 2015 (duration 35m 45s) [production]
02:22 <l10nupdate@tin> LocalisationUpdate completed (1.26wmf23) at 2015-09-22 02:22:56+00:00 [production]
02:19 <l10nupdate@tin> Synchronized php-1.26wmf23/cache/l10n: l10nupdate for 1.26wmf23 (duration: 06m 00s) [production]
01:53 <mutante> sodium - deleted salt key, revoked puppet cert, rm from icinga .. [production]
00:32 <ori> Disabled Puppet for 24h on hafnium and stopped ganglia-monitor. gmond was saturating CPU. [production]
2015-09-21 §
23:29 <krinkle@tin> Synchronized php-1.26wmf23/extensions/NavigationTiming/modules/ext.navigationTiming.js: T112593 (duration: 00m 14s) [production]
23:21 <krenair@tin> Synchronized php-1.26wmf22/extensions/Wikidata: https://gerrit.wikimedia.org/r/#/c/239828/ (duration: 00m 21s) [production]
23:07 <krenair@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/238357/ (duration: 00m 13s) [production]
22:26 <mutante> restarting gerrit for ssh config change [production]
20:41 <mdholloway> MobileApps deployed sha1 013044e [production]
20:39 <chasemp> banning elastic1005 for T112559 [production]
20:29 <subbu> deployed parsoid version 9984d221 [production]