2851-2900 of 10000 results (47ms)
2017-06-15 §
08:02 <moritzm> updating HHVM on terbium/wasat to 3.18 [production]
07:57 <akosiaris@tin> Finished deploy [citoid/deploy@ba0db9c]: Remove the bad PMCID test from spec (duration: 00m 38s) [production]
07:56 <akosiaris@tin> Started deploy [citoid/deploy@ba0db9c]: Remove the bad PMCID test from spec [production]
07:48 <akosiaris> schedule 2 hours downtime for all citoid endpoints health on scb boxes [production]
06:08 <marostegui> Deploy alter table s2 - labsdb1003 - T166205 [production]
05:50 <marostegui> Deploy alter table s2 - db1018 - T166205 [production]
05:49 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Add comments to db1018 current status - T166205 (duration: 00m 43s) [production]
05:41 <marostegui> Deploy alter table s4 - dbstore1001 - T166206 [production]
05:22 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1036 - T166205 (duration: 00m 44s) [production]
02:50 <l10nupdate@tin> ResourceLoader cache refresh completed at Thu Jun 15 02:50:16 UTC 2017 (duration 6m 48s) [production]
02:43 <l10nupdate@tin> scap sync-l10n completed (1.30.0-wmf.5) (duration: 07m 34s) [production]
02:26 <l10nupdate@tin> scap sync-l10n completed (1.30.0-wmf.4) (duration: 09m 15s) [production]
01:17 <mutante> releases1001 - reinstalling with stretch [production]
00:15 <mutante> dumpsdata1001 - was reported in icinga as CRIT systemdstate - reason was puppet service was failed with "Invalid value '"no"' for boolean parameter: daemonize" (it was ok on other hosts??). commented the option, stopped puppet, systemctl reset-failed - which made it recover (T165368) [production]
00:02 <twentyafterfour> Deploying phabricator update (tagged release/2017-06-14/1) details: https://phabricator.wikimedia.org/project/view/2831/ [production]
2017-06-14 §
23:55 <mutante> mwreleases: revoke puppet cert, delete salt key, remove from icinga. releases1001 still syncing disks for a while (50m), being created... T164030 [production]
23:49 <mutante> ganeti: removed instance mwreleases1001, created new instance releases1001 with same parameters (2 VCPUS,4G memory, 1 x 128G disk) (T164030) [production]
23:41 <mutante> mwreleases1001 - scheduled downtime, shutdown, kill VM, re-install as releases1001 (T164030) [production]
23:33 <catrope@tin> Synchronized php-1.30.0-wmf.5/includes/: Unbreak watchlist highlighting T167922 (duration: 01m 30s) [production]
23:30 <catrope@tin> Synchronized wmf-config/InitialiseSettings.php: Send search traffic back to eqiad T149006 (duration: 00m 44s) [production]
23:23 <catrope@tin> Synchronized wmf-config/: ORES config cleanups (duration: 00m 46s) [production]
22:43 <reedy@tin> Synchronized php-1.30.0-wmf.5/extensions/WikimediaMaintenance/addWiki.php: Remove accountaudit (duration: 00m 44s) [production]
22:33 <reedy@tin> Synchronized wmf-config/InitialiseSettings.php: meta namespace talk for atjwiki (duration: 00m 44s) [production]
21:36 <reedy@tin> Synchronized wmf-config/interwiki.php: Update interwiki map for atjwiki T167714 (duration: 00m 44s) [production]
21:29 <reedy@tin> Synchronized langlist: Add atj T167714 (duration: 00m 43s) [production]
21:29 <reedy@tin> Synchronized static/images/project-logos/: atjwiki T167714 (duration: 00m 43s) [production]
21:27 <reedy@tin> Synchronized wmf-config/InitialiseSettings.php: atjwiki T167714 (duration: 00m 43s) [production]
21:26 <reedy@tin> rebuilt wikiversions.php and synchronized wikiversions files: Add atjwiki T167714 [production]
21:25 <reedy@tin> Synchronized dblists/: add atjwiki T167714 (duration: 00m 42s) [production]
21:22 <reedy@tin> Synchronized php-1.30.0-wmf.4/extensions/WikimediaMaintenance/addWiki.php: Remove accountaudit (duration: 00m 44s) [production]
21:15 <reedy@terbium> scap aborted: (no justification provided) (duration: 00m 01s) [production]
21:15 <reedy@terbium> Started scap: (no justification provided) [production]
20:06 <reedy@tin> Synchronized wmf-config/CommonSettings-labs.php: noop (duration: 00m 43s) [production]
20:05 <reedy@tin> Synchronized wmf-config/CommonSettings.php: CollaborationKit loader code (duration: 00m 43s) [production]
20:03 <reedy@tin> Synchronized wmf-config/InitialiseSettings.php: Add CollaborationKit to testwiki (duration: 00m 44s) [production]
19:47 <demon@tin> Synchronized wmf-config/CommonSettings-labs.php: no-op (duration: 00m 44s) [production]
19:42 <Reedy> running mwscript initSiteStats.php srnwiki --update [production]
19:37 <demon@tin> Synchronized wmf-config/extension-list-labs: No-op (duration: 00m 44s) [production]
19:23 <demon@tin> Synchronized php: symlink bump (duration: 00m 43s) [production]
19:17 <bblack> restart varnish backend on cp1074 [production]
19:08 <demon@tin> rebuilt wikiversions.php and synchronized wikiversions files: group1 to wmf.5 [production]
18:50 <otto@tin> Finished deploy [eventlogging/analytics@1ce446d]: (no justification provided) (duration: 00m 04s) [production]
18:49 <otto@tin> Started deploy [eventlogging/analytics@1ce446d]: (no justification provided) [production]
18:34 <niharika29@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/358007/ Add wmgBabelMainCategory for many languages (duration: 00m 43s) [production]
18:32 <niharika29@tin> scap failed: average error rate on 1/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/3888cca979647b9381a7739b0bdbc88e for details) [production]
18:25 <niharika29@tin> Synchronized wmf-config/InitialiseSettings.php: Sort wmgBabelMainCategory alphabetically https://gerrit.wikimedia.org/r/#/c/358006/ (duration: 00m 44s) [production]
18:24 <jynus> reimporting data from pc1004 to db1096 [production]
18:17 <niharika29@tin> Synchronized tests/cirrusTest.php: https://gerrit.wikimedia.org/r/#/c/358625/ Test elastic2020 does not fall out of cluster (duration: 00m 43s) [production]
18:13 <niharika29@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/358625/ Test elastic2020 does not fall out of cluster (duration: 00m 44s) [production]
18:06 <moritzm> installing unzip security updates [production]