|
2017-06-15
§
|
| 07:48 |
<akosiaris> |
schedule 2 hours downtime for all citoid endpoints health on scb boxes |
[production] |
| 06:08 |
<marostegui> |
Deploy alter table s2 - labsdb1003 - T166205 |
[production] |
| 05:50 |
<marostegui> |
Deploy alter table s2 - db1018 - T166205 |
[production] |
| 05:49 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Add comments to db1018 current status - T166205 (duration: 00m 43s) |
[production] |
| 05:41 |
<marostegui> |
Deploy alter table s4 - dbstore1001 - T166206 |
[production] |
| 05:22 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1036 - T166205 (duration: 00m 44s) |
[production] |
| 02:50 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Thu Jun 15 02:50:16 UTC 2017 (duration 6m 48s) |
[production] |
| 02:43 |
<l10nupdate@tin> |
scap sync-l10n completed (1.30.0-wmf.5) (duration: 07m 34s) |
[production] |
| 02:26 |
<l10nupdate@tin> |
scap sync-l10n completed (1.30.0-wmf.4) (duration: 09m 15s) |
[production] |
| 01:17 |
<mutante> |
releases1001 - reinstalling with stretch |
[production] |
| 00:15 |
<mutante> |
dumpsdata1001 - was reported in icinga as CRIT systemdstate - reason was puppet service was failed with "Invalid value '"no"' for boolean parameter: daemonize" (it was ok on other hosts??). commented the option, stopped puppet, systemctl reset-failed - which made it recover (T165368) |
[production] |
| 00:02 |
<twentyafterfour> |
Deploying phabricator update (tagged release/2017-06-14/1) details: https://phabricator.wikimedia.org/project/view/2831/ |
[production] |
|
2017-06-14
§
|
| 23:55 |
<mutante> |
mwreleases: revoke puppet cert, delete salt key, remove from icinga. releases1001 still syncing disks for a while (50m), being created... T164030 |
[production] |
| 23:49 |
<mutante> |
ganeti: removed instance mwreleases1001, created new instance releases1001 with same parameters (2 VCPUS,4G memory, 1 x 128G disk) (T164030) |
[production] |
| 23:41 |
<mutante> |
mwreleases1001 - scheduled downtime, shutdown, kill VM, re-install as releases1001 (T164030) |
[production] |
| 23:33 |
<catrope@tin> |
Synchronized php-1.30.0-wmf.5/includes/: Unbreak watchlist highlighting T167922 (duration: 01m 30s) |
[production] |
| 23:30 |
<catrope@tin> |
Synchronized wmf-config/InitialiseSettings.php: Send search traffic back to eqiad T149006 (duration: 00m 44s) |
[production] |
| 23:23 |
<catrope@tin> |
Synchronized wmf-config/: ORES config cleanups (duration: 00m 46s) |
[production] |
| 22:43 |
<reedy@tin> |
Synchronized php-1.30.0-wmf.5/extensions/WikimediaMaintenance/addWiki.php: Remove accountaudit (duration: 00m 44s) |
[production] |
| 22:33 |
<reedy@tin> |
Synchronized wmf-config/InitialiseSettings.php: meta namespace talk for atjwiki (duration: 00m 44s) |
[production] |
| 21:36 |
<reedy@tin> |
Synchronized wmf-config/interwiki.php: Update interwiki map for atjwiki T167714 (duration: 00m 44s) |
[production] |
| 21:29 |
<reedy@tin> |
Synchronized langlist: Add atj T167714 (duration: 00m 43s) |
[production] |
| 21:29 |
<reedy@tin> |
Synchronized static/images/project-logos/: atjwiki T167714 (duration: 00m 43s) |
[production] |
| 21:27 |
<reedy@tin> |
Synchronized wmf-config/InitialiseSettings.php: atjwiki T167714 (duration: 00m 43s) |
[production] |
| 21:26 |
<reedy@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: Add atjwiki T167714 |
[production] |
| 21:25 |
<reedy@tin> |
Synchronized dblists/: add atjwiki T167714 (duration: 00m 42s) |
[production] |
| 21:22 |
<reedy@tin> |
Synchronized php-1.30.0-wmf.4/extensions/WikimediaMaintenance/addWiki.php: Remove accountaudit (duration: 00m 44s) |
[production] |
| 21:15 |
<reedy@terbium> |
scap aborted: (no justification provided) (duration: 00m 01s) |
[production] |
| 21:15 |
<reedy@terbium> |
Started scap: (no justification provided) |
[production] |
| 20:06 |
<reedy@tin> |
Synchronized wmf-config/CommonSettings-labs.php: noop (duration: 00m 43s) |
[production] |
| 20:05 |
<reedy@tin> |
Synchronized wmf-config/CommonSettings.php: CollaborationKit loader code (duration: 00m 43s) |
[production] |
| 20:03 |
<reedy@tin> |
Synchronized wmf-config/InitialiseSettings.php: Add CollaborationKit to testwiki (duration: 00m 44s) |
[production] |
| 19:47 |
<demon@tin> |
Synchronized wmf-config/CommonSettings-labs.php: no-op (duration: 00m 44s) |
[production] |
| 19:42 |
<Reedy> |
running mwscript initSiteStats.php srnwiki --update |
[production] |
| 19:37 |
<demon@tin> |
Synchronized wmf-config/extension-list-labs: No-op (duration: 00m 44s) |
[production] |
| 19:23 |
<demon@tin> |
Synchronized php: symlink bump (duration: 00m 43s) |
[production] |
| 19:17 |
<bblack> |
restart varnish backend on cp1074 |
[production] |
| 19:08 |
<demon@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group1 to wmf.5 |
[production] |
| 18:50 |
<otto@tin> |
Finished deploy [eventlogging/analytics@1ce446d]: (no justification provided) (duration: 00m 04s) |
[production] |
| 18:49 |
<otto@tin> |
Started deploy [eventlogging/analytics@1ce446d]: (no justification provided) |
[production] |
| 18:34 |
<niharika29@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/358007/ Add wmgBabelMainCategory for many languages (duration: 00m 43s) |
[production] |
| 18:32 |
<niharika29@tin> |
scap failed: average error rate on 1/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/3888cca979647b9381a7739b0bdbc88e for details) |
[production] |
| 18:25 |
<niharika29@tin> |
Synchronized wmf-config/InitialiseSettings.php: Sort wmgBabelMainCategory alphabetically https://gerrit.wikimedia.org/r/#/c/358006/ (duration: 00m 44s) |
[production] |
| 18:24 |
<jynus> |
reimporting data from pc1004 to db1096 |
[production] |
| 18:17 |
<niharika29@tin> |
Synchronized tests/cirrusTest.php: https://gerrit.wikimedia.org/r/#/c/358625/ Test elastic2020 does not fall out of cluster (duration: 00m 43s) |
[production] |
| 18:13 |
<niharika29@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/358625/ Test elastic2020 does not fall out of cluster (duration: 00m 44s) |
[production] |
| 18:06 |
<moritzm> |
installing unzip security updates |
[production] |
| 17:55 |
<moritzm> |
restarting hhvm on mw1261-mw1265 to pick up libxslt update |
[production] |
| 17:49 |
<moritzm> |
installing mongodb update from jessie point release on tungsten |
[production] |
| 16:03 |
<godog> |
point varnish upload in esams back to eqiad |
[production] |