|
2017-09-18
§
|
| 17:42 |
<smalyshev@tin> |
Finished deploy [wdqs/wdqs@ecdbd0d]: Deploying Blazegraph fixes and category scripts for WDQS (duration: 00m 21s) |
[production] |
| 17:42 |
<smalyshev@tin> |
Started deploy [wdqs/wdqs@ecdbd0d]: Deploying Blazegraph fixes and category scripts for WDQS |
[production] |
| 17:26 |
<demon@tin> |
Synchronized wmf-config/ProductionServices.php: no-op/comment fix (duration: 00m 45s) |
[production] |
| 16:53 |
<elukey> |
removed https://gerrit.wikimedia.org/r/#/c/377753/ from the git cherry-picks in operations/puppet on puppetmaster02 |
[releng] |
| 16:46 |
<jynus> |
shuting down db1100 T175973 |
[production] |
| 16:40 |
<reedy@tin> |
Synchronized php-1.30.0-wmf.18/maintenance/populateIpChanges.php: perf improvements T175962 (duration: 00m 46s) |
[production] |
| 16:05 |
<bblack> |
cp1063 - backend restart, mailbox lag |
[production] |
| 15:38 |
<bblack> |
cp1072 - varnish backend restart, mailbox lag |
[production] |
| 15:28 |
<bblack> |
cp1074 - backend restart for mailbox lag |
[production] |
| 15:25 |
<bblack> |
cp1050 - backend restart for mailbox lahg |
[production] |
| 14:27 |
<reedy@tin> |
Synchronized php-1.30.0-wmf.18/includes/filerepo/file/LocalFile.php: T175444 (duration: 00m 47s) |
[production] |
| 13:58 |
<JeanFred> |
Killed `update_monuments` job as it had been stuck for 3 days on the `Update monuments_all table` step. |
[tools.heritage] |
| 13:29 |
<ppchelko@tin> |
Finished deploy [cpjobqueue/deploy@2c422f5]: Annotate the job event with pipeline property (duration: 00m 29s) |
[production] |
| 13:28 |
<ppchelko@tin> |
Started deploy [cpjobqueue/deploy@2c422f5]: Annotate the job event with pipeline property |
[production] |
| 13:25 |
<hashar@tin> |
Synchronized wmf-config/InitialiseSettings.php: Meta(Talk)Namespace configuration for be.wiktionary - T175950 (duration: 00m 46s) |
[production] |
| 13:18 |
<hashar@tin> |
Synchronized wmf-config/InitialiseSettings.php: pagePreviews: Stop A/B test on enwiki and dewiki - T176068 (duration: 00m 45s) |
[production] |
| 13:10 |
<hashar@tin> |
Synchronized php-1.30.0-wmf.18/extensions/BetaFeatures: Temporary log all the executions of the update job. - T175637 (duration: 00m 46s) |
[production] |
| 13:09 |
<hashar@tin> |
Synchronized wmf-config: New 'abusefilter-helper' configuration for en.wikipedia - T175684 (duration: 00m 49s) |
[production] |
| 12:59 |
<moritzm> |
installing libxen updates |
[production] |
| 12:36 |
<moritzm> |
installing tomcat8 security updates |
[production] |
| 12:12 |
<Amir1> |
set eswiki labeling campaign as completed (T131963) |
[wikilabels] |
| 10:40 |
<ema> |
cp1099 - backend restart, mailbox lag |
[production] |
| 06:42 |
<moritzm> |
installing freexl security updates |
[production] |
| 06:18 |
<TimStarling> |
testing EtcdConfig in beta cluster |
[production] |
| 05:40 |
<tstarling@tin> |
Synchronized wmf-config: just for consistency, should have no effect (gerrit 375108) (duration: 00m 49s) |
[production] |
| 02:36 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Mon Sep 18 02:36:50 UTC 2017 (duration 7m 6s) |
[production] |
| 02:29 |
<l10nupdate@tin> |
scap sync-l10n completed (1.30.0-wmf.18) (duration: 08m 04s) |
[production] |
| 00:43 |
<Nettrom> |
Converted all database tables to binary character set |
[suggestbot] |
|
2017-09-17
§
|
| 22:36 |
<Lokal_Profil> |
Service down again ("backend is overloaded" in error.log). Tried another webservice restart |
[tools.heritage] |
| 18:59 |
<addshore> |
Reloading Zuul to deploy archiving of 2 extensions |
[releng] |
| 18:28 |
<JeanFred> |
Deploy latest from Git master: b3c3ab0 (T174871) |
[tools.heritage] |
| 18:28 |
<JeanFred> |
Restarted the webservice − Yarl notified us around 10 hours ago that API was inaccessible. `webservice restart` fixed the issue. |
[tools.heritage] |
| 12:49 |
<_joe_> |
taking a full debug dump of mw1288 after depooling it |
[production] |
| 12:40 |
<_joe_> |
restarting hhvm on some api appservers, to ease the cpu overlock |
[production] |
| 09:46 |
<elukey> |
restart varnish backend on cp1052 - recurrent mailbox lag |
[production] |
| 08:11 |
<elukey> |
restart varnish backend on cp1053 - recurrent mailbox lag |
[production] |