|
2017-09-20
§
|
| 11:03 |
<moritzm> |
rolling out new debdeploy release across the fleet |
[production] |
| 11:02 |
<mobrovac@tin> |
Finished deploy [cassandra/metrics-collector@d0169ee]: (no justification provided) (duration: 00m 19s) |
[production] |
| 11:02 |
<mobrovac@tin> |
Started deploy [cassandra/metrics-collector@d0169ee]: (no justification provided) |
[production] |
| 11:02 |
<ema> |
restarted varnish-be on cp4008 |
[production] |
| 11:02 |
<mobrovac@tin> |
Finished deploy [cassandra/metrics-collector@d0169ee]: (no justification provided) (duration: 00m 04s) |
[production] |
| 11:01 |
<mobrovac@tin> |
Started deploy [cassandra/metrics-collector@d0169ee]: (no justification provided) |
[production] |
| 11:01 |
<mobrovac@tin> |
Finished deploy [cassandra/metrics-collector@d0169ee]: (no justification provided) (duration: 00m 03s) |
[production] |
| 11:01 |
<mobrovac@tin> |
Started deploy [cassandra/metrics-collector@d0169ee]: (no justification provided) |
[production] |
| 11:00 |
<mobrovac@tin> |
Finished deploy [cassandra/metrics-collector@d0169ee]: (no justification provided) (duration: 00m 04s) |
[production] |
| 11:00 |
<mobrovac@tin> |
Started deploy [cassandra/metrics-collector@d0169ee]: (no justification provided) |
[production] |
| 09:55 |
<bblack> |
restarted varnish-be on cp3042 |
[production] |
| 09:29 |
<bblack> |
restarted varnish-be on cp1052 |
[production] |
| 09:23 |
<ema> |
restarted varnish-be on cp3043 |
[production] |
| 09:21 |
<ema> |
restarted varnish-be on cp3041 |
[production] |
| 09:19 |
<ema> |
restarted varnish-be on cp3032 |
[production] |
| 09:14 |
<ema> |
restarted varnish-be on cp3040 |
[production] |
| 08:42 |
<bblack> |
restarted varnish-be on cp1053 |
[production] |
| 08:41 |
<bblack> |
restarted varnish-be on cp1068 |
[production] |
| 08:40 |
<bblack> |
restarted varnish-be on cp1054 |
[production] |
| 08:40 |
<bblack> |
restarted varnish-be on cp1065 |
[production] |
| 07:11 |
<ema> |
cp3030 varnish-be restart due to 503s |
[production] |
| 03:16 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Wed Sep 20 03:16:25 UTC 2017 (duration 7m 31s) |
[production] |
| 03:08 |
<l10nupdate@tin> |
scap sync-l10n completed (1.30.0-wmf.19) (duration: 15m 57s) |
[production] |
| 02:31 |
<l10nupdate@tin> |
scap sync-l10n completed (1.30.0-wmf.18) (duration: 08m 06s) |
[production] |
| 00:55 |
<bblack> |
cp1066 - backend restart, mailbox lag, text |
[production] |
| 00:54 |
<bblack> |
cp4016 - backend restart, mailbox lag, text |
[production] |
|
2017-09-19
§
|
| 23:57 |
<thcipriani@tin> |
Synchronized php-1.30.0-wmf.18/extensions/VisualEditor/ApiVisualEditor.php: SWAT: [[gerrit:378990|ApiVisualEditor: Fix checkbox label message handling with Message objects]] T176249 (duration: 00m 49s) |
[production] |
| 23:56 |
<thcipriani@tin> |
Synchronized php-1.30.0-wmf.19/extensions/VisualEditor/ApiVisualEditor.php: SWAT: [[gerrit:378991|ApiVisualEditor: Fix checkbox label message handling with Message objects]] T176249 (duration: 00m 48s) |
[production] |
| 23:46 |
<thcipriani@tin> |
Synchronized php-1.30.0-wmf.18/extensions/WikimediaEvents/modules/ext.wikimediaEvents.humanSearchRelevance.js: SWAT: [[gerrit:379118|Javascript timestamps are in ms, not s]] T174106 (duration: 00m 48s) |
[production] |
| 23:45 |
<thcipriani@tin> |
Synchronized php-1.30.0-wmf.19/extensions/WikimediaEvents/modules/ext.wikimediaEvents.humanSearchRelevance.js: SWAT: [[gerrit:379119|Javascript timestamps are in ms, not s]] T174106 (duration: 00m 50s) |
[production] |
| 23:39 |
<thcipriani@tin> |
Synchronized php-1.30.0-wmf.18/includes/specials/SpecialRecentchangeslinked.php: SWAT: [[gerrit:378973|SpecialRecentchangeslinked: Unconditionally join on the page table]] T176228 (duration: 00m 49s) |
[production] |
| 23:36 |
<thcipriani@tin> |
Synchronized php-1.30.0-wmf.19/includes/specials/SpecialRecentchangeslinked.php: SWAT: [[gerrit:378973|SpecialRecentchangeslinked: Unconditionally join on the page table]] T176228 (duration: 00m 49s) |
[production] |
| 23:29 |
<thcipriani@tin> |
Synchronized php-1.30.0-wmf.18/includes/page/PageArchive.php: SWAT: [[gerrit:379133|Do not attempt to copy to ip_changes in PageArchive class]] (duration: 00m 49s) |
[production] |
| 23:27 |
<thcipriani@tin> |
Synchronized php-1.30.0-wmf.19/includes/page/PageArchive.php: SWAT: [[gerrit:379132|Do not attempt to copy to ip_changes in PageArchive class]] (duration: 00m 50s) |
[production] |
| 23:17 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:378802|Enable jQuery 3 on meta.wikimedia.org]] T124742 (duration: 00m 50s) |
[production] |
| 22:58 |
<eileen> |
manually running Omnirecipient.load from 2017-09-18 with accidentally low throttle setting |
[production] |
| 22:22 |
<mutante> |
gerrit2001 - stopped gerrit with init.d script. moved init.d script to /root, started with systemctl |
[production] |
| 22:21 |
<eileen> |
update civicrm from 9677cf7eac969d0f98492c1c91adfa8d33fefa63 to 0fb46767f0c86b3fc85c44e228fd7c1a7ae75e46 |
[production] |
| 22:15 |
<mutante> |
gerrit2001 /bin/sh /var/lib/gerrit2/review_site/bin/gerrit.sh start |
[production] |
| 22:02 |
<mutante> |
gerrit2001 - systemctl start gerrit |
[production] |
| 21:51 |
<volans> |
disabled puppet on labpuppetmaster1001, testing cumin T175712 |
[production] |
| 21:27 |
<MaxSem> |
on terbium: mwscript populateIpChanges.php --wiki=enwikivoyage --force |
[production] |
| 21:23 |
<bblack@neodymium> |
conftool action : set/pooled=yes; selector: cluster=cache_text,name=cp4008.ulsfo.wmnet |
[production] |
| 21:23 |
<bblack@neodymium> |
conftool action : set/pooled=yes; selector: cluster=cache_text,name=cp4016.ulsfo.wmnet |
[production] |
| 21:22 |
<bblack@neodymium> |
conftool action : set/pooled=yes; selector: cluster=cache_text,dc=eqiad,name=cp1066.* |
[production] |
| 21:18 |
<MaxSem> |
re-ran populateIpChanges.php on group0 wikis |
[production] |
| 21:15 |
<maxsem@tin> |
Synchronized php-1.30.0-wmf.19/maintenance/populateIpChanges.php: https://gerrit.wikimedia.org/r/#/c/379057/1 (duration: 00m 49s) |
[production] |
| 21:06 |
<ema> |
cp4009: varnish-be restart, 503 spike |
[production] |
| 20:04 |
<bblack@neodymium> |
conftool action : set/pooled=no; selector: cluster=cache_upload,name=cp4013.ulsfo.wmnet |
[production] |
| 20:03 |
<bblack@neodymium> |
conftool action : set/pooled=no; selector: cluster=cache_text,name=cp4016.ulsfo.wmnet |
[production] |