|
2019-04-10
ยง
|
| 19:40 |
<twentyafterfour@deploy1001> |
rebuilt and synchronized wikiversions files: group1 wikis to 1.33.0-wmf.25 refs T206679 |
[production] |
| 19:28 |
<twentyafterfour@deploy1001> |
rebuilt and synchronized wikiversions files: group0 wikis to 1.33.0-wmf.25 refs T206679 |
[production] |
| 19:26 |
<XioNoX> |
enable sampling on cr2-eqiad external links, outbound |
[production] |
| 19:23 |
<bstorm_> |
T220646 shut down webservice because it is just in a restart loop and cannot run |
[tools.dplbot] |
| 19:17 |
<twentyafterfour@deploy1001> |
Pruned MediaWiki: 1.33.0-wmf.20 [keeping static files] (duration: 02m 18s) |
[production] |
| 19:14 |
<ejegg> |
updated fundraising CiviCRM from d0e44a9e51 to 24b968b1f9 |
[production] |
| 19:08 |
<twentyafterfour@deploy1001> |
Pruned MediaWiki: 1.33.0-wmf.19 [keeping static files] (duration: 02m 22s) |
[production] |
| 18:52 |
<bstorm_> |
depooled and rebooted tools-sgeexec-0929 because systemd was in a weird state |
[tools] |
| 18:46 |
<bstorm_> |
depooled and rebooted tools-sgewebgrid-lighttpd-0913 because high load was caused by ancient lsof processes |
[tools] |
| 17:44 |
<twentyafterfour@deploy1001> |
Pruned MediaWiki: 1.33.0-wmf.18 [keeping static files] (duration: 02m 22s) |
[production] |
| 16:58 |
<chaomodus> |
restarted nagios-nrpe-server on proton1001 (it died due to OOM) |
[production] |
| 16:51 |
<elukey@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=druid1004.eqiad.wmnet |
[production] |
| 16:01 |
<elukey> |
restart brokers on druid100[3-6] - locking after segments get deleted |
[production] |
| 15:46 |
<krinkle@deploy1001> |
Synchronized php-1.33.0-wmf.25/includes/parser/DateFormatter.php: Ib2b3fb315dc93b / T220563 (duration: 01m 00s) |
[production] |
| 15:28 |
<gilles@deploy1001> |
Synchronized php-1.33.0-wmf.25/includes/media/ThumbnailImage.php: T216499 Only apply high priority hint half the time (duration: 00m 59s) |
[production] |
| 15:26 |
<oblivian@deploy1001> |
Finished deploy [docker-pkg/deploy@605690c]: Upgrade to docker-pkg 2.0.0 everywhere (duration: 00m 21s) |
[production] |
| 15:26 |
<oblivian@deploy1001> |
Started deploy [docker-pkg/deploy@605690c]: Upgrade to docker-pkg 2.0.0 everywhere |
[production] |
| 15:24 |
<jforrester@deploy1001> |
Synchronized php-1.33.0-wmf.25/extensions/Score/: UBN Revert Score changes that broke VE T220465 (duration: 01m 01s) |
[production] |
| 15:19 |
<oblivian@deploy1001> |
Finished deploy [docker-pkg/deploy@605690c]: Upgrade to docker-pkg 2.0.0 (duration: 00m 13s) |
[production] |
| 15:19 |
<oblivian@deploy1001> |
Started deploy [docker-pkg/deploy@605690c]: Upgrade to docker-pkg 2.0.0 |
[production] |
| 15:01 |
<fsero> |
pooled back mwdebug200[1,2] T219989 |
[production] |
| 15:00 |
<fsero> |
repooling mwdebug2002 |
[production] |
| 15:00 |
<jijiki> |
Enable puppet on thumbor1001, switch back to nginx, pool thumbor1004 - T187765 |
[production] |
| 14:57 |
<fsero> |
repooling mwdebug2001 |
[production] |
| 14:49 |
<bstorm_> |
cleared E state from 5 queues |
[tools] |
| 14:48 |
<elukey> |
restart turnilo to pick up the new nodejs runtime |
[analytics] |
| 14:20 |
<hashar> |
CI processing was a bit slower than usual over the past couple hours or so. It should be slightly faster now T220606 |
[production] |
| 14:16 |
<hashar> |
contint1001: sudo -u zuul git -C /srv/zuul/git/mediawiki/core remote prune origin # T220606 |
[releng] |
| 14:13 |
<joal@deploy1001> |
Finished deploy [analytics/aqs/deploy@fc1d232]: Deploying per-page limits for druid-endpoints (duration: 14m 41s) |
[production] |
| 14:13 |
<hashar> |
contint2001: sudo -u zuul git -C /srv/zuul/git/mediawiki/core remote prune origin # T220606 |
[releng] |
| 13:58 |
<joal> |
Deploying AQS |
[analytics] |
| 13:58 |
<joal@deploy1001> |
Started deploy [analytics/aqs/deploy@fc1d232]: Deploying per-page limits for druid-endpoints |
[production] |
| 13:47 |
<fsero> |
resizing disk on mwdebug2002 T219989 |
[production] |
| 13:42 |
<anomie@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Setting actor migration to write-both/read-new on group0 (T188327) (duration: 01m 00s) |
[production] |
| 13:19 |
<marostegui> |
Deploy schema change on aawiki aawikibooks aawiktionary abwiki abwiktionary acewiki advisorswiki advisorywiki adywiki afwiki on x1 - T136427 |
[production] |
| 13:06 |
<arturo> |
T218126 hard reboot tools-sgeexec-0906 |
[tools] |
| 13:00 |
<Krinkle> |
Updating docker-pkg files on contint1001 for https://gerrit.wikimedia.org/r/502790 |
[releng] |
| 12:53 |
<arturo> |
force deleted job 1011036 because it was stucked (trying to depool exec node for T218126) |
[tools.vltools] |
| 12:48 |
<arturo> |
restart wikibugs following docs at https://www.mediawiki.org/wiki/Wikibugs#Restarting_wikibugs |
[tools.wikibugs] |
| 12:46 |
<Krinkle> |
Reloading Zuul to deploy https://gerrit.wikimedia.org/r/502786 |
[releng] |
| 12:42 |
<arturo> |
force deleted job 1045055 because it was stucked (trying to depool exec node for T218126) |
[tools.jarbot] |
| 12:41 |
<urandom> |
decommissioning cassandra-b, restbase2007 -- T208087 |
[production] |
| 12:40 |
<hashar> |
contint2001: stopped puppet and zuul-merger for debugging |
[production] |
| 12:40 |
<hashar> |
contint2001: stopped puppet and zuul-merger for debugging |
[releng] |
| 12:31 |
<arturo> |
T218126 hard reboot tools-sgeexec-0926 |
[tools] |
| 12:27 |
<arturo> |
T218126 hard reboot tools-sgeexec-0925 |
[tools] |
| 12:17 |
<jbond42> |
rolling security update of systemd on stretch systems |
[production] |
| 12:07 |
<Amir1> |
EU swat is done |
[production] |
| 12:07 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/CommonSettings.php: SWAT: Prep work for deploying UrlShortener extension (T108557), part II (duration: 01m 00s) |
[production] |
| 12:06 |
<arturo> |
T218126 hard reboot tools-sgeexec-0901 |
[tools] |