3401-3450 of 10000 results (54ms)
2017-09-11 §
21:45 <awight@tin> Finished deploy [ores/deploy@42c5663]: Try ORES filehandle fix on new cluster (duration: 13m 47s) [production]
21:41 <bblack@neodymium> conftool action : set/pooled=yes; selector: name=cp4025.* [production]
21:31 <awight@tin> Started deploy [ores/deploy@42c5663]: Try ORES filehandle fix on new cluster [production]
21:03 <bblack@neodymium> conftool action : set/pooled=yes; selector: name=cp4023.* [production]
20:13 <demon@tin> Pruned MediaWiki: 1.30.0-wmf.13 (duration: 02m 49s) [production]
19:11 <chasemp> adjust nodepool rate to 10 [production]
19:08 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool es1019 with low load (duration: 00m 46s) [production]
19:01 <mutante> restbase-dev1004:/srv# mv /home/eevans/cassandra-1502141526-pid13410.hprof /srv/eevans/ to free disk space [production]
18:52 <mutante> restbase - java[12418]: Error: Could not find or load main class org.wikimedia.cassandra.metrics.service.Service [production]
18:40 <niharika29@tin> Synchronized wmf-config/InitialiseSettings.php: Enable responsive reference columns on wiktionaries, wikivoyages and enwiki https://gerrit.wikimedia.org/r/#/c/376573/, https://gerrit.wikimedia.org/r/#/c/371630/ (duration: 00m 46s) [production]
18:33 <robh> firmware update on scs-a1-codfw and scs-c1-codfw has been complete and tested good T174475 [production]
18:29 <chasemp> bump nodepool rate to 15 and max-servers to 18 (no restart as it picks up config periodically) [production]
18:29 <robh> firmware update on scs-a1-codfw and scs-c1-codfw has been started, awaiting completion T174475 [production]
18:24 <robh> updating firmware on scs-a1-codfw and scs-c1-codfw [production]
18:10 <robh> scs-ulsfo has successfully updated firmware T174475 [production]
18:03 <robh> upgrading firmware on scs-ulsfo [production]
17:09 <gehel@tin> Finished deploy [wdqs/wdqs@177d20a]: (no justification provided) (duration: 02m 39s) [production]
17:07 <gehel> wdqs weekly deployment (logging and throttling fixes) [production]
17:06 <gehel@tin> Started deploy [wdqs/wdqs@177d20a]: (no justification provided) [production]
15:20 <bblack@neodymium> conftool action : set/pooled=yes; selector: name=cp4022.* [production]
15:20 <bblack@neodymium> conftool action : set/pooled=yes; selector: name=cp4028.* [production]
14:40 <godog> roll-restart thumbor to apply https://gerrit.wikimedia.org/r/#/c/377264/ and upgrade to 1.4 - T173580 T174997 [production]
14:24 <hashar> tin.eqiad.wmnet: reverted patch "WLFilters: Respect default values" that got merged but left undeployed [production]
14:23 <hashar> tin.eqiad.wmnet: reverted all four mediawiki-config that got merged but left undeployed and rebased the workspace [production]
14:05 <hashar> European SWAT cancelled due to deploy infrastructure issue [production]
13:55 <hashar@tin> Synchronized wmf-config/InitialiseSettings.php: (no justification provided) (duration: 00m 27s) [production]
13:54 <hashar@tin> Synchronized wmf-config/InitialiseSettings.php: (no justification provided) (duration: 00m 27s) [production]
13:50 <hashar@tin> Synchronized wmf-config/InitialiseSettings.php: (no justification provided) (duration: 00m 28s) [production]
13:43 <hashar@tin> Synchronized wmf-config/InitialiseSettings.php: (no justification provided) (duration: 00m 28s) [production]
13:40 <hashar@tin> Synchronized static/images/project-logos/huwiktionary.png: Change logo for huwiktonary - T175483 (duration: 00m 28s) [production]
11:43 <moritzm> installing file/libmagic security updates (stretch-specific, does not affect older distros) [production]
10:30 <jynus> restarting mysql @ labsdb1001 [production]
09:40 <godog> roll-restart thumbor to apply changes for gif max animated area - T173580 [production]
09:39 <mobrovac@tin> Finished deploy [cpjobqueue/deploy@e73a10f]: Initial deploy of cpjobqueue - T175281 (duration: 00m 20s) [production]
09:39 <mobrovac@tin> Started deploy [cpjobqueue/deploy@e73a10f]: Initial deploy of cpjobqueue - T175281 [production]
08:44 <mobrovac@tin> Finished deploy [zotero/translators@a0c41c3]: Update translators to upstream e03695273 - T174992 (duration: 00m 07s) [production]
08:44 <mobrovac@tin> Started deploy [zotero/translators@a0c41c3]: Update translators to upstream e03695273 - T174992 [production]
08:16 <volans> reimage script tests continue on mc100[1-2] T166300 [production]
07:59 <moritzm> installing systemd updates from stretch point update [production]
07:41 <moritzm> installing remaining libonig security updates [production]
02:41 <l10nupdate@tin> ResourceLoader cache refresh completed at Mon Sep 11 02:41:43 UTC 2017 (duration 7m 0s) [production]
02:34 <l10nupdate@tin> scap sync-l10n completed (1.30.0-wmf.17) (duration: 08m 10s) [production]
2017-09-10 §
21:00 <bawolff> disabled Jforrester's gerrit account and flush sessions [production]
13:41 <elukey> restart Varnish backend on cp1073 (cache::upload) for mailbox expiry lag [production]
13:13 <elukey> restart cp1053's varnish backend for mailbox expiry lag and 503s - T175473 [production]
00:37 <chasemp> labnodepool1001:~# service nodepool restart [production]
00:36 <bd808> wmcs: purged rabbitmq ceilometer_notifications.* queues [production]
2017-09-09 §
23:42 <chasemp> labnodepool1001:~# service nodepool start [production]
23:06 <chasemp> freeswap && labcontrol1001:/home/rush# service rabbitmq-server restart [production]
22:59 <chasemp> restart nova-api and nova-network [production]