6251-6300 of 10000 results (52ms)
2016-12-26 §
19:38 <otto@tin> Finished deploy [eventstreams/deploy@648613a]: (no message) (duration: 00m 34s) [production]
19:38 <otto@tin> Starting deploy [eventstreams/deploy@648613a]: (no message) [production]
19:35 <otto@tin> Starting deploy [eventstreams/deploy@ed2e39c]: (no message) [production]
19:32 <otto@tin> Starting deploy [eventstreams/deploy@90934c3]: (no message) [production]
19:14 <otto@tin> Finished deploy [eventstreams/deploy@90934c3]: (no message) (duration: 00m 31s) [production]
19:13 <otto@tin> Starting deploy [eventstreams/deploy@90934c3]: (no message) [production]
19:13 <otto@tin> Finished deploy [eventstreams/deploy@581a5a1]: (no message) (duration: 00m 22s) [production]
19:13 <otto@tin> Starting deploy [eventstreams/deploy@581a5a1]: (no message) [production]
19:10 <otto@tin> Finished deploy [eventstreams/deploy@836b441]: (no message) (duration: 01m 16s) [production]
19:09 <otto@tin> Starting deploy [eventstreams/deploy@836b441]: (no message) [production]
19:08 <otto@tin> Finished deploy [eventstreams/deploy@e771863]: (no message) (duration: 01m 05s) [production]
19:07 <otto@tin> Starting deploy [eventstreams/deploy@e771863]: (no message) [production]
19:07 <otto@tin> Finished deploy [eventstreams/deploy@e771863]: log (duration: 00m 03s) [production]
19:07 <otto@tin> Starting deploy [eventstreams/deploy@e771863]: log [production]
19:07 <otto@tin> Finished deploy [eventstreams/deploy@e771863]: (no message) (duration: 00m 04s) [production]
19:07 <otto@tin> Starting deploy [eventstreams/deploy@e771863]: (no message) [production]
19:07 <otto@tin> Finished deploy [eventstreams/deploy@e771863]: (no message) (duration: 00m 10s) [production]
19:06 <otto@tin> Starting deploy [eventstreams/deploy@e771863]: (no message) [production]
2016-12-25 §
08:30 <jynus> restarting dbstore1002 mariadb, alive but unresponsive to queries do to long running queries saturating the service [production]
2016-12-23 §
21:29 <mutante> restarted apache on mw canary servers [production]
19:55 <mutante> cobalt - restarted apache [production]
19:46 <mutante> install libxml2 upgrade on bastions and mw-canary [production]
19:38 <mutante> install libxml2 upgrade on "misc-others" [production]
16:32 <robh> rebooted db2060 due to some kind of hw raid or xfs failure, wouldnt take input [production]
15:13 <jynus> testing labsdb-analytics automatic failover [production]
09:23 <jynus> stopping slave dbstore2001(s2) and db2034 for more table cloning [production]
07:56 <moritzm> installing Python security updates [production]
2016-12-22 §
23:16 <ejegg> updated fundraising dashboard from c2cccc058e3e7f929dca5c733c29a3054bca6712 to bec0077599737c774cc716851171365b38a8b02a [production]
22:46 <ejegg> updated fundraising dashboard from ea4305bc9b2c919d3f828ba542eb32b91b207af7 to c2cccc058e3e7f929dca5c733c29a3054bca6712 [production]
22:11 <thcipriani> disable l10nupdate cron for deployment freeze [production]
21:25 <ebernhardson> restarting elasticsearch (again) on relforge100[12] to test ltr plugin [production]
21:10 <RoanKattouw> Got lots of errors like 20:49:56 Unable to find remote tracking branch/tag for /srv/mediawiki-staging/php-1.29.0-wmf.6/extensions/ParserFunctions during this scap [production]
21:03 <catrope@tin> Finished scap: Sync Idf4618977f172 in the OAuth extension- (duration: 24m 16s) [production]
20:39 <catrope@tin> Started scap: Sync Idf4618977f172 in the OAuth extension- [production]
19:59 <ebernhardson> restarting elasticsearch (again) on relforge100[12] to test ltr plugin [production]
19:22 <gehel> restart wdqs-blazegraph and wdqs-updater on wdqs1001.eqiad.wmnet (suspicious load) [production]
19:18 <ebernhardson> restarting elasticsearch on relforge100[12] to test ltr plugin [production]
19:18 <jynus> stopping replication on dbstore2001(s2) and db2035 for enwiktionary.templatelinks reimport [production]
19:04 <godog> roll restart swift proxy on ms-fe1* to drain thumbor traffic [production]
15:39 <jynus> restart dbstore2001 to change buffer pool size, testing gerrit:328671 [production]
14:51 <elukey> restarting the yarn node manager java daemons on all the Hadoop worker nodes due to suspect memory leak [production]
14:14 <elukey> the previous entry is missing: "on analytics1032" [production]
14:13 <elukey> manually starting the yarn nodemanager after OOM [production]
13:41 <jynus> stopping db1035 (depooled) replication to perform maintenance to avoid disk alerts in the next 2 weeks [production]
10:02 <moritzm> installing c-ares security updates on trusty systems (jessie already fixed for quite a while) [production]
10:02 <moritzm> installing c-ares security updates [production]
09:02 <moritzm> installing tomcat security updates [production]
08:45 <moritzm> installing libav security updates on trusty systems [production]
08:18 <moritzm> installing Django security updates [production]
07:26 <elukey> created /var/log/squid3/access.log.1.gz on aluminum to fix cronspam - T132324 [production]