|
2016-10-28
§
|
| 20:42 |
<bd808> |
Sending Tool Labs survey reminder emails from silver (T147336) |
[production] |
| 20:42 |
<yuvipanda> |
stop all user containers |
[tools.paws] |
| 20:15 |
<chasemp> |
restart prometheus service on tools-prometheus-01 to see if that wakes it up |
[tools] |
| 20:06 |
<yuvipanda> |
restart kube-apiserver again, ran into too many open file handles |
[tools] |
| 20:02 |
<bd808> |
Restarted bot that had crashed and wasn't self-starting due to syntax error in config |
[tools.stashbot] |
| 20:02 |
<Krenair> |
It got killed again... restarted |
[tools.stewardbots] |
| 20:02 |
<Krenair> |
I forgot to log this earlier: Found the bot was down, started the bot |
[tools.stewardbots] |
| 19:24 |
<yurik> |
deployed kartotherian https://gerrit.wikimedia.org/r/#/c/318575/ - caching is still broken |
[production] |
| 17:15 |
<mutante> |
contint1001 - removed php5-* packages (https://puppet-compiler.wmflabs.org/4502/contint1001.wikimedia.org/) |
[production] |
| 16:43 |
<hasharAway> |
gallium contint1001: apt-get remove --purge doxygen graphviz |
[production] |
| 15:58 |
<Yuvi[m]> |
restart k8s master, seems to have run out of fds |
[tools] |
| 15:44 |
<chasemp> |
toolschecker seems to have come up wonky, restarting service |
[production] |
| 15:43 |
<chasemp> |
restart toolschecker service on 01 and 02 |
[tools] |
| 15:23 |
<hashar> |
Restarted nodepool |
[production] |
| 15:09 |
<andrewbogott> |
rebooting labservices1001 |
[production] |
| 15:02 |
<andrewbogott> |
rebooting labnet1001 |
[production] |
| 14:56 |
<moritzm> |
upgrading openjdk-8/cassandra restart on restbase staging hosts |
[production] |
| 14:38 |
<moritzm> |
various reboots of multatuli for systemd tests |
[production] |
| 13:47 |
<moritzm> |
uploaded firejail 0.9.44 to carbon |
[production] |
| 13:42 |
<hoo@tin> |
Synchronized wmf-config/Wikibase-labs.php: For consistency (duration: 00m 46s) |
[production] |
| 13:04 |
<elukey> |
oozie firewall rules changed - nowonly the analytics network is allowed |
[analytics] |
| 12:42 |
<jynus> |
restarting and upgrading labsdb1004 |
[production] |
| 10:46 |
<moritzm> |
migrating nodes from ganeti1002 for kernel reboot (earlier entry was a typo) |
[production] |
| 10:46 |
<moritzm> |
migrating nodes from ganeti1003 for kernel reboot |
[production] |
| 10:28 |
<moritzm> |
migrating nodes from ganeti1003 for kernel reboot |
[production] |
| 10:25 |
<ema> |
upgrading python-varnishapi to v50.18 on all v4 cache hosts |
[production] |
| 10:00 |
<moritzm> |
migrating nodes from ganeti1004 for kernel reboot |
[production] |
| 09:39 |
<jynus> |
stopping slave on mariadb labsdb1005 for labsdb1004 reimporting |
[production] |
| 09:24 |
<hashar@tin> |
Synchronized /srv/mediawiki-staging/php-1.28.0-wmf.23/extensions/CirrusSearch: https://gerrit.wikimedia.org/r/#/c/318505/ for T149254 (fix log spam/fatal/warnings) (duration: 00m 56s) |
[production] |
| 09:20 |
<hashar> |
Pulling CirrusSearch patch https://gerrit.wikimedia.org/r/#/c/318505/ on mw1099 for T149254 (fix log spam/fatal/warnings) |
[production] |
| 09:10 |
<moritzm> |
rebooting pool counters in codfw for kernel update |
[production] |
| 09:06 |
<marostegui> |
Deploying schema change s1.enwiki - only codfw - T147166 |
[production] |
| 08:01 |
<jynus> |
applying schema change (imagelinks) to s3 wikis T139090 |
[production] |
| 07:17 |
<moritzm> |
installing PHP security updates on jessie |
[production] |
| 02:32 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Fri Oct 28 02:32:31 UTC 2016 (duration 5m 12s) |
[production] |
| 02:27 |
<l10nupdate@tin> |
scap sync-l10n completed (1.28.0-wmf.23) (duration: 09m 07s) |
[production] |
| 01:32 |
<eileen1> |
update civicrm from 31bea5b36fb22792472990672a49e8dea637546c to 56eadabf705b3d035e11bb9fd3478457c159e40d |
[production] |
| 01:18 |
<bd808> |
All bots shutdown. Stashbot is now handling !log messages in #countervandalism, #wikimedia-analytics, #wikimedia-fundraising, #wikimedia-labs, #wikimedia-operations, and #wikimedia-releng |
[tools.morebots] |
| 01:17 |
<bd808> |
now handling !log messages in #countervandalism, #wikimedia-analytics, #wikimedia-fundraising, #wikimedia-labs, #wikimedia-operations, and #wikimedia-releng |
[tools.stashbot] |
| 01:17 |
<bd808> |
Is LDAP happy yet? |
[tools.stashbot] |
| 00:20 |
<bd808> |
Testing logging to SAL via stashbot |
[production] |
| 00:19 |
<bd808> |
Testing logging to mw.o SAL via stashbot |
[analytics] |
| 00:18 |
<bd808> |
Testing logging to wikitech SAL via stashbot |
[cvn] |