|
2016-08-31
§
|
| 13:40 |
<chasemp> |
restart rabbitmq on labcontrol1001 |
[production] |
| 13:36 |
<bblack> |
repooling ulsfo traffic |
[production] |
| 13:25 |
<moritzm> |
installing libarchive security updates on jessie |
[production] |
| 13:13 |
<moritzm> |
reimaging mw2212-mw2215 to jessie |
[production] |
| 11:39 |
<godog> |
swift eqiad-prod: set weight for ms-be1021 sd[h-n] to 0 - T139767 |
[production] |
| 11:10 |
<gehel> |
restarting elasticsearch104[456] to take new rack configuration into account - T143685 |
[production] |
| 10:32 |
<akosiaris> |
starting a gradual deployment of wikidiff2 across the mw* fleet. T140443 |
[production] |
| 09:53 |
<mobrovac> |
change-prop deploying e999f517 |
[production] |
| 09:51 |
<elukey> |
restarting cassandra on aqs100[123] to verify performances after daemon restart |
[production] |
| 09:42 |
<moritzm> |
reimaging mw2108-mw2111 to jessie |
[production] |
| 09:18 |
<elukey> |
deleted /var/www/limn-public-data/caching on stat1001 to free space |
[analytics] |
| 09:10 |
<elukey> |
Moved stat1003:/srv/reportupdater/output/caching to /home/elukey/caching as temporary measure to free space on stat1001 |
[analytics] |
| 08:24 |
<akosiaris> |
drained ulsfo of traffic, it seems to be unstable currently |
[production] |
| 07:54 |
<elukey> |
removed /home/home dir from stat1001 to free space |
[analytics] |
| 07:52 |
<elukey> |
removed /home/home/home dir from stat1001 to free space |
[analytics] |
| 07:10 |
<moritzm> |
removed cached files on stat1001 (/var/www/limn-public-data/caching) after checking with joal, disk space on root partition was depleted |
[production] |
| 07:07 |
<jynus> |
removed db1027 from our dns |
[production] |
| 07:05 |
<moritzm> |
reimaging mw2104-mw2108 to jessie |
[production] |
| 04:28 |
<ejegg> |
updated civicrm from e1feb34ff688e230cced92c46e5c2a78e2b3cffa to d067c476da074afa70297c29e3d471743c110e3a |
[production] |
| 03:48 |
<ejegg> |
rolled back civicrm to e1feb34ff688e230cced92c46e5c2a78e2b3cffa |
[production] |
| 03:43 |
<ejegg> |
updated civicrm from e1feb34ff688e230cced92c46e5c2a78e2b3cffa to 8895f0e8ac9ad03cdf11b81542c17c5a39ca5cd8 |
[production] |
| 03:17 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Wed Aug 31 03:17:37 UTC 2016 (duration 7m 13s) |
[production] |
| 03:11 |
<krinkle@tin> |
Synchronized php-1.28.0-wmf.17/resources/src/mediawiki/mediawiki.js: Ie4e7464aa811 and I90eea4bfe (duration: 00m 47s) |
[production] |
| 03:10 |
<mwdeploy@tin> |
scap sync-l10n completed (1.28.0-wmf.17) (duration: 19m 02s) |
[production] |
| 02:57 |
<ejegg> |
rolled back civicrm to e1feb34ff688e230cced92c46e5c2a78e2b3cffa |
[production] |
| 02:53 |
<bd808> |
Cherry-picked https://gerrit.wikimedia.org/r/#/c/307333 for testing |
[tools.jouncebot] |
| 02:53 |
<ejegg> |
updated civicrm from e1feb34ff688e230cced92c46e5c2a78e2b3cffa to c0a7f45bd913ebd28e16c0d78b009a7af95209e9 |
[production] |
| 02:51 |
<ejegg> |
disabled fredge queue consumer |
[production] |
| 02:34 |
<mwdeploy@tin> |
scap sync-l10n completed (1.28.0-wmf.16) (duration: 12m 45s) |
[production] |
| 01:44 |
<Krinkle> |
Reloading Zuul to deploy https://gerrit.wikimedia.org/r/307670 |
[releng] |
| 00:06 |
<catrope@tin> |
Synchronized php-1.28.0-wmf.17/extensions/Flow: SWAT (duration: 01m 09s) |
[production] |
| 00:04 |
<catrope@tin> |
Synchronized php-1.28.0-wmf.17/extensions/Echo: SWAT (duration: 00m 53s) |
[production] |
|
2016-08-30
§
|
| 23:59 |
<catrope@tin> |
Synchronized wmf-config/CirrusSearch-common.php: Fix CirrusSearch BM25 A/B test similarity config (duration: 00m 48s) |
[production] |
| 23:59 |
<RoanKattouw> |
Whoops, I meant scap sync-file, not scap sync |
[production] |
| 23:59 |
<catrope@tin> |
scap aborted: wmf-config/CirrusSearch-common.php Fix CirrusSearch BM25 A/B test similarity config (duration: 00m 01s) |
[production] |
| 23:58 |
<catrope@tin> |
Started scap: wmf-config/CirrusSearch-common.php Fix CirrusSearch BM25 A/B test similarity config |
[production] |
| 23:58 |
<catrope@tin> |
Synchronized wmf-config/logging.php: Require ack of kafka logging (T135159) (duration: 00m 47s) |
[production] |
| 23:40 |
<ejegg> |
updated SmashPig from 4ba14a10518f80fe7e20fadc493d78c796c15921 to 7f9eb7475d194c67ff070b5d8bbc9fc6837b462f |
[production] |
| 23:35 |
<ejegg> |
rolled back SmashPig to 4ba14a10518f80fe7e20fadc493d78c796c15921 |
[production] |
| 23:34 |
<catrope@tin> |
Synchronized wmf-config: Enable Wikidata description taglines on all projects except top 6 wikis (T143344) (duration: 00m 54s) |
[production] |
| 23:32 |
<catrope@tin> |
Synchronized dblists/nowikidatadescriptiontaglines.dblist: (no message) (duration: 00m 53s) |
[production] |
| 23:31 |
<yuvipanda> |
cherry-picking https://gerrit.wikimedia.org/r/#/c/307656/ fixed puppet on the elasticsearch machines! |
[releng] |
| 23:30 |
<ejegg> |
updated SmashPig from 4ba14a10518f80fe7e20fadc493d78c796c15921 to b94325bea6158e80f194689e247b16239053baa1 |
[production] |
| 23:20 |
<Krenair> |
removed 'project_id' key from deployment-restbase02's metadata to fix compatibility with the new labsprojectfrommetadata code |
[releng] |
| 22:29 |
<yuvipanda> |
in lieu of blood sacrifice, restart puppetmaster on deployment-pupetmaster |
[releng] |
| 22:19 |
<ejegg> |
rolled back SmashPig to 4ba14a10518f80fe7e20fadc493d78c796c15921 |
[production] |
| 22:18 |
<mobrovac> |
change-prop deploying a87a61d |
[production] |
| 21:57 |
<ejegg> |
updated SmashPig from 4ba14a10518f80fe7e20fadc493d78c796c15921 to b94325bea6158e80f194689e247b16239053baa1 |
[production] |
| 21:43 |
<yuvipanda> |
use clush to fix puppet.conf of all clients, realize also accidentally set a client's puppet.conf for the server, recover server's old conf file from a cat in shell history, restore, breathe sigh of relief |
[releng] |
| 21:37 |
<yuvipanda> |
sudo takes like 15s each time, is there no god? |
[releng] |