|
2016-10-28
§
|
| 10:46 |
<moritzm> |
migrating nodes from ganeti1002 for kernel reboot (earlier entry was a typo) |
[production] |
| 10:46 |
<moritzm> |
migrating nodes from ganeti1003 for kernel reboot |
[production] |
| 10:28 |
<moritzm> |
migrating nodes from ganeti1003 for kernel reboot |
[production] |
| 10:25 |
<ema> |
upgrading python-varnishapi to v50.18 on all v4 cache hosts |
[production] |
| 10:00 |
<moritzm> |
migrating nodes from ganeti1004 for kernel reboot |
[production] |
| 09:39 |
<jynus> |
stopping slave on mariadb labsdb1005 for labsdb1004 reimporting |
[production] |
| 09:24 |
<hashar@tin> |
Synchronized /srv/mediawiki-staging/php-1.28.0-wmf.23/extensions/CirrusSearch: https://gerrit.wikimedia.org/r/#/c/318505/ for T149254 (fix log spam/fatal/warnings) (duration: 00m 56s) |
[production] |
| 09:20 |
<hashar> |
Pulling CirrusSearch patch https://gerrit.wikimedia.org/r/#/c/318505/ on mw1099 for T149254 (fix log spam/fatal/warnings) |
[production] |
| 09:10 |
<moritzm> |
rebooting pool counters in codfw for kernel update |
[production] |
| 09:06 |
<marostegui> |
Deploying schema change s1.enwiki - only codfw - T147166 |
[production] |
| 08:01 |
<jynus> |
applying schema change (imagelinks) to s3 wikis T139090 |
[production] |
| 07:17 |
<moritzm> |
installing PHP security updates on jessie |
[production] |
| 02:32 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Fri Oct 28 02:32:31 UTC 2016 (duration 5m 12s) |
[production] |
| 02:27 |
<l10nupdate@tin> |
scap sync-l10n completed (1.28.0-wmf.23) (duration: 09m 07s) |
[production] |
| 01:32 |
<eileen1> |
update civicrm from 31bea5b36fb22792472990672a49e8dea637546c to 56eadabf705b3d035e11bb9fd3478457c159e40d |
[production] |
| 00:20 |
<bd808> |
Testing logging to SAL via stashbot |
[production] |
|
2016-10-27
§
|
| 23:39 |
<yurik@tin> |
Synchronized php-1.28.0-wmf.23/extensions/Kartographer/modules/dialog/dialog.js: https://gerrit.wikimedia.org/r/#/c/318457/ (duration: 00m 47s) |
[production] |
| 22:08 |
<godog> |
"cassandra" graphite machines LV at 90% used, add 300G via lvresize |
[production] |
| 21:55 |
<yurik> |
deployed kartotherian |
[production] |
| 21:41 |
<yurik> |
about to deploy kartotherian update |
[production] |
| 21:10 |
<urandom> |
T133395: Altering mobileapps keyspaces to use time-windowed compaction |
[production] |
| 19:27 |
<twentyafterfour@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: all wikis to 1.28.0-wmf.23 |
[production] |
| 19:25 |
<twentyafterfour> |
Bumping all wikis to 1.28.0-wmf.23 refs T147517 |
[production] |
| 19:18 |
<ejegg> |
updated payments-wiki from df4c72dbd328307019a82449527dd13c84bf41ab to e86f23a371e75a1684de5c102c06d993ead660e0 |
[production] |
| 19:07 |
<maxsem@tin> |
Finished scap: https://gerrit.wikimedia.org/r/#/c/318343/ (duration: 37m 38s) |
[production] |
| 19:06 |
<ejegg> |
updated SmashPig from f5f49d79fac0887df78ddcc68a2f5ced0670c387 to 142e60bfe09982f9f86b7839cbf35d9e0e96b8d7 |
[production] |
| 18:29 |
<maxsem@tin> |
Started scap: https://gerrit.wikimedia.org/r/#/c/318343/ |
[production] |
| 18:26 |
<legoktm@tin> |
Synchronized php-1.28.0-wmf.23/includes/parser/Parser.php: Remove tracking category stuff that accidentally slipped into 61adc1e14 - T149310 (duration: 00m 46s) |
[production] |
| 18:14 |
<thcipriani@tin> |
Synchronized wmf-config/throttle.php: SWAT: [[gerrit:318293|Get rid of ip/IP tolerance for throttle rules (T131469)]] (duration: 00m 46s) |
[production] |
| 18:09 |
<gehel> |
wdqs deployment of latest GUI |
[production] |
| 17:54 |
<godog> |
upgrading prometheus to 1.2.1 in codfw/eqiad |
[production] |
| 16:56 |
<moritzm> |
uploaded gerrit 2.12.5 to apt.wikimedia.org |
[production] |
| 16:43 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: scb1003.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=scb', 'service=cxserver']) |
[production] |
| 16:43 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: mw1241.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=appserver', 'service=apache2']) |
[production] |
| 16:33 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=no; selector: mw1241.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=appserver', 'service=apache2']) |
[production] |
| 16:24 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=no; selector: scb1003.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=scb', 'service=cxserver']) |
[production] |
| 16:18 |
<hashar> |
Restarted Jenkins Gearman client due to a deadlock with the beta cluster jobs |
[production] |
| 15:26 |
<akosiaris> |
start confd on puppetmaster1001 and puppetmaster2001 |
[production] |
| 15:02 |
<akosiaris> |
disable puppet across the fleet for puppetmaster kernel upgrades |
[production] |
| 14:26 |
<moritzm> |
migrating nodes from ganeti2001 for kernel reboot |
[production] |
| 14:24 |
<moritzm> |
restarted ntp on ganeti2006 (stuck in XFAC state) |
[production] |
| 14:17 |
<moritzm> |
failover of ganeti2002 to new master node in codfw |
[production] |
| 13:59 |
<moritzm> |
migrating nodes from ganeti2002 for kernel reboot |
[production] |
| 13:42 |
<hashar> |
European SWAT completed |
[production] |
| 13:39 |
<moritzm> |
migrating nodes from ganeti2003 for kernel reboot |
[production] |
| 13:35 |
<hashar@tin> |
Synchronized php-1.28.0-wmf.23/extensions/CirrusSearch/includes/HTMLCompletionProfileSettings.php: Fix comp suggest pref page (duration: 00m 48s) |
[production] |
| 13:34 |
<gehel> |
maps / postgres replication checks in error after deployment of https://gerrit.wikimedia.org/r/#/c/315271/ (T147194) - replication is working, only check is failing - icinga is silenced |
[production] |
| 13:33 |
<gehel> |
postgres replication checks in error after deployment of https://gerrit.wikimedia.org/r/#/c/315271/ (T147194) - replication is working, only check is failing - icinga is silenced |
[production] |
| 13:32 |
<moritzm> |
migrating nodes from ganeti2004 for kernel reboot |
[production] |
| 13:17 |
<moritzm> |
migrating nodes from ganeti2005 for kernel reboot |
[production] |