|
2018-01-31
§
|
| 18:46 |
<robh@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=cp4024.ulsfo.wmnet |
[production] |
| 18:45 |
<robh@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=cp4023.ulsfo.wmnet |
[production] |
| 18:45 |
<robh@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=cp4022.ulsfo.wmnet |
[production] |
| 18:45 |
<robh@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=cp4021.ulsfo.wmnet |
[production] |
| 18:40 |
<robh> |
putting all ulsfo servers into maint mode |
[production] |
| 18:10 |
<XioNoX> |
deactivating bgp session from ulsfo to office |
[production] |
| 16:17 |
<marostegui> |
Optimize wbc_entity_usage on s6 on db1102 |
[production] |
| 16:15 |
<robh> |
depooling ulsfo for https://phabricator.wikimedia.org/T185228 |
[production] |
| 15:44 |
<akosiaris> |
reimage ores100{1..9} T171851 |
[production] |
| 14:37 |
<godog> |
bump prometheus global instance retention to 15 months - T160677 |
[production] |
| 12:25 |
<marostegui> |
Fix replication on labsdb1004 |
[production] |
| 09:32 |
<moritzm> |
rolling restart of thumbor/nginx to pick up libxml security update |
[production] |
| 08:21 |
<moritzm> |
installing clamav security update on fermium |
[production] |
| 07:55 |
<moritzm> |
installing libxml security updates |
[production] |
| 07:48 |
<marostegui> |
Stop MySQL on db1030 - T184397 |
[production] |
| 07:47 |
<marostegui> |
Remove db1030 from tendril - T184397 |
[production] |
| 07:13 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Remove db1030, will be decommissioned - T184397 (duration: 00m 56s) |
[production] |
| 07:10 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Remove db1030, will be decommissioned - T184397 (duration: 00m 57s) |
[production] |
| 07:08 |
<marostegui> |
Force BBU relearn on db1051 - T186049 |
[production] |
| 06:19 |
<elukey> |
restart varnish backend on cp4024 - failed fetches / 503s |
[production] |
| 02:23 |
<l10nupdate@tin> |
scap sync-l10n completed (1.31.0-wmf.17) (duration: 05m 46s) |
[production] |
| 01:51 |
<mutante> |
catchpoint: recycled gwicke's user and turned it into a user for volans, upgraded him to admin (T162857) |
[production] |
| 00:55 |
<krinkle@tin> |
Synchronized wmf-config: no-op, adding files for beta cluster (duration: 00m 59s) |
[production] |
| 00:51 |
<krinkle@tin> |
Synchronized wmf-config/profiler.php: no-op (comment-only) (duration: 00m 58s) |
[production] |
|
2018-01-30
§
|
| 21:39 |
<demon@tin> |
Synchronized docroot/noc/conf/open.dblist: (no justification provided) (duration: 00m 57s) |
[production] |
| 21:38 |
<demon@tin> |
Synchronized dblists/open.dblist: Adding open.dblist (duration: 00m 57s) |
[production] |
| 19:37 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1051 (duration: 00m 57s) |
[production] |
| 18:32 |
<mutante> |
powercyling amslvs4, to be reinstalled as bast3003 |
[production] |
| 18:08 |
<moritzm> |
installing PHP security updates |
[production] |
| 15:52 |
<moritzm> |
installing libxml2 security updates |
[production] |
| 15:35 |
<moritzm> |
installing libxcursor security updates |
[production] |
| 15:30 |
<jynus> |
stop and reimage es2018 |
[production] |
| 14:42 |
<moritzm> |
installing curl security updates on app server canaries along with HHVM restart |
[production] |
| 13:15 |
<moritzm> |
installing rsync security updates on trusty |
[production] |
| 12:15 |
<moritzm> |
installing libxtst updates |
[production] |
| 10:57 |
<moritzm> |
installing ffmpeg security updates |
[production] |
| 09:34 |
<moritzm> |
installing wireshark security updates |
[production] |
| 08:35 |
<moritzm> |
installing libxml2 security updates |
[production] |
| 02:23 |
<l10nupdate@tin> |
scap sync-l10n completed (1.31.0-wmf.17) (duration: 05m 58s) |
[production] |
| 00:31 |
<demon@tin> |
rebuilt and synchronized wikiversions files: not changing versions, testing something |
[production] |
|
2018-01-29
§
|
| 21:33 |
<arlolra> |
Updated Parsoid to 91854ff (T185643, T185346, T185385, T185267) |
[production] |
| 21:23 |
<arlolra@tin> |
Finished deploy [parsoid/deploy@cc1574b]: Updating Parsoid to 91854ff (duration: 08m 23s) |
[production] |
| 21:14 |
<arlolra@tin> |
Started deploy [parsoid/deploy@cc1574b]: Updating Parsoid to 91854ff |
[production] |
| 20:25 |
<_joe_> |
repooling mw1275, taking samples of apc metadata at intervals |
[production] |
| 20:19 |
<_joe_> |
depooling mw1275 to take an APC dump |
[production] |
| 20:15 |
<niharika29@tin> |
Synchronized docroot/noc/conf/: Sync removed dblist in https://gerrit.wikimedia.org/r/#/c/406632/ (duration: 00m 56s) |
[production] |
| 20:13 |
<niharika29@tin> |
Synchronized dblists/: Sync removed dblist in https://gerrit.wikimedia.org/r/#/c/406632/ (duration: 00m 56s) |
[production] |
| 19:58 |
<niharika29@tin> |
Synchronized wmf-config/CommonSettings.php: Revert upload rights patch https://gerrit.wikimedia.org/r/#/c/406632/ (duration: 00m 55s) |
[production] |
| 19:57 |
<niharika29@tin> |
Synchronized wmf-config/InitialiseSettings.php: Revert upload rights patch https://gerrit.wikimedia.org/r/#/c/406632/ (duration: 00m 56s) |
[production] |
| 19:51 |
<niharika29@tin> |
Synchronized php-1.31.0-wmf.17/extensions/Flow/: https://gerrit.wikimedia.org/r/#/c/406574/ and https://gerrit.wikimedia.org/r/#/c/406622/ (duration: 01m 13s) |
[production] |