|
2016-11-23
§
|
| 17:36 |
<marostegui> |
Stopping MySQL on db2070 for maintenance - https://phabricator.wikimedia.org/T149553 |
[production] |
| 16:24 |
<marostegui> |
Setting offline disk [32:4] on db1053 - looks like it is causing repl issues |
[production] |
| 16:01 |
<marostegui> |
Stopping replication db2070 for maintenance - T149553 |
[production] |
| 15:50 |
<dcausse> |
elastic@eqiad: ruwiki reindex done (T148344) |
[production] |
| 14:37 |
<dcausse> |
elastic@eqiad: reindexing ruwiki from terbium, logs in ~dcausse/bm25_reindex/cirrus_log (T148344) |
[production] |
| 14:33 |
<jynus> |
rebooting, upgrading db1092 while it is depooled for maintenance |
[production] |
| 14:31 |
<marostegui> |
Stopping replication db1095 (not pooled) - maintenance - T150960 |
[production] |
| 11:48 |
<_joe_> |
uploaded calico/kube-policy-controller:0.5.0 to the docker registry |
[production] |
| 10:24 |
<marostegui> |
Stopping replication on the following m3 hosts for maintenance - db1048, dbstore1002 (m3 instance), db2012 - T151384 |
[production] |
| 10:23 |
<jynus> |
stopping replication to dbstore1001 to change its masters |
[production] |
| 07:46 |
<marostegui> |
Stopping MySQL db2070 for maintenance - T149553 |
[production] |
| 07:29 |
<marostegui> |
Stopping replication on db1095 (depooled) for maintenance - T150960 |
[production] |
| 07:14 |
<marostegui> |
Stopping replication on db1052 (depooled) for maintenance - T150960 |
[production] |
| 03:20 |
<papaul> |
prometheus200[3-4] signing puppet certs, salt-key, initial run |
[production] |
| 02:33 |
<l10nupdate@tin> |
scap sync-l10n completed (1.29.0-wmf.3) (duration: 14m 13s) |
[production] |
| 02:04 |
<mutante> |
depooled mw2092 because it had I/O errors, dev sda |
[production] |
| 02:03 |
<dzahn@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=mw2092.codfw.wmnet |
[production] |
| 01:47 |
<Krenair> |
mw2092 seems broken |
[production] |
| 01:44 |
<krenair@tin> |
Synchronized php-1.29.0-wmf.3/extensions/VisualEditor/modules/ve-mw: https://gerrit.wikimedia.org/r/323080 and https://gerrit.wikimedia.org/r/323103 (duration: 00m 49s) |
[production] |
| 01:13 |
<bd808> |
Updated striker to c546f4c (T151409) |
[production] |
| 00:04 |
<maxsem@tin> |
Synchronized wmf-config/CommonSettings-labs.php: https://gerrit.wikimedia.org/r/#/c/323078/ (duration: 00m 49s) |
[production] |
|
2016-11-22
§
|
| 23:02 |
<reedy@tin> |
Synchronized wmf-config/InitialiseSettings-labs.php: EmailAuth to beta T151015 (duration: 00m 51s) |
[production] |
| 23:00 |
<reedy@tin> |
Synchronized wmf-config/CommonSettings-labs.php: EmailAuth to beta T151015 (duration: 00m 57s) |
[production] |
| 22:59 |
<reedy@tin> |
Synchronized wmf-config/extension-list-labs: EmailAuth to beta T151015 (duration: 00m 55s) |
[production] |
| 22:37 |
<ejegg> |
updated payments-wiki from 6412a22f5ff1bd342736a6f3536818bd2c00549a to f8ca94201a3f69ee8176f4984f1caa410ac90c49 |
[production] |
| 21:31 |
<cwd> |
updated payments from 84b035ed72b9e3deb0089023777c400f514a6de5 to 6412a22f5ff1bd342736a6f3536818bd2c00549a |
[production] |
| 19:58 |
<cwd> |
updated payments wiki from ac14126ab3a4913f987e47190e636da9fe664d9f to 84b035ed72b9e3deb0089023777c400f514a6de5 |
[production] |
| 19:54 |
<thcipriani@tin> |
Synchronized debug.json: SWAT: [[gerrit:322929|debug.json: update eqiad debug hosts]] (duration: 00m 49s) |
[production] |
| 19:49 |
<ottomata> |
restarting pybal on lvs2003 and lvs2006 for eventstreams in codfw |
[production] |
| 19:48 |
<godog> |
set thumbor access for temp containers - T150760 |
[production] |
| 19:26 |
<thcipriani@tin> |
Synchronized portals: SWAT: [[gerrit:322942|Bumping wikipedia.org portal to master]] (T128546) (duration: 00m 56s) |
[production] |
| 19:25 |
<thcipriani@tin> |
Synchronized portals/prod/wikipedia.org/assets: SWAT: [[gerrit:322942|Bumping wikipedia.org portal to master]] (T128546) (duration: 00m 53s) |
[production] |
| 19:20 |
<jynus> |
rebooting es2019 for upgrade |
[production] |
| 19:17 |
<thcipriani@tin> |
Synchronized wmf-config/CirrusSearch-production.php: SWAT: [[gerrit:322900|[cirrus] Increase interwiki loadtest to 75%]] (T149740) (duration: 00m 55s) |
[production] |
| 18:53 |
<jynus> |
trying schema change on db1057 (enwiki.page) T69223 |
[production] |
| 18:50 |
<jynus> |
trying schema change on db1082 (wikidatawiki.page) T69223 |
[production] |
| 18:17 |
<mobrovac> |
restbase deploy end of 9c7822d |
[production] |
| 17:56 |
<mobrovac> |
restbase deploy start of 9c7822d |
[production] |
| 17:47 |
<jynus> |
performing schema change on db1094 (metawiki.page) T69223 |
[production] |
| 17:46 |
<godog> |
swift eqiad-prod: ms-be1027 to weight 1000 T136631 |
[production] |
| 17:39 |
<jynus> |
performing schema change on db1076 (enwiktionary.page) T69223 |
[production] |
| 17:35 |
<jynus> |
performing schema change on db1075 (page) T69223 |
[production] |
| 17:31 |
<jynus> |
performing schema change on db1078 (page) T69223 |
[production] |
| 17:21 |
<gehel> |
re-enabling alerts for maps-test* servers |
[production] |
| 16:51 |
<bd808> |
Testing safesubst: log message recording on wiki |
[production] |
| 16:46 |
<bblack> |
roll back to globalsign R3-based intermediate for unified complete and confirmed on all hosts |
[production] |
| 16:30 |
<bblack> |
disabling puppet on caches to do post-merge fixup on chain certs for https://gerrit.wikimedia.org/r/#/c/322913/ |
[production] |
| 16:15 |
<cmjohnson1> |
relocating dbprox1010/1011 to rack c5 |
[production] |
| 16:11 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1052 - T150960 (duration: 00m 49s) |
[production] |
| 15:19 |
<mobrovac> |
scb in codfw restarting all services to pick up the new firejail |
[production] |