|
2017-12-21
§
|
| 09:30 |
<elukey> |
restart zookeeper on conf100[2,3] for jvm updates - T179943 |
[production] |
| 09:22 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1100 - T161294 (duration: 00m 51s) |
[production] |
| 09:20 |
<elukey> |
restart zookeeper on conf1001 for jvm updates - T179943 |
[production] |
| 08:51 |
<elukey> |
run kafka preferred-replica-election after maintenance of kafka1023 (fully bootstrapped now) |
[production] |
| 08:35 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1100 - T161294 (duration: 00m 51s) |
[production] |
| 08:34 |
<marostegui> |
Stop replication in sync on db1100 and dbstore1002 - T161294 |
[production] |
| 08:23 |
<elukey> |
repool mw1277 after investigation |
[production] |
| 07:37 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Slowly repool db1100- T161294 (duration: 00m 52s) |
[production] |
| 07:21 |
<marostegui> |
Upgrade MariaDB on db1100 |
[production] |
| 07:16 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1109 and db1096:3315 - T161294 (duration: 00m 51s) |
[production] |
| 06:55 |
<_joe_> |
restarting hhvm on mw1231 and mw1208 |
[production] |
| 06:50 |
<marostegui> |
Stop replication in sync on dbstore1002 - db1100 - T161294 |
[production] |
| 06:42 |
<marostegui> |
Stop replication in sync on db1100 - db2052 - T161294 |
[production] |
| 06:36 |
<marostegui> |
Remove some old files in dbstore1001:/srv/tmp to address the WARNING alert |
[production] |
| 06:35 |
<marostegui> |
Stop replication in sync db1100 and db1071 - T161294 |
[production] |
| 06:33 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1109 - T161294 (duration: 00m 51s) |
[production] |
| 03:59 |
<mutante> |
mw1315 kill and restart hhvm | mw1312 stop and start hhvm |
[production] |
| 03:55 |
<mutante> |
mw1290 kill and restart hhvm | mw1230 stop and start hhvm |
[production] |
| 02:20 |
<l10nupdate@tin> |
scap sync-l10n completed (1.31.0-wmf.12) (duration: 05m 31s) |
[production] |
| 01:16 |
<eileen> |
update CiviCRM civicrm revision changed from 9d6ba74f57 to ffa9d7fc7a, config revision is da6fa4cce9 |
[production] |
|
2017-12-20
§
|
| 23:26 |
<twentyafterfour> |
restarting apache on phab1001 to deploy a hotfix for T144184 |
[production] |
| 21:42 |
<mepps> |
updated dash from 114131713e to b01458b260 |
[production] |
| 21:20 |
<otto@tin> |
Finished deploy [analytics/refinery@548dad7]: deploying refinery v0.0.56 with JsonRefine fixes to allow Popups schema to be refined. This is a no-op for everything else (duration: 04m 51s) |
[production] |
| 21:15 |
<otto@tin> |
Started deploy [analytics/refinery@548dad7]: deploying refinery v0.0.56 with JsonRefine fixes to allow Popups schema to be refined. This is a no-op for everything else |
[production] |
| 20:31 |
<ebernhardson> |
T183053 update elasticsearch settings for wikidatawiki_content on codfw to use: index.refresh_interval=5s |
[production] |
| 20:18 |
<XioNoX> |
remove local-as from cr2-esams IX4 |
[production] |
| 19:46 |
<XioNoX> |
remove local-as from cr2-esams IX6 |
[production] |
| 17:57 |
<_joe_> |
depooling mw1277 for further investigation |
[production] |
| 17:51 |
<demon@tin> |
Synchronized wmf-config/InitialiseSettings.php: T172875 (second try, forgot to pull first (duration: 00m 51s) |
[production] |
| 17:48 |
<elukey> |
new mw jobrunner in production (mw1334) - T165519 |
[production] |
| 17:47 |
<demon@tin> |
Synchronized wmf-config/InitialiseSettings.php: T172875 (duration: 00m 51s) |
[production] |
| 17:46 |
<demon@tin> |
Synchronized wmf-config/Wikibase-production.php: T180614 (duration: 00m 51s) |
[production] |
| 17:43 |
<elukey> |
restart zookeeper on conf2003 for jvm updates - T179943 |
[production] |
| 17:42 |
<elukey> |
restart hhvm on mw1316 |
[production] |
| 17:38 |
<demon@tin> |
Synchronized wmf-config/InitialiseSettings.php: sandbox link on Atikamekw 'pedia (duration: 00m 52s) |
[production] |
| 17:38 |
<elukey> |
restart hhvm on mw1234 |
[production] |
| 17:32 |
<elukey> |
restart zookeeper on conf2002 for jvm updates - T179943 |
[production] |
| 17:20 |
<demon@tin> |
Synchronized wmf-config/CommonSettings.php: more n0-0ps (duration: 00m 52s) |
[production] |
| 17:16 |
<demon@tin> |
Synchronized multiversion/submodules.json: no-op (duration: 00m 51s) |
[production] |
| 17:09 |
<demon@tin> |
Synchronized README: noop (duration: 00m 51s) |
[production] |
| 16:27 |
<ema> |
lvs1003: stop pybal, clean ipvs services, start pybal |
[production] |
| 16:25 |
<ema> |
lvs1006: stop pybal, clean ipvs services, start pybal |
[production] |
| 15:54 |
<moritzm> |
rolling restart of scb* hosts in eqiad to pick up openssl update |
[production] |
| 15:47 |
<elukey@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=mw1334.eqiad.wmnet |
[production] |
| 15:38 |
<moritzm> |
rolling restart of remaining scb* hosts in codfw to pick up openssl update |
[production] |
| 14:26 |
<ema> |
start pybal on lvs2003 |
[production] |
| 14:24 |
<ema> |
stop pybal on lvs2003, clean IPVS table after traffic failover to get rid of trendingedits `TCP 10.2.1.9:6699 wrr` |
[production] |
| 14:14 |
<moritzm> |
upgrading openssl on wdqs (along with system service restarts) |
[production] |
| 14:13 |
<ema> |
bounce pybal on lvs2006 and clean IPVS table |
[production] |
| 14:06 |
<elukey> |
temporarily shutdown kafka on kafka1023 to move some topic partitions on different disk partition (disk space usage alerts) |
[production] |