|
2019-01-17
ยง
|
| 14:03 |
<vgutierrez> |
running ipvsadm -D -t 10.2.2.29:1968 in lvs1006 - T214041 |
[production] |
| 14:01 |
<gehel> |
pooling maps1004 (first time after stretch upgrade) - T198622 |
[production] |
| 13:46 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=no; selector: dc=.*,service=.*,cluster=kubernetes,name=kubernetes1001.eqiad.wmnet |
[production] |
| 13:38 |
<gehel> |
starting upgrade to stretch for maps1003 - T198622 |
[production] |
| 12:59 |
<addshore> |
swat done! |
[production] |
| 12:58 |
<fsero@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=kubernetes1001.eqiad.wmnet |
[production] |
| 12:58 |
<addshore@deploy1001> |
Synchronized php-1.33.0-wmf.13/extensions/Wikibase/view/resources/jquery/wikibase/jquery.wikibase.badgeselector.js: T213998 Fix js type error when adding badges to items (duration: 00m 53s) |
[production] |
| 12:53 |
<dcausse@deploy1001> |
Synchronized wmf-config/CirrusSearch-production.php: T210381: [cirrus] Enable CirrusSearchCrossClusterSearch (duration: 00m 51s) |
[production] |
| 12:46 |
<dcausse@deploy1001> |
Synchronized php-1.33.0-wmf.13/extensions/UploadWizard/: T214007: Don't reuse existing input object (duration: 00m 53s) |
[production] |
| 12:41 |
<gtirloni> |
imported nfsd-ldap_1.2+deb9u1 in stretch-wikimedia (T209527) |
[production] |
| 12:41 |
<fsero> |
poweroff kubernetes1001 - T213859 |
[production] |
| 12:40 |
<dcausse@deploy1001> |
Synchronized php-1.33.0-wmf.13/extensions/CirrusSearch/: Hack around cross cluster search bug (duration: 00m 59s) |
[production] |
| 12:34 |
<gehel> |
shutting down relforge1001 for PDU swap - T213859 |
[production] |
| 12:33 |
<akosiaris@deploy1001> |
Finished deploy [citoid/deploy@269c9c7]: (no justification provided) (duration: 00m 48s) |
[production] |
| 12:32 |
<akosiaris@deploy1001> |
Started deploy [citoid/deploy@269c9c7]: (no justification provided) |
[production] |
| 12:29 |
<dcausse@deploy1001> |
Synchronized php-1.33.0-wmf.12/extensions/CirrusSearch/: Hack around cross cluster search bug (duration: 01m 00s) |
[production] |
| 12:25 |
<godog> |
poweroff restbase1010 / restbase1011 before A3 maint - T213859 |
[production] |
| 12:19 |
<jynus> |
killing migrateActors.php --wiki=ptwiki on mwmaint, was using outdated db config T188327 |
[production] |
| 12:17 |
<jijiki> |
poweroff rdb1005.eqiad.wmnet before A3 maint - T213859 |
[production] |
| 12:11 |
<godog> |
poweroff ms-be1019 / ms-be1044 / ms-be1045 before A2 maint - T213748 |
[production] |
| 12:09 |
<mvolz@deploy1001> |
scap-helm zotero finished |
[production] |
| 12:09 |
<mvolz@deploy1001> |
scap-helm zotero cluster codfw completed |
[production] |
| 12:09 |
<mvolz@deploy1001> |
scap-helm zotero upgrade production -f zotero-values-codfw.yaml stable/zotero [namespace: zotero, clusters: codfw] |
[production] |
| 12:08 |
<elukey> |
stop mariadb and shutdown db1107 to ease rack a3 maintenance |
[production] |
| 12:04 |
<mvolz@deploy1001> |
scap-helm zotero finished |
[production] |
| 12:04 |
<mvolz@deploy1001> |
scap-helm zotero cluster eqiad completed |
[production] |
| 12:04 |
<mvolz@deploy1001> |
scap-helm zotero upgrade production -f zotero-values-eqiad.yaml stable/zotero [namespace: zotero, clusters: eqiad] |
[production] |
| 11:56 |
<mvolz@deploy1001> |
scap-helm zotero finished |
[production] |
| 11:56 |
<mvolz@deploy1001> |
scap-helm zotero cluster staging completed |
[production] |
| 11:56 |
<mvolz@deploy1001> |
scap-helm zotero upgrade staging -f zotero-values-staging.yaml --version=0.0.1 stable/zotero [namespace: zotero, clusters: staging] |
[production] |
| 11:55 |
<arturo> |
T209527 copy nfsd-ldap between jessie-wikimedia and stretch-wikimedia in reprepro. It will require a rebuild though bc updated build-deps/deps |
[production] |
| 11:55 |
<mvolz@deploy1001> |
scap-helm zotero upgrade staging -f zotero-values-staging.yaml stable/zotero [namespace: zotero, clusters: staging] |
[production] |
| 11:43 |
<marostegui> |
Poweroff db1082 db1081 db1080 db1079 db1075 db1074 es1012 es1011 - T213748 |
[production] |
| 11:36 |
<mvolz@deploy1001> |
scap-helm zotero finished |
[production] |
| 11:36 |
<mvolz@deploy1001> |
scap-helm zotero cluster codfw completed |
[production] |
| 11:36 |
<mvolz@deploy1001> |
scap-helm zotero upgrade production -f zotero-values-codfw.yaml stable/zotero [namespace: zotero, clusters: codfw] |
[production] |
| 11:16 |
<onimisionipe> |
shutdown elastic103[0-5] to prepare for T213859 |
[production] |
| 11:09 |
<elukey> |
stop eventlogging on eventlog1002 and eventlogging replication on db1108 as prep step for db1107 maintenance |
[production] |
| 10:55 |
<marostegui> |
Lag will be generated on labs due to maintenance on sanitarium db masters |
[production] |
| 10:54 |
<marostegui> |
Stop MySQL on db1082 db1081 db1080 db1079 db1075 db1074 es1012 es1011 - T213748 |
[production] |
| 10:54 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool DBs on A2 rack T213748 (duration: 00m 54s) |
[production] |
| 10:39 |
<moritzm> |
installing libcaca security updates |
[production] |
| 10:30 |
<arturo> |
T213859 icinga downtime cloudservices1004 for 1 day |
[production] |
| 10:29 |
<moritzm> |
installing ruby-loofah security updates |
[production] |
| 10:09 |
<marostegui> |
Stop MySQL on db1103:3312 and db1103:3314, also poweroff the server - T213859 |
[production] |
| 10:08 |
<moritzm> |
installing krb5 security updates on trusty |
[production] |
| 10:04 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1103 - T213859 (duration: 00m 53s) |
[production] |
| 09:59 |
<marostegui> |
Poweroff dbproxy1001 dbproxy1002 dbproxy1003 for a3 maintenance - T213859 |
[production] |
| 09:25 |
<marostegui> |
Poweroff dbstore1003 for hw maintenance T213859 |
[production] |
| 09:24 |
<moritzm> |
power off graphite1003 for later hw maintenance (T213859) |
[production] |