|
2019-01-17
ยง
|
| 16:28 |
<fsero> |
uncordoned kubernetes1001 |
[production] |
| 16:27 |
<fsero@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=kubernetes1001.eqiad.wmnet |
[production] |
| 16:19 |
<moritzm> |
rebooting roentgenium (failoid node in eqiad) to enable SSBD-enabled qemu |
[production] |
| 16:18 |
<cmjohnson1> |
ps1-a2-eqiad removing redundant power from side A to replace blown fuse |
[production] |
| 16:16 |
<moritzm> |
rebooting tureis (failoid node in codfw) to enable SSBD-enabled qemu |
[production] |
| 15:12 |
<moritzm> |
rebooting archiva1001 (archiva.wikimedia.org) to enable SSBD-enabled qemu |
[production] |
| 14:49 |
<moritzm> |
rebooting darmstadtium (docker registry) to enable SSBD-enabled qemu |
[production] |
| 14:36 |
<jbond42> |
rolling out update for debdeploy 0.0.99.6-1 -> 0.0.99.7-1 T207845 |
[production] |
| 14:24 |
<anomie> |
Restarting migrateActors.php on s3 |
[production] |
| 14:19 |
<marostegui> |
Drop empty frimpressions database from m2 - T213973 |
[production] |
| 14:04 |
<vgutierrez> |
running ipvsadm -D -t 10.2.2.29:1968 in lvs1016 - T214041 |
[production] |
| 14:03 |
<vgutierrez> |
running ipvsadm -D -t 10.2.2.29:1968 in lvs1006 - T214041 |
[production] |
| 14:01 |
<gehel> |
pooling maps1004 (first time after stretch upgrade) - T198622 |
[production] |
| 13:46 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=no; selector: dc=.*,service=.*,cluster=kubernetes,name=kubernetes1001.eqiad.wmnet |
[production] |
| 13:38 |
<gehel> |
starting upgrade to stretch for maps1003 - T198622 |
[production] |
| 12:59 |
<addshore> |
swat done! |
[production] |
| 12:58 |
<fsero@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=kubernetes1001.eqiad.wmnet |
[production] |
| 12:58 |
<addshore@deploy1001> |
Synchronized php-1.33.0-wmf.13/extensions/Wikibase/view/resources/jquery/wikibase/jquery.wikibase.badgeselector.js: T213998 Fix js type error when adding badges to items (duration: 00m 53s) |
[production] |
| 12:53 |
<dcausse@deploy1001> |
Synchronized wmf-config/CirrusSearch-production.php: T210381: [cirrus] Enable CirrusSearchCrossClusterSearch (duration: 00m 51s) |
[production] |
| 12:46 |
<dcausse@deploy1001> |
Synchronized php-1.33.0-wmf.13/extensions/UploadWizard/: T214007: Don't reuse existing input object (duration: 00m 53s) |
[production] |
| 12:41 |
<gtirloni> |
imported nfsd-ldap_1.2+deb9u1 in stretch-wikimedia (T209527) |
[production] |
| 12:41 |
<fsero> |
poweroff kubernetes1001 - T213859 |
[production] |
| 12:40 |
<dcausse@deploy1001> |
Synchronized php-1.33.0-wmf.13/extensions/CirrusSearch/: Hack around cross cluster search bug (duration: 00m 59s) |
[production] |
| 12:34 |
<gehel> |
shutting down relforge1001 for PDU swap - T213859 |
[production] |
| 12:33 |
<akosiaris@deploy1001> |
Finished deploy [citoid/deploy@269c9c7]: (no justification provided) (duration: 00m 48s) |
[production] |
| 12:32 |
<akosiaris@deploy1001> |
Started deploy [citoid/deploy@269c9c7]: (no justification provided) |
[production] |
| 12:29 |
<dcausse@deploy1001> |
Synchronized php-1.33.0-wmf.12/extensions/CirrusSearch/: Hack around cross cluster search bug (duration: 01m 00s) |
[production] |
| 12:25 |
<godog> |
poweroff restbase1010 / restbase1011 before A3 maint - T213859 |
[production] |
| 12:19 |
<jynus> |
killing migrateActors.php --wiki=ptwiki on mwmaint, was using outdated db config T188327 |
[production] |
| 12:17 |
<jijiki> |
poweroff rdb1005.eqiad.wmnet before A3 maint - T213859 |
[production] |
| 12:11 |
<godog> |
poweroff ms-be1019 / ms-be1044 / ms-be1045 before A2 maint - T213748 |
[production] |
| 12:09 |
<mvolz@deploy1001> |
scap-helm zotero finished |
[production] |
| 12:09 |
<mvolz@deploy1001> |
scap-helm zotero cluster codfw completed |
[production] |
| 12:09 |
<mvolz@deploy1001> |
scap-helm zotero upgrade production -f zotero-values-codfw.yaml stable/zotero [namespace: zotero, clusters: codfw] |
[production] |
| 12:08 |
<elukey> |
stop mariadb and shutdown db1107 to ease rack a3 maintenance |
[production] |
| 12:04 |
<mvolz@deploy1001> |
scap-helm zotero finished |
[production] |
| 12:04 |
<mvolz@deploy1001> |
scap-helm zotero cluster eqiad completed |
[production] |
| 12:04 |
<mvolz@deploy1001> |
scap-helm zotero upgrade production -f zotero-values-eqiad.yaml stable/zotero [namespace: zotero, clusters: eqiad] |
[production] |
| 11:56 |
<mvolz@deploy1001> |
scap-helm zotero finished |
[production] |
| 11:56 |
<mvolz@deploy1001> |
scap-helm zotero cluster staging completed |
[production] |
| 11:56 |
<mvolz@deploy1001> |
scap-helm zotero upgrade staging -f zotero-values-staging.yaml --version=0.0.1 stable/zotero [namespace: zotero, clusters: staging] |
[production] |
| 11:55 |
<arturo> |
T209527 copy nfsd-ldap between jessie-wikimedia and stretch-wikimedia in reprepro. It will require a rebuild though bc updated build-deps/deps |
[production] |
| 11:55 |
<mvolz@deploy1001> |
scap-helm zotero upgrade staging -f zotero-values-staging.yaml stable/zotero [namespace: zotero, clusters: staging] |
[production] |
| 11:43 |
<marostegui> |
Poweroff db1082 db1081 db1080 db1079 db1075 db1074 es1012 es1011 - T213748 |
[production] |
| 11:36 |
<mvolz@deploy1001> |
scap-helm zotero finished |
[production] |
| 11:36 |
<mvolz@deploy1001> |
scap-helm zotero cluster codfw completed |
[production] |
| 11:36 |
<mvolz@deploy1001> |
scap-helm zotero upgrade production -f zotero-values-codfw.yaml stable/zotero [namespace: zotero, clusters: codfw] |
[production] |
| 11:16 |
<onimisionipe> |
shutdown elastic103[0-5] to prepare for T213859 |
[production] |
| 11:09 |
<elukey> |
stop eventlogging on eventlog1002 and eventlogging replication on db1108 as prep step for db1107 maintenance |
[production] |
| 10:55 |
<marostegui> |
Lag will be generated on labs due to maintenance on sanitarium db masters |
[production] |