|
2018-11-08
ยง
|
| 17:24 |
<banyek> |
repooling labsdb1010 (T189158) |
[production] |
| 17:07 |
<godog> |
upload libfastjson 0.99.8-1~bpo9+1wmf1 version bump only |
[production] |
| 16:59 |
<akosiaris@deploy1001> |
scap-helm zotero finished |
[production] |
| 16:59 |
<akosiaris@deploy1001> |
scap-helm zotero cluster staging completed |
[production] |
| 16:59 |
<akosiaris@deploy1001> |
scap-helm zotero [namespace: zotero, clusters: staging] |
[production] |
| 16:50 |
<akosiaris@deploy1001> |
scap-helm zotero install --name alextest --set main_app.version=20181019165254-production --set monitoring.enable=true charts/zotero [namespace: zotero, clusters: staging] |
[production] |
| 16:50 |
<akosiaris@deploy1001> |
scap-helm zotero install --name alextest --set main_app.version=20181019165254-production --set monitoring.enable=true charts/zotero [namespace: zotero, clusters: staging] |
[production] |
| 16:29 |
<XioNoX> |
enable Zayo transit on cr3-ulsfo |
[production] |
| 15:42 |
<chasemp> |
disable /etc/logrotate.d/udp2log-mw for a bit on mwlog1001 |
[production] |
| 15:25 |
<Amir1> |
rolling restart of celery on ores nodes (T209060) |
[production] |
| 15:20 |
<akosiaris> |
'cd /srv/deployment/ores/deploy/submodules/wheels && sudo -u deploy-service git lfs pull' on all ores1* and ores2* hosts T209060 |
[production] |
| 15:07 |
<XioNoX> |
zeroize asw-c8-codfw (decom) |
[production] |
| 14:12 |
<moritzm> |
rebooting releases2001 for some tests with ssbd for KVM |
[production] |
| 13:52 |
<moritzm> |
installing postgres updates on labsdb1006/1007 |
[production] |
| 13:38 |
<jiji> |
Done reimaging rdb1006 - T206450 |
[production] |
| 13:37 |
<moritzm> |
draining ganeti2001 for reboot/kernel security update |
[production] |
| 13:36 |
<moritzm> |
failing over ganeti master in codfw from ganeti2001 to ganeti2003 |
[production] |
| 13:13 |
<godog> |
upload rsyslog 8.38.0-1~bpo9+1wmf1 to stretch-wikimedia, version bump only |
[production] |
| 13:07 |
<addshore@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Re-enable wmgUseTwoColConflict on dewiki - T205942 T208840 T209012 T209036 (duration: 00m 53s) |
[production] |
| 12:56 |
<akosiaris> |
increase weight of scb1001 for apertium to 99+% |
[production] |
| 12:56 |
<akosiaris@puppetmaster1001> |
conftool action : set/weight=3800; selector: dc=eqiad,service=apertium,cluster=scb,name=scb1001.* |
[production] |
| 12:53 |
<addshore@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Re-enable wmgUseTwoColConflict on group0 only T205942 T208840 T209012 T209036 (duration: 00m 54s) |
[production] |
| 12:52 |
<moritzm> |
draining ganeti2002 for reboot/kernel security update |
[production] |
| 12:41 |
<jiji> |
Shutdown and reimage rdb200[56] - T206450 |
[production] |
| 12:31 |
<moritzm> |
draining ganeti2003 for reboot/kernel security update |
[production] |
| 12:30 |
<zeljkof> |
EU SWAT finished |
[production] |
| 12:29 |
<zfilipin@deploy1001> |
Synchronized php-1.33.0-wmf.3/extensions/TwoColConflict: SWAT: [[gerrit:472175|Fix harmless edits turning into conflicts (T205942 T208840 T209012 T209036)]] (duration: 00m 55s) |
[production] |
| 12:19 |
<zfilipin@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:472134|Set AdvancedSearch to default on group0 wikis (T207641)]] (duration: 00m 55s) |
[production] |
| 12:18 |
<moritzm> |
draining ganeti2004 for reboot/kernel security update |
[production] |
| 11:57 |
<moritzm> |
draining ganeti2005 for reboot/kernel security update |
[production] |
| 11:51 |
<akosiaris> |
increase weight of scb1001 for apertium to 50% |
[production] |
| 11:50 |
<akosiaris@puppetmaster1001> |
conftool action : set/weight=38; selector: dc=eqiad,service=apertium,cluster=scb,name=scb1001.* |
[production] |
| 11:41 |
<moritzm> |
draining ganeti2006 for reboot/kernel security update |
[production] |
| 11:18 |
<moritzm> |
draining ganeti2007 for reboot/kernel security update |
[production] |
| 11:05 |
<moritzm> |
draining ganeti2008 for reboot/kernel security update |
[production] |
| 10:52 |
<jiji> |
Reimaging rdb1006 to stretch - T206450 |
[production] |
| 10:52 |
<addshore@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Disable wmgUseTwoColConflict everywhere T209012 T208840 T195724 (duration: 00m 58s) |
[production] |
| 10:26 |
<elukey> |
restart memcached on mc2029 (was depooled yesterday for network maintenance) |
[production] |
| 10:23 |
<jiji> |
restarting pdfrender on scb1003 |
[production] |
| 10:19 |
<volans> |
restarting pdfrender on scb1004 |
[production] |
| 10:18 |
<volans> |
restarting pdfrender on scb1002 |
[production] |
| 10:18 |
<_joe_> |
restarting pdfrender on scb1001 |
[production] |
| 10:02 |
<moritzm> |
installing ppp security updates on trusty |
[production] |
| 09:37 |
<godog> |
keep 2x not 3x copies of older (>15d) logstash elasticsearch indices |
[production] |
| 09:29 |
<moritzm> |
installing curl security updates |
[production] |
| 09:29 |
<godog> |
temporarily set elasticsearch logstash watermark to low:0.85 and high:0.9 |
[production] |
| 06:34 |
<bawolff@deploy1001> |
Synchronized php-1.33.0-wmf.3/extensions/OpenStackManager/special/SpecialNovaSudoer.php: T203885 (duration: 00m 54s) |
[production] |
| 05:30 |
<bawolff> |
deployed patch T208881 |
[production] |
| 01:18 |
<mutante> |
scb1004 - systemctl restart pdfrender (T174916) |
[production] |
| 00:43 |
<jforrester@deploy1001> |
Synchronized php-1.33.0-wmf.3/includes/resourceloader/ResourceLoader.php: ResourceLoader: Fail less hard when JSON serialization of config fails I673f59d93 (duration: 00m 53s) |
[production] |