|
2018-11-08
ยง
|
| 17:29 |
<banyek> |
depooling labsdb1009 (T189158) |
[production] |
| 17:24 |
<banyek> |
repooling labsdb1010 (T189158) |
[production] |
| 17:18 |
<gtirloni> |
cleaned up old tmp files on tools-exec-1406 |
[tools] |
| 17:07 |
<godog> |
upload libfastjson 0.99.8-1~bpo9+1wmf1 version bump only |
[production] |
| 16:59 |
<akosiaris@deploy1001> |
scap-helm zotero finished |
[production] |
| 16:59 |
<akosiaris@deploy1001> |
scap-helm zotero cluster staging completed |
[production] |
| 16:59 |
<akosiaris@deploy1001> |
scap-helm zotero [namespace: zotero, clusters: staging] |
[production] |
| 16:56 |
<gtirloni> |
cleaned up /tmp on tools-bastion-05 |
[tools] |
| 16:50 |
<akosiaris@deploy1001> |
scap-helm zotero install --name alextest --set main_app.version=20181019165254-production --set monitoring.enable=true charts/zotero [namespace: zotero, clusters: staging] |
[production] |
| 16:50 |
<akosiaris@deploy1001> |
scap-helm zotero install --name alextest --set main_app.version=20181019165254-production --set monitoring.enable=true charts/zotero [namespace: zotero, clusters: staging] |
[production] |
| 16:49 |
<gtirloni> |
stopped jobs due to long-standing high CPU usage |
[tools.pavlochembot] |
| 16:37 |
<gtirloni> |
re-enabled tools-webgrid-lighttpd-1424.tools.eqiad.wmflabs |
[tools] |
| 16:36 |
<gtirloni> |
re-enabled tools-webgrid-lighttpd-1414.tools.eqiad.wmflabs |
[tools] |
| 16:36 |
<gtirloni> |
re-enabled tools-webgrid-lighttpd-1408.tools.eqiad.wmflabs |
[tools] |
| 16:36 |
<gtirloni> |
re-enabled tools-webgrid-lighttpd-1403.tools.eqiad.wmflabs |
[tools] |
| 16:36 |
<gtirloni> |
re-enabled tools-exec-1429.tools.eqiad.wmflabs |
[tools] |
| 16:36 |
<gtirloni> |
re-enabled tools-exec-1411.tools.eqiad.wmflabs |
[tools] |
| 16:29 |
<bstorm_> |
re-enabled tools-exec-1433.tools.eqiad.wmflabs |
[tools] |
| 16:29 |
<XioNoX> |
enable Zayo transit on cr3-ulsfo |
[production] |
| 15:42 |
<Krenair> |
dropped https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/434055/ cherry-pick and rebased to fix puppet updates |
[releng] |
| 15:42 |
<chasemp> |
disable /etc/logrotate.d/udp2log-mw for a bit on mwlog1001 |
[production] |
| 15:37 |
<addshore> |
for https://gerrit.wikimedia.org/r/472476 |
[releng] |
| 15:36 |
<addshore> |
addshore@deployment-deploy01:~$ sudo puppet agent -tv |
[releng] |
| 15:25 |
<Amir1> |
rolling restart of celery on ores nodes (T209060) |
[production] |
| 15:20 |
<akosiaris> |
'cd /srv/deployment/ores/deploy/submodules/wheels && sudo -u deploy-service git lfs pull' on all ores1* and ores2* hosts T209060 |
[production] |
| 15:07 |
<XioNoX> |
zeroize asw-c8-codfw (decom) |
[production] |
| 14:30 |
<hashar> |
updated search-highlighter-maven-java8-docker-site-publish to decouple install and site goals | T208496 |
[releng] |
| 14:12 |
<moritzm> |
rebooting releases2001 for some tests with ssbd for KVM |
[production] |
| 13:52 |
<moritzm> |
installing postgres updates on labsdb1006/1007 |
[production] |
| 13:38 |
<jiji> |
Done reimaging rdb1006 - T206450 |
[production] |
| 13:37 |
<moritzm> |
draining ganeti2001 for reboot/kernel security update |
[production] |
| 13:36 |
<moritzm> |
failing over ganeti master in codfw from ganeti2001 to ganeti2003 |
[production] |
| 13:13 |
<godog> |
upload rsyslog 8.38.0-1~bpo9+1wmf1 to stretch-wikimedia, version bump only |
[production] |
| 13:07 |
<addshore@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Re-enable wmgUseTwoColConflict on dewiki - T205942 T208840 T209012 T209036 (duration: 00m 53s) |
[production] |
| 12:56 |
<akosiaris> |
increase weight of scb1001 for apertium to 99+% |
[production] |
| 12:56 |
<akosiaris@puppetmaster1001> |
conftool action : set/weight=3800; selector: dc=eqiad,service=apertium,cluster=scb,name=scb1001.* |
[production] |
| 12:53 |
<addshore@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Re-enable wmgUseTwoColConflict on group0 only T205942 T208840 T209012 T209036 (duration: 00m 54s) |
[production] |
| 12:52 |
<moritzm> |
draining ganeti2002 for reboot/kernel security update |
[production] |
| 12:41 |
<jiji> |
Shutdown and reimage rdb200[56] - T206450 |
[production] |
| 12:31 |
<moritzm> |
draining ganeti2003 for reboot/kernel security update |
[production] |
| 12:30 |
<zeljkof> |
EU SWAT finished |
[production] |
| 12:29 |
<zfilipin@deploy1001> |
Synchronized php-1.33.0-wmf.3/extensions/TwoColConflict: SWAT: [[gerrit:472175|Fix harmless edits turning into conflicts (T205942 T208840 T209012 T209036)]] (duration: 00m 55s) |
[production] |
| 12:19 |
<zfilipin@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:472134|Set AdvancedSearch to default on group0 wikis (T207641)]] (duration: 00m 55s) |
[production] |
| 12:18 |
<moritzm> |
draining ganeti2004 for reboot/kernel security update |
[production] |
| 11:57 |
<moritzm> |
draining ganeti2005 for reboot/kernel security update |
[production] |
| 11:51 |
<akosiaris> |
increase weight of scb1001 for apertium to 50% |
[production] |
| 11:50 |
<akosiaris@puppetmaster1001> |
conftool action : set/weight=38; selector: dc=eqiad,service=apertium,cluster=scb,name=scb1001.* |
[production] |
| 11:41 |
<moritzm> |
draining ganeti2006 for reboot/kernel security update |
[production] |
| 11:32 |
<gtirloni> |
removed temporary /var/mail fix (T208843) |
[tools] |
| 11:18 |
<moritzm> |
draining ganeti2007 for reboot/kernel security update |
[production] |