|
2018-10-25
§
|
| 17:20 |
<bsitzmann@deploy1001> |
Started deploy [mobileapps/deploy@95452cf]: Update mobileapps to 58cbdff (T206527) |
[production] |
| 17:20 |
<mutante> |
planet - regenerating feeds for 'en' and 'de', others will follow by cron. switching to new theme. replaced bootstrap with bulma. removed jQuery. thanks to paladox |
[production] |
| 16:34 |
<gehel@puppetmaster1001> |
conftool action : set/weight=20; selector: dc=eqiad,cluster=wdqs,name=wdqs1005.codfw.wmnet |
[production] |
| 16:34 |
<gehel@puppetmaster1001> |
conftool action : set/weight=20; selector: dc=eqiad,cluster=wdqs,name=wdqs1004.codfw.wmnet |
[production] |
| 16:34 |
<gehel> |
decreasing relative weight of wdqs1003 in LVS to ease the updater |
[production] |
| 16:24 |
<shdubsh> |
installed patched nagios-nrpe-plugin and nagios-nrpe-server on icinga1001 - T207775 |
[production] |
| 15:36 |
<elukey> |
shutdown aqs1006 to replace one broken disk |
[analytics] |
| 15:36 |
<elukey> |
shutdown aqs1006 to replace one broken disk - T206915 |
[production] |
| 15:31 |
<SMalyshev> |
depooling wdqs1003 again, it's not catching up like the other hosts |
[production] |
| 15:16 |
<addshore@deploy1001> |
Synchronized wmf-config/InitialiseSettings-labs.php: [Beta Cluster] Re-enable WBMI on Beta Commons (duration: 00m 54s) |
[production] |
| 15:11 |
<addshore@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Revert "logging: Disable Wikibase.NewItemIdFormatter channel" (duration: 00m 55s) |
[production] |
| 15:08 |
<addshore@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Explicitly set wgLexemeEnableRepo for wikidatas [[gerrit:469625]] (duration: 00m 55s) |
[production] |
| 15:02 |
<godog> |
test rsyslog 8.38 upgrade on lithium - T136312 |
[production] |
| 14:28 |
<elukey> |
upgrade druid on druid100[4-6] to Druid 0.12.3 |
[analytics] |
| 14:28 |
<elukey> |
upgrade druid on druid100[4-6] to Druid 0.12.3 |
[production] |
| 14:24 |
<elukey> |
added AAAA DNS records to all the druid nodes |
[analytics] |
| 14:20 |
<banyek> |
running dns update (gerrit patch: 467711) |
[production] |
| 13:48 |
<anomie@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Setting comment table migration stage to write-new/read-both on all wikis (T166733) (duration: 00m 55s) |
[production] |
| 13:46 |
<godog> |
reformat ms-be2043 xfs filesystems - T199198 |
[production] |
| 13:29 |
<XioNoX> |
test successful, rollback add term return-tcp permit on cr2-codfw |
[production] |
| 13:28 |
<XioNoX> |
test add term return-tcp permit on cr2-codfw |
[production] |
| 12:14 |
<volans> |
rebooting cumin1001 to pick new kernel and clear any potential weird state after OOMs |
[production] |
| 12:01 |
<zeljkof> |
EU SWAT finished |
[production] |
| 11:17 |
<zfilipin@deploy1001> |
Synchronized wmf-config/throttle.php: SWAT: [[gerrit:469261|New throttle rule for Johannesburg Event on 2018-10-27 (T207742)]] (duration: 00m 55s) |
[production] |
| 11:08 |
<zfilipin@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:465418|Stop collecting data CitaitonUsage and CitationUsagePageLoad (T191086 T203253)]] (duration: 00m 57s) |
[production] |
| 10:57 |
<volans> |
restart pdfrender on scb1003 |
[production] |
| 10:36 |
<joal> |
Resuming oozie webrequest and pageview druid hourly indexation jobs |
[analytics] |
| 10:35 |
<elukey> |
upgraded Druid on druid100[1-3] to 0.12.3-1 |
[analytics] |
| 10:11 |
<elukey> |
upgrade druid100[1-3] to druid 0.12.3 |
[production] |
| 09:51 |
<gehel> |
resetting deployment directory on wdqs1003 |
[production] |
| 09:16 |
<elukey> |
upgrade turnilo to 1.8.1 |
[analytics] |
| 09:15 |
<elukey@deploy1001> |
Finished deploy [analytics/turnilo/deploy@84bf1ad]: Upgrade to 1.8.1 (duration: 00m 10s) |
[production] |
| 09:15 |
<elukey@deploy1001> |
Started deploy [analytics/turnilo/deploy@84bf1ad]: Upgrade to 1.8.1 |
[production] |
| 09:10 |
<ema> |
resume cache hosts rolling reboots for kernel/microcode updates T203011 |
[production] |
| 08:56 |
<elukey> |
restart hive-server on an-coord1001 to pick up new prometheus settings |
[analytics] |
| 08:10 |
<joal> |
Suspend webrequest-druid-hourly and pageview-druid-hourly oozie jobs |
[analytics] |
| 07:52 |
<joal> |
Manually add za.wikimedia to pageview-witelist (patch merged: https://gerrit.wikimedia.org/r/469557) |
[analytics] |
| 07:50 |
<hashar> |
enabling puppet again on deployment-deploy01 . Was disabled by _joe_ for apache-fast-test hacking |
[releng] |
| 07:16 |
<vgutierrez> |
Uploaded certcentral 0.3 to apt.wikimedia.org (stretch) - T207737 T207478 |
[production] |
| 07:11 |
<moritzm> |
installing requests security updates on trusty |
[production] |
| 06:17 |
<SMalyshev> |
depooling wdqs1003 again, it's not catching up like the other hosts |
[production] |
| 06:06 |
<elukey> |
upload druid 0.12.3-1 debs to stretch-wikimedia |
[production] |