|
2016-12-16
ยง
|
| 22:36 |
<eevans@tin> |
Starting deploy [cassandra/twcs@0b0c838]: (no message) |
[production] |
| 22:29 |
<mutante> |
salt master: deleting unacceptd keys for decom'ed hosts neon and palladium, accepting key for restbase1018 |
[production] |
| 22:24 |
<mutante> |
restbase1018 - signing puppet cert, initial run |
[production] |
| 21:35 |
<mutante> |
labmon1001 - upgrade apache, gnupg, host, openssh-*, openssl |
[production] |
| 20:31 |
<mutante> |
eventlog2001 - upgraded scap | bohrium - upgraded salt | multatuli - upgraded snimpy (all one-offs from servermon list) |
[production] |
| 20:17 |
<mutante> |
silver (wikitech) - upgraded openssh-sftp-server, login, firejail |
[production] |
| 20:14 |
<mutante> |
stat1002 - /etc/sudoers is puppetized but package upgrades of sudo want to override it and suggest to put local modifications in /etc/sudoers.d/, keeping installed version |
[production] |
| 20:09 |
<mutante> |
stat1002 - install various package upgrades |
[production] |
| 20:05 |
<mutante> |
helium (backups) - upgrade apache2, openssl, python, dpkg .. |
[production] |
| 20:02 |
<mutante> |
iridium (phabricator) - upgrade openssl, openssh-server, sftp, python2.7 |
[production] |
| 19:58 |
<mutante> |
carbon (install) apt-get upgrade |
[production] |
| 19:27 |
<mutante> |
rolling out php upgrades on mw-codfw |
[production] |
| 19:24 |
<mutante> |
contint1001, tungsten, hafnium - upgrade php5-cli/-common, libapache-mod-php5,.. |
[production] |
| 19:21 |
<mutante> |
planet[12]001, rutherfordium (people.wm.org), ununpentium (RT) - upgrade php5-cli/-common, libapache-mod-php5,.. |
[production] |
| 18:49 |
<mobrovac@tin> |
Finished deploy [citoid/deploy@d05c8bb]: (no message) (duration: 00m 39s) |
[production] |
| 18:49 |
<mobrovac@tin> |
Starting deploy [citoid/deploy@d05c8bb]: (no message) |
[production] |
| 18:08 |
<Zppix> |
Attention: At 7PM CST UTC-6, grrrit-wm will be going under maintaience and will be down for at most 30 minutes if you have any questions please direct them to me, for more info please go to E424 on Phab! |
[production] |
| 17:35 |
<gehel> |
restart elastic2006.codfw.wmnet |
[production] |
| 17:16 |
<gehel> |
unbanned elastic2006 to complete repooling |
[production] |
| 17:12 |
<mutante> |
mw-canary - upgraded php5 packages |
[production] |
| 17:05 |
<mutante> |
silver (wikitech) - upgrade apache2, apparmor, python |
[production] |
| 17:04 |
<mutante> |
silver (wikitech) - upgrade openssh, openssl |
[production] |
| 16:47 |
<gehel@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=elastic2006.codfw.wmnet |
[production] |
| 16:46 |
<gehel> |
repooling elastic2006.codfw.wmnet |
[production] |
| 16:46 |
<mutante> |
silver - upgraded php5-fss | copper - upgraded php5-dev | einsteinium/tegmen - upgraded php5-gd, php5* |
[production] |
| 16:42 |
<mutante> |
krypton, mira, wasat, phab2001, bohrium, notebook[12]001 - upgrade php5 packages |
[production] |
| 16:36 |
<legoktm@tin> |
Synchronized php-1.29.0-wmf.6/resources/Resources.php: Revert confirmation button and apply other fixes - T153389 T153438 (duration: 00m 39s) |
[production] |
| 16:36 |
<gehel> |
cleaning dangling elasticsearch indices on codfw |
[production] |
| 16:35 |
<mutante> |
tin, auth1001, auth2001 - upgrade php5 packages |
[production] |
| 16:35 |
<legoktm@tin> |
Synchronized php-1.29.0-wmf.6/resources/src/mediawiki.special/mediawiki.special.watchlist.js: Revert confirmation button and apply other fixes - T153389 T153438 (duration: 00m 39s) |
[production] |
| 16:22 |
<mutante> |
argon, chlorine, cp3012, elastic2006: upgraded apt (these were the few exceptions somehow not covered by 'dc-all' already) |
[production] |
| 16:19 |
<mobrovac@tin> |
Finished deploy [citoid/deploy@e7e3a42]: (no message) (duration: 02m 05s) |
[production] |
| 16:17 |
<mobrovac@tin> |
Starting deploy [citoid/deploy@e7e3a42]: (no message) |
[production] |
| 15:13 |
<elukey> |
prometheus apache and hhvm exporters running on the eqiad MW appservers |
[production] |
| 15:09 |
<volans> |
killing excess salt minions on iridium.eqiad.wmnet (there are 3 running) |
[production] |
| 14:30 |
<elukey> |
disabling puppet on the eqiad appservers to rollout gradually the prometheus apache/hhvm exporters |
[production] |
| 13:21 |
<mobrovac@tin> |
Finished deploy [mobileapps/deploy@c67a5ef]: Switching MCS in eqiad to Scap3 deploys T144598 (duration: 00m 34s) |
[production] |
| 13:21 |
<mobrovac@tin> |
Starting deploy [mobileapps/deploy@c67a5ef]: Switching MCS in eqiad to Scap3 deploys T144598 |
[production] |
| 13:20 |
<mobrovac> |
enabling and running puppet in eqiad scb |
[production] |
| 13:13 |
<mobrovac@tin> |
Finished deploy [mobileapps/deploy@c67a5ef]: Switching MCS in codfw to Scap3 deploys T144598 (duration: 01m 03s) |
[production] |
| 13:12 |
<mobrovac@tin> |
Starting deploy [mobileapps/deploy@c67a5ef]: Switching MCS in codfw to Scap3 deploys T144598 |
[production] |
| 13:06 |
<akosiaris> |
running puppet on scb200X boxes for mobileapps scap3 migration |
[production] |
| 13:05 |
<akosiaris> |
disable puppet for mobileapps scap3 migration on scb boxes |
[production] |
| 12:16 |
<akosiaris> |
remove all WMF php5 packages from apt.wikimedia.org for precise-wikimedia. No longer required |
[production] |
| 12:16 |
<marostegui> |
Stop replication db2033 for maintenance - T151552 |
[production] |
| 11:38 |
<yuvipanda> |
abort apt-get autoremove very quickly, because I don't want to mess with grub menus on a friday |
[production] |
| 11:37 |
<yuvipanda> |
run apt-get autoremove across labs to cleanup old linux kernel images |
[production] |
| 11:26 |
<volans> |
enabling remote IPMI where it's not enabled T150160 |
[production] |
| 11:14 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1073 (duration: 00m 40s) |
[production] |
| 10:47 |
<ariel@tin> |
Finished deploy [dumps/dumps@7118c1b]: fix error checking for reruns of single checkpoint files (duration: 00m 01s) |
[production] |