|
2016-07-04
§
|
| 11:15 |
<yuvipanda> |
delete instance waah, was totally unused for a long time |
[marathon] |
| 11:14 |
<yuvipanda> |
stop instance papaultest to free up some resources on labvirt1006 |
[testlabs] |
| 11:14 |
<yuvipanda> |
stop instance tool-master-02 to free up some resources on labvirt1006 |
[testlabs] |
| 11:13 |
<yuvipanda> |
delete tools-prometheus-01 to free up resources on labvirt1010 |
[tools] |
| 11:11 |
<yuvipanda> |
actually deleted instance tools-cron-02 to free up resources on labvirt1010 - was large and not currently used, and failover process takes a while anyway, so we can recreate if needed |
[tools] |
| 11:10 |
<yuvipanda> |
stopped instance tools-cron-02 to free up some resources on labvirt1010 |
[tools] |
| 11:10 |
<yuvipanda> |
shutoff instances tool-master-05, tool-exec-05 and tool-exec-07 to save up resources on labvirt1010 |
[tool-renewal] |
| 11:06 |
<yuvipanda> |
delete matrix-01 to clear up some space on labvirt1010 |
[matrix] |
| 10:56 |
<moritzm> |
rolling reboot of swift frontends in eqiad for kernel security update |
[production] |
| 10:43 |
<yuvipanda> |
migrate wm-bot instance to labvirt1011 for T139264 |
[bots] |
| 10:30 |
<yuvipanda> |
stop nodepool on labnodepool1001 and disable puppet to keep it down, to allow stabilizing labs first |
[production] |
| 10:28 |
<yuvipanda> |
restart rabbitmq-server on labcontrol1001 |
[production] |
| 10:14 |
<moritzm> |
installing chromium security update on osmium |
[production] |
| 10:07 |
<moritzm> |
installing xerces-c security updates on Ubuntu systems (jessie already fixed) |
[production] |
| 10:01 |
<_joe_> |
stopping jobchron and jobrunner on mw1001-10 before decommission |
[production] |
| 09:50 |
<godog> |
reimage ms-be300[234] with jessie |
[production] |
| 09:44 |
<hashar> |
Labs infra cant delete instances anymore (impacts CI as well) T139285 |
[production] |
| 09:41 |
<paladox> |
<hashar> !log CI is out of Nodepool instances, the pool has drained because instances can no more be deleted over the OpenStack API |
[integration] |
| 09:41 |
<moritzm> |
installing p7zip security updates |
[production] |
| 09:38 |
<hashar> |
CI is out of Nodepool instances, the pool has drained because instances can no more be deleted over the OpenStack API |
[production] |
| 09:25 |
<elukey> |
Added new jobrunners in service - mw130[256].eqiad.wmnet (https://etherpad.wikimedia.org/p/jessie-install) |
[production] |
| 08:16 |
<moritzm> |
rolling reboot of swift backends in eqiad for kernel security update |
[production] |
| 07:49 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Failover db1034 to db1062 (duration: 00m 30s) |
[production] |
| 02:26 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Mon Jul 4 02:26:54 UTC 2016 (duration 5m 42s) |
[production] |
| 02:21 |
<mwdeploy@tin> |
scap sync-l10n completed (1.28.0-wmf.8) (duration: 09m 14s) |
[production] |
| 00:22 |
<JeanFred> |
Deployed latest from Git: 2f9024e |
[tools.heritage] |
|
2016-07-03
§
|
| 19:27 |
<Reedy> |
Ran namespaceDupes --fix on gomwiki |
[production] |
| 17:09 |
<yuvipanda> |
run qstat -u '*' | grep 'dr ' | awk '{ print $1;}' | xargs -L1 qdel -f to clean out jobs stuck in dr state |
[tools] |
| 16:58 |
<yuvipanda> |
migrate tools-web-static-02 to labvirt1011 to provide more breathing room |
[tools] |
| 16:56 |
<yuvipanda> |
delete temp-test-trusty-package to provide more breathing room on labvirt1010 |
[tools] |
| 16:50 |
<yuvipanda> |
migrating visualeditor-test to labvirt1011, krenair reports it broken |
[visualeditor] |
| 15:16 |
<JeanFred> |
Deployed latest from Git: 76383f9 |
[tools.heritage] |
| 15:02 |
<yuvipanda> |
migrating toolsbeta-valhallasw-puppet-compiler to labvirt1011 to ease pressure on labvirt1010 |
[toolsbeta] |
| 14:59 |
<yuvipanda> |
restart nova-compute process on labvirt1010 |
[production] |
| 14:59 |
<yuvipanda> |
restart nova-compute process on labvirt10101 |
[production] |
| 14:44 |
<JeanFred> |
Deployed latest from Git: 1fdeff6 |
[tools.heritage] |
| 14:09 |
<yuvipanda> |
migrate social-tools2 to labvirt1011 |
[social-tools] |
| 13:49 |
<yuvipanda> |
reboot tools-exec-1219 |
[tools] |
| 13:37 |
<yuvipanda> |
migrating tools-exec-1216 to labvirt1011 |
[tools] |
| 13:10 |
<paladox> |
phabricator Update phab-01 and phab-05 (phab-02) and phab-03 to fix a security bug in phabricator (Did the update last night but forgot to log it) |
[releng] |
| 13:07 |
<yuvipanda> |
delete tools-bastion-01 which was shut down anyway |
[tools] |
| 13:04 |
<yuvipanda> |
attempt to reboot tools-exec-1212 |
[tools] |
| 13:01 |
<JeanFred> |
Deployed latest from Git: 0154a31, 9a4d05b, 4b6c343, 39c5409 (T138633) |
[tools.heritage] |
| 12:04 |
<jzerebecki> |
reloading zuul for 7e6a2e2..13ea50f |
[releng] |
| 09:06 |
<jynus> |
removing old logs from pc2004 |
[production] |
| 07:42 |
<legoktm@tin> |
Synchronized static/images/project-logos/: Put high-res enwiktionary logos in the right place - T139255 (duration: 00m 38s) |
[production] |
| 02:27 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Sun Jul 3 02:27:13 UTC 2016 (duration 5m 38s) |
[production] |
| 02:21 |
<mwdeploy@tin> |
scap sync-l10n completed (1.28.0-wmf.8) (duration: 09m 13s) |
[production] |