|
2015-12-17
ยง
|
| 22:58 |
<legoktm> |
marked integration-slave-trusty-1014 as offline due to tmpfs issues |
[releng] |
| 22:47 |
<hashar> |
ssh to tin is back https://gerrit.wikimedia.org/r/#/c/259876/ |
[production] |
| 22:39 |
<hashar> |
Only tin lost SSH user keys apparently due to https://gerrit.wikimedia.org/r/#/c/253465/ overriding the admin::groups to simply "eventlogging-admins" |
[production] |
| 22:34 |
<hashar> |
Ssh User keys are gone on deployment servers ( tin / mira ) |
[production] |
| 22:19 |
<hashar> |
Nodepool: all nodes are on ci-jessie-wikimedia-1450388384 |
[releng] |
| 22:04 |
<hashar> |
Nodepool: openstack image delete ci-jessie-wikimedia_old_20151210 |
[releng] |
| 21:49 |
<hashar> |
milestone, Nodepool has spawned 14500 instances so far |
[releng] |
| 21:48 |
<hashar> |
Image ci-jessie-wikimedia-1450388384 in wmflabs-eqiad is ready |
[releng] |
| 21:39 |
<hashar> |
refreshing nodepool snapshot to get the latest zuul right now ( https://wikitech.wikimedia.org/wiki/Nodepool#Manually_generate_a_new_snapshot ) |
[releng] |
| 21:33 |
<hashar> |
gallium: upgrading Zuul from 2.1.0-60-g1cc37f7-wmf2precise1 .. 2.1.0-60-g1cc37f7-wmf4precise1 . Should be noop, only change zuul-cloner which is not used there |
[production] |
| 21:29 |
<mutante> |
add zuul_2.1.0-60-g1cc37f7-wmf4jessie1 to jessie-wikimedia repo |
[production] |
| 21:28 |
<mutante> |
add zuul_2.1.0-60-g1cc37f7-wmf4trusty1 to trusty-wikimedia repo |
[production] |
| 21:22 |
<mutante> |
add zuul_2.1.0-60-g1cc37f7-wmf4precise1 to precise-wikimedia APT |
[production] |
| 19:42 |
<mobrovac> |
mathoid deploying a2187a6 |
[production] |
| 19:07 |
<thcipriani@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: all wikis to 1.27.0-wmf.9 |
[production] |
| 19:05 |
<godog> |
disable puppet on graphite2001, brief testing cluster aggregations |
[production] |
| 19:00 |
<thcipriani> |
starting update of all wikis to 1.27.0-wmf.9 |
[production] |
| 18:11 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Repool x1-slave (db1031), increase db1041 load to 100% (duration: 00m 30s) |
[production] |
| 18:06 |
<gwicke> |
running `nodetool cleanup` on restbase1001 and restbase1005 |
[production] |
| 18:04 |
<robh> |
calcium is supposed to be down, reclaiming to spares, ignore any irc alerts (its in maint mode in icinga) |
[production] |
| 17:55 |
<gwicke> |
running `nodetool cleanup` on restbase1002 |
[production] |
| 17:18 |
<jynus> |
setting mysql db1031 as db2009's master |
[production] |
| 17:05 |
<jynus> |
restarting and reconfiguring mysql at db2009 |
[production] |
| 16:51 |
<hashar> |
Added PdfHandler to extension-gate https://gerrit.wikimedia.org/r/#/c/259714/ |
[releng] |
| 16:49 |
<thcipriani@tin> |
Synchronized php-1.27.0-wmf.8/extensions/Math: SWAT: Make math usable without RESTbase [[gerrit:259734]] (duration: 00m 30s) |
[production] |
| 16:41 |
<jynus> |
problems with corruption on x1-slave for cebwiki. Fixed them. Will leave db1031 depooled for a while to check they are gone. |
[production] |
| 16:39 |
<thcipriani@tin> |
Synchronized php-1.27.0-wmf.9/extensions/ContentTranslation/includes/Translation.php: SWAT: Fix Undefined index: targetRevisionId in ContentTranslation [[gerrit:259649]] (duration: 00m 29s) |
[production] |
| 16:23 |
<thcipriani@tin> |
Synchronized php-1.27.0-wmf.9/extensions/WikimediaEvents/WikimediaEventsHooks.php: SWAT: Actually define tags for cross-wiki upload A/B test [[gerrit:259729]] (duration: 00m 31s) |
[production] |
| 16:17 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Enable cross-wiki upload A/B test in additional languages [[gerrit:259665]] (duration: 00m 30s) |
[production] |
| 16:11 |
<thcipriani@tin> |
Synchronized php-1.27.0-wmf.9/extensions/CirrusSearch/includes/CirrusSearch.php: SWAT: Fix array-to-string conversion [[gerrit:259633]] (duration: 00m 30s) |
[production] |
| 15:57 |
<moritzm> |
stopping opendj LDAP servers on nembus/neptunium (read-only since about days now due to migration to openldap) |
[production] |
| 15:56 |
<akosiaris> |
depool sca1001, playing with cxserver config |
[production] |
| 15:24 |
<jynus> |
reinstall, reboot and reconfigure mysql at db1031 |
[production] |
| 15:03 |
<moritzm> |
installing git security updates |
[production] |
| 14:23 |
<_joe_> |
restarting HHVM on the first jobrunners |
[production] |
| 14:11 |
<jynus> |
soft-rebooting mw1004, responsive to ping, but not to salt, ssh |
[production] |
| 14:06 |
<godog> |
nodetool stop -- CLEANUP on restbase1002 |
[production] |
| 13:59 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1031 (x1-slave) for maintenance (duration: 07m 30s) |
[production] |
| 13:46 |
<hashar> |
Build example pass ( https://integration.wikimedia.org/ci/job/mediawiki-extensions-hhvm/43270/ https://integration.wikimedia.org/ci/job/mediawiki-extensions-qunit/23552/ ) |
[releng] |
| 13:42 |
<hashar> |
Added CirrusSearch to extension-gate https://gerrit.wikimedia.org/r/259679 |
[releng] |
| 13:11 |
<moritzm> |
starting to restart hhvm on application servers (to effect security updates for libxml2, openssl and others) |
[production] |
| 13:01 |
<akosiaris> |
moved old cruft /srv/deployment/cxserver/deploy/src/config.js out of the way |
[production] |
| 12:51 |
<akosiaris> |
repooled sca1002 for cxserver |
[production] |
| 12:51 |
<akosiaris> |
restarted cxserver on sca1002 |
[production] |
| 12:33 |
<akosiaris> |
depooling sca1002 for cxserver |
[production] |
| 12:33 |
<akosiaris> |
repooling sca1001 for cxserver |
[production] |
| 12:24 |
<kart_> |
Updated cxserver on sca1002 |
[production] |
| 12:16 |
<hashar> |
beta: salt -v '*' cmd.run 'apt-get clean' |
[releng] |
| 12:08 |
<akosiaris> |
disable puppet, stop salt-minion on sca1002 |
[production] |
| 12:08 |
<akosiaris> |
depool sca1001 from cxserver service. |
[production] |