|
2015-12-09
ยง
|
| 21:20 |
<hashar> |
Jenkins going down right now. |
[production] |
| 21:18 |
<subbu> |
starting parsoid deploy |
[production] |
| 21:10 |
<hashar> |
Stopping Jenkins |
[production] |
| 19:56 |
<thcipriani@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: hewiki and cawiki to php-1.27.0-wmf.8 |
[production] |
| 19:46 |
<thcipriani@tin> |
Synchronized dblists/group1.dblist: Train: Add hewiki and cawiki to group1. Part II [[gerrit:257973]] (duration: 00m 29s) |
[production] |
| 19:45 |
<thcipriani@tin> |
Synchronized dblists/group1-wikipedia.dblist: Train: Add hewiki and cawiki to group1. Part I [[gerrit:257973]] (duration: 00m 33s) |
[production] |
| 19:10 |
<thcipriani@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.27.0-wmf.8 |
[production] |
| 19:02 |
<ebernhardson@tin> |
Synchronized php-1.27.0-wmf.7/extensions/CirrusSearch/includes/Job/Job.php: Revert manual adjustment made to CirrusSearch Job.php (duration: 00m 29s) |
[production] |
| 18:56 |
<mutante> |
mw1003 - restarted hhvm (and apache a bit earlier too) |
[production] |
| 18:15 |
<Jamesofur> |
inserted decryption key into database for enWP Arbcom case |
[production] |
| 17:49 |
<hashar> |
salt-key --delete deployment-sentry2.eqiad.wmflabs ( already have deployment-sentry2.deployment-prep.eqiad.wmflabs ) |
[releng] |
| 17:41 |
<bd808> |
Rebooting bd808-vagrant.wikimania-support.eqiad.wmflabs to see if that makes ssh magically work again |
[wikimania-support] |
| 17:31 |
<akosiaris> |
restarted hhvm on mw1125, memory starvation |
[production] |
| 17:31 |
<akosiaris> |
restarted hhvm on mw1125 |
[production] |
| 17:17 |
<thcipriani@tin> |
Synchronized php-1.27.0-wmf.8/extensions/Wikidata: SWAT: Update Wikibase [[gerrit:257901]] (duration: 00m 49s) |
[production] |
| 17:05 |
<krenair@tin> |
Synchronized wmf-config/interwiki.cdb: Updating interwiki cache (duration: 00m 28s) |
[production] |
| 16:44 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Add rights to CU+OS groups on en.wikipedia.org [[gerrit:255129]] (duration: 00m 29s) |
[production] |
| 16:32 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Turn off language detection user test [[gerrit:254071]] (duration: 00m 29s) |
[production] |
| 16:25 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Set initial titlesuggest shard sizes [[gerrit:256974]] (duration: 00m 29s) |
[production] |
| 16:19 |
<hashar> |
Image ci-jessie-wikimedia-1449677602 in wmflabs-eqiad is ready ( comes with python-etcd ) |
[releng] |
| 16:18 |
<thcipriani@tin> |
Synchronized dblists/group1.dblist: SWAT: Move Catalan and Hebrew Wikipedias to group1 [[gerrit:253371]] (duration: 00m 29s) |
[production] |
| 16:15 |
<hashar> |
Refreshing nodepool snapshots will hopefully grab python-etcd ( https://gerrit.wikimedia.org/r/257906 ) |
[releng] |
| 16:12 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Enable importupload and some import sources for officewiki [[gerrit:256881]] (duration: 00m 42s) |
[production] |
| 16:06 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Add config for wgVisualEditorUseSingleEditTab and set true for enwiki Labs Part II [[gerrit:257800]] (duration: 00m 28s) |
[production] |
| 16:05 |
<thcipriani@tin> |
Synchronized wmf-config/CommonSettings.php: SWAT: Add config for wgVisualEditorUseSingleEditTab and set true for enwiki Labs Part I [[gerrit:257800]] (duration: 00m 29s) |
[production] |
| 16:05 |
<hashar> |
Image ci-jessie-wikimedia-1449676603 in wmflabs-eqiad is ready |
[releng] |
| 15:56 |
<hashar> |
refreshing nodepool snapshot instance, need a new etcd version |
[releng] |
| 15:48 |
<akosiaris> |
uploaded to apt.wikimedia.org jessie-wikimedia: etherpad-lite_1.5.7-2 |
[production] |
| 15:01 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Repool es1019 after maintenance (duration: 00m 33s) |
[production] |
| 14:09 |
<godog> |
decommission restbase1007 |
[production] |
| 14:06 |
<hashar> |
integration-slave-trusty-1011: sudo rm -fR /mnt/home/jenkins-deploy/tmpfs/jenkins-0 ( https://phabricator.wikimedia.org/T120824 ) |
[releng] |
| 13:06 |
<hashar> |
restarting Jenkins (upgrading Gearman plugin) |
[production] |
| 12:57 |
<hashar> |
Upgrading Jenkins Gearman plugin to grab upstream patch https://review.openstack.org/#/c/252768/ 'fix registration for jenkins master' should be noop |
[releng] |
| 11:51 |
<akosiaris> |
reissue certificates for labs-ldap.{eqiad,codfw}.wikimedia.org with a 2048bit key size |
[production] |
| 11:29 |
<kart_> |
Update cxserver to c88ef57 |
[production] |
| 10:45 |
<akosiaris> |
sudo gnt-instance modify -H cpu_type=SandyBridge seaborgium to get aesni and sse cpu flags. rebooting seaborgium to apply those |
[production] |
| 10:45 |
<akosiaris> |
!log sudo gnt-instance modify -H cpu_type=SandyBridge seaborgium to get aesni and sse cpu flags. rebooting seaborgium to apply those |
[] |
| 10:25 |
<akosiaris> |
reboot serpens to add 3 more vCPUs |
[production] |
| 10:21 |
<akosiaris> |
reboot seaborgium to add 3 more vCPUs |
[production] |
| 10:04 |
<moritzm> |
restarting slapd on serpens/seaborgium to apply updated indices |
[production] |
| 10:03 |
<ori> |
running hhvm-collect-heaps in screen on mw1001 with a 600s interval |
[production] |
| 10:00 |
<akosiaris> |
stopped slapd on seaborgium, run sudo -u openldap slapindex to add the new indices, started slapd |
[production] |
| 10:00 |
<paravoid> |
manually ran update-ubuntu-mirror twice on carbon to fix mirror errors |
[production] |
| 09:58 |
<akosiaris> |
stopped slapd on serpens, run sudo -u openldap slapindex to add the new indices, started slapd |
[production] |
| 08:15 |
<ori> |
Memory utilization on the job runners began to climb around 2015-12-08T10:00:00+00:00 UTC. To investigate, enabled jemalloc profiling and restarted HHVM on mw1001. |
[production] |
| 07:40 |
<YuviPanda> |
restarted create-dbusers on labstore1001 |
[production] |
| 04:44 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Wed Dec 9 04:44:57 UTC 2015 (duration 1h 50m 43s) |
[production] |
| 02:54 |
<mwdeploy@tin> |
sync-l10n completed (1.27.0-wmf.8) (duration: 04m 34s) |
[production] |
| 02:34 |
<mwdeploy@tin> |
sync-l10n completed (1.27.0-wmf.7) (duration: 10m 27s) |
[production] |
| 02:23 |
<ori@tin> |
Synchronized wmf-config/wikitech.php: I4ef826af47: Increase LDAP log verbosity (duration: 00m 44s) |
[production] |