|
2013-11-20
§
|
| 17:51 |
<^demon|sick> |
gerrit up, forcing replication of all repos |
[production] |
| 17:50 |
<^demon|sick> |
restarting gerrit since replication plugin won't reload |
[production] |
| 17:27 |
<^demon|sick> |
gerrit: disabled replication plugin fix, pending firewall updates. everything's timing out and flooding logs with errors. |
[production] |
| 13:59 |
<hashar> |
jenkins: added slave integration-slave01 with label hasNpm. That is a slave running in labs ( integration-slave01.pmtpa.wmflabs ) |
[production] |
| 12:31 |
<apergos> |
end of an era: shut down ms7 webserver and opening ticket for decom |
[production] |
| 10:14 |
<hashar> |
Jenkins: disabled gearman plugin, Zuul is no more a Gearman server. |
[production] |
| 10:12 |
<hashar> |
restarted again stalled Jenkins |
[production] |
| 10:05 |
<hashar> |
restarted Zuul with non gearman version. |
[production] |
| 10:02 |
<hashar> |
reverting Zuul to last known version: wmf-deploy-20131023 + 6241272...1e3adfd wmf-deploy-20131023 -> master (forced update) |
[production] |
| 09:58 |
<hashar> |
shutting down Zuul and reverting upgrade :-( |
[production] |
| 09:46 |
<hashar> |
restarting Jenkins to update gearman plugin |
[production] |
| 09:38 |
<hashar> |
Zuul upgraded with Gearman support to trigger build in Jenkins. Will monitor for the rest of the morning. |
[production] |
| 09:34 |
<hashar> |
enabling Gearman in Jenkins, making it register with Zuul new version |
[production] |
| 09:34 |
<hashar> |
restarted Zuul with Gearman version |
[production] |
| 09:27 |
<hashar> |
removing all old versions of zuul: rm -fR /usr/local/lib/python2.7/dist-packages/zuul* |
[production] |
| 09:20 |
<hashar> |
gallium temp install of python-pip to be able to ugprade Zuul |
[production] |
| 09:15 |
<hashar> |
Zuul: bumped source code in integration/zuul.git to Gearman based version: 1e3adfd...6241272 labs -> master |
[production] |
| 09:05 |
<hashar> |
stopping Zuul on gallium for upgrading purposes. |
[production] |
| 07:51 |
<apergos> |
rebooting sq37, we had /dev//sdc gone and reappeared as /dev/sdc killing back-end squid |
[production] |
| 07:40 |
<ori> |
synchronized php-1.23wmf3/extensions/WikimediaEvents/modules/ext.wikimediaEvents.moduleStorage.js 'Re-syncing I51d2d6495' |
[production] |
| 07:38 |
<ori> |
synchronized php-1.23wmf4/extensions/WikimediaEvents/modules/ext.wikimediaEvents.moduleStorage.js 'Re-syncing I51d2d6495' |
[production] |
| 06:47 |
<apergos> |
removed on mw* hosts from /tmp all *png/map/err/tif older than an hour, as some tmpfs were full |
[production] |
| 05:55 |
<ori-l> |
/tmp on Apaches filling up with math .pngs; moving some of the oldest away as a stopgap |
[production] |
| 05:04 |
<springle> |
synchronized wmf-config/db-pmtpa.php |
[production] |
| 03:17 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Wed Nov 20 03:17:15 UTC 2013 |
[production] |
| 02:31 |
<LocalisationUpdate> |
completed (1.23wmf3) at Wed Nov 20 02:31:26 UTC 2013 |
[production] |
| 02:15 |
<LocalisationUpdate> |
completed (1.23wmf4) at Wed Nov 20 02:15:34 UTC 2013 |
[production] |
| 01:38 |
<paravoid> |
rebooting ms-be1001, i/o stuck kernel bug |
[production] |
| 01:37 |
<ori> |
synchronized php-1.23wmf4/extensions/WikimediaEvents 'Update WikimediaEvents to I5b8cfe592' |
[production] |
| 01:35 |
<ori> |
synchronized php-1.23wmf3/resources/startup.js 'touch' |
[production] |
| 01:33 |
<ori> |
synchronized php-1.23wmf3/extensions/WikimediaEvents 'Update WikimediaEvents to I5b8cfe592' |
[production] |
| 00:43 |
<csteipp> |
synchronized php-1.23wmf4/extensions/OAuth 'update OAuth to master for last blocker fix' |
[production] |
| 00:33 |
<ori> |
synchronized php-1.23wmf3/resources/startup.js 'touch' |
[production] |
| 00:28 |
<ori> |
synchronized php-1.23wmf3/extensions/MobileFrontend 'Updating MobileFrontend for I3efc1fa64' |
[production] |
|
2013-11-19
§
|
| 23:58 |
<ori-l> |
Restarting EventLogging jobs on vanadium |
[production] |
| 23:54 |
<ori> |
synchronized php-1.23wmf3/resources/startup.js 'touch' |
[production] |
| 23:14 |
<ori> |
synchronized wmf-config/InitialiseSettings.php 'Iee7332c97: Disable infobox experiment' |
[production] |
| 23:13 |
<ori> |
updated /a/common to {{Gerrit|Iee7332c97}}: Disable infobox experiment |
[production] |
| 22:53 |
<reedy> |
synchronized php-1.23wmf4/extensions/AbuseFilter/ 'bug 57268' |
[production] |
| 21:59 |
<mholmquist> |
synchronized php-1.23wmf3/extensions/VectorBeta/ 'Sync VectorBeta code to wikis that will never use it' |
[production] |
| 21:45 |
<mholmquist> |
synchronized wmf-config/extension-list 'Add VectorBeta to extension-list' |
[production] |
| 21:44 |
<mholmquist> |
updated /a/common to {{Gerrit|Ib532e5558}}: Add VectorBeta to extension-list |
[production] |
| 21:41 |
<mholmquist> |
Finished syncing Wikimedia installation... : Adding VectorBeta |
[production] |
| 21:21 |
<mholmquist> |
synchronized php-1.23wmf4/extensions/VectorBeta/ |
[production] |
| 21:17 |
<mholmquist> |
Started syncing Wikimedia installation... : Adding VectorBeta |
[production] |
| 21:10 |
<mholmquist> |
synchronized wmf-config/InitialiseSettings.php 'Set wmgUseVectorBeta = true for phase0 wikis' |
[production] |
| 21:09 |
<mholmquist> |
synchronized wmf-config/CommonSettings.php 'Add wmgUseVectorBeta' |
[production] |
| 21:08 |
<mholmquist> |
updated /a/common to {{Gerrit|Ic3a64b434}}: Enable VectorBeta on group0 wikis |
[production] |
| 20:55 |
<reedy> |
synchronized wmf-config/ |
[production] |
| 20:04 |
<ori> |
synchronized php-1.23wmf4/extensions/WikimediaEvents 'Update WikimediaEvents to d4f2a43' |
[production] |