|
2014-06-12
§
|
| 17:49 |
<ottomata> |
disabling puppet on analytics1012 and analytics1022 |
[production] |
| 17:48 |
<ottomata> |
starting some kafka failure tests, I have scheduled downtime for some service checks in icinga, hopefully this will not be noisy |
[production] |
| 17:41 |
<ottomata> |
restarting elasticsearch on logstash servers |
[production] |
| 17:34 |
<yurik> |
Synchronized wmf-config/InitialiseSettings.php: Enabling new zero ext on all wikis (duration: 01m 03s) |
[production] |
| 17:22 |
<yurik> |
Synchronized wmf-config/InitialiseSettings.php: Attempting to enable new zero ext on zerowiki & ruwiki - take3 (duration: 01m 04s) |
[production] |
| 17:06 |
<yurik> |
Synchronized php-1.24wmf8/extensions/: (no message) (duration: 01m 12s) |
[production] |
| 17:05 |
<greg-g> |
yurik's blank sync message could have been: Deploying new JsonConfig,ZeroBanner,ZeroPortal extensions (refactoring ZeroRatedMobileAccess ext) |
[production] |
| 17:04 |
<yurik> |
Synchronized php-1.24wmf7/extensions/: (no message) (duration: 01m 15s) |
[production] |
| 15:31 |
<manybubbles> |
Synchronized wmf-config/throttle.php: SWAT: Raise account creation limit for eswiki outreach event (duration: 00m 05s) |
[production] |
| 13:39 |
<bblack> |
enabling cp301[34] esams mobile frontends in pybal |
[production] |
| 11:18 |
<hashar> |
Gerrit: created mediawiki/services/cxserver/deploy repository for Nikerabbit and kart_ |
[production] |
| 05:52 |
<paravoid> |
cr1-esams/cr2-knams: dismantling amslvs BGP peerings |
[production] |
| 05:46 |
<paravoid> |
amslvs[1234]: stopping pybal |
[production] |
| 03:40 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Thu Jun 12 03:39:07 UTC 2014 (duration 39m 6s) |
[production] |
| 03:03 |
<LocalisationUpdate> |
completed (1.24wmf8) at 2014-06-12 03:02:09+00:00 |
[production] |
| 02:58 |
<springle> |
Synchronized wmf-config/db-eqiad.php: depool db1051 (duration: 01m 08s) |
[production] |
| 02:33 |
<LocalisationUpdate> |
completed (1.24wmf7) at 2014-06-12 02:32:07+00:00 |
[production] |
| 01:47 |
<ori> |
graceful'd appservers for I0e66ee0a1: 2.4 compat: load mod_filter for AddOutputFilterByType |
[production] |
| 00:44 |
<bblack> |
ran "puppetca -s palladium.eqiad.wmnet" on palladium to get agent running again, someone borked/regenerated the key there 6 hours ago? |
[production] |
| 00:20 |
<mwalker> |
clearMessageBlobs.php killed because we fixed the problem in a more different way |
[production] |
| 00:17 |
<mwalker> |
Synchronized php-1.24wmf8/extensions/MultimediaViewer/resources/mmv/ui/mmv.ui.canvasButtons.js: poking cache for multimediaviewer messages (duration: 00m 04s) |
[production] |
| 00:05 |
<aaron> |
Synchronized php-1.24wmf8/includes/EditPage.php: e11d41dd366b039bff79e247368b6bff1245ea5e (duration: 00m 07s) |
[production] |
|
2014-06-11
§
|
| 23:50 |
<mwalker> |
clearing resourceloader blobs on commonswiki to try and force a multimediaviewer message "mwscript extensions/WikimediaMaintenance/clearMessageBlobs.php --wiki=commonswiki" |
[production] |
| 23:49 |
<awight> |
updated SmashPig from 98b1f348aa55f6a3aac441db08a59ca309fade7a to 22e2923a3a030b17815181574f9ca99b38c5f2dc |
[production] |
| 23:41 |
<mwalker> |
Finished scap: SWAT deploy for MultimediaViewer, CentralNotice, and testwiki config (duration: 24m 16s) |
[production] |
| 23:16 |
<mwalker> |
Started scap: SWAT deploy for MultimediaViewer, CentralNotice, and testwiki config |
[production] |
| 23:10 |
<Krinkle> |
Running deleteEqualMessages.php on trwiki (bug 43917) |
[production] |
| 22:58 |
<yurik> |
Synchronized wmf-config/: Restoring to ZRMA for now (duration: 01m 04s) |
[production] |
| 22:22 |
<yurik> |
Synchronized wmf-config/InitialiseSettings.php: Attempting to enable new zero ext on zerowiki & ruwiki - take2 (duration: 01m 06s) |
[production] |
| 22:19 |
<^d> |
restarted elasticsearch on logstash1003, complaining about heap. |
[production] |
| 22:06 |
<yurik> |
Synchronized wmf-config/InitialiseSettings.php: Attempting to enable new zero ext on zerowiki & ruwiki (duration: 01m 12s) |
[production] |
| 21:58 |
<yurik> |
Synchronized php-1.24wmf8/extensions/JsonConfig/: (no message) (duration: 01m 11s) |
[production] |
| 21:56 |
<yurik> |
Synchronized php-1.24wmf7/extensions/JsonConfig/: (no message) (duration: 01m 09s) |
[production] |
| 21:50 |
<yurik> |
Finished scap: (no message) (duration: 25m 51s) |
[production] |
| 21:46 |
<ori> |
Disabling Puppet on mw1149. It's a former bits app server that isn't in PyBal so it isn't getting traffic. Going to stage some proposed changes for apache-config and operations/puppet there. |
[production] |
| 21:24 |
<yurik> |
Started scap: (no message) |
[production] |
| 21:05 |
<yurik> |
Finished scap: Deploying 3 new ext (JsonConfig, ZeroBanner, ZeroPortal), but they are not enabled anywhere yet (duration: 05m 03s) |
[production] |
| 21:00 |
<yurik> |
Started scap: Deploying 3 new ext (JsonConfig, ZeroBanner, ZeroPortal), but they are not enabled anywhere yet |
[production] |
| 20:07 |
<gwicke> |
deployed Parsoid 3de0dba15 |
[production] |
| 19:18 |
<bblack> |
rebooting lvs3003 for 3.13 kernel |
[production] |
| 19:18 |
<marktraceur> |
Finished scap: MultimediaViewer fixes for cards 630, 429, and 697 (duration: 18m 45s) |
[production] |
| 19:17 |
<greg-g> |
mw1151 *still* giving permission denied errors (publickey), what's the status, yo? |
[production] |
| 19:03 |
<bblack> |
rebooting lvs3002 for 3.13 kernel + XPS |
[production] |
| 18:59 |
<marktraceur> |
Started scap: MultimediaViewer fixes for cards 630, 429, and 697 |
[production] |
| 18:44 |
<ottomata> |
disabling puppet on analytics1012 to allow for more replica threads to catch up with current broker replicas...maybe :) |
[production] |
| 18:41 |
<awight> |
updated crm from b6815d29de97b80a0ab65db576213a604f0c7cb9 to c38296add61421f87e12cb5b4f3dd68bdf2340db |
[production] |
| 18:03 |
<Krinkle> |
Reloading Zuul to deploy I5d154a4002d08 |
[production] |
| 16:43 |
<bblack> |
shutting off lvs3002.esams pybal to test XPS balancing of live traffic on lvs3004.esams + 3.13 |
[production] |
| 16:30 |
<bblack> |
rebooting lvs3004 (inactive uploads LVS) for 3.13 again |
[production] |
| 14:52 |
<hashar> |
Jenkins restarting (plugin upgrades) |
[production] |