|
2014-04-26
§
|
| 23:27 |
<aaron> |
synchronized php-1.24wmf2/includes/profiler/Profiler.php '7e20cdd2ba0381b81d3b43c8743fa4202a76bd61' |
[production] |
| 13:43 |
<hoo> |
synchronized wmf-config/InitialiseSettings-labs.php 'Syncing for cluster consistency' |
[production] |
| 13:42 |
<hoo> |
updated /a/common to {{Gerrit|Ic98928d54}}: Have Commons on Beta Labs use $stdlogo |
[production] |
| 13:26 |
<springle> |
db1016 xfs head behind tail. reverted to last snapshot volume |
[production] |
| 12:58 |
<springle> |
powercycle db1016 unresponsive |
[production] |
| 03:11 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Sat Apr 26 03:11:16 UTC 2014 (duration 11m 15s) |
[production] |
| 02:31 |
<LocalisationUpdate> |
completed (1.24wmf2) at 2014-04-26 02:31:41+00:00 |
[production] |
| 02:22 |
<LocalisationUpdate> |
completed (1.24wmf1) at 2014-04-26 02:22:41+00:00 |
[production] |
|
2014-04-25
§
|
| 20:29 |
<mwalker> |
synchronized php-1.24wmf2/extensions/WikiEditor/ 'Reverting some faulty WikiEditor code for bug 64289' |
[production] |
| 20:28 |
<mwalker> |
synchronized php-1.24wmf1/extensions/WikiEditor/ 'Reverting some faulty WikiEditor code for bug 64289' |
[production] |
| 18:02 |
<K4-713> |
adjusted antifraud filters on payments |
[production] |
| 17:08 |
<Jeff_Green> |
reenabled puppet and notifications for iodine |
[production] |
| 16:23 |
<manybubbles> |
Elasticsearch rolling restart complete. |
[production] |
| 14:47 |
<Jeff_Green> |
disabled icinga notifications for iodine too... |
[production] |
| 14:44 |
<Jeff_Green> |
puppet stopped on iodine, doing manual spamassassin training |
[production] |
| 12:58 |
<springle> |
upgrading db1047 (analytics slave) to mariadb 10 |
[production] |
| 12:28 |
<manybubbles> |
Performing rolling restart of Cirrus's Elasticsearch servers to upgrade a plugin. Low risk because it won't be used by the general public until Mondayish so a Friday push should be ok. |
[production] |
| 12:07 |
<ottomata> |
stopping puppet on analytics1026 to test more frequent runs of Camus |
[production] |
| 12:02 |
<reedy> |
synchronized wmf-config/ |
[production] |
| 11:36 |
<reedy> |
synchronized docroot and w |
[production] |
| 09:42 |
<reedy> |
synchronized wmf-config/ |
[production] |
| 09:15 |
<reedy> |
synchronized wmf-config/ 'I4a68dc8321b7b302f5e89b5adafcff096f2ac35b' |
[production] |
| 09:13 |
<reedy> |
synchronized multiversion/ 'I4a68dc8321b7b302f5e89b5adafcff096f2ac35b' |
[production] |
| 08:43 |
<reedy> |
synchronized docroot and w |
[production] |
| 08:39 |
<reedy> |
updated /a/common to {{Gerrit|I57b6d055e}}: Update flow cache version to 4.2 |
[production] |
| 07:22 |
<springle> |
up to 5x pt-table-sync running on db1048 m2 master for eventlogging migration. ok to kill if necessary |
[production] |
| 03:44 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Fri Apr 25 03:44:16 UTC 2014 (duration 44m 15s) |
[production] |
| 03:03 |
<LocalisationUpdate> |
completed (1.24wmf2) at 2014-04-25 03:03:33+00:00 |
[production] |
| 02:37 |
<LocalisationUpdate> |
completed (1.24wmf1) at 2014-04-25 02:37:06+00:00 |
[production] |
| 00:47 |
<mwalker> |
updating payments servers from e6d188f0dfcd57406acb58aa2b5bf45e48117c33 to a7fa0d64da2c56586c83cf92babb65bac857be2e for worldpay |
[production] |
| 00:29 |
<bd808|deploy> |
Ori was able to fix permissions and second scap test worked as expected |
[production] |
| 00:29 |
<bd808> |
Finished scap: no-op scap to validate I24149ab and Ie967901 (try 2) (duration: 05m 02s) |
[production] |
| 00:26 |
<bd808|deploy> |
File permissions on /srv/scap/scap/*.{py,pyc} were not consistently a+r which is needed for scap-rebuild-cdbs |
[production] |
| 00:23 |
<bd808> |
Started scap: no-op scap to validate I24149ab and Ie967901 (try 2) |
[production] |
|
2014-04-24
§
|
| 23:55 |
<bd808> |
Finished scap: no-op scap to validate I24149ab and Ie967901 (duration: 02m 51s) |
[production] |
| 23:52 |
<bd808> |
Started scap: no-op scap to validate I24149ab and Ie967901 |
[production] |
| 23:46 |
<awight> |
perform crm schema update 7018 |
[production] |
| 23:36 |
<bd808|deploy> |
Running scap-rebuild-cdbs on tin to test python port |
[production] |
| 23:17 |
<mwalker> |
synchronized wmf-config/CommonSettings.php 'Updating flow configuration {{gerrit|129589}}' |
[production] |
| 23:16 |
<mwalker> |
synchronized php-1.24wmf2/extensions/Flow 'Updating flow for {{gerrit|129589}} and {{gerrit|129604}}' |
[production] |
| 22:53 |
<AaronSchulz> |
Running PopulateImageSha1.php for all multi-versioned files on all wikis to fix broken SHA-1s |
[production] |
| 21:22 |
<springle> |
eventlogging dump loading on db1048 m2 master in screen. ok to kill if necessary |
[production] |
| 21:18 |
<hashar> |
restarting Zuul |
[production] |
| 21:01 |
<mwalker> |
updating payments from 4811f6d3d80d126c8b3c89c11d20cc6416cb58f6 to e6d188f0dfcd57406acb58aa2b5bf45e48117c33 for donationinterface / worldpay updates |
[production] |
| 20:39 |
<paravoid> |
shutting down sdtpa, cr1-sdtpa, csw1-sdtpa, msw1-sdtpa and other sdtpa hosts gone forever |
[production] |
| 20:37 |
<Coren> |
sync-apache for 126969 and 91339 |
[production] |
| 19:59 |
<reedy> |
synchronized docroot and w |
[production] |
| 19:54 |
<aaron> |
synchronized wmf-config/PoolCounterSettings-eqiad.php 'Removed redundant pool counter config' |
[production] |
| 19:00 |
<ori> |
eventlogging data streaming into db1048; db1047 consumer decom'd. |
[production] |