6351-6400 of 10000 results (30ms)
2014-04-27 §
14:49 <paravoid> stopping pybal on lvs300[1-4] to avoid the logspam [production]
05:31 <springle> mariadb sql dump in progress db1048 /a for rebuilding db1046. ok to kill if necessary [production]
03:08 <LocalisationUpdate> ResourceLoader cache refresh completed at Sun Apr 27 03:08:01 UTC 2014 (duration 8m 0s) [production]
02:28 <LocalisationUpdate> completed (1.24wmf2) at 2014-04-27 02:28:32+00:00 [production]
02:19 <LocalisationUpdate> completed (1.24wmf1) at 2014-04-27 02:19:43+00:00 [production]
2014-04-26 §
23:27 <aaron> synchronized php-1.24wmf2/includes/profiler/Profiler.php '7e20cdd2ba0381b81d3b43c8743fa4202a76bd61' [production]
13:43 <hoo> synchronized wmf-config/InitialiseSettings-labs.php 'Syncing for cluster consistency' [production]
13:42 <hoo> updated /a/common to {{Gerrit|Ic98928d54}}: Have Commons on Beta Labs use $stdlogo [production]
13:26 <springle> db1016 xfs head behind tail. reverted to last snapshot volume [production]
12:58 <springle> powercycle db1016 unresponsive [production]
03:11 <LocalisationUpdate> ResourceLoader cache refresh completed at Sat Apr 26 03:11:16 UTC 2014 (duration 11m 15s) [production]
02:31 <LocalisationUpdate> completed (1.24wmf2) at 2014-04-26 02:31:41+00:00 [production]
02:22 <LocalisationUpdate> completed (1.24wmf1) at 2014-04-26 02:22:41+00:00 [production]
2014-04-25 §
20:29 <mwalker> synchronized php-1.24wmf2/extensions/WikiEditor/ 'Reverting some faulty WikiEditor code for bug 64289' [production]
20:28 <mwalker> synchronized php-1.24wmf1/extensions/WikiEditor/ 'Reverting some faulty WikiEditor code for bug 64289' [production]
18:02 <K4-713> adjusted antifraud filters on payments [production]
17:08 <Jeff_Green> reenabled puppet and notifications for iodine [production]
16:23 <manybubbles> Elasticsearch rolling restart complete. [production]
14:47 <Jeff_Green> disabled icinga notifications for iodine too... [production]
14:44 <Jeff_Green> puppet stopped on iodine, doing manual spamassassin training [production]
12:58 <springle> upgrading db1047 (analytics slave) to mariadb 10 [production]
12:28 <manybubbles> Performing rolling restart of Cirrus's Elasticsearch servers to upgrade a plugin. Low risk because it won't be used by the general public until Mondayish so a Friday push should be ok. [production]
12:07 <ottomata> stopping puppet on analytics1026 to test more frequent runs of Camus [production]
12:02 <reedy> synchronized wmf-config/ [production]
11:36 <reedy> synchronized docroot and w [production]
09:42 <reedy> synchronized wmf-config/ [production]
09:15 <reedy> synchronized wmf-config/ 'I4a68dc8321b7b302f5e89b5adafcff096f2ac35b' [production]
09:13 <reedy> synchronized multiversion/ 'I4a68dc8321b7b302f5e89b5adafcff096f2ac35b' [production]
08:43 <reedy> synchronized docroot and w [production]
08:39 <reedy> updated /a/common to {{Gerrit|I57b6d055e}}: Update flow cache version to 4.2 [production]
07:22 <springle> up to 5x pt-table-sync running on db1048 m2 master for eventlogging migration. ok to kill if necessary [production]
03:44 <LocalisationUpdate> ResourceLoader cache refresh completed at Fri Apr 25 03:44:16 UTC 2014 (duration 44m 15s) [production]
03:03 <LocalisationUpdate> completed (1.24wmf2) at 2014-04-25 03:03:33+00:00 [production]
02:37 <LocalisationUpdate> completed (1.24wmf1) at 2014-04-25 02:37:06+00:00 [production]
00:47 <mwalker> updating payments servers from e6d188f0dfcd57406acb58aa2b5bf45e48117c33 to a7fa0d64da2c56586c83cf92babb65bac857be2e for worldpay [production]
00:29 <bd808|deploy> Ori was able to fix permissions and second scap test worked as expected [production]
00:29 <bd808> Finished scap: no-op scap to validate I24149ab and Ie967901 (try 2) (duration: 05m 02s) [production]
00:26 <bd808|deploy> File permissions on /srv/scap/scap/*.{py,pyc} were not consistently a+r which is needed for scap-rebuild-cdbs [production]
00:23 <bd808> Started scap: no-op scap to validate I24149ab and Ie967901 (try 2) [production]
2014-04-24 §
23:55 <bd808> Finished scap: no-op scap to validate I24149ab and Ie967901 (duration: 02m 51s) [production]
23:52 <bd808> Started scap: no-op scap to validate I24149ab and Ie967901 [production]
23:46 <awight> perform crm schema update 7018 [production]
23:36 <bd808|deploy> Running scap-rebuild-cdbs on tin to test python port [production]
23:17 <mwalker> synchronized wmf-config/CommonSettings.php 'Updating flow configuration {{gerrit|129589}}' [production]
23:16 <mwalker> synchronized php-1.24wmf2/extensions/Flow 'Updating flow for {{gerrit|129589}} and {{gerrit|129604}}' [production]
22:53 <AaronSchulz> Running PopulateImageSha1.php for all multi-versioned files on all wikis to fix broken SHA-1s [production]
21:22 <springle> eventlogging dump loading on db1048 m2 master in screen. ok to kill if necessary [production]
21:18 <hashar> restarting Zuul [production]
21:01 <mwalker> updating payments from 4811f6d3d80d126c8b3c89c11d20cc6416cb58f6 to e6d188f0dfcd57406acb58aa2b5bf45e48117c33 for donationinterface / worldpay updates [production]
20:39 <paravoid> shutting down sdtpa, cr1-sdtpa, csw1-sdtpa, msw1-sdtpa and other sdtpa hosts gone forever [production]