3001-3050 of 10000 results (33ms)
2015-05-18 §
17:55 <ori> Enabling heap profiling on mw11107 to troubleshoot T99525 [production]
17:08 <andrewbogott> starting all instances on labvirt1001 (well, the ones that were running before) [production]
16:59 <andrewbogott_> dist-upgrading labvirt1001 since it’s down anyway and we may be due for kernel updates. [production]
16:53 <andrewbogott_> rebooting labvirt1001, and frowning a lot [production]
15:59 <krenair> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/209286/ and https://gerrit.wikimedia.org/r/#/c/211407/ - should be no-ops (duration: 00m 20s) [production]
15:36 <marktraceur> Synchronized php-1.26wmf6/includes/: [SWAT] [wmf6] resourceloader: Don't cache minification of user.tokens (duration: 00m 19s) [production]
15:24 <marktraceur> Synchronized php-1.26wmf6/includes/Title.php: [SWAT] [wmf6] Log callers that trigger Title::newFromText $text type warning (duration: 00m 46s) [production]
15:23 <marktraceur> Synchronized php-1.26wmf5/includes/Title.php: [SWAT] [wmf5] Log callers that trigger Title::newFromText $text type warning (duration: 00m 15s) [production]
15:07 <marktraceur> Synchronized wmf-config/InitialiseSettings.php: [SWAT] [config] Add wikis for deployment on 2015-05-18 (duration: 00m 29s) [production]
14:35 <andrewbogott> disabling puppet on labnet1001 to debug dnsmasq [production]
14:07 <_joe_> restarting HHVM on mw1107 - memory leak probably happening [production]
13:38 <aude> Synchronized wmf-config/InitialiseSettings-labs.php: Remove beta-specific Graph settings (duration: 01m 46s) [production]
13:34 <aude> Synchronized wmf-config/InitialiseSettings.php: Enable arbitrary access on enwikivoyage, fawiki, and hewiki, and graph extension everywhere (duration: 00m 57s) [production]
13:31 <aude> Synchronized php-1.26wmf6/extensions/Wikidata: Fix rdf dump script (duration: 03m 23s) [production]
13:27 <jynus> Synchronized wmf-config/db-eqiad.php: repool db1063 after warmup period (duration: 01m 01s) [production]
13:01 <jynus> Synchronized wmf-config/db-eqiad.php: repool db1063 (duration: 00m 17s) [production]
11:13 <yurik> deployed graphoid update to fix https://phabricator.wikimedia.org/T99349 [production]
11:10 <jynus> Synchronized wmf-config/db-eqiad.php: depool db1063 (duration: 01m 00s) [production]
11:07 <jynus> depooling db1063 from cluster for maintenance [production]
09:02 <godog> loss on ulsfo-eqiad, depooled ulsfo [production]
05:18 <LocalisationUpdate> ResourceLoader cache refresh completed at Mon May 18 05:17:50 UTC 2015 (duration 17m 49s) [production]
02:46 <LocalisationUpdate> completed (1.26wmf6) at 2015-05-18 02:45:52+00:00 [production]
02:42 <l10nupdate> Synchronized php-1.26wmf6/cache/l10n: (no message) (duration: 05m 35s) [production]
02:27 <LocalisationUpdate> completed (1.26wmf5) at 2015-05-18 02:25:54+00:00 [production]
02:21 <l10nupdate> Synchronized php-1.26wmf5/cache/l10n: (no message) (duration: 06m 24s) [production]
2015-05-17 §
05:06 <LocalisationUpdate> ResourceLoader cache refresh completed at Sun May 17 05:05:16 UTC 2015 (duration 5m 15s) [production]
02:44 <LocalisationUpdate> completed (1.26wmf6) at 2015-05-17 02:43:13+00:00 [production]
02:39 <l10nupdate> Synchronized php-1.26wmf6/cache/l10n: (no message) (duration: 05m 18s) [production]
02:25 <LocalisationUpdate> completed (1.26wmf5) at 2015-05-17 02:24:09+00:00 [production]
02:20 <l10nupdate> Synchronized php-1.26wmf5/cache/l10n: (no message) (duration: 06m 10s) [production]
2015-05-16 §
13:27 <manybubbles> that was the last server in the elasticsearch rolling restart. all done. now we have new versions of the plugins. Lets try not to do that again. [production]
13:25 <manybubbles> es-tool restart-fast on elastic1031 [production]
09:15 <godog> bounce hhvm on mw1196 [production]
09:10 <godog> bounce hhvm on mw1141 [production]
07:49 <godog> restart hhvm on mw1234, still pushing xhprof metrics [production]
06:03 <_joe_> killed nrpe on labvirt1003 - see T99341 [production]
05:02 <LocalisationUpdate> ResourceLoader cache refresh completed at Sat May 16 05:01:02 UTC 2015 (duration 1m 1s) [production]
04:11 <andrewbogott> restarting sshd and generally poking around on labvirt1003 [production]
02:47 <LocalisationUpdate> completed (1.26wmf6) at 2015-05-16 02:46:08+00:00 [production]
02:43 <l10nupdate> Synchronized php-1.26wmf6/cache/l10n: (no message) (duration: 04m 55s) [production]
02:29 <LocalisationUpdate> completed (1.26wmf5) at 2015-05-16 02:28:37+00:00 [production]
02:25 <l10nupdate> Synchronized php-1.26wmf5/cache/l10n: (no message) (duration: 05m 55s) [production]
2015-05-15 §
22:35 <ejegg> updated crm from 03eb4cff1b009e8abaceec250f9a1c5d1f3c6b18 to 7ffe0cefb019828a09c9369187f14518847b5f41 [production]
19:44 <manybubbles> elastic1027 es-tool restart-fast [production]
19:37 <awight> update crm from 2a2336655737a2cd1d3cc24624d1e8475e4cf039 to 03eb4cff1b009e8abaceec250f9a1c5d1f3c6b18 [production]
18:29 <manybubbles> elastic1026 es-tool restart-fast [production]
18:28 <godog> bounce hhvm on mw1118 [production]
17:55 <jynus> migrating of db service from virt1000 to m5-master aborted, service continues on virt1000 [production]
17:44 <manybubbles> rolling restart almost done on elastic1025 - 1026 is next! [production]
17:33 <andrewbogott> updating qemu binaries on labvirt1001 [production]