6901-6950 of 10000 results (45ms)
2015-08-24 §
09:00 <YuviPanda> starting up replicate for tools on labstore1002 [production]
09:00 <YuviPanda> cleaning up lockdir on labstore for maps and tools [production]
09:00 <YuviPanda> others replication on labstore1002 completed successfuly [production]
08:31 <YuviPanda> cleaned up others lockdir for replication on labstore1002 and started it manually [production]
06:43 <jynus> reloading dbproxy1003 service [production]
02:21 <l10nupdate@tin> Synchronized php-1.26wmf19/cache/l10n: l10nupdate for 1.26wmf19 (duration: 06m 36s) [production]
2015-08-23 §
16:54 <urandom> bouncing Cassandra on restbase1001 to apply temporary GC settings [production]
02:19 <l10nupdate@tin> Synchronized php-1.26wmf19/cache/l10n: l10nupdate for 1.26wmf19 (duration: 06m 23s) [production]
2015-08-22 §
23:08 <krenair@tin> Synchronized php-1.26wmf19/extensions/AbuseFilter/maintenance/addMissingLoggingEntries.php: (no message) (duration: 01m 05s) [production]
19:41 <YuviPanda> manually remove old snapshots from labstore1002 [production]
17:28 <chasemp> tweaking apache on iridum T109941 [production]
16:45 <chasemp> scratch that as we have mpm_prefork enabled :) [production]
16:32 <chasemp> raising values in mpm_worker.conf for iridium to to debug and hopefully head off further crashing [production]
14:44 <twentyafterfour> restarted apache2 on iridium. Segfault again. This time I at least got one clue in the log: "zend_mm_heap corrupted" [production]
09:18 <twentyafterfour> phabricator seems stable now, restarting apache2 on iridium did the trick, unfortunately we didn't learn why [production]
08:36 <twentyafterfour> restarted phd on iridium [production]
08:35 <twentyafterfour> restarted apache2 on iridium [production]
02:20 <l10nupdate@tin> Synchronized php-1.26wmf19/cache/l10n: l10nupdate for 1.26wmf19 (duration: 06m 09s) [production]
00:26 <mutante> deleting blog.sh and blog_pageviews crontab from stat1003 [production]
2015-08-21 §
23:34 <urandom> restarting Cassandra on restbase1001 to restore baseline settings [production]
23:11 <yurik> synced kartotherian [production]
22:35 <mutante> deleting held messages on mailman that are older than 1 year [production]
21:44 <mutante> had to reset list creator password for mailman - ask me if you think you should have it and don't (this is not the master pass) [production]
20:37 <ori@tin> Synchronized php-1.26wmf19/includes: I1eb8dfc: Revert Count API and hook calls, with 1:1000 sampling (duration: 01m 09s) [production]
16:06 <jynus> checksumming dewiki database, higher write rate/dbstore lag expected temporarily [production]
15:10 <ottomata> rebooting kafka broker analytics1021 to hopefully reload /dev/sdg with new disk, also will turn on hyperthreading [production]
14:13 <ottomata> rebooting analytics1056 after upgrading kernel to linux-image-3.13.0-61-generic [production]
13:57 <urandom> restarting restbase1001 to apply temporary GC setting [production]
13:33 <ottomata> stopping kafka broker on analytics1021 due to bad disk. [production]
13:30 <bblack> wiped ganglia apache access log on uranium, to free up half of the (full) rootfs [production]
10:07 <godog> enable puppet on ms-fe1/ms-be1 [production]
09:49 <godog> disable puppet on ms-fe1/ms-be1 before merging https://gerrit.wikimedia.org/r/#/c/231240/ [production]
07:06 <_joe_> restarting gitblit, because it will be decommissioned "soon"... [production]
02:34 <l10nupdate@tin> Synchronized php-1.26wmf19/cache/l10n: l10nupdate for 1.26wmf19 (duration: 11m 19s) [production]
2015-08-20 §
23:40 <ebernhardson@tin> Synchronized php-1.26wmf19/extensions/CirrusSearch/: Fix some cirrussearch logspam (duration: 00m 13s) [production]
23:30 <ebernhardson@tin> Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 12s) [production]
23:29 <ebernhardson@tin> Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 13s) [production]
23:23 <krenair@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/232854/ (duration: 00m 13s) [production]
23:22 <krenair@tin> Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/232671/ (duration: 00m 12s) [production]
23:15 <krenair@tin> Synchronized php-1.26wmf19/extensions/LiquidThreads/classes/Hooks.php: https://gerrit.wikimedia.org/r/#/c/232783/ (duration: 00m 12s) [production]
23:13 <krinkle@tin> Synchronized php-1.26wmf19/includes/resourceloader/ResourceLoaderFileModule.php: T102578 (duration: 00m 13s) [production]
23:08 <krenair@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/232782/ (duration: 00m 12s) [production]
22:47 <ori@tin> Synchronized php-1.26wmf19/includes/libs/CSSMin.php: Icc1c23a2: CSSMin: remove dot segments in relative local URLs (duration: 00m 12s) [production]
21:36 <cscott> updated Parsoid to version db6e6404f67a9f971b4fbefe9de239735426c738 [production]
21:25 <matt_flaschen> Ran FlowUpdateRevContentModelFromOccupyPages.php on all wikis [production]
20:41 <twentyafterfour> scap failed to sync to mw2180.codwf.wmnet [production]
20:41 <twentyafterfour@tin> rebuilt wikiversions.cdb and synchronized wikiversions files: wikipedia wikis to 1.26wmf19 [production]
20:38 <twentyafterfour@tin> Synchronized php-1.26wmf19: Silence the undefined index error in CirrusSearch (duration: 06m 24s) [production]
19:40 <chasemp> moving enwiki_content_1432182861 elastic shard from 1022 to 1004 due to space (1022 is at 91%) [production]
18:57 <mutante> no log bot [production]