3351-3400 of 10000 results (26ms)
2017-06-26 §
06:45 <marostegui> Drop table wikilove_image_log from s4 - T127219 [production]
06:44 <marostegui> Drop table wikilove_image_log from s6 - T127219 [production]
06:36 <marostegui> Deploy alter table s7 - db1086 - T166208 [production]
06:35 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1086 - T166208 (duration: 00m 46s) [production]
06:26 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Remove comments from db1041 long running alter status - T166208 (duration: 00m 47s) [production]
03:01 <l10nupdate@tin> ResourceLoader cache refresh completed at Mon Jun 26 03:01:35 UTC 2017 (duration 6m 52s) [production]
02:54 <l10nupdate@tin> scap sync-l10n completed (1.30.0-wmf.6) (duration: 08m 04s) [production]
02:27 <l10nupdate@tin> scap sync-l10n completed (1.30.0-wmf.5) (duration: 08m 03s) [production]
2017-06-25 §
09:00 <elukey> Executing 'sudo -u _graphite find /var/lib/carbon/whisper/eventstreams/rdkafka -type f -mtime +15 -delete' on graphite1001 to free some space (/var/lib/carbon filling up) - T1075 [production]
2017-06-23 §
23:42 <akosiaris> bounce celery-ores-worker on scb1004 [production]
19:38 <ppchelko@tin> Finished deploy [changeprop/deploy@ffabd13]: Re-enable ORES rules back (duration: 01m 07s) [production]
19:37 <ppchelko@tin> Started deploy [changeprop/deploy@ffabd13]: Re-enable ORES rules back [production]
19:34 <akosiaris> restart celery-ores-workers on scb1001, scb1002, scb1003, leave scb1004 alone [production]
18:39 <godog> roll restart celery-ores-worker in codfw [production]
17:01 <mobrovac@tin> Finished deploy [changeprop/deploy@1f45fae]: Temporary disable ORES (ongoing outage) (duration: 01m 19s) [production]
16:59 <mobrovac@tin> Started deploy [changeprop/deploy@1f45fae]: Temporary disable ORES (ongoing outage) [production]
16:44 <mobrovac> scb1001 disabling puppet [production]
16:34 <akosiaris> restart celery ores worker on scb1003 [production]
15:54 <hashar_> Restarted Jenkins [production]
15:45 <godog> bounce celery-ores-worker on scb1001 with logging level INFO [production]
13:51 <akosiaris> issue flashdb on oresrdb1001:6379 [production]
13:21 <akosiaris> issue flashdb on oresrdb1001:6379 [production]
13:13 <akosiaris> bump uwsgi-ores and celery-ores-worker on scb100* [production]
12:38 <akosiaris> disable changeprop due to ORES issues [production]
12:26 <Amir1> restarting celery and uwsgi on all scb nodes in eqiad [production]
11:55 <Amir1> restarted uwsgi-ores and celery-ores-worker services in scb1003 [production]
11:45 <ema> scb1001: restart pdfrender.service [production]
09:55 <elukey> reboot mw1250-53 for kernel updates [production]
09:27 <jynus> reapplying dns change - small downtime on tendril until puppet deploy and run [production]
08:38 <jynus> deploying dns change to tendril [production]
06:17 <mutante> releases1001 - systemctl reset-failed to clear Icinga systemd status CRIT - service puppet [production]
06:17 <marostegui> Deploy alter table on db1041 - s7 - T166208 [production]
06:15 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Add comments to db1041 long running alter status - T166208 (duration: 00m 46s) [production]
06:08 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2066 - T168354 (duration: 00m 46s) [production]
05:59 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1026 - T166207 (duration: 00m 47s) [production]
00:15 <mutante> RT (ununpentium) installing pending package upgrades [production]
2017-06-22 §
23:15 <Dereckson> kbp.wikipedia wiki creation done. [production]
23:11 <dereckson@tin> Synchronized wmf-config/interwiki.php: Add kbp.wikipedia to interwiki map (T160868) (duration: 00m 46s) [production]
23:07 <dereckson@tin> Synchronized wmf-config/InitialiseSettings.php: Add kbp.wikipedia to interwiki map (T160868) (duration: 00m 47s) [production]
22:56 <dereckson@tin> Synchronized wmf-config/InitialiseSettings.php: Initial configuration for kbp.wikipedia (T160868) (duration: 00m 45s) [production]
22:54 <dereckson@tin> Synchronized langlist: +kbp (T160868) (duration: 00m 46s) [production]
22:53 <dereckson@tin> rebuilt wikiversions.php and synchronized wikiversions files: +kbpwiki (T160868) [production]
22:52 <dereckson@tin> Synchronized dblists: (no justification provided) (duration: 00m 48s) [production]
22:51 <Dereckson> Create tables for kbpwiki (T160868) [production]
21:43 <RainbowSprinkles> gerrit: Stopping momentarily, reindexing accounts [production]
21:03 <andrewbogott> restarting rabbitmq-server on labcontrol1001 [production]
20:34 <mutante> icinga - re-enabling disabled notifications for IPMI temp checks on some mc* and mw* hosts where check is fine and OK [production]
20:21 <andrewbogott> labtestnet2001 turning neutron debug logs off because they're flooding the (very small) '/' partition [production]
19:52 <twentyafterfour> the train is currently blocked by https://phabricator.wikimedia.org/T168681 [production]
19:31 <thcipriani@tin> Finished scap: SWAT: [[gerrit:360889|Translation updates for QuickSurveys]] T131949 (duration: 22m 10s) [production]