7051-7100 of 10000 results (50ms)
2016-04-18 §
09:19 <godog> depool restbase100[56].eqiad.wmnet, about to get decomissioned [production]
09:17 <godog> repool restbase2006 after raid expansion [production]
09:08 <jynus@tin> Synchronized wmf-config/db-codfw.php: Update master comments in preparation for dc failover (duration: 00m 26s) [production]
09:07 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Update master comments in preparation for dc failover (duration: 01m 41s) [production]
07:02 <jynus> changing binlog_format to MIXED on db2018 [production]
2016-04-17 §
21:51 <urandom> Decommissioning restbase1005.eqiad.wmnet : T95253 [production]
21:50 <urandom> `systemctl mask cassandra' on restbase1006.eqiad.wmnet (node is decommissioned) : T95253 [production]
00:10 <urandom> Decommissioning restbase1006.eqiad.wmnet : T95253 [production]
2016-04-16 §
14:25 <andrewbogott> rebooting mw1132 — OOM [production]
14:24 <andrewbogott> rebooting mw1134 — OOM [production]
10:34 <jynus> recreating _counters table on s3 to solve replication issues [production]
10:08 <jynus> recreating hitcounter table on s3 to solve replication issues [production]
09:31 <volans> Skipped on dbstore1002 query from replica: 'DELETE FROM `bawiktionary`.`hitcounter`' [production]
09:31 <jynus> importing sys schema to db1075 [production]
06:44 <akosiaris> restart fermium to apply extra vcpus assignment [production]
06:23 <volans> Stopped and restarted replica on dbstore2002 for s3 to "unstuck" the replica [production]
02:31 <l10nupdate@tin> ResourceLoader cache refresh completed at Sat Apr 16 02:31:33 UTC 2016 (duration 9m 11s) [production]
02:22 <mwdeploy@tin> sync-l10n completed (1.27.0-wmf.21) (duration: 09m 03s) [production]
02:16 <urandom> Bootstraping restbase1009-a.eqiad.wmnet : T95253 [production]
2016-04-15 §
22:28 <mutante> rebooting bast4001 - debugging install issue [production]
21:04 <volans@tin> Synchronized wmf-config/db-eqiad.php: Repool new db1075,1077,1078 after TLS upgrade on s3 - T111654 (duration: 00m 36s) [production]
16:08 <demon@tin> Synchronized wmf-config/CommonSettings.php: more liberal initialisesettings invalidation (duration: 00m 42s) [production]
15:34 <godog> remove cassandra metrics for restbase100[1234]* restbase100[789] restbase2004 - T132771 [production]
14:40 <gehel> reindexing all wikis after the switch to codfw (T132762) [production]
14:06 <urandom> start decommission of restbase1009-a.eqiad.wmnet : T95253 [production]
12:15 <gehel> increase max request size for elasticsearch [production]
12:14 <volans> Re-arrange s3 replica topology: making codfw replicate from db1075 (this time for real) - T111654 [production]
12:08 <bblack> experimenting on carbon HTTP config (apt/mirrors/ubuntu.wm.o) - watch out for installer / package-update issues! [production]
12:00 <gehel> remove maintenance from wdqs1002 [production]
10:50 <volans@tin> Synchronized wmf-config/db-eqiad.php: Depool new db1075,1077,1078 to upgrade TLS on s3 - T111654 (duration: 00m 41s) [production]
10:37 <volans@tin> Synchronized wmf-config/db-eqiad.php: Repool db1042 after TLS upgrade on s4 - T111654 (duration: 00m 30s) [production]
10:21 <_joe_> restarted zuul, zuul-merger on gallium [production]
10:10 <TimStarling> on helium: scheduled restore of home_pmtpa to bast4001 [production]
09:23 <volans> Re-arrange s3 replica topology: making codfw replicate from db1075 - T111654 [production]
09:01 <gehel> reenabling wdqs1002 in varnish rotation after reinstall (T132387) [production]
08:09 <volans@tin> Synchronized wmf-config/db-eqiad.php: Depool db1042 to upgrade TLS on s4 - T111654 (duration: 00m 36s) [production]
08:05 <volans> starting TLS upgrade for shard s4 T111654 [production]
08:00 <gehel> removing empty log archives from Fluorine (T132324) [production]
07:40 <moritzm> rebooting oresrdb* to Linux 4.4 [production]
07:17 <moritzm> rebooting oxygen for kernel update to 4.4 [production]
02:30 <l10nupdate@tin> ResourceLoader cache refresh completed at Fri Apr 15 02:30:21 UTC 2016 (duration 8m 55s) [production]
02:21 <mwdeploy@tin> sync-l10n completed (1.27.0-wmf.21) (duration: 08m 28s) [production]
2016-04-14 §
23:13 <demon@tin> Synchronized portals: (no message) (duration: 00m 29s) [production]
23:12 <demon@tin> Synchronized portals/prod/wikipedia.org/assets: (no message) (duration: 00m 29s) [production]
23:11 <demon@tin> Synchronized php-1.27.0-wmf.21/includes/resourceloader/ResourceLoaderSpecialCharacterDataModule.php: I3e26d08a (duration: 00m 30s) [production]
23:08 <demon@tin> Synchronized wmf-config/InitialiseSettings.php: Add images.unsplash.com to $wgCopyUploadsDomains (duration: 00m 33s) [production]
23:06 <demon@tin> Synchronized portals/: updating to master, removing top-links A/B test (duration: 00m 45s) [production]
21:57 <bd808@tin> Synchronized php-1.27.0-wmf.21/extensions/ContentTranslation: Enable europeana2802016 campaign (T125626) (duration: 00m 34s) [production]
21:44 <csteipp@tin> Synchronized wmf-config/CommonSettings-labs.php: Syncing labs config change (duration: 00m 27s) [production]
21:43 <csteipp@tin> Synchronized wmf-config/InitialiseSettings-labs.php: Syncing labs config change (duration: 00m 34s) [production]