1301-1350 of 10000 results (17ms)
2015-04-28 §
12:36 <springle> xtrabackup clone db2019 to db2044 [production]
12:34 <springle> xtrabackup clone db2018 to db2043 [production]
05:31 <LocalisationUpdate> ResourceLoader cache refresh completed at Tue Apr 28 05:30:47 UTC 2015 (duration 30m 46s) [production]
02:52 <LocalisationUpdate> completed (1.26wmf3) at 2015-04-28 02:51:34+00:00 [production]
02:50 <ottomata> 'kafka preferred-replica-election' [production]
02:48 <l10nupdate> Synchronized php-1.26wmf3/cache/l10n: (no message) (duration: 08m 32s) [production]
02:29 <LocalisationUpdate> completed (1.26wmf2) at 2015-04-28 02:28:11+00:00 [production]
02:25 <bblack> restarted apache2 on palladium - it was throwing infinite 500 errors due to some mod_passenger issue... [production]
02:24 <l10nupdate> Synchronized php-1.26wmf2/cache/l10n: (no message) (duration: 10m 17s) [production]
01:45 <bblack> rebooting analytics1013 (not 1016) [production]
01:45 <bblack> rebooting analytics1016 [production]
00:37 <bblack> rebooting cp3030 [production]
00:13 <catrope> Synchronized php-1.26wmf3/extensions/Flow: SWAT (duration: 00m 28s) [production]
00:12 <catrope> Synchronized php-1.26wmf2/extensions/Flow: SWAT (duration: 00m 41s) [production]
00:11 <catrope> Synchronized php-1.26wmf3/extensions/WikimediaEvents/: SWAT (duration: 00m 45s) [production]
2015-04-27 §
23:33 <catrope> Synchronized wmf-config/CommonSettings.php: Re-enable same-domain RESTbase entry point for VE (duration: 00m 22s) [production]
23:29 <catrope> Synchronized wmf-config/InitialiseSettings.php: SWAT (duration: 00m 26s) [production]
23:28 <catrope> Synchronized wmf-config/flaggedrevs.php: Remove autoreview group on frwikinews (duration: 00m 35s) [production]
22:43 <mutante> racreset on analytics1016 because no console [production]
22:36 <ottomata> powercycled analytics1016 after it is unreachable. [production]
20:36 <subbu> deployed parsoid sha ebdac59b [production]
19:47 <mutante> apt-get upgrade on iron (incl. apt itself, gnupg, ssl) [production]
17:53 <mutante> temp stopped icinga-wm [production]
17:22 <aaron> Synchronized php-1.26wmf2/includes/media/DjVu.php: 40d702b8d2d023d6f701e4aeb082b62b7adf2f0f (duration: 00m 19s) [production]
17:20 <aaron> Synchronized php-1.26wmf3/includes/media/DjVu.php: b980b0a9457b2f98a502cfe36edfc75300c7952f (duration: 00m 27s) [production]
17:05 <aaron> Synchronized wmf-config/db-eqiad.php: Lowered innodb_lock_wait_timeout from defaults (duration: 00m 27s) [production]
17:03 <aaron> Synchronized wmf-config/db-codfw.php: Lowered innodb_lock_wait_timeout from defaults (duration: 00m 22s) [production]
17:03 <aaron> Synchronized wmf-config/jobqueue-eqiad.php: Set to .1 (duration: 00m 11s) [production]
17:02 <aaron> Synchronized wmf-config/jobqueue-codfw.php: Set to .1 (duration: 00m 27s) [production]
16:24 <thcipriani> Synchronized wmf-config/InitialiseSettings.php: Extended SWAT [[gerrit:206822]] (duration: 00m 26s) [production]
16:16 <godog> boostrap cassandra on xenon [production]
16:02 <thcipriani> Synchronized wmf-config/InitialiseSettings.php: SWAT [[gerrit:201897]] (duration: 00m 22s) [production]
15:55 <thcipriani> Synchronized wmf-config/flaggedrevs.php: SWAT [[gerrit:199321]] (duration: 00m 17s) [production]
15:51 <thcipriani> Synchronized wmf-config/flaggedrevs.php: SWAT [[gerrit:206650]] no-op whitespace changes (duration: 00m 22s) [production]
15:42 <thcipriani> Synchronized wmf-config/InitialiseSettings.php: SWAT [[gerrit:206727]] and [[gerrit:206786]] (duration: 00m 16s) [production]
15:27 <thcipriani> Synchronized wmf-config/InitialiseSettings.php: SWAT [[gerrit:204467]] (duration: 00m 29s) [production]
15:20 <thcipriani> Synchronized wmf-config/flaggedrevs.php: SWAT [[gerrit:206647]] (duration: 00m 14s) [production]
15:09 <thcipriani> Synchronized wmf-config/InitialiseSettings.php: SWAT [[gerrit:206648]] (duration: 00m 51s) [production]
14:50 <godog> upgrade statsite on graphite1001 [production]
14:04 <bblack> puppet disabled on caches while apt upgrades run... [production]
13:28 <paravoid> upgrading pfw-codfw to newer junos [production]
12:31 <paravoid> upgrading pfw-eqiad to newer junos [production]
08:19 <godog> ms-be101[678] object weight to 3000 [production]
05:09 <LocalisationUpdate> ResourceLoader cache refresh completed at Mon Apr 27 05:08:23 UTC 2015 (duration 8m 22s) [production]
2015-04-26 §
23:31 <paravoid> draining esams for planned upstream network maintenance (00:00-04:00 UTC) [production]
08:16 <jgage> ms-be1007 was unresponsive for ~6 hours, "soft lockup" output on console. rebooted. [production]
05:29 <LocalisationUpdate> ResourceLoader cache refresh completed at Sun Apr 26 05:28:11 UTC 2015 (duration 28m 10s) [production]
03:37 <ori> Previous sync-file was for: If296f3d3c: Set max_execution_time in CommonSettings.php [production]
03:36 <ori> Synchronized wmf-config/CommonSettings.php: (no message) (duration: 00m 14s) [production]
03:05 <jgage> mw2027 rebooted unexpectedly, no clues in syslog. afterward i dist-upgraded, including new kernel. [production]