|
2015-04-27
§
|
| 15:27 |
<thcipriani> |
Synchronized wmf-config/InitialiseSettings.php: SWAT [[gerrit:204467]] (duration: 00m 29s) |
[production] |
| 15:20 |
<thcipriani> |
Synchronized wmf-config/flaggedrevs.php: SWAT [[gerrit:206647]] (duration: 00m 14s) |
[production] |
| 15:09 |
<thcipriani> |
Synchronized wmf-config/InitialiseSettings.php: SWAT [[gerrit:206648]] (duration: 00m 51s) |
[production] |
| 14:50 |
<godog> |
upgrade statsite on graphite1001 |
[production] |
| 14:04 |
<bblack> |
puppet disabled on caches while apt upgrades run... |
[production] |
| 13:28 |
<paravoid> |
upgrading pfw-codfw to newer junos |
[production] |
| 12:31 |
<paravoid> |
upgrading pfw-eqiad to newer junos |
[production] |
| 08:19 |
<godog> |
ms-be101[678] object weight to 3000 |
[production] |
| 08:01 |
<_joe_> |
installed hhvm 3.6 on deployment-mediawiki02 |
[releng] |
| 05:09 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Mon Apr 27 05:08:23 UTC 2015 (duration 8m 22s) |
[production] |
|
2015-04-26
§
|
| 23:31 |
<paravoid> |
draining esams for planned upstream network maintenance (00:00-04:00 UTC) |
[production] |
| 08:16 |
<jgage> |
ms-be1007 was unresponsive for ~6 hours, "soft lockup" output on console. rebooted. |
[production] |
| 06:09 |
<thcipriani|afk> |
rm scap l10nfiles from /tmp on deployment-bastion root partition 100% again... |
[releng] |
| 05:29 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Sun Apr 26 05:28:11 UTC 2015 (duration 28m 10s) |
[production] |
| 03:37 |
<ori> |
Previous sync-file was for: If296f3d3c: Set max_execution_time in CommonSettings.php |
[production] |
| 03:36 |
<ori> |
Synchronized wmf-config/CommonSettings.php: (no message) (duration: 00m 14s) |
[production] |
| 03:05 |
<jgage> |
mw2027 rebooted unexpectedly, no clues in syslog. afterward i dist-upgraded, including new kernel. |
[production] |
| 02:56 |
<LocalisationUpdate> |
completed (1.26wmf3) at 2015-04-26 02:55:00+00:00 |
[production] |
| 02:52 |
<l10nupdate> |
Synchronized php-1.26wmf3/cache/l10n: (no message) (duration: 06m 38s) |
[production] |
| 02:35 |
<LocalisationUpdate> |
completed (1.26wmf2) at 2015-04-26 02:33:59+00:00 |
[production] |
| 02:30 |
<l10nupdate> |
Synchronized php-1.26wmf2/cache/l10n: (no message) (duration: 07m 39s) |
[production] |
|
2015-04-25
§
|
| 16:00 |
<thcipriani|afk> |
manually ran logrotate on deployment-jobrunner01, root partition at 100% |
[releng] |
| 15:26 |
<subbu> |
deployed parsoid version fca17070 (cherry-pick of d2135c6b on parsoid master) |
[production] |
| 15:16 |
<thcipriani|afk> |
clear /tmp/scap files on deployment-bastion, root partition at 100% |
[releng] |
| 09:57 |
<_joe_> |
nuked User:Niteshift/MVneu/2015_April_21-30 on commonswiki |
[production] |
| 05:18 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Sat Apr 25 05:17:41 UTC 2015 (duration 17m 40s) |
[production] |
| 04:30 |
<mattflaschen> |
Synchronized wmf-config/CommonSettings-labs.php: Sync Beta Cluster-only change (for MW UI beta feature) (duration: 00m 16s) |
[production] |
| 04:30 |
<mattflaschen> |
Synchronized wmf-config/InitialiseSettings-labs.php: Sync Beta Cluster-only change (for MW UI beta feature) (duration: 00m 16s) |
[production] |
| 02:43 |
<LocalisationUpdate> |
completed (1.26wmf3) at 2015-04-25 02:41:54+00:00 |
[production] |
| 02:39 |
<l10nupdate> |
Synchronized php-1.26wmf3/cache/l10n: (no message) (duration: 05m 56s) |
[production] |
| 02:24 |
<LocalisationUpdate> |
completed (1.26wmf2) at 2015-04-25 02:23:33+00:00 |
[production] |
| 02:20 |
<l10nupdate> |
Synchronized php-1.26wmf2/cache/l10n: (no message) (duration: 07m 48s) |
[production] |
|
2015-04-24
§
|
| 22:14 |
<krinkle> |
Synchronized php-1.26wmf2/includes/resourceloader/ResourceLoaderModule.php: Ibedc31659ed (duration: 00m 14s) |
[production] |
| 22:13 |
<krinkle> |
Synchronized php-1.26wmf3/includes/resourceloader/ResourceLoaderModule.php: Ibedc31659ed (duration: 00m 17s) |
[production] |
| 21:11 |
<ottomata> |
started hdfs balancer run |
[production] |
| 20:34 |
<ori> |
Deployed I1fa012ca1: HHVM: Limit wall execution time of FCGI reqs to 290s |
[production] |
| 19:53 |
<aaron> |
Synchronized wmf-config/db-codfw.php: Removed unused "max threads" stuff (duration: 00m 15s) |
[production] |
| 19:52 |
<subbu> |
revert parsoid deploy to 3311936a |
[production] |
| 19:52 |
<aaron> |
Synchronized wmf-config/db-eqiad.php: Removed unused "max threads" stuff (duration: 00m 14s) |
[production] |
| 19:42 |
<demon> |
Synchronized php-1.26wmf2/extensions/CirrusSearch/includes/Searcher.php: undo debugging (duration: 00m 14s) |
[production] |
| 19:40 |
<demon> |
Synchronized php-1.26wmf2/extensions/CirrusSearch/includes/Searcher.php: debugging (duration: 00m 17s) |
[production] |
| 18:58 |
<ori> |
restarted puppetmaster on palladium as well |
[production] |
| 18:56 |
<ori> |
restarted apache2 on palladium |
[production] |
| 18:10 |
<Krinkle> |
cvn Promited Rxy from member to projectadmin |
[releng] |
| 18:01 |
<thcipriani> |
ran sudo chown -R mwdeploy:mwdeploy /srv/mediawiki on deployment-bastion to fix beta-scap-eqiad, hopefully |
[releng] |
| 17:26 |
<thcipriani> |
remove deployment-prep from domain in /etc/puppet/puppet.conf on deployment-stream, puppet now OK |
[releng] |
| 17:20 |
<thcipriani> |
rm stale lock on deployment-rsync01, puppet fine |
[releng] |
| 17:10 |
<thcipriani> |
gzip /var/log/account/pacct.0 on deployment-bastion: ought to revisit logrotate on that instance. |
[releng] |
| 17:00 |
<thcipriani> |
rm stale /var/lib/puppet/state/agent_catalog_run.lock on deployment-kafka02 |
[releng] |
| 16:06 |
<andrewbogott> |
dist-upgrade (including kernel upgrade to 3.13.0-49-generic) on labvirt1004, rebooting |
[production] |