|
2015-02-19
§
|
| 09:58 |
<AaronS> |
Deleted more bogus GlobalUserPage purge job queues |
[production] |
| 06:11 |
<springle> |
bacula-director restart to pick up m1-master CNAME |
[production] |
| 06:07 |
<springle> |
ran RT update-rt-siteconfig + apache restart to pick up m1-master CNAME |
[production] |
| 05:55 |
<springle> |
etherpad-lite restart to pick up m1-master CNAME |
[production] |
| 05:49 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Thu Feb 19 05:48:40 UTC 2015 (duration 48m 39s) |
[production] |
| 04:32 |
<ori> |
txstatsd on graphite1001: disabled profiling and returned service to normal state |
[production] |
| 04:23 |
<ori> |
restarting txstatsd on graphite1001 with --profile; will disable profiling in a few minutes. |
[production] |
| 02:41 |
<mutante> |
restarted hhvm on mw1141 (locked up, T89912?) |
[production] |
| 02:36 |
<LocalisationUpdate> |
completed (1.25wmf18) at 2015-02-19 02:35:41+00:00 |
[production] |
| 02:35 |
<l10nupdate> |
Synchronized php-1.25wmf18/cache/l10n: (no message) (duration: 00m 01s) |
[production] |
| 02:21 |
<LocalisationUpdate> |
completed (1.25wmf17) at 2015-02-19 02:20:01+00:00 |
[production] |
| 02:19 |
<l10nupdate> |
Synchronized php-1.25wmf17/cache/l10n: (no message) (duration: 00m 01s) |
[production] |
| 02:18 |
<mutante> |
restbase1004 - starting restbase service, running puppet |
[production] |
| 02:11 |
<mutante> |
restbase1004/1005 systemctl daemon-reload to run systemd-sysv-generator to make it create missing unit for restbase and unbreak puppet running the service |
[production] |
| 01:12 |
<ejegg> |
Synchronized wmf-config/CommonSettings.php: Use URLs without mobile redirects for CentralNotice (duration: 00m 07s) |
[production] |
| 00:54 |
<demon> |
Finished scap: global user page extension-list fix + l10n rebuild (duration: 15m 21s) |
[production] |
| 00:39 |
<AaronS> |
Deleted labswiki redis jobs (labswiki uses the db queue) for GlobalUserPage and flushed the queue aggregator |
[production] |
| 00:38 |
<demon> |
Started scap: global user page extension-list fix + l10n rebuild |
[production] |
| 00:33 |
<demon> |
Synchronized wmf-config/CommonSettings.php: (no message) (duration: 00m 06s) |
[production] |
| 00:26 |
<demon> |
Synchronized php-1.25wmf17/extensions/VisualEditor/modules/ve-mw/init/ve.init.mw.Target.js: (no message) (duration: 00m 06s) |
[production] |
| 00:16 |
<demon> |
Synchronized wmf-config/InitialiseSettings.php: RL image debug logs (duration: 00m 07s) |
[production] |
| 00:14 |
<demon> |
Synchronized php-1.25wmf17/includes/skins/SkinTemplate.php: (no message) (duration: 00m 05s) |
[production] |
| 00:14 |
<demon> |
Synchronized php-1.25wmf17/includes/skins/Skin.php: (no message) (duration: 00m 05s) |
[production] |
| 00:12 |
<demon> |
Synchronized php-1.25wmf18/includes/resourceloader/ResourceLoaderImage.php: fix up svg handling in RL (duration: 00m 07s) |
[production] |
| 00:12 |
<demon> |
Synchronized php-1.25wmf17/includes/resourceloader/ResourceLoaderImage.php: fix up svg handling in RL (duration: 00m 07s) |
[production] |
| 00:09 |
<demon> |
Synchronized wmf-config/InitialiseSettings-labs.php: no-op, for completeness (duration: 00m 05s) |
[production] |
| 00:04 |
<aaron> |
Synchronized php-1.25wmf16/includes/db/LoadBalancer.php: 9dc01855bca9ba322f6cb15092b29c654d74cecc (duration: 00m 05s) |
[production] |
|
2015-02-18
§
|
| 23:51 |
<demon> |
Synchronized wmf-config/CommonSettings.php: rm no-op profile calls (duration: 00m 06s) |
[production] |
| 23:48 |
<aaron> |
Synchronized php-1.25wmf17/includes/db/LoadBalancer.php: 42a56404328547a0b8bd07f001b1c4dff67b3498 (duration: 00m 05s) |
[production] |
| 23:46 |
<legoktm> |
Synchronized wmf-config: Enable GlobalUserPage extension on all public, CentralAuth wikis (duration: 00m 05s) |
[production] |
| 23:39 |
<twentyafterfour> |
fixed symlinks. uploaded release notes. deployment finished 1.5 hours behind schedule |
[production] |
| 23:25 |
<twentyafterfour> |
Purged l10n cache for 1.25wmf16 |
[production] |
| 23:23 |
<twentyafterfour> |
rebuilt wikiversions.cdb and synchronized wikiversions files: group0 to 1.25wmf18 |
[production] |
| 23:23 |
<ori> |
HHVM on mw1141 locked up (threads stuck in __lll_lock_wait). Depooling for further investigation. |
[production] |
| 23:17 |
<twentyafterfour> |
Finished scap: testwiki to php-1.25wmf18 and rebuild l10n cache (duration: 42m 58s) |
[production] |
| 22:34 |
<twentyafterfour> |
Started scap: testwiki to php-1.25wmf18 and rebuild l10n cache |
[production] |
| 22:30 |
<twentyafterfour> |
rebuilt wikiversions.cdb and synchronized wikiversions files: rollback group0 to 1.25wmf17 |
[production] |
| 22:28 |
<twentyafterfour> |
rebuilt wikiversions.cdb and synchronized wikiversions files: group0 to 1.25wmf18 |
[production] |
| 22:24 |
<twentyafterfour> |
rebuilt wikiversions.cdb and synchronized wikiversions files: wikipedias to 1.25wmf17 |
[production] |
| 21:41 |
<subbu> |
deployed parsoid version 17f68256 |
[production] |
| 19:24 |
<bd808|LUNCH> |
pruned stale members from trebuchet minions set for scap/scap: redis-cli srem "deploy:scap/scap:minions" fenari.wikimedia.org virt0.wikimedia.org nickel.wikimedia.org searchidx1001.eqiad.wmnet |
[production] |
| 19:01 |
<godog> |
restart txstatsd on graphite1001 to flush old metrics |
[production] |
| 18:40 |
<ori> |
Synchronized wmf-config/CommonSettings.php: Id215ff962: Change $wgUDPProfilerPort to 8135. (duration: 00m 05s) |
[production] |
| 18:14 |
<oblivian> |
Synchronized wmf-config/session.php: mc1013 IP change (duration: 00m 05s) |
[production] |
| 18:11 |
<oblivian> |
Synchronized wmf-config/session.php: mc1013 IP change (duration: 00m 07s) |
[production] |
| 17:58 |
<_joe_> |
fixed scap on mw1158, moving /srv/deployment/scap away made puppet perform the redeploy |
[production] |
| 17:56 |
<_joe_> |
fixed scap on mw1154, moving /srv/deployment/scap away made puppet perform the redeploy |
[production] |
| 17:51 |
<bd808> |
fixing scap on mw1158 and mw1154 will take a root to fix bad trebuchet git clones -- cd /src/deployment/scap; sudo mv scap scap-broken; sudo salt-call deploy.fetch 'scap/scap'; sudo salt-call deploy.checkout 'scap/scap' |
[production] |
| 17:22 |
<_joe_> |
shutting down mc1014, moving to a different rack |
[production] |
| 17:19 |
<_joe_> |
mw1158 and mw1154 report broken python imports during scap |
[production] |