|
2015-02-19
§
|
| 21:28 |
<gwicke> |
restbase now up on all live (3 of 6) prod nodes |
[production] |
| 21:20 |
<gwicke> |
cleanly re-initialized prod cassandra cluster after puppet run; picked up local dc from property file |
[production] |
| 20:49 |
<chasemp> |
restart ntp on mw1009 |
[production] |
| 20:15 |
<mutante> |
readding mw1062 to puppet, signing new cert and salt-key |
[production] |
| 19:54 |
<mutante> |
reinstalling mw1062 after disk has been replaced |
[production] |
| 19:28 |
<mutante> |
ran puppet on ruthenium |
[production] |
| 17:46 |
<demon> |
Synchronized php-1.25wmf17/extensions/DoubleWiki/DoubleWiki_body.php: shut up warnings finally (duration: 00m 05s) |
[production] |
| 17:42 |
<oblivian> |
Synchronized wmf-config/session.php: mc1011-12 IP change (duration: 00m 05s) |
[production] |
| 17:35 |
<kartik> |
Finished scap: ContentTranslation update (duration: 25m 31s) |
[production] |
| 17:25 |
<^d> |
jenkins stuck communicating to beta, restarting |
[production] |
| 17:10 |
<kartik> |
Started scap: ContentTranslation update |
[production] |
| 16:53 |
<_joe_> |
shutting down mc1009 and mc1010 |
[production] |
| 16:39 |
<oblivian> |
Synchronized wmf-config/session.php: mc1009-10 IP change (duration: 00m 05s) |
[production] |
| 16:23 |
<kart_> |
Updated cxserver to 395be27 |
[production] |
| 16:16 |
<kart_> |
started cxserver deployment |
[production] |
| 16:01 |
<demon> |
Synchronized wmf-config/CommonSettings-labs.php: (no message) (duration: 00m 07s) |
[production] |
| 15:49 |
<oblivian> |
Synchronized wmf-config/session.php: mc1007-8 IP change (duration: 00m 06s) |
[production] |
| 15:21 |
<_joe_> |
restarting hhvm on mw1103, mw1078,mw1032 - TC full as well. |
[production] |
| 15:17 |
<_joe_> |
restarting hhvm on mw1027, TC full |
[production] |
| 15:11 |
<_joe_> |
powering down mc1007,mc1008 |
[production] |
| 09:58 |
<AaronS> |
Deleted more bogus GlobalUserPage purge job queues |
[production] |
| 06:11 |
<springle> |
bacula-director restart to pick up m1-master CNAME |
[production] |
| 06:07 |
<springle> |
ran RT update-rt-siteconfig + apache restart to pick up m1-master CNAME |
[production] |
| 05:55 |
<springle> |
etherpad-lite restart to pick up m1-master CNAME |
[production] |
| 05:49 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Thu Feb 19 05:48:40 UTC 2015 (duration 48m 39s) |
[production] |
| 04:32 |
<ori> |
txstatsd on graphite1001: disabled profiling and returned service to normal state |
[production] |
| 04:23 |
<ori> |
restarting txstatsd on graphite1001 with --profile; will disable profiling in a few minutes. |
[production] |
| 02:41 |
<mutante> |
restarted hhvm on mw1141 (locked up, T89912?) |
[production] |
| 02:36 |
<LocalisationUpdate> |
completed (1.25wmf18) at 2015-02-19 02:35:41+00:00 |
[production] |
| 02:35 |
<l10nupdate> |
Synchronized php-1.25wmf18/cache/l10n: (no message) (duration: 00m 01s) |
[production] |
| 02:21 |
<LocalisationUpdate> |
completed (1.25wmf17) at 2015-02-19 02:20:01+00:00 |
[production] |
| 02:19 |
<l10nupdate> |
Synchronized php-1.25wmf17/cache/l10n: (no message) (duration: 00m 01s) |
[production] |
| 02:18 |
<mutante> |
restbase1004 - starting restbase service, running puppet |
[production] |
| 02:11 |
<mutante> |
restbase1004/1005 systemctl daemon-reload to run systemd-sysv-generator to make it create missing unit for restbase and unbreak puppet running the service |
[production] |
| 01:12 |
<ejegg> |
Synchronized wmf-config/CommonSettings.php: Use URLs without mobile redirects for CentralNotice (duration: 00m 07s) |
[production] |
| 00:54 |
<demon> |
Finished scap: global user page extension-list fix + l10n rebuild (duration: 15m 21s) |
[production] |
| 00:39 |
<AaronS> |
Deleted labswiki redis jobs (labswiki uses the db queue) for GlobalUserPage and flushed the queue aggregator |
[production] |
| 00:38 |
<demon> |
Started scap: global user page extension-list fix + l10n rebuild |
[production] |
| 00:33 |
<demon> |
Synchronized wmf-config/CommonSettings.php: (no message) (duration: 00m 06s) |
[production] |
| 00:26 |
<demon> |
Synchronized php-1.25wmf17/extensions/VisualEditor/modules/ve-mw/init/ve.init.mw.Target.js: (no message) (duration: 00m 06s) |
[production] |
| 00:16 |
<demon> |
Synchronized wmf-config/InitialiseSettings.php: RL image debug logs (duration: 00m 07s) |
[production] |
| 00:14 |
<demon> |
Synchronized php-1.25wmf17/includes/skins/SkinTemplate.php: (no message) (duration: 00m 05s) |
[production] |
| 00:14 |
<demon> |
Synchronized php-1.25wmf17/includes/skins/Skin.php: (no message) (duration: 00m 05s) |
[production] |
| 00:12 |
<demon> |
Synchronized php-1.25wmf18/includes/resourceloader/ResourceLoaderImage.php: fix up svg handling in RL (duration: 00m 07s) |
[production] |
| 00:12 |
<demon> |
Synchronized php-1.25wmf17/includes/resourceloader/ResourceLoaderImage.php: fix up svg handling in RL (duration: 00m 07s) |
[production] |
| 00:09 |
<demon> |
Synchronized wmf-config/InitialiseSettings-labs.php: no-op, for completeness (duration: 00m 05s) |
[production] |
| 00:04 |
<aaron> |
Synchronized php-1.25wmf16/includes/db/LoadBalancer.php: 9dc01855bca9ba322f6cb15092b29c654d74cecc (duration: 00m 05s) |
[production] |