|
2015-02-19
ยง
|
| 21:20 |
<gwicke> |
cleanly re-initialized prod cassandra cluster after puppet run; picked up local dc from property file |
[production] |
| 20:49 |
<chasemp> |
restart ntp on mw1009 |
[production] |
| 20:15 |
<mutante> |
readding mw1062 to puppet, signing new cert and salt-key |
[production] |
| 19:54 |
<mutante> |
reinstalling mw1062 after disk has been replaced |
[production] |
| 19:45 |
<Krinkle> |
Destroying integration-slave1009 and re-imaging |
[releng] |
| 19:28 |
<mutante> |
ran puppet on ruthenium |
[production] |
| 19:02 |
<bd808> |
VICTORY! deployment-bastion jenkins slave unstuck |
[releng] |
| 19:01 |
<bd808> |
toggling gearman plugin in jenkins admin console |
[releng] |
| 18:59 |
<bd808> |
took deployment-bastion jenkins connection offline and online 5 times; gearman plugin still stuck |
[releng] |
| 18:41 |
<bd808> |
cleaned up mess in /tmp on integration-slave1008 |
[releng] |
| 18:38 |
<bd808> |
brought integration-slave1007 back online |
[releng] |
| 18:37 |
<bd808> |
cleaned up mess in /tmp on integration-slave1007 |
[releng] |
| 18:29 |
<bd808> |
restarting jenkins because I messed up and disabled gearman plugin earlier |
[releng] |
| 17:46 |
<demon> |
Synchronized php-1.25wmf17/extensions/DoubleWiki/DoubleWiki_body.php: shut up warnings finally (duration: 00m 05s) |
[production] |
| 17:42 |
<oblivian> |
Synchronized wmf-config/session.php: mc1011-12 IP change (duration: 00m 05s) |
[production] |
| 17:35 |
<kartik> |
Finished scap: ContentTranslation update (duration: 25m 31s) |
[production] |
| 17:25 |
<^d> |
jenkins stuck communicating to beta, restarting |
[production] |
| 17:10 |
<kartik> |
Started scap: ContentTranslation update |
[production] |
| 16:53 |
<_joe_> |
shutting down mc1009 and mc1010 |
[production] |
| 16:39 |
<oblivian> |
Synchronized wmf-config/session.php: mc1009-10 IP change (duration: 00m 05s) |
[production] |
| 16:30 |
<bd808> |
disconnected and reconnected deployment-bastion.eqiad again |
[releng] |
| 16:28 |
<bd808> |
reconnected deployment-bastion.eqiad to jenkins |
[releng] |
| 16:28 |
<bd808> |
disconnected deployment-bastion.eqiad from jenkins |
[releng] |
| 16:27 |
<bd808> |
killed all pending jobs for deployment-bastion.eqiad |
[releng] |
| 16:26 |
<bd808> |
disconnected deployment-bastion.eqiad from jenkins |
[releng] |
| 16:23 |
<kart_> |
Updated cxserver to 395be27 |
[production] |
| 16:20 |
<legoktm> |
updated phpunit for https://gerrit.wikimedia.org/r/188398 |
[releng] |
| 16:16 |
<kart_> |
started cxserver deployment |
[production] |
| 16:01 |
<demon> |
Synchronized wmf-config/CommonSettings-labs.php: (no message) (duration: 00m 07s) |
[production] |
| 15:49 |
<oblivian> |
Synchronized wmf-config/session.php: mc1007-8 IP change (duration: 00m 06s) |
[production] |
| 15:21 |
<_joe_> |
restarting hhvm on mw1103, mw1078,mw1032 - TC full as well. |
[production] |
| 15:17 |
<_joe_> |
restarting hhvm on mw1027, TC full |
[production] |
| 15:11 |
<_joe_> |
powering down mc1007,mc1008 |
[production] |
| 09:58 |
<AaronS> |
Deleted more bogus GlobalUserPage purge job queues |
[production] |
| 06:11 |
<springle> |
bacula-director restart to pick up m1-master CNAME |
[production] |
| 06:07 |
<springle> |
ran RT update-rt-siteconfig + apache restart to pick up m1-master CNAME |
[production] |
| 05:55 |
<springle> |
etherpad-lite restart to pick up m1-master CNAME |
[production] |
| 05:49 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Thu Feb 19 05:48:40 UTC 2015 (duration 48m 39s) |
[production] |
| 04:32 |
<ori> |
txstatsd on graphite1001: disabled profiling and returned service to normal state |
[production] |
| 04:23 |
<ori> |
restarting txstatsd on graphite1001 with --profile; will disable profiling in a few minutes. |
[production] |
| 02:41 |
<mutante> |
restarted hhvm on mw1141 (locked up, T89912?) |
[production] |
| 02:36 |
<LocalisationUpdate> |
completed (1.25wmf18) at 2015-02-19 02:35:41+00:00 |
[production] |
| 02:35 |
<l10nupdate> |
Synchronized php-1.25wmf18/cache/l10n: (no message) (duration: 00m 01s) |
[production] |
| 02:21 |
<LocalisationUpdate> |
completed (1.25wmf17) at 2015-02-19 02:20:01+00:00 |
[production] |
| 02:19 |
<l10nupdate> |
Synchronized php-1.25wmf17/cache/l10n: (no message) (duration: 00m 01s) |
[production] |
| 02:18 |
<mutante> |
restbase1004 - starting restbase service, running puppet |
[production] |
| 02:11 |
<mutante> |
restbase1004/1005 systemctl daemon-reload to run systemd-sysv-generator to make it create missing unit for restbase and unbreak puppet running the service |
[production] |
| 01:12 |
<ejegg> |
Synchronized wmf-config/CommonSettings.php: Use URLs without mobile redirects for CentralNotice (duration: 00m 07s) |
[production] |
| 00:54 |
<demon> |
Finished scap: global user page extension-list fix + l10n rebuild (duration: 15m 21s) |
[production] |
| 00:39 |
<AaronS> |
Deleted labswiki redis jobs (labswiki uses the db queue) for GlobalUserPage and flushed the queue aggregator |
[production] |