|
2014-09-29
§
|
| 15:46 |
<hashar> |
Zuul lost all Jenkins jobs :( |
[production] |
| 15:24 |
<manybubbles> |
Synchronized php-1.24wmf22/extensions/UploadWizard/: SWAT update UploadWizard (duration: 00m 05s) |
[production] |
| 15:17 |
<manybubbles> |
Synchronized php-1.25wmf1/extensions/Wikidata/: SWAT update wikidata to fix hhvm issues. (duration: 00m 14s) |
[production] |
| 15:05 |
<manybubbles> |
Synchronized wmf-config/wikitech.php: SWAT sync wikitech file - is a noop I believe (duration: 00m 05s) |
[production] |
| 15:02 |
<manybubbles> |
Synchronized wmf-config/InitialiseSettings.php: SWAT fix config type of flow. (duration: 00m 06s) |
[production] |
| 14:22 |
<hashar> |
apt-get upgrade and reboot of all integration-slaveXX instances |
[releng] |
| 14:07 |
<hashar> |
updated puppetmaster labs/private on both integration and beta cluster projects ( a41fcdd..84f0906 ) |
[releng] |
| 13:32 |
<hashar> |
Restarted Zuul |
[production] |
| 13:27 |
<hashar> |
Zuul: tweaking configuration files {{gerrit|162584}} |
[production] |
| 09:31 |
<godog> |
deployed new swift ring to eqiad-prod |
[production] |
| 08:57 |
<hashar> |
rebased puppetmaster |
[releng] |
| 08:21 |
<hashar> |
Restarting Jenkins to have a plugin installed/loaded properly |
[production] |
| 06:58 |
<ori> |
Configured Beta cluster to use redis for session storage |
[releng] |
| 06:57 |
<ori> |
Created deployment-redis02 and converted it to use local puppet & salt masters |
[releng] |
| 05:23 |
<ori> |
Created deployment-redis01 and converted it to use local puppet & salt masters |
[releng] |
| 03:25 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Mon Sep 29 03:25:11 UTC 2014 (duration 25m 10s) |
[production] |
| 02:26 |
<LocalisationUpdate> |
completed (1.25wmf1) at 2014-09-29 02:26:50+00:00 |
[production] |
| 02:15 |
<LocalisationUpdate> |
completed (1.24wmf22) at 2014-09-29 02:15:34+00:00 |
[production] |
| 02:14 |
<bblack> |
restarting squid on carbon (webproxy) |
[production] |
|
2014-09-28
§
|
| 23:27 |
<springle> |
Synchronized wmf-config/db-eqiad.php: switch db1042 load groups to db1056 (duration: 00m 06s) |
[production] |
| 23:17 |
<springle> |
powercycle db1042 |
[production] |
| 23:15 |
<springle> |
Synchronized wmf-config/db-eqiad.php: depool db1042, locked up (duration: 00m 07s) |
[production] |
| 23:12 |
<bblack> |
restarted apache on mw1123 + mw1196 |
[production] |
| 23:11 |
<bblack> |
test |
[production] |
| 23:11 |
<bblack> |
restarted apache on mw1123 + mw1196 |
[production] |
| 20:28 |
<ori> |
Puppet failures appear to be caused by apt-get timeouts |
[production] |
| 14:38 |
<andrewbogott> |
cherry-picked https://gerrit.wikimedia.org/r/#/c/163464/ onto deployment-salt to fix a puppet compile failure. |
[releng] |
| 14:38 |
<andrewbogott> |
edited and re-cherry-picked roan's citoid patch into beta because the previous version was breaking puppet |
[releng] |
| 10:09 |
<_joe_> |
updated bash (again) across the whole cluster |
[production] |
| 03:24 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Sun Sep 28 03:24:20 UTC 2014 (duration 24m 19s) |
[production] |
| 02:28 |
<LocalisationUpdate> |
completed (1.25wmf1) at 2014-09-28 02:28:14+00:00 |
[production] |
| 02:17 |
<LocalisationUpdate> |
completed (1.24wmf22) at 2014-09-28 02:17:01+00:00 |
[production] |
|
2014-09-26
§
|
| 23:26 |
<mutante> |
switched noc.wikimedia.org to terbium, behind misc-web |
[production] |
| 22:16 |
<bd808> |
Deleted deployment-mediawiki04 (i-000005ba.eqiad.wmflabs) and removed from salt and trebuchet |
[releng] |
| 22:01 |
<bd808> |
sudo apache2ctl graceful on logstash100[123] for ldap revert |
[production] |
| 22:00 |
<bd808> |
running puppet on logstash100[123] to revert ldap change |
[production] |
| 21:56 |
<bd808> |
sudo apache2ctl graceful on logstash100[123] for ldap change |
[production] |
| 21:35 |
<andrewbogott> |
gracefulled apache on neon |
[production] |
| 21:21 |
<mutante> |
graceful'ed apache on neon |
[production] |
| 20:45 |
<ori> |
Synchronized wmf-config/CommonSettings.php: Disable HHVM beta-feature on wikidatawiki (duration: 00m 06s) |
[production] |
| 19:58 |
<awight> |
update CRM from 25159fcfc29921b08de86f12121fb292139be09d to 3e42bac8cb7f58f5e504946f4944c69ca5553e60 |
[production] |
| 19:42 |
<mutante> |
removing root's public_html from fenari - backup kept just in case |
[production] |
| 19:15 |
<AaronS> |
Deployed security patches to CentralAuth |
[production] |
| 19:09 |
<Krinkle> |
git-deploy: Deploying integration/slave-scripts 08147c42ea42e1a5eca1d29 |
[production] |
| 19:09 |
<aaron> |
Synchronized php-1.25wmf1/extensions/CentralAuth: (no message) (duration: 00m 07s) |
[production] |