|
2014-09-29
§
|
| 19:26 |
<Reedy> |
doing rolling upgrade of elasticsearch on logstash100[1-3] |
[production] |
| 17:59 |
<cscott> |
updated OCG to version 89d8f29a24295b05d0643abe976fea83b56575c9 |
[production] |
| 17:58 |
<ori> |
Synchronized php-1.24wmf22/includes/password/Pbkdf2Password.php: I3b0a1de69: Test for string in Pbkdf2Password::crypt() (duration: 00m 05s) |
[production] |
| 17:47 |
<bblack> |
stopped powerdns and disabled puppet on virt1000 to prevent further cache pollution w/ bad data in public caches |
[production] |
| 15:57 |
<manybubbles> |
Synchronized wmf-config/InitialiseSettings.php: SWAT enable collection extension svwikiversity (duration: 00m 06s) |
[production] |
| 15:53 |
<hashar> |
Zuul jobs reregistered |
[production] |
| 15:46 |
<hashar> |
Zuul lost all Jenkins jobs :( |
[production] |
| 15:24 |
<manybubbles> |
Synchronized php-1.24wmf22/extensions/UploadWizard/: SWAT update UploadWizard (duration: 00m 05s) |
[production] |
| 15:17 |
<manybubbles> |
Synchronized php-1.25wmf1/extensions/Wikidata/: SWAT update wikidata to fix hhvm issues. (duration: 00m 14s) |
[production] |
| 15:05 |
<manybubbles> |
Synchronized wmf-config/wikitech.php: SWAT sync wikitech file - is a noop I believe (duration: 00m 05s) |
[production] |
| 15:02 |
<manybubbles> |
Synchronized wmf-config/InitialiseSettings.php: SWAT fix config type of flow. (duration: 00m 06s) |
[production] |
| 13:32 |
<hashar> |
Restarted Zuul |
[production] |
| 13:27 |
<hashar> |
Zuul: tweaking configuration files {{gerrit|162584}} |
[production] |
| 09:31 |
<godog> |
deployed new swift ring to eqiad-prod |
[production] |
| 08:21 |
<hashar> |
Restarting Jenkins to have a plugin installed/loaded properly |
[production] |
| 03:25 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Mon Sep 29 03:25:11 UTC 2014 (duration 25m 10s) |
[production] |
| 02:26 |
<LocalisationUpdate> |
completed (1.25wmf1) at 2014-09-29 02:26:50+00:00 |
[production] |
| 02:15 |
<LocalisationUpdate> |
completed (1.24wmf22) at 2014-09-29 02:15:34+00:00 |
[production] |
| 02:14 |
<bblack> |
restarting squid on carbon (webproxy) |
[production] |
|
2014-09-28
§
|
| 23:27 |
<springle> |
Synchronized wmf-config/db-eqiad.php: switch db1042 load groups to db1056 (duration: 00m 06s) |
[production] |
| 23:17 |
<springle> |
powercycle db1042 |
[production] |
| 23:15 |
<springle> |
Synchronized wmf-config/db-eqiad.php: depool db1042, locked up (duration: 00m 07s) |
[production] |
| 23:12 |
<bblack> |
restarted apache on mw1123 + mw1196 |
[production] |
| 23:11 |
<bblack> |
test |
[production] |
| 23:11 |
<bblack> |
restarted apache on mw1123 + mw1196 |
[production] |
| 20:28 |
<ori> |
Puppet failures appear to be caused by apt-get timeouts |
[production] |
| 10:09 |
<_joe_> |
updated bash (again) across the whole cluster |
[production] |
| 03:24 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Sun Sep 28 03:24:20 UTC 2014 (duration 24m 19s) |
[production] |
| 02:28 |
<LocalisationUpdate> |
completed (1.25wmf1) at 2014-09-28 02:28:14+00:00 |
[production] |
| 02:17 |
<LocalisationUpdate> |
completed (1.24wmf22) at 2014-09-28 02:17:01+00:00 |
[production] |
|
2014-09-26
§
|
| 23:26 |
<mutante> |
switched noc.wikimedia.org to terbium, behind misc-web |
[production] |
| 22:01 |
<bd808> |
sudo apache2ctl graceful on logstash100[123] for ldap revert |
[production] |
| 22:00 |
<bd808> |
running puppet on logstash100[123] to revert ldap change |
[production] |
| 21:56 |
<bd808> |
sudo apache2ctl graceful on logstash100[123] for ldap change |
[production] |
| 21:35 |
<andrewbogott> |
gracefulled apache on neon |
[production] |
| 21:21 |
<mutante> |
graceful'ed apache on neon |
[production] |
| 20:45 |
<ori> |
Synchronized wmf-config/CommonSettings.php: Disable HHVM beta-feature on wikidatawiki (duration: 00m 06s) |
[production] |
| 19:58 |
<awight> |
update CRM from 25159fcfc29921b08de86f12121fb292139be09d to 3e42bac8cb7f58f5e504946f4944c69ca5553e60 |
[production] |
| 19:42 |
<mutante> |
removing root's public_html from fenari - backup kept just in case |
[production] |
| 19:15 |
<AaronS> |
Deployed security patches to CentralAuth |
[production] |
| 19:09 |
<Krinkle> |
git-deploy: Deploying integration/slave-scripts 08147c42ea42e1a5eca1d29 |
[production] |
| 19:09 |
<aaron> |
Synchronized php-1.25wmf1/extensions/CentralAuth: (no message) (duration: 00m 07s) |
[production] |
| 19:06 |
<aaron> |
Synchronized php-1.24wmf22/extensions/CentralAuth: (no message) (duration: 00m 08s) |
[production] |
| 18:15 |
<Nemo_bis> |
untruncated: andrewbogott> ldap is broken for gerrit, should be working elsewhere |
[production] |
| 18:14 |
<legoktm> |
ldap is broken |
[production] |