|
2015-06-13
§
|
| 17:08 |
<krinkle> |
Synchronized php-1.26wmf9/extensions/WikimediaEvents: T101806 (duration: 00m 12s) |
[production] |
| 15:47 |
<paravoid> |
labstore1001: stopping manage-nfs-volumes daemon |
[production] |
| 04:42 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Sat Jun 13 04:41:57 UTC 2015 (duration 41m 56s) |
[production] |
| 03:51 |
<Krinkle> |
Running deleteEqualMessages.php for sawiki (T45917) |
[production] |
| 03:49 |
<Krinkle> |
Running deleteEqualMessages.php for cewiki (T45917) |
[production] |
| 02:21 |
<LocalisationUpdate> |
completed (1.26wmf9) at 2015-06-13 02:20:58+00:00 |
[production] |
| 02:18 |
<l10nupdate> |
Synchronized php-1.26wmf9/cache/l10n: (no message) (duration: 05m 19s) |
[production] |
| 00:17 |
<gwicke> |
restarted cassandra on restbase1001 |
[production] |
| 00:13 |
<gwicke> |
restarted cassandra on restbase1002 |
[production] |
|
2015-06-12
§
|
| 22:57 |
<ejegg> |
rolled back SmashPig on listener from 15acdafef9d9682c417632e5ac5a5f2e5380f92e to e1e925c9fc2a60c1e14ef01d8b653dc09512f51f |
[production] |
| 22:40 |
<ejegg> |
updated SmashPig on listener from e1e925c9fc2a60c1e14ef01d8b653dc09512f51f to 15acdafef9d9682c417632e5ac5a5f2e5380f92e |
[production] |
| 22:24 |
<godog> |
upgrade and bounce carbon daemons on graphite2001 to investigate T101572 |
[production] |
| 21:16 |
<ori> |
Synchronized wmf-config/InitialiseSettings.php: I3694489ba: wgCanonicalServer->https for new HTTPS domains (duration: 00m 14s) |
[production] |
| 20:33 |
<krenair> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/217878/1 (duration: 00m 13s) |
[production] |
| 20:32 |
<krenair> |
Synchronized w/static/images/project-logos/dawiki-200k.png: https://gerrit.wikimedia.org/r/#/c/217878/1 (duration: 00m 16s) |
[production] |
| 20:15 |
<krenair> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/217670/ (duration: 00m 12s) |
[production] |
| 19:28 |
<ejegg> |
updated SmashPig on payments-listener from f9c3eaa99fa0fe8ef098d0fc876091d3676aa039 to 5a463400bc74706ba7bf6256cd0101014e792acb |
[production] |
| 19:28 |
<ejegg> |
updated SmashPig on payments-listener ccepting New Patients: |
[production] |
| 18:47 |
<ejegg> |
updated SmashPig on payments-listener from 7fed22ad933a6d3e371d60dfc6f8fdd0f9131510 to f9c3eaa99fa0fe8ef098d0fc876091d3676aa039 |
[production] |
| 18:45 |
<faidon> |
Synchronized wmf-config/InitialiseSettings.php: remove wmgHTTPSBlacklistCountries (duration: 00m 12s) |
[production] |
| 18:45 |
<faidon> |
Synchronized wmf-config/CommonSettings.php: remove CanIPUseHTTPS hook (duration: 00m 13s) |
[production] |
| 17:39 |
<moritzm> |
updated cerium, xenon and praseodymium to 3.19 kernel |
[production] |
| 17:08 |
<ejegg> |
enabled queue consumer |
[production] |
| 17:08 |
<ejegg> |
updated crm from d13aaa4e9e937b0b1ae1f5de61ea7ff1f316d58f to bd8a00196071ddd04efbff7b30567dd9357c9000 |
[production] |
| 16:53 |
<ejegg> |
disabled donations queue consumer |
[production] |
| 15:52 |
<faidon> |
Synchronized wmf-config/CommonSettings.php: hide prefershttps user pref (duration: 00m 13s) |
[production] |
| 15:40 |
<faidon> |
Synchronized docroot/search.wikimedia.org/index.php: unbreak search.wikimedia.org due to HTTPS (duration: 00m 12s) |
[production] |
| 15:27 |
<jynus> |
mysql load issues on labsdb1003, investigating |
[production] |
| 13:39 |
<moritzm> |
updated etcd* to 3.19 kernel |
[production] |
| 12:11 |
<jynus> |
restarting mariadb at labsdb1003 |
[production] |
| 11:59 |
<moritzm> |
updated rdb200* to 3.19 kernel |
[production] |
| 11:31 |
<jynus> |
db2068 up but all services and console login unresponsive, powercycling |
[production] |
| 10:06 |
<springle> |
killed a bunch of queries hammering labsdb1003 for days |
[production] |
| 09:58 |
<moritzm> |
updated mc2004 to mc2016 to 3.19 kernel |
[production] |
| 06:06 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Fri Jun 12 06:06:55 UTC 2015 (duration 6m 54s) |
[production] |
| 04:37 |
<ori> |
Synchronized php-1.26wmf9/extensions/FlaggedRevs: I4cfb47b41: Avoid post-redirect parse for certain edits (duration: 00m 14s) |
[production] |
| 02:40 |
<LocalisationUpdate> |
completed (1.26wmf9) at 2015-06-12 02:40:36+00:00 |
[production] |
| 02:34 |
<l10nupdate> |
Synchronized php-1.26wmf9/cache/l10n: (no message) (duration: 10m 00s) |
[production] |
| 00:40 |
<legoktm> |
Synchronized wmf-config/InitialiseSettings-labs.php: https://gerrit.wikimedia.org/r/217759 (duration: 00m 15s) |
[production] |
| 00:07 |
<catrope> |
Synchronized wmf-config/InitialiseSettings-labs.php: (no message) (duration: 00m 14s) |
[production] |
|
2015-06-11
§
|
| 23:59 |
<legoktm> |
Synchronized wmf-config/InitialiseSettings-labs.php: https://gerrit.wikimedia.org/r/217753 (duration: 00m 16s) |
[production] |
| 23:54 |
<ori> |
Synchronized php-1.26wmf9/includes/EditPage.php: cf7df757f2: Instrument edit failures (duration: 00m 14s) |
[production] |
| 23:41 |
<ebernhardson> |
Synchronized php-1.26wmf9/extensions/MobileFrontend: Bump MobileFrontend in 1.26wmf9 for SWAT (duration: 00m 14s) |
[production] |
| 23:41 |
<ejegg> |
updated civicrm from 7ffe0cefb019828a09c9369187f14518847b5f41 to d13aaa4e9e937b0b1ae1f5de61ea7ff1f316d58f |
[production] |
| 23:25 |
<ebernhardson> |
Synchronized php-1.26wmf9/extensions/CirrusSearch/: Fix prefer-recent queries in cirrussearch (duration: 00m 13s) |
[production] |
| 23:02 |
<ejegg> |
updated SmashPig on the rest of the cluster from 477e8a8be5ea895262031c147330de5a651cc3ac to 7fed22ad933a6d3e371d60dfc6f8fdd0f9131510 |
[production] |
| 22:17 |
<godog> |
temporary bump php memory_limit on magnesium to test T102092 |
[production] |
| 22:11 |
<ejegg> |
updated SmashPig on payments-listener from 477e8a8be5ea895262031c147330de5a651cc3ac to 7fed22ad933a6d3e371d60dfc6f8fdd0f9131510 |
[production] |
| 21:54 |
<ori> |
Widespread TC cache exhaustion again, doing rolling restart of HHVMs |
[production] |
| 21:46 |
<ori> |
Synchronized wmf-config/CommonSettings.php: I3d3ed7647: Test LCStoreStaticArray on test2wiki (duration: 00m 14s) |
[production] |