|
2016-09-16
§
|
| 09:02 |
<moritzm> |
reimaging mw1252-mw1254 to jessie |
[production] |
| 08:59 |
<moritzm> |
installing tomcat7 security updates |
[production] |
| 08:52 |
<moritzm> |
installing tomcat8 security updates |
[production] |
| 08:43 |
<moritzm> |
installing libidn security updates in eqiad |
[production] |
| 07:36 |
<elukey> |
forced logrotation with debug of /etc/logrotate.d/graphite-web on graphite1001 to find cronspam source |
[production] |
| 03:21 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Fri Sep 16 03:21:54 UTC 2016 (duration 5m 18s) |
[production] |
| 03:16 |
<mwdeploy@tin> |
scap sync-l10n completed (1.28.0-wmf.19) (duration: 18m 44s) |
[production] |
| 02:41 |
<mwdeploy@tin> |
scap sync-l10n completed (1.28.0-wmf.18) (duration: 18m 25s) |
[production] |
| 01:28 |
<mutante> |
mw1294 - down and frozen, powercycled |
[production] |
| 00:53 |
<awight> |
remove "pending" from AMQ old message consumer |
[production] |
| 00:50 |
<awight> |
update paymentswiki config to disable legacy orphan rectifier |
[production] |
|
2016-09-15
§
|
| 23:38 |
<legoktm> |
legoktm@terbium:~$ foreachwiki extensions/WikimediaMaintenance/createExtensionTables.php babel # T145366 |
[production] |
| 23:24 |
<awight> |
rolled back paymentswiki to 392d67520d14998d61823755b22df50ab45afb35 |
[production] |
| 23:22 |
<awight> |
updating paymentswiki to possible broken 609c1e5f03ddcd9d72f562d7911cf77cc459371b |
[production] |
| 23:00 |
<awight> |
update paymentswiki to from 996ca30076946c6148d9688a905c82e2e346e165 to 392d67520d14998d61823755b22df50ab45afb35 (reverted DI submodule update) |
[production] |
| 22:55 |
<awight> |
Reenabled donations and fredge consumers |
[production] |
| 22:50 |
<awight> |
update fundraising CRM from f381bd1c15e30e4d47fe372e128143baee6a7c7a to 5ba6976f2552564b51085abff0afd5f76195229b |
[production] |
| 22:29 |
<awight> |
rollback paymentswiki from 609c1e5f03ddcd9d72f562d7911cf77cc459371b to 996ca30076946c6148d9688a905c82e2e346e165 |
[production] |
| 22:28 |
<awight> |
update paymentswiki from 996ca30076946c6148d9688a905c82e2e346e165 to 609c1e5f03ddcd9d72f562d7911cf77cc459371b |
[production] |
| 22:19 |
<ejegg> |
updated SmashPig from af19422065c08669269179019fea1e7c208d8a7e to db68be988194c960aebca691d0fd8e6a6d24246a |
[production] |
| 22:10 |
<ejegg> |
updated SmashPig from 12a7b78cf280f96ff3d2314abb2a9290506ae454 to af19422065c08669269179019fea1e7c208d8a7e |
[production] |
| 21:41 |
<ejegg> |
updated SmashPig from e11af5793df9a0e2dbcf9ac138a8f2a3fa1bf574 to 12a7b78cf280f96ff3d2314abb2a9290506ae454 |
[production] |
| 20:55 |
<hashar> |
All wikis are on 1.28.0-wmf.19 wikidatawiki / testwikidatawiki stick to .18 for now. |
[production] |
| 20:35 |
<gehel> |
increasing number of shards per node for dewiki_content index to 2 on elasticsearch codfw |
[production] |
| 20:27 |
<hashar@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: All wiki to .19. Keep testwikidata and wikidata at .18 (commits: 38603f0 770d336) |
[production] |
| 20:14 |
<yuvipanda> |
remove self from github wikimedia org, was getting spammed for each new repo creation |
[production] |
| 20:13 |
<ema> |
varnish-be esams cache_upload: rolling depool and restart |
[production] |
| 20:11 |
<ejegg> |
updated SmashPig from e11af5793df9a0e2dbcf9ac138a8f2a3fa1bf574 to 12a7b78cf280f96ff3d2314abb2a9290506ae454 |
[production] |
| 20:08 |
<gehel> |
increasing number of shards per node for enwiki_content index to 2 on elasticsearch codfw |
[production] |
| 20:01 |
<yuvipanda> |
restart puppetmaster on labcontrol1001 to pick up hiera changes |
[production] |
| 19:59 |
<ema> |
depool and restart varnish-be on cp1048 |
[production] |
| 19:56 |
<ema> |
depool and restart varnish-be on cp1064 |
[production] |
| 19:52 |
<hashar@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: (no message) |
[production] |
| 19:50 |
<ema> |
depool and restart varnish-be on cp1062 |
[production] |
| 19:45 |
<ema> |
depool and restart varnish-be on cp1073 |
[production] |
| 19:33 |
<ema> |
depool and restart varnish-be on cp1050 |
[production] |
| 19:20 |
<ema> |
depool and restart varnish-be on cp1063 |
[production] |
| 19:09 |
<hashar@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.28.0-wmf.19 |
[production] |
| 19:08 |
<ema> |
depool and restart varnish-be on cp1072 |
[production] |
| 19:08 |
<awight> |
disabled fredge, donations, and banner-history consumers |
[production] |
| 19:07 |
<hashar@tin> |
Synchronized php-1.28.0-wmf.18/extensions/CentralAuth/maintenance/fixStuckGlobalRename.php: To unblock renames stuck on mediawiki.org T145596 (duration: 00m 47s) |
[production] |
| 19:06 |
<hashar@tin> |
Synchronized php-1.28.0-wmf.19/extensions/CentralAuth/maintenance/fixStuckGlobalRename.php: To unblock renames stuck on mediawiki.org T145596 (duration: 00m 47s) |
[production] |
| 19:05 |
<thcipriani@tin> |
Finished scap: SWAT: [[gerrit:310851|Add missing close button title message (T145774)]] and [[gerrit:310872|Revert "Remove jquery.arrowSteps module" (T144974)]] (duration: 28m 08s) |
[production] |
| 18:59 |
<ema> |
depool and restart varnish-be on cp1099 |
[production] |
| 18:43 |
<ejegg> |
updated smashpig consume pending job with new queue name |
[production] |
| 18:36 |
<thcipriani@tin> |
Started scap: SWAT: [[gerrit:310851|Add missing close button title message (T145774)]] and [[gerrit:310872|Revert "Remove jquery.arrowSteps module" (T144974)]] |
[production] |
| 18:33 |
<mutante> |
titanium - stop salt, stop puppet, revoke puppet cert, delete salt key |
[production] |
| 18:23 |
<thcipriani@tin> |
Synchronized php-1.28.0-wmf.19/extensions/Kartographer: SWAT: [[gerrit:310848|Fix map popup CSS (T145716)]] (duration: 00m 56s) |
[production] |
| 18:23 |
<ema> |
depool and restart varnish-be on cp1074 |
[production] |
| 17:56 |
<awight> |
Purging GC messages from pending with timestamp < '2016-09-15 13:44:55' |
[production] |