|
2016-08-01
§
|
| 16:59 |
<Pchelolo> |
labs deploy restbase 840411a44 |
[production] |
| 16:10 |
<bd808> |
Restarted logstash on logstash1001; missing hhvm and service logs; no output to /var/log/logstash/logstash.log for days |
[production] |
| 15:59 |
<bblack> |
cp1065: canary upgrade of openssl to 1.0.2h-1~wmf2 (+ nginx upgrade-restart) |
[production] |
| 15:58 |
<urandom> |
T134016: Bootstrapping restbase1015-c.eqiad.wmnet |
[production] |
| 15:57 |
<bblack> |
uploaded openssl_1.0.2h-1~wmf2 to carbon (jessie-wikimedia) - https://gerrit.wikimedia.org/r/#/c/301903/ |
[production] |
| 15:38 |
<addshore@tin> |
Synchronized php-1.28.0-wmf.12/includes/Linker.php: [[gerrit:302226|Debug Logging for Undefined index: width in Linker.php]] (duration: 00m 25s) |
[production] |
| 15:29 |
<addshore@tin> |
Synchronized wmf-config/InitialiseSettings.php: [[gerrit:302259|Remove dewiki_diffstats logging]] (duration: 00m 26s) |
[production] |
| 15:27 |
<addshore@tin> |
Synchronized wmf-config/InitialiseSettings.php: [[gerrit:302114|Remove T124356 debug logging]] (duration: 00m 25s) |
[production] |
| 15:25 |
<addshore@tin> |
Synchronized wmf-config/InitialiseSettings.php: [[gerrit:302085|Debug logging for T138987]] (duration: 00m 26s) |
[production] |
| 15:23 |
<addshore@tin> |
Synchronized wmf-config/InitialiseSettings-labs.php: [[gerrit:301820|Beta move $wgEchoMentionStatusNotifications to CommonSettings]] PART 2/2 (duration: 00m 24s) |
[production] |
| 15:22 |
<addshore@tin> |
Synchronized wmf-config/CommonSettings-labs.php: [[gerrit:301820|Beta move $wgEchoMentionStatusNotifications to CommonSettings]] PART 1/2 (duration: 00m 24s) |
[production] |
| 15:17 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:301807|Set favicon for mk.wiktionary (T140566)]] (duration: 00m 25s) |
[production] |
| 15:11 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:302054|Allow sysops on he.wiktionary to remove autopatroller and patroller user rights (T140563)]] (duration: 00m 30s) |
[production] |
| 15:04 |
<thcipriani@tin> |
Synchronized wmf-config/throttle.php: SWAT: [[gerrit:301761|Expanding throttle limits for enwiki Edit-a-thon (T141421)]] (duration: 00m 24s) |
[production] |
| 14:40 |
<andrewbogott> |
restarting slapd on serpens to reclaim leaked memory |
[production] |
| 13:48 |
<godog> |
reboot ms-be1023 after raid controller fw upgrade T141756 |
[production] |
| 12:46 |
<mobrovac> |
zotero translators deployed cde2f75 |
[production] |
| 10:56 |
<JeanFred> |
Deployed latest from Git: 6763dbb and dadf805 (T141757) |
[tools.heritage] |
| 10:11 |
<godog> |
reboot ms-be2027 after raid controller fw upgrade T141756 |
[production] |
| 09:25 |
<jynus> |
dropping index name_type_patrolled_timestamp on zhwiki on db1060 and db1054 T140108 |
[production] |
| 08:28 |
<Amir1> |
deploying fedd675 to ores in sca03 |
[releng] |
| 07:54 |
<Lokal_Profil> |
(correction to last line) Deployed latest from Git, 5fe42fe (T111618), 1ec3530, 9a630b5 (T139258) |
[tools.heritage] |
| 07:53 |
<Lokal_Profil> |
Deployed latest from Git, 5fe42fe (5fe42fe), 1ec3530, 9a630b5 (T139258) |
[tools.heritage] |
| 03:20 |
<aaron@tin> |
Synchronized php-1.28.0-wmf.12/includes/filerepo/file/LocalFile.php: c4f34e7a12baa9 (duration: 00m 44s) |
[production] |
| 02:26 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Mon Aug 1 02:26:44 UTC 2016 (duration 5m 38s) |
[production] |
| 02:21 |
<mwdeploy@tin> |
scap sync-l10n completed (1.28.0-wmf.12) (duration: 08m 22s) |
[production] |
|
2016-07-29
§
|
| 23:56 |
<YuviPanda> |
hardreset xenon |
[production] |
| 23:44 |
<urandom> |
Rebooting xenon.eqiad.wmnet |
[production] |
| 23:27 |
<bd808> |
Rebooting deployment-logstash2; Console showed hung task timeouts (P3606) |
[releng] |
| 23:13 |
<bblack> |
installed openssl-1.0.2h-1~wmf2 on pinkunicorn for the weekend (not on carbon yet) - https://gerrit.wikimedia.org/r/301903 |
[production] |
| 22:04 |
<YuviPanda> |
repooled tools-worker-1006 |
[tools] |
| 21:48 |
<YuviPanda> |
deleted tools-worker-1006 after depooling+draining |
[tools] |
| 21:45 |
<YuviPanda> |
repool new tools-worker-1003 with direct-lvm docker storage backend |
[tools] |
| 21:30 |
<YuviPanda> |
depool tools-worker-1003 to be recreated with new docker config, picking this because it's on a non-ssd host |
[tools] |
| 21:17 |
<YuviPanda> |
depooled tools-worker-1020/21 after fixing them up |
[tools] |
| 21:02 |
<ostriches> |
gerrit: raised log level on sshd to ERROR from WARN. Irrelevant logspam. |
[production] |
| 20:56 |
<mutante> |
restarted grrrit-wm but this time only because it died by itself |
[production] |
| 20:41 |
<YuviPanda> |
delete tools-worker-1001 |
[tools] |
| 20:29 |
<YuviPanda> |
depool tools-worker-1001, going to recreate with to test new puppet deploying-first-run |
[tools] |
| 20:26 |
<YuviPanda> |
built new worker nodes tools-worker-1020 and 21 with direct-lvm storage backend |
[tools] |
| 20:22 |
<mutante> |
gerrit restarting to apply config change 301873 - tuning caches |
[production] |
| 20:11 |
<YuviPanda> |
restart gerrit-wm bot |
[production] |
| 19:56 |
<mutante> |
gerrit restarting to apply config change 300446 - up heap size limit |
[production] |