|
2018-05-31
ยง
|
| 19:04 |
<ariel@tin> |
Started deploy [dumps/dumps@038c8b3]: tempdir split into subdirs |
[production] |
| 16:07 |
<addshore> |
WikibaseLexeme slot done (7 min overrun) |
[production] |
| 16:06 |
<addshore@tin> |
Synchronized wmf-config/InitialiseSettings.php: REVERT Load WikibaseLexeme on testwiki (again) T195615 (duration: 01m 21s) |
[production] |
| 16:03 |
<addshore@tin> |
Synchronized wmf-config/InitialiseSettings.php: REVERT Load WikibaseLexeme on group0 T195615 (duration: 01m 21s) |
[production] |
| 15:59 |
<addshore@tin> |
Synchronized wmf-config/InitialiseSettings.php: [[gerrit:436497|Load WikibaseLexeme on group0]] T195615 (duration: 01m 18s) |
[production] |
| 15:52 |
<andrewbogott> |
rebooting labtestservices2001 to troubleshoot unknown load problems |
[production] |
| 15:50 |
<addshore@tin> |
Synchronized wmf-config/InitialiseSettings.php: [[gerrit:436560|Load WikibaseLexeme on testwiki (again)]] T195615 (duration: 01m 21s) |
[production] |
| 15:46 |
<herron> |
enabling localhost:25 exim smtp listeners in production realm T175361 |
[production] |
| 15:44 |
<addshore@tin> |
Synchronized php-1.32.0-wmf.5/extensions/WikibaseLexeme: [[gerrit:436567|Only add repo-specific entity type definition elements in Repo context]] T195615 (duration: 01m 32s) |
[production] |
| 15:42 |
<addshore@tin> |
Synchronized php-1.32.0-wmf.6/extensions/WikibaseLexeme: [[gerrit:436566|Only add repo-specific entity type definition elements in Repo context]] T195615 (duration: 01m 32s) |
[production] |
| 15:31 |
<jynus> |
reimage db2079 |
[production] |
| 14:52 |
<addshore@tin> |
Synchronized wmf-config/InitialiseSettings.php: NOOP [[gerrit:436496|patch]] and [[gerrit:436556|revert]] Load WikibaseLexeme on testwiki (sanity) (duration: 01m 22s) |
[production] |
| 14:38 |
<addshore@tin> |
Synchronized php-1.32.0-wmf.5/extensions/WikibaseLexeme/src/WikibaseLexemeHooks.php: T195615 Dont run repo only hooks on clients (duration: 01m 20s) |
[production] |
| 14:36 |
<addshore@tin> |
Synchronized php-1.32.0-wmf.6/extensions/WikibaseLexeme/src/WikibaseLexemeHooks.php: T195615 Dont run repo only hooks on clients (duration: 01m 24s) |
[production] |
| 14:27 |
<addshore@tin> |
Synchronized wmf-config/Wikibase.php: [[gerrit:436495|Wikibase.php shift around the loading of WikibaseLexeme]] (duration: 01m 22s) |
[production] |
| 14:21 |
<addshore@tin> |
Synchronized wmf-config/InitialiseSettings-labs.php: BETA ONLY [[gerrit:436500|gerrit]] (duration: 01m 21s) |
[production] |
| 14:20 |
<addshore@tin> |
Synchronized wmf-config/Wikibase-labs.php: BETA ONLY [[gerrit:436500|gerrit]] (duration: 01m 21s) |
[production] |
| 14:08 |
<ottomata> |
beginning restarts of Kafka main-eqiad to enable SSL port - T193778 |
[production] |
| 13:41 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool sanitarium masters - T190704 (duration: 01m 21s) |
[production] |
| 13:23 |
<hashar@tin> |
Synchronized php-1.32.0-wmf.6/vendor: WikibaseLexeme: Encoding problems in labels - T195359 (duration: 03m 12s) |
[production] |
| 12:54 |
<akosiaris> |
reimage kubernetes200{3,4}.codfw.wmnet |
[production] |
| 12:30 |
<marostegui> |
Stop replication on all sanitarium masters - T190704 |
[production] |
| 11:14 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool sanitarium masters - T190704 (duration: 01m 22s) |
[production] |
| 10:45 |
<elukey> |
removed Pivot from thorium (pivot.wikimedia.org now simply redirects to Turnilo) |
[production] |
| 09:45 |
<marostegui> |
Stop MySQL on db2062 to clone db2092 |
[production] |
| 09:45 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Depool db2062 for cloning db2092 (duration: 01m 22s) |
[production] |
| 09:40 |
<volans> |
restarting Icinga, issues processing the command file |
[production] |
| 09:35 |
<jynus> |
testing icinga alerting |
[production] |
| 09:28 |
<elukey> |
reimage druid1006 to Debian Stretch |
[production] |
| 09:11 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1082 fully (duration: 01m 21s) |
[production] |
| 08:42 |
<gehel> |
power off elastic2018 - T196045 |
[production] |
| 08:39 |
<Amir1> |
ladsgroup@terbium:~$ mwscript deleteAutoPatrolLogs.php --wiki=commonswiki --sleep 2 --check-old |
[production] |
| 08:09 |
<gehel> |
power reset elastic2018 |
[production] |
| 08:08 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=inactive; selector: dc=codfw,service=mathoid,cluster=scb,name=scb.* |
[production] |
| 08:07 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=inactive; selector: dc=eqiad,service=mathoid,cluster=scb,name=scb.* |
[production] |
| 07:54 |
<akosiaris> |
reimage kubernetes1004 without swap |
[production] |
| 07:48 |
<ema> |
power-cycle elastic2018 |
[production] |
| 07:41 |
<marostegui> |
Stop Replication on db2066 |
[production] |
| 07:40 |
<akosiaris> |
re-enable puppet across the fleet |
[production] |
| 07:30 |
<akosiaris> |
disable puppet for https://gerrit.wikimedia.org/r/#/c/436468/ merge cross fleet |
[production] |
| 07:27 |
<marostegui> |
Deploy schema change on s5 codfw master (db2052) this will generate lag on codfw - T191316 T192926 T89737 T195193 |
[production] |
| 07:24 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2066 after alter table (duration: 01m 22s) |
[production] |
| 06:38 |
<marostegui> |
Deploy schema change on db2066 - T191316 T192926 T89737 T195193 |
[production] |
| 06:38 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Depool db2066 for alter table (duration: 01m 21s) |
[production] |
| 06:30 |
<marostegui> |
Deploy schema change on db2092:3315 and db2094:3315 - T191316 T192926 T89737 T195193 |
[production] |
| 06:28 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2084:3315 after alter table (duration: 01m 28s) |
[production] |
| 06:09 |
<akosiaris> |
reimage ganeti1003, ganeti1007 to stretch |
[production] |
| 05:59 |
<elukey> |
reimage druid1005 to Debian Stretch |
[production] |
| 05:51 |
<elukey> |
delete /tmp/scap_l10n_1501525840,scap_l10n_1501525840,l10nstuff,l10nstuff3 from tin to free some space in the root partition (1.9G left) |
[production] |
| 05:40 |
<elukey> |
restart pdfrender on scb1001 |
[production] |