|
2019-02-06
§
|
| 21:05 |
<arlolra@deploy1001> |
Finished deploy [parsoid/deploy@a4acfa6]: Updating Parsoid to fb67a71 (duration: 03m 43s) |
[production] |
| 21:04 |
<Krinkle> |
krinkle@webperf1001 Kill xenon-log (pid 449). It seems its Redis TCP socket to mwlog1001 has been stuck since Dec 13, causing the process to indefinitely hang on listen()/socket.recv() |
[production] |
| 21:01 |
<arlolra@deploy1001> |
Started deploy [parsoid/deploy@a4acfa6]: Updating Parsoid to fb67a71 |
[production] |
| 20:49 |
<mutante> |
LDAP - adding h78na to wmf - welcome Hana Worku, developer on the multimedia team (T215352) |
[production] |
| 20:40 |
<mutante> |
LDAP - adding egardner to wmf - welcome Eric Gardner , software engineer in Audiences (T214654) |
[production] |
| 20:35 |
<twentyafterfour> |
1.33.0-wmf.16 has a significantly higher rate of "entire web request took longer than 60 seconds and timed out" |
[production] |
| 20:25 |
<twentyafterfour@deploy1001> |
rebuilt and synchronized wikiversions files: group0 wikis to 1.33.0-wmf.16 refs T206670 |
[production] |
| 20:03 |
<twentyafterfour> |
Resuming the MediaWiki train for version 1.33.0-wmf.16. Will deploy Group0 wikis first and then catch up to group1 after a few minutes monitoring logs for stability. |
[production] |
| 19:50 |
<robh> |
updated firmware on cp4026 and re-seated (already well seated) dimm b3. errors have cleared for now T214516 |
[production] |
| 19:24 |
<milimetric@deploy1001> |
Finished deploy [analytics/refinery@cd413dd]: Small bug fix for history checker (duration: 12m 45s) |
[production] |
| 19:13 |
<robh> |
taking cp4026 offline to flash firmware and reseat dimm for testing on T214516 |
[production] |
| 19:12 |
<milimetric@deploy1001> |
Started deploy [analytics/refinery@cd413dd]: Small bug fix for history checker |
[production] |
| 19:11 |
<thcipriani@deploy1001> |
Finished deploy [gerrit/gerrit@3272a46]: Add healthcheck plugin (no restart) cobalt T214326 (duration: 00m 09s) |
[production] |
| 19:11 |
<thcipriani@deploy1001> |
Started deploy [gerrit/gerrit@3272a46]: Add healthcheck plugin (no restart) cobalt T214326 |
[production] |
| 19:09 |
<thcipriani@deploy1001> |
Finished deploy [gerrit/gerrit@3272a46]: Add healthcheck plugin (no restart) gerrit2001 first (duration: 00m 10s) |
[production] |
| 19:09 |
<mutante> |
LDAP - adding afandian2 and toddleroux to nda (T214727) |
[production] |
| 19:09 |
<thcipriani@deploy1001> |
Started deploy [gerrit/gerrit@3272a46]: Add healthcheck plugin (no restart) gerrit2001 first |
[production] |
| 19:04 |
<jforrester@deploy1001> |
Synchronized php-1.33.0-wmf.16/extensions/Flow/includes/Conversion/Utils.php: I405dd193 Update Parsoid Accept header to 2.0.0 so service can deploy (duration: 00m 54s) |
[production] |
| 19:03 |
<jforrester@deploy1001> |
Synchronized php-1.33.0-wmf.14/extensions/Flow/includes/Conversion/Utils.php: I405dd193 Update Parsoid Accept header to 2.0.0 so service can deploy (duration: 00m 56s) |
[production] |
| 18:03 |
<thcipriani@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:486536|Removed namespace Коментар, added namespace Портал on srwikinews]] T214561 T214563 (duration: 00m 53s) |
[production] |
| 18:01 |
<mutante> |
LDAP - adding alaasarhan to wmde (T215066) |
[production] |
| 17:57 |
<thcipriani@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:486538|Changed wgImportSources for srwikinews]] T214562 (duration: 00m 53s) |
[production] |
| 17:53 |
<thcipriani@deploy1001> |
Synchronized dblists/s3.dblist: SWAT: [[gerrit:487291|dblists/s3.dblist: Fix sorting of list of wikis per alphabetical order]] (duration: 00m 54s) |
[production] |
| 17:49 |
<thcipriani@deploy1001> |
Synchronized php-1.33.0-wmf.16/extensions/MobileFrontend: SWAT: [[gerrit:488494|VE: Load HTML in parallel with modules]] T209052 (duration: 00m 57s) |
[production] |
| 17:39 |
<thcipriani@deploy1001> |
Synchronized php-1.33.0-wmf.16/extensions/MobileFrontend: SWAT: [[gerrit:488492|EditorOverlay: Pass constructor of itself to VisualEditorOverlay, not instance]] T215408 (duration: 00m 57s) |
[production] |
| 17:10 |
<jynus> |
setting db1111 in read-write mode |
[production] |
| 16:24 |
<moritzm> |
reimaging graphite2002 to buster |
[production] |
| 16:19 |
<jynus> |
running alter table on db2055 T93564 |
[production] |
| 16:14 |
<gehel@puppetmaster1001> |
conftool action : set/pooled=true; selector: dnsdisc=kartotherian,name=eqiad |
[production] |
| 15:44 |
<papaul> |
powering down thumbor2002 for disk replacement |
[production] |
| 15:42 |
<moritzm> |
installing spice security updates |
[production] |
| 15:41 |
<andrewbogott> |
rebooting cloudvirt1015 to make sure that nothing drastic changes once libguestfs is installed T215423 |
[production] |
| 15:11 |
<moritzm> |
installing libav security updates |
[production] |
| 15:08 |
<jynus@deploy1001> |
Synchronized wmf-config/db-codfw.php: Depool db2055 for performance testing T93564 (duration: 00m 55s) |
[production] |
| 14:50 |
<moritzm> |
draining restbase1018 for eventual reboot for kernel security update (bundled with Java update) |
[production] |
| 14:36 |
<moritzm> |
draining restbase1017 for eventual reboot for kernel security update (bundled with Java update) |
[production] |
| 14:29 |
<elukey> |
add term mysql-dbstore to analytics-in4/6 on cr1/2-eqiad to allow tcp connections to dbstore100[3-5] - T210478 |
[production] |
| 12:30 |
<vgutierrez@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=cp3032.esams.wmnet |
[production] |
| 12:29 |
<vgutierrez@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=cp3032.esams.wmnet |
[production] |
| 12:28 |
<vgutierrez@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=cp3033.esams.wmnet |
[production] |
| 12:26 |
<vgutierrez@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=cp3033.esams.wmnet |
[production] |
| 12:25 |
<vgutierrez@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=cp3040.esams.wmnet |
[production] |
| 12:24 |
<vgutierrez@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=cp3040.esams.wmnet |
[production] |
| 12:22 |
<vgutierrez@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=cp3041.esams.wmnet |
[production] |
| 12:22 |
<Amir1> |
EU SWAT is done |
[production] |
| 12:21 |
<vgutierrez@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=cp3041.esams.wmnet |
[production] |
| 12:20 |
<vgutierrez> |
restarting varnish-fe safely across esams/text cluster - T215389 |
[production] |
| 12:19 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/Wikibase.php: SWAT: [[gerrit:488114|Use separate DB connection for ID insertions on testwikidatawiki (T215147)]], Part II (duration: 00m 54s) |
[production] |
| 12:17 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:488114|Use separate DB connection for ID insertions on testwikidatawiki (T215147)]], Part I (duration: 00m 55s) |
[production] |
| 11:58 |
<vgutierrez@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=cp3042.esams.wmnet |
[production] |