751-800 of 10000 results (75ms)
2018-12-03 §
08:32 <moritzm> restarted keyholder agents/proxies on netmon1002/netmon2001 to pick up removal of netbox key [production]
08:30 <marostegui> Deploy schema change on s5 codfw master (db2052) with replication, lag will be generated on codfw T86338 T202167 [production]
08:13 <moritzm> rearmed keyholders on netmon1002/netmon2001 [production]
08:07 <marostegui> Deploy schema change on s2 master (db1066) T86338 T202167 [production]
07:53 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1074 T86338 T202167 (duration: 00m 47s) [production]
07:32 <marostegui> Deploy schema change db1074 with replication (lag will appear on labs) T86338 T202167 [production]
07:32 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1074 T86338 T202167 (duration: 00m 46s) [production]
07:27 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1122 T86338 T202167 (duration: 00m 47s) [production]
07:09 <marostegui> Stop MySQL on pc1004, pc1005 and pc1006 as they will be decommissioned - T210969 [production]
06:52 <marostegui> Remove pc1004, pc1005 and pc1006 from tendril and zarcillo - T210969 [production]
06:38 <marostegui> Deploy schema change db1122 T86338 T202167 [production]
06:38 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1122 T86338 T202167 (duration: 00m 48s) [production]
06:33 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1076 T86338 T202167 (duration: 00m 47s) [production]
06:16 <marostegui> Deploy schema change db1076 T86338 T202167 [production]
06:16 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1076 T86338 T202167 (duration: 00m 50s) [production]
00:34 <legoktm@deploy1001> Synchronized php-1.33.0-wmf.6/includes/Title.php: https://gerrit.wikimedia.org/r/c/mediawiki/core/+/477182 (duration: 00m 52s) [production]
2018-12-02 §
22:39 <addshore> addshore@mwmaint1002:~$ mwscript extensions/OATHAuth/maintenance/disableOATHAuthForUser.php --wiki=testwikidatawiki addless # This is my account, and apparently I no longer have the 2fa for it [production]
2018-12-01 §
16:48 <andrewbogott> rebuilding labvirt1014 as cloudvirt1014, T210904 [production]
2018-11-30 §
20:23 <ottomata> temporarily disabled puppet on stat1005 to test rsyncd changes [production]
20:02 <ssastry@deploy1001> Finished deploy [parsoid/deploy@9981ddf]: Update Parsoid to 310edecd (deploy-20181130 branch) (duration: 11m 38s) [production]
19:50 <ssastry@deploy1001> Started deploy [parsoid/deploy@9981ddf]: Update Parsoid to 310edecd (deploy-20181130 branch) [production]
15:29 <urandom> bootstrapping restbase2013-a -- T210843 [production]
15:22 <moritzm> uploaded nodejs 6.11.0~dfsg-1+wmf4+jessie to apt.wikimedia.org/jessie-wikimedia (fixes a dependency compared to the initial jessie update) [production]
12:55 <moritzm> uploaded nodejs 6.11.0~dfsg-1+wmf3+jessie to apt.wikimedia.org/jessie-wikimedia (backporting the current security fixes) [production]
11:38 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1105:3312 T86338 T202167 (duration: 00m 47s) [production]
11:07 <banyek> deploy schema change on dbstore1002 - T85757 [production]
10:59 <marostegui> Deploy schema change on db1105:3312 T86338 T202167 [production]
10:59 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1105:3312 T86338 T202167 (duration: 00m 45s) [production]
09:48 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1090:3312 T86338 T202167 (duration: 00m 46s) [production]
09:00 <marostegui> Deploy schema change on db1090:3312 T86338 T202167 [production]
09:00 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1090:3312 T86338 T202167 (duration: 00m 47s) [production]
08:55 <moritzm> removed rutherfordium from debmonitor DB (T210036) [production]
08:21 <marostegui> Deploy schema change on dbstore1002 T86338 T202167 [production]
08:12 <moritzm> installing perl security updates [production]
07:28 <marostegui> Deploy schema change on db1095:3312 T86338 T202167 [production]
07:27 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1103:3312 T86338 T202167 (duration: 00m 47s) [production]
06:55 <marostegui> Purge binary logs on pc1005 [production]
06:52 <marostegui> Deploy schema change on db1103:3312 T86338 T202167 [production]
06:51 <marostegui> Deploy schema change on db1103:3312 T86338 T20216 [production]
06:51 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1103:3312 T86338 T202167 (duration: 00m 48s) [production]
06:12 <marostegui> Deploy schema change on s2 codfw master with replication (db2035), this will generate lag on codfw - T86338 T202167 [production]
02:17 <ebernhardson@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:476772|update wbsearchentities ab test configuration]] T209402 (duration: 00m 47s) [production]
01:06 <thcipriani@deploy1001> Synchronized php-1.33.0-wmf.6/extensions/WikimediaEvents: SWAT: [[gerrit:476777|wbsearchentities ab test improvements]] T209402 (duration: 00m 46s) [production]
01:04 <thcipriani@deploy1001> Synchronized php-1.33.0-wmf.6/extensions/MobileFrontend: SWAT: [[gerrit:476613|Change config flag for enabling Block Notice stats]] T201719 (duration: 00m 48s) [production]
00:57 <thcipriani@deploy1001> Synchronized php-1.33.0-wmf.6/extensions/VisualEditor: SWAT: [[gerrit:476612|Rename configs for tracking block notices on visual editor]] [[gerrit:476762|ve.init.mw.ArticleTarget: Stop when we fail to load metadata]] T209542 (duration: 00m 48s) [production]
00:39 <thcipriani@deploy1001> Synchronized php-1.33.0-wmf.6/includes/api/ApiBase.php: SWAT: [[gerrit:476409|Add stats for block errors on create/edit actions]] T201717 (duration: 00m 48s) [production]
2018-11-29 §
23:26 <mutante> puppetmaster: sudo puppet cert revoke rutherfordium.eqiad.wmnet; sudo puppet node clean rutherfordium.eqiad.wmnet ; sudo puppet node deactivate rutherfordium.eqiad.wmnet ; run puppet on icinga1001.. removed host from monitoring (decom for ganeti VM) (T210036) [production]
22:21 <hashar> 1.33.0-wmf.6 is on all wikis and looks stable. [production]
22:04 <hashar> hashar@deploy1001 rebuilt and synchronized wikiversions files: all wikis to 1.33.0-wmf.6 [production]
22:03 <hashar@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.33.0-wmf.6 [production]