151-200 of 10000 results (47ms)
2018-07-17 §
06:30 <moritzm> installing postgresql-9.6 updates from stretch point release [production]
05:55 <marostegui> Deploy schema change on db2039 (s6 codfw master) with replication, this will generate lag on codfw T144010 T51190 T199368 [production]
05:37 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1100 after alter table (duration: 00m 49s) [production]
05:34 <marostegui> Deploy schema change on db1070 (s5 primary master) T144010 T51190 T199368 [production]
05:30 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1100 for alter table (duration: 00m 49s) [production]
05:25 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1082 after alter table (duration: 00m 49s) [production]
05:18 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1082 for alter table (duration: 00m 49s) [production]
05:12 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1097:3315 after alter table (duration: 00m 49s) [production]
05:04 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1097:3315 for alter table (duration: 00m 50s) [production]
04:59 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1096:3315 after alter table (duration: 00m 49s) [production]
04:50 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1096:3315 for alter table (duration: 00m 53s) [production]
02:45 <l10nupdate@deploy1001> ResourceLoader cache refresh completed at Tue Jul 17 02:45:01 UTC 2018 (duration 10m 21s) [production]
02:34 <l10nupdate@deploy1001> scap sync-l10n completed (1.32.0-wmf.12) (duration: 13m 51s) [production]
2018-07-16 §
20:57 <ejegg> re-enabled payments listener failmail stream [production]
20:11 <bsitzmann@deploy1001> Finished deploy [mobileapps/deploy@fcae441]: Update mobileapps to bed7b29 (T174809) (duration: 09m 01s) [production]
20:02 <bsitzmann@deploy1001> Started deploy [mobileapps/deploy@fcae441]: Update mobileapps to bed7b29 (T174809) [production]
18:35 <mepps> updated payments-wiki config to 4e0c6c3cfd [production]
18:10 <niharika29@deploy1001> Synchronized wmf-config/: Rollout Watchlist Structured Filters to all wikis T181193 (duration: 00m 51s) [production]
14:54 <moritzm> installing openssh updates from stretch point release [production]
14:52 <marostegui> Change expire_log_days on db1067 - https://phabricator.wikimedia.org/T197069 [production]
14:49 <marostegui> Drop unused ceilometer database from db1073 [production]
14:47 <marostegui> Remove unused grants from db1073 [production]
14:39 <marostegui> Remove unused grants from labsdb1004 and labsdb1005 [production]
14:37 <marostegui> Remove unused grants from es2019 [production]
14:27 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Repool db2076 (duration: 00m 49s) [production]
14:24 <anomie@deploy1001> Synchronized wmf-config/InitialiseSettings-labs.php: Sync labs config file, no prod impact (duration: 00m 49s) [production]
14:22 <anomie@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Explicitly set wgMultiContentRevisionSchemaMigrationStage to current default (T174044) (duration: 00m 50s) [production]
13:59 <marostegui> Stop replication on db2076 (db2095's master) [production]
13:51 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Depool db2076 for maintenance (duration: 00m 50s) [production]
12:31 <moritzm> rebooting mw2136 for microcode tests [production]
12:14 <moritzm> rebooting multatuli for microcode tests [production]
11:56 <zeljkof> EU SWAT finished [production]
11:55 <zfilipin@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:445929|Create Reconstruction NS at frwikt (T199631)]] (duration: 00m 49s) [production]
11:38 <vgutierrez> power cycle cp3033 - T199677 [production]
11:36 <pmiazga@deploy1001> Synchronized php-1.32.0-wmf.12/includes/WebResponse.php: SWAT: [[gerrit:445957|WebReponse: Use values altered in WebResponseSetCookie hook (T198525)]] (duration: 00m 54s) [production]
11:20 <zfilipin@deploy1001> Synchronized robots.txt: SWAT: [[gerrit:445952|Remove frwiki outdated entries in robots.txt (T199496)]] (duration: 00m 50s) [production]
11:18 <zfilipin@deploy1001> Synchronized robots.txt: SWAT: [[gerrit:445952|Remove frwiki outdated entries in robots.txt (T199496)]] (duration: 00m 49s) [production]
11:14 <mobrovac@deploy1001> Finished deploy [changeprop/deploy@ab8f7e9]: Bug fix: Remove anchors in blacklisting URIs and decode event URIs - T198386 (duration: 01m 33s) [production]
11:12 <mobrovac@deploy1001> Started deploy [changeprop/deploy@ab8f7e9]: Bug fix: Remove anchors in blacklisting URIs and decode event URIs - T198386 [production]
11:06 <Amir1> start of ladsgroup@mwmaint1001:~$ mwscript populateChangeTagDef.php --wiki=frwiki [production]
11:05 <vgutierrez@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp5001.eqsin.wmnet [production]
11:04 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:445969|Write to the new change tag backend in frwiki (T194165)]] (duration: 00m 50s) [production]
11:02 <vgutierrez> Power cycling cp5001 to attempt recovering it [production]
10:13 <jdrewniak@deploy1001> Synchronized portals: Wikimedia Portals Update: [[gerrit:445966|Bumping portals to master (T128546)]] (duration: 00m 50s) [production]
10:12 <jdrewniak@deploy1001> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:445966|Bumping portals to master (T128546)]] (duration: 00m 50s) [production]
08:29 <godog> put back ms-be1036 to full weight - T196873 [production]
08:27 <marostegui> Drop unused grants on db1108 - this might get dbproxy1009 to complain [production]
08:19 <godog> run xfs_repair on filesystems reporting negative space available on ms-be1041 - T199198 [production]
08:05 <marostegui> Drop unused grants on eqiad hosts [production]
07:33 <marostegui> Drop unused grants on codfw hosts [production]