1151-1200 of 10000 results (57ms)
2018-08-30 §
19:13 <krinkle@deploy1001> Synchronized php-1.32.0-wmf.19/resources/src/startup: I13a996e01b48 (duration: 01m 06s) [production]
18:52 <moritzm> restarting aphlict on phab1001 to pick up nodejs security update [production]
16:59 <godog> xfs_repair on ms-be1041 sdf1 - T199198 (retroactive, started at 15:32 [production]
16:35 <gehel@puppetmaster1001> conftool action : set/pooled=inactive; selector: dc=eqiad,cluster=wdqs,name=wdqs1005.eqiad.wmnet [production]
16:30 <gehel> shutting down wdqs1005 for new SSD and reimaging - T202779 [production]
16:29 <gehel> shutting down wdqs1005 for new SSD and reimaging - T198351 [production]
16:15 <gehel> restart of logstash to move data directory - T198351 [production]
15:17 <bstorm_> increased number of nfsd threads on labstore1004 to 300 [production]
14:08 <moritzm> upgrading mw1262-1265 to wikidiff 1.7.3 [production]
13:46 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1119, db1090 (s2 and s7) (duration: 00m 59s) [production]
13:41 <moritzm> upgrading mw1261 to wikidiff 1.7.3 [production]
13:31 <jynus> depooling labsdb1009 due to extra lag [production]
13:10 <jynus> sanitizing fixcopyrightwiki on db2094 and children T202820 [production]
13:08 <jynus> sanitizing fixcopyrightwiki on db1124 and children T202820 [production]
13:03 <moritzm> upgrading grafana to 4.6.4 (security release) [production]
12:59 <elukey> drain + reboot analytics10[28-79]* for kernel updates (will take multiple days) [production]
12:28 <godog> roll restart thumbor in eqiad to upgrade to 2.1 [production]
12:25 <reedy@deploy1001> Synchronized wmf-config/interwiki.php: Updating interwiki cache (duration: 02m 36s) [production]
12:23 <reedy@deploy1001> Synchronized dblists/: fixcopyrightwiki (duration: 00m 56s) [production]
12:22 <moritzm> uploaded grafana 4.6.4 to apt.wikimedia.org [production]
12:13 <reedy@deploy1001> Synchronized wmf-config/InitialiseSettings.php: fixcopyrightwiki (duration: 00m 56s) [production]
12:11 <reedy@deploy1001> Synchronized static/images/project-logos: fixcopyrightwiki (duration: 00m 55s) [production]
12:10 <reedy@deploy1001> rebuilt and synchronized wikiversions files: fixcopyright [production]
12:07 <reedy@deploy1001> Synchronized dblists/: fixcopyrightwiki (duration: 00m 56s) [production]
11:41 <banyek@deploy1001> Synchronized wmf-config/db-codfw.php: Repool db2070 (duration: 00m 55s) [production]
11:28 <zeljkof> EU SWAT finished [production]
11:26 <zfilipin@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:456358|Test Wikidata: Use new item ID formatter for all the items (T203147)]] (duration: 00m 53s) [production]
11:14 <zfilipin@deploy1001> Synchronized wmf-config/InitialiseSettings-labs.php: SWAT: [[gerrit:456357|Beta Wikidata: Use new item ID formatter for all the items (T203147)]] (duration: 00m 57s) [production]
11:09 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:455561|Add editsitejson to everyone who has editinterface (T190015)]] (duration: 01m 00s) [production]
10:37 <moritzm> upgrading deployment-prep to wikidiff 1.7.3 [production]
10:04 <godog> roll-restart thumbor to upgrade 2.1 [production]
08:52 <godog> roll-restart swift-proxy to send requests to thumbor in eqiad and codfw - T201858 [production]
07:34 <banyek@deploy1001> Synchronized wmf-config/db-codfw.php: Depool db2070 (duration: 00m 57s) [production]
06:46 <jynus> upgrade and restart db1090 [production]
06:43 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1090 (s2 and s7) (duration: 00m 56s) [production]
05:52 <jynus> upgrade and restart db1119 [production]
05:49 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1119 (duration: 00m 58s) [production]
03:42 <mutante> running manual update of en.planet feeds (T203055) [production]
03:21 <l10nupdate@deploy1001> ResourceLoader cache refresh completed at Thu Aug 30 03:21:55 UTC 2018 (duration 10m 14s) [production]
03:11 <l10nupdate@deploy1001> scap sync-l10n completed (1.32.0-wmf.19) (duration: 15m 12s) [production]
02:36 <l10nupdate@deploy1001> scap sync-l10n completed (1.32.0-wmf.18) (duration: 15m 20s) [production]
2018-08-29 §
23:56 <catrope@deploy1001> Synchronized php-1.32.0-wmf.18/extensions/Translate/stringmangler/StringMatcher.php: T202058 (duration: 00m 56s) [production]
23:55 <catrope@deploy1001> Synchronized php-1.32.0-wmf.19/extensions/Translate/stringmangler/StringMatcher.php: T202058 (duration: 00m 59s) [production]
19:47 <bstorm_> failed tools and cloud vps storage services over to labstore1004 [production]
19:24 <dduvall@deploy1001> rebuilt and synchronized wikiversions files: group1 to 1.32.0-wmf.19 [production]
19:21 <marxarelli> Deploying 1.32.0-wmf.19 to group1 [production]
18:55 <mutante> puppet deploy of new cluster apache site inclusion for fixcopyright.wm, tested on mwdebug100*,mw1269, apache-fast-test (T202819) (gerrit:456194) [production]
18:31 <ottomata> debdeploy git-fat update for all nodes - T202100 [production]
18:10 <mutante> puppet re-enabled on mw* via cumin before last log message (cumin expected to log to SAL automatically?) [production]
18:08 <mutante> new apache config in sites-available for new site fixcopyright.wm is being generated by puppet on cluster, but not enabled yet (T202819) [production]