3551-3600 of 10000 results (51ms)
2017-05-11 §
12:55 <akosiaris> migrate sca2004 to ganeti nodegroup row_A [production]
12:33 <marostegui> Run pt-table-checksum on s7.ukwiki - https://phabricator.wikimedia.org/T163190 [production]
12:19 <elukey> reboot kafka100[23] for kernel upgrades (kafka main-eqiad, eventbus eqiad) [production]
11:03 <marostegui> Deploy alter table on s2 (revision table) db2064 - T162611 [production]
11:03 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2064 - T162611 (duration: 00m 42s) [production]
10:15 <akosiaris> reboot ganeti200{5,6,7,8} for network reconfiguration [production]
10:10 <marostegui> Run pt-table-checksum on s7.rowiki - https://phabricator.wikimedia.org/T163190 [production]
10:07 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Restore db1056 original load (duration: 00m 49s) [production]
09:46 <ema> cp4010: downgrade varnish to 4.1.5-1wm4 and check frontend transient memory usage [production]
09:12 <ayounsi@puppetmaster1001> conftool action : set/pooled=yes; selector: name=logstash1003.eqiad.wmnet [production]
09:12 <ayounsi@puppetmaster1001> conftool action : set/pooled=yes; selector: name=logstash1002.eqiad.wmnet [production]
09:12 <ayounsi@puppetmaster1001> conftool action : set/pooled=yes; selector: name=logstash1001.eqiad.wmnet [production]
09:10 <moritzm> upgrading mw1170-mw1188 to HHVM 3.18 / Linux 4.9 (also pruning HHVM CLI bytecode since downtimed anyway) [production]
08:55 <moritzm> migrating mw1161 (job runner) to HHVM 3.18 and Linux 4.9 [production]
08:47 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase db1056 load (duration: 00m 43s) [production]
08:35 <marostegui> Run pt-table-checksum on s7.kowiki - https://phabricator.wikimedia.org/T163190 [production]
08:32 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase db1056 load (duration: 00m 42s) [production]
08:26 <moritzm> migrating mw1189 (API server) to HHVM 3.18 and Linux 4.9 [production]
07:53 <godog> roll-restart ms-fe1* for linux 4.9 upgrade - T162029 [production]
06:50 <moritzm> migrating mw1293 (image scaler) to HHVM 3.18 and Linux 4.9 [production]
06:30 <marostegui> Drop mira user on wikitech database - T164968 [production]
06:11 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1056 with less load (duration: 00m 43s) [production]
05:56 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1067 - T147166 T130067 (duration: 00m 57s) [production]
03:14 <l10nupdate@tin> ResourceLoader cache refresh completed at Thu May 11 03:14:51 UTC 2017 (duration 6m 44s) [production]
03:08 <l10nupdate@tin> scap sync-l10n completed (1.30.0-wmf.1) (duration: 13m 33s) [production]
02:46 <Jamesofur> all election emails out [production]
02:41 <Jamesofur> Sending English and all other language election emails via terbium [production]
02:35 <l10nupdate@tin> scap sync-l10n completed (1.29.0-wmf.21) (duration: 13m 22s) [production]
02:21 <Jamesofur> sending Chinese election emails via terbium [production]
02:18 <Jamesofur> sending uk and vi election emails via terbium [production]
02:10 <Jamesofur> sending pt,pt-br and ru election emails via terbium [production]
01:55 <Jamesofur> sending polish and dutch election emails via terbium [production]
01:32 <Jamesofur> sending Italian and Japanese election emails via terbium [production]
01:21 <Jamesofur> sending he, hi and id election emails via terbium [production]
01:08 <Jamesofur> sending French election emails via terbium [production]
01:05 <twentyafterfour@tin> rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.30.0-wmf.1 [production]
01:00 <Jamesofur> sending farsi election emails via terbium [production]
00:50 <Jamesofur> sending Spanish election emails via terbium [production]
00:36 <Jamesofur> sending german election emails via terbium [production]
00:29 <Jamesofur> sending bg and bn election emails via terbium [production]
00:11 <Jamesofur> sending arabic election emails via terbium [production]
00:03 <maxsem@tin> Finished deploy [kartotherian/deploy@9401f38]: Try https://gerrit.wikimedia.org/r/#/c/352886/ and https://gerrit.wikimedia.org/r/#/c/353184/ on test hosts (duration: 145m 42s) [production]
2017-05-10 §
23:50 <twentyafterfour@tin> Finished scap: Sync fix for T164983 plus i18n files leftover from swat. refs T162954 (duration: 30m 37s) [production]
23:19 <twentyafterfour@tin> Started scap: Sync fix for T164983 plus i18n files leftover from swat. refs T162954 [production]
23:13 <catrope@tin> Synchronized php-1.30.0-wmf.1/extensions/WikimediaEvents/: T164617 (duration: 00m 42s) [production]
23:08 <catrope@tin> Synchronized wmf-config/InitialiseSettings.php: Enable archive search on select wikis (T162302) (duration: 00m 41s) [production]
21:38 <twentyafterfour@tin> Synchronized php-1.30.0-wmf.1/extensions/ORES/includes/Hooks.php: sync fix for T164984 refs T162954 (duration: 00m 42s) [production]
21:38 <maxsem@tin> Started deploy [kartotherian/deploy@9401f38]: Try https://gerrit.wikimedia.org/r/#/c/352886/ and https://gerrit.wikimedia.org/r/#/c/353184/ on test hosts [production]
20:55 <elukey> restart hhvm on mw1268 (HHVM 3.12, HPHP::Treadmill::getAgeOldestRequest issue) [production]
20:37 <demon@tin> Synchronized README: no-op, comaster sync (duration: 00m 42s) [production]