1301-1350 of 10000 results (43ms)
2017-02-20 §
13:41 <hashar@tin> Synchronized wmf-config/throttle.php: [throttle] New rule - T158312 (duration: 00m 42s) [production]
13:35 <marostegui> Transferring dbstore1001:/srv/backups (the last 2 backups) to dbstore2001:/srv/backup/dbstore1001 - T153768 [production]
13:17 <gehel@puppetmaster1001> conftool action : set/pooled=no; selector: name=elastic10(25|28|29|30).eqiad.wmnet [production]
13:04 <moritzm> installing jasper security updates [production]
12:20 <godog> remove syslog from graphite1001, bump max open files for carbon-c-relay [production]
11:00 <godog> switch diamond traffic to graphite1001 - T157022 [production]
10:54 <moritzm> rolling restart of nginx on remaining mediawiki servers in eqiad to pick up openssl update [production]
10:26 <ariel@tin> Finished deploy [dumps/dumps@dee43ca]: fix prefetch on retries of partially complete page content dumps (duration: 00m 02s) [production]
10:26 <ariel@tin> Started deploy [dumps/dumps@dee43ca]: fix prefetch on retries of partially complete page content dumps [production]
10:24 <hashar@tin> Synchronized wmf-config/throttle.php: Add new throttle rule - T158432 (duration: 00m 49s) [production]
09:46 <moritzm> upgrading mediawiki servers in codfw to HHVM 3.12.14 [production]
09:33 <marostegui> Manually deploy gtid_domain_id on s6 hosts - T149418 [production]
08:47 <gehel> restarting diamond on wdqs1002 after initial data import [production]
08:41 <marostegui> Increase 100G dbstore1002 lv /dev/mapper/tank-data [production]
08:17 <ariel@tin> Finished deploy [dumps/dumps@d50e129]: cleanup tmp files before checkpoint file rerun (duration: 00m 02s) [production]
08:17 <ariel@tin> Started deploy [dumps/dumps@d50e129]: cleanup tmp files before checkpoint file rerun [production]
07:39 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Update ticket number for db2048 depool reason (duration: 00m 44s) [production]
07:29 <marostegui> Deploy alter table on db2048 enwiki.revision - T132416 [production]
07:28 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2048 - T132416 (duration: 00m 41s) [production]
02:25 <l10nupdate@tin> ResourceLoader cache refresh completed at Mon Feb 20 02:25:07 UTC 2017 (duration 5m 19s) [production]
02:19 <l10nupdate@tin> scap sync-l10n completed (1.29.0-wmf.12) (duration: 07m 53s) [production]
2017-02-19 §
20:08 <ariel@tin> Finished deploy [dumps/dumps@364470e]: fix private table dumping, report failed runs correctly (duration: 00m 03s) [production]
20:08 <ariel@tin> Started deploy [dumps/dumps@364470e]: fix private table dumping, report failed runs correctly [production]
15:54 <hashar> Restarted Zuul to clear out a stall function in Gearman server. [production]
02:37 <l10nupdate@tin> ResourceLoader cache refresh completed at Sun Feb 19 02:37:07 UTC 2017 (duration 5m 18s) [production]
02:31 <l10nupdate@tin> scap sync-l10n completed (1.29.0-wmf.12) (duration: 13m 08s) [production]
2017-02-18 §
18:00 <reedy@tin> Synchronized wmf-config/CommonSettings.php: Rv reservedusernames addition from CS (duration: 00m 42s) [production]
17:59 <reedy@tin> Synchronized php-1.29.0-wmf.12/includes/DefaultSettings.php: Unknown user to reserved usernames in defaultsettings (duration: 00m 45s) [production]
17:29 <reedy@tin> Synchronized wmf-config/CommonSettings.php: Add Unknown user to reservedusernames (duration: 00m 48s) [production]
02:23 <l10nupdate@tin> ResourceLoader cache refresh completed at Sat Feb 18 02:23:52 UTC 2017 (duration 5m 20s) [production]
02:18 <l10nupdate@tin> scap sync-l10n completed (1.29.0-wmf.12) (duration: 06m 41s) [production]
2017-02-17 §
21:34 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: name=elastic1023.eqiad.wmnet [production]
19:20 <gehel> upgrading maps-test2004 to nodejs6 for testing - T150354 [production]
18:34 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: name=elastic10(21|22|24).eqiad.wmnet [production]
17:17 <gehel@puppetmaster1001> conftool action : set/pooled=no; selector: name=elastic10(21|22|23|24).eqiad.wmnet [production]
17:17 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: name=elastic10(17|18|19|20).eqiad.wmnet [production]
16:18 <ejegg> updated 3DS rules for DK, SE, and NO [production]
16:15 <bblack> restarting cp1074 varnish backend (cron due in 24h, but rep lag looks pretty bad) [production]
15:26 <urandom> T155120: Restarting Cassandra on restbase1007-a.eqiad.wmnet to disable Prometheus exporter agent [production]
14:48 <_joe_> uploaded clustershell 1.7.3, tqdm, pyparsing to jessie-wikimedia in preparation for cumin [production]
13:47 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2070 - T156478 (duration: 00m 45s) [production]
12:21 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2070 - T156478 (duration: 00m 41s) [production]
12:18 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2070 - T156478 (duration: 00m 41s) [production]
11:54 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Clean up db1028 old comments - T153300 (duration: 00m 41s) [production]
11:11 <moritzm> restarting nginx on sodium (mirrors.wikimedia.org) to pick up openssl update [production]
10:01 <gehel@puppetmaster1001> conftool action : set/pooled=no; selector: name=elastic10(17|18|19|20).eqiad.wmnet [production]
09:54 <moritzm> rolling restart of nginx on mediawiki servers in codfw to pick up openssl update [production]
09:33 <moritzm> rolling restart of nginx on mw canaries to pick up openssl update [production]
09:32 <gehel> upgrade nginx on elasticsearch codfw for ssl upgrade [production]
09:30 <gehel> upgrade nginx on elastic1049-1052 for ssl upgrade [production]