2951-3000 of 10000 results (49ms)
2018-01-11 §
10:31 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Restore db1110 original weight (duration: 01m 04s) [production]
10:27 <moritzm> rolling reboot of sca/zotero clusters for kernel security update [production]
10:23 <jynus> upgrade and restart db2061 [production]
10:20 <akosiaris> upload hfst_3.13.0~r3461-1+wmf1_amd64 to apt.wikimedia.org/jessie-wikimedia/main T181463 [production]
10:14 <moritzm> migrating instances off ganeti1002 for subsequent reboot for kernel security update [production]
10:07 <jynus> upgrade and restart db2054 [production]
10:06 <moritzm> rebooting rhenium for kernel security update [production]
10:00 <elukey> reboot analytics1059-61 for kernel updates [production]
10:00 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase db1110 weight (duration: 01m 06s) [production]
09:41 <moritzm> reboot bast4002 for kernel security update [production]
09:34 <elukey> reboot analytics1055->1058 for kernel updates [production]
09:32 <godog> cleanup ores metrics older than 30d - T169969 [production]
09:31 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1110 with low weight - T174569 (duration: 01m 08s) [production]
09:24 <gehel> relforge reboot completed [production]
09:08 <gehel> reboot of relforge* for kernel upgrade [production]
09:04 <elukey> reboot analytics1051->1054 for kernel updates [production]
09:00 <gehel> logstash rolling restart completed [production]
08:57 <moritzm> reboot remaining mediawiki app servers in eqiad for kernel security update (along with update to HHVM 3.18.6) [production]
08:55 <marostegui> Upgrade db1110 kernel - T184256 [production]
08:36 <moritzm> powercycling wtp2013 (apparently didn't come back up after reboot) [production]
08:27 <marostegui> Fix data drifts on enwiki.archive on codfw - T162807 [production]
08:21 <gehel@puppetmaster1001> conftool action : set/pooled=no; selector: name=logstash1007.eqiad.wmnet [production]
08:17 <gehel> rolling restart of logstash for kernel upgrade [production]
07:50 <marostegui> Deploy schema change on db1110 - T174569 [production]
07:50 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1110 - T174569 (duration: 01m 03s) [production]
07:47 <moritzm> reboot remaining mediawiki API servers for kernel security update (along with update to HHVM 3.18.6) [production]
07:44 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1082 - T174569 (duration: 01m 03s) [production]
07:24 <marostegui> Drop external_user table from s3 - T184247 [production]
07:17 <foks> Removed 2FA from Amjaabc [production]
07:12 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1099:3311 db1099:3318 - T162807 T184256 (duration: 01m 02s) [production]
06:32 <marostegui> Deploy schema change on db1082.s5 with replication (this will generate lag on labs) - T174569 [production]
06:32 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1082 - T174569 (duration: 01m 02s) [production]
06:25 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1096:3315 - T174569 (duration: 01m 03s) [production]
06:21 <marostegui> Upgrade mariadb+kernel on db1089 [production]
06:17 <marostegui> Force BBU relearn on db1059 - T184160 [production]
02:37 <l10nupdate@tin> scap sync-l10n completed (1.31.0-wmf.15) (duration: 11m 10s) [production]
00:57 <urandom> bootstrapping restbase1011-c -- T184100 [production]
2018-01-10 §
23:50 <eileen> civicrm revision changed from 429a5c5385 to 354f32fe8a, deploy contact change, contact search fixes, install cleanup [production]
21:57 <twentyafterfour> group1 looks stable. This concludes the MediaWiki train for today. [production]
21:54 <twentyafterfour@tin> Synchronized php: group1 wikis to 1.31.0-wmf.16 (duration: 01m 02s) [production]
21:53 <twentyafterfour@tin> rebuilt and synchronized wikiversions files: group1 wikis to 1.31.0-wmf.16 [production]
21:47 <twentyafterfour@tin> Finished scap: group0 to 1.31.0-wmf.16 refs T180749 (duration: 38m 29s) [production]
21:09 <twentyafterfour@tin> Started scap: group0 to 1.31.0-wmf.16 refs T180749 [production]
20:49 <twentyafterfour@tin> Synchronized php-1.31.0-wmf.16: Sync wmf.16 to deploy multiple patches from addshore refs T180749 (duration: 10m 23s) [production]
20:14 <otto@tin> Finished deploy [eventstreams/deploy@ee854df]: Update eventstreams with newer service-template-node: T171011 (duration: 04m 11s) [production]
20:09 <otto@tin> Started deploy [eventstreams/deploy@ee854df]: Update eventstreams with newer service-template-node: T171011 [production]
20:09 <otto@tin> Finished deploy [eventstreams/deploy@ee854df]: Update eventstreams deploy test to scb2002: T171011 (duration: 00m 24s) [production]
20:09 <otto@tin> Started deploy [eventstreams/deploy@ee854df]: Update eventstreams deploy test to scb2002: T171011 [production]
20:05 <jynus> upgrade and restart dbstore2002 [production]
20:00 <jynus> upgrade and restart dbstore2001 [production]