551-600 of 10000 results (59ms)
2018-08-21 ยง
22:29 <mutante> bromine - last log line refers to /srv/org/wikimedia/TransparencyReport (transparency.wikimedia.org) [production]
22:28 <mutante> bromine - git reset --hard origin ; git checkout master ; git pull origin ; puppet agent -tv (to fix broken puppet run due to unclean git repo.. unknown why it broke) [production]
21:00 <moritzm> rebooting mw2232 for some tests [production]
20:17 <herron> re-enabling puppet agents after puppetmaster apache update [production]
20:11 <thcipriani@deploy1001> rebuilt and synchronized wikiversions files: Group0 to 1.32.0-wmf.18 [production]
20:07 <herron> temporarily disabling puppet agents during puppetmaster apache updates [production]
19:49 <thcipriani@deploy1001> Finished scap: testwiki to php-1.32.0-wmf.18 and rebuild l10n cache (duration: 34m 54s) [production]
19:14 <thcipriani@deploy1001> Started scap: testwiki to php-1.32.0-wmf.18 and rebuild l10n cache [production]
19:11 <thcipriani@deploy1001> Pruned MediaWiki: 1.32.0-wmf.13 (duration: 01m 41s) [production]
19:08 <mutante> deploy1001 - chmod -R g+w /srv/mediawiki-staging/php-1.32.0-wmf.13/.git [production]
18:58 <thcipriani@deploy1001> Pruned MediaWiki: 1.32.0-wmf.12 (duration: 03m 15s) [production]
18:52 <thcipriani@deploy1001> Pruned MediaWiki: 1.32.0-wmf.10 (duration: 07m 37s) [production]
18:17 <volans> restarting ircecho on einsteinium - T202314 [production]
17:58 <volans> restarting ircecho on einsteinium - T202314 [production]
17:13 <thcipriani> starting branch cut for 1.32.0-wmf.18 [production]
16:32 <XioNoX> enabling ae1 on asw-a-eqiad then ae1 on cr1-eqiad - T202075 [production]
16:27 <godog> upgrade hp raid firmware on ms-be2020 - T141756 [production]
16:21 <XioNoX> disable ae1 on asw-a-eqiad - T202075 [production]
16:18 <XioNoX> disable ae1 on cr1-eqiad - T202075 [production]
16:17 <papaul> replacing PEM2 on cr2-codfw [production]
15:38 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1096 (duration: 00m 50s) [production]
15:24 <ejegg> restarted CiviCRM deduplication jobs [production]
15:10 <moritzm> installing apache updates from stretch 9.5 point release [production]
14:58 <moritzm> rolling restart of proton* to pick up nodejs security update [production]
13:44 <jynus> stop db1096 (both s5 an s6) for upgrade [production]
13:36 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1096 (duration: 00m 49s) [production]
13:27 <jynus> stop db2090 for upgrade [production]
12:38 <ema> power-cycle ms-be2020: multiple alerts, no ssh access, I/O errors in console [production]
12:34 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1100 (duration: 00m 50s) [production]
12:31 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool es1015 (duration: 00m 50s) [production]
12:18 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1100 (duration: 00m 49s) [production]
12:14 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1097:3315 (duration: 00m 49s) [production]
12:13 <moritzm> rolling restart of services in scb/eqiad to pick up the nodejs security update [production]
12:05 <jynus> stop es1015 for upgrade [production]
11:59 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool es1015 (duration: 00m 50s) [production]
11:37 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1097:3315 (duration: 00m 50s) [production]
11:16 <zeljkof> EU SWAT finished [production]
11:16 <zfilipin@deploy1001> Synchronized wmf-config/Wikibase-production.php: SWAT: [[gerrit:449017|Update several Wikidata-related configs]] (duration: 00m 50s) [production]
11:05 <zfilipin@deploy1001> Synchronized wmf-config/throttle.php: SWAT: [[gerrit:454186|Add IP ranges for ptWiki editathon (T202354)]] (duration: 00m 52s) [production]
09:58 <moritzm> installing libxcursor security updates [production]
09:46 <moritzm> installing libxml2 security updates on trusty [production]
09:27 <moritzm> installing mutt security updates [production]
09:16 <moritzm> installing jetty9 security updates [production]
08:37 <marostegui> Rename blob_tracking and blob_orphans on db1089 - T59186 [production]
07:55 <marostegui> Slowly reload haproxies on dbproxy10XX - T201021 [production]
06:27 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1096:3315 (duration: 00m 50s) [production]
05:12 <marostegui> Stop puppet on dbproxy1006 to do some haproxy logging tests - https://phabricator.wikimedia.org/T201021 [production]
05:09 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1096:3315 (duration: 00m 51s) [production]
04:54 <marostegui> Set max_connections back from 800 to 500 on db1073 - T188589 [production]
02:47 <krinkle@deploy1001> Synchronized wmf-config/InitialiseSettings.php: rm unused Id5f5295d (duration: 00m 50s) [production]