8051-8100 of 10000 results (71ms)
2017-12-04 ยง
16:41 <marostegui> Deploy schema change on db1053 (s2) - T174569 [production]
16:40 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1103:3312 - T174569 (duration: 00m 45s) [production]
16:39 <demon@tin> Finished scap: docroot/noc/conf/ Adding new dblist symlink (duration: 02m 36s) [production]
16:39 <marostegui> Deploy schema change on db1103:3312 - T174569 [production]
16:37 <demon@tin> Started scap: docroot/noc/conf/ Adding new dblist symlink [production]
16:37 <demon@tin> scap aborted: docroot/noc/conf/dblists (duration: 00m 02s) [production]
16:37 <demon@tin> Started scap: docroot/noc/conf/dblists [production]
16:34 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1105:3312 - T174569 (duration: 00m 45s) [production]
16:32 <demon@tin> Finished scap: docroot/noc/conf/ drop some dangling symlinks (duration: 03m 53s) [production]
16:28 <demon@tin> Started scap: docroot/noc/conf/ drop some dangling symlinks [production]
16:11 <herron> re-enabling puppet agents in eqiad [production]
16:07 <demon@tin> Finished scap: Revert "Special:Preferences: Use OOjs UI" and follow-ups (duration: 21m 19s) [production]
16:05 <herron> re-enabling puppet agents in codfw [production]
15:46 <demon@tin> Started scap: Revert "Special:Preferences: Use OOjs UI" and follow-ups [production]
15:31 <herron> temporarily disabling puppet agents in eqiad and codfw while puppetdb catches up with command queue [production]
15:29 <herron> disabling ircecho temporarily [production]
15:24 <_joe_> restarting puppetdb on nihal, will cause puppet failures [production]
15:23 <jmm@puppetmaster1001> conftool action : set/pooled=yes; selector: mw1259.eqiad.wmnet [production]
15:18 <demon@tin> Synchronized wmf-config/CommonSettings-labs.php: no-op (duration: 00m 45s) [production]
15:01 <godog> reimage restbase1014 - T179422 [production]
14:51 <herron> cutting over all production puppet agents to codfw puppet 4 masters via dns [production]
14:50 <Amir1> deployed backward compatibility of entity compact diff transmit T113468 [production]
14:49 <ladsgroup@tin> Synchronized php-1.31.0-wmf.10/extensions/Wikibase: (no justification provided) (duration: 01m 41s) [production]
14:37 <gehel@tin> Finished deploy [kartotherian/deploy@e166d87]: dummy kartotherian deployment to test udp2log config change - T175242 (duration: 00m 03s) [production]
14:37 <gehel@tin> Started deploy [kartotherian/deploy@e166d87]: dummy kartotherian deployment to test udp2log config change - T175242 [production]
14:30 <elukey> reboot druid100[23] for kernel updates [production]
14:28 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:394771|Localize sitename and meta NS for wawiktionary (T181782)]] (duration: 00m 46s) [production]
14:01 <elukey> reboot analytics106* (hadoop worker nodes) for kernel+jvm updates - T179943 [production]
13:24 <paravoid> upgrading bast2001 to stretch [production]
13:22 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1105:3312 - T174569 (duration: 00m 45s) [production]
13:20 <marostegui> Deploy schema change on db1105:3312 (s2) - T174569 [production]
13:05 <marostegui> Compress s6 on db1098 - T178359 [production]
12:44 <gehel@tin> Finished deploy [kartotherian/deploy@e166d87]: testing new kartotherian packaging on maps-test2003 (duration: 00m 22s) [production]
12:43 <gehel@tin> Started deploy [kartotherian/deploy@e166d87]: testing new kartotherian packaging on maps-test2003 [production]
11:06 <jdrewniak@tin> Synchronized portals: Wikimedia Portals Update: [[gerrit:394964|Bumping portals to master (T128546)]] (duration: 00m 45s) [production]
11:05 <jdrewniak@tin> Synchronized portals/prod/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:394964|Bumping portals to master (T128546)]] (duration: 00m 45s) [production]
10:37 <jynus@tin> Synchronized wmf-config/db-codfw.php: Repool db2085 (duration: 00m 43s) [production]
10:06 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Fully pool db1096:3316 - T178359wq! (duration: 00m 45s) [production]
09:55 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Remove db1099:3318 from s5 (duration: 00m 44s) [production]
09:51 <godog> bootstrap restbase1012-c - T179422 [production]
09:32 <godog> clear erroneous table metrics from graphite1003 / graphite2002 - T181689 [production]
09:24 <elukey> reboot analytics104* (hadoop worker nodes) for kernel+jvm updates - T179943 [production]
09:19 <jynus> rebooting mariadb at labsdb1005 [production]
09:12 <moritzm> reimaging mw1259 (video scaler) to stretch, will be kept disabled initially (some controlled live tests following) [production]
08:57 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1096:3315 and 3316 - T178359 (duration: 00m 45s) [production]
08:45 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1096:3316 - T178359 (duration: 00m 45s) [production]
08:44 <moritzm> updating tor on radium to 0.3.1.9 [production]
08:41 <moritzm> updating tor packages to 0.3.1.9 [production]
08:30 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1096:3315 and pool db1096:3316 - T178359 (duration: 00m 45s) [production]
08:12 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Pool db1096:3315 - T178359 (duration: 00m 44s) [production]