651-700 of 10000 results (50ms)
2018-04-23 §
08:27 <_joe_> restarting pybal on lvs5003 [production]
08:17 <_joe_> upgrading nginx on the config cluster in codfw (T164456) [production]
08:13 <marostegui> Drop table logging_pre_1_10 in s7 - T118859 [production]
08:08 <_joe_> restarting memcached in codfw (T184854) [production]
08:08 <gehel> restarting blazegraph on wdqs1003 (crazy number of java threads) [production]
08:04 <moritzm> upgrading terbium to MEMC_VAL_COMPRESSION_ZLIB enabled HHVM build [production]
07:58 <ema> cp-misc: upgrade varnish to 5.1.3-1wm7 [production]
07:55 <marostegui> reload haproxy on dbproxy1010 to depool labsdb1010 [production]
07:55 <marostegui> Depool labsdb1010 - T184446 [production]
07:50 <marostegui> Drop table logging_pre_1_10 in s2 - T118859 [production]
07:47 <marostegui> Drop table logging_pre_1_10 in s6 - T118859 [production]
07:36 <moritzm> upgrading remaining API servers to MEMC_VAL_COMPRESSION_ZLIB enabled HHVM build [production]
07:35 <elukey> reboot ms-be2034 - stuck in com2 console with "sd 0:1:0:1: rejecting I/O to offline device", not responsive to ssh [production]
07:00 <moritzm> upgrading remaining app servers to MEMC_VAL_COMPRESSION_ZLIB enabled HHVM build [production]
06:26 <marostegui> Remove logging_pre_1_10 from codfw - T118859 [production]
05:28 <marostegui> flow_subscription empty table from officewiki - T149936 [production]
05:17 <marostegui> Deploy schema change on db1070 (s5 primary master) - T191519 T188299 T190148 [production]
02:40 <l10nupdate@tin> scap sync-l10n completed (1.31.0-wmf.29) (duration: 05m 56s) [production]
2018-04-22 §
16:29 <ariel@tin> Finished deploy [dumps/dumps@bb7ae96]: creadtedirs date fixup, rerun only missing stub type (duration: 00m 03s) [production]
16:29 <ariel@tin> Started deploy [dumps/dumps@bb7ae96]: creadtedirs date fixup, rerun only missing stub type [production]
2018-04-21 §
17:31 <andrewbogott> re-imaging labvirt1016 and labvirt1018 with Jessie [production]
07:35 <hashar> restarting Jenkins for a plugin update | T192660 [production]
07:33 <hashar> (previous changes are solely for CI, noop in production) [production]
07:33 <hashar> on tin rebasing wmf/1.31.0-wmf.29 for https://gerrit.wikimedia.org/r/#/c/428044/ https://gerrit.wikimedia.org/r/#/c/426884/ [production]
00:01 <krinkle@tin> Synchronized wmf-config/CommonSettings-labs.php: beta-only (duration: 01m 17s) [production]
2018-04-20 §
20:45 <andrewbogott> re-imaging labvirt1021 and 1022 as Jessie [production]
20:23 <ejegg> updated fundraising python tools from 0c50f9e38f to 7c5c7a5f9e [production]
18:23 <mutante> add LDAP user "tieu" to group "wmde" (T192256) [production]
17:42 <imarlier@tin> Finished deploy [performance/coal@99db58f]: coal - update to submit via graphite. Not yet active, requires puppet changes (duration: 00m 04s) [production]
17:41 <imarlier@tin> Started deploy [performance/coal@99db58f]: coal - update to submit via graphite. Not yet active, requires puppet changes [production]
17:35 <no_justification> gerrit: update mysql-client and deps 5.5.59 -> 5.5.60 [production]
17:28 <mutante> phabricator - restarted apache [production]
17:26 <mutante> phabricator (phab1001) - upgrading Apache, openssl, mysql-common [production]
17:17 <mutante> phab2001 - upgrading apache, openssl, mysql-common [production]
17:04 <andrewbogott> rebooting labvirt1021 and 1022 [production]
16:44 <dcausse@tin> Synchronized php-1.31.0-wmf.30/extensions/CirrusSearch/: T192609: Do not propagate Elastica doc modifications out of DataSender (duration: 01m 34s) [production]
15:07 <jynus@tin> Synchronized wmf-config/db-codfw.php: Repool db2087 (duration: 01m 16s) [production]
14:41 <jynus@tin> Synchronized wmf-config/db-codfw.php: Repool db2086, depool db2087 (duration: 01m 16s) [production]
14:16 <andrew@tin> Synchronized dblists: Purging obsolete silver.dblist (duration: 01m 17s) [production]
14:02 <moritzm> upgrading labweb* servers to MEMC_VAL_COMPRESSION_ZLIB enabled HHVM build [production]
14:00 <jynus> upgrade and restart db2086 [production]
13:59 <jynus@tin> Synchronized wmf-config/db-codfw.php: Depool db2086 (duration: 01m 13s) [production]
13:35 <anomie> (re-)creating `slots` table on all wikis, following up T190153 and T184446#4143097 [production]
13:25 <moritzm> upgrading mysql (as shipped in Debian) on bohrium [production]
13:00 <moritzm> installing zsh security updates on trusty servers [production]
12:25 <moritzm> upgrading apache on auth* servers [production]
12:18 <jynus> upgrading and restarting dbstore2002 [production]
12:15 <jynus@tin> Synchronized wmf-config/db-codfw.php: Repool db2070 (duration: 01m 17s) [production]
12:06 <moritzm> installing apache security updates on video scalers [production]
12:05 <moritzm> upgrading apache on einsteinium/icinga.wikimedia.org [production]