2951-3000 of 10000 results (46ms)
2018-04-23 §
10:26 <jdrewniak@tin> Synchronized portals: Wikimedia Portals Update: [[gerrit:428299|Bumping portals to master (T128546)]] (duration: 01m 16s) [production]
10:25 <jdrewniak@tin> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:428299|Bumping portals to master (T128546)]] (duration: 01m 17s) [production]
09:56 <_joe_> restarting memcached on mc1020-1036 at 1 hour intervals - T184854 [production]
09:13 <godog> Flashing Smart Array P840 in Slot 3 [ 4.52 -> 6.30 ] on ms-be2034 - T192721 T141756 [production]
09:05 <_joe_> AMEND: restart memcached on mc1019 (T184854) [production]
09:05 <_joe_> restart memcached on mw1019 (Ttail -f /var/log/etcdmirror-conftool-eqiad-wmnet/syslog.log [production]
09:05 <vgutierrez> restarting pybal on lvs1006 [production]
09:02 <_joe_> restarting etcdmirror on conf2002 after restarting nginx on conf1001 [production]
08:59 <moritzm> reimaging mw1283,mw1285,mw1286 (API servers) to stretch [production]
08:57 <marostegui> Deploy schema change on s6 codfw master (db2039) - this will generate lag on codfw - T191519 T188299 T190148 [production]
08:56 <gehel> rolling restart of blazegraph on wdqs1004, 2004 and 2005 for JVM upgrade [production]
08:55 <moritzm> reimaging mw1270,mw1271,mw1272 (app servers) to stretch [production]
08:52 <vgutierrez> restarting pybal on esams cluster [production]
08:50 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1078 (duration: 01m 16s) [production]
08:48 <_joe_> upgrading nginx on the config cluster in eqiad (T164456) [production]
08:47 <marostegui> Drop table logging_pre_1_10 in s5 - T118859 [production]
08:47 <marostegui> Dropped table logging_pre_1_10 in s3 - T118859 [production]
08:42 <vgutierrez> restarting pybal on lvs4006 [production]
08:40 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1078 (duration: 01m 18s) [production]
08:36 <vgutierrez> restarting pybal on codfw (once at a time) [production]
08:33 <vgutierrez> restart pybal on lvs4007 [production]
08:31 <vgutierrez> restarting pybal on lvs5002 [production]
08:30 <vgutierrez> restarting pybal on lvs5001 [production]
08:30 <marostegui> Drop table logging_pre_1_10 in s4 - T118859 [production]
08:27 <vgutierrez> restarting pybal on lvs4005 [production]
08:27 <_joe_> restarting pybal on lvs5003 [production]
08:17 <_joe_> upgrading nginx on the config cluster in codfw (T164456) [production]
08:13 <marostegui> Drop table logging_pre_1_10 in s7 - T118859 [production]
08:08 <_joe_> restarting memcached in codfw (T184854) [production]
08:08 <gehel> restarting blazegraph on wdqs1003 (crazy number of java threads) [production]
08:04 <moritzm> upgrading terbium to MEMC_VAL_COMPRESSION_ZLIB enabled HHVM build [production]
07:58 <ema> cp-misc: upgrade varnish to 5.1.3-1wm7 [production]
07:55 <marostegui> reload haproxy on dbproxy1010 to depool labsdb1010 [production]
07:55 <marostegui> Depool labsdb1010 - T184446 [production]
07:50 <marostegui> Drop table logging_pre_1_10 in s2 - T118859 [production]
07:47 <marostegui> Drop table logging_pre_1_10 in s6 - T118859 [production]
07:36 <moritzm> upgrading remaining API servers to MEMC_VAL_COMPRESSION_ZLIB enabled HHVM build [production]
07:35 <elukey> reboot ms-be2034 - stuck in com2 console with "sd 0:1:0:1: rejecting I/O to offline device", not responsive to ssh [production]
07:00 <moritzm> upgrading remaining app servers to MEMC_VAL_COMPRESSION_ZLIB enabled HHVM build [production]
06:26 <marostegui> Remove logging_pre_1_10 from codfw - T118859 [production]
05:28 <marostegui> flow_subscription empty table from officewiki - T149936 [production]
05:17 <marostegui> Deploy schema change on db1070 (s5 primary master) - T191519 T188299 T190148 [production]
02:40 <l10nupdate@tin> scap sync-l10n completed (1.31.0-wmf.29) (duration: 05m 56s) [production]
2018-04-22 §
16:29 <ariel@tin> Finished deploy [dumps/dumps@bb7ae96]: creadtedirs date fixup, rerun only missing stub type (duration: 00m 03s) [production]
16:29 <ariel@tin> Started deploy [dumps/dumps@bb7ae96]: creadtedirs date fixup, rerun only missing stub type [production]
2018-04-21 §
17:31 <andrewbogott> re-imaging labvirt1016 and labvirt1018 with Jessie [production]
07:35 <hashar> restarting Jenkins for a plugin update | T192660 [production]
07:33 <hashar> (previous changes are solely for CI, noop in production) [production]
07:33 <hashar> on tin rebasing wmf/1.31.0-wmf.29 for https://gerrit.wikimedia.org/r/#/c/428044/ https://gerrit.wikimedia.org/r/#/c/426884/ [production]
00:01 <krinkle@tin> Synchronized wmf-config/CommonSettings-labs.php: beta-only (duration: 01m 17s) [production]