7301-7350 of 10000 results (63ms)
2017-08-28 §
12:03 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Add db1099 pooled with low weight to s5 - T172679 (duration: 00m 45s) [production]
11:05 <moritzm> installing libxml2 security updates [production]
08:41 <moritzm> restarting squid3 on install1002 [production]
08:16 <marostegui> Ugprade MariaDB on s4 codfw master - db2051 to 10.0.32 - T168661 [production]
08:10 <marostegui> Stop MySQL on db1045 - T172679 [production]
08:04 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1045 to clone db1099 from it - T172679 (duration: 00m 46s) [production]
07:51 <moritzm> reimaging mw1259 to jessie (T145742) [production]
07:22 <marostegui> Force re-learn cycle on db1055 - https://phabricator.wikimedia.org/T174265 [production]
07:12 <moritzm> installing openjdk security updates on notebook* hosts [production]
07:05 <moritzm> installing openjdk security updates on meitnerium [production]
02:36 <l10nupdate@tin> ResourceLoader cache refresh completed at Mon Aug 28 02:36:23 UTC 2017 (duration 6m 54s) [production]
02:29 <l10nupdate@tin> scap sync-l10n completed (1.30.0-wmf.15) (duration: 09m 36s) [production]
2017-08-27 §
20:35 <ariel@tin> Finished deploy [dumps/dumps@39f9b52]: write output files to temp location and move into place when complete (duration: 00m 02s) [production]
20:34 <ariel@tin> Started deploy [dumps/dumps@39f9b52]: write output files to temp location and move into place when complete [production]
15:46 <akosiaris> upload kubernetes_1.4.6-7 to apt.wikimedia.org/jessie-wikimedia/main T170346 [production]
05:30 <marostegui> Force BBU relearn on db1055 - T174265 [production]
00:45 <jynus> correction last log s/db1051/db1055/ [production]
00:42 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Depool db1051, hw issues, may get lag (duration: 00m 44s) [production]
2017-08-26 §
15:46 <godog> bounce varnish on cp1073 - mailbox lag [production]
2017-08-25 §
19:09 <gehel> actually not killing the "stuck discovery report-updater process on stat1005", it is already gone - T174110 [production]
19:07 <gehel> kill stuck discovery report-updater process on stat1005 - T174110 [production]
16:03 <moritzm> created cn=ciadmin group in LDAP to be used for privileged Jenkins access, initial members in ticket (T169557) [production]
14:29 <godog> bounce varnish on cp1049 / cp1072 - mailbox lag [production]
14:16 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db1097 - T168661 (duration: 00m 44s) [production]
13:53 <marostegui> Upgrade MariaDB on db1097 to 10.0.32 - T168661 [production]
13:53 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db1097 - T168661 (duration: 00m 44s) [production]
13:40 <marostegui> Upgrade MariaDB to 10.0.32 on db2019 - T168661 [production]
13:37 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2037 - T168661 (duration: 00m 45s) [production]
13:24 <marostegui> Upgrade MariaDB on db2037 to 10.0.32 - T168661 [production]
13:02 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2037 - T168661 (duration: 00m 44s) [production]
12:51 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2044 - T168661 (duration: 00m 44s) [production]
12:29 <marostegui> Upgrade MariaDB on db2044 - T168661 [production]
12:29 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2044 - T168661 (duration: 00m 43s) [production]
12:19 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2058 - T168661 (duration: 00m 48s) [production]
11:48 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Depool db1028 (duration: 00m 47s) [production]
09:19 <moritzm> restart thumbor to pick up libxml2 security updates [production]
09:12 <godog> reimage restbase2001 to test new partman recipe - T169939 [production]
08:41 <moritzm> restarting apache/hhvm on canary app servers to pick up libxml security update [production]
08:00 <volans> upgrading cumin to v1.0.0 on sarin/neodymium [production]
07:55 <gehel> reimaging logstash1006 after change of failed disk - T173679 [production]
07:49 <jynus@tin> Synchronized wmf-config/db-eqiad.php: pool db1069 with more weight (duration: 00m 44s) [production]
07:00 <jynus@tin> Synchronized wmf-config/db-eqiad.php: decom db1033, pool db1069 with low weight (duration: 00m 44s) [production]
06:55 <jynus@tin> Synchronized wmf-config/db-codfw.php: decom db1033 (duration: 00m 43s) [production]
06:30 <jynus@tin> Synchronized wmf-config/db-eqiad.php: formatting fixes (duration: 00m 44s) [production]
06:11 <jynus@tin> Synchronized wmf-config/db-codfw.php: repool es2013, formatting fixes (duration: 00m 44s) [production]
06:01 <marostegui> Upgrade MariaDB to 10.0.32 on db2058 - T168661 [production]
06:00 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2058 - T168661 (duration: 00m 43s) [production]
05:30 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2065 - T168661 (duration: 00m 44s) [production]
05:18 <moritzm> re-enable mw1260 (video scaler) for active job processing [production]
05:16 <marostegui> Reboot db2065 to pick up new kernel [production]