5151-5200 of 10000 results (93ms)
2019-11-18 §
07:09 <marostegui> Stop MySQL on db2070 to clone db2135 - T238183 [production]
06:52 <vgutierrez> Move cp1083 from nginx to ats-tls - T231627 [production]
06:32 <vgutierrez> Move cp1081 from nginx to ats-tls - T231627 [production]
06:30 <marostegui> Restart tendril mysql - T231769 [production]
06:12 <vgutierrez> Move cp2012 from nginx to ats-tls - T231627 [production]
06:05 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1096:3316 for compression', diff saved to https://phabricator.wikimedia.org/P9652 and previous config saved to /var/cache/conftool/dbconfig/20191118-060508-marostegui.json [production]
06:02 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1105:3312 for compression', diff saved to https://phabricator.wikimedia.org/P9651 and previous config saved to /var/cache/conftool/dbconfig/20191118-060207-marostegui.json [production]
06:01 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2072, db2088:3311, db2087:3316, db2086:3317 after maintenances and schema changes', diff saved to https://phabricator.wikimedia.org/P9650 and previous config saved to /var/cache/conftool/dbconfig/20191118-060114-marostegui.json [production]
05:53 <marostegui> Deploy schema change on s5 primary master db1100 - T233135 T234066 [production]
03:40 <vgutierrez> Move cp2007 from nginx to ats-tls - T231627 [production]
00:44 <tstarling@deploy1001> Synchronized php-1.35.0-wmf.5/includes/Rest/Handler/PageHistoryCountHandler.php: fix extremely slow query T238378 (duration: 00m 59s) [production]
2019-11-17 §
18:52 <wm-bot> <lucaswerkmeister> deployed ef3af6b29f (clean up underscore handling; temporary experiment for OAuth errors still in effect) [tools.wd-image-positions]
15:23 <James_F> Zuul: Add dependency to BlueSpiceUEModuleBookPDF [releng]
15:23 <James_F> Zuul: Archive the OAuth2 extension T238429 [releng]
12:24 <hauskater> Deleted GitHub mirror for extension-OAuth2 refs. T238429 [releng]
05:04 <andrewbogott> deleting remaining project and instance (as per https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#DELETE_hhvm) [hhvm]
00:57 <James_F> Zuul: Enable seccheck on Wikisource; add BlueSpiceUEModuleBookPDF, BlueSpiceRecursive, BlueSpiceSubpages [releng]
00:27 <James_F> Zuul: Add Wikibase as dependency for Wikisource [releng]
2019-11-16 §
20:27 <ariel@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:25 <ariel@cumin1001> START - Cookbook sre.hosts.downtime [production]
12:17 <effie> restart rsyslog on mw2221 [production]
09:44 <elukey> systemctl restart hadoop-* on analytics1077 after oom killer [analytics]
09:43 <elukey> systemctl restart hadoop-* on analytics1077 after oom killer [production]
01:45 <wm-bot> <peterbowman> Register plwiktMissingPolishAudio dump job [tools.pbbot]
2019-11-15 §
22:14 <jeh@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
22:12 <jeh@cumin1001> START - Cookbook sre.hosts.downtime [production]
21:56 <James_F> Docker: Adding new images refreshed for PHP 7.2.24 T237275 [releng]
21:54 <jeh@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
21:52 <jeh@cumin1001> START - Cookbook sre.hosts.downtime [production]
21:31 <jeh@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
21:29 <jeh@cumin1001> START - Cookbook sre.hosts.downtime [production]
21:21 <_joe_> disabling proxying to ws on phabricator1003 [production]
20:39 <wm-bot> <lucaswerkmeister> deployed 57735fe450 (fix overflow behavior; temporary experiment for OAuth errors still in effect) [tools.wd-image-positions]
20:04 <andrewbogott> repool labdb1011 (T237509) [admin]
20:04 <XioNoX> push pfw policies to pfw3-eqiad - T238368 [production]
20:02 <XioNoX> push pfw policies to pfw3-codfw - T238368 [production]
19:29 <andrewbogott> running maintain-views --all-databases --replace-all —clean on labsdb1011 [admin]
19:25 <andrewbogott> depooling labsdb1011, killing remaining queries [admin]
19:25 <andrewbogott> repooling labsdb1010 [admin]
19:07 <XioNoX> remove vlan 1 trunking between msw1-codfw and mr1-codfw, will cause a quick connectivity issue - T228112 [production]
18:59 <andrewbogott> running maintain-views --all-databases --replace-all —clean on labsdb1012 [admin]
18:57 <andrewbogott> running maintain-views --all-databases --replace-all —clean on labsdb1010 [admin]
18:54 <andrewbogott> depooling labsdb1010, killing remaining user queries [admin]
18:54 <andrewbogott> depooled labsdb1009, ran maintain-views —clean —all-databases —replace-all, repooled [admin]
18:07 <XioNoX> homer push on management switches [production]
17:30 <mutante> phabricator - -started phd service [production]
17:11 <XioNoX> homer push to management routers (https://gerrit.wikimedia.org/r/550576) [production]
17:05 <elukey> restart hdfs-cleaner (failed due to tmp hive files not present when deleting) [analytics]
16:45 <James_F> Gearman merge queue clear thanks to hashar, all fixed. [releng]
16:43 <hashar> Restored zuul-merger / CI for operations/puppet.git [production]