5851-5900 of 10000 results (85ms)
2019-10-28 §
18:15 <Urbanecm> Run mwscript namespaceDupes.php --wiki=thwikisource --fix (T236640) [production]
18:14 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: ea927dd: Rename author NS at thwikisource (T236640) (duration: 00m 53s) [production]
18:07 <urbanecm@deploy1001> Synchronized wmf-config/: SWAT: ddaa534: Config changes for Echo kask migration (T222851) (duration: 00m 55s) [production]
17:20 <elukey@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
17:12 <bblack> mr1-eqiad: fix bast3004 access for eqiad mgmt network - T236686 [production]
17:11 <_joe_> starting rolling restart of memcached servers in eqiad, beginning with mc1019 T235188 [production]
17:11 <bblack> mr1-codfw: fix bast3004 access for codfw mgmt network - T236686 [production]
17:10 <bblack> mr1-ulsfo: fix bast3004 access for ulsfo mgmt network - T236686 [production]
16:57 <bblack> mr1-eqsin: fix bast3004 access for eqsin mgmt network - T236686 [production]
16:56 <elukey@cumin1001> START - Cookbook sre.ganeti.makevm [production]
16:54 <bblack> mr1-esams: fix bast3004 access for esams mgmt network - T236686 [production]
16:36 <jbond42> restart puppetdb on pupetdb1001 to remove queue [production]
13:50 <ema> pool cp5007 with ATS backend T227432 [production]
13:30 <godog> roll restart logstash in codfw/eqiad to apply new config [production]
13:23 <effie> enable puppet on mw1*, depool and repool to reload apache - T229792 [production]
13:13 <effie> enable puppet on mw[1261-1265].eqiad.wmnet (mw canaries), depool and repool to reload apache - T229792 [production]
13:07 <ema@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
13:07 <ema@cumin1001> START - Cookbook sre.hosts.downtime [production]
13:05 <effie> enable puppet on mw2* servers, depool and repool to reload apache - T229792 [production]
13:01 <jynus> stop db1114 for testing [production]
12:30 <ema> depool cp5007 and reimage as text_ats T227432 [production]
12:22 <effie> depool mw2150 [production]
11:56 <twentyafterfour@deploy1001> Finished deploy [phabricator/deployment@e4e2b22]: testing deployment of phabricator to phab1001 (duration: 00m 05s) [production]
11:56 <twentyafterfour@deploy1001> Started deploy [phabricator/deployment@e4e2b22]: testing deployment of phabricator to phab1001 [production]
11:34 <Urbanecm> EU SWAT done [production]
11:33 <urbanecm@deploy1001> Synchronized php-1.35.0-wmf.3/extensions/VisualEditor/includes/ApiVisualEditorEdit.php: SWAT: 8caf681: Dont log missing ETags when creating a new page, thats normal (T233320) (duration: 00m 54s) [production]
11:33 <effie> Disable puppet on mw* for 545652 - T229792 [production]
11:12 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: dd2f06c: Add Translate channel for the Translate extension (T221119) (duration: 00m 53s) [production]
11:07 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: ff17666: Adjust wgUploadNavigationUrl for azwiki to point to commons UpWiz (T236307) (duration: 00m 53s) [production]
11:05 <urbanecm@deploy1001> Synchronized dblists/commonsuploads.dblist: SWAT: 7e26ef4: Revert "Restrict uploads on azwiki" (T236307) (duration: 00m 53s) [production]
11:02 <moritzm> installing OpenJDK security updates on elastic* [production]
10:40 <jdrewniak@deploy1001> Synchronized portals: Wikimedia Portals Update: [[gerrit:546442| Bumping portals to master (T128546)]] (duration: 00m 53s) [production]
10:39 <jdrewniak@deploy1001> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:546442| Bumping portals to master (T128546)]] (duration: 00m 54s) [production]
08:48 <godog> bump udp_localhost kafka-logging topics to 6 partitions and roll-restart logstash and rsyslog - T215904 [production]
08:26 <volans> manually cleanup changes reverted in https://gerrit.wikimedia.org/r/546407 on icinga[12]001 - T222074 [production]
08:25 <moritzm> installing file/libmagic security updates [production]
08:16 <mobrovac@deploy1001> Finished deploy [restbase/deploy@447981b]: Parsoid: Shim content-language and vary headers only for the PHP variant - T230791 (duration: 13m 42s) [production]
08:15 <godog> swift eqiad-prod: final weight to ms-be105[1-6] - T232367 [production]
08:02 <mobrovac@deploy1001> Started deploy [restbase/deploy@447981b]: Parsoid: Shim content-language and vary headers only for the PHP variant - T230791 [production]
07:40 <mobrovac@deploy1001> Finished deploy [restbase/deploy@c500d7a]: Add the Parsoid proxy for JS/PHP variants, add top mediarequests end point and add mnwwiki and ge.wm.org - T230791 T235744 T236389 (duration: 13m 44s) [production]
07:40 <elukey@deploy1001> Finished deploy [eventlogging/analytics@0f1ad6d]: Move codebase to Python3 - second attempt (duration: 00m 05s) [production]
07:40 <elukey@deploy1001> Started deploy [eventlogging/analytics@0f1ad6d]: Move codebase to Python3 - second attempt [production]
07:37 <elukey> upload archiva 2.2.4-1 to wikimedia-stretch (fix to avoid overriding archiva.xml upon install) [production]
07:27 <mobrovac@deploy1001> Started deploy [restbase/deploy@c500d7a]: Add the Parsoid proxy for JS/PHP variants, add top mediarequests end point and add mnwwiki and ge.wm.org - T230791 T235744 T236389 [production]
07:25 <mobrovac@deploy1001> Finished deploy [restbase/deploy@c500d7a] (dev-cluster): Add the Parsoid proxy for JS/PHP variants, add top mediarequests end point and add mnwwiki and ge.wm.org (duration: 02m 37s) [production]
07:22 <mobrovac@deploy1001> Started deploy [restbase/deploy@c500d7a] (dev-cluster): Add the Parsoid proxy for JS/PHP variants, add top mediarequests end point and add mnwwiki and ge.wm.org [production]
2019-10-26 §
11:30 <XioNoX> restart cr3-esams [production]
11:01 <XioNoX> re0.cr3-esams> request chassis routing-engine master switch [production]
2019-10-25 §
22:54 <mutante> moscovium rm /dev/shm/envoy_shared_memory_0 to revive envoy which failed to run after changing ports and reinstalling it (T180641) [production]
22:42 <mutante> moscovium - manually deleting envoy listener on 1443 and letting puppet recreate config because it's not removed if you change the port (T180641) [production]