2701-2750 of 10000 results (86ms)
2019-08-05 §
11:42 <jbond@cumin1001> END (ERROR) - Cookbook sre.elasticsearch.rolling-restart (exit_code=97) [production]
11:42 <jbond@cumin1001> START - Cookbook sre.elasticsearch.rolling-restart [production]
11:38 <urbanecm@deploy1001> Synchronized php-1.34.0-wmf.16/extensions/MobileFrontend/: SWAT: b7ae4fb: Revert "[AMC] [desktop] [mobile] use AMC by default for desktop users" (T229722) (duration: 00m 49s) [production]
11:33 <marostegui> Upgrade MySQL on db2074 db2057 db2050 db2035 db2098 [production]
11:29 <urbanecm@deploy1001> Synchronized php-1.34.0-wmf.16/extensions/Wikibase: SWAT: 3ecaa57: Add only needed entity usages in AddUsagesForPageJob (T226818, T205045) (duration: 01m 12s) [production]
11:04 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 9eb74c2: Define import sources for fawiki (T229717) (duration: 00m 48s) [production]
10:40 <jbond42> update java on sessionstore [production]
10:40 <jdrewniak@deploy1001> Synchronized portals: Wikimedia Portals Update: [[gerrit:528092| Bumping portals to master (T128546)]] (duration: 00m 46s) [production]
10:39 <jdrewniak@deploy1001> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:528092| Bumping portals to master (T128546)]] (duration: 00m 49s) [production]
10:27 <ema> upload fifo-log-demux 0.5 to stretch-wikimedia [production]
10:12 <jbond42> rolling update of openjdk on maps servers [production]
09:30 <marostegui> Stop MySQL on db2105 to change binlog format [production]
09:18 <@> helmfile [STAGING] Ran 'apply' command on namespace 'restrouter' for release 'staging' . [production]
09:07 <arturo> downtime toolschecker for 5hours [production]
09:05 <@> helmfile [STAGING] Ran 'apply' command on namespace 'restrouter' for release 'staging' . [production]
08:56 <moritzm> installing vim security updates for jessie (stretch/buster already fixed) [production]
08:46 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Remove db2035 from config T229784 (duration: 00m 46s) [production]
08:45 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Remove db2035 from config T229784 (duration: 00m 47s) [production]
08:43 <@> helmfile [STAGING] Ran 'apply' command on namespace 'restrouter' for release 'staging' . [production]
08:32 <marostegui@cumin1001> dbctl commit of MediaWiki config (dc=all), diff saved to 'https://phabricator.wikimedia.org/P8861', previous config saved to /var/cache/conftool/dbconfig/20190805-083254-marostegui.json [production]
08:21 <marostegui> Switchover s2 codfw master from db2035 to db2107 - T221533 T220170 [production]
07:53 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Reorganize s2 T228969 (duration: 00m 47s) [production]
07:53 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Reorganize s2 T228969 (duration: 00m 48s) [production]
07:52 <marostegui@deploy1001> sync-file aborted: Reorganize s2 T228969 (duration: 00m 06s) [production]
07:49 <marostegui@cumin1001> dbctl commit of MediaWiki config (dc=all), diff saved to 'https://phabricator.wikimedia.org/P8859', previous config saved to /var/cache/conftool/dbconfig/20190805-074930-marostegui.json [production]
07:45 <moritzm> installing unzip regression DLA for jessie [production]
07:43 <moritzm> removed orespoolcounter[12]00[12] from debmonitor T227640 [production]
07:23 <marostegui> Move db2095:3312 from db2063 to db2126 - T228969 [production]
05:58 <marostegui> Update rack column on zarcillo.servers for the new servers T229683 [production]
05:30 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Provision db2124 into s6 T228969 (duration: 00m 46s) [production]
05:29 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Provision db2124 into s6 T228969 (duration: 00m 49s) [production]
05:28 <marostegui@cumin1001> dbctl commit of MediaWiki config (dc=all), diff saved to 'https://phabricator.wikimedia.org/P8858', previous config saved to /var/cache/conftool/dbconfig/20190805-052839-marostegui.json [production]
2019-08-04 §
18:45 <krinkle@deploy1001> Synchronized wmf-config/abusefilter.php: labs-only noop - f740f89c594979 (duration: 00m 50s) [production]
2019-08-03 §
12:02 <gilles> purging ruwiki articles on mwmaint1002 [production]
11:30 <gilles> purging eswiki articles on mwmaint1002 [production]
10:01 <ema> cp1085: restart varnish-be [production]
09:35 <gilles@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T216499 T216594 Renew origin trial tokens (duration: 00m 48s) [production]
00:40 <ejegg> rolled back fundraising python tools from 493a38f9e0 to 2a56e5e283 [production]
2019-08-02 §
23:58 <mutante> scandium - apt-get remove --purge prometheus-hhvm-exporter - not needed here, no HHVM (T228069) [production]
23:16 <XioNoX> Make the Level3 link between eqiad-knams primary - T228827 [production]
23:06 <mutante> mwdebug1001/mwdebug1002 - restart-php7.2-fpm - low opcache [production]
20:48 <sbassett> Deployed security patch for T229541 [production]
20:14 <Urbanecm> Run mwscript deleteEqualMessages.php --wiki=cswiki --delete [production]
19:24 <mutante> gerrit2001 - re-enabling puppet, starting as slave for the first time ever, thanks to codfw dbproxy, gerrit service running (T176532) [production]
18:37 <mutante> gerrit2001 - disabling puppet, stopping gerrit service [production]
18:36 <mutante> adding gerrit2001 to ferm rules on dbproxy for misc [production]
18:14 <Lucas_WMDE> recached all WikibaseView messages in ResourceLoader for T229604, cf. https://w.wiki/6kc [production]
17:46 <XioNoX> flap NTT link in eqsin [production]
17:42 <lucaswerkmeister-wmde@deploy1001> Finished scap: Fix WikibaseView i18n globals (T229604) (duration: 16m 51s) [production]
17:26 <XioNoX> add avoid_path to cr1/2-eqsin [production]