401-450 of 10000 results (63ms)
2019-08-05 §
09:18 <@> helmfile [STAGING] Ran 'apply' command on namespace 'restrouter' for release 'staging' . [production]
09:07 <arturo> downtime toolschecker for 5hours [production]
09:05 <@> helmfile [STAGING] Ran 'apply' command on namespace 'restrouter' for release 'staging' . [production]
08:56 <moritzm> installing vim security updates for jessie (stretch/buster already fixed) [production]
08:46 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Remove db2035 from config T229784 (duration: 00m 46s) [production]
08:45 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Remove db2035 from config T229784 (duration: 00m 47s) [production]
08:43 <@> helmfile [STAGING] Ran 'apply' command on namespace 'restrouter' for release 'staging' . [production]
08:32 <marostegui@cumin1001> dbctl commit of MediaWiki config (dc=all), diff saved to 'https://phabricator.wikimedia.org/P8861', previous config saved to /var/cache/conftool/dbconfig/20190805-083254-marostegui.json [production]
08:21 <marostegui> Switchover s2 codfw master from db2035 to db2107 - T221533 T220170 [production]
07:53 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Reorganize s2 T228969 (duration: 00m 47s) [production]
07:53 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Reorganize s2 T228969 (duration: 00m 48s) [production]
07:52 <marostegui@deploy1001> sync-file aborted: Reorganize s2 T228969 (duration: 00m 06s) [production]
07:49 <marostegui@cumin1001> dbctl commit of MediaWiki config (dc=all), diff saved to 'https://phabricator.wikimedia.org/P8859', previous config saved to /var/cache/conftool/dbconfig/20190805-074930-marostegui.json [production]
07:45 <moritzm> installing unzip regression DLA for jessie [production]
07:43 <moritzm> removed orespoolcounter[12]00[12] from debmonitor T227640 [production]
07:23 <marostegui> Move db2095:3312 from db2063 to db2126 - T228969 [production]
05:58 <marostegui> Update rack column on zarcillo.servers for the new servers T229683 [production]
05:30 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Provision db2124 into s6 T228969 (duration: 00m 46s) [production]
05:29 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Provision db2124 into s6 T228969 (duration: 00m 49s) [production]
05:28 <marostegui@cumin1001> dbctl commit of MediaWiki config (dc=all), diff saved to 'https://phabricator.wikimedia.org/P8858', previous config saved to /var/cache/conftool/dbconfig/20190805-052839-marostegui.json [production]
2019-08-04 §
18:45 <krinkle@deploy1001> Synchronized wmf-config/abusefilter.php: labs-only noop - f740f89c594979 (duration: 00m 50s) [production]
2019-08-03 §
12:02 <gilles> purging ruwiki articles on mwmaint1002 [production]
11:30 <gilles> purging eswiki articles on mwmaint1002 [production]
10:01 <ema> cp1085: restart varnish-be [production]
09:35 <gilles@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T216499 T216594 Renew origin trial tokens (duration: 00m 48s) [production]
00:40 <ejegg> rolled back fundraising python tools from 493a38f9e0 to 2a56e5e283 [production]
2019-08-02 §
23:58 <mutante> scandium - apt-get remove --purge prometheus-hhvm-exporter - not needed here, no HHVM (T228069) [production]
23:16 <XioNoX> Make the Level3 link between eqiad-knams primary - T228827 [production]
23:06 <mutante> mwdebug1001/mwdebug1002 - restart-php7.2-fpm - low opcache [production]
20:48 <sbassett> Deployed security patch for T229541 [production]
20:14 <Urbanecm> Run mwscript deleteEqualMessages.php --wiki=cswiki --delete [production]
19:24 <mutante> gerrit2001 - re-enabling puppet, starting as slave for the first time ever, thanks to codfw dbproxy, gerrit service running (T176532) [production]
18:37 <mutante> gerrit2001 - disabling puppet, stopping gerrit service [production]
18:36 <mutante> adding gerrit2001 to ferm rules on dbproxy for misc [production]
18:14 <Lucas_WMDE> recached all WikibaseView messages in ResourceLoader for T229604, cf. https://w.wiki/6kc [production]
17:46 <XioNoX> flap NTT link in eqsin [production]
17:42 <lucaswerkmeister-wmde@deploy1001> Finished scap: Fix WikibaseView i18n globals (T229604) (duration: 16m 51s) [production]
17:26 <XioNoX> add avoid_path to cr1/2-eqsin [production]
17:25 <lucaswerkmeister-wmde@deploy1001> Started scap: Fix WikibaseView i18n globals (T229604) [production]
17:19 <krinkle@deploy1001> Synchronized docroot/noc/db.php: a75d23ecb1b (duration: 00m 47s) [production]
17:10 <krinkle@deploy1001> Synchronized docroot/noc/db.php: ee528e886268c08e9377fbd764ec861b09adfc73 (duration: 00m 48s) [production]
16:42 <XioNoX> replace rhenium with netflow1001 netflow target + iBGP peer on all routers [production]
15:52 <mholloway-shell@deploy1001> Finished deploy [mobileapps/deploy@250f711]: Fix MCS production crashers (T229521, T229630) (duration: 04m 41s) [production]
15:47 <mholloway-shell@deploy1001> Started deploy [mobileapps/deploy@250f711]: Fix MCS production crashers (T229521, T229630) [production]
15:14 <@> helmfile [STAGING] Ran 'apply' command on namespace 'restrouter' for release 'staging' . [production]
15:12 <@> helmfile [STAGING] Ran 'apply' command on namespace 'restrouter' for release 'staging' . [production]
14:14 <mforns@deploy1001> Finished deploy [analytics/refinery@b50a939]: deploying refinery up to b50a93955952ed863d5ef7703a91ab59f5d979cf (rollback of cassandra and edit_hourly hive2 actions to unbreak production) (duration: 16m 47s) [production]
13:57 <mforns@deploy1001> Started deploy [analytics/refinery@b50a939]: deploying refinery up to b50a93955952ed863d5ef7703a91ab59f5d979cf (rollback of cassandra and edit_hourly hive2 actions to unbreak production) [production]
13:54 <@> helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . [production]
13:45 <oblivian@puppetmaster1001> conftool action : set/weight=10; selector: cluster=api_appserver,dc=eqiad,service=nginx,name=mw12[23].* [production]