|
2019-08-05
§
|
| 09:30 |
<marostegui> |
Stop MySQL on db2105 to change binlog format |
[production] |
| 09:18 |
<@> |
helmfile [STAGING] Ran 'apply' command on namespace 'restrouter' for release 'staging' . |
[production] |
| 09:07 |
<arturo> |
downtime toolschecker for 5hours |
[production] |
| 09:05 |
<@> |
helmfile [STAGING] Ran 'apply' command on namespace 'restrouter' for release 'staging' . |
[production] |
| 08:56 |
<moritzm> |
installing vim security updates for jessie (stretch/buster already fixed) |
[production] |
| 08:46 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Remove db2035 from config T229784 (duration: 00m 46s) |
[production] |
| 08:45 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-codfw.php: Remove db2035 from config T229784 (duration: 00m 47s) |
[production] |
| 08:43 |
<@> |
helmfile [STAGING] Ran 'apply' command on namespace 'restrouter' for release 'staging' . |
[production] |
| 08:32 |
<marostegui@cumin1001> |
dbctl commit of MediaWiki config (dc=all), diff saved to 'https://phabricator.wikimedia.org/P8861', previous config saved to /var/cache/conftool/dbconfig/20190805-083254-marostegui.json |
[production] |
| 08:21 |
<marostegui> |
Switchover s2 codfw master from db2035 to db2107 - T221533 T220170 |
[production] |
| 07:53 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-codfw.php: Reorganize s2 T228969 (duration: 00m 47s) |
[production] |
| 07:53 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Reorganize s2 T228969 (duration: 00m 48s) |
[production] |
| 07:52 |
<marostegui@deploy1001> |
sync-file aborted: Reorganize s2 T228969 (duration: 00m 06s) |
[production] |
| 07:49 |
<marostegui@cumin1001> |
dbctl commit of MediaWiki config (dc=all), diff saved to 'https://phabricator.wikimedia.org/P8859', previous config saved to /var/cache/conftool/dbconfig/20190805-074930-marostegui.json |
[production] |
| 07:45 |
<moritzm> |
installing unzip regression DLA for jessie |
[production] |
| 07:43 |
<moritzm> |
removed orespoolcounter[12]00[12] from debmonitor T227640 |
[production] |
| 07:23 |
<marostegui> |
Move db2095:3312 from db2063 to db2126 - T228969 |
[production] |
| 05:58 |
<marostegui> |
Update rack column on zarcillo.servers for the new servers T229683 |
[production] |
| 05:30 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Provision db2124 into s6 T228969 (duration: 00m 46s) |
[production] |
| 05:29 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-codfw.php: Provision db2124 into s6 T228969 (duration: 00m 49s) |
[production] |
| 05:28 |
<marostegui@cumin1001> |
dbctl commit of MediaWiki config (dc=all), diff saved to 'https://phabricator.wikimedia.org/P8858', previous config saved to /var/cache/conftool/dbconfig/20190805-052839-marostegui.json |
[production] |
|
2019-08-02
§
|
| 23:58 |
<mutante> |
scandium - apt-get remove --purge prometheus-hhvm-exporter - not needed here, no HHVM (T228069) |
[production] |
| 23:16 |
<XioNoX> |
Make the Level3 link between eqiad-knams primary - T228827 |
[production] |
| 23:06 |
<mutante> |
mwdebug1001/mwdebug1002 - restart-php7.2-fpm - low opcache |
[production] |
| 20:48 |
<sbassett> |
Deployed security patch for T229541 |
[production] |
| 20:14 |
<Urbanecm> |
Run mwscript deleteEqualMessages.php --wiki=cswiki --delete |
[production] |
| 19:24 |
<mutante> |
gerrit2001 - re-enabling puppet, starting as slave for the first time ever, thanks to codfw dbproxy, gerrit service running (T176532) |
[production] |
| 18:37 |
<mutante> |
gerrit2001 - disabling puppet, stopping gerrit service |
[production] |
| 18:36 |
<mutante> |
adding gerrit2001 to ferm rules on dbproxy for misc |
[production] |
| 18:14 |
<Lucas_WMDE> |
recached all WikibaseView messages in ResourceLoader for T229604, cf. https://w.wiki/6kc |
[production] |
| 17:46 |
<XioNoX> |
flap NTT link in eqsin |
[production] |
| 17:42 |
<lucaswerkmeister-wmde@deploy1001> |
Finished scap: Fix WikibaseView i18n globals (T229604) (duration: 16m 51s) |
[production] |
| 17:26 |
<XioNoX> |
add avoid_path to cr1/2-eqsin |
[production] |
| 17:25 |
<lucaswerkmeister-wmde@deploy1001> |
Started scap: Fix WikibaseView i18n globals (T229604) |
[production] |
| 17:19 |
<krinkle@deploy1001> |
Synchronized docroot/noc/db.php: a75d23ecb1b (duration: 00m 47s) |
[production] |
| 17:10 |
<krinkle@deploy1001> |
Synchronized docroot/noc/db.php: ee528e886268c08e9377fbd764ec861b09adfc73 (duration: 00m 48s) |
[production] |
| 16:42 |
<XioNoX> |
replace rhenium with netflow1001 netflow target + iBGP peer on all routers |
[production] |
| 15:52 |
<mholloway-shell@deploy1001> |
Finished deploy [mobileapps/deploy@250f711]: Fix MCS production crashers (T229521, T229630) (duration: 04m 41s) |
[production] |
| 15:47 |
<mholloway-shell@deploy1001> |
Started deploy [mobileapps/deploy@250f711]: Fix MCS production crashers (T229521, T229630) |
[production] |
| 15:14 |
<@> |
helmfile [STAGING] Ran 'apply' command on namespace 'restrouter' for release 'staging' . |
[production] |
| 15:12 |
<@> |
helmfile [STAGING] Ran 'apply' command on namespace 'restrouter' for release 'staging' . |
[production] |
| 14:14 |
<mforns@deploy1001> |
Finished deploy [analytics/refinery@b50a939]: deploying refinery up to b50a93955952ed863d5ef7703a91ab59f5d979cf (rollback of cassandra and edit_hourly hive2 actions to unbreak production) (duration: 16m 47s) |
[production] |
| 13:57 |
<mforns@deploy1001> |
Started deploy [analytics/refinery@b50a939]: deploying refinery up to b50a93955952ed863d5ef7703a91ab59f5d979cf (rollback of cassandra and edit_hourly hive2 actions to unbreak production) |
[production] |
| 13:54 |
<@> |
helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . |
[production] |