|
2019-08-08
ยง
|
| 21:28 |
<mutante> |
rolling out new scap package 3.12.0-1 on contint servers |
[production] |
| 21:22 |
<mutante> |
built new scap version 3.12.0-1 on boron, imported packages on install1002 (apt.wm.org), copied from stretch to jessie and buster (T230144) |
[production] |
| 20:33 |
<gehel@cumin1001> |
END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) |
[production] |
| 19:36 |
<thcipriani> |
restart gerrit on cobalt to pick up new config |
[production] |
| 19:34 |
<thcipriani> |
restart gerrit-replica on gerrit2001 to pick up new config |
[production] |
| 19:27 |
<gehel@cumin1001> |
START - Cookbook sre.wdqs.data-transfer |
[production] |
| 19:06 |
<brennen@deploy1001> |
rebuilt and synchronized wikiversions files: all wikis to 1.34.0-wmf.17 |
[production] |
| 17:52 |
<XioNoX> |
run /usr/local/sbin/restart-php7.2-fpm on mwdebug1001 |
[production] |
| 17:33 |
<fdans@deploy1001> |
Finished deploy [analytics/refinery@cef01d3]: deploy analytics refinery, second attempt (duration: 16m 52s) |
[production] |
| 17:21 |
<XioNoX> |
add user jbond to network devices |
[production] |
| 17:16 |
<fdans@deploy1001> |
Started deploy [analytics/refinery@cef01d3]: deploy analytics refinery, second attempt |
[production] |
| 16:56 |
<ppchelko@deploy1001> |
Finished deploy [changeprop/deploy@069d297]: Remove workaround for ORES not supporting eventgate events T228688 (duration: 01m 24s) |
[production] |
| 16:55 |
<ppchelko@deploy1001> |
Started deploy [changeprop/deploy@069d297]: Remove workaround for ORES not supporting eventgate events T228688 |
[production] |
| 16:40 |
<fdans@deploy1001> |
Started deploy [analytics/refinery@cef01d3]: deploying analytics refinery |
[production] |
| 15:49 |
<XioNoX> |
set virtual-chassis vcp-snmp-statistics to all VC - T228824 |
[production] |
| 15:13 |
<herron> |
rebooting fermium (lists) for security updates |
[production] |
| 15:11 |
<XioNoX> |
commit synchronize on cr1-codfw - T226422 |
[production] |
| 14:52 |
<XioNoX> |
continue cr1-codfw:re1 replacement - T226422 |
[production] |
| 13:09 |
<marostegui> |
Drop table math from s8 T196055 |
[production] |
| 12:15 |
<tarrow> |
EU midday SWAT done |
[production] |
| 12:15 |
<tarrow@deploy1001> |
Synchronized php-1.34.0-wmf.17/extensions/Wikibase/: SWAT: [[gerrit:529059|Add hook to invalidate cache entries missing TermboxOption (T228978)]] (duration: 01m 14s) |
[production] |
| 12:01 |
<tarrow@deploy1001> |
Synchronized php-1.34.0-wmf.17/extensions/Wikibase/: SWAT: [[gerrit:529055|Split ParserCache on Termbox (T228978)]] (duration: 01m 21s) |
[production] |
| 12:00 |
<tarrow> |
Running SWAT a little over time because late start and slow jenkins |
[production] |
| 11:46 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: dfeb2a9: HD logo for enwikivoyage (T230114) (duration: 00m 56s) |
[production] |
| 11:44 |
<urbanecm@deploy1001> |
Synchronized static/images/project-logos/: SWAT: dfeb2a9: HD logo for enwikivoyage (T230114) (duration: 00m 56s) |
[production] |
| 11:31 |
<Urbanecm> |
Purge https://en.wikipedia.org/static/images/project-logos/zhwikisource.png (T229715) |
[production] |
| 11:30 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: be886ad: Add hd variations for zhwikiource project logo (T229715) (duration: 00m 55s) |
[production] |
| 11:28 |
<urbanecm@deploy1001> |
Synchronized static/images/project-logos/: SWAT: be886ad: Add hd variations for zhwikiource project logo (T229715) (duration: 00m 56s) |
[production] |
| 11:24 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: 9a4494a: Add Hubblesite.org and Spacetelescope.org to commons wgCopyUploadsDomains (T230083) (duration: 00m 57s) |
[production] |
| 11:05 |
<Urbanecm> |
Run scap pull on mwdebug1001 to revert local modifications (T207627) |
[production] |
| 10:53 |
<jijiki> |
Disable puppet, depool and pool mw1221, mw1222, mw1223 for 529061 |
[production] |
| 10:46 |
<Urbanecm> |
Set $wgContentHandlers["flow-board"] = $wgContentHandlers["wikitext"]; locally on mwdebug1001 to fix few bad pages (T207627) |
[production] |
| 10:43 |
<moritzm> |
installing exim4 security updates on buster hosts (our exim config is not vulnerable) |
[production] |
| 09:41 |
<moritzm> |
installing OpenJDK security updates on WDQS servers |
[production] |
| 09:30 |
<jbond42> |
disabling puppet fleet wide |
[production] |
| 09:26 |
<marostegui> |
Drop table math from labswiki (wikitech) and labtestwiki T196055 |
[production] |
| 09:20 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Remove db2069 from config T230107 (duration: 00m 55s) |
[production] |
| 09:19 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-codfw.php: Remove db2069 from config T230107 (duration: 00m 57s) |
[production] |
| 08:45 |
<elukey> |
restart hadoop namenodes on an-master100* to pick up new GC settings (CMS -> G1 switch) |
[production] |
| 08:44 |
<moritzm> |
installing OpenJDK security updates on elastic* servers |
[production] |
| 08:36 |
<marostegui> |
Remove math table from s5 T196055 |
[production] |
| 08:13 |
<marostegui> |
Stop MySQL on db2065 to test dbproxy2003 |
[production] |
| 07:48 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-codfw.php: Promote db2096 as codfw x1 master T220170 (duration: 00m 57s) |
[production] |
| 07:39 |
<marostegui> |
Switchover x1 codfw master db2069 -> db2096 T220170 |
[production] |
| 06:40 |
<_joe_> |
restarting php-fpm on the application servers to pick up the change |
[production] |
| 05:54 |
<marostegui> |
Stop MySQL on db2035 for decommissioning T229784 |
[production] |
| 05:52 |
<marostegui> |
Remove db2035 from tendril and zarcillo T229784 |
[production] |
| 00:48 |
<mutante> |
mwdebug2002 - sudo -i restart-php7.2-fpm |
[production] |
| 00:20 |
<ejegg> |
re-enabled both recurring charge jobs |
[production] |
| 00:02 |
<tstarling@deploy1001> |
Synchronized wmf-config/CommonSettings.php: hack for Parsoid testing on scandium (duration: 00m 55s) |
[production] |