2019-06-10
§
|
19:10 |
<akosiaris@deploy1001> |
scap-helm zotero upgrade -f zotero-values-codfw.yaml production stable/zotero [namespace: zotero, clusters: codfw] |
[production] |
17:55 |
<ottomata> |
rolling restart of AQS service using scap deploy for new mediawiki_history_snaphost |
[production] |
17:55 |
<otto@deploy1001> |
Started restart [analytics/aqs/deploy@fc1d232]: (no justification provided) |
[production] |
16:24 |
<marostegui> |
Power reset db1077 from the idrac T225391 |
[production] |
13:18 |
<mvolz@deploy1001> |
scap-helm citoid finished |
[production] |
13:18 |
<mvolz@deploy1001> |
scap-helm citoid cluster codfw completed |
[production] |
13:18 |
<mvolz@deploy1001> |
scap-helm citoid upgrade production -f citoid-codfw-values.yaml stable/citoid [namespace: citoid, clusters: codfw] |
[production] |
13:13 |
<mvolz@deploy1001> |
scap-helm citoid finished |
[production] |
13:13 |
<mvolz@deploy1001> |
scap-helm citoid cluster eqiad completed |
[production] |
13:13 |
<mvolz@deploy1001> |
scap-helm citoid upgrade production -f citoid-eqiad-values.yaml stable/citoid [namespace: citoid, clusters: eqiad] |
[production] |
13:04 |
<mvolz@deploy1001> |
scap-helm citoid finished |
[production] |
13:04 |
<mvolz@deploy1001> |
scap-helm citoid cluster staging completed |
[production] |
13:04 |
<mvolz@deploy1001> |
scap-helm citoid upgrade staging -f citoid-staging-values.yaml stable/citoid [namespace: citoid, clusters: staging] |
[production] |
05:37 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1077 - host crashed (duration: 00m 52s) |
[production] |
2019-06-07
§
|
18:56 |
<herron> |
performing rolling reboots of logstash codfw frontends for security updates |
[production] |
18:22 |
<cstone> |
Update payments-wiki revision changed from c6c7bbf71e to 75abd71cc1 |
[production] |
15:34 |
<godog> |
bounce rsyslog on wezen - T199406 |
[production] |
15:09 |
<elukey> |
restart thorium for kernel upgrades |
[production] |
14:00 |
<ema> |
pool cp3039 w/ ATS backend T222937 |
[production] |
13:15 |
<ema> |
depool cp3039 and reimage as upload_ats T222937 |
[production] |
13:04 |
<arturo> |
aborrero@cumin1001:~ $ sudo cumin "P{R:Systemd::Timer::Job}" "puppet agent --enable && run-puppet-agent" (patch already merged) |
[production] |
13:03 |
<arturo> |
aborrero@cumin1001:~$ sudo cumin "P{R:Systemd::Timer::Job}" "puppet agent --disable 'arturo merging systemd timer nrpe change'" (19 hosts affected) merging: https://gerrit.wikimedia.org/r/c/operations/puppet/+/514988 |
[production] |
11:45 |
<ema> |
pool cp3043 w/ ATS backend T222937 |
[production] |
10:51 |
<jbond42> |
upload libcpp-hocon0.1.6_0.1.6-1~bpo9+1_amd64.deb to wikimedia-stretch component/facter3 |
[production] |
10:45 |
<jbond42> |
upload libleatherman-data_1.4.0+dfsg-1\~bpo9+1_all.deb to wikimedia-stretch component/facter3 |
[production] |
10:43 |
<ema> |
depool cp3043 and reimage as upload_ats T222937 |
[production] |
10:09 |
<_joe_> |
restarting php-fpm on the codfw hosts to pick up the recent changes in opcache |
[production] |
09:59 |
<jbond42> |
upload libleatherman1.4.0_1.4.0+dfsg-1~bpo9+1_amd64.deb to wikimedia-stretch component/facter3 |
[production] |
09:49 |
<jbond42> |
upload libleatherman1.4.0_1.4.0+dfsg-1~bpo8+1_amd64.deb to wikimedia-jessie component/facter3 |
[production] |
09:16 |
<mobrovac@deploy1001> |
scap-helm mathoid finished |
[production] |
09:16 |
<mobrovac@deploy1001> |
scap-helm mathoid cluster codfw completed |
[production] |
09:16 |
<mobrovac@deploy1001> |
scap-helm mathoid cluster eqiad completed |
[production] |
09:16 |
<mobrovac@deploy1001> |
scap-helm mathoid upgrade production stable/mathoid -f mathoid-values.yaml [namespace: mathoid, clusters: eqiad,codfw] |
[production] |
09:00 |
<marostegui> |
Upgrade x1 codfw hosts in preparation for its failover T220170 |
[production] |
08:46 |
<elukey> |
start the reboot of the Analytics Hadoop's worker nodes for kernel+openjdk upgrades |
[production] |
08:24 |
<marostegui> |
Upgrade s2 codfw to 10.1.39 in preparation for its codfw failover - T221533 |
[production] |
08:19 |
<XioNoX> |
remove BGP session to AS55658 on cr1-eqsin (left the IXP) |
[production] |
08:12 |
<vgutierrez> |
upgrading certbot in wikitech-static |
[production] |
07:29 |
<marostegui> |
Drop unused temporary test tables on db1111 and db1112 |
[production] |
05:40 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-codfw.php: Move db2051 from s4 to s2T221533 (duration: 00m 49s) |
[production] |
00:00 |
<jforrester@deploy1001> |
Synchronized wmf-config/CommonSettings.php: Remove unused preference T47877-buster (duration: 00m 47s) |
[production] |
00:00 |
<bstorm_> |
T224850 repooled labsdb1009 after completing view updates |
[production] |