|
2018-11-27
§
|
| 23:49 |
<ejegg> |
updated payments-wiki config to 04f718e8f1 |
[production] |
| 23:29 |
<ejegg> |
updated payments-wiki config to 082eab3566 |
[production] |
| 22:35 |
<ejegg> |
rolled back payments-wiki to 86742dd4fd |
[production] |
| 22:33 |
<ejegg> |
updated payments-wiki from 86742dd4fd to 3ba10e49b0 |
[production] |
| 21:26 |
<ejegg> |
updated payments-wiki config to d497b7e880 |
[production] |
| 20:14 |
<andrewbogott> |
moving traffic back to novaproxy-01 |
[project-proxy] |
| 19:57 |
<andrewbogott> |
moving novaproxy-01 to labvirt1001 |
[project-proxy] |
| 19:55 |
<andrewbogott> |
moving traffic to novaproxy-02 |
[project-proxy] |
| 19:40 |
<thcipriani@deploy1001> |
rebuilt and synchronized wikiversions files: no op sync wikiversions to test scap 3.8.10-1 |
[production] |
| 18:54 |
<zhuyifei1999_> |
triggered OOM killer on quarry-worker-02 9 times T188564 |
[quarry] |
| 18:03 |
<thcipriani@deploy1001> |
rebuilt and synchronized wikiversions files: no op sync wikiversions to test scap 3.8.9-1 |
[production] |
| 17:51 |
<godog> |
upload scap 3.8.9-1 - T210469 |
[production] |
| 17:49 |
<bstorm_> |
restarted maintain-kubeusers just in case it had any issues reconnecting to toolsdb |
[tools] |
| 17:40 |
<bstorm_> |
T209517 rebooted labsdb1005 after upgrades |
[production] |
| 17:30 |
<bstorm_> |
T209517 icinga downtime labsdb1004 |
[production] |
| 17:30 |
<XioNoX> |
repool uslfo |
[production] |
| 17:25 |
<arturo> |
T209517 icinga downtime labsdb1005 |
[production] |
| 17:23 |
<arturo> |
T207377 icinga downtime labnet1001 |
[production] |
| 16:50 |
<andrewbogott> |
migrating project to eqiad1-r |
[social-tools] |
| 16:17 |
<mutante> |
einsteinium - apt-get remove --purge icinga nsca; apt-get autoremove ; apt-get remove --purge icinga-doc icinga-common icinga-cgi-bin icinga-cgi; apt-get remove --purge monitoring-plugin* ; rm /etc/rsync.d/frag-icinga* T209738 |
[production] |
| 16:14 |
<hashar@deploy1001> |
rebuilt and synchronized wikiversions files: group0 to 1.33.0-wmf.6 |
[production] |
| 16:09 |
<moritzm> |
rebooting planet1001 for kernel security update |
[production] |
| 16:04 |
<jynus@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1105 (duration: 00m 53s) |
[production] |
| 15:55 |
<Amir1> |
giving User:Fisch-WMDE and User:Thiemo Mättig (WMDE) admin rights on enwiki, dewiki and arwiki (WMDE staff, beta cluster) |
[releng] |
| 15:53 |
<moritzm> |
rebooting planet2001 for kernel security update |
[production] |
| 15:44 |
<moritzm> |
rebooting kafkamon1001 for kernel security update |
[production] |
| 15:41 |
<mutante> |
einsteinium - removed icinga package |
[production] |
| 15:39 |
<moritzm> |
rebooting kafkamon2001 for kernel security update |
[production] |
| 15:35 |
<mutante> |
einsteinium - stopped icinga, stopped nsca, stopped rsyncd, killall -u icinga, killall -u nagios ... T209738 |
[production] |
| 15:35 |
<hashar@deploy1001> |
Finished scap: testwiki to php-1.33.0-wmf.6 and rebuild l10n cache | T206660 (duration: 32m 42s) |
[production] |
| 15:21 |
<akosiaris> |
create graphoid namespace on kubernetes eqiad, codfw, staging clusters T203091 |
[production] |
| 15:02 |
<hashar@deploy1001> |
Started scap: testwiki to php-1.33.0-wmf.6 and rebuild l10n cache | T206660 |
[production] |
| 14:52 |
<hashar@deploy1001> |
Pruned MediaWiki: 1.32.0-wmf.26 (duration: 09m 48s) |
[production] |
| 14:43 |
<andrewbogott> |
migrating project to eqiad1-r |
[rcm] |
| 14:40 |
<hashar> |
Applied security patches for 1.33.0-wmf.6 | T206660 |
[production] |
| 14:33 |
<hashar> |
scap prep 1.33.0-wmf.6 | T206660 |
[production] |
| 14:26 |
<andrewbogott> |
migrating project to eqiad1-r |
[petscan] |
| 14:21 |
<andrewbogott> |
migrating project to eqiad1-r |
[osmit] |
| 14:04 |
<hashar> |
Cutting 1.33.0-wmf.6 branches | T206660 |
[production] |
| 14:00 |
<banyek> |
repooling db1105 due a schema change (T85757) |
[production] |
| 13:59 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Pool pc1010 in pc1 - T208383 (duration: 00m 46s) |
[production] |
| 13:59 |
<godog> |
cherry-pick https://gerrit.wikimedia.org/r/c/operations/puppet/+/475352 |
[releng] |
| 13:34 |
<marostegui> |
Change pc2007 and pc2010 to replicate from pc1010 instead of from pc1004 - T208383 |
[production] |
| 13:32 |
<gtirloni> |
enabled DRBD stats collection on labstore100[4-5] T208446 |
[admin] |
| 13:18 |
<banyek> |
executing schema change on db1105 (T85757) |
[production] |
| 13:18 |
<banyek@deploy1001> |
Synchronized wmf-config/db-eqiad.php: T85757: depool db1105 (duration: 00m 46s) |
[production] |
| 13:17 |
<pmiazga@deploy1001> |
Finished deploy [proton/deploy@9efc072]: Proton: Rewrite Queue to promise-way flow (T204055) (duration: 02m 43s) |
[production] |
| 13:15 |
<pmiazga@deploy1001> |
Started deploy [proton/deploy@9efc072]: Proton: Rewrite Queue to promise-way flow (T204055) |
[production] |
| 13:14 |
<banyek> |
depooling db1105 due a schema change (T85757) |
[production] |
| 13:09 |
<raynor> |
proton deploying 9efc07238f8dee62385799791718f4d57f754073 |
[production] |