|
2019-01-14
ยง
|
| 14:31 |
<hashar> |
Nuked Castor cache for all *tox* jobs. Some might have cached binary wheels compiled against a lib that is no more existing (eg libmysqlclient.so.18 for mysql-python). Follow up the jessie -> stretch upgrade # T191764 |
[releng] |
| 14:28 |
<hashar> |
Deleted Castor cache for wikimedia-cz/tracker mysql-python got cached as a wheel but compiled against libmysqlclient.so.18. That fails with the new tox...:0.3.0 containers which uses mariadb / libmysqlclient.so compat symlink |
[releng] |
| 14:18 |
<dcausse> |
elasticsearch (search cluster): pre-populating omega & psi clusters in eqiad & codfw (from mwmaint1002 and mwmaint2001 respectively) (T210381) |
[production] |
| 14:13 |
<akosiaris@deploy1001> |
scap-helm zotero finished |
[production] |
| 14:13 |
<akosiaris@deploy1001> |
scap-helm zotero cluster eqiad completed |
[production] |
| 14:13 |
<akosiaris@deploy1001> |
scap-helm zotero upgrade production -f zotero-values-eqiad.yaml stable/zotero [namespace: zotero, clusters: eqiad] |
[production] |
| 14:11 |
<akosiaris@deploy1001> |
scap-helm zotero upgrade production --debug -f zotero-values-eqiad.yaml stable/zotero [namespace: zotero, clusters: eqiad] |
[production] |
| 14:10 |
<akosiaris@deploy1001> |
scap-helm zotero upgrade production -f zotero-values-eqiad.yaml stable/zotero [namespace: zotero, clusters: eqiad] |
[production] |
| 14:04 |
<marostegui> |
Add pc1007 to tendril and zarcillo - T208383 |
[production] |
| 14:00 |
<arturo> |
T213421 disable updatetools in the new services nodes while building them |
[tools] |
| 13:53 |
<arturo> |
T213421 delete tools-services-03/04 and create them with another prefix: tools-sge-services-03/04 to actually use the new role |
[tools] |
| 13:51 |
<akosiaris@deploy1001> |
scap-helm zotero finished |
[production] |
| 13:51 |
<akosiaris@deploy1001> |
scap-helm zotero cluster codfw completed |
[production] |
| 13:51 |
<akosiaris@deploy1001> |
scap-helm zotero upgrade production -f zotero-values-codfw.yaml stable/zotero [namespace: zotero, clusters: codfw] |
[production] |
| 13:49 |
<Jeff_Green> |
authdns update for T210445 |
[production] |
| 13:48 |
<dcausse> |
creating testcommonswiki index in the omega search-elastic cluster (eqiad & codfw) |
[production] |
| 13:47 |
<arturo> |
T213421 create tools-services-03 and tools-services-04 (stretch) they will use the new puppet role `role::wmcs::toolforge::services` |
[tools] |
| 13:42 |
<akosiaris@deploy1001> |
scap-helm zotero finished |
[production] |
| 13:42 |
<akosiaris@deploy1001> |
scap-helm zotero cluster codfw completed |
[production] |
| 13:42 |
<akosiaris@deploy1001> |
scap-helm zotero upgrade production --dry-run --debug -f zotero-values-codfw.yaml stable/zotero [namespace: zotero, clusters: codfw] |
[production] |
| 13:41 |
<akosiaris> |
rollback zotero codfw deployment |
[production] |
| 13:37 |
<akosiaris@deploy1001> |
scap-helm zotero upgrade production -f zotero-values-codfw.yaml stable/zotero [namespace: zotero, clusters: codfw] |
[production] |
| 13:37 |
<akosiaris@deploy1001> |
scap-helm zotero upgrade -f zotero-values-codfw.yaml stable/zotero [namespace: zotero, clusters: codfw] |
[production] |
| 13:10 |
<jijiki> |
Restarted npre on proton1002 |
[production] |
| 13:03 |
<zeljkof> |
eu swat finished |
[production] |
| 13:03 |
<zfilipin@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:481108|Add http://mbc.cyfrowemazowsze.pl to $wgCopyUploadsDomains (T212469)]] (duration: 00m 46s) |
[production] |
| 12:56 |
<zfilipin@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:481244|Localisation of Babel categories on nap.wikipedia.org (T123188)]] (duration: 00m 44s) |
[production] |
| 12:48 |
<zfilipin@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:483737|Configure $wgImportSources for ne.wiktionary (T213023)]] (duration: 00m 45s) |
[production] |
| 12:44 |
<zfilipin@deploy1001> |
sync-file aborted: SWAT: [[gerrit:481578|Configure $wgNamespaceAliases for yue.wiktionary (T212678)]] (duration: 00m 01s) |
[production] |
| 12:37 |
<zfilipin@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:481578|Configure $wgNamespaceAliases for yue.wiktionary (T212678)]] (duration: 00m 45s) |
[production] |
| 12:27 |
<zfilipin@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:481579|Configure $wgAddGroups, $wgRemoveGroups and $wgImportSources for ur.wiki (T212612)]] (duration: 00m 46s) |
[production] |
| 12:19 |
<zfilipin@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:480768|Add suppressredirect user right to patroller user group at zh.wikivoyage (T212272)]] (duration: 00m 46s) |
[production] |
| 12:10 |
<zfilipin@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:482508|Create Portal namespace on shn.wikipedia (T212992)]] (duration: 00m 46s) |
[production] |
| 12:05 |
<zfilipin@deploy1001> |
Synchronized wmf-config/throttle.php: SWAT: [[gerrit:483409|Add new throttle rule for Berklee College of Music library (T213311)]] (duration: 00m 52s) |
[production] |
| 11:20 |
<volans> |
installed spicerack 0.0.13 on cumin1001 - T205884 |
[production] |
| 10:39 |
<moritzm> |
start installing systemd security updates for stretch |
[production] |
| 10:13 |
<volans> |
installed spicerack 0.0.13 on cumin2001 for final testing - T205884 |
[production] |
| 10:11 |
<volans> |
uploaded spicerack_0.0.13-1_amd64.deb to apt.wikimedia.org stretch-wikimedia T205884 |
[production] |
| 10:07 |
<moritzm> |
install tmpreaper security updates on remaining hosts |
[production] |
| 09:51 |
<marostegui> |
Running aria_chk for all myisam tables on dbstore1002 T213670 |
[production] |
| 09:37 |
<marostegui> |
Running aria_chk for all linter tables on dbstore1002 - T213670 |
[production] |
| 08:44 |
<marostegui> |
Stop mysql on dbstore1002 - T213670 |
[production] |
| 08:38 |
<marostegui> |
Stop MySQL on pc2010 to clone pc1007 - T208383 |
[production] |
| 07:48 |
<elukey> |
executed bmc-device --debug --cold-reset on dbstore1002 - "No more sessions available" for mgmt |
[production] |
| 03:39 |
<rxy> |
Flags +AV were set on Vermont in #cvn-mediawiki. |
[cvn] |
| 03:36 |
<rxy> |
Flags +AV were set on Zhangj1079 in #cvn-wikivoyage. |
[cvn] |
| 03:36 |
<rxy> |
Flags +AV were set on Zhangj1079 in #cvn-wikidata. |
[cvn] |
| 03:36 |
<rxy> |
Flags +AV were set on Zhangj1079 in #cvn-mediawiki. |
[cvn] |
| 03:36 |
<rxy> |
Flags +AV were set on Zhangj1079 in #cvn-commons-uploads. |
[cvn] |
| 02:54 |
<bd808> |
Stopped webservice. Kubernetes pod stuck in CrashLoopBackOff with 8746 restarts |
[tools.etytree] |