|
2018-09-24
§
|
| 10:43 |
<jdrewniak@deploy1001> |
Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:462417|Bumping portals to master (T128546)]] (duration: 00m 50s) |
[production] |
| 09:59 |
<Lucas_WMDE> |
wikidata-constraints update MediaWiki and extensions to current master |
[wikidata-dev] |
| 09:51 |
<hashar> |
deployment-deploy01 : backed up /srv/mediawiki-staging/php-master/cache/gitinfo and created a new. Its size of 69632 bytes might cause slow writes?? | T204762 |
[releng] |
| 09:42 |
<jynus> |
stop and upgrade db1066 (s2 eqiad master)- it may create some temporary lag on s2 |
[production] |
| 09:30 |
<godog> |
upgrade / roll restart thumbor in eqiad / codfw - T20871 T198370 |
[production] |
| 09:24 |
<hashar> |
Live hacked scap code on deployment-deploy01 for T204762 and reverted hack changes |
[releng] |
| 09:03 |
<jynus> |
stop and upgrade db1067 (s1 eqiad master)- it may create some temporary lag on s1 |
[production] |
| 08:32 |
<hashar> |
deployment-deploy01 rm -fR /tmp/scap_l10n_* |
[releng] |
| 07:55 |
<l10nupdate@deploy1001> |
ResourceLoader cache refresh completed at Mon Sep 24 07:55:18 UTC 2018 (duration 10m 50s) |
[production] |
| 07:44 |
<bawolff@deploy1001> |
scap sync-l10n completed (1.32.0-wmf.22) (duration: 07m 44s) |
[production] |
| 07:31 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-codfw.php: Repool db2062 (duration: 00m 46s) |
[production] |
| 07:25 |
<bawolff_> |
manually running l10n update (T205238) |
[production] |
| 07:09 |
<moritzm> |
installing libarchive-zip-perl security updates |
[production] |
| 07:05 |
<volans> |
wiping netbox DB to re-import it cleanly from racktables - T199083 |
[production] |
| 06:58 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-codfw.php: Depool db2062 (duration: 00m 50s) |
[production] |
| 06:57 |
<godog> |
repair sde on ms-be2041 - T199198 |
[production] |
| 06:57 |
<godog> |
repair sdn on ms-be1041 - T199198 |
[production] |
| 06:54 |
<volans@deploy1001> |
Finished deploy [netbox/deploy@5e70423]: Cherry pick of custom fields fix (duration: 00m 05s) |
[production] |
| 06:54 |
<volans@deploy1001> |
Started deploy [netbox/deploy@5e70423]: Cherry pick of custom fields fix |
[production] |
| 06:41 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/462341 |
[releng] |
| 05:48 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-codfw.php: Repool db2088:3311 (duration: 00m 50s) |
[production] |
| 05:28 |
<marostegui> |
Deploy schema change on db2088:3311 - T203709 |
[production] |
| 05:27 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-codfw.php: Depool db2088:3311 (duration: 00m 50s) |
[production] |
| 04:15 |
<kartik@deploy1001> |
Finished deploy [cxserver/deploy@3e2d668]: Update cxserver to d913793 (T203551, T203780, T202716, T203947) (duration: 04m 20s) |
[production] |
| 04:10 |
<kartik@deploy1001> |
Started deploy [cxserver/deploy@3e2d668]: Update cxserver to d913793 (T203551, T203780, T202716, T203947) |
[production] |
| 03:45 |
<kart_> |
Update cxserver to d913793 |
[releng] |
| 02:48 |
<l10nupdate@deploy1001> |
ResourceLoader cache refresh completed at Mon Sep 24 02:48:16 UTC 2018 (duration 10m 49s) |
[production] |
| 02:37 |
<l10nupdate@deploy1001> |
scap sync-l10n completed (1.32.0-wmf.22) (duration: 16m 02s) |
[production] |
|
2018-09-23
§
|
| 21:41 |
<krinkle@deploy1001> |
Synchronized wmf-config/profiler.php: (no justification provided) (duration: 00m 52s) |
[production] |
| 18:51 |
<legoktm> |
restarted and updated all dependencies |
[tools.extreg-wos] |
| 16:56 |
<zhuyifei1999_> |
deployed till e74f575 on -web-01, T202588 T205153 |
[quarry] |
| 14:03 |
<Krenair> |
rm stuff in deployment-deploy01:/tmp to try to clear space and stop shinken whining |
[releng] |
| 04:32 |
<krinkle@deploy1001> |
Synchronized php-1.32.0-wmf.22/includes/user/User.php: T202149 - Ic0c25f66f23f (duration: 00m 53s) |
[production] |
| 04:08 |
<andrewbogott> |
deleting project as per https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#OBSOLETE_wdq-mm |
[wdq-mm] |
| 04:05 |
<andrewbogott> |
deleting project as per https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#OBSOLETE_tor |
[tor] |
| 04:04 |
<andrewbogott> |
deleting project as per https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#OBSOLETE_reading-lists |
[reading-lists] |
| 04:02 |
<andrewbogott> |
deleting project as per https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#OBSOLETE_mw-api-testing |
[mw-api-testing] |
| 03:58 |
<andrewbogott> |
deleting project as per https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2018_Purge#OBSOLETE_jupyter |
[jupyter] |
| 01:05 |
<andrewbogott> |
rebooted deployment-maps03; OOM and also T205195 |
[releng] |
| 01:05 |
<andrewbogott> |
rebooted deployment-maps03; OOM and also T205195 |
[deployment-prep] |
|
2018-09-22
§
|
| 20:51 |
<Hauskatze> |
github: deleting several wikimedia/mediawiki-extensions-Collection-.* mirror repos for T183891 |
[releng] |
| 20:05 |
<Hauskatze> |
github: deleted mirror wikimedia/mediawiki-extensions-Collection-OfflineContentGenerator-zim_renderer | T183891; moving to the next one |
[releng] |
| 18:28 |
<krinkle@deploy1001> |
Synchronized php-1.32.0-wmf.22/extensions/MultimediaViewer/resources/: I0954c42a37668b0, T205162 (duration: 00m 56s) |
[production] |
| 18:21 |
<Krenair> |
went to do the same with deployment-maps03 and accidentally broke SSH access to the server |
[releng] |
| 18:20 |
<Krenair> |
removed ferm package from deployment-snapshot01 as it appeared unmanaged by puppet and was causing problems with SSH access from the current deployment hosts (previous logs referenced T153468, this just explains why puppet hadn't purged stuff) |
[releng] |
| 18:01 |
<Krenair> |
rm deployment-maps03:/etc/ferm/conf.d/10_redis_exporter_6379 as it was breaking ferm from starting (T153468), puppet has not re-created it so I assume it was historical (shouldn't puppet be purging such files?) |
[releng] |
| 18:00 |
<Krenair> |
rm deployment-snapshot01:/etc/ferm/conf.d/10_prometheus-nutcracker-exporter as it was breaking ferm from starting (T153468), puppet has not re-created it so I assume it was historical (shouldn't puppet be purging such files?) |
[releng] |