|
2018-03-14
ยง
|
| 20:16 |
<demon@tin> |
Finished scap: scapping, pt. 2. prior one failed because i tested something (duration: 69m 43s) |
[production] |
| 19:06 |
<demon@tin> |
Started scap: scapping, pt. 2. prior one failed because i tested something |
[production] |
| 19:06 |
<demon@tin> |
scap failed: LockFailedError Failed to acquire lock "/var/lock/scap.operations_mediawiki-config.lock"; owner is "demon"; reason is "rebuilding l10n" (duration: 00m 00s) |
[production] |
| 18:20 |
<jynus> |
running pt-table-checksum on all m2, some lag will happen on passive replicas |
[production] |
| 18:16 |
<jynus> |
running pt-table-checksum on all m1, some lag will happen on passive replicas |
[production] |
| 17:56 |
<demon@tin> |
Started scap: rebuilding l10n |
[production] |
| 17:55 |
<reedy@tin> |
Synchronized php-1.31.0-wmf.25/extensions/CentralNotice: updates! (duration: 01m 16s) |
[production] |
| 17:54 |
<demon@tin> |
scap failed: LockFailedError Failed to acquire lock "/var/lock/scap.operations_mediawiki-config.lock"; owner is "reedy"; reason is "updates!" (duration: 00m 00s) |
[production] |
| 17:54 |
<reedy@tin> |
Synchronized php-1.31.0-wmf.24/extensions/CentralNotice: updates! (duration: 01m 18s) |
[production] |
| 17:26 |
<maxsem@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/416489 (duration: 01m 14s) |
[production] |
| 17:18 |
<maxsem@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/419077 (duration: 01m 15s) |
[production] |
| 16:58 |
<hoo> |
Manually running extensions/Wikibase/repo/maintenance/dispatchChanges.php on terbium, so that dispatching can catch up |
[production] |
| 16:56 |
<jynus> |
deploying new firewall rules to dbproxy1001 and 7 |
[production] |
| 16:40 |
<moritzm> |
installing cron updates from stretch 9.4 point release |
[production] |
| 16:35 |
<demon@tin> |
Synchronized .gitignore: ignore scap logs (duration: 01m 15s) |
[production] |
| 16:22 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Restore db1074 original weight (duration: 01m 13s) |
[production] |
| 16:12 |
<godog> |
temporarily add back puppetmaster2002 as a low-weight backend |
[production] |
| 15:48 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Increase traffic for db1074 (duration: 01m 15s) |
[production] |
| 15:47 |
<andrew@tin> |
Synchronized multiversion/MWMultiVersion.php: wikitech cleanup (duration: 01m 14s) |
[production] |
| 15:25 |
<XioNoX> |
Re-enabling BGP on cr2-codfw Zayo transit - T189452 |
[production] |
| 15:12 |
<XioNoX> |
Disabling BGP on cr2-codfw Zayo transit - T189452 |
[production] |
| 15:02 |
<jynus> |
disabling puppet in preparation for reimage of dbproxy1002 and 6 |
[production] |
| 14:59 |
<moritzm> |
installing virt-what updates from stretch point release |
[production] |
| 14:58 |
<paravoid> |
rebooting furud |
[production] |
| 14:44 |
<ottomata> |
beginning migration of eventlogging analtyics from Kafka analytics to Kafka jumbo: T183297 |
[production] |
| 14:33 |
<godog> |
depool puppetmaster2002 for reimage |
[production] |
| 14:06 |
<Reedy> |
created wbc_entity_uages on ruwikimedia T188456 |
[production] |
| 13:50 |
<zeljkof> |
EU SWAT finished |
[production] |
| 13:49 |
<zfilipin@tin> |
Synchronized dblists/wikidataclient.dblist: SWAT: [[gerrit:419425|Revert "Add ruwikimedia to wikidataclient" (T188456)]] (duration: 01m 14s) |
[production] |
| 13:42 |
<zfilipin@tin> |
Synchronized docroot/noc/conf/: SWAT: [[gerrit:419422|Revert "Publish throttle-analyze at noc" (T187894)]] (duration: 01m 15s) |
[production] |
| 13:21 |
<ppchelko@tin> |
Finished deploy [cpjobqueue/deploy@c879056]: Deduplicate based on the root job dt and sha1 combination. Forgot to pull (duration: 00m 33s) |
[production] |
| 13:21 |
<ppchelko@tin> |
Started deploy [cpjobqueue/deploy@c879056]: Deduplicate based on the root job dt and sha1 combination. Forgot to pull |
[production] |
| 13:21 |
<zfilipin@tin> |
Synchronized docroot/noc/conf/throttle-analyze.php.txt: SWAT: [[gerrit:414758|Publish throttle-analyze at noc (T187894)]] (duration: 01m 13s) |
[production] |
| 13:20 |
<ppchelko@tin> |
Finished deploy [cpjobqueue/deploy@5686f16]: Deduplicate based on the root job dt and sha1 combination (duration: 00m 38s) |
[production] |
| 13:20 |
<ppchelko@tin> |
Started deploy [cpjobqueue/deploy@5686f16]: Deduplicate based on the root job dt and sha1 combination |
[production] |
| 13:12 |
<zfilipin@tin> |
Synchronized dblists/commonsuploads.dblist: SWAT: [[gerrit:417189|Disable upload for non-admins on kowikiversity (T189021)]] (duration: 01m 14s) |
[production] |
| 13:06 |
<zfilipin@tin> |
Synchronized wmf-config/throttle.php: SWAT: [[gerrit:417687|Remove obsolete throttle rules, add one new (T189241)]] (duration: 01m 15s) |
[production] |
| 12:53 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Increase traffic for db1074 (duration: 01m 14s) |
[production] |
| 12:39 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Increase traffic for db1074 (duration: 01m 15s) |
[production] |
| 12:22 |
<kartik@tin> |
Finished deploy [cxserver/deploy@c204d9c]: Update cxserver to c355d0c (duration: 03m 12s) |
[production] |
| 12:19 |
<kartik@tin> |
Started deploy [cxserver/deploy@c204d9c]: Update cxserver to c355d0c |
[production] |
| 12:14 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Slowly repool db1074 (duration: 01m 14s) |
[production] |
| 11:45 |
<marostegui> |
Stop db1074 for kernel upgrade |
[production] |
| 11:44 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1074 for data checks and kernel upgrade (duration: 01m 14s) |
[production] |
| 11:36 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Restore original weight for es1018 after kernel and mariadb upgrade (duration: 01m 15s) |
[production] |
| 11:02 |
<moritzm> |
rebooting einsteinium / icinga.wikimedia.org for kernel security update |
[production] |
| 10:54 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Slwoly repool es1018 after kernel and mariadb upgrade (duration: 01m 14s) |
[production] |
| 10:37 |
<marostegui> |
Stop mariadb on es1018 for kernel and mariadb upgrade + change socket location |
[production] |
| 10:35 |
<moritzm> |
rebooting hydrogen for kernel security update |
[production] |
| 10:35 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool es1018 for kernel and mariadb upgrade (duration: 01m 14s) |
[production] |