1001-1050 of 10000 results (56ms)
2018-03-14 ยง
19:06 <demon@tin> scap failed: LockFailedError Failed to acquire lock "/var/lock/scap.operations_mediawiki-config.lock"; owner is "demon"; reason is "rebuilding l10n" (duration: 00m 00s) [production]
18:20 <jynus> running pt-table-checksum on all m2, some lag will happen on passive replicas [production]
18:16 <jynus> running pt-table-checksum on all m1, some lag will happen on passive replicas [production]
18:07 <chicocvenancio> updated paws-beta k8s cluster and nodes to v1.9.4 for T189680 [toolsbeta]
17:56 <demon@tin> Started scap: rebuilding l10n [production]
17:55 <reedy@tin> Synchronized php-1.31.0-wmf.25/extensions/CentralNotice: updates! (duration: 01m 16s) [production]
17:54 <demon@tin> scap failed: LockFailedError Failed to acquire lock "/var/lock/scap.operations_mediawiki-config.lock"; owner is "reedy"; reason is "updates!" (duration: 00m 00s) [production]
17:54 <reedy@tin> Synchronized php-1.31.0-wmf.24/extensions/CentralNotice: updates! (duration: 01m 18s) [production]
17:26 <maxsem@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/416489 (duration: 01m 14s) [production]
17:18 <maxsem@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/419077 (duration: 01m 15s) [production]
16:58 <hoo> Manually running extensions/Wikibase/repo/maintenance/dispatchChanges.php on terbium, so that dispatching can catch up [production]
16:56 <jynus> deploying new firewall rules to dbproxy1001 and 7 [production]
16:40 <moritzm> installing cron updates from stretch 9.4 point release [production]
16:36 <Hauskatze> maurelio@deployment-tin:~$ sudo chown -R jenkins-deploy:wikidev /srv/mediawiki-staging/php-master [releng]
16:35 <demon@tin> Synchronized .gitignore: ignore scap logs (duration: 01m 15s) [production]
16:22 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Restore db1074 original weight (duration: 01m 13s) [production]
16:12 <godog> temporarily add back puppetmaster2002 as a low-weight backend [production]
15:48 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1074 (duration: 01m 15s) [production]
15:47 <andrew@tin> Synchronized multiversion/MWMultiVersion.php: wikitech cleanup (duration: 01m 14s) [production]
15:44 <addshore> killed https://integration.wikimedia.org/ci/job/mediawiki-core-code-coverage/3382/ and https://integration.wikimedia.org/ci/job/mediawiki-core-code-coverage-php7/143/ to unblock integration slaves [releng]
15:27 <ottomata> bouncing main -> jumbo mirror maker instances [analytics]
15:25 <XioNoX> Re-enabling BGP on cr2-codfw Zayo transit - T189452 [production]
15:12 <XioNoX> Disabling BGP on cr2-codfw Zayo transit - T189452 [production]
15:02 <jynus> disabling puppet in preparation for reimage of dbproxy1002 and 6 [production]
14:59 <moritzm> installing virt-what updates from stretch point release [production]
14:58 <paravoid> rebooting furud [production]
14:45 <ottomata> beginning migration of eventlogging analtyics from Kafka analytics to Kafka jumbo: T183297 [analytics]
14:44 <ottomata> beginning migration of eventlogging analtyics from Kafka analytics to Kafka jumbo: T183297 [production]
14:33 <godog> depool puppetmaster2002 for reimage [production]
14:23 <Reedy> beta-scap-eqiad disabled while freeing up space on deployment-tin [releng]
14:06 <Reedy> created wbc_entity_uages on ruwikimedia T188456 [production]
13:50 <zeljkof> EU SWAT finished [production]
13:49 <zfilipin@tin> Synchronized dblists/wikidataclient.dblist: SWAT: [[gerrit:419425|Revert "Add ruwikimedia to wikidataclient" (T188456)]] (duration: 01m 14s) [production]
13:42 <zfilipin@tin> Synchronized docroot/noc/conf/: SWAT: [[gerrit:419422|Revert "Publish throttle-analyze at noc" (T187894)]] (duration: 01m 15s) [production]
13:21 <ppchelko@tin> Finished deploy [cpjobqueue/deploy@c879056]: Deduplicate based on the root job dt and sha1 combination. Forgot to pull (duration: 00m 33s) [production]
13:21 <ppchelko@tin> Started deploy [cpjobqueue/deploy@c879056]: Deduplicate based on the root job dt and sha1 combination. Forgot to pull [production]
13:21 <zfilipin@tin> Synchronized docroot/noc/conf/throttle-analyze.php.txt: SWAT: [[gerrit:414758|Publish throttle-analyze at noc (T187894)]] (duration: 01m 13s) [production]
13:20 <ppchelko@tin> Finished deploy [cpjobqueue/deploy@5686f16]: Deduplicate based on the root job dt and sha1 combination (duration: 00m 38s) [production]
13:20 <ppchelko@tin> Started deploy [cpjobqueue/deploy@5686f16]: Deduplicate based on the root job dt and sha1 combination [production]
13:12 <zfilipin@tin> Synchronized dblists/commonsuploads.dblist: SWAT: [[gerrit:417189|Disable upload for non-admins on kowikiversity (T189021)]] (duration: 01m 14s) [production]
13:06 <zfilipin@tin> Synchronized wmf-config/throttle.php: SWAT: [[gerrit:417687|Remove obsolete throttle rules, add one new (T189241)]] (duration: 01m 15s) [production]
12:53 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1074 (duration: 01m 14s) [production]
12:39 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1074 (duration: 01m 15s) [production]
12:22 <kartik@tin> Finished deploy [cxserver/deploy@c204d9c]: Update cxserver to c355d0c (duration: 03m 12s) [production]
12:19 <kartik@tin> Started deploy [cxserver/deploy@c204d9c]: Update cxserver to c355d0c [production]
12:16 <kart_> update cxserver to c355d0c [releng]
12:14 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Slowly repool db1074 (duration: 01m 14s) [production]
12:07 <arturo> reboot tools-webgrid-lighttpd-1415, almost full /tmp [tools]
12:01 <arturo> repool tools-webgrid-lighttpd-1421, /tmp is now empty [tools]
11:56 <arturo> depool tools-webgrid-lighttpd-1421 for reboot due to /tmp almost full [tools]