7051-7100 of 10000 results (78ms)
2019-02-05 §
07:44 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1076 T210713 (duration: 00m 47s) [production]
07:13 <marostegui> Taking mysqldump from dbstore1002.staging - T210478 [production]
07:05 <marostegui> Reboot mysql on db1117:3323 (this will make the dbproxies complain) T214248 [production]
02:24 <XioNoX> remove BGP session to as6412 on cr2-eqiad (gone from IX) [production]
02:21 <XioNoX> delete 2nd as9121 router on cr2-esams [production]
00:47 <XioNoX> add BGP sessions to AS64050 on cr1-eqsin [production]
00:24 <maxsem@deploy1001> Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/operations/mediawiki-config/+/486405/ (duration: 00m 46s) [production]
00:11 <maxsem@deploy1001> Synchronized wmf-config/InitialiseSettings.php: (no justification provided) (duration: 00m 46s) [production]
2019-02-04 §
22:05 <mutante> scandium - systemctl start parsoid-vd (T201366) [production]
20:01 <herron> manually ran puppet on mc1023 [production]
19:50 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: Clean-up: Stop setting wgParsoidWikiPrefix, unused since the Parsoid extension (duration: 00m 45s) [production]
19:45 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: Clean-up: Stop setting wgFlowEventLogging, unread (duration: 00m 45s) [production]
19:39 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Clean-up: Stop setting values for wgEcho*FooterNotice*, unread (duration: 00m 46s) [production]
19:32 <James_F> Manually purged atjwiki*.png logos for T215122. [production]
19:28 <jforrester@deploy1001> Synchronized static/images/project-logos/atjwiki.png: SWAT: Milestone lobo for atjwiki T215122, 1x (duration: 00m 46s) [production]
19:27 <jforrester@deploy1001> Synchronized static/images/project-logos/atjwiki-1.5x.png: SWAT: Milestone lobo for atjwiki T215122, 1.5x (duration: 00m 45s) [production]
19:26 <jforrester@deploy1001> Synchronized static/images/project-logos/atjwiki-2x.png: SWAT: Milestone lobo for atjwiki T215122, 2x (duration: 00m 44s) [production]
19:22 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: T191039 Enable wgAbuseFilterRuntimeProfile on all wikis (duration: 00m 47s) [production]
19:19 <smalyshev@deploy1001> Finished deploy [wdqs/wdqs@8b2f078]: Weekly GUI deploy (duration: 09m 47s) [production]
19:09 <smalyshev@deploy1001> Started deploy [wdqs/wdqs@8b2f078]: Weekly GUI deploy [production]
18:31 <XioNoX> adding Papaul to root@wiki [production]
18:22 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: Clean-up: Drop reading for wgEcho*FooterNotice*, unread (duration: 00m 46s) [production]
18:18 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: Clean-up: Stop setting wgEchoConfig, unused since 2016 (duration: 00m 48s) [production]
18:11 <jforrester@deploy1001> Synchronized dblists/: T213504: Finally, drop the wikidatarepo dblist (duration: 00m 45s) [production]
18:09 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: T213504: Stop telling CommonsSettings about the wikidatarepo dblist (duration: 00m 45s) [production]
18:06 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T213504: Unconfigure the wikidatarepo dblist (duration: 00m 46s) [production]
18:05 <XioNoX> manually rotate log file wtmp on csw2-esams [production]
18:02 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T213504: Configure wikibaserepo dblist just like the wikidatarepo one (duration: 00m 46s) [production]
17:58 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: T213504: Tell CommonSettings about the new wikibaserepo dblist (duration: 00m 47s) [production]
17:56 <jforrester@deploy1001> Synchronized dblists/wikibaserepo.dblist: T213504: Create the new wikibaserepo dblist (duration: 00m 47s) [production]
17:25 <papaul> powering down thumbor2002 for disk replacement [production]
17:10 <XioNoX> revert ospf metrics to normal values on esams-eqiad Level3 link [production]
16:50 <Lucas_WMDE> deployed patch for T212118 [production]
12:41 <Lucas_WMDE> EU SWAT done [production]
12:40 <lucaswerkmeister-wmde@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:477522|Fix Wikidata base URI in client config (T198946)]] (duration: 00m 46s) [production]
12:34 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:487076|Populate wmgWikibaseRepoSpecialSiteLinkGroups for commonswiki (T213975)]] (duration: 00m 51s) [production]
11:04 <moritzm> installing ghostscript security updates [production]
08:48 <jynus> fixing dbstore1002 x1 replication [production]
07:56 <vgutierrez> uploaded certcentral 0.8 to apt.wikimedia.org (stretch) - T209980 T213820 T213301 [production]
2019-02-03 §
20:25 <elukey> powercycle mw1272 - no ssh, no tty available via com2 - DIMM correctable errors + OEM errors registered in getsel [production]
18:56 <elukey> started a tmux session on dbstore1002 to migrate all the tokudb tables of mediawikiwiki to InnoDB - (s3 replication broken) [production]
17:53 <elukey> start all slaves on dbstore1002 (After a crash + recovery) + moved mediawikiwiki.revision_actor_temp to Innodb to unblock s3 slave replication (still broken though) [production]
04:55 <legoktm@deploy1001> Synchronized wmf-config/extension-list: Remove WikibaseQuality from extensions-list (T208499) (duration: 00m 51s) [production]
01:10 <elukey> powercycle mw1299 - can't ssh nor get a tty via console - racadm getsel shows "An OEM diagnostic event occurred." [production]
2019-02-02 §
20:42 <chaomodus> restarted pdfrender on scb1003 [production]
20:41 <chaomodus> restarted pdfrender on scb1004 [production]
20:06 <chaomodus> parsoid was failed on scandium and alerting, the service parsoid-vd was restarted and appears to have come back [production]
05:44 <jforrester@deploy1001> Synchronized php-1.33.0-wmf.14/extensions/VisualEditor/lib/ve/src/ui/dialogs/ve.ui.FindAndReplaceDialog.js: b/src/ui/dialogs/ve.ui.FindAndReplaceDialog.js T214963 Hot-deploy VE fix to stop hitting user pref writes without debounce (duration: 01m 02s) [production]
2019-02-01 §
23:16 <vgutierrez> restart pdfrender on scb1004 [production]
21:57 <ejegg> updated payments-wiki-staging from 7767c7027e to 52a271e681 [production]