| 
      
        2018-12-04
      
      §
     | 
  
    
  | 10:57 | 
  <fdans> | 
  deploying AQS to expose offset and underestimate numbers on unique devices | 
  [production] | 
            
  | 10:51 | 
  <moritzm> | 
  rebooting analytics-tool1003 to pick up SSBD-enabled qemu | 
  [production] | 
            
  | 10:47 | 
  <moritzm> | 
  rebooting analytics-tool1002 to pick up SSBD-enabled qemu | 
  [production] | 
            
  | 10:43 | 
  <mobrovac@deploy1001> | 
  Started deploy [restbase/deploy@8abcbda]: Disable Citoid test for switching it to Zotero v2 - T211088 T197242 | 
  [production] | 
            
  | 10:41 | 
  <moritzm> | 
  rebooting analytics-tool1001 to pick up SSBD-enabled qemu | 
  [production] | 
            
  | 10:03 | 
  <mobrovac@deploy1001> | 
  Finished deploy [citoid/deploy@b902865]: Switch Citoid to Zotero v2 in codfw - T197242 (duration: 01m 45s) | 
  [production] | 
            
  | 10:02 | 
  <godog> | 
  bootstrap cassandra-a on restbase2015 - T210843 | 
  [production] | 
            
  | 10:01 | 
  <mobrovac@deploy1001> | 
  Started deploy [citoid/deploy@b902865]: Switch Citoid to Zotero v2 in codfw - T197242 | 
  [production] | 
            
  | 09:59 | 
  <gehel> | 
  upgrading nginx on elasticsearch eqiad | 
  [production] | 
            
  | 09:54 | 
  <akosiaris> | 
  enable puppet on all scb2*, run puppet T197242 | 
  [production] | 
            
  | 09:52 | 
  <gehel> | 
  upgrading nginx on elasticsearch codfw | 
  [production] | 
            
  | 09:52 | 
  <mobrovac@deploy1001> | 
  Finished deploy [citoid/deploy@b902865]: Switch Citoid to Zotero v2 on scb2001 - T197242 (duration: 00m 30s) | 
  [production] | 
            
  | 09:51 | 
  <mobrovac@deploy1001> | 
  Started deploy [citoid/deploy@b902865]: Switch Citoid to Zotero v2 on scb2001 - T197242 | 
  [production] | 
            
  | 09:50 | 
  <akosiaris> | 
  enable puppet on scb2001, run puppet T197242 | 
  [production] | 
            
  | 09:46 | 
  <akosiaris> | 
  disable puppet on scb for citoid migration to zoterov2 T197242 | 
  [production] | 
            
  | 09:46 | 
  <gehel@puppetmaster1001> | 
  conftool action : set/pooled=yes; selector: dc=codfw,cluster=elasticsearch | 
  [production] | 
            
  | 09:31 | 
  <gehel> | 
  add elastic2039-2044 to cirrus eqiad (new server) - T210265 | 
  [production] | 
            
  | 09:11 | 
  <gehel> | 
  add elastic2038 to cirrus eqiad (new server) - T210265 | 
  [production] | 
            
  | 09:00 | 
  <addshore> | 
  graphite1004 & graphite2003, /var/lib/carbon/whisper/MediaWiki/electronpdf/action # Ran https://phabricator.wikimedia.org/P7882 for T157012 | 
  [production] | 
            
  | 08:54 | 
  <marostegui> | 
  Deploy schema change on db1097:3314 T86338 T202167 | 
  [production] | 
            
  | 08:54 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1097:3314 T86338 T202167 (duration: 00m 47s) | 
  [production] | 
            
  | 08:46 | 
  <addshore> | 
  graphite1004 & graphite2003, /var/lib/carbon/whisper/daily/wikidata/api/actions$ sudo -u _graphite find . -type f -name "*-*.wsp" -delete # T120639 | 
  [production] | 
            
  | 08:46 | 
  <addshore> | 
  graphite1004 & graphite2003, /var/lib/carbon/whisper/daily/wikidata/api/actions$ sudo -u _graphite find . -type f -name "*_*.wsp" -delete # T120639 | 
  [production] | 
            
  | 08:43 | 
  <marostegui> | 
  Deploy schema change on db1102:3314 T86338 T202167 | 
  [production] | 
            
  | 08:42 | 
  <marostegui> | 
  Deploy schema change on dbstore1002:s4 T86338 T202167 | 
  [production] | 
            
  | 08:41 | 
  <addshore> | 
  graphite1004 & graphite2003, /var/lib/carbon/whisper/daily/wikidata/datamodel$ sudo -u _graphite rm wikipedia_references.wsp # T121521 | 
  [production] | 
            
  | 08:35 | 
  <gehel> | 
  restarting stuck tilerator on maps* - T204047 | 
  [production] | 
            
  | 08:35 | 
  <addshore> | 
  graphite1004 & graphite2003, /var/lib/carbon/whisper/daily/wikidata/api/wbgetclaims$ sudo -u _graphite find . -type f -name "*.wsp" -delete # T140280 | 
  [production] | 
            
  | 08:11 | 
  <moritzm> | 
  installing perl security updates on jessie/trusty (stretch already updated) | 
  [production] | 
            
  | 07:49 | 
  <godog> | 
  bootstrap cassandra-c on restbase2014 - T209615 | 
  [production] | 
            
  | 07:26 | 
  <marostegui> | 
  Deploy schema change on s4 codfw master (db2051) with replication T86338 T202167 | 
  [production] | 
            
  | 07:22 | 
  <marostegui> | 
  Deploy schema change on wikitech primary master (db1073) for labswiki and labtestwiki T86338 T202167 | 
  [production] | 
            
  | 06:39 | 
  <marostegui> | 
  Deploy schema change on s5 primary master (db1070) T86338 T202167 | 
  [production] | 
            
  | 06:37 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1110 T86338 T202167 (duration: 00m 49s) | 
  [production] | 
            
  | 06:12 | 
  <marostegui> | 
  Deploy schema change on db1110 T86338 T202167 | 
  [production] | 
            
  | 06:12 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1110 T86338 T202167 (duration: 00m 53s) | 
  [production] | 
            
  | 01:22 | 
  <foks> | 
  Removing 2FA per request at https://phabricator.wikimedia.org/T210703 | 
  [production] | 
            
  | 01:22 | 
  <foks> | 
  Reset password for user "Orangemike" | 
  [production] | 
            
  
    | 
      
        2018-12-03
      
      §
     | 
  
    
  | 23:54 | 
  <legoktm@deploy1001> | 
  Synchronized php-1.33.0-wmf.6/tests/: for completeness (duration: 00m 58s) | 
  [production] | 
            
  | 23:53 | 
  <legoktm@deploy1001> | 
  Synchronized php-1.33.0-wmf.6/resources/src/mediawiki.legacy/: Restore gray coloring for autocomments (T165189 part 2) (duration: 00m 47s) | 
  [production] | 
            
  | 23:51 | 
  <legoktm@deploy1001> | 
  Synchronized php-1.33.0-wmf.6/includes/Linker.php: Restore old HTML structure for history section links (T165189 part 1) (duration: 00m 47s) | 
  [production] | 
            
  | 22:56 | 
  <sbassett@deploy1001> | 
  Synchronized php-1.33.0-wmf.6/extensions/AbuseFilter/includes/api/ApiQueryAbuseLog.php: Deploy security fix for T210329 (duration: 00m 47s) | 
  [production] | 
            
  | 21:24 | 
  <mutante> | 
  temp. disabling puppet on logstash1007 and logstash1008 to carefully deploy gerrit:476916 | 
  [production] | 
            
  | 21:17 | 
  <XioNoX> | 
  push firewall change to pfw3-eqiad - T211028 | 
  [production] | 
            
  | 21:10 | 
  <catrope@deploy1001> | 
  Synchronized php-1.33.0-wmf.6/extensions/WikimediaEvents/includes/WikimediaEventsHooks.php: Fix ChangesListFilters validation errors (duration: 00m 49s) | 
  [production] | 
            
  | 21:00 | 
  <urandom> | 
  bootstrapping restbase2014-a -- T210843 | 
  [production] | 
            
  | 20:20 | 
  <ppchelko@deploy1001> | 
  Finished deploy [changeprop/deploy@7470c85]: Start emitting revision-score events with new schema (duration: 01m 13s) | 
  [production] | 
            
  | 20:19 | 
  <ppchelko@deploy1001> | 
  Started deploy [changeprop/deploy@7470c85]: Start emitting revision-score events with new schema | 
  [production] | 
            
  | 20:14 | 
  <onimisionipe@deploy1001> | 
  Finished deploy [wdqs/wdqs@0c94e5f]: New GUI and updater build (duration: 09m 31s) | 
  [production] | 
            
  | 20:05 | 
  <onimisionipe@deploy1001> | 
  Started deploy [wdqs/wdqs@0c94e5f]: New GUI and updater build | 
  [production] |