Skip to content
Snippets Groups Projects
New look: Off

decomission unifolium/kvm2, 6 VMs to migrate

    • Closed (moved) Issue created by anarcat @anarcat

    Requires a new gnt node (#33081 (moved)).

    ✓ 6 of 6 checklist items completed
    To upload designs, you'll need to enable LFS and have an admin enable hashed storage. More information

    Child items ...

    • Activity

    • Trac
      Trac @tracbot ·

      Trac:
      Child Ticket(s): #33441 (moved), #33442 (moved), #33446 (moved), #33447 (moved), #33448 (moved)

    • anarcat added component::internal services/tor sysadmin team owner::anarcat points::20 priority::high resolution::fixed severity::normal status::closed tpa-roadmap-march type::task labels

      added component::internal services/tor sysadmin team owner::anarcat points::20 priority::high resolution::fixed severity::normal status::closed tpa-roadmap-march type::task labels

    • anarcat
      anarcat @anarcat ·
      Author Owner

      Trac:
      Sponsor: N/A to N/A
      Points: N/A to 5
      Actualpoints: N/A to N/A
      Parent: N/A to N/A
      Reviewer: N/A to N/A

    • anarcat
      anarcat @anarcat ·
      Author Owner

      Trac:
      Priority: Medium to High

    • anarcat
      anarcat @anarcat ·
      Author Owner

      new node (fsn-node-04) online, ready to start migration. also, bracteata not required because migrated already.

      Trac:
      Status: new to assigned
      Description: * [ ] cupani.torproject.org (git-rw)

      • polyanthum.torproject.org (bridges)
      • omeiense.torproject.org (onionoo.torproject.org)
      • savii.torproject.org (static content backend)
      • build-x86-07.torproject.org (buildbox)
      • bracteata.torproject.org (sandstorm) #32390 (moved)

      Requires a new gnt node (#33081 (moved)).

      to

      • cupani.torproject.org (git-rw)
      • polyanthum.torproject.org (bridges)
      • omeiense.torproject.org (onionoo.torproject.org)
      • savii.torproject.org (static content backend)
      • build-x86-07.torproject.org (buildbox)
      • bracteata.torproject.org (sandstorm) decom'd in #32390 (moved)

      Requires a new gnt node (#33081 (moved)).

    • anarcat
      anarcat @anarcat ·
      Author Owner

      Trac:
      Description: * [ ] cupani.torproject.org (git-rw)

      • polyanthum.torproject.org (bridges)
      • omeiense.torproject.org (onionoo.torproject.org)
      • savii.torproject.org (static content backend)
      • build-x86-07.torproject.org (buildbox)
      • bracteata.torproject.org (sandstorm) decom'd in #32390 (moved)

      Requires a new gnt node (#33081 (moved)).

      to

      • cupani.torproject.org (git-rw)
      • polyanthum.torproject.org (bridges)
      • omeiense.torproject.org (onionoo.torproject.org) (possibly to decom? see #32268 (moved))
      • savii.torproject.org (static content backend) (TO DECOMISSION, check fastly firt)
      • build-x86-07.torproject.org (buildbox) (TO DECOMISSION, maybe create a new node in gnt-fsn later?)
      • bracteata.torproject.org (sandstorm) decom'd in #32390 (moved)

      Requires a new gnt node (#33081 (moved)).

    • anarcat
      anarcat @anarcat ·
      Author Owner

      Trac:
      Description: * [ ] cupani.torproject.org (git-rw)

      • polyanthum.torproject.org (bridges)
      • omeiense.torproject.org (onionoo.torproject.org) (possibly to decom? see #32268 (moved))
      • savii.torproject.org (static content backend) (TO DECOMISSION, check fastly firt)
      • build-x86-07.torproject.org (buildbox) (TO DECOMISSION, maybe create a new node in gnt-fsn later?)
      • bracteata.torproject.org (sandstorm) decom'd in #32390 (moved)

      Requires a new gnt node (#33081 (moved)).

      to

      • cupani.torproject.org (git-rw)
      • polyanthum.torproject.org (bridges)
      • omeiense.torproject.org (onionoo.torproject.org) (possibly to decom? see #32268 (moved))
      • savii.torproject.org (static content backend) (TO DECOMISSION, #33441 (moved))
      • build-x86-07.torproject.org (buildbox) (TO DECOMISSION, #33442 (moved))
      • bracteata.torproject.org (sandstorm) decom'd in #32390 (moved)

      Requires a new gnt node (#33081 (moved)).

    • anarcat
      anarcat @anarcat ·
      Author Owner

      savii decom'd, linked more tickets in summary

      Trac:
      Description: * [ ] cupani.torproject.org (git-rw)

      • polyanthum.torproject.org (bridges)
      • omeiense.torproject.org (onionoo.torproject.org) (possibly to decom? see #32268 (moved))
      • savii.torproject.org (static content backend) (TO DECOMISSION, #33441 (moved))
      • build-x86-07.torproject.org (buildbox) (TO DECOMISSION, #33442 (moved))
      • bracteata.torproject.org (sandstorm) decom'd in #32390 (moved)

      Requires a new gnt node (#33081 (moved)).

      to

      Requires a new gnt node (#33081 (moved)).

    • anarcat
      anarcat @anarcat ·
      Author Owner

      build-x86-07 done!

      Trac:
      Description: * [ ] cupani.torproject.org (git-rw) #33446 (moved)

      Requires a new gnt node (#33081 (moved)).

      to

      Requires a new gnt node (#33081 (moved)).

    • anarcat
      anarcat @anarcat ·
      Author Owner

      Trac:
      Keywords: tpa-roadmap-february deleted, tpa-roadmap-march added

    • anarcat
      anarcat @anarcat ·
      Author Owner

      this is taking much more time than i expected, partly because i'm automating much of this work with fabric.

      but now, cupani has been migrated, and i'll head towards the other two next.

      Trac:
      Description: * [ ] cupani.torproject.org (git-rw) #33446 (moved)

      Requires a new gnt node (#33081 (moved)).

      to

      Requires a new gnt node (#33081 (moved)).

      Points: 5 to 20

    • anarcat
      anarcat @anarcat ·
      Author Owner

      all vms moved, now i just need to retire unifolium!

      Trac:
      Description: * [x] cupani.torproject.org (git-rw) migrated in #33446 (moved)

      Requires a new gnt node (#33081 (moved)).

      to

      Requires a new gnt node (#33081 (moved)).

    • anarcat
      anarcat @anarcat ·
      Author Owner

      starting the decom process now.

      Trac:
      Status: assigned to accepted

    • anarcat
      anarcat @anarcat ·
      Author Owner
      1. warned already: DONE
      2. removed from nagios: DONE
      3. N/A
      4. N/A
      5. scrubbing: DONE
      6. LDAP: DONE

      337 host=unifolium,ou=hosts,dc=torproject,dc=org objectClass: top objectClass: debianServer host: unifolium hostname: unifolium.torproject.org architecture: amd64 admin: torproject-admin@torproject.org sshRSAHostKey: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eQYY314co1YKne5dUi7t5dfbbP40Oad7swbhnWO83aPbEdLYzyH3UtWdUq3bMvhfwzOOU2gdmufOFDZ9GJU7ZqZESPc1AwjSOYFAfzw9EUqOmLw5ayNvqRCQFtMbRjhz/DTDai43bJkZvDdFFHuCXbOdSO0WnElKx8uy2iyFHh+GbvFhDY9Q5CAzFfkBkZ1Ei89ytI0F4B9v9ZDzQmpqkaYJlQx1dm3TBLHFoRdZB6HIvD8xYHq9xVPqt9L+TKijJud1GIj+e3MaeClVfzRCx5ESekNKj2Kg9x4CMCODNoheMy8OLntQVFPSqKKQhtCKFP+/WZchNy50EhhWutvL root@unifolium sshRSAHostKey: ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEl8F6smRLPt06epUYSJSgYE/i36v7PJvnz6ZSDCNxku root@unifolium description: KVM host access: restricted distribution: Debian ipHostNumber: 148.251.180.115 ipHostNumber: 2a01:4f8:211:6e8::2 l: Falkenstein, Saxony, Germany purpose: KVM host purpose: [[kvm2.torproject.org]]

      7. DNS: did as part of the magic grep
8. Puppet: DONE along with backups:

      $ ./retire -v -H unifolium.torproject.org retire-all not wiping instance unifolium.torproject.org data: no parent host scheduling unifolium.torproject.org backup disks removal on host bungei.torproject.org checking for path "/srv/backups/bacula/unifolium.torproject.org/" on bungei.torproject.org scheduling rm -rf "/srv/backups/bacula/unifolium.torproject.org/" to run on bungei.torproject.org in 30 days warning: commands will be executed using /bin/sh job 23 at Sun Apr 12 14:58:00 2020 Notice: Revoked certificate with serial 71 Notice: Removing file Puppet::SSL::Certificate unifolium.torproject.org at '/var/lib/puppet/ssl/ca/signed/unifolium.torproject.org.pem' unifolium.torproject.org Submitted 'deactivate node' for unifolium.torproject.org with UUID 5b467408-c6c4-4623-adf8-d4381d29db9b

      9. tor-puppet: DONE
10. tor-passwords: DONE
11. let's encrypt: DONE (N/A)
12. dnswl: DONE (N/A)
13. backups purge scheduled in step 8: DONE
14. docs: DONE
15. upstream: DONE in now +7d ("Please note that this server will be cancelled on 20/03/2020 and all data will be deleted.")

the magic grep in this case was:

      grep -nH -r -e 148.251.180.115 -e 2a01:4f8:211:6e8::2 -e kvm2.torproject.org -e unifolium.torproject.org -e unifolium -e kvm2

      
an interesting tidbit: the `kvm2.torproject.org` string was in the server's "purpose" field in LDAP, so it might make sense to search for that. it also makes sense to search for the short names (`unifolium` and `kvm2`) as those yielded postives as well.
    • anarcat
      anarcat @anarcat ·
      Author Owner

      all done here, disks are wiped and the server will be deracked on friday.

    • anarcat
      anarcat @anarcat ·
      Author Owner

      Trac:
      Resolution: N/A to fixed
      Status: accepted to closed

    • Trac closed

      closed

    • Trac changed time estimate to 160h

      changed time estimate to 160h

    • Cecylia Bocovich mentioned in issue #33448 (moved)

      mentioned in issue #33448 (moved)

    • Trac mentioned in issue #33447 (moved)

      mentioned in issue #33447 (moved)

    • Loading
    • Loading
    • Loading
    • Loading
    • Loading
    • Loading
    • Loading
    • Loading
    • Loading
    • Loading
    Please register or sign in to reply