ILRI Research Computing

User Tools

Site Tools

You are here: start » brainstorms » research_computing_storage_infrastructure_2012
brainstorms:research_computing_storage_infrastructure_2012

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
Last revisionBoth sides next revision
brainstorms:research_computing_storage_infrastructure_2012 [2012/06/13 13:47] – aorthbrainstorms:research_computing_storage_infrastructure_2012 [2012/07/24 06:39] – aorth
Line 28: Line 28:
     * We need to talk to Ian Moore to see what he thinks     * We need to talk to Ian Moore to see what he thinks
     * It's possible we now use ICT's NetApp to provide 1-2TB for GIS server, then building some custom solution for the DMZ     * It's possible we now use ICT's NetApp to provide 1-2TB for GIS server, then building some custom solution for the DMZ
 +  * **June 14, 2012**:
 +    * Brainstorming raw storage costs vs NetApp quote:
 +    * <file>NetApp quote 1TB x 24 = 29000 USD
 +NetApp quote 2TB x 24 = 39000 USD
 +
 +scan.co.uk 1TB Seagate 75 GBP x 24 = 1800 (~2800 USD)
 +amazon.co.uk 1TB Seagate 65 GBP x 24 = 1560 (~2500 USD)
 +
 +scan.co.uk 2TB Seagate 70 GBP x 24 = 1680 (~2600 USD)
 +amazon.co.uk 2TB Seagate 83 GBP x 24 = 1992 (~3100 USD)
 +
 +scan.co.uk 3TB Hitachi 130 GBP x 24 = 3120 (~4900 USD)
 +amazon.co.uk 3TB Seagate 120 GBP x 24 = 2928 (~4600 USD)</file>
 +  * **June 18, 2012**:
 +    * Had a meeting with Ian Moore and Isaac Kahugu about storage
 +      * He said he'd support us building our own, but gave us tips to talk to Tor at ICRAF (GIS, MySQL, Drobo), and to consider Dell Equalogic for storage
 +      * Another point was that we could possibly buy storage from KENET (to sync off site), or maybe colocate a box there
 +  * **July 10, 2012**:
 +    * GK from Techno Associates called again with a new offer for a single-site, single-controller NetApp solution:
 +      * He said he can give us 12TB raw for $9,000, or 24TB for $11,000 (one controller only, excludes pricing for replication licenses)
 +  * **July 22, 2012**:
 +    * Begin compiling report about current situation, options, and recommendations
 +      * https://docs.google.com/document/d/123VL6l5xt1AspzqTaW2tpJ_XFUZGDIXUCsaFK2_EwUY/edit#
 +  * **July 23, 2012**:
 +    * George Ogoti provided us with an iSCSI target on their NetApp so we can test configuration and performance.
  
 ===== Proposed NetApp architecture ===== ===== Proposed NetApp architecture =====
Line 42: Line 67:
   * Build our own storage, ala Backblaze "pods": http://blog.backblaze.com/2011/07/20/petabytes-on-a-budget-v2-0revealing-more-secrets/   * Build our own storage, ala Backblaze "pods": http://blog.backblaze.com/2011/07/20/petabytes-on-a-budget-v2-0revealing-more-secrets/
   * Using FreeBSD + ZFS?   * Using FreeBSD + ZFS?
 +  * FreeNAS storage based on AMD Fusion APUs: http://the.only.ipnextgen.net/fnas/doku.php
 +
 +===== Links =====
 +  * Growing a ZFS pool (with good background on pools vs filesystems in ZFS): http://www.itsacon.net/?p=158
brainstorms/research_computing_storage_infrastructure_2012.txt · Last modified: 2012/07/24 06:57 by aorth