{"id":475,"date":"2011-07-13T17:29:49","date_gmt":"2011-07-14T00:29:49","guid":{"rendered":"http:\/\/mattfife.net\/wordpress\/?p=475"},"modified":"2012-08-12T19:16:16","modified_gmt":"2012-08-13T02:16:16","slug":"booting-from-a-40tb-raid-drive-in-windows-7","status":"publish","type":"post","link":"https:\/\/mattfife.com\/?p=475","title":{"rendered":"Booting from a 4.0TB raid drive in Windows 7"},"content":{"rendered":"<p>Woot!\u00a0 I just set up my system the last few nights with *three* 2TB drives all connected in RAID 5 setup into a single, 4.0 TB partition &#8211; AND I am using that huge bit bucket as my primary boot drive.\u00a0 Now I have speed from the data striping and redundancy from the RAID. \u00a0 It&#8217;s quite nice so far, but I&#8217;m still getting all my old software installed. \u00a0 However, up until about a month ago &#8211; this wasn&#8217;t possible with the standard Intel storage controller that comes with almost all the new 2nd generation core systems (or with most RAID controllers).\u00a0 But getting this magical land to work involves a lot of new information and a good bit of bleeding-edge fighting.<\/p>\n<p><strong>What you need to know: <\/strong><br \/>\nFirst off, getting a RAID-ed boot partition larger than 2.2TB involves several pieces that need to work together.\u00a0 If you only have the first 2, then you can still boot from a single-drive larger than 2.2TB, but you won&#8217;t be able to use it in a RAID setup with large partitions.<\/p>\n<ol>\n<li>A motherboard with EFI support<\/li>\n<li>An OS that can boot in EFI mode and supports GPT partitions<\/li>\n<li>A raid controller that can support creating and using boot partitions larger than 2.2TB.<\/li>\n<\/ol>\n<p>First off, you need a motherboard with an <a href=\"http:\/\/en.wikipedia.org\/wiki\/Extensible_Firmware_Interface\" target=\"_blank\">EFI (Extensible Firmware Interface)<\/a> bios.\u00a0 EFI bios is the successor to the 20+ year old CMOS bios.\u00a0 You might remember or have seen CMOS when that awful text screen came up when you hit the power and it would count memory or say &#8216;Press [del] to enter setup&#8217;.\u00a0 Well, Intel with a lot of other companies finally, happily, heavenly, triumphantly are putting the nails in what had become a painful bit of computing legacy by throwing out CMOS and inventing EFI.\u00a0 Apple has had EFI bios in their machines for a few years now, and some of the first-generation Core i3\/i5\/i7 motherboards had EFI support too &#8211; but it was spotty and very few things seemed to take advantage of it.\u00a0 Which brings us to #2 &#8211; needing an OS that supports EFI booting and GPT.<\/p>\n<p>If you have a motherboard that supports booting in EFI mode, you still need an OS that supports it and knows how to boot from partitions created with <a href=\"http:\/\/en.wikipedia.org\/wiki\/GUID_Partition_Table\" target=\"_blank\">GPT (GUID Partitioning Table)<\/a>. I had an EFI board on my old system, but you couldn&#8217;t actually boot in EFI mode unless you used an early Linux distribution with EFI support or until about Windows Vista SP1\/Win7 range.\u00a0 Not only that, but EFI booting only worked on 64-bit versions of the Vista\/Win7.\u00a0 If you&#8217;d bought the 32-bit version &#8211; then you were out of luck.\u00a0 The Vista route was also painful because unless you had an install disk that had the EFI boot files on it, you couldn&#8217;t actually install Vista in EFI mode.\u00a0 Early versions of the Vista install CD&#8217;s (at least the one I had) didn&#8217;t have the EFI boot files.\u00a0 I never learned if someone who had one of those early disks could return it and get an install disk with EFI boot support.\u00a0 The reason you needed this is because if you couldn&#8217;t boot in EFI mode, you were stuck with the 2.2TB CMOS MBR boot limit.\u00a0 If you weren&#8217;t in EFI mode during the install process, Vista\/Win7 will refuse to create a boot partition larger than 2.2TB because it knew a MBR system couldn&#8217;t boot from it.\u00a0 Unfortunately, you couldn&#8217;t override this in the install.\u00a0 GPT booting was usually only supported when the BIOS booted in EFI mode.\u00a0 So if your OS install disk couldn&#8217;t boot to EFI, or wasn&#8217;t able to make GPT boot partitions in CMOS mode, you were still out of luck.\u00a0 As you&#8217;ll see, booting in EFI mode is actually more than just having a disk with the EFI files on it.\u00a0 It&#8217;s a two-step approach, but those details will come later.<\/p>\n<p>Finally, Windows 7 64-bit comes along and seems to solve our problems. \u00a0 The OS install disk has EFI boot support on it.\u00a0 The install disk is able to make bootable GPT partitions larger than 2.2tb.\u00a0 Awesome.\u00a0 But until this last month, you weren&#8217;t able to get your Intel RAID controller to make a bootable RAID set larger than 2.2tb because Intel hadn&#8217;t finished writing the EFI bios support for it.\u00a0 You have to check the motherboard manufacturer&#8217;s website for a BIOS update &#8211; but you should now see new BIOS&#8217;s with the new large-partition RAID booting support.\u00a0 That was the final key to the puzzle.<\/p>\n<p>So, without further adieu, here is how one does this with the following equipment:<\/p>\n<ul>\n<li>Asus P8P67 rev 3.1 motherboard (socket 1155 with 8 SATA ports and embedded Intel matrix storage controller) with BIOS flashed to version 1704 or higher<\/li>\n<li>Three 2.0TB Hitachi drives all plugged into the Intel SATA ports<\/li>\n<li>Windows 7 64-bit install DVD<\/li>\n<\/ul>\n<ol>\n<li><strong>Back up everything<\/strong><br \/>\nThe way I did it IS a destructive process and your drives will get erased.\u00a0 There is no way that I know that you can migrate from a CMOS partitioning system to GPT.\u00a0 There might be, but fiddling with this sort of stuff in a RAID setup is voodoo and you&#8217;ve been warned.<\/li>\n<li><strong>Get and install the BIOS patch<\/strong><br \/>\nBe sure you are backed up at this point.\u00a0 Asus bios flashing seems to always forget my RAID setup when I flash the bios.\u00a0 In other words, poof &#8211; they&#8217;re gone.<br \/>\nI went to Asus and found the newest BIOS patch. In my case it had the very clearly named:<br \/>\n<em><span id=\"DownloadContent1_Repeater1_Repeater2_1_DownloadUnit_1_lbl_desc_content_1\">P8P67 (REV 3.1) 1704 BIOS &#8211; <\/span><\/em><span id=\"DownloadContent1_Repeater1_Repeater2_1_DownloadUnit_1_lbl_desc_content_1\"><em>2.2TB or larger HDD can be supported under RAID mode.<\/em><br \/>\nI downloaded the patch file and put it on a USB key.\u00a0 I then rebooted the machine and entered the BIOS setup.\u00a0 Asus has a really nice built-in BIOS flashing utility with their new EFI BIOS.\u00a0 I was able to point it at the USB key, find the image, flash the BIOS, and reboot. If the flashing forgot your RAID drives, then you&#8217;ll likely be greeted by a &#8216;no boot device found&#8217; error.\u00a0 You cannot safely re-create them if this happened.\u00a0 The data on them is gone. <\/span><\/li>\n<li><span id=\"DownloadContent1_Repeater1_Repeater2_1_DownloadUnit_1_lbl_desc_content_1\"><strong>Reboot your machine, and create your raid set<\/strong><br \/>\nWith your BIOS patched, you should now be able to enter the Intel storage manager portion of the boot-up cycle via CTRL-I and create a large RAID set as bootable.\u00a0 In my case, I selected: create a new set, selected the 3 drives I had plugged in, set the RAID configuration to RAID 5, 64k blocks, and made it bootable.\u00a0 Save the changes and reboot.<br \/>\nI find it extremely helpful and safer to shut off the machine, and physically unplug any extra drives you don&#8217;t want to get accidentally erased when manipulating RAID setups.\u00a0 When you create the RAID set, you simply select the drives by serial number.\u00a0 If you accidentally include a drive that (let say was your backup drive), the moment you add it to the RAID set &#8211; the data is gone. Be careful.<br \/>\n<\/span><\/li>\n<li><strong>Insert your EFI bootable Linux\/Win7\/Vista DVD, or USB key<\/strong><br \/>\nThis is where you&#8217;ll need to consult your individual motherboard&#8217;s docs &#8211; and where things can get a little hairy.\u00a0 For EFI booting on my ASUS board, I have to insert the EFI bootable media (in my case it was the Windows 7 x64 install disk), then reboot\/turn the machine on.\u00a0 Then I had to:<\/p>\n<ol>\n<li>press [DEL] to enter the CMOS setup during boot (with my Windows 7 disk in the drive)<\/li>\n<li>Go to the &#8216;boot&#8217; menu in the CMOS<\/li>\n<li>Scroll down to list all the bootable devices (CD-Rom\/Volume0 RAID set\/etc)<\/li>\n<li>I saw the CD-Rom drive I wanted listed at the top, but that&#8217;s NOT the one you want.<\/li>\n<li>Keep scrolling down, and at the bottom you&#8217;ll see the device listed AGAIN but with the word EFI printed at the start of it.\u00a0 THAT&#8217;S the one to choose.\u00a0 It tells the system to boot from that device in EFI mode.\u00a0 If you do NOT see your device listed a second time with the letters EFI in front of it, then that means the BIOS has not been able to find the key EFI boot files on the media you&#8217;re using.\u00a0 In my case, my old Vista x64 disk wouldn&#8217;t allow me the option.\u00a0 Why Asus doesn&#8217;t let you just manually set the mode to EFI only booting &#8211; I&#8217;ll never know.\u00a0 I think it&#8217;s stupid they don&#8217;t let you, my old Intel DP35DP board let you do that&#8230;<\/li>\n<li>Select the device with the EFI bootable disk in it and tell the bios to boot.\u00a0 You&#8217;ll notice that the fonts are different on startup, and that the cursor will do a funny indented thing during the boot cycle.\u00a0 This tells you it&#8217;s in EFI booting mode.<\/li>\n<\/ol>\n<\/li>\n<li><strong>Boot the Windows install disk and create your partitions<\/strong><br \/>\nYou should see the windows installer start just as normal.\u00a0 When you get to the partitioning menu, you can select the auto-create option, and that should work.\u00a0 However, this step is the MOST finicky and the place where you&#8217;ll find if you really are in EFI mode or not.\u00a0 I chose the manual creation of the partitions and told it to make me the biggest one.\u00a0 Sure enough, it said 3.7TB.\u00a0 By default, you will get 2 other 100MB partitions created by windows for recovery purposes.\u00a0 You can live without them, and they do not show up as drive letters in your system after it&#8217;s up.\u00a0 Instructions on how to create your system without those extra partitions are here. The important thing is that you make SURE the partition is the right size at this point.\u00a0 If it won&#8217;t create a 2.2+TB partition, or if it says it did, but the size is 2.2TB, then you&#8217;re not really in EFI mode or the Vista disk you have isn&#8217;t EFI bootable.\u00a0 After you see that beautiful, full-sized partition &#8211; you might get a   warning about the partition being potentially unbootable due to it&#8217;s   size -but you can safely ignore it.\u00a0 Just make sure that it actually   created the partition.<\/li>\n<li><strong>Finish the OS install as normal<\/strong><br \/>\nFrom here on out, follow the Windows install as normal.\u00a0 On reboot, the motherboard  will detect the GPT partition and properly boot in EFI mode automatically from here on out.\u00a0 You&#8217;ll  never need to do the selective EFI bios boot again.<\/li>\n<li><strong>Install the Intel matrix storage manager software <\/strong><br \/>\nThis really excellent software should be on your system.\u00a0 If you have a UPS device on your system, I highly recommend turning the buffering on.\u00a0 It allows for the drive read\/writes to also be buffered in system memory.\u00a0 It is dangerous without a UPS because a power loss means anything in the system buffer is lost, but delivers a noticeable speed improvement if you do have a UPS. Also, make sure to &#8216;Initialize&#8217; the drives.\u00a0 When you&#8217;re just fresh installed with windows, this is instantaneous.\u00a0 Finally, this software is great because it&#8217;ll report any SMART errors your drives start throwing.\u00a0 If a drive starts dying, it&#8217;ll warn you (hopefully) long before it finally goes bad.\u00a0 I&#8217;ve seen this software work exactly as advertized when one of my own drives started failing in a previous setup.\u00a0 It also gives you information about which drive is failing so you know which one to pull out and shows you status of any rebuilds when you swap in a new one &#8211; which can happen WHILE you&#8217;re actively using the system.\u00a0 How cool is that?<\/li>\n<li><strong>Done!<\/strong>\u00a0 When you get into windows, you should have one large C: drive with all your space and no extra &#8216;boot&#8217; drives!<\/li>\n<\/ol>\n<p>I know many Linux afficianatos cringe at big bit buckets like this.\u00a0\u00a0 Put your swap on another partition!\u00a0 Make a partition for your programs files!\u00a0 Make a tiny one for your boot partition!\u00a0 This is all well and good if you like micro-managing.\u00a0 I hate micro-managing.\u00a0 I hate extra drive letters.\u00a0 We&#8217;re in the f-ing 2000&#8217;s now people!\u00a0 3TB drives are $150, and 2TB drives are $65.\u00a0 RAID comes built into boards for free.\u00a0 Storage is a commodity.<br \/>\nI use Windows for most of my daily game playing\/tv watching\/etc and don&#8217;t want to futz with the headaches of multiple partitions.\u00a0 I want to play games, watch tv, and surf the web.\u00a0 I don&#8217;t want to have to worry about how big to make a partition for my programs files or data files or worry about how big my boot partition is on windows.\u00a0 What if I over or under-guess?\u00a0 I get to either re-install or test my luck with a partition resizer or have some programs one place, and others somewhere else.\u00a0 Or the fun of every. single. time. I install a program, I have to select a custom install and pick a different drive letter.\u00a0 Windows patches often automatically install in the system32 directory &#8211; what if a new service pack is too big to fit on my tiny boot partition?\u00a0 It makes no difference for security if my boot is on a different partition than my data or programs.\u00a0 Creating a separate partition on the same drive just for the swap file is no gain.\u00a0 Unless it&#8217;s on another physical drive, you&#8217;re not gaining any speed in Windows.\u00a0 And even then, I have 16GB of memory in my machine (and you can too &#8211; it&#8217;s ridiculously cheap at $60\/8GB of high-quality DDR3 ram), I never swap anymore.<\/p>\n<p>In short, I never have to worry about my space or what I&#8217;m putting where.\u00a0 We&#8217;re not in the 70&#8217;s anymore where drives were real investments.\u00a0 They&#8217;re cheap, replaceable commodities now.\u00a0 I have a RAID 5 which means I&#8217;m getting the best of both speed and redundancy all in one place, and it&#8217;s details are taken care of by the hardware.\u00a0 What more could one ask for.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Woot!\u00a0 I just set up my system the last few nights with *three* 2TB drives all connected in RAID 5 setup into a single, 4.0 TB partition &#8211; AND I am using that huge bit bucket as my primary boot drive.\u00a0 Now I have speed from the data striping and redundancy from the RAID. \u00a0 It&#8217;s quite nice so far, but I&#8217;m still getting all my old software installed. \u00a0 However, up until about a month ago &#8211; this wasn&#8217;t&#8230;<\/p>\n<p class=\"read-more\"><a class=\"btn btn-default\" href=\"https:\/\/mattfife.com\/?p=475\"> Read More<span class=\"screen-reader-text\">  Read More<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[5],"tags":[],"class_list":["post-475","post","type-post","status-publish","format-standard","hentry","category-technical"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p4WECr-7F","jetpack-related-posts":[],"_links":{"self":[{"href":"https:\/\/mattfife.com\/index.php?rest_route=\/wp\/v2\/posts\/475","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mattfife.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mattfife.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mattfife.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/mattfife.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=475"}],"version-history":[{"count":1,"href":"https:\/\/mattfife.com\/index.php?rest_route=\/wp\/v2\/posts\/475\/revisions"}],"predecessor-version":[{"id":564,"href":"https:\/\/mattfife.com\/index.php?rest_route=\/wp\/v2\/posts\/475\/revisions\/564"}],"wp:attachment":[{"href":"https:\/\/mattfife.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=475"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mattfife.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=475"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mattfife.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=475"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}