{"id":11893,"date":"2024-08-31T14:17:33","date_gmt":"2024-08-31T21:17:33","guid":{"rendered":"https:\/\/mattfife.com\/?p=11893"},"modified":"2024-08-30T18:44:25","modified_gmt":"2024-08-31T01:44:25","slug":"installing-black-forest-flux-1","status":"publish","type":"post","link":"https:\/\/mattfife.com\/?p=11893","title":{"rendered":"Installing Black Forest Flux.1"},"content":{"rendered":"\n<p>Stable Diffusion really opened the world to what is possible with generative AI. <a href=\"https:\/\/stablediffusion3.net\/blog-the-painful-launch-of-stable-diffusion-3-44474\" data-type=\"link\" data-id=\"https:\/\/stablediffusion3.net\/blog-the-painful-launch-of-stable-diffusion-3-44474\">Stable Diffusion 2 and 3 &#8230;well&#8230;did not go so well<\/a>. For a while now, Stable Diffusion 1.5 was your best bet on locally generated AI art but it is really showing it&#8217;s age.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" width=\"540\" height=\"238\" data-attachment-id=\"11895\" data-permalink=\"https:\/\/mattfife.com\/?attachment_id=11895\" data-orig-file=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/image-8.png?fit=540%2C238&amp;ssl=1\" data-orig-size=\"540,238\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"image\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/image-8.png?fit=540%2C238&amp;ssl=1\" src=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/image-8.png?resize=540%2C238&#038;ssl=1\" alt=\"\" class=\"wp-image-11895\" srcset=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/image-8.png?w=540&amp;ssl=1 540w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/image-8.png?resize=300%2C132&amp;ssl=1 300w\" sizes=\"auto, (max-width: 540px) 100vw, 540px\" \/><\/figure>\n<\/div>\n\n\n<p>Now there is a new player in open source generative AI you can run locally. The developers from Stability.ai have founded <a href=\"https:\/\/blackforestlabs.ai\/\" data-type=\"link\" data-id=\"https:\/\/blackforestlabs.ai\/\">Black Forest Labs<\/a> and released their open source tool: <a href=\"https:\/\/blackforestlabs.ai\/#get-flux\" data-type=\"link\" data-id=\"https:\/\/blackforestlabs.ai\/#get-flux\">Flux.1<\/a> <\/p>\n\n\n\n<p>While there are plenty of online generative AI&#8217;s like Midjourney, Adobe Firefly and others, they usually require paid or only give limited usage. What&#8217;s great about Flux.1 is that is allows completely local installation and usage. <\/p>\n\n\n\n<p>Like many open source packages, there are free and paid versions. Their paid Pro version gives the most impressive results via their api (no purely local generation), a local dev version that can be used by developers but not for commercial use, and a free schnell version for personal use. Both the dev and shnell versions are available for local install and use.<\/p>\n\n\n\n<p>So, lets get started with the shnell version &#8211; but the instructions are the same for dev except using 2 different model\/weight files.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" width=\"640\" height=\"301\" data-attachment-id=\"11894\" data-permalink=\"https:\/\/mattfife.com\/?attachment_id=11894\" data-orig-file=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture.png?fit=2153%2C1012&amp;ssl=1\" data-orig-size=\"2153,1012\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"Capture\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture.png?fit=640%2C301&amp;ssl=1\" src=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture.png?resize=640%2C301&#038;ssl=1\" alt=\"\" class=\"wp-image-11894\" srcset=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture.png?resize=1024%2C481&amp;ssl=1 1024w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture.png?resize=300%2C141&amp;ssl=1 300w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture.png?resize=768%2C361&amp;ssl=1 768w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture.png?resize=1536%2C722&amp;ssl=1 1536w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture.png?resize=2048%2C963&amp;ssl=1 2048w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture.png?resize=574%2C270&amp;ssl=1 574w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture.png?w=1280&amp;ssl=1 1280w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture.png?w=1920&amp;ssl=1 1920w\" sizes=\"auto, (max-width: 640px) 100vw, 640px\" \/><\/figure>\n\n\n\n<p>Instructions for installing Flux.1 on nVidia based Windows 10\/11 system:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Prerequisites:\n<ul class=\"wp-block-list\">\n<li>Ensure you have <a href=\"https:\/\/www.python.org\/downloads\/\" data-type=\"link\" data-id=\"https:\/\/www.python.org\/downloads\/\">python<\/a> installed (I used 3.12.5)<\/li>\n\n\n\n<li>Ensure you have <a href=\"https:\/\/pip.pypa.io\/en\/stable\/installation\/\" data-type=\"link\" data-id=\"https:\/\/pip.pypa.io\/en\/stable\/installation\/\">pip installed<\/a> (I used pip 24.2)<\/li>\n\n\n\n<li>Ensure you have <a href=\"https:\/\/git-scm.com\/downloads\" data-type=\"link\" data-id=\"https:\/\/git-scm.com\/downloads\">git<\/a> installed and working<\/li>\n\n\n\n<li>You might want to enable <a href=\"https:\/\/learn.microsoft.com\/en-us\/windows\/win32\/fileio\/maximum-file-path-limitation?tabs=registry\" data-type=\"link\" data-id=\"https:\/\/learn.microsoft.com\/en-us\/windows\/win32\/fileio\/maximum-file-path-limitation?tabs=registry\">Windows Long Path support<\/a> as python sometimes requires it for dependent packages. Be sure to reboot your system after enabling it.<\/li>\n\n\n\n<li>Supported graphics card.<\/li>\n\n\n\n<li>32gb of system ram (though again, you can use the smaller model if you have less ram)<br><\/li>\n<\/ul>\n<\/li>\n\n\n\n<li>Open a command prompt and make a local working root directory somewhere, I&#8217;ll use c:\\depot\\<br><\/li>\n\n\n\n<li>We&#8217;re going to follow the instructions on the <a href=\"https:\/\/github.com\/comfyanonymous\/ComfyUI?tab=readme-ov-file\" data-type=\"link\" data-id=\"https:\/\/github.com\/comfyanonymous\/ComfyUI?tab=readme-ov-file\">ComfyUI git page<\/a>.\n<ul class=\"wp-block-list\">\n<li>Clone the ComfyUI project<\/li>\n<\/ul>\n<\/li>\n<\/ol>\n\n\n\n<pre class=\"wp-block-code\"><code>C:\\depot&gt; git clone https:\/\/github.com\/comfyanonymous\/ComfyUI.git<\/code><\/pre>\n\n\n\n<figure class=\"wp-block-image size-full\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" width=\"640\" height=\"182\" data-attachment-id=\"11896\" data-permalink=\"https:\/\/mattfife.com\/?attachment_id=11896\" data-orig-file=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture-1.png?fit=966%2C274&amp;ssl=1\" data-orig-size=\"966,274\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"Capture\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture-1.png?fit=640%2C182&amp;ssl=1\" src=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture-1.png?resize=640%2C182&#038;ssl=1\" alt=\"\" class=\"wp-image-11896\" srcset=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture-1.png?w=966&amp;ssl=1 966w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture-1.png?resize=300%2C85&amp;ssl=1 300w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture-1.png?resize=768%2C218&amp;ssl=1 768w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture-1.png?resize=604%2C171&amp;ssl=1 604w\" sizes=\"auto, (max-width: 640px) 100vw, 640px\" \/><\/figure>\n\n\n\n<ol start=\"4\" class=\"wp-block-list\">\n<li>Install pytorch<\/li>\n<\/ol>\n\n\n\n<p>Nvidia users should install stable pytorch using this command:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>C:\\depot&gt;<span style=\"background-color: initial; font-family: inherit; font-size: inherit; color: initial;\"> pip install torch torchvision torchaudio --extra-index-url https:\/\/download.pytorch.org\/whl\/cu121<\/span><\/code><\/pre>\n\n\n\n<figure class=\"wp-block-image size-large\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" width=\"640\" height=\"499\" data-attachment-id=\"11897\" data-permalink=\"https:\/\/mattfife.com\/?attachment_id=11897\" data-orig-file=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture-2.png?fit=1994%2C1556&amp;ssl=1\" data-orig-size=\"1994,1556\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"Capture\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture-2.png?fit=640%2C499&amp;ssl=1\" src=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture-2.png?resize=640%2C499&#038;ssl=1\" alt=\"\" class=\"wp-image-11897\" srcset=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture-2.png?resize=1024%2C799&amp;ssl=1 1024w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture-2.png?resize=300%2C234&amp;ssl=1 300w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture-2.png?resize=768%2C599&amp;ssl=1 768w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture-2.png?resize=1536%2C1199&amp;ssl=1 1536w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture-2.png?resize=346%2C270&amp;ssl=1 346w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture-2.png?w=1994&amp;ssl=1 1994w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture-2.png?w=1280&amp;ssl=1 1280w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture-2.png?w=1920&amp;ssl=1 1920w\" sizes=\"auto, (max-width: 640px) 100vw, 640px\" \/><\/figure>\n\n\n\n<p>This is the command to install pytorch nightly instead which might have performance improvements:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code><code>C:\\depot&gt;pip install --pre torch torchvision torchaudio --index-url https:\/\/download.pytorch.org\/whl\/nightly\/cu124<\/code><\/code><\/pre>\n\n\n\n<ol start=\"5\" class=\"wp-block-list\">\n<li>Change directory into ComfyUI and ensure the requirements.txt file is there:<\/li>\n<\/ol>\n\n\n\n<figure class=\"wp-block-image size-full is-resized\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" width=\"640\" height=\"195\" data-attachment-id=\"11898\" data-permalink=\"https:\/\/mattfife.com\/?attachment_id=11898\" data-orig-file=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture-3.png?fit=754%2C230&amp;ssl=1\" data-orig-size=\"754,230\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"Capture\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture-3.png?fit=640%2C195&amp;ssl=1\" src=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture-3.png?resize=640%2C195&#038;ssl=1\" alt=\"\" class=\"wp-image-11898\" style=\"width:492px;height:auto\" srcset=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture-3.png?w=754&amp;ssl=1 754w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture-3.png?resize=300%2C92&amp;ssl=1 300w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture-3.png?resize=604%2C184&amp;ssl=1 604w\" sizes=\"auto, (max-width: 640px) 100vw, 640px\" \/><\/figure>\n\n\n\n<ol start=\"6\" class=\"wp-block-list\">\n<li>Use pip to install all the ComfyUI requirements:<\/li>\n<\/ol>\n\n\n\n<pre class=\"wp-block-code\"><code>C:\\depot\\ComfyUI&gt;pip install -r requirements.txt\nDefaulting to user installation because normal site-packages is not writeable\nRequirement already satisfied: torch in c:\\users\\matt\\appdata\\local\\packages\\pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\\localcache\\local-packages\\python312\\site-packages (from -r requirements.txt (line 1)) (2.4.0+cu121)\nCollecting torchsde (from -r requirements.txt (line 2))\nDownloading torchsde-0.2.6-py3-none-any.whl.metadata (5.3 kB)\nRequirement already satisfied: torchvision in c:\\users\\matt\\appdata\\local\\packages\\pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\\localcache\\local-packages\\python312\\site-packages (from -r requirements.txt (line 3)) (0.19.0+cu121)\nRequirement already satisfied: torchaudio in c:\\users\\matt\\appdata\\local\\packages\\pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\\localcache\\local-packages\\python312\\site-packages (from -r requirements.txt (line 4)) (2.4.0+cu121)\nCollecting einops (from -r requirements.txt (line 5))\nDownloading einops-0.8.0-py3-none-any.whl.metadata (12 kB)\nCollecting transformers&gt;=4.28.1 (from -r requirements.txt (line 6))\nDownloading transformers-4.44.0-py3-none-any.whl.metadata (43 kB)\nCollecting tokenizers&gt;=0.13.3 (from -r requirements.txt (line 7))\nDownloading tokenizers-0.20.0-cp312-none-win_amd64.whl.metadata (6.9 kB)\nCollecting sentencepiece (from -r requirements.txt (line 8))\nDownloading sentencepiece-0.2.0-cp312-cp312-win_amd64.whl.metadata (8.3 kB)\nCollecting safetensors&gt;=0.4.2 (from -r requirements.txt (line 9))\nDownloading safetensors-0.4.4-cp312-none-win_amd64.whl.metadata (3.9 kB)\nCollecting aiohttp (from -r requirements.txt (line 10))\nDownloading aiohttp-3.10.2-cp312-cp312-win_amd64.whl.metadata (7.8 kB)\nCollecting pyyaml (from -r requirements.txt (line 11))\nDownloading PyYAML-6.0.2-cp312-cp312-win_amd64.whl.metadata (2.1 kB)\nRequirement already satisfied: Pillow in c:\\users\\matt\\appdata\\local\\packages\\pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\\localcache\\local-packages\\python312\\site-packages (from -r requirements.txt (line 12)) (10.4.0)\nCollecting scipy (from -r requirements.txt (line 13))\nDownloading scipy-1.14.0-cp312-cp312-win_amd64.whl.metadata (60 kB)\nCollecting tqdm (from -r requirements.txt (line 14))\nDownloading tqdm-4.66.5-py3-none-any.whl.metadata (57 kB)\nCollecting psutil (from -r requirements.txt (line 15))\nDownloading psutil-6.0.0-cp37-abi3-win_amd64.whl.metadata (22 kB)\nCollecting kornia&gt;=0.7.1 (from -r requirements.txt (line 18))\nDownloading kornia-0.7.3-py2.py3-none-any.whl.metadata (7.7 kB)\nCollecting spandrel (from -r requirements.txt (line 19))\nDownloading spandrel-0.3.4-py3-none-any.whl.metadata (14 kB)\nCollecting soundfile (from -r requirements.txt (line 20))\nDownloading soundfile-0.12.1-py2.py3-none-win_amd64.whl.metadata (14 kB)\nRequirement already satisfied: filelock in c:\\users\\matt\\appdata\\local\\packages\\pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\\localcache\\local-packages\\python312\\site-packages (from torch-&gt;-r requirements.txt (line 1)) (3.15.4)\nRequirement already satisfied: typing-extensions&gt;=4.8.0 in c:\\users\\matt\\appdata\\local\\packages\\pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\\localcache\\local-packages\\python312\\site-packages (from torch-&gt;-r requirements.txt (line 1)) (4.12.2)\nRequirement already satisfied: sympy in c:\\users\\matt\\appdata\\local\\packages\\pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\\localcache\\local-packages\\python312\\site-packages (from torch-&gt;-r requirements.txt (line 1)) (1.13.1)\nRequirement already satisfied: networkx in c:\\users\\matt\\appdata\\local\\packages\\pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\\localcache\\local-packages\\python312\\site-packages (from torch-&gt;-r requirements.txt (line 1)) (3.3)\nRequirement already satisfied: jinja2 in c:\\users\\matt\\appdata\\local\\packages\\pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\\localcache\\local-packages\\python312\\site-packages (from torch-&gt;-r requirements.txt (line 1)) (3.1.4)\nRequirement already satisfied: fsspec in c:\\users\\matt\\appdata\\local\\packages\\pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\\localcache\\local-packages\\python312\\site-packages (from torch-&gt;-r requirements.txt (line 1)) (2024.6.1)\nRequirement already satisfied: setuptools in c:\\users\\matt\\appdata\\local\\packages\\pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\\localcache\\local-packages\\python312\\site-packages (from torch-&gt;-r requirements.txt (line 1)) (72.1.0)\nRequirement already satisfied: numpy&gt;=1.19 in c:\\users\\matt\\appdata\\local\\packages\\pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\\localcache\\local-packages\\python312\\site-packages (from torchsde-&gt;-r requirements.txt (line 2)) (2.0.1)\nCollecting trampoline&gt;=0.1.2 (from torchsde-&gt;-r requirements.txt (line 2))\nDownloading trampoline-0.1.2-py3-none-any.whl.metadata (10 kB)\nCollecting huggingface-hub&lt;1.0,&gt;=0.23.2 (from transformers&gt;=4.28.1-&gt;-r requirements.txt (line 6))\nDownloading huggingface_hub-0.24.5-py3-none-any.whl.metadata (13 kB)\nCollecting packaging&gt;=20.0 (from transformers&gt;=4.28.1-&gt;-r requirements.txt (line 6))\nDownloading packaging-24.1-py3-none-any.whl.metadata (3.2 kB)\nCollecting regex!=2019.12.17 (from transformers&gt;=4.28.1-&gt;-r requirements.txt (line 6))\nDownloading regex-2024.7.24-cp312-cp312-win_amd64.whl.metadata (41 kB)\nCollecting requests (from transformers&gt;=4.28.1-&gt;-r requirements.txt (line 6))\nDownloading requests-2.32.3-py3-none-any.whl.metadata (4.6 kB)\nCollecting tokenizers&gt;=0.13.3 (from -r requirements.txt (line 7))\nDownloading tokenizers-0.19.1-cp312-none-win_amd64.whl.metadata (6.9 kB)\nCollecting aiohappyeyeballs&gt;=2.3.0 (from aiohttp-&gt;-r requirements.txt (line 10))\nDownloading aiohappyeyeballs-2.3.5-py3-none-any.whl.metadata (5.8 kB)\nCollecting aiosignal&gt;=1.1.2 (from aiohttp-&gt;-r requirements.txt (line 10))\nDownloading aiosignal-1.3.1-py3-none-any.whl.metadata (4.0 kB)\nCollecting attrs&gt;=17.3.0 (from aiohttp-&gt;-r requirements.txt (line 10))\nDownloading attrs-24.2.0-py3-none-any.whl.metadata (11 kB)\nCollecting frozenlist&gt;=1.1.1 (from aiohttp-&gt;-r requirements.txt (line 10))\nDownloading frozenlist-1.4.1-cp312-cp312-win_amd64.whl.metadata (12 kB)\nCollecting multidict&lt;7.0,&gt;=4.5 (from aiohttp-&gt;-r requirements.txt (line 10))\nDownloading multidict-6.0.5-cp312-cp312-win_amd64.whl.metadata (4.3 kB)\nCollecting yarl&lt;2.0,&gt;=1.0 (from aiohttp-&gt;-r requirements.txt (line 10))\nDownloading yarl-1.9.4-cp312-cp312-win_amd64.whl.metadata (32 kB)\nCollecting colorama (from tqdm-&gt;-r requirements.txt (line 14))\nDownloading colorama-0.4.6-py2.py3-none-any.whl.metadata (17 kB)\nCollecting kornia-rs&gt;=0.1.0 (from kornia&gt;=0.7.1-&gt;-r requirements.txt (line 18))\nDownloading kornia_rs-0.1.5-cp312-none-win_amd64.whl.metadata (8.9 kB)\nCollecting cffi&gt;=1.0 (from soundfile-&gt;-r requirements.txt (line 20))\nDownloading cffi-1.17.0-cp312-cp312-win_amd64.whl.metadata (1.6 kB)\nCollecting pycparser (from cffi&gt;=1.0-&gt;soundfile-&gt;-r requirements.txt (line 20))\nDownloading pycparser-2.22-py3-none-any.whl.metadata (943 bytes)\nCollecting idna&gt;=2.0 (from yarl&lt;2.0,&gt;=1.0-&gt;aiohttp-&gt;-r requirements.txt (line 10))\nDownloading idna-3.7-py3-none-any.whl.metadata (9.9 kB)\nRequirement already satisfied: MarkupSafe&gt;=2.0 in c:\\users\\matt\\appdata\\local\\packages\\pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\\localcache\\local-packages\\python312\\site-packages (from jinja2-&gt;torch-&gt;-r requirements.txt (line 1)) (2.1.5)\nCollecting charset-normalizer&lt;4,&gt;=2 (from requests-&gt;transformers&gt;=4.28.1-&gt;-r requirements.txt (line 6))\nDownloading charset_normalizer-3.3.2-cp312-cp312-win_amd64.whl.metadata (34 kB)\nCollecting urllib3&lt;3,&gt;=1.21.1 (from requests-&gt;transformers&gt;=4.28.1-&gt;-r requirements.txt (line 6))\nDownloading urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB)\nCollecting certifi&gt;=2017.4.17 (from requests-&gt;transformers&gt;=4.28.1-&gt;-r requirements.txt (line 6))\nDownloading certifi-2024.7.4-py3-none-any.whl.metadata (2.2 kB)\nRequirement already satisfied: mpmath&lt;1.4,&gt;=1.1.0 in c:\\users\\matt\\appdata\\local\\packages\\pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\\localcache\\local-packages\\python312\\site-packages (from sympy-&gt;torch-&gt;-r requirements.txt (line 1)) (1.3.0)\nDownloading torchsde-0.2.6-py3-none-any.whl (61 kB)\nDownloading einops-0.8.0-py3-none-any.whl (43 kB)\nDownloading transformers-4.44.0-py3-none-any.whl (9.5 MB)\n---------------------------------------- 9.5\/9.5 MB ? eta 0:00:00\nDownloading tokenizers-0.19.1-cp312-none-win_amd64.whl (2.2 MB)\n---------------------------------------- 2.2\/2.2 MB 3.9 MB\/s eta 0:00:00\nDownloading sentencepiece-0.2.0-cp312-cp312-win_amd64.whl (991 kB)\n---------------------------------------- 992.0\/992.0 kB 2.3 MB\/s eta 0:00:00\nDownloading safetensors-0.4.4-cp312-none-win_amd64.whl (286 kB)\nDownloading aiohttp-3.10.2-cp312-cp312-win_amd64.whl (376 kB)\nDownloading PyYAML-6.0.2-cp312-cp312-win_amd64.whl (156 kB)\nDownloading scipy-1.14.0-cp312-cp312-win_amd64.whl (44.5 MB)\n---------------------------------------- 44.5\/44.5 MB 2.9 MB\/s eta 0:00:00\nDownloading tqdm-4.66.5-py3-none-any.whl (78 kB)\nDownloading psutil-6.0.0-cp37-abi3-win_amd64.whl (257 kB)\nDownloading kornia-0.7.3-py2.py3-none-any.whl (833 kB)\n---------------------------------------- 833.3\/833.3 kB 1.7 MB\/s eta 0:00:00\nDownloading spandrel-0.3.4-py3-none-any.whl (268 kB)\nDownloading soundfile-0.12.1-py2.py3-none-win_amd64.whl (1.0 MB)\n---------------------------------------- 1.0\/1.0 MB 7.9 MB\/s eta 0:00:00\nDownloading aiohappyeyeballs-2.3.5-py3-none-any.whl (12 kB)\nDownloading aiosignal-1.3.1-py3-none-any.whl (7.6 kB)\nDownloading attrs-24.2.0-py3-none-any.whl (63 kB)\nDownloading cffi-1.17.0-cp312-cp312-win_amd64.whl (181 kB)\nDownloading frozenlist-1.4.1-cp312-cp312-win_amd64.whl (50 kB)\nDownloading huggingface_hub-0.24.5-py3-none-any.whl (417 kB)\nDownloading kornia_rs-0.1.5-cp312-none-win_amd64.whl (1.3 MB)\n---------------------------------------- 1.3\/1.3 MB 6.5 MB\/s eta 0:00:00\nDownloading multidict-6.0.5-cp312-cp312-win_amd64.whl (27 kB)\nDownloading packaging-24.1-py3-none-any.whl (53 kB)\nDownloading regex-2024.7.24-cp312-cp312-win_amd64.whl (269 kB)\nDownloading trampoline-0.1.2-py3-none-any.whl (5.2 kB)\nDownloading yarl-1.9.4-cp312-cp312-win_amd64.whl (76 kB)\nDownloading colorama-0.4.6-py2.py3-none-any.whl (25 kB)\nDownloading requests-2.32.3-py3-none-any.whl (64 kB)\nDownloading certifi-2024.7.4-py3-none-any.whl (162 kB)\nDownloading charset_normalizer-3.3.2-cp312-cp312-win_amd64.whl (100 kB)\nDownloading idna-3.7-py3-none-any.whl (66 kB)\nDownloading urllib3-2.2.2-py3-none-any.whl (121 kB)\nDownloading pycparser-2.22-py3-none-any.whl (117 kB)\nInstalling collected packages: trampoline, sentencepiece, urllib3, scipy, safetensors, regex, pyyaml, pycparser, psutil, packaging, multidict, kornia-rs, idna, frozenlist, einops, colorama, charset-normalizer, certifi, attrs, aiohappyeyeballs, yarl, tqdm, requests, cffi, aiosignal, torchsde, soundfile, kornia, huggingface-hub, aiohttp, tokenizers, spandrel, transformers\nWARNING: The script normalizer.exe is installed in 'C:\\Users\\matt\\AppData\\Local\\Packages\\PythonSoftwareFoundation.Python.3.12_qbz5n2kfra8p0\\LocalCache\\local-packages\\Python312\\Scripts' which is not on PATH.\nConsider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.\nWARNING: The script tqdm.exe is installed in 'C:\\Users\\matt\\AppData\\Local\\Packages\\PythonSoftwareFoundation.Python.3.12_qbz5n2kfra8p0\\LocalCache\\local-packages\\Python312\\Scripts' which is not on PATH.\nConsider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.\nWARNING: The script huggingface-cli.exe is installed in 'C:\\Users\\matt\\AppData\\Local\\Packages\\PythonSoftwareFoundation.Python.3.12_qbz5n2kfra8p0\\LocalCache\\local-packages\\Python312\\Scripts' which is not on PATH.\nConsider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.\nERROR: Could not install packages due to an OSError: &#91;Errno 2] No such file or directory: 'C:\\Users\\matt\\AppData\\Local\\Packages\\PythonSoftwareFoundation.Python.3.12_qbz5n2kfra8p0\\LocalCache\\local-packages\\Python312\\site-packages\\transformers\\models\\deprecated\\trajectory_transformer\\convert_trajectory_transformer_original_pytorch_checkpoint_to_pytorch.py'\nHINT: This error might have occurred since this system does not have Windows Long Path support enabled. You can find information on how to enable this at https:\/\/pip.pypa.io\/warnings\/enable-long-paths\n\nc:\\depot\\ComfyUI&gt;<\/code><\/pre>\n\n\n\n<ol start=\"7\" class=\"wp-block-list\">\n<li>Download and install the model data files in the correct folders<\/li>\n<\/ol>\n\n\n\n<p>After you have ComfyUI downloaded, you need to <a href=\"https:\/\/comfyanonymous.github.io\/ComfyUI_examples\/flux\/\" data-type=\"link\" data-id=\"https:\/\/comfyanonymous.github.io\/ComfyUI_examples\/flux\/\">get the model files and put them in the right places<\/a>. <a href=\"https:\/\/huggingface.co\/black-forest-labs\" data-type=\"link\" data-id=\"https:\/\/huggingface.co\/black-forest-labs\">Model files are found here<\/a> and are downloaded and put inside the proper comfyUI\\models\\ subfolders.<\/p>\n\n\n\n<p>You have a few options. First, you need to pick if you&#8217;re using the non-commercial Dev version or Schnell version. After that, each has the option of a single easy to use checkpoint package file, or each of the model data files individually. I&#8217;ll be using the Schnell ones, but you just need to get the Dev ones from the Dev branch if you want those instead.<\/p>\n\n\n\n<p>If you&#8217;re running out of memory, you can replace the \\clip\\t5xxl_fp16.safetensors with <a href=\"https:\/\/huggingface.co\/comfyanonymous\/flux_text_encoders\/tree\/main\" data-type=\"link\" data-id=\"https:\/\/huggingface.co\/comfyanonymous\/flux_text_encoders\/tree\/main\">t5xxl_fp8_e4m3fn.safetensors located here<\/a>.<\/p>\n\n\n\n<p>Schnell checkpoint file:<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><tbody><tr><td>File<\/td><td>Download link<\/td><td>Copy location<\/td><\/tr><tr><td>flux1-dev-fp8.safetensors<\/td><td><a href=\"https:\/\/huggingface.co\/Comfy-Org\/flux1-dev\/blob\/main\/flux1-dev-fp8.safetensors\">https:\/\/huggingface.co\/Comfy-Org\/flux1-dev\/blob\/main\/flux1-dev-fp8.safetensors<\/a><\/td><td>ComfyUI\\models\\checkpoints<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p>Schnell individual files:<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><tbody><tr><td>File<\/td><td>Download link<\/td><td>Copy location<\/td><\/tr><tr><td>t5xxl_fp16.safetensors <\/td><td><a href=\"https:\/\/huggingface.co\/comfyanonymous\/flux_text_encoders\/tree\/main\">https:\/\/huggingface.co\/comfyanonymous\/flux_text_encoders\/tree\/main<\/a><\/td><td>ComfyUI\\models\\clip\\<\/td><\/tr><tr><td>ae.safetensors <\/td><td><a href=\"https:\/\/huggingface.co\/black-forest-labs\/FLUX.1-schnell\/blob\/main\/ae.safetensors\">https:\/\/huggingface.co\/black-forest-labs\/FLUX.1-schnell\/blob\/main\/ae.safetensors<\/a><\/td><td>ComfyUI\\models\\vae\\<\/td><\/tr><tr><td>flux1-schnell.safetensors<\/td><td><a href=\"https:\/\/huggingface.co\/black-forest-labs\/FLUX.1-schnell\/blob\/main\/flux1-schnell.safetensors\">https:\/\/huggingface.co\/black-forest-labs\/FLUX.1-schnell\/blob\/main\/flux1-schnell.safetensors<\/a><\/td><td>ComfyUI\\models\\unet\\<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<ol start=\"8\" class=\"wp-block-list\">\n<li>Start up the engine by running python on main.py<\/li>\n<\/ol>\n\n\n\n<pre class=\"wp-block-code\"><code>C:\\depot\\ComfyUI&gt;python main.py\n\nA module that was compiled using NumPy 1.x cannot be run in\nNumPy 2.0.1 as it may crash. To support both 1.x and 2.x\nversions of NumPy, modules must be compiled with NumPy 2.0.\nSome module may need to rebuild instead e.g. with 'pybind11&gt;=2.12'.\n\nIf you are a user of the module, the easiest solution will be to\ndowngrade to 'numpy&lt;2' or try to upgrade the affected module.\nWe expect that some modules will need time to support NumPy 2.\n\nTraceback (most recent call last):  File \"C:\\depot\\ComfyUI\\main.py\", line 83, in &lt;module&gt;\n    import comfy.utils\n  File \"C:\\depot\\ComfyUI\\comfy\\utils.py\", line 20, in &lt;module&gt;\n    import torch\n  File \"C:\\Users\\matt\\AppData\\Local\\Packages\\PythonSoftwareFoundation.Python.3.12_qbz5n2kfra8p0\\LocalCache\\local-packages\\Python312\\site-packages\\torch\\__init__.py\", line 2120, in &lt;module&gt;\n    from torch._higher_order_ops import cond\n  File \"C:\\Users\\matt\\AppData\\Local\\Packages\\PythonSoftwareFoundation.Python.3.12_qbz5n2kfra8p0\\LocalCache\\local-packages\\Python312\\site-packages\\torch\\_higher_order_ops\\__init__.py\", line 1, in &lt;module&gt;\n    from .cond import cond\n  File \"C:\\Users\\matt\\AppData\\Local\\Packages\\PythonSoftwareFoundation.Python.3.12_qbz5n2kfra8p0\\LocalCache\\local-packages\\Python312\\site-packages\\torch\\_higher_order_ops\\cond.py\", line 5, in &lt;module&gt;\n    import torch._subclasses.functional_tensor\n  File \"C:\\Users\\matt\\AppData\\Local\\Packages\\PythonSoftwareFoundation.Python.3.12_qbz5n2kfra8p0\\LocalCache\\local-packages\\Python312\\site-packages\\torch\\_subclasses\\functional_tensor.py\", line 42, in &lt;module&gt;\n    class FunctionalTensor(torch.Tensor):\n  File \"C:\\Users\\matt\\AppData\\Local\\Packages\\PythonSoftwareFoundation.Python.3.12_qbz5n2kfra8p0\\LocalCache\\local-packages\\Python312\\site-packages\\torch\\_subclasses\\functional_tensor.py\", line 258, in FunctionalTensor\n    cpu = _conversion_method_template(device=torch.device(\"cpu\"))\nC:\\Users\\matt\\AppData\\Local\\Packages\\PythonSoftwareFoundation.Python.3.12_qbz5n2kfra8p0\\LocalCache\\local-packages\\Python312\\site-packages\\torch\\_subclasses\\functional_tensor.py:258: UserWarning: Failed to initialize NumPy: _ARRAY_API not found (Triggered internally at C:\\actions-runner\\_work\\pytorch\\pytorch\\builder\\windows\\pytorch\\torch\\csrc\\utils\\tensor_numpy.cpp:84.)\n  cpu = _conversion_method_template(device=torch.device(\"cpu\"))\nTotal VRAM 24576 MB, total RAM 32492 MB\npytorch version: 2.4.0+cu121\nSet vram state to: NORMAL_VRAM\nDevice: cuda:0 NVIDIA GeForce RTX 3090 : cudaMallocAsync\nUsing pytorch cross attention\nC:\\depot\\ComfyUI\\comfy\\extra_samplers\\uni_pc.py:19: SyntaxWarning: invalid escape sequence '\\h'\n  \"\"\"Create a wrapper class for the forward SDE (VP type).\n****** User settings have been changed to be stored on the server instead of browser storage. ******\n****** For multi-user setups add the --multi-user CLI argument to enable multiple user profiles. ******\n&#91;Prompt Server] web root: C:\\depot\\ComfyUI\\web\nC:\\Users\\matt\\AppData\\Local\\Packages\\PythonSoftwareFoundation.Python.3.12_qbz5n2kfra8p0\\LocalCache\\local-packages\\Python312\\site-packages\\kornia\\feature\\lightglue.py:44: FutureWarning: `torch.cuda.amp.custom_fwd(args...)` is deprecated. Please use `torch.amp.custom_fwd(args..., device_type='cuda')` instead.\n  @torch.cuda.amp.custom_fwd(cast_inputs=torch.float32)\n\nImport times for custom nodes:\n   0.0 seconds: C:\\depot\\ComfyUI\\custom_nodes\\websocket_image_save.py\n\nStarting server\n\nTo see the GUI go to: http:\/\/127.0.0.1:8188<\/code><\/pre>\n\n\n\n<ol start=\"9\" class=\"wp-block-list\">\n<li>Open your web browser and go to http:\/\/127.0.01:8188<\/li>\n<\/ol>\n\n\n\n<figure class=\"wp-block-image size-large\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" width=\"640\" height=\"378\" data-attachment-id=\"11901\" data-permalink=\"https:\/\/mattfife.com\/?attachment_id=11901\" data-orig-file=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/image-9.png?fit=2576%2C1521&amp;ssl=1\" data-orig-size=\"2576,1521\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"image\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/image-9.png?fit=640%2C378&amp;ssl=1\" src=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/image-9.png?resize=640%2C378&#038;ssl=1\" alt=\"\" class=\"wp-image-11901\" srcset=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/image-9.png?resize=1024%2C605&amp;ssl=1 1024w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/image-9.png?resize=300%2C177&amp;ssl=1 300w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/image-9.png?resize=768%2C453&amp;ssl=1 768w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/image-9.png?resize=1536%2C907&amp;ssl=1 1536w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/image-9.png?resize=2048%2C1209&amp;ssl=1 2048w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/image-9.png?resize=457%2C270&amp;ssl=1 457w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/image-9.png?w=1280&amp;ssl=1 1280w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/image-9.png?w=1920&amp;ssl=1 1920w\" sizes=\"auto, (max-width: 640px) 100vw, 640px\" \/><\/figure>\n\n\n\n<ol start=\"10\" class=\"wp-block-list\">\n<li>Click on the &#8216;Queue Prompt&#8217; button to execute the current prompt<\/li>\n<\/ol>\n\n\n\n<p>Technically it queues up the work and you should see progress in the command window where you launched python main.py<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>got prompt\nmodel weight dtype torch.float8_e4m3fn, manual cast: torch.bfloat16\nmodel_type FLOW\nUsing pytorch attention in VAE\nUsing pytorch attention in VAE\nModel doesn't have a device attribute.\nC:\\Users\\matt\\AppData\\Local\\Packages\\PythonSoftwareFoundation.Python.3.12_qbz5n2kfra8p0\\LocalCache\\local-packages\\Python312\\site-packages\\transformers\\tokenization_utils_base.py:1601: FutureWarning: `clean_up_tokenization_spaces` was not set. It will be set to `True` by default. This behavior will be depracted in transformers v4.45, and will be then set to `False` by default. For more details check this issue: https:\/\/github.com\/huggingface\/transformers\/issues\/31884\n  warnings.warn(\nModel doesn't have a device attribute.\nloaded straight to GPU\nRequested to load Flux\nLoading 1 new model\nRequested to load FluxClipModel_\nLoading 1 new model\nC:\\depot\\ComfyUI\\comfy\\ldm\\modules\\attention.py:407: UserWarning: 1Torch was not compiled with flash attention. (Triggered internally at C:\\actions-runner\\_work\\pytorch\\pytorch\\builder\\windows\\pytorch\\aten\\src\\ATen\\native\\transformers\\cuda\\sdp_utils.cpp:555.)\n  out = torch.nn.functional.scaled_dot_product_attention(q, k, v, attn_mask=mask, dropout_p=0.0, is_causal=False)\n100%|\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588| 4\/4 &#91;00:04&lt;00:00,  1.18s\/it]\nRequested to load AutoencodingEngine\nLoading 1 new model\nPrompt executed in 23.65 seconds<\/code><\/pre>\n\n\n\n<ol start=\"11\" class=\"wp-block-list\">\n<li>When it completes you should see your image. You can then save your image or tweak the parameters.<\/li>\n<\/ol>\n\n\n\n<figure class=\"wp-block-image size-large\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" width=\"640\" height=\"301\" data-attachment-id=\"11894\" data-permalink=\"https:\/\/mattfife.com\/?attachment_id=11894\" data-orig-file=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture.png?fit=2153%2C1012&amp;ssl=1\" data-orig-size=\"2153,1012\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"Capture\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture.png?fit=640%2C301&amp;ssl=1\" src=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture.png?resize=640%2C301&#038;ssl=1\" alt=\"\" class=\"wp-image-11894\" srcset=\"https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture.png?resize=1024%2C481&amp;ssl=1 1024w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture.png?resize=300%2C141&amp;ssl=1 300w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture.png?resize=768%2C361&amp;ssl=1 768w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture.png?resize=1536%2C722&amp;ssl=1 1536w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture.png?resize=2048%2C963&amp;ssl=1 2048w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture.png?resize=574%2C270&amp;ssl=1 574w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture.png?w=1280&amp;ssl=1 1280w, https:\/\/i0.wp.com\/mattfife.com\/wp-content\/themes\/mattTheme\/headerimgs\/2024\/08\/Capture.png?w=1920&amp;ssl=1 1920w\" sizes=\"auto, (max-width: 640px) 100vw, 640px\" \/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Debugging help:<\/h2>\n\n\n\n<ol class=\"wp-block-list\">\n<li>numpy is not available<\/li>\n<\/ol>\n\n\n\n<p>My first runs, I got this from the console when I queued up a request:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>got prompt\nmodel weight dtype torch.float8_e4m3fn, manual cast: torch.bfloat16\nmodel_type FLOW\nUsing pytorch attention in VAE\nUsing pytorch attention in VAE\nModel doesn't have a device attribute.\nC:\\Users\\matt\\AppData\\Local\\Packages\\PythonSoftwareFoundation.Python.3.12_qbz5n2kfra8p0\\LocalCache\\local-packages\\Python312\\site-packages\\transformers\\tokenization_utils_base.py:1601: FutureWarning: `clean_up_tokenization_spaces` was not set. It will be set to `True` by default. This behavior will be depracted in transformers v4.45, and will be then set to `False` by default. For more details check this issue: https:\/\/github.com\/huggingface\/transformers\/issues\/31884\n  warnings.warn(\nModel doesn't have a device attribute.\nloaded straight to GPU\nRequested to load Flux\nLoading 1 new model\nRequested to load FluxClipModel_\nLoading 1 new model\nC:\\depot\\ComfyUI\\comfy\\ldm\\modules\\attention.py:407: UserWarning: 1Torch was not compiled with flash attention. (Triggered internally at C:\\actions-runner\\_work\\pytorch\\pytorch\\builder\\windows\\pytorch\\aten\\src\\ATen\\native\\transformers\\cuda\\sdp_utils.cpp:555.)\n  out = torch.nn.functional.scaled_dot_product_attention(q, k, v, attn_mask=mask, dropout_p=0.0, is_causal=False)\n100%|\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588\u2588| 4\/4 &#91;00:04&lt;00:00,  1.19s\/it]\nRequested to load AutoencodingEngine\nLoading 1 new model\n!!! Exception during processing!!! Numpy is not available\nTraceback (most recent call last):\n  File \"C:\\depot\\ComfyUI\\execution.py\", line 152, in recursive_execute\n    output_data, output_ui = get_output_data(obj, input_data_all)\n                             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n  File \"C:\\depot\\ComfyUI\\execution.py\", line 82, in get_output_data\n    return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)\n                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n  File \"C:\\depot\\ComfyUI\\execution.py\", line 75, in map_node_over_list\n    results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))\n                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n  File \"C:\\depot\\ComfyUI\\nodes.py\", line 1445, in save_images\n    i = 255. * image.cpu().numpy()\n               ^^^^^^^^^^^^^^^^^^^\nRuntimeError: Numpy is not available\n\nPrompt executed in 26.44 seconds<\/code><\/pre>\n\n\n\n<p>It turns out that <a href=\"https:\/\/github.com\/comfyanonymous\/ComfyUI\/issues\/3794\">I, and others, have the wrong version of numpy<\/a>. This fixed it by exiting out of the server (ctrl-c) and then installing numpy verison 1.26.4:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>C:\\depot\\ComfyUI&gt;pip install numpy==1.26.4\nDefaulting to user installation because normal site-packages is not writeable\nCollecting numpy==1.26.4\n  Downloading numpy-1.26.4-cp312-cp312-win_amd64.whl.metadata (61 kB)\nDownloading numpy-1.26.4-cp312-cp312-win_amd64.whl (15.5 MB)\n   ---------------------------------------- 15.5\/15.5 MB 57.4 MB\/s eta 0:00:00\nInstalling collected packages: numpy\n  Attempting uninstall: numpy\n    Found existing installation: numpy 2.0.1\n    Uninstalling numpy-2.0.1:\n      Successfully uninstalled numpy-2.0.1\nSuccessfully installed numpy-1.26.4\n\nC:\\depot\\ComfyUI&gt;<\/code><\/pre>\n\n\n\n<p>Uninstalling all pip\/python package, clear your pip cache, then re-install the requirements<\/p>\n\n\n\n<p>The first time I installed, I got an error when downloading the numpy library during step in which you pip install the requirements. In order to <a href=\"https:\/\/pip.pypa.io\/en\/stable\/cli\/pip_cache\/\" data-type=\"link\" data-id=\"https:\/\/pip.pypa.io\/en\/stable\/cli\/pip_cache\/\">clear the pip cache<\/a>, <a href=\"https:\/\/www.minitool.com\/news\/pip-uninstall.html\" data-type=\"link\" data-id=\"https:\/\/www.minitool.com\/news\/pip-uninstall.html\">uninstall all pip packages<\/a>, then re-install all requirements again, I did the following:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>C:\\depot\\ComfyUI&gt; pip uninstall -r requirements.txt -y&nbsp;\nC:\\depot\\ComfyUI&gt; python -m pip cache purge<\/code><\/pre>\n\n\n\n<p>Then I re-ran all the pip installation commands.<\/p>\n\n\n\n<p>Links:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>ComfyUI home: <a href=\"https:\/\/comfyanonymous.github.io\/ComfyUI_examples\/flux\/\">https:\/\/comfyanonymous.github.io\/ComfyUI_examples\/flux\/<\/a><\/li>\n\n\n\n<li>ComfyUI github: <a href=\"https:\/\/github.com\/comfyanonymous\/ComfyUI?tab=readme-ov-file\">https:\/\/github.com\/comfyanonymous\/ComfyUI?tab=readme-ov-file<\/a><\/li>\n\n\n\n<li>BlackForest ComfyUI models: <a href=\"https:\/\/huggingface.co\/black-forest-labs\">https:\/\/huggingface.co\/black-forest-labs<\/a><\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Other generative AI installation guides:<\/h2>\n\n\n\n<p>I have previous posted instructions on how to install <a href=\"https:\/\/mattfife.com\/?p=8230\" data-type=\"link\" data-id=\"https:\/\/mattfife.com\/?p=8230\">Stable Diffusion 2<\/a> (as well as <a href=\"https:\/\/mattfife.com\/?p=8082\" data-type=\"link\" data-id=\"https:\/\/mattfife.com\/?p=8082\">Stable Diffusion 1.5<\/a> and <a href=\"https:\/\/mattfife.com\/?p=7089\" data-type=\"link\" data-id=\"https:\/\/mattfife.com\/?p=7089\">1.4<\/a>) as well as some other package installs. <\/p>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Stable Diffusion really opened the world to what is possible with generative AI. Stable Diffusion 2 and 3 &#8230;well&#8230;did not go so well. For a while now, Stable Diffusion 1.5 was your best bet on locally generated AI art but it is really showing it&#8217;s age. Now there is a new player in open source generative AI you can run locally. The developers from Stability.ai have founded Black Forest Labs and released their open source tool: Flux.1 While there are&#8230;<\/p>\n<p class=\"read-more\"><a class=\"btn btn-default\" href=\"https:\/\/mattfife.com\/?p=11893\"> Read More<span class=\"screen-reader-text\">  Read More<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[28,6],"tags":[],"class_list":["post-11893","post","type-post","status-publish","format-standard","hentry","category-ai","category-technicalproblemsolutions"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p4WECr-35P","jetpack-related-posts":[],"_links":{"self":[{"href":"https:\/\/mattfife.com\/index.php?rest_route=\/wp\/v2\/posts\/11893","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mattfife.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mattfife.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mattfife.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/mattfife.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=11893"}],"version-history":[{"count":10,"href":"https:\/\/mattfife.com\/index.php?rest_route=\/wp\/v2\/posts\/11893\/revisions"}],"predecessor-version":[{"id":11917,"href":"https:\/\/mattfife.com\/index.php?rest_route=\/wp\/v2\/posts\/11893\/revisions\/11917"}],"wp:attachment":[{"href":"https:\/\/mattfife.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=11893"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mattfife.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=11893"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mattfife.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=11893"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}