Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums.

You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today!

If you have any problems with the registration process or your account login, please contact us.

Post New Thread Reply

Register GFY Rules Calendar
Go Back   GoFuckYourself.com - Adult Webmaster Forum > >
Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed.

 
Thread Tools
Old 12-24-2013, 10:57 AM   #1
edgeprod
Permanently Gone
 
Industry Role:
Join Date: Mar 2004
Posts: 10,019
Cooling rack-based equipment

Server guys, your time to shine!

For racks of bare components (motherboards, video cards, power supplies), what are some good cooling methods? Can I make the rack out of thick aluminum? The video cards are already on risers, and the machines are built into milk crates for airflow, but the footprint is sub-optimal. I want to be able to put them in racks that maximize cooling while minimizing square footage in the data center cage (which is how I am billed).

Any and all suggestions welcome.
edgeprod is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 12-24-2013, 01:11 PM   #2
American Psycho
Confirmed User
 
Industry Role:
Join Date: Feb 2009
Posts: 3,068
Pour cold water on it.
American Psycho is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 12-24-2013, 02:06 PM   #3
SplitInfinity
Confirmed User
 
Join Date: Dec 2002
Location: San Diego, CA
Posts: 3,047
Submerge boards and power supplies in non-conductive cooling oil. That's how lots of the bitcoin miners are doing it. We have a rig here with a radiator cycling oil through it and the tank has many many ASIC miners.
SplitInfinity is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 12-24-2013, 02:48 PM   #4
livexxx
Confirmed User
 
livexxx's Avatar
 
Industry Role:
Join Date: May 2005
Location: UK
Posts: 1,201
Rack vertically and have the floor tile off to allow the air in, also put vents on the side to suck the neighbours cool air in
__________________
http://www.webcamalerts.com for auto tweets for web cam operators

Last edited by livexxx; 12-24-2013 at 02:50 PM..
livexxx is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 12-24-2013, 05:59 PM   #5
FlowerKid
Confirmed User
 
Join Date: Sep 2005
Location: Zurich
Posts: 1,045
Why do you need video cards in servers?
__________________
FlowerKid is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 12-24-2013, 06:36 PM   #6
Zeiss
Confirmed User
 
Industry Role:
Join Date: May 2012
Location: With your mom
Posts: 5,189
Quote:
Originally Posted by FlowerKid View Post
Why do you need video cards in servers?
Yes, it's possible to run xserver without a graphics card
__________________


Adult Webmasters Guides
Zeiss is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 12-24-2013, 08:10 PM   #7
edgeprod
Permanently Gone
 
Industry Role:
Join Date: Mar 2004
Posts: 10,019
Quote:
Originally Posted by American Psycho View Post
Pour cold water on it.
I'm going to pass on that, thank you though.


Quote:
Originally Posted by SplitInfinity View Post
Submerge boards and power supplies in non-conductive cooling oil. That's how lots of the bitcoin miners are doing it. We have a rig here with a radiator cycling oil through it and the tank has many many ASIC miners.
This is a great idea, thank you very much. I'm going to see how feasible this is (datacenter may not want liquids in proximity to other machines).


Quote:
Originally Posted by livexxx View Post
Rack vertically and have the floor tile off to allow the air in, also put vents on the side to suck the neighbours cool air in
This is what we're doing right now. It's slowing the graphics cards down to be as warm as they are. With just a couple of machines, it's fine, but when you start adding more, it just gets to the point where it's too warm. I want to solve the problem before it really becomes one.


Quote:
Originally Posted by FlowerKid View Post
Why do you need video cards in servers?
They're not servers. Each machine has three Radeon R9 290 4GB GDDR5 in it, all running 24/7, all overclocked. The oldest machines have Radeon 7950's, but I am phasing those out (anyone buying 7950 cards?) in favor of the 290's (650 kH/s versus 850 kH/s).


Quote:
Originally Posted by Zealotry View Post
Yes, it's possible to run xserver without a graphics card
-- I've seen people try to install cgminer on server-based Linux platforms, forgetting that they need the X components. Hilarity ensued.
edgeprod is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 12-24-2013, 10:05 PM   #8
freecartoonporn
Confirmed User
 
freecartoonporn's Avatar
 
Industry Role:
Join Date: Jan 2012
Location: NC
Posts: 7,683
hope this helps.




btw how many gh/s you getting? or is it th/s ?

Last edited by freecartoonporn; 12-24-2013 at 10:10 PM..
freecartoonporn is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 12-24-2013, 10:39 PM   #9
edgeprod
Permanently Gone
 
Industry Role:
Join Date: Mar 2004
Posts: 10,019
Quote:
Originally Posted by freecartoonporn View Post
hope this helps.




btw how many gh/s you getting? or is it th/s ?
All joking aside, fans like that worked up to a certain point for me.
edgeprod is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 12-24-2013, 10:40 PM   #10
johnnyloadproductions
Account Shutdown
 
Industry Role:
Join Date: Oct 2008
Location: Gone
Posts: 3,611
What are you planning to do?

Glad to see you try new things...

Hope it's not mining http://m.techspot.com/news/55111-ins...n-iceland.html
johnnyloadproductions is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 12-24-2013, 11:05 PM   #11
edgeprod
Permanently Gone
 
Industry Role:
Join Date: Mar 2004
Posts: 10,019
Quote:
Originally Posted by johnnyloadproductions View Post
What are you planning to do?

Glad to see you try new things...

Hope it's not mining http://m.techspot.com/news/55111-ins...n-iceland.html
New things? Where do you get that from?

And who the fuck mines Bitcoins anymore?
edgeprod is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 12-24-2013, 11:11 PM   #12
johnnyloadproductions
Account Shutdown
 
Industry Role:
Join Date: Oct 2008
Location: Gone
Posts: 3,611
Quote:
Originally Posted by edgeprod View Post
New things? Where do you get that from?

And who the fuck mines Bitcoins anymore?
The people in the story I linked to

Have a merry christmas
johnnyloadproductions is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 12-24-2013, 11:13 PM   #13
edgeprod
Permanently Gone
 
Industry Role:
Join Date: Mar 2004
Posts: 10,019
Quote:
Originally Posted by johnnyloadproductions View Post
The people in the story I linked to

Have a merry christmas
Haha, fair point! I should rephrase: who the fuck GPU-mines Bitcoin anymore? Idiots, that's who.

When ASICs arrived, that shit shut down.
edgeprod is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 12-25-2013, 09:49 AM   #14
DAMNMAN
Confirmed User
 
Join Date: Dec 2002
Posts: 1,440
Quote:
Originally Posted by SplitInfinity View Post
Submerge boards and power supplies in non-conductive cooling oil. That's how lots of the bitcoin miners are doing it. We have a rig here with a radiator cycling oil through it and the tank has many many ASIC miners.
We looked at this option, but some cables and wiring are melted by mineral oil. Also Harddrives need to be kept out of it. Resale of components is impossible after being submerged in mineral oil. Fluorine inert liquid is prohibitively expensive.
Etc........
__________________
email: zmaster (at) earthlink.net
ICQ: 196678616
ZMASTER

One less god!!!
I contend that we are both an atheist. I just belive in one fewer god than you do. When you understand why you dismiss all the other possible gods, you will understand why I dismiss yours.
DAMNMAN is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 12-25-2013, 09:51 AM   #15
DAMNMAN
Confirmed User
 
Join Date: Dec 2002
Posts: 1,440
Quote:
Originally Posted by FlowerKid View Post
Why do you need video cards in servers?
Yer, joking right?
__________________
email: zmaster (at) earthlink.net
ICQ: 196678616
ZMASTER

One less god!!!
I contend that we are both an atheist. I just belive in one fewer god than you do. When you understand why you dismiss all the other possible gods, you will understand why I dismiss yours.
DAMNMAN is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 12-25-2013, 09:52 AM   #16
DAMNMAN
Confirmed User
 
Join Date: Dec 2002
Posts: 1,440
Quote:
Originally Posted by Zealotry View Post
Yes, it's possible to run xserver without a graphics card
It ain't possible to mine LTC without video card unless you use FPAC and ASIC ain't available yet.
__________________
email: zmaster (at) earthlink.net
ICQ: 196678616
ZMASTER

One less god!!!
I contend that we are both an atheist. I just belive in one fewer god than you do. When you understand why you dismiss all the other possible gods, you will understand why I dismiss yours.
DAMNMAN is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 12-25-2013, 04:32 PM   #17
edgeprod
Permanently Gone
 
Industry Role:
Join Date: Mar 2004
Posts: 10,019
Quote:
Originally Posted by DAMNMAN View Post
We looked at this option, but some cables and wiring are melted by mineral oil. Also Harddrives need to be kept out of it. Resale of components is impossible after being submerged in mineral oil. Fluorine inert liquid is prohibitively expensive.
Etc........
That's what I found when I looked into it yesterday also. A shame, but it seems like a dead end, at least right now.
edgeprod is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 12-25-2013, 05:13 PM   #18
Grapesoda
So Fucking Banned
 
Industry Role:
Join Date: Jul 2003
Location: Montana
Posts: 46,238
Quote:
Originally Posted by edgeprod View Post
Server guys, your time to shine!

For racks of bare components (motherboards, video cards, power supplies), what are some good cooling methods? Can I make the rack out of thick aluminum? The video cards are already on risers, and the machines are built into milk crates for airflow, but the footprint is sub-optimal. I want to be able to put them in racks that maximize cooling while minimizing square footage in the data center cage (which is how I am billed).

Any and all suggestions welcome.
how about a cabinet with AC?
Grapesoda is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 12-25-2013, 05:36 PM   #19
edgeprod
Permanently Gone
 
Industry Role:
Join Date: Mar 2004
Posts: 10,019
Quote:
Originally Posted by Grapesoda View Post
how about a cabinet with AC?
The form-factor is weird, sadly.
edgeprod is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 12-25-2013, 06:02 PM   #20
Grapesoda
So Fucking Banned
 
Industry Role:
Join Date: Jul 2003
Location: Montana
Posts: 46,238
Quote:
Originally Posted by edgeprod View Post
The form-factor is weird, sadly.
that's too bad... get a rather larger fridge for $1700

put the HD's in the freezer and the rest in the fridge

http://www.amazon.com/Whirlpool-GX5F...s=refrigerator

Last edited by Grapesoda; 12-25-2013 at 06:05 PM..
Grapesoda is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 12-25-2013, 06:19 PM   #21
rowan
Too lazy to set a custom title
 
Join Date: Mar 2002
Location: Australia
Posts: 17,393
Quote:
Originally Posted by DAMNMAN View Post
We looked at this option, but some cables and wiring are melted by mineral oil. Also Harddrives need to be kept out of it. Resale of components is impossible after being submerged in mineral oil. Fluorine inert liquid is prohibitively expensive.
Etc........
The other thing to be aware of with liquid is possible wicking, where the oil travels along the cable (against gravity) and ends up depositing itself at the other end... in your power supply, ethernet switch, etc.

One cooling method I am currently experimenting with is fast moving fresh air. Filtered inlet at ground level, m/b and GPUs in a sealed box, big-ass fan exhausting out via the roof space. The idea being that even with high outside ambient temps the airflow is still sufficient to draw the heat away from the GPUs. As a bonus it means you do not need to cool the entire room. (Obviously this sort of thing is not possible in a data centre.)
rowan is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 12-25-2013, 06:23 PM   #22
rowan
Too lazy to set a custom title
 
Join Date: Mar 2002
Location: Australia
Posts: 17,393
One other thought. Is the D/C going to be happy about letting you install extreme heat producing equipment that you've self-assembled into a milk crate?
rowan is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 12-25-2013, 06:38 PM   #23
DAMNMAN
Confirmed User
 
Join Date: Dec 2002
Posts: 1,440
Quote:
Originally Posted by DAMNMAN View Post
It ain't possible to mine LTC without video card unless you use FPAC and ASIC ain't available yet.
Mistype FPGA
__________________
email: zmaster (at) earthlink.net
ICQ: 196678616
ZMASTER

One less god!!!
I contend that we are both an atheist. I just belive in one fewer god than you do. When you understand why you dismiss all the other possible gods, you will understand why I dismiss yours.
DAMNMAN is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 12-25-2013, 06:40 PM   #24
DAMNMAN
Confirmed User
 
Join Date: Dec 2002
Posts: 1,440
Quote:
Originally Posted by rowan View Post
The other thing to be aware of with liquid is possible wicking, where the oil travels along the cable (against gravity) and ends up depositing itself at the other end... in your power supply, ethernet switch, etc.

One cooling method I am currently experimenting with is fast moving fresh air. Filtered inlet at ground level, m/b and GPUs in a sealed box, big-ass fan exhausting out via the roof space. The idea being that even with high outside ambient temps the airflow is still sufficient to draw the heat away from the GPUs. As a bonus it means you do not need to cool the entire room. (Obviously this sort of thing is not possible in a data centre.)
This is the best path we've found so far as well. = No Data Center
__________________
email: zmaster (at) earthlink.net
ICQ: 196678616
ZMASTER

One less god!!!
I contend that we are both an atheist. I just belive in one fewer god than you do. When you understand why you dismiss all the other possible gods, you will understand why I dismiss yours.
DAMNMAN is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 12-25-2013, 06:55 PM   #25
Due
Confirmed User
 
Due's Avatar
 
Industry Role:
Join Date: Mar 2001
Location: Murrieta, CA
Posts: 3,620
Your datacenter should be able to supply sufficient cooling, you just need to design it so air can flow.
If you have airflow it might be better with less airspace since it well be easier to maintain the flow.
Look on eBay or similar for refurbished server hardware, you can buy some older units cheaper than what the chassis would cost you.
I know in the past people that was looking for GPU power used a modified PlayStation (or possible Xbox can't remember).
__________________
I buy plugs
Skype: Due_Global
/Due
Due is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 12-26-2013, 12:25 PM   #26
edgeprod
Permanently Gone
 
Industry Role:
Join Date: Mar 2004
Posts: 10,019
Quote:
Originally Posted by rowan View Post
One other thought. Is the D/C going to be happy about letting you install extreme heat producing equipment that you've self-assembled into a milk crate?
They weren't crazy about it when I first started, but became more comfortable the more bills that got paid on time.

Looking at two different data centers now, so I'm going to have to do the whole song-and-dance again, it looks like. Not using milk carts in the new data centers, though, looking at using these:

https://openrigs.com/arianna-grid-gpu-frame
edgeprod is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Post New Thread Reply
Go Back   GoFuckYourself.com - Adult Webmaster Forum > >

Bookmarks



Advertising inquiries - marketing at gfy dot com

Contact Admin - Advertise - GFY Rules - Top

©2000-, AI Media Network Inc



Powered by vBulletin
Copyright © 2000- Jelsoft Enterprises Limited.