Page 1 of 2 12 LastLast
Results 1 to 16 of 18

Thread: GPGPU: far more important than you think. Think 10x a CPU's performance

  1. #1
    HEXUS.admin
    Join Date
    Apr 2005
    Posts
    31,709
    Thanks
    0
    Thanked
    2,073 times in 719 posts

    GPGPU: far more important than you think. Think 10x a CPU's performance

    Why we need more funding for GPGPU. It beats the pants off a quad-core CPU when done right.
    Read more.

  2. #2
    Comfortably Numb directhex's Avatar
    Join Date
    Jul 2003
    Location
    /dev/urandom
    Posts
    17,074
    Thanks
    228
    Thanked
    1,026 times in 677 posts
    • directhex's system
      • Motherboard:
      • Asus ROG Strix B550-I Gaming
      • CPU:
      • Ryzen 5900x
      • Memory:
      • 64GB G.Skill Trident Z RGB
      • Storage:
      • 2TB Seagate Firecuda 520
      • Graphics card(s):
      • EVGA GeForce RTX 3080 XC3 Ultra
      • PSU:
      • EVGA SuperNOVA 850W G3
      • Case:
      • NZXT H210i
      • Operating System:
      • Ubuntu 20.04, Windows 10
      • Monitor(s):
      • LG 34GN850
      • Internet:
      • FIOS

    Re: GPGPU: far more important than you think. Think 10x a CPU's performance

    done right is the key. there are a whole bunch of problems with gpgpu, not least of which is the low accuracy of numbers (32-bit floats only, with no guarantees how things will be rounded)

  3. #3
    Banhammer in peace PeterB kalniel's Avatar
    Join Date
    Aug 2005
    Posts
    31,038
    Thanks
    1,878
    Thanked
    3,379 times in 2,716 posts
    • kalniel's system
      • Motherboard:
      • Gigabyte Z390 Aorus Ultra
      • CPU:
      • Intel i9 9900k
      • Memory:
      • 32GB DDR4 3200 CL16
      • Storage:
      • 1TB Samsung 970Evo+ NVMe
      • Graphics card(s):
      • nVidia GTX 1060 6GB
      • PSU:
      • Seasonic 600W
      • Case:
      • Cooler Master HAF 912
      • Operating System:
      • Win 10 Pro x64
      • Monitor(s):
      • Dell S2721DGF
      • Internet:
      • rubbish

    Re: GPGPU: far more important than you think. Think 10x a CPU's performance

    Only 10x?

    The R580 can do operations 40-50x faster than a CPU provided the problem is something that a shader can solve.

  4. #4
    Seething Cauldron of Hatred TheAnimus's Avatar
    Join Date
    Aug 2005
    Posts
    17,168
    Thanks
    803
    Thanked
    2,152 times in 1,408 posts

    Re: GPGPU: far more important than you think. Think 10x a CPU's performance

    its interesting because only a couple of years back we where told what an amazing difference these Physics Co Proccessors would make. Now the problem comes when you can't express the problem in a way that makes it easy to leverage these co-processors.

    Its hard enough most of the time to make something that can be parralised accross two proccessors, let alone 16.

    Also as hex said, rounding is odd with GPUs, take something we all should know, 0.1 + 0.2 != 0.3, but with GPUs, it could be a slightly different rounding.

    Take a look at:
    Programming in the Age of Concurrency: The Accelerator Project
    This allows you to use the Pixel Shader, via direct-x from .Net code.

    Then try and think how you could use that for the average developement task.
    throw new ArgumentException (String, String, Exception)

  5. Received thanks from:

    dangel (12-02-2008)

  6. #5
    Lovely chap dangel's Avatar
    Join Date
    Aug 2005
    Location
    Cambridge, UK
    Posts
    8,398
    Thanks
    412
    Thanked
    459 times in 334 posts
    • dangel's system
      • Motherboard:
      • See My Sig
      • CPU:
      • See My Sig
      • Memory:
      • See My Sig
      • Storage:
      • See My Sig
      • Graphics card(s):
      • See My Sig
      • PSU:
      • See My Sig
      • Case:
      • See My Sig
      • Operating System:
      • Windows 10
      • Monitor(s):
      • See My Sig
      • Internet:
      • 60mbit Sky LLU

    Re: GPGPU: far more important than you think. Think 10x a CPU's performance

    Very interesting - I could see some applications for the tech in the work I do.. I did pick up a book on shader programming but I must admit i'd much rather have a tool that scaled the code onto the hardware automajically..
    Crosshair VIII Hero (WIFI), 3900x, 32GB DDR4, Many SSDs, EVGA FTW3 3090, Ethoo 719


  7. #6
    ?!
    Join Date
    Sep 2004
    Posts
    1,045
    Thanks
    2
    Thanked
    6 times in 5 posts

    Re: GPGPU: far more important than you think. Think 10x a CPU's performance

    I'm currently in the process of optimizing OpenFOAM with CUDA, it really does require some thought and understanding of the architecture and application domain.

    Some algorithms happily lend themselves to the parallel architecture of the GPU and are fairly good to execute on the GPU. Others clearly dont given the limited actual buffer space despite the huge transfer speeds capable on the ring-bus memory system. Also with the G9x series coming out in the near future (Geforce 9xxx), 64-bit precision wont be a huge issue either.

    I'm finding alot of algorithms dont even need to fully occupy (WARP as its known in CUDA world) the ALU to benefit entirely from the GPU - a lot of operations in CFD applications are bandwidth restricted rather than processing power restricted. For example, benchmarking OpenFOAM on a quad core system that shares the bus (e.g. current Intel ones) show a nonlinear increase in performance at 3 cores, as the cores fight for bus access.

    Here's an example of what algorithms clearly perform well on the GPU architecture to date : NVIDIA CUDA SDK Code Samples

    As for 64-bit on current hardware (G82 etc), its so dam powerful that should you manage to spawn off enough threads per seconds to occupy the ALUs, it would easily overcome the extra cycles required to calculate at 64-bit precision.

    As for Microsoft Accelerator, you'll want to skip that, it optimizes too generically for the architecture due to DX limitations. Interfaces such as CUDA (NVIDIA) / Close to Metal (ATI research) allow far better access to the chip, with less performance penalties per thread.

    Finally, there are papers on IEEE 754 rounding on GPGPU architectures, which can help mitigate the total effect on your application, have a look within the ACM for these.
    Last edited by javalord; 12-02-2008 at 02:10 PM.

  8. #7
    ?!
    Join Date
    Sep 2004
    Posts
    1,045
    Thanks
    2
    Thanked
    6 times in 5 posts

    Re: GPGPU: far more important than you think. Think 10x a CPU's performance

    Quote Originally Posted by kalniel View Post
    Only 10x?

    The R580 can do operations 40-50x faster than a CPU provided the problem is something that a shader can solve.
    Thats not necessarily true when you place it into context in a real world application. Theoretically and practically yes you can optimize a algorithm to run 40x - 50x faster, but thats only one part of the application in question.

  9. #8
    Banhammer in peace PeterB kalniel's Avatar
    Join Date
    Aug 2005
    Posts
    31,038
    Thanks
    1,878
    Thanked
    3,379 times in 2,716 posts
    • kalniel's system
      • Motherboard:
      • Gigabyte Z390 Aorus Ultra
      • CPU:
      • Intel i9 9900k
      • Memory:
      • 32GB DDR4 3200 CL16
      • Storage:
      • 1TB Samsung 970Evo+ NVMe
      • Graphics card(s):
      • nVidia GTX 1060 6GB
      • PSU:
      • Seasonic 600W
      • Case:
      • Cooler Master HAF 912
      • Operating System:
      • Win 10 Pro x64
      • Monitor(s):
      • Dell S2721DGF
      • Internet:
      • rubbish

    Re: GPGPU: far more important than you think. Think 10x a CPU's performance

    Quote Originally Posted by javalord View Post
    Thats not necessarily true when you place it into context in a real world application. Theoretically and practically yes you can optimize a algorithm to run 40x - 50x faster, but thats only one part of the application in question.
    What application? If you're making the point that some applications can't be speeded up 40-50x then well, of course But it's the same here - GPGPU will not speed up every application by 10x either.

  10. #9
    Comfortably Numb directhex's Avatar
    Join Date
    Jul 2003
    Location
    /dev/urandom
    Posts
    17,074
    Thanks
    228
    Thanked
    1,026 times in 677 posts
    • directhex's system
      • Motherboard:
      • Asus ROG Strix B550-I Gaming
      • CPU:
      • Ryzen 5900x
      • Memory:
      • 64GB G.Skill Trident Z RGB
      • Storage:
      • 2TB Seagate Firecuda 520
      • Graphics card(s):
      • EVGA GeForce RTX 3080 XC3 Ultra
      • PSU:
      • EVGA SuperNOVA 850W G3
      • Case:
      • NZXT H210i
      • Operating System:
      • Ubuntu 20.04, Windows 10
      • Monitor(s):
      • LG 34GN850
      • Internet:
      • FIOS

    Re: GPGPU: far more important than you think. Think 10x a CPU's performance

    we're doing some gpgpu research imminently, and have a 1u nvidia tesla on order. the gut feeling is "it's great for monte carlo simulations" (i.e. codes where you want a huge number of unconnected threads doing the same thing and never talking to each other). let's see how that pans out in reality

    but with all these alternative techniques (gpgpu, accelerator cards like mdgrape or clearspeed, fpgas, etc) there still needs to be sufficient payoff for the coding time, effort, cost, and running costs which all jump up where you start deviating from the norm

  11. #10
    Registered User
    Join Date
    Jan 2008
    Posts
    4
    Thanks
    0
    Thanked
    0 times in 0 posts

    Re: GPGPU: far more important than you think. Think 10x a CPU's performance

    ATI's Radeon HD 3870 X2, released last month, can hit around 1TFLOPS (one trillion floating-point operations per second). Its 320 stream processors combine for massive parallel computation.
    Would be 320 x2, or 640 stream processors in one of them.

  12. #11
    HEXUS.timelord. Zak33's Avatar
    Join Date
    Jul 2003
    Location
    I'm a Jessie
    Posts
    35,185
    Thanks
    3,126
    Thanked
    3,179 times in 1,926 posts
    • Zak33's system
      • Storage:
      • Kingston HyperX SSD, Hitachi 1Tb
      • Graphics card(s):
      • Nvidia 1050
      • PSU:
      • Coolermaster 800w
      • Case:
      • Silverstone Fortress FT01
      • Operating System:
      • Win10
      • Internet:
      • Zen FTC uber speedy

    Re: GPGPU: far more important than you think. Think 10x a CPU's performance

    it's about time SOUND CARDS caught up with all the FLOP-age available.

    I want a HUGE leap forward in accuracy, positional and spacing, and enviroments,.

    It's all too fake at the moment

    Quote Originally Posted by Advice Trinity by Knoxville
    "The second you aren't paying attention to the tool you're using, it will take your fingers from you. It does not know sympathy." |
    "If you don't gaffer it, it will gaffer you" | "Belt and braces"

  13. #12
    Out of the Loop
    Join Date
    Mar 2005
    Location
    Staffordshire
    Posts
    1,036
    Thanks
    140
    Thanked
    52 times in 42 posts
    • vrykyl's system
      • Motherboard:
      • Asus ROG X570 Strix-E
      • CPU:
      • Ryzen 3900 @ 4.5ghz 1.28v (Noctua DH15)
      • Memory:
      • 32gb (2x16gb) Crucial Ballistix 3200mhz @ 3800mhz 1.35v
      • Storage:
      • 1tb Corsair MP600 NVME, 256gb Samsung Evo, 4tb WD Red
      • Graphics card(s):
      • MSI RTX 3080 Ventus 3X OC 10gb
      • PSU:
      • Corsair AX 860w + White Braided Cables
      • Case:
      • Corsair 600T White Limited Edition (Soundproofed)
      • Operating System:
      • Windows 10 x64
      • Monitor(s):
      • Samsung 49" CRG9 Ultrawide 5120x1440 @ 120hz
      • Internet:
      • Plusnet 80mb fibre (80/20)

    Re: GPGPU: far more important than you think. Think 10x a CPU's performance

    that or its time to take the sound card technology they have, minaturise it, bring it fully into pci express (100% ditching pci) and maybe start adding extra features into the on pcb space that most sound cards seem to have...

    For example - soundcard with onboard physx card? or soundcard with onboard nic/wireless.....maybe even a mini cpu (ala killer nic cards) on soundcards that can run an antivirus or such forth on it.......

    id love to see sound cards move towards multi purpose

  14. #13
    YUKIKAZE arthurleung's Avatar
    Join Date
    Feb 2005
    Location
    Aberdeen
    Posts
    3,280
    Thanks
    8
    Thanked
    88 times in 83 posts
    • arthurleung's system
      • Motherboard:
      • Asus P5E (Rampage Formula 0902)
      • CPU:
      • Intel Core2Quad Q9550 3.6Ghz 1.2V
      • Memory:
      • A-Data DDR2-800 2x2GB CL4
      • Storage:
      • 4x1TB WD1000FYPS @ RAID5 3Ware 9500S-8 / 3x 1TB Samsung Ecogreen F2
      • Graphics card(s):
      • GeCube HD4870 512MB
      • PSU:
      • Corsair VX450
      • Case:
      • Antec P180
      • Operating System:
      • Windows Server 2008 Standard
      • Monitor(s):
      • Dell Ultrasharp 2709W + 2001FP
      • Internet:
      • Be*Unlimited 20Mbps

    Re: GPGPU: far more important than you think. Think 10x a CPU's performance

    Quote Originally Posted by Zak33 View Post
    it's about time SOUND CARDS caught up with all the FLOP-age available.

    I want a HUGE leap forward in accuracy, positional and spacing, and enviroments,.

    It's all too fake at the moment
    Consider how many people actually have decent speakers to make use of "quality" sound, I personally think the sound card market pretty much reached the point of diminishing return, unless there are some kind of interface that transfer sound directly to our brain, otherwise the difference in sound quality will be quite minimal.

    Alternatively, we could have some sort of sound system that looks like a halo, with like 360 tiny speakers. That way true surround sound and could max out the volume without other people hearing it (phased array).

    Or at the very least i think it is possible to make sensors that clip to your ears and the software will calculate the position of the speakers in related to you, and the sound card will calculate positional sound accurately

    Back in Audigy2 age, there is(was?) a THX console where you can set the distance and angle of the speaker. Creative only put that console on the CD so I couldn't get hold of it anymore :S

    Back to topic.
    I'll buy whatever graphics card(s) that will do hardware-assisted x264 encoding. Even overclocked quad-core can't do real-time x264 encoding with a couple of cpu-intensive filters.

  15. #14
    Registered User
    Join Date
    Mar 2009
    Posts
    1
    Thanks
    0
    Thanked
    0 times in 0 posts

    Re: GPGPU: far more important than you think. Think 10x a CPU's performance

    Javalord - I am interested to know what success you've had with OpenFOAM and using CUDA.
    Is there a place to look at what you have done?

  16. #15
    Registered User
    Join Date
    Jul 2009
    Posts
    2
    Thanks
    0
    Thanked
    0 times in 0 posts

    Re: GPGPU: far more important than you think. Think 10x a CPU's performance

    Hello everybody! As a proud owner of Tesla C1060 card I want to know if anybody can share some experiences of using OpenFoam with CUDA?
    Anyway, I plan to hack it and if anyone is interested to join, then please let me know.

  17. #16
    Registered User
    Join Date
    Jul 2009
    Posts
    2
    Thanks
    0
    Thanked
    0 times in 0 posts

    Re: GPGPU: far more important than you think. Think 10x a CPU's performance

    ....

Page 1 of 2 12 LastLast

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. Building A Gaming Rig - A Living Document. (A HEXUS Project)
    By Stewart in forum PC Hardware and Components
    Replies: 188
    Last Post: 06-09-2008, 04:19 PM
  2. Replies: 3
    Last Post: 19-07-2007, 12:28 PM
  3. Flash Voyager Performance and New Product Update, READ ME!
    By Yellowbeard in forum Solid State Drives (SSD)
    Replies: 0
    Last Post: 21-03-2007, 07:26 PM
  4. Do you get an 'XP rating' applied when you o/c?
    By Austin in forum PC Hardware and Components
    Replies: 56
    Last Post: 11-12-2003, 03:10 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •