AMD and Xilinx scalp AI inference world record
Quote:
Systems packing AMD Epyc and Xilinx Alveo U250 parts scored 30K img/sec in GoogLeNet.
Read more.
Re: AMD and Xilinx scalp AI inference world record
Well... okay, but what was the previous record? How is it defined? Single system? Is there a benchmark or is this just a continuous operation and they pulled the number as they felt like it?
Nice to know, but I find it hard to relate to anything. This article almost feels like an advert.
Re: AMD and Xilinx scalp AI inference world record
Quote:
Originally Posted by
Ozaron
Well... okay, but what was the previous record? How is it defined? Single system? Is there a benchmark or is this just a continuous operation and they pulled the number as they felt like it?
Nice to know, but I find it hard to relate to anything. This article almost feels like an advert.
30,000 images per-second inference throughput!
Re: AMD and Xilinx scalp AI inference world record
Quote:
Originally Posted by
MajorZod
30,000 images per-second inference throughput!
Me: "This article is lacking context"
You: *types single, quoted-from-article statistic without context*
Re: AMD and Xilinx scalp AI inference world record
Quote:
Originally Posted by
Ozaron
Me: "This article is lacking context"
You: *types single, quoted-from-article statistic without context*
But... 30K images/sec
:p
Re: AMD and Xilinx scalp AI inference world record
Quote:
Originally Posted by
Ozaron
Me: "This article is lacking context"
You: *types single, quoted-from-article statistic without context*
http://lmgtfy.com/?q=What+is+image+p...nce+throughput
Re: AMD and Xilinx scalp AI inference world record
This is more a sideswipe towards Nvidia/IBM since they are working together on similar stuff.
Re: AMD and Xilinx scalp AI inference world record
Quote:
Originally Posted by
Tabbykatze
Sorry, I've got a sass blocker running..
Re: AMD and Xilinx scalp AI inference world record
Quote:
Originally Posted by
Ozaron
Sorry, I've got a sass blocker running..
Sass blocker isn't very efficient, I would recommend installing "HowToGoogle v2.0", it is quite helpful :P
This article was written for people whom have an idea how these systems work, explaining it in the article would be a multi-page article in itself.
Re: AMD and Xilinx scalp AI inference world record
Quote:
Originally Posted by
Tabbykatze
Sass blocker isn't very efficient, I would recommend installing "HowToGoogle v2.0", it is quite helpful :P
This article was written for people whom have an idea how these systems work, explaining it in the article would be a multi-page article in itself.
I just read it as "AMD put out press release to show that they are good at a carefully selected benchmark which they are good at".
I presume if I cared about this stuff, I hope I would already know the relative merits.
Re: AMD and Xilinx scalp AI inference world record
Quote:
Originally Posted by
Tabbykatze
This article was written for people whom have an idea how these systems work, explaining it in the article would be a multi-page article in itself.
Yep, that's almost certainly true, but it doesn't even reference performance numbers of comparative systems. There's nothing to learn here except the existence of this product and how well it does in this specific workload. I dunno, maybe it's just me.