Page 1 of 2 12 LastLast
Results 1 to 16 of 22

Thread: DeepMind AI agents surpass humans in Quake III Arena CTF

  1. #1
    HEXUS.admin
    Join Date
    Apr 2005
    Posts
    31,709
    Thanks
    0
    Thanked
    2,073 times in 719 posts

    DeepMind AI agents surpass humans in Quake III Arena CTF

    Multiple AI agents learned CTF mode from scratch and leveraged collective intelligence.
    Read more.

  2. #2
    Senior Member
    Join Date
    Sep 2016
    Location
    Merseyside
    Posts
    570
    Thanks
    19
    Thanked
    37 times in 31 posts
    • EvilCycle's system
      • Motherboard:
      • ASUS ROG MAXIMUS IX HERO
      • CPU:
      • Intel I7 7700K (OC to 4.8GHz on Corsair H100i V2)
      • Memory:
      • 32GB Corsair Vengeance DDR4 @ 3000MHz
      • Storage:
      • WD Blue SN550 1TB NVMe SSD, Samsung 840 evo 120GB SSD + 2 x 500GB 72000rpm HDD's
      • Graphics card(s):
      • Gigabyte AORUS GeForce RTX 2080 XTREME
      • PSU:
      • DEEPCOOL DQ 750st
      • Case:
      • Corsair Obsidian Series 750D Airflow Edition
      • Operating System:
      • Windows 10
      • Monitor(s):
      • 27" 1440p 60hz AOC q2778vqe
      • Internet:
      • Virgin Media 380Mb (Fibre Optic)

    Re: DeepMind AI agents surpass humans in Quake III Arena CTF

    Good, put this into robotics so that next time war breaks out we can send those onto the battlefield instead of a bunch of innocent teenagers

  3. #3
    Two Places At Once Ozaron's Avatar
    Join Date
    Jan 2017
    Location
    Sometimes UK
    Posts
    638
    Thanks
    86
    Thanked
    34 times in 33 posts
    • Ozaron's system
      • Motherboard:
      • MSI X570 Unify
      • CPU:
      • Ryzen 3700X
      • Memory:
      • 32GB Patriot Blackout @ 3800 CL16
      • Storage:
      • Toshiba X300 4TB (2), Samsung 850 Evo 500GB
      • Graphics card(s):
      • Sapphire 5700XT, Sapphire R9 Fury Nitro
      • PSU:
      • Seasonic M12-II 620w
      • Case:
      • Corsair Obsidian 500D
      • Operating System:
      • W10 Enterprise 64bit
      • Monitor(s):
      • Gigabyte G27QC
      • Internet:
      • 2.5 MB/s ↓ 0.86 MB/s ↑ ~20ms

    Re: DeepMind AI agents surpass humans in Quake III Arena CTF

    Quote Originally Posted by EvilCycle View Post
    Good, put this into robotics so that next time war breaks out we can send those onto the battlefield instead of a bunch of innocent teenagers
    ....And when they begin killing innocent, now defenseless teenagers?

  4. #4
    RIP Peterb ik9000's Avatar
    Join Date
    Nov 2009
    Posts
    7,743
    Thanks
    1,849
    Thanked
    1,442 times in 1,065 posts
    • ik9000's system
      • Motherboard:
      • Asus P7H55-M/USB3
      • CPU:
      • i7-870, Prolimatech Megahalems, 2x Akasa Apache 120mm
      • Memory:
      • 4x4GB Corsair Vengeance 2133 11-11-11-27
      • Storage:
      • 2x256GB Samsung 840-Pro, 1TB Seagate 7200.12, 1TB Seagate ES.2
      • Graphics card(s):
      • Gigabyte GTX 460 1GB SuperOverClocked
      • PSU:
      • NZXT Hale 90 750w
      • Case:
      • BitFenix Survivor + Bitfenix spectre LED fans, LG BluRay R/W optical drive
      • Operating System:
      • Windows 7 Professional
      • Monitor(s):
      • Dell U2414h, U2311h 1920x1080
      • Internet:
      • 200Mb/s Fibre and 4G wifi

    Re: DeepMind AI agents surpass humans in Quake III Arena CTF

    Quote Originally Posted by HEXUS View Post
    as someone who still plays Q3 can they release this as some less predictable single player would be ace.

  5. #5
    Registered+
    Join Date
    Jun 2016
    Posts
    44
    Thanks
    1
    Thanked
    3 times in 2 posts

    Re: DeepMind AI agents surpass humans in Quake III Arena CTF

    Teaching AI how to kill and capture...

  6. #6
    MCRN Tachi Ttaskmaster's Avatar
    Join Date
    Nov 2013
    Location
    Reading, UK
    Posts
    6,945
    Thanks
    702
    Thanked
    812 times in 674 posts
    • Ttaskmaster's system
      • Motherboard:
      • Aorus Master X670E
      • CPU:
      • Ryzen 7800X3D
      • Memory:
      • 32GB Corsair Dominator DDR5 6000MHz
      • Storage:
      • Samsung Evo 120GB and Seagate Baracuda 2TB
      • Graphics card(s):
      • Aorus Master 4090
      • PSU:
      • EVGA Supernova G2 1000W
      • Case:
      • Lian Li V3000 Plus
      • Operating System:
      • Win11
      • Monitor(s):
      • Gigabyte M32U
      • Internet:
      • 900Mbps Gigaclear WHOOOOOOOOOOOO!!!!!!!!

    Re: DeepMind AI agents surpass humans in Quake III Arena CTF

    Games have unbreakable rules. Combat does not. 'Nuff said...

  7. #7
    Senior Member
    Join Date
    Mar 2012
    Posts
    262
    Thanks
    0
    Thanked
    26 times in 25 posts
    • devBunny's system
      • Motherboard:
      • Asus P9X79 Pro
      • CPU:
      • i7-3930
      • Memory:
      • 8GB Kingston HyperX
      • Storage:
      • 256GB Samsung 830
      • Graphics card(s):
      • 2 x GTX 560Ti
      • PSU:
      • OCZ ZX1000W Gold
      • Case:
      • Xigmatek Elysium
      • Operating System:
      • Win 7 and Win XP in VMs
      • Monitor(s):
      • 3 x Dell 2410M 1920x1200 IPS

    Re: DeepMind AI agents surpass humans in Quake III Arena CTF

    The AIs are certainly good but I have to wonder how excellently the best human players would play if they were able to gain 150,000 to 450,000 games worth of experience! 150K is only 40 games per day, every day of the year for ten years. Any volunteers? ;-)

    In games like Go and Backgammon, the nets are given a game state (basically the board and pieces) and trained to give as accurate an evaluation of that state as they can. Given a state and selection of possible actions, the resulting state of each action is determined and thus its evaluation can be obtained (estimated by the net). The action that gets made is the one with the highest evaluation. This is what AIs that play Go and Backgammon do. They have no understanding of their respective games.

    They don't know the concepts of, for example, hitting a piece in Backgammon, or creating a certain configuration to acquire territory in Go. All they know is that when they've encountered states which represent the outcomes of those tactics (without knowing that they *are* such outcomes), the evaluation is X .... and X happens, after sufficient training, to end up higher than the outcomes of other states that can be reached from common predecessor states. Hence the AI will make the hit or strive to achieve the territory without needing to know what it's doing or why. Indeed, such an AI cannot explain its conceptual logic, for there is none; it can only say "I did that because, in looking at all the possibilities, that one had the highest evaluation".

    The game-learning concept is the same with video-game playing AIs so it's no surprise that they are showing similar capabilities. The games states are more complex - a *lot* more complex - because instead of a board with simple possibilities (no piece, my piece, your piece), you have a grid of pixels which represents a visual view upon some part of an underlying model (terrain height, object types and locations). This grid of pixels has to be translated into an equivalent model state. But from that point on, the exercise of learning to play and win is no different than with a board game - associating states with increasingly accurate evaluations.

    It's certainly an achievement to have developed a perceptual pipeline that can convert pixels into a model state. It's also very impressive that, unlike a board game, where you only have a few options such as "Place piece X at location P" and each player makes just one action per turn, video games have much wider options and multiple actions can be made in sequence, for example "select weapon W, run to location P, fire at location (x, y, z) then crouch" .... but while it's an "AI" doing this, it's hard to credit it with intelligence.

    A human player knows when to select a BFG because it's a *BF* gun which makes *BF* holes and that's what's needed to get past the giant troll just ahead. The current AIs know that in a game state where the bits that arbitrarily encode the presence of (what a person would recognise as) a troll, and where among the action options there's one which selects (what a person would be able to recognise as) a BFG, the outcome which selects that weapon has a higher-valued outcome than actions which don't select it. And they discover this by trying *all* the actions possible from this point and looking up the evaluations, not by knowing anything about BFGs and trolls.

    The best Backgammon bots in the world "explain" and "teach" the best way to play the game by giving a list of possible moves along with the corresponding evaulations. That's it. No explanation of anything backgammony is currently possible so the greatest benefit goes to players who are comfortable with numbers.

    *True* intelligence, in my opinion, will only begin to emerge when a game-playing AI knows *conceptually* what it is looking at, what the various actions do in their own right, why to use them in certain circumstances, what the concepts behind the various goals of the game are, and even more convincingly, when it can explain its actions in those terms.

  8. #8
    Senior Member
    Join Date
    Dec 2013
    Posts
    3,526
    Thanks
    504
    Thanked
    468 times in 326 posts

    Re: DeepMind AI agents surpass humans in Quake III Arena CTF

    I've not read their research paper but doesn't the impressiveness of beating human players depend on how good those humans are? If we're talking about a selection of the worlds top 100 competitive Q3 players then colour me impressed, if on the other hand we're talking about the average player found on public servers then it's not so impressive.

  9. #9
    Moosing about! CAT-THE-FIFTH's Avatar
    Join Date
    Aug 2006
    Location
    Not here
    Posts
    32,042
    Thanks
    3,909
    Thanked
    5,213 times in 4,005 posts
    • CAT-THE-FIFTH's system
      • Motherboard:
      • Less E-PEEN
      • CPU:
      • Massive E-PEEN
      • Memory:
      • RGB E-PEEN
      • Storage:
      • Not in any order
      • Graphics card(s):
      • EVEN BIGGER E-PEEN
      • PSU:
      • OVERSIZED
      • Case:
      • UNDERSIZED
      • Operating System:
      • DOS 6.22
      • Monitor(s):
      • NOT USUALLY ON....WHEN I POST
      • Internet:
      • FUNCTIONAL

    Re: DeepMind AI agents surpass humans in Quake III Arena CTF

    Quote Originally Posted by Corky34 View Post
    I've not read their research paper but doesn't the impressiveness of beating human players depend on how good those humans are? If we're talking about a selection of the worlds top 100 competitive Q3 players then colour me impressed, if on the other hand we're talking about the average player found on public servers then it's not so impressive.
    If the AI was a camping sniper than it would easily thrash anyone!!
    Last edited by CAT-THE-FIFTH; 05-07-2018 at 06:31 PM.

  10. #10
    Long member
    Join Date
    Apr 2008
    Posts
    2,427
    Thanks
    70
    Thanked
    404 times in 291 posts
    • philehidiot's system
      • Motherboard:
      • Father's bored
      • CPU:
      • Cockroach brain V0.1
      • Memory:
      • Innebriated, unwritten
      • Storage:
      • Big Yellow Self Storage
      • Graphics card(s):
      • Semi chewed Crayola Mega Pack
      • PSU:
      • 20KW single phase direct grid supply
      • Case:
      • Closed, Open, Cold
      • Operating System:
      • Cockroach
      • Monitor(s):
      • The mental health nurses
      • Internet:
      • Please.

    Re: DeepMind AI agents surpass humans in Quake III Arena CTF

    So basically, the AI has an equation which lists moves and so on. The AI tries these and moves performed at certain times or in certain patterns have an outcome closer to the desired. Therefore the AI weights the equations so it performs moves like this more often at such and such a time. It gradually improves this weighting over time and thousands of games. This is a massively complex equation which has to be created but the concept when broken down seems very, very simple. It shows no understanding of what's actually happening but it's just modifying weighting in an algebraic form to get closer to a desired outcome. Zero comprehension, just maths with an answer and the shuffling of variables to make the output match a desired state.

    Fundamentally, am I wrong? I have no understanding of AI and have done no work in the field but this seems pretty simple.

  11. #11
    Senior Member
    Join Date
    Dec 2013
    Posts
    3,526
    Thanks
    504
    Thanked
    468 times in 326 posts

    Re: DeepMind AI agents surpass humans in Quake III Arena CTF

    ^^That's^^ basically sums up what grinds my gears with 'AI'. What everyone is calling 'AI' is not much more than a collection of pattern matching algorithms and weighting, just maths with an answer and the shuffling of variables to make the output match a desired state.

    Maybe I'm being overly harsh but to me intelligence is the ability to acquire and apply knowledge and skills to something you've never done before, we can teach a pigeon to peck at a flashing light but IMO that doesn't make it intelligent, it just means that through trial and error its learnt that pecking the light means food.

  12. #12
    root Member DanceswithUnix's Avatar
    Join Date
    Jan 2006
    Location
    In the middle of a core dump
    Posts
    13,010
    Thanks
    781
    Thanked
    1,568 times in 1,325 posts
    • DanceswithUnix's system
      • Motherboard:
      • Asus X470-PRO
      • CPU:
      • 5900X
      • Memory:
      • 32GB 3200MHz ECC
      • Storage:
      • 2TB Linux, 2TB Games (Win 10)
      • Graphics card(s):
      • Asus Strix RX Vega 56
      • PSU:
      • 650W Corsair TX
      • Case:
      • Antec 300
      • Operating System:
      • Fedora 39 + Win 10 Pro 64 (yuk)
      • Monitor(s):
      • Benq XL2730Z 1440p + Iiyama 27" 1440p
      • Internet:
      • Zen 900Mb/900Mb (CityFibre FttP)

    Re: DeepMind AI agents surpass humans in Quake III Arena CTF

    Quote Originally Posted by Corky34 View Post
    Maybe I'm being overly harsh but to me intelligence is the ability to acquire and apply knowledge and skills to something you've never done before, we can teach a pigeon to peck at a flashing light but IMO that doesn't make it intelligent, it just means that through trial and error its learnt that pecking the light means food.
    That is general intelligence, and certainly no-one knows how to make computers do that (yet).

    What we have here is something more like "flying by the seat of your pants" muscle memory. It is useful in itself, and the techniques involved will no doubt evolve at some point into creating the feedback for a general intelligence network.

    So yes, I think you are being a bit harsh. If all the AI out there stopped working, I think you would be shocked at how much we depend on it. For starters, you wouldn't be able to Google what was going on...

  13. #13
    Senior Member
    Join Date
    Dec 2013
    Posts
    3,526
    Thanks
    504
    Thanked
    468 times in 326 posts

    Re: DeepMind AI agents surpass humans in Quake III Arena CTF

    Don't get me wrong, I'm not saying these programs are not useful and probably very sophisticated, i agree with your sentiment that we depend on them, what i take exception at is calling it artificial intelligence when in my mind it's nothing of the sorts, as i said we can train a pigeon to do simple tasks but i think it's safe to say we wouldn't consider that intelligence, but when a computer (with the aid of programers) puts together what are in essence lots of pigeons pecking things we call it intelligent.

  14. #14
    Missed by us all - RIP old boy spacein_vader's Avatar
    Join Date
    Sep 2014
    Location
    Darkest Northamptonshire
    Posts
    2,015
    Thanks
    184
    Thanked
    1,086 times in 410 posts
    • spacein_vader's system
      • Motherboard:
      • MSI B450 Tomahawk Max
      • CPU:
      • Ryzen 5 3600
      • Memory:
      • 2x8GB Patriot Steel DDR4 3600mhz
      • Storage:
      • 1tb Sabrent Rocket NVMe (boot), 500GB Crucial MX100, 1TB Crucial MX200
      • Graphics card(s):
      • Gigabyte Radeon RX5700 Gaming OC
      • PSU:
      • Corsair HX 520W modular
      • Case:
      • Fractal Design Meshify C
      • Operating System:
      • Windows 10 Pro
      • Monitor(s):
      • BenQ GW2765, Dell Ultrasharp U2412
      • Internet:
      • Zen Internet

    Re: DeepMind AI agents surpass humans in Quake III Arena CTF

    Quote Originally Posted by Corky34 View Post
    Don't get me wrong, I'm not saying these programs are not useful and probably very sophisticated, i agree with your sentiment that we depend on them, what i take exception at is calling it artificial intelligence when in my mind it's nothing of the sorts, as i said we can train a pigeon to do simple tasks but i think it's safe to say we wouldn't consider that intelligence, but when a computer (with the aid of programers) puts together what are in essence lots of pigeons pecking things we call it intelligent.
    It used to be called machine learning, I can only assume marketing got involved and thought AI sounded sexier.

  15. Received thanks from:

    Corky34 (06-07-2018)

  16. #15
    Senior Member
    Join Date
    Dec 2003
    Location
    Taichung City
    Posts
    898
    Thanks
    281
    Thanked
    172 times in 121 posts
    • mtyson's system
      • Motherboard:
      • Gigabyte GA-B85M-HD3
      • CPU:
      • Intel Core i7 4790T
      • Memory:
      • 12GB
      • Storage:
      • Sandisk 128GB SSD + Kingston 500GB SSD + NAS etc
      • Graphics card(s):
      • Sapphire Radeon RX 580 Nitro+
      • PSU:
      • Corsair 430W
      • Case:
      • Zalman Z9 Plus
      • Operating System:
      • Windows 10
      • Monitor(s):
      • AOC 31.5-inch VA QHD monitor
      • Internet:
      • 100MB Virgin fibre

    Re: DeepMind AI agents surpass humans in Quake III Arena CTF

    On the topic of AI:

    Blue Yonder, 06.07.18 – Retail artificial intelligence (AI) specialist Blue Yonder has turned the attention of its powerful AI solution to predict the results for the remaining games of the World Cup 2018. The AI powered algorithm, developed using techniques honed at CERN, puts England on course for a win on Saturday’s match against Sweden, though only gives the team a 9.8% chance of taking home the ultimate prize.

    Commenting on the predictions, Christian Haag, Data Science Consultant at Blue Yonder, said: To arrive at the predictions, Blue Yonder’s powerful AI solution analysed every international football match played since 1872 (approximately 38,000 matches) running over 1 million simulations of the World Cup. From this, Blue Yonder has identified Brazil as the overall winner, though it is set to be a tight race between the remaining countries.

    Blue Yonder’s latest predictions for the winner of the Fifa World Cup 2018 are as follows:

    Brazil – 29.8%
    France – 15.3%
    Russia – 11.5%
    Belgium – 10.1%
    England – 9.8%
    Uruguay – 8.8%
    Croatia – 7.6%
    Sweden – 7.1%

  17. #16
    root Member DanceswithUnix's Avatar
    Join Date
    Jan 2006
    Location
    In the middle of a core dump
    Posts
    13,010
    Thanks
    781
    Thanked
    1,568 times in 1,325 posts
    • DanceswithUnix's system
      • Motherboard:
      • Asus X470-PRO
      • CPU:
      • 5900X
      • Memory:
      • 32GB 3200MHz ECC
      • Storage:
      • 2TB Linux, 2TB Games (Win 10)
      • Graphics card(s):
      • Asus Strix RX Vega 56
      • PSU:
      • 650W Corsair TX
      • Case:
      • Antec 300
      • Operating System:
      • Fedora 39 + Win 10 Pro 64 (yuk)
      • Monitor(s):
      • Benq XL2730Z 1440p + Iiyama 27" 1440p
      • Internet:
      • Zen 900Mb/900Mb (CityFibre FttP)

    Re: DeepMind AI agents surpass humans in Quake III Arena CTF

    Quote Originally Posted by spacein_vader View Post
    It used to be called machine learning, I can only assume marketing got involved and thought AI sounded sexier.
    I've only seen the name AI used for machine learning with neural nets and generally with deep learning, which are currently very trendy. There are lots of other machine learning techniques out there, so calling it ML would be overly broad. I can't see you ever getting a Bayesian spam filter to play Quake.

Page 1 of 2 12 LastLast

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •