Results 1 to 13 of 13

Thread: Google Brain fills in the details of very lo-res images

  1. #1
    HEXUS.admin
    Join Date
    Apr 2005
    Posts
    31,709
    Thanks
    0
    Thanked
    2,073 times in 719 posts

    Google Brain fills in the details of very lo-res images

    CSI style unpixelating system uses neural net and learned conditioning to clear things up.
    Read more.

  2. #2
    Now 100% Apple free cheesemp's Avatar
    Join Date
    Apr 2007
    Location
    Near the New forest
    Posts
    2,931
    Thanks
    351
    Thanked
    243 times in 167 posts
    • cheesemp's system
      • Motherboard:
      • ASUS TUF x570-plus
      • CPU:
      • Ryzen 3600
      • Memory:
      • 16gb Corsair RGB ram
      • Storage:
      • 256Gb NVMe + 500Gb TcSunbow SDD (cheap for games only)
      • Graphics card(s):
      • RX 480 8Gb Nitro+ OC (with auto OC to above 580 speeds!)
      • PSU:
      • Cooler Master MWE 750 bronze
      • Case:
      • Gamemax f15m
      • Operating System:
      • Win 11
      • Monitor(s):
      • 32" QHD AOC Q3279VWF
      • Internet:
      • FTTC ~35Mb

    Re: Google Brain fills in the details of very lo-res images

    So the CSI 'computer enhance' meme is starting to come true? That something I never expected. Wonder if this will help with crimes - You couldn't use it as evidence but could help with suspect wanted mug shots...
    Trust

    Laptop : Dell Inspiron 1545 with Ryzen 5500u, 16gb and 256 NVMe, Windows 11.

  3. #3
    Senior Member
    Join Date
    Jun 2013
    Posts
    344
    Thanks
    54
    Thanked
    22 times in 19 posts

    Re: Google Brain fills in the details of very lo-res images

    Quote Originally Posted by cheesemp View Post
    So the CSI 'computer enhance' meme is starting to come true? That something I never expected. Wonder if this will help with crimes - You couldn't use it as evidence but could help with suspect wanted mug shots...
    No. It creates very "Hollywood" faces because it's creating believable composites from overlapping images in a database that match the angle. If the person looked like the image, it would be chance (and a relatively low chance, given that your average Joe/Jo is not photogenic).

    In the same way, look at the images with involve windows. It's smart enough to track subtle gradation of light from right to left across an image, pick up a frame shape, and decide that this thing on the right is: a light source; a gentle enough light source to be a window; a size and shape consistent with a window. But in one of Google's shots, the window is a skylight cut into the slanting roof of an attic room. To replace the window, the software has to insert a composite window-ish element, and it has vertical frames like the ones in its database.

  4. #4
    root Member DanceswithUnix's Avatar
    Join Date
    Jan 2006
    Location
    In the middle of a core dump
    Posts
    12,609
    Thanks
    741
    Thanked
    1,480 times in 1,248 posts
    • DanceswithUnix's system
      • Motherboard:
      • Asus X470-PRO
      • CPU:
      • 3700X
      • Memory:
      • 32GB 3200MHz ECC
      • Storage:
      • 1TB Linux, 2TB Games (Win 10)
      • Graphics card(s):
      • Asus Strix RX Vega 56
      • PSU:
      • 650W Corsair TX
      • Case:
      • Antec 300
      • Operating System:
      • Fedora 35 + Win 10 Pro 64 (yuk)
      • Monitor(s):
      • Benq XL2730Z 1440p + Iiyama 27" 1440p
      • Internet:
      • Zen 80Mb/20Mb VDSL

    Re: Google Brain fills in the details of very lo-res images

    Quote Originally Posted by cheesemp View Post
    So the CSI 'computer enhance' meme is starting to come true? That something I never expected. Wonder if this will help with crimes - You couldn't use it as evidence but could help with suspect wanted mug shots...
    No, the information in the fuzzed out images is gone and cannot ever be restored. This tech could make for a cracking TV upscaler, but not evidence.

    The network was trained with images of celebs. Given a fuzzed input, it hallucinates a celeb based on the input. Given a picture of me, it would hallucinate the closest celeb like face it could.

    I look forward to TVs having a de-pixellation mode to make tamed tv footage rude again, it would work very well for that

  5. #5
    Senior Member
    Join Date
    Jul 2009
    Location
    West Sussex
    Posts
    1,690
    Thanks
    183
    Thanked
    235 times in 216 posts
    • kompukare's system
      • Motherboard:
      • Asus P8Z77-V LX
      • CPU:
      • Intel i5-3570K
      • Memory:
      • 4 x 8GB DDR3
      • Storage:
      • Samsung 850 EVo 500GB | Corsair MP510 960GB | 2 x WD 4TB spinners
      • Graphics card(s):
      • Sappihre R7 260X 1GB (sic)
      • PSU:
      • Antec 650 Gold TruePower (Seasonic)
      • Case:
      • Aerocool DS 200 (silenced, 53.6 litres)l)
      • Operating System:
      • Windows 10-64
      • Monitor(s):
      • 2 x ViewSonic 27" 1440p

    Re: Google Brain fills in the details of very lo-res images

    Quote Originally Posted by DanceswithUnix View Post
    The network was trained with images of celebs. Given a fuzzed input, it hallucinates a celeb based on the input. Given a picture of me, it would hallucinate the closest celeb like face it could.
    So cameo appearances are going to soar and celebs themselves will begin to wonder if they had accidentally wandered on the set of some film without knowing it?

  6. #6
    Now 100% Apple free cheesemp's Avatar
    Join Date
    Apr 2007
    Location
    Near the New forest
    Posts
    2,931
    Thanks
    351
    Thanked
    243 times in 167 posts
    • cheesemp's system
      • Motherboard:
      • ASUS TUF x570-plus
      • CPU:
      • Ryzen 3600
      • Memory:
      • 16gb Corsair RGB ram
      • Storage:
      • 256Gb NVMe + 500Gb TcSunbow SDD (cheap for games only)
      • Graphics card(s):
      • RX 480 8Gb Nitro+ OC (with auto OC to above 580 speeds!)
      • PSU:
      • Cooler Master MWE 750 bronze
      • Case:
      • Gamemax f15m
      • Operating System:
      • Win 11
      • Monitor(s):
      • 32" QHD AOC Q3279VWF
      • Internet:
      • FTTC ~35Mb

    Re: Google Brain fills in the details of very lo-res images

    Quote Originally Posted by DanceswithUnix View Post
    No, the information in the fuzzed out images is gone and cannot ever be restored. This tech could make for a cracking TV upscaler, but not evidence.

    The network was trained with images of celebs. Given a fuzzed input, it hallucinates a celeb based on the input. Given a picture of me, it would hallucinate the closest celeb like face it could.

    I look forward to TVs having a de-pixellation mode to make tamed tv footage rude again, it would work very well for that
    Um - Thats why I stated not for evidence but for mug shots. Sure it might be just a very generic face in the future but its better than some useless CCTV police often show now when try to find a wanted person.

    Edit: Also don't forget this is version 1 of this tech. I'm sure it will improve to support more generic faces.
    Trust

    Laptop : Dell Inspiron 1545 with Ryzen 5500u, 16gb and 256 NVMe, Windows 11.

  7. #7
    Senior Member
    Join Date
    Sep 2014
    Posts
    278
    Thanks
    0
    Thanked
    27 times in 18 posts

    Re: Google Brain fills in the details of very lo-res images

    The starting image was a bowl of fruit.

  8. Received thanks from:

    DanceswithUnix (09-02-2017)

  9. #8
    root Member DanceswithUnix's Avatar
    Join Date
    Jan 2006
    Location
    In the middle of a core dump
    Posts
    12,609
    Thanks
    741
    Thanked
    1,480 times in 1,248 posts
    • DanceswithUnix's system
      • Motherboard:
      • Asus X470-PRO
      • CPU:
      • 3700X
      • Memory:
      • 32GB 3200MHz ECC
      • Storage:
      • 1TB Linux, 2TB Games (Win 10)
      • Graphics card(s):
      • Asus Strix RX Vega 56
      • PSU:
      • 650W Corsair TX
      • Case:
      • Antec 300
      • Operating System:
      • Fedora 35 + Win 10 Pro 64 (yuk)
      • Monitor(s):
      • Benq XL2730Z 1440p + Iiyama 27" 1440p
      • Internet:
      • Zen 80Mb/20Mb VDSL

    Re: Google Brain fills in the details of very lo-res images

    Quote Originally Posted by cheesemp View Post
    Edit: Also don't forget this is version 1 of this tech. I'm sure it will improve to support more generic faces.
    The information is gone, all the neural net can do is fill in the gaps with generic features best guessed from colour matching the blobs. Give it a heavily pixellated bowl of fruit, and it would get out the best face it could match.

    Don't think of this as image processing, think of it as an interpretive painting. The net sees the blobs and decides which brush strokes to use to make something that looks like a face and hair. It is clever, but it can only ever be an educated guess.

  10. #9
    . bledd's Avatar
    Join Date
    Jul 2003
    Posts
    1,886
    Thanks
    22
    Thanked
    135 times in 85 posts

    Re: Google Brain fills in the details of very lo-res images

    Is that Gavin Rossdale from Bush?

  11. #10
    Now 100% Apple free cheesemp's Avatar
    Join Date
    Apr 2007
    Location
    Near the New forest
    Posts
    2,931
    Thanks
    351
    Thanked
    243 times in 167 posts
    • cheesemp's system
      • Motherboard:
      • ASUS TUF x570-plus
      • CPU:
      • Ryzen 3600
      • Memory:
      • 16gb Corsair RGB ram
      • Storage:
      • 256Gb NVMe + 500Gb TcSunbow SDD (cheap for games only)
      • Graphics card(s):
      • RX 480 8Gb Nitro+ OC (with auto OC to above 580 speeds!)
      • PSU:
      • Cooler Master MWE 750 bronze
      • Case:
      • Gamemax f15m
      • Operating System:
      • Win 11
      • Monitor(s):
      • 32" QHD AOC Q3279VWF
      • Internet:
      • FTTC ~35Mb

    Re: Google Brain fills in the details of very lo-res images

    Quote Originally Posted by DanceswithUnix View Post
    The information is gone, all the neural net can do is fill in the gaps with generic features best guessed from colour matching the blobs. Give it a heavily pixellated bowl of fruit, and it would get out the best face it could match.

    Don't think of this as image processing, think of it as an interpretive painting. The net sees the blobs and decides which brush strokes to use to make something that looks like a face and hair. It is clever, but it can only ever be an educated guess.
    I understand what you are saying. I just trying to point out even if it is a closest match face it will be more helpful than a heavily pixelated picture narrowing down suspects. After all show someone the 8x8 pixel picture and they won't have a clue who it is. This might just help a human think 'that looks a little bit like John Smith and he has clothes like that' - I'm not saying it a miracle - just another tool similar to photofits.
    Trust

    Laptop : Dell Inspiron 1545 with Ryzen 5500u, 16gb and 256 NVMe, Windows 11.

  12. #11
    Admin (Ret'd)
    Join Date
    Jul 2003
    Posts
    18,481
    Thanks
    1,016
    Thanked
    3,208 times in 2,281 posts

    Re: Google Brain fills in the details of very lo-res images

    Quote Originally Posted by DanceswithUnix View Post
    ....

    I look forward to TVs having a de-pixellation mode to make tamed tv footage rude again, it would work very well for that
    Now that would, I suspect, reveal a very large ..... market.


  13. #12
    Le Adder Noir CK_1985's Avatar
    Join Date
    Apr 2008
    Posts
    587
    Thanks
    35
    Thanked
    29 times in 24 posts
    • CK_1985's system
      • Motherboard:
      • Gigabyte GA-H87N-WiFi mini-ITX
      • CPU:
      • i5-4670K
      • Memory:
      • 8GB Corsair Vengeance 1600MHz
      • Storage:
      • 500GB Samsung 850EVO
      • Graphics card(s):
      • GeForce GTX660ti
      • PSU:
      • Silverstone Strider 450W SFX
      • Case:
      • Silverstone Sugo SG-05
      • Operating System:
      • Windows 10 Pro
      • Monitor(s):
      • Dell U2414H
      • Internet:
      • BT Infinity Fibre

    Re: Google Brain fills in the details of very lo-res images

    This is realy interesting tech. I agree with the various comments about it creating very generic 'hollywood' faces, which is of limited use. However I an see benefits:

    1. The examples given are starting from an extreme (8x8) and so it's not surprising they're extremely generic. If you're talking about the CSI-type use case, it would be interesting to see how well it performs on a 16x16 image, or a 32x32 one... If it can take a slightly blurry picture and make it much less blurry that could be much more reliable.
    2. Even in the extreme examples given, you could still use it in a CSI-style use case. Obviously not for a conviction, but for producing a photofit-type image that could help you narrow the search. With enough development, you could even quantify something like 'there is a 90% certainty that this is a reasonable likeness' - which could definitely hav value. Even DNA evidence only gives you a certain % of certainty.
    "I want to be young and wild, then I want to be middle aged and rich, then I want to be old and annoy people by pretending that I'm deaf..."

    my Hexus.Trust

  14. #13
    Senior Member Xlucine's Avatar
    Join Date
    May 2014
    Posts
    2,151
    Thanks
    295
    Thanked
    186 times in 145 posts
    • Xlucine's system
      • Motherboard:
      • Asus TUF B450M-plus
      • CPU:
      • 3700X
      • Memory:
      • 16GB @ 3.2 Gt/s
      • Storage:
      • Crucial P5 1TB (boot), Crucial MX500 1TB, Crucial MX100 512GB
      • Graphics card(s):
      • EVGA 980ti
      • PSU:
      • Fractal Design ION+ 560P
      • Case:
      • Silverstone TJ08-E
      • Operating System:
      • W10 pro
      • Monitor(s):
      • Viewsonic vx3211-2k-mhd, Dell P2414H

    Re: Google Brain fills in the details of very lo-res images

    Look at the top row - the two photos look like very different people. Courts are terrible at evaluating probability, this will be taken to be infallible. Any tool using this approach will be biased to output the training data, if you use this in court it's guaranteeing a miscarriage of justice.

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •