2022-01-22

"Cyber Fish" is a project done by a Chinese artist who goes by the name "Contra." It is a collection of AI-generated cyberpunk fish.

Evolution of Cyber Fish

Evolution of Cyber Fish

This Blog is an explanation on how the images are generated, but it is very hard to understand if the reader does not have AI-background. It uses analogy of cooking fish to explain data processing.

Raw data from biodiversitylibrary.org

Raw data from biodiversitylibrary.org

After downloading data from biodiversitylibrary.org, the artist first use image processing techniques to clean up the background.

After cleaning up background

After cleaning up background

Here is a video output.

It is unclear to me how the video was generated. I guess he first trained a GAN generating fish from latent space. And then do a walk on latent space using genetic algorithm based on pixel-wise error.

But this video made me rethink my original guess.

The artist then applied the same algorithm on many different dataset, got different results. But he didn't cite where the data was coming from.

Submarine dataset from unknown source

Submarine dataset from unknown source

Cyberpunk dataset from unknown source

Cyberpunk dataset from unknown source

Squid dataset from unknown source

Squid dataset from unknown source

Steampunk dataset from unknown source

Steampunk dataset from unknown source

Guns dataset from unknown source

Guns dataset from unknown source

And I found an image that I don't know whether it is the original dataset or from the artist

And I found an image that I don't know whether it is the original dataset or from the artist

It looks like after genetic algorithm, the artist tried style transform to get the following results: But it is unclear which algorithm are used.

Cyberpunk dataset style transform

Cyberpunk dataset style transform

The artist had many tries on the algorithm

The artist had many tries on the algorithm

From the images themself, I can tell that they are generated by CNNs due to some texture quality. This seems to be resolved with higher processing power from the graphics card with the later generations of the fish. This let me think instead of end-to-end generation, would it be better to have the network generate the model and render it though traditional computer graphics. This way, pixel quality could be ensured.

From those artwork and failures, I see a general theme and interest from the artist. The game cyberpunk 2077 and the collection Bored Ape Yacht Club was mentioned in his documentation. And therefore I suspect those influence this collection.

Documentations From Artist:

The artist also tried to sell those artwork on Opensea.

CyberFish on Opensea

CyberFish on Opensea

Table of Content