Notes 002

Koke_Cacao-LookingOutwards03

(LookingOutwards-03)

The Current Team made a strange and unpleasant video using 3D reconstructions. It uses badly made 3D models to address the issue of consumerism which is clever.

Other Great Artworks:

Koke_Cacao-Pix2Pix

(05-Pix2Pix)

I have played this model years ago. The model tries very hard to fit both low-level pattern and border structure to the input data, which creates funny-looking images. But the model is only good at interpreting thin lines, with equal stroke weight and without color.

Koke_Cacao-ArtBreeder

(05-ArtBreeder) ArtBreeder ProsePainter

The art breeder model is very cool. It magically preserves the lower-level pattern of oil paintings with relatively high resolution. This quality is often, at least to me, hard to achieve and requires a lot of hyperparameter tuning and GPU power. The fact that it can run on the browser this fast is amazing (is it running on a browser though? Or does it use backend GPU with querying?). Also, it is very rare to have a user interface that allows both breeding and gene-editing. I wonder if "breeding" means parameter breeding rather than pixel-wise breeding.

Koke_Cacao-TextSynthesis

(05-TextSynthesis)

inferkit narrative-device

Using: Narrative Device Themes: coding, homework Result: The teacher looked up from his computer screen and saw that his student had not yet arrived. "I'm going to have to start grading your homework," he said, "but I want to make sure you are doing it right." Comment: This has nothing to do with coding homework. The model interpret coding as teacher's computer screen. The result might by highly "plagiarized" from a story book.

Using: inferkit Result:

The teacher looked up from his computer screen and saw that his student had not yet arrived. "I'm going to have to start grading your homework," he said, "but I want to make sure you are doing it right."

The student sighed, rolled his eyes, and said, "There's no point.

This is the ninth grade.

You'll do whatever I say and there's nothing I can do about it. "He sat down, and opened his book.

His teacher put his name in the "Now On and shook his head.

"I get to do this each and every night. Why can't you do it during the day?"

"Well," the teacher said, "when I set my alarm clock for noon, my friend buys me coffee.

I set it back to 5: 30 and I'm still awake.

It's got to be midnight by the time you go to bed.

There's no point in going to sleep."

The student sighed and closed his book.

Comment: The model only seem to pay attention to previous 2 sentences and major characters. Although attention (to characters) is all you need, but it is hard for the model to generate a global level theme of the text that is consistent and relevent.

Koke_Cacao-VQGAN+CLIP

(05-VQGAN+CLIP)

Using: wikiart_16384 + ViT-B/32 + default paremeter Prompt: A student suffering from his coding homework

The image quality is not very good as other synthesizers based on image inputs (compared to models related to style transfer) since the natural language processing pipeline restricted the latent space or because they are not trained end-to-end. The style of the images generated can get very cliche very soon and the tool doesn't give the artists very much control over the generated image.