{"id":24151,"date":"2023-08-09T12:46:59","date_gmt":"2023-08-09T11:46:59","guid":{"rendered":"https:\/\/www.vtei.cz\/?p=24151"},"modified":"2024-08-19T19:38:59","modified_gmt":"2024-08-19T18:38:59","slug":"graphical-use-of-ai","status":"publish","type":"post","link":"https:\/\/www.vtei.cz\/en\/2023\/08\/graphical-use-of-ai\/","title":{"rendered":"Graphical use of AI"},"content":{"rendered":"

In the June VTEI issue, we got familiar with the AI tool ChatGPT in the form of\u00a0an \u201cinterview\u201d. We continue with the topic of artificial intelligence and this time we present experiences with a more \u201cvisual\u201d tool. Our intention was to create different visualizations of the situation using text input, the so-called \u201cprompt\u201d, or from a master photo, for example a watercourse restoration or the idea of building a water tower in the countryside. But before we get to the visualizations themselves, let us say a few words about this topic.<\/span><\/p>\n

There are several AI tools that allow users to generate desired images based on text inputs, called prompts. These tools use advanced machine learning technologies and generative models and can create realistic images based on\u00a0the description provided by the user. Such tools include, for example, DALL-E from the OpenAI company and MidJourney from David Holz\u2019s American company of\u00a0the same name. These tools have the potential to be used for various applications, including the creation of visual content, visual design, or even the\u00a0design of new products.<\/span><\/p>\n

For our purposes, we chose MidJourney, a service for generating graphics using artificial intelligence. The tool launched in the middle of 2022, and users create graphics using commands given to a chatbot in the Discord app.<\/span><\/p>\n

MidJourney\u2019s function is to recognize the relationship between images and text, where a machine learning algorithm is trained on a large number of\u00a0images with text descriptions. If the user enters a request\/prompt in the chat window, artificial intelligence will allow the creation of an image that matches the description.<\/span><\/p>\n

We tested the functioning\/usage of the MidJourney AI tool on four examples.<\/span><\/p>\n

Design for the Jezerka stream restoration<\/h3>\n

In this case, the basis was the image of the visualization of the restoration\u00a0of\u00a0the\u00a0inflow into a reservoir with a bridge and wetland vegetation published in this year\u2019s April VTEI issue [1]. The entire process of generating the\u00a0result took place in the following order \u2013 uploading a real photo of the park before the restoration (Fig. 1a<\/span><\/em>), generating a bridge over the stream (only about 20th prompt with a satisfactory result, Fig. 1b<\/span><\/em>), connecting both outputs (Fig. 1c<\/span><\/em> ), and fine-tuning the resulting image (Fig. 1d<\/span><\/em>). The time required for this process was approximately three hours.<\/span><\/p>\n

\"\"<\/a><\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
\"\"<\/a><\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
\"\"<\/a><\/h6>\n
\"\"<\/a><\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
Fig. 1a, b, c, d. The Jezerka stream, the situation of the groundwater drainage outlet as an occasional inflow into the water reservoir (Photo: T. Hrdinka, subsequent editing with\u00a0the MidJourney tool)<\/h6>\n

Water tower<\/h3>\n

In another case, our intention was to depict the construction of a water tower. Here, too, the source was a picture from an article on water towers published in\u00a0VTEI 6\/2022 (Fig. 2a<\/span><\/em>) [2]. The following written prompt was used: \u201ca tall concrete\u00a0<\/span><\/span>tower with a metal dome of the tower, featured on cg society, danube school, arial shot, watertank, germany, low pressure system, awe \u2013 inspiring award \u2013 winning, waterdrops, manufactured in the 1920s, aquiline features, parks and monuments, brenizer method –v 5\u201d<\/span><\/span> which then drew a preview image of the four variants (Fig.\u00a02b<\/span><\/em>). Individual variants can then be created separately at a higher resolution. The time required for the process was about ten minutes.<\/span><\/p>\n\"\"<\/a>\n

<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
\"\"<\/a><\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
Fig. 2a, b. Tower reservoir in Kol\u00edn designed by architect Franti\u0161ek Janda in\u00a0the\u00a0functionalist style (Photo: O. Civ\u00edn, subsequent editing with the MidJourney tool)<\/h6>\n

Aquatic animal<\/h3>\n

We tested the creativity and capabilities of the MidJourney AI tool on the creation of depictions of living organisms. Using text input, we let the tool draw a crayfish (Fig. 3a<\/span><\/em>). It turns out that the Midjourney tool generates crayfish with difficulty \u2013 adding the wrong anatomy to them. Compiling the prompt required about 10 attempts. Example of a failed prompt:<\/span><\/p>\n

\u201eA captivating, hyper-realistic underwater photograph of a crayfish with two antennae, gracefully navigating the crystal-clear waters of a mountain creek, showcasing the intricate details and beauty of this fascinating aquatic creature. This stunning image is skillfully captured using a Nikon D850 DSLR camera, equipped with a NIKKOR AF-S 105mm f\/2.8G IF-ED VR Micro lens, renowned for its exceptional sharpness and ability to render vivid, lifelike colors, even in challenging underwater environments. The camera settings are meticulously chosen to highlight the delicate features of the crayfish and the serene ambiance of its habitat, with an aperture of f\/11, ISO 800, and a shutter speed of 1\/125 sec. The\u00a0composition is taken from a close perspective, immersing the viewer in the aquatic world of\u00a0the\u00a0crayfish as it scuttles among the rocks and submerged plants that line the creek bed. The scene is softly illuminated by natural sunlight filtering through the water\u2019s surface, casting shimmering patterns that dance across the crayfish\u2019s intricate exoskeleton and the surrounding environment. This awe-inspiring, high-resolution photograph transports viewers beneath the surface of the mountain creek, offering a rare and privileged glimpse into the\u00a0secret underwater realm of the crayfish. –ar 4:3 –q 2 –v 5.\u201c<\/span><\/span><\/p>\n

\"\"<\/a><\/span><\/p>\n

\u00a0<\/span><\/h6>\n
Fig. 3a. The result of the \u201ccrayfish\u201d entry \u2013 the first MidJourney attempts<\/h6>\n

After this \u201cfailure\u201d, a simple prompt was eventually used: \u201cA crayfish, captivating, hyper-realistic photograph –ar 4:3 –q 2 –v 5<\/span>\u201d. By comparing the first, extensive assignment and the final form, it clearly demonstrates the saying that sometimes less means more :-) (Figs. 3b, c<\/span><\/em>). The time required for the process was approximately one hour.<\/span><\/p>\n

\"\"<\/a><\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
\"\"<\/a><\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
Figs. 3b, c. The final result of entering \u201ccrayfish\u201d with the MidJourney tool<\/h6>\n

TGM WRI building<\/h3>\n

The last example on which we tested the AI capabilities was the task of visualizing the building of TGM WRI Prague headquarters, not only in real form (Figs.\u00a04a,\u00a0b<\/span><\/em>), but also in \u201cLego\u201d form (Figs. 4c, d<\/span><\/em>). The template was a photo of\u00a0the\u00a0TGM WRI building, which was uploaded to the AI tool with the \u201cimage to text\u201d command. Some of the elements from the \u201cimage to text\u201d description were used and supplemented with a description of lighting, photographic and artistic styles, and colours. The resulting prompt \u201ca large red and white brick building, in the style of agfa vista, dark bronze and blue, vray, school of london, computer-aided manufacturing, dark brown and navy, lively and energetic — ar 31:22 — v 5\u201d <\/span>then produced the following result.<\/span><\/p>\n

\"\"<\/a><\/span><\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
Fig. 4a. TGM WRI building (Photo: TGM WRI archive)<\/h6>\n\"\"<\/a>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
Fig. 4b. TGM WRI (visualization using the MidJourney tool)<\/h6>\n
\"\"<\/a><\/h6>\n
\"\"<\/a><\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
<\/h6>\n
Figs. 4c, d. TGM WRI building in Lego style \u2013 preview image of variants and visualization using the MidJourney tool<\/h6>\n

Creating the TGM WRI building from Lego bricks required modifying the\u00a0prompt to the following form: \u201ca large red and white brick building, in\u00a0the\u00a0style of agfa vista, dark bronze and blue, vray, school of london, computer-aided manufacturing, dark brown and navy, lively and energetic, as lego. –ar 31:22 –v 5\u201d<\/span>. The\u00a0result was the generation of a preview image (Fig. 4c<\/span><\/em>). Individual variants can then be created separately at a higher resolution (Fig. 4d<\/span><\/em>). The time required for the process was about 15 minutes.<\/span><\/p>\n

Conclusion<\/h3>\n

The MidJourney tool can generate some really nice images, even a bit kitschy in\u00a0some cases. However, the problem turned out to be that the artificial intelligence does not know what exactly is in the photo. Although it recognizes objects (you tell it to), it cannot assess whether the created image is in accordance with our perceived reality. An example can be the visualization of the font (in our case, the name of our institution on the facade of the building generated by the tool), when the AI tool is not yet able to take the font\/signs as parameters from queries. However, Stable Diffusion can already deal with texts.<\/span><\/p>\n

Due to the relatively dynamic development in the field of artificial intelligence, the functionality and quality of the output in AI applications are constantly changing. For example, the current version of MidJourney already generates very realistic high-resolution images with many details compared to previous versions. On the other hand, there is no detailed documentation of the model on which MidJourney runs, so the resulting graphical outputs vary depending on the form of the prompt that users \u201cfine-tune\u201d based on their experience with the tool, and thus, by \u201creverse engineering\u201d, they discover possibilities and hidden model settings. To create such a prompt, other AIs are widely used in the form of web applications, which allow the creation of a prompt \u201ctailored\u201d to the desired idea of\u00a0the\u00a0output. For this purpose, e.g. ChatGPT will also serve very well.<\/span><\/p>\n

In particular, MidJourney now has not only the function of creating images, but can also describe others in text after inserting them into the tool and offer its own version. Several image inputs can also be mixed in it and the result is then a\u00a0composite. It also has numerous choices of styles in which it generates graphics (from imitations of the styles of various artists to animated and anime outputs to\u00a0photorealistic graphics, e.g. in a fantasy environment). It also allows you to vary the outputs offered almost arbitrarily.<\/span><\/p>\n

It should be noted that the use of this tool is currently charged and requires registration and login via the Discord service.<\/span><\/p>\n

This informative article has not been peer-reviewed.<\/p>\n","protected":false},"excerpt":{"rendered":"

In the June VTEI issue, we got familiar with the AI tool ChatGPT in the form of an \u201cinterview\u201d. We continue with the topic of artificial intelligence and this time we present experiences with a more \u201cvisual\u201d tool. Our intention was to create different visualizations of the situation using text input, the so-called \u201cprompt\u201d, or from a master photo, for example a watercourse restoration or the idea of building a water tower in the country-side. But before we get to the visualizations themselves, let us say a few words about this topic.<\/p>\n","protected":false},"author":8,"featured_media":23795,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[88],"tags":[3163,3167,3213,3220,2528,3221],"coauthors":[1742,3148],"class_list":["post-24151","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-informatics-cartography-in-water-management","tag-ai","tag-artificial-intelligence","tag-design","tag-pictures","tag-raci","tag-tower-reservoir"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.vtei.cz\/en\/wp-json\/wp\/v2\/posts\/24151","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.vtei.cz\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.vtei.cz\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.vtei.cz\/en\/wp-json\/wp\/v2\/users\/8"}],"replies":[{"embeddable":true,"href":"https:\/\/www.vtei.cz\/en\/wp-json\/wp\/v2\/comments?post=24151"}],"version-history":[{"count":9,"href":"https:\/\/www.vtei.cz\/en\/wp-json\/wp\/v2\/posts\/24151\/revisions"}],"predecessor-version":[{"id":32111,"href":"https:\/\/www.vtei.cz\/en\/wp-json\/wp\/v2\/posts\/24151\/revisions\/32111"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.vtei.cz\/en\/wp-json\/wp\/v2\/media\/23795"}],"wp:attachment":[{"href":"https:\/\/www.vtei.cz\/en\/wp-json\/wp\/v2\/media?parent=24151"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.vtei.cz\/en\/wp-json\/wp\/v2\/categories?post=24151"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.vtei.cz\/en\/wp-json\/wp\/v2\/tags?post=24151"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.vtei.cz\/en\/wp-json\/wp\/v2\/coauthors?post=24151"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}