Creating Stunning Fonts with Salt Crystals and Machine Learning

Creating Stunning Fonts with Salt Crystals and Machine Learning

Table of Contents

1. Introduction
2. Background
3. The Idea Behind the Project
4. Experimenting with Different Materials
   • Growing Crystals with Borax and Food Coloring
   • Using Wire and Pipe Cleaners
   • Heating Letters on the Stove
   • Creating Modular Letter Pieces
   • Using Wood Letters
5. Converting Physical Letters into Digital Format
6. Training Models with Existing Digital Fonts
7. Using Code Repositories and Open-Source Tools
8. Installing Font Forge and Overcoming Challenges
9. Designing and Refining the Fonts
10. Creating Variable Fonts and Alternate Characters
11. Using Defy Font to Synthesize Glyphs
12. Implementing Whisper API for Speech-to-Text
13. Cost Optimization of API Usage
14. Setting Up the Gradux Exhibition
15. Designing Posters for the Exhibition
16. Overcoming Challenges with Display and Technology
17. User Interaction and Feedback at Gradux
18. Conclusion

The Story Behind the Crystal Tape Font Project

The Crystal Tape font project was born out of the author's interest in the intersection of data science, typography, and style transfer. The idea of designing a few characters and then applying that style to an entire set of glyphs intrigued them. The project involved growing crystals and inputting physical letters into a machine learning model to Create unique and visually appealing fonts.

Introduction

Typography has always played a crucial role in design and communication. The Crystal Tape font project, developed as part of the author's graduation project at OCAD University, explores the possibilities of combining data science and typography to create innovative fonts. This article delves into the Journey behind the project, from the initial idea to the final exhibition at Gradux.

Background

The author's background in the Digital Futures program at OCAD University provided them with a strong foundation in the intersection of art, design, and technology. They had been researching applications of data science in typography, particularly focusing on style transfer for fonts. This research and Curiosity became the driving force behind the Crystal Tape font project.

The Idea Behind the Project

The Core idea of the Crystal Tape font project was to create fonts using crystals and machine learning. The author was inspired by the concept of designing a few characters and then leveraging a machine learning model to synthesize the entire alphabet. They aimed to explore the potential of applying style transfer algorithms to fonts.

Experimenting with Different Materials

To start the project, the author experimented with different materials to create the physical letters that would serve as the basis for their fonts. They explored various techniques, including growing crystals with Borax and food coloring, using wire and pipe cleaners, heating letters on the stove, creating modular letter pieces, and even using pre-made wooden letters.

Growing Crystals with Borax and Food Coloring

One of the initial experiments involved growing salt crystals with Borax and food coloring to form letter shapes. The author made letters with wire and pipe cleaners, which were then hung inside Glass cups. After pouring hot Water into the cups, they patiently waited for the crystals to grow.

Using Wire and Pipe Cleaners

In another approach, the author used wire and pipe cleaners to craft the letters, which were then displayed in a glass bowl. This method provided a different aesthetic and allowed for more freedom in shaping the letters.

Heating Letters on the Stove

To explore the impact of temperature on the crystal formation, the author decided to place the wire and pipe cleaner letters on a stove. They wanted to see if the heat would affect the growth and appearance of the crystals. This experiment yielded intriguing results, adding another layer of complexity to the project.

Creating Modular Letter Pieces

Inspired by the idea of letters as modular pieces, the author experimented with different shapes, such as circles and lines, that could be digitally arranged to form complete letters. This approach allowed for flexibility in creating unique and visually striking fonts.

Using Wood Letters

As the project progressed, the author opted for convenience and simplicity by using pre-made wooden letters. They placed the wooden letters in a bowl and covered them, allowing crystals to grow overnight. Surprisingly, the vectorized wood letters created less complex paths that worked better with the thick font.

Converting Physical Letters into Digital Format

Once the physical letters were created, the next step was to convert them into a digital format. The author took photos of each letter, cleaned them up in Photoshop, and traced them in Illustrator. They then imported the letters into Glyphs, a font design software, where they fine-tuned the typography by adjusting the kerning and adding alternate characters.

Training Models with Existing Digital Fonts

To enhance the project's capabilities, the author decided to train the models using existing digital fonts as a starting point. They sourced code repositories and open-source tools that allowed them to utilize pre-trained models to synthesize glyphs Based on the few characters they designed. One of the most successful models they encountered was the Effect Font, which provided impressive results by synthesizing a full alphabet from minimal input.

Using Code Repositories and Open-Source Tools

The process of setting up the code repositories and getting them to run smoothly on the author's computer required perseverance and trial and error. After multiple attempts, they successfully ran the test command using provided test data, which generated the desired letters. However, to incorporate their own data, they had to install Font Forge, which posed challenges initially. They had to resort to using Linux instead of their Mac, but eventually, they overcame the hurdles and made progress.

Installing Font Forge and Overcoming Challenges

Installing Font Forge, a font editing software, proved to be a challenge for the author, especially on their Mac. They encountered difficulties that required switching to Linux as an alternative operating system. With Linux, they were able to install Font Forge successfully, enabling them to work on their own data and fonts.

Designing and Refining the Fonts

Once the fonts were in a digital format, the author focused on refining their design. They addressed issues such as spacing inconsistencies, overly distracting characters, and letter forms that disrupted reading flow. By making adjustments in Glyphs, they optimized the fonts by fixing kerning, adding alternate characters, and increasing the overall weight. They transformed the fonts into variable fonts, allowing flexibility in weight adjustments.

Creating Variable Fonts and Alternate Characters

In their Quest for creative typography, the author explored the concept of variable fonts. By altering the weight settings of the fonts, they created a dynamic range from 100 to 400, providing various visual possibilities. Furthermore, they included alternate characters for certain letters that stood out too prominently or disrupted readability. This added layer of customization enhanced the overall aesthetic of the fonts.

Using Defy Font to Synthesize Glyphs

To synthesize the glyphs and generate visually Cohesive fonts, the author utilized Defy Font, a tool that accepts input glyphs and produces corresponding output glyphs based on machine learning algorithms. They trained Defy Font with their own letter designs and inputted them into the system to generate the desired output. The resulting glyphs showcased the unique characteristics and style transfer capabilities of the Crystal Tape font.

Implementing Whisper API for Speech-to-Text

To enhance user interaction with the Crystal Tape font, the author decided to incorporate speech-to-text functionality. They discovered the Whisper API, which provided real-time speech-to-text conversion. However, implementing the API posed challenges, as most existing examples required sending recorded audio to the API. To achieve real-time functionality, the author utilized a React hook specifically designed for Whisper.

Cost Optimization of API Usage

As the author delved deeper into the implementation of the Whisper API, they realized the potential cost implications of continuous API usage. The per-minute pricing structure meant that even short testing Sessions could quickly accumulate expenses. After careful assessment and consideration, the author optimized their usage by implementing a loop that recorded audio for short durations, reducing API usage costs significantly.

Setting Up the Gradux Exhibition

Gradux, the culminating exhibition for graduating students at OCAD, provided the author with an opportunity to showcase their Crystal Tape font project. As part of the exhibition setup, the author faced challenges regarding the display space. They had envisioned a white wall as a backdrop but discovered it was made of glass. This prompted them to adapt their plans and cover the glass wall with tablet-sized posters.

Designing Posters for the Exhibition

With the need for new posters to cover the glass wall, the author delved into the creative process of designing visually captivating and informative posters. They utilized screenshots, images, typographic details, and quotes collected during the project to create an engaging layout. Each poster featured different elements of the Crystal Tape font project, showcasing the progression and various aspects of the project.

Overcoming Challenges with Display and Technology

During the exhibition setup, the author encountered unexpected obstacles with the display and technology. The initial plan to use a Chrome stick to connect to the display proved ineffective for interactive elements. Troubleshooting the issues in real-time became impractical due to time constraints. To overcome the challenge, they switched to a laptop connected to the display, concealing it within a custom-made box for a seamless and professional appearance.

User Interaction and Feedback at Gradux

The Gradux exhibition provided an opportunity for users to Interact with the Crystal Tape font project. The author opted for a microphone instead of a traditional keyboard interface, allowing users to speak into the microphone and Visualize their words on the screen. Users found joy in experimenting with different sounds and languages, showcasing the unexpected and playful nature of the project. The author also received valuable feedback and observed user reactions throughout the exhibition.

Conclusion

The Crystal Tape font project at Gradux showcased the author's innovative exploration of typography, machine learning, and data science. The journey involved experimenting with materials, converting physical letters into digital format, training machine learning models, refining fonts, and implementing speech-to-text functionality. The project successfully merged the physical and digital worlds, offering an engaging and creative experience for users and observers alike.

Highlights

• The Crystal Tape font project combined typography, data science, and machine learning to create unique fonts.
• The author experimented with various materials to craft physical letters, including growing crystals and heating wire letters.
• Converting physical letters into a digital format required a combination of photography, image editing, and font design software.
• Training machine learning models with existing digital fonts allowed the author to synthesize complete alphabets from a few input characters.
• Overcoming challenges with code repositories, open-source tools, and the installation of Font Forge required perseverance and problem-solving.
• Refining the fonts involved adjusting spacing, fixing kerning, and adding alternate characters for improved readability and customization.
• The Crystal Tape font project utilized Defy Font to generate synthesized glyphs based on the author's designs and input.
• Incorporating the Whisper API for speech-to-text functionality enhanced user interaction with the fonts.
• The author optimized their API usage to minimize costs, implementing a loop for short recording intervals.
• Setting up the Gradux exhibition presented challenges with display space and necessitated the design and arrangement of informative posters.
• User interaction and feedback at Gradux showcased the playful and unexpected nature of the Crystal Tape font project.