Posts

This article introduces the concept of learnable position encoding, its implementation methods, and its application in Transformer models. Learnable position encoding is a position embedding method that can be directly applied without training, featuring simple operations that are easy to understand.

This article introduces the study of memory management in Java and Go, using GC to achieve automatic memory management, which helps in gaining a deeper understanding of performance bottlenecks. GC is divided into three types: Serial GC, Parallel GC, and Concurrent GC, each with its own characteristics and applicable scenarios. GC strategies include Copying GC, Mark-sweep GC, and Mark-compact GC, each with its own advantages and disadvantages. Reference counting is one method for determining dead objects, but it has drawbacks such as thread safety issues and the inability to handle cyclic structures. Java memory management technology has evolved over multiple generations, adopting generational collection, which selects different cleanup strategies based on the lifespan of objects. Golang uses the tri-color marking method to track dead objects, using white, gray, and black to represent objects that can be reclaimed, are being examined, and cannot be reclaimed, respectively.

Java's thread safety is mainly reflected in three aspects: atomicity, visibility and orderliness. The thread safety of data can be ensured in three ways: transaction management, locking mechanism and version control.

Redis has handcrafted many underlying data structures that are better suited to Redis application scenarios, enhancing high performance and reducing storage consumption.

This article describes a compilation error encountered during development, namely `/usr/bin/ld: cannot find -lLLVM-13-rust-1.58.0-nightly`. The cause is that the path to this library was written into the `LD_LIBRARY_PATH` variable in the zshrc configuration file, preventing the compiler from locating it. By consulting relevant resources, the difference between `LIBRARY_PATH` and `LD_LIBRARY_PATH` was identified, along with their respective roles and effects on tools during compilation and runtime. Additionally, the article provides suggestions on how to use both variables simultaneously, as well as considerations regarding security issues, debugging problems, and persistent configuration when using them.