huggingface
Initialization for core Hugging Face modules and definition of supported Transformers for use with the SGT.
Modules:
| Name | Description |
|---|---|
data |
Initialization for core Hugging Face data. |
generation |
A module for the management of generation configs for Stained Glass. |
tensor_parallel |
Utilities for tensor parallelism with Hugging Face models. |
tokenization_utils |
Initialization for Hugging Face tokenization utilities. |