mirror of https://github.com/huggingface/xet-core.git synced 2026-06-04 13:30:29 +08:00

Files

Hoyt Koepke 0d9f78aaf4 Add README.md files and Cargo.toml updates needed for publishing hf-xet (#773 )

This PR adds crates.io-facing metadata (homepage, readme, keywords,
categories) for the publishable crates, along with crate README files
and concise crate-level docs so crates.io and docs.rs pages have better
context.

2026-04-03 12:34:47 -07:00

1.4 KiB

Raw Blame History

hf-xet

Client library for the Hugging Face Xet data storage system. Provides the high-level session API for uploading and downloading files with chunk-based deduplication.

Overview

XetSession — Top-level session managing authentication, configuration, and concurrent file transfers
Upload & download — Stream files to/from Hugging Face Hub with automatic chunking, deduplication, and local caching

Crate Ecosystem

hf-xet ties together the lower-level xet-core crates:

Crate	Role
`xet-runtime`	Async runtime, config, logging
`xet-core-structures`	Merkle hashes, shards, Xorb objects
`xet-client`	HTTP client for CAS and Hub APIs
`xet-data`	Chunking, dedup, file reconstruction

This crate is part of xet-core, the Rust backend for huggingface_hub.

License

Apache-2.0

1.4 KiB Raw Blame History

hf-xet

Overview

Crate Ecosystem

License

1.4 KiB

Raw Blame History