mirror of
https://github.com/huggingface/xet-core.git
synced 2026-06-04 13:30:29 +08:00
removing async_scoped dep and creating new parallel util to replace tokio_par_for_each that relied on async_scoped. Any usage of tokio_par_for_each which is the only fn used out of parutils has been replaced with the new `tokio_run_max_concurrency_fold_result_with_semaphore` TODO: - [x] add more tests - [x] use semaphore acquired from the global semaphore provider where/if relevant.