Recommended sizes for input/output buffer + compressor/decompressor #326

New Issue

claunia · 2026-01-29T20:42:02Z

claunia commented

2026-01-29 20:42:02 +00:00

Originally created by @andrew-aladev on GitHub (Jul 2, 2020).

Hello. zstd has the following functions available:

size_t ZSTD_CStreamInSize(void);    /**< recommended size for input buffer */
size_t ZSTD_CStreamOutSize(void);   /**< recommended size for output buffer. Guarantee to successfully flush at least one complete compressed block. */

size_t ZSTD_DStreamInSize(void);    /*!< recommended size for input buffer */
size_t ZSTD_DStreamOutSize(void);   /*!< recommended size for output buffer. Guarantee to successfully flush at least one complete block in all circumstances. */

It will be good to have similar functions for brotli.

For now i am using 256/64 kb for compressor and 64/256 kb for decompressor.

Originally created by @andrew-aladev on GitHub (Jul 2, 2020). Hello. zstd has the [following functions](https://github.com/facebook/zstd/blob/dev/lib/zstd.h#L778-L779) available: ```c size_t ZSTD_CStreamInSize(void); /**< recommended size for input buffer */ size_t ZSTD_CStreamOutSize(void); /**< recommended size for output buffer. Guarantee to successfully flush at least one complete compressed block. */ size_t ZSTD_DStreamInSize(void); /*!< recommended size for input buffer */ size_t ZSTD_DStreamOutSize(void); /*!< recommended size for output buffer. Guarantee to successfully flush at least one complete block in all circumstances. */ ``` It will be good to have similar functions for brotli. For now i am using `256/64 kb` for compressor and `64/256 kb` for decompressor.

claunia closed this issue

2026-01-29 20:42:03 +00:00

claunia commented

2026-01-29 20:42:03 +00:00

@eustas commented on GitHub (Aug 3, 2023):

Both encoder and decoder are just fine with any input buffer, the bigger - the better.
As for output I recommend "zero-copy" API (*TakeOutput) it already uses optimal buffer internally.

@eustas commented on GitHub (Aug 3, 2023): Both encoder and decoder are just fine with any input buffer, the bigger - the better. As for output I recommend "zero-copy" API (`*TakeOutput`) it already uses optimal buffer internally.

claunia referenced this issue

2026-01-29 20:51:42 +00:00

[PR #332] [CLOSED] build: create an encoder and decoder library #929

claunia referenced this issue

2026-01-29 20:52:13 +00:00

[PR #421] [MERGED] Add support for CMake's BUILD_SHARED_LIBS option. #326 #1032

claunia referenced this issue

2026-01-29 20:52:14 +00:00

[PR #421] Add support for CMake's BUILD_SHARED_LIBS option. #326 #1037

claunia referenced this issue

2026-01-29 20:52:17 +00:00

[PR #437] [MERGED] Also install the brotli headers when building the shared libraries. #326 #1052