Is there a way to create a custom dictionary? #33

Closed
opened 2026-01-29 20:29:28 +00:00 by claunia · 6 comments
Owner

Originally created by @DiThi on GitHub (Sep 23, 2015).

Most files of our project have data that is not text, but delta-encoded floats and shorts, and I think it would greatly benefit from creating a dictionary with the most common strings.

Related #165

Originally created by @DiThi on GitHub (Sep 23, 2015). Most files of our project have data that is not text, but delta-encoded floats and shorts, and I think it would greatly benefit from creating a dictionary with the most common strings. Related #165
Author
Owner

@wizzard0 commented on GitHub (Sep 23, 2015):

👍

@wizzard0 commented on GitHub (Sep 23, 2015): :+1:
Author
Owner

@eustas commented on GitHub (Sep 24, 2015):

Use BrotliCompressWithCustomDictionary / BrotliSetCustomDictionary API

@eustas commented on GitHub (Sep 24, 2015): Use BrotliCompressWithCustomDictionary / BrotliSetCustomDictionary API
Author
Owner

@DiThi commented on GitHub (Sep 24, 2015):

@eustas Thanks!

Though, I can't find any documentation or examples. Can the custom dictionary be anything? Is it enough to concatenate a bunch of common data together?

@DiThi commented on GitHub (Sep 24, 2015): @eustas Thanks! Though, I can't find any documentation or examples. Can the custom dictionary be anything? Is it enough to concatenate a bunch of common data together?
Author
Owner

@eustas commented on GitHub (Sep 24, 2015):

Custom dictionary could contain any data. Like with any LZ codec it is used as an initial window data.
Though I could recommend not to place short pattern last few bytes of custom dictionary, because it may be the "blind" zone of encoder.

@eustas commented on GitHub (Sep 24, 2015): Custom dictionary could contain any data. Like with any LZ codec it is used as an initial window data. Though I could recommend not to place short pattern last few bytes of custom dictionary, because it may be the "blind" zone of encoder.
Author
Owner

@yangxiaomin08 commented on GitHub (May 19, 2016):

Asking the same question, is there any tool that could help to generate custom dictionary for specified domain?

@yangxiaomin08 commented on GitHub (May 19, 2016): Asking the same question, is there any tool that could help to generate custom dictionary for specified domain?
Author
Owner

@eustas commented on GitHub (May 20, 2016):

You could try this: https://github.com/vkrasnov/dictator

@eustas commented on GitHub (May 20, 2016): You could try this: https://github.com/vkrasnov/dictator
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: starred/brotli#33