[BUG] CEA-708 hangs forever if character set is specified on rust builds #835

Closed
opened 2026-01-29 16:54:43 +00:00 by claunia · 2 comments
Owner

Originally created by @hrideshmg on GitHub (Apr 29, 2025).

Can be verified by running this sample using the following arguments: --service 1[EUC-KR].

It works as expected on a build of ccextractor built -without-rust but hangs forever otherwise. This is currently causing the sample platform tests to abort from a timeout as evidenced by this run taking more than 3 hours:

[INFO] Starting with entry 10 of 14
[WARN] Aborting CCExtractor, maximum time elapsed.
[ERROR] Path is empty
[INFO] Finished entry 10 with exit code: -1
[INFO] Starting with entry 11 of 14
[WARN] Aborting CCExtractor, maximum time elapsed.
[ERROR] Path is empty
[INFO] Finished entry 11 with exit code: -1
[INFO] Starting with entry 12 of 14
[ERROR] Path is empty
[INFO] Finished entry 12 with exit code: 0
[INFO] Starting with entry 13 of 14
[WARN] Aborting CCExtractor, maximum time elapsed.
[ERROR] Path is empty
[INFO] Finished entry 13 with exit code: -1
[INFO] Starting with entry 14 of 14
[ERROR] Path is empty
[INFO] Finished entry 14 with exit code: 0
[INFO] Runtime: 03:21:00.9565500
Originally created by @hrideshmg on GitHub (Apr 29, 2025). Can be verified by running this [sample](https://sampleplatform.ccextractor.org/sample/b5d6aad89f768674175fedf577b6df66a22f572f732d8a760c8e57b5b504829e) using the following arguments: `--service 1[EUC-KR]`. It works as expected on a build of ccextractor built `-without-rust` but hangs forever otherwise. This is currently causing the sample platform tests to abort from a timeout as evidenced by this [run](https://sampleplatform.ccextractor.org/test/5668) taking more than 3 hours: ``` [INFO] Starting with entry 10 of 14 [WARN] Aborting CCExtractor, maximum time elapsed. [ERROR] Path is empty [INFO] Finished entry 10 with exit code: -1 [INFO] Starting with entry 11 of 14 [WARN] Aborting CCExtractor, maximum time elapsed. [ERROR] Path is empty [INFO] Finished entry 11 with exit code: -1 [INFO] Starting with entry 12 of 14 [ERROR] Path is empty [INFO] Finished entry 12 with exit code: 0 [INFO] Starting with entry 13 of 14 [WARN] Aborting CCExtractor, maximum time elapsed. [ERROR] Path is empty [INFO] Finished entry 13 with exit code: -1 [INFO] Starting with entry 14 of 14 [ERROR] Path is empty [INFO] Finished entry 14 with exit code: 0 [INFO] Runtime: 03:21:00.9565500 ```
Author
Owner

@hrideshmg commented on GitHub (May 1, 2025):

I've managed to debug this issue after messing around with gdb a bit, it seems to be caused by the iconv crate (which is currently unmaintained) being broken on the latest version of rust, see this issue.

I've managed to fix it by swapping out the iconv crate for encoding_rs (which appears to be the most popular and well maintained option) in this PR.

Note that the rust implementation for this particular case was and still is buggy, regression tests 142, 147 and 149 all of which test this specific scenario have historically had empty output files (see here for eg), which is why the tests were passing. The C builds however, produce the proper outputs.

@hrideshmg commented on GitHub (May 1, 2025): I've managed to debug this issue after messing around with gdb a bit, it seems to be caused by the iconv [crate](https://github.com/andelf/rust-iconv) (which is currently unmaintained) being broken on the latest version of rust, see this [issue](https://github.com/andelf/rust-iconv/issues/10). I've managed to fix it by swapping out the iconv crate for encoding_rs (which appears to be the most popular and well maintained option) in this [PR](https://github.com/CCExtractor/ccextractor/pull/1698). Note that the rust implementation for this particular case was and still is buggy, regression tests 142, 147 and 149 all of which test this specific scenario have historically had empty output files (see [here](https://sampleplatform.ccextractor.org/regression/test/142/view) for eg), which is why the tests were passing. The C builds however, produce the proper outputs.
Author
Owner

@rboy1 commented on GitHub (Aug 4, 2025):

@canihavesomecoffee any chance we get a new release of ccextractor, been almost 5 years :)
Also is it possible to update the build instructions to cross compile the windows build using ubuntu ? TIA

@rboy1 commented on GitHub (Aug 4, 2025): @canihavesomecoffee any chance we get a new release of ccextractor, been almost 5 years :) Also is it possible to update the build instructions to cross compile the windows build using ubuntu ? TIA
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: starred/ccextractor#835