Out of Memory after DiscImageCreator finishes #304

Closed
opened 2026-01-29 16:13:56 +00:00 by claunia · 1 comment
Owner

Originally created by @Feathered-Serpent on GitHub (Jun 11, 2021).

Originally assigned to: @mnadareski on GitHub.

Version
What version are you using?

  • Stable release (version here)
  • WIP release (x86, AnsiBuild, 20210603T221334)

Build
What runtime version are you using?

  • .NET Framework 4.7.2 running on (Operating System)
  • .NET Framework 4.8 running on (Windows 10 Pro 20H2)
  • .NET Core 3.1 running on (Operating System)

Describe the issue
The Witcher Enhanced Edition has two Audio CDs and a DVD delivered as bonus in the case. Upon trying to backup the first Audio CD I get the following error after DiscImageCreator finishes and MPF should ask me for the disc information:

System.OutOfMemoryException: Eine Ausnahme vom Typ "System.OutOfMemoryException" wurde ausgelöst.
   bei System.String.Join(String separator, String[] value, Int32 startIndex, Int32 count)
   bei System.String.Join(String separator, String[] value)
   bei MPF.Data.BaseParameters.GetFullFile(String filename, Boolean binary) in C:\projects\mpf\MPF.Library\Data\BaseParameters.cs:Zeile 304.
   bei MPF.DiscImageCreator.Parameters.GenerateSubmissionInfo(SubmissionInfo info, String basePath, Drive drive, Boolean includeArtifacts) in C:\projects\mpf\MPF.Library\DiscImageCreator\Parameters.cs:Zeile 749.
   bei MPF.Data.DumpEnvironment.<ExtractOutputInformation>d__45.MoveNext() in C:\projects\mpf\MPF.Library\Data\DumpEnvironment.cs:Zeile 606.
--- Ende der Stapelüberwachung vom vorhergehenden Ort, an dem die Ausnahme ausgelöst wurde ---
   bei System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   bei System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   bei System.Runtime.CompilerServices.TaskAwaiter`1.GetResult()
   bei MPF.Data.DumpEnvironment.<VerifyAndSaveDumpOutput>d__41.MoveNext() in C:\projects\mpf\MPF.Library\Data\DumpEnvironment.cs:Zeile 424.
--- Ende der Stapelüberwachung vom vorhergehenden Ort, an dem die Ausnahme ausgelöst wurde ---
   bei System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   bei System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   bei System.Runtime.CompilerServices.TaskAwaiter`1.GetResult()
   bei MPF.Windows.MainWindow.<StartDumping>d__49.MoveNext() in C:\projects\mpf\MPF\Windows\MainWindow.xaml.cs:Zeile 788.

I assume it is because the disc produces a LOT of Subchannel errors. After DiscImageCreator ends, the following files (with sizes) are in the export directory:

 Verzeichnis von G:\ISO\Audio CD

11.06.2021  19:54    <DIR>          .
11.06.2021  19:54    <DIR>          ..
11.06.2021  19:54        48.150.144 Audio CD (Track 01).bin
11.06.2021  19:54        23.143.680 Audio CD (Track 02).bin
11.06.2021  19:54        56.727.888 Audio CD (Track 03).bin
11.06.2021  19:54        12.409.152 Audio CD (Track 04).bin
11.06.2021  19:54        85.377.600 Audio CD (Track 05).bin
11.06.2021  19:54        13.164.144 Audio CD (Track 06).bin
11.06.2021  19:54        13.262.928 Audio CD (Track 07).bin
11.06.2021  19:54        14.954.016 Audio CD (Track 08).bin
11.06.2021  19:54        72.702.672 Audio CD (Track 09).bin
11.06.2021  19:54        16.007.712 Audio CD (Track 10).bin
11.06.2021  19:54        10.099.488 Audio CD (Track 11).bin
11.06.2021  19:54        54.684.000 Audio CD (Track 12).bin
11.06.2021  19:54        55.177.920 Audio CD (Track 13).bin
11.06.2021  19:54         8.657.712 Audio CD (Track 14).bin
11.06.2021  19:54        41.221.152 Audio CD (Track 15).bin
11.06.2021  19:54        12.042.240 Audio CD (Track 16).bin
11.06.2021  19:54        15.633.744 Audio CD (Track 17).bin
11.06.2021  19:54        13.406.400 Audio CD (Track 18).bin
11.06.2021  19:54        12.075.168 Audio CD (Track 19).bin
11.06.2021  19:54        16.268.784 Audio CD (Track 20).bin
11.06.2021  19:54        20.438.880 Audio CD (Track 21).bin
11.06.2021  19:54         4.339.440 Audio CD (Track 22).bin
11.06.2021  19:54        15.125.712 Audio CD (Track 23).bin
11.06.2021  19:54        74.932.368 Audio CD (Track 24).bin
11.06.2021  19:54         6.971.328 Audio CD (Track 25).bin
11.06.2021  19:54        15.579.648 Audio CD (Track 26).bin
11.06.2021  19:54        18.761.904 Audio CD (Track 27).bin
11.06.2021  19:54        16.405.200 Audio CD (Track 28).bin
11.06.2021  19:54        19.429.872 Audio CD (Track 29).bin
11.06.2021  19:54        98.393.862 Audio CD.c2
11.06.2021  19:54             7.328 Audio CD.ccd
11.06.2021  19:54             3.974 Audio CD.cue
11.06.2021  19:54             5.277 Audio CD.dat
11.06.2021  19:54       787.150.896 Audio CD.img
11.06.2021  19:54        32.128.608 Audio CD.sub
11.06.2021  19:47               102 Audio CD_20210603T221334.txt
11.06.2021  19:54                14 Audio CD_c2Error.txt
11.06.2021  19:54            26.520 Audio CD_disc.txt
11.06.2021  19:47            12.455 Audio CD_drive.txt
11.06.2021  19:54             2.871 Audio CD_img.cue
11.06.2021  19:47                 0 Audio CD_mainError.txt
11.06.2021  19:48           791.291 Audio CD_mainInfo.txt
11.06.2021  19:54     1.367.626.837 Audio CD_subError.txt
11.06.2021  19:54            16.996 Audio CD_subInfo.txt
11.06.2021  19:54        55.830.097 Audio CD_subReadable.txt
11.06.2021  19:47                 0 Audio CD_volDesc.txt
              46 Datei(en),  3.129.148.024 Bytes
               2 Verzeichnis(se), 153.926.082.560 Bytes frei

As you can see, the file is larger than 1 GB. This happens with two different Plextor drives (W4012TA and PX-W5224TA) as well as with Asus BW-16D1HT. The file size of the file is different on each drive, though only barely. The disc has been cleaned carefully.
The MPF.exe uses up to 3.2 GB of RAM during the step "Extracting output information from output files..."

To Reproduce
One would have to backup the audio CD from The Witcher Enhanced Edition

Expected behavior
MPF shouldn't crash I guess? Is there a 64 Bit version?

Additional context
I know that Audio CDs are usually not submitted anyway, yet this one belongs to the game, same with another Audio CD and even a DVD with content from the producers.
But maybe that error might come at some point else from someone else at a different game at some point. So I think it's worth submitting.

If I make a duplicate file search, the image file itself is always identical aka every single one of the 29 bin files is identical from all three drives and so is the scm and img file.

Only those files stay in the Plextor rips if I remove the duplicate files:

Audio CD.sub
Audio CD_disc.txt
Audio CD_drive.txt
Audio CD_mainInfo.txt
Audio CD_subError.txt
Audio CD_subReadable.txt

(I could provide those files if necessary)
So it seems, the image itself is fine, I guess? The second Audio CD produces a Audio CD_subError file with 81 KB in size.

Originally created by @Feathered-Serpent on GitHub (Jun 11, 2021). Originally assigned to: @mnadareski on GitHub. **Version** What version are you using? - [ ] Stable release (version here) - [X] WIP release (x86, AnsiBuild, 20210603T221334) **Build** What runtime version are you using? - [ ] .NET Framework 4.7.2 running on (Operating System) - [X] .NET Framework 4.8 running on (Windows 10 Pro 20H2) - [ ] .NET Core 3.1 running on (Operating System) **Describe the issue** The Witcher Enhanced Edition has two Audio CDs and a DVD delivered as bonus in the case. Upon trying to backup the first Audio CD I get the following error after DiscImageCreator finishes and MPF should ask me for the disc information: ``` System.OutOfMemoryException: Eine Ausnahme vom Typ "System.OutOfMemoryException" wurde ausgelöst. bei System.String.Join(String separator, String[] value, Int32 startIndex, Int32 count) bei System.String.Join(String separator, String[] value) bei MPF.Data.BaseParameters.GetFullFile(String filename, Boolean binary) in C:\projects\mpf\MPF.Library\Data\BaseParameters.cs:Zeile 304. bei MPF.DiscImageCreator.Parameters.GenerateSubmissionInfo(SubmissionInfo info, String basePath, Drive drive, Boolean includeArtifacts) in C:\projects\mpf\MPF.Library\DiscImageCreator\Parameters.cs:Zeile 749. bei MPF.Data.DumpEnvironment.<ExtractOutputInformation>d__45.MoveNext() in C:\projects\mpf\MPF.Library\Data\DumpEnvironment.cs:Zeile 606. --- Ende der Stapelüberwachung vom vorhergehenden Ort, an dem die Ausnahme ausgelöst wurde --- bei System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task) bei System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) bei System.Runtime.CompilerServices.TaskAwaiter`1.GetResult() bei MPF.Data.DumpEnvironment.<VerifyAndSaveDumpOutput>d__41.MoveNext() in C:\projects\mpf\MPF.Library\Data\DumpEnvironment.cs:Zeile 424. --- Ende der Stapelüberwachung vom vorhergehenden Ort, an dem die Ausnahme ausgelöst wurde --- bei System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task) bei System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) bei System.Runtime.CompilerServices.TaskAwaiter`1.GetResult() bei MPF.Windows.MainWindow.<StartDumping>d__49.MoveNext() in C:\projects\mpf\MPF\Windows\MainWindow.xaml.cs:Zeile 788. ``` I assume it is because the disc produces a LOT of Subchannel errors. After DiscImageCreator ends, the following files (with sizes) are in the export directory: ``` Verzeichnis von G:\ISO\Audio CD 11.06.2021 19:54 <DIR> . 11.06.2021 19:54 <DIR> .. 11.06.2021 19:54 48.150.144 Audio CD (Track 01).bin 11.06.2021 19:54 23.143.680 Audio CD (Track 02).bin 11.06.2021 19:54 56.727.888 Audio CD (Track 03).bin 11.06.2021 19:54 12.409.152 Audio CD (Track 04).bin 11.06.2021 19:54 85.377.600 Audio CD (Track 05).bin 11.06.2021 19:54 13.164.144 Audio CD (Track 06).bin 11.06.2021 19:54 13.262.928 Audio CD (Track 07).bin 11.06.2021 19:54 14.954.016 Audio CD (Track 08).bin 11.06.2021 19:54 72.702.672 Audio CD (Track 09).bin 11.06.2021 19:54 16.007.712 Audio CD (Track 10).bin 11.06.2021 19:54 10.099.488 Audio CD (Track 11).bin 11.06.2021 19:54 54.684.000 Audio CD (Track 12).bin 11.06.2021 19:54 55.177.920 Audio CD (Track 13).bin 11.06.2021 19:54 8.657.712 Audio CD (Track 14).bin 11.06.2021 19:54 41.221.152 Audio CD (Track 15).bin 11.06.2021 19:54 12.042.240 Audio CD (Track 16).bin 11.06.2021 19:54 15.633.744 Audio CD (Track 17).bin 11.06.2021 19:54 13.406.400 Audio CD (Track 18).bin 11.06.2021 19:54 12.075.168 Audio CD (Track 19).bin 11.06.2021 19:54 16.268.784 Audio CD (Track 20).bin 11.06.2021 19:54 20.438.880 Audio CD (Track 21).bin 11.06.2021 19:54 4.339.440 Audio CD (Track 22).bin 11.06.2021 19:54 15.125.712 Audio CD (Track 23).bin 11.06.2021 19:54 74.932.368 Audio CD (Track 24).bin 11.06.2021 19:54 6.971.328 Audio CD (Track 25).bin 11.06.2021 19:54 15.579.648 Audio CD (Track 26).bin 11.06.2021 19:54 18.761.904 Audio CD (Track 27).bin 11.06.2021 19:54 16.405.200 Audio CD (Track 28).bin 11.06.2021 19:54 19.429.872 Audio CD (Track 29).bin 11.06.2021 19:54 98.393.862 Audio CD.c2 11.06.2021 19:54 7.328 Audio CD.ccd 11.06.2021 19:54 3.974 Audio CD.cue 11.06.2021 19:54 5.277 Audio CD.dat 11.06.2021 19:54 787.150.896 Audio CD.img 11.06.2021 19:54 32.128.608 Audio CD.sub 11.06.2021 19:47 102 Audio CD_20210603T221334.txt 11.06.2021 19:54 14 Audio CD_c2Error.txt 11.06.2021 19:54 26.520 Audio CD_disc.txt 11.06.2021 19:47 12.455 Audio CD_drive.txt 11.06.2021 19:54 2.871 Audio CD_img.cue 11.06.2021 19:47 0 Audio CD_mainError.txt 11.06.2021 19:48 791.291 Audio CD_mainInfo.txt 11.06.2021 19:54 1.367.626.837 Audio CD_subError.txt 11.06.2021 19:54 16.996 Audio CD_subInfo.txt 11.06.2021 19:54 55.830.097 Audio CD_subReadable.txt 11.06.2021 19:47 0 Audio CD_volDesc.txt 46 Datei(en), 3.129.148.024 Bytes 2 Verzeichnis(se), 153.926.082.560 Bytes frei ``` As you can see, the file is larger than 1 GB. This happens with two different Plextor drives (W4012TA and PX-W5224TA) as well as with Asus BW-16D1HT. The file size of the file is different on each drive, though only barely. The disc has been cleaned carefully. The MPF.exe uses up to 3.2 GB of RAM during the step "Extracting output information from output files..." **To Reproduce** One would have to backup the audio CD from The Witcher Enhanced Edition **Expected behavior** MPF shouldn't crash I guess? Is there a 64 Bit version? **Additional context** I know that Audio CDs are usually not submitted anyway, yet this one belongs to the game, same with another Audio CD and even a DVD with content from the producers. But maybe that error might come at some point else from someone else at a different game at some point. So I think it's worth submitting. If I make a duplicate file search, the image file itself is always identical aka every single one of the 29 bin files is identical from all three drives and so is the scm and img file. Only those files stay in the Plextor rips if I remove the duplicate files: ``` Audio CD.sub Audio CD_disc.txt Audio CD_drive.txt Audio CD_mainInfo.txt Audio CD_subError.txt Audio CD_subReadable.txt ``` (I could provide those files if necessary) So it seems, the image itself is fine, I guess? The second Audio CD produces a Audio CD_subError file with 81 KB in size.
claunia added the bug label 2026-01-29 16:13:56 +00:00
Author
Owner

@mnadareski commented on GitHub (Jun 19, 2021):

Turns out, that absolutely massive file was the issue when it does the artifact serialization. Note to self: make artifact serialization a separate option to fix this.

@mnadareski commented on GitHub (Jun 19, 2021): Turns out, that absolutely massive file was the issue when it does the artifact serialization. Note to self: make artifact serialization a separate option to fix this.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: SabreTools/MPF#304