Matt Nadareski
a7f97cc419
More 0-byte file shennanigans
2016-05-06 12:56:02 -07:00
Matt Nadareski
ced41c5cde
Add skip on nodump
2016-05-06 10:59:05 -07:00
Matt Nadareski
53cfcd19ed
Fix "-" crc, md5, and sha1 hashes
2016-05-06 10:53:42 -07:00
Matt Nadareski
411115083d
Make merging more robust
2016-05-03 23:59:32 -07:00
Matt Nadareski
51dbb6cf8f
[doc] update comment
2016-05-02 15:30:39 -07:00
Matt Nadareski
dcf5aa7071
Forgot the other Parse
2016-05-02 14:08:50 -07:00
Matt Nadareski
690d17f9b5
Take care of hex-hashes
2016-05-02 14:02:43 -07:00
Matt Nadareski
842ab5f39d
Reduce the number of steps
2016-04-29 11:49:23 -07:00
Matt Nadareski
586488296b
Forgot to add fix from DB iteration of code
2016-04-28 17:13:16 -07:00
Matt Nadareski
e9a9ddad6a
Make keys more selective
2016-04-28 16:41:23 -07:00
Matt Nadareski
0897f39c52
Mono doesn't like a missing DTD
2016-04-28 13:04:32 -07:00
Matt Nadareski
fa519036ad
Remove all traces of the outdated DB merge/import
2016-04-28 12:43:56 -07:00
Matt Nadareski
ae2b8fd44d
Add more code for dictionary based merging
2016-04-28 11:31:35 -07:00
Matt Nadareski
a202dc3dbb
More changes to enable Dictionary merging
2016-04-28 11:06:27 -07:00
Matt Nadareski
8aea894aed
Fix non-deduped merging in DB-based version
2016-04-28 10:40:45 -07:00
Matt Nadareski
6d67512258
Add dictionary-based Parse for future use
2016-04-28 10:37:33 -07:00
Matt Nadareski
ed193d1f1e
Remove commented code
2016-04-27 21:53:54 -07:00
Matt Nadareski
a6536fd65e
Fix some finicky XML DATs and how the name is read
2016-04-27 21:27:41 -07:00
Matt Nadareski
820097a2ec
Rename since this is a permanent method now
2016-04-27 20:57:05 -07:00
Matt Nadareski
18369e89df
More code changes to accustom diff and AB
2016-04-27 16:57:03 -07:00
Matt Nadareski
0d22715fa4
Remove unnecessary switch
2016-04-27 11:54:27 -07:00
Matt Nadareski
40b7d64303
Fix standard merging; dedupe still broken
2016-04-27 11:44:14 -07:00
Matt Nadareski
e450eebfd7
Stage 2 changes for using in-mem database
...
This change makes it mostly functional, having a way to both parse and merge in one step and output from the database. The issue is that the output from Parse2 doesn't match Parse OR Parse + Merge. Duplicates don't seem to be added in the first case and there are a differing number of roms in the second.
2016-04-27 01:10:24 -07:00
Matt Nadareski
bce1cc5839
Add stage 1 changes for better merging
...
The new merging process is both parse and merge in one step using an in-memory database. The next steps are to get the data in this database and write it out properly.
2016-04-27 00:53:15 -07:00
Matt Nadareski
f8ed865eaa
Replace Parse with mature second iteration
...
This code for parsing needed to be changed because of large file handling. XmlTextReader ended up being the best solution that doesn't crash at 500 MB in. A side effect of this change is that the code for processing a given DAT is very minimal now. The entire sub-block for SL-specific DAT info doesn't need to exist anymore. Small-scale tests have given 1:1 results with previous versions but further testing is needed for large files to make sure no data is lost.
2016-04-25 01:59:09 -07:00
Matt Nadareski
994a03826f
Add version 1 of XmlTextReader-based parsing
...
This is currently borken for reasons that I don't 100% understand. It needs to be tested further with a basic DAT to see why it doesn't seem to get every ROM.
2016-04-25 00:30:50 -07:00
Matt Nadareski
77b1512bff
[doc] add notes for future work
2016-04-25 00:27:27 -07:00
Matt Nadareski
55733f1ec9
Add retrieval of XmlTextReader
2016-04-25 00:26:19 -07:00
Matt Nadareski
7301cd3ba4
Add lazy evaluation of XML status
2016-04-25 00:25:08 -07:00
Matt Nadareski
755b5abf25
No need to parse the file first; add outofmemory error
2016-04-23 01:00:31 -07:00
Matt Nadareski
fdf6047f21
Minor logging and fixes
2016-04-23 00:29:48 -07:00
Matt Nadareski
2655aa12da
Separate to see where issue is coming from
2016-04-22 16:12:31 -07:00
Matt Nadareski
7f1ce9e3bc
Add more catches
2016-04-22 15:59:32 -07:00
Matt Nadareski
2d5bf0145b
Add "AB" mode
...
Basically, this will output the information that's in each DAT but not in the merged and also the data that's only in every DAT. This needs testing, but it's a good start.
2016-04-22 13:51:37 -07:00
Matt Nadareski
f2985b40cc
Fix outputted DAT information
2016-04-21 14:35:11 -07:00
Matt Nadareski
d9e298373c
Found a case of size being dash
2016-04-21 00:14:11 -07:00
Matt Nadareski
1c4d7dab2c
RV is not old-style CMP is
2016-04-20 21:55:28 -07:00
Matt Nadareski
ac575438a1
Slight code consolodation
2016-04-20 15:37:49 -07:00
Matt Nadareski
f82152e0a6
Add DAT name prefixing
2016-04-20 15:30:56 -07:00
Matt Nadareski
6ceac909da
Build a working DiffDat generator
2016-04-19 16:39:17 -07:00
Matt Nadareski
b02e7bbce1
Get diff of two rom sets
2016-04-19 15:41:06 -07:00
Matt Nadareski
037da6f20a
Actually, same here.
2016-04-19 14:45:52 -07:00
Matt Nadareski
bb8db07c9c
Maybe this can error out?
2016-04-19 14:45:35 -07:00
Matt Nadareski
5360744482
Make error more descriptive.
2016-04-19 13:35:38 -07:00
Matt Nadareski
788bf2d794
Extensions are confusing
2016-04-19 13:11:11 -07:00
Matt Nadareski
269ff4a2bd
I missed two auto-replaced variables
2016-04-19 12:26:24 -07:00
Matt Nadareski
fa488aa434
..wasn't actually adding the roms
2016-04-19 10:38:01 -07:00
Matt Nadareski
14d229bc1d
Use centralized DAT parsing and manipulate data after
...
Though the change doesn't reflect this, RomManipulation is a renamed Sorting with an addtional method, Parse.
2016-04-19 01:11:23 -07:00
