03-20-2017 09:57 AM
I have a logdata with parameteroptimizing, I get about 50 combinations in x-validation and therefore in my logdata as examples. Now, if I transform log into Example Set and inspect results at the end, everything is OK, there are 50 examples in the example set.. however, if I store the example set in the repository then, and retrieve it to inspect it, only a part of the examples have been stored!! Like sometimes 17, 19 or 27 examples... I donÄt know why.. I have enough disk space on my PC... thats very weird and especially bad if I want to reconstruct some graphs in the later from my results..
Did anybody encouter the same problem before?
03-20-2017 10:11 AM
I have not. Are you using any of the sorting in the Log operattion? Like Top K sorting? That might cause it skip the order of some examples.
03-20-2017 02:35 PM
No, you should be able to store it in a repository using a Log to Data operator. It might be the Top K sort.
03-21-2017 05:48 PM - edited 03-21-2017 05:50 PM
then it shouldn't be, because I never chose any sorting type option.. it was always 'none'. But it seems to be with the Log to data operator only (or log data only) because example sets for other data like usual excel tabular data example sets are fully saved..
03-22-2017 07:21 AM
I just did a test on my end with 36 rows and saved the log into a repository, all 36 show up. I will test with 56 next. '
Is there some sort of parallelized loop involved in your process?
03-22-2017 08:14 AM
So I just did this with 56 rows and it saved fine but what I noticed is that it saves the repository after each parameter optimization iteration. Maybe there's something broken on your end there? Is the Log to Data inside the Parameter Optimization operator?
03-23-2017 01:37 PM
actually yes, its inside the parameter optimization operator..
I noticed at the end when it gives out the results.. its only part of the data, but when I click on show example set result after it finished, it gives the full data.. and when I save it, It also saves the full data... just wondered me that it does not do this in the first place when the process has finished...
03-24-2017 09:28 AM
Like I said, I don't know your set up there but I've run this multiple times on a different processes and I see all the combinations in the Log File and see them all in a Repository. I know this would help you with pulling out your hair but I don't think it's a bug.