I would prefer if changing settings are persisted to next time I sit in front of the piano.
I don´t know how the other brands behave, but Roland here fails completely. I have the 505, and it sucks in this regard.
Example: you set the speed of the metronome, practice, and then want to record what you are practicing; the moment you press the REC button for preparing the recorder for recording, the tempo is reset back to a standard value (on mine it is 108 beats for a 4/4 measure); so, you now for the recording first have to set again the tempo you want - lucky if you remember what it was; after recording you will decide if to keep your song saved or if to discard it; if you keep it, then the new Metronome speed is memorized for practicing but not for the next time pressing the record button; if you discard it, then the speed is reset to 108 beats for both, practicing and recording.
Example: The 505 neither memorizes which sound you last have had in use, for powering Off and On. When powering on, you always start with the Grand piano, and if changing to another sound bank, i.e. "Others", then there will always be sound No.1 be preselected, but not the one which you last time used before powering off. There is also no way to save the reverb level with a sound, it is only global. So, changing between Grand Piano and Church Organ can easily require to press about 30 buttons (19 to have changed to the "Others" sound bank and scroll forward to sound 18, for instance, and 10 more for rising the reverb from 1 to its maximum 10.
I could imagine that the DP90 and HP505 feature the same electronics, so be careful with that model as well, test it!