Synaptic Intelligence vs Naive Finetuning Comparison

[vmromero-ubi]

Hi, I am running some experiments to compare synaptic intelligence and naive fine-tuning on different benchmarks, including SplitMNIST, PermutedMNIST, and a custom dataset benchmark of non-iid datasets. I observed that the performance of synaptic intelligence mirrors exactly the performance of the naive fine-tuning strategy. Is this performance expected?