It seems that the extra data is always 144 bytes
>> b = [1:10000; 1:10000];
>> a = dictionary(b(1,:), b(2,:));
>> whos b
Name Size Bytes Class Attributes
b 2x10000 160000 double
>> whos a
Name Size Bytes Class Attributes
a 1x1 160144 dictionary