The library shrank over a long period due to the change in patronage, from rulers friendly to academia to some that had other priorities. The writings were taken to other places that were more interested in them. There was indeed a fire at some point but it only burned part of it and anyway by that time the collection was a fraction of what it used to be.