This restaurant in modern day Fez was once a fantastic private residence – built and maintained by wealth hard-earned in the trans-Saharan trade.