Hi Fabien,
Previously I have hacked Pony Gallery into shape for a functional gallery, see
http://www.johnavon.com/index.php?option=com_ponygallery&Itemid=26.
Here are the problems/fixes, I had to manage:
No csv upload for image data.
Image upload & batch upload renames files to system time stamped, totally useless.
No custom sorting of how items are displayed, ie alpha, date or custom.
All muti user options had to be commented out from code, rather than switched off from admin interface.
Not enough fields for image information.
No integration with Joomla breadcrumbs.
On the same site, we use EZstore - A hacked evolution of pony gallery - This was required to seperate the Art Store logic from the gallery. Again all of the above issues, but since it had PayPal buy now & cart support it fitted our needs.
Both hacks of Pony Gallery worked, but it would have been nice to have an install and forget gallery the client could operate.
So include all of the above points (please), and you will have a winner

Robert