There is no convenient way.
You would have to make a query which gave you the ID fields of all the published albums and a separate one of all the published images.
Then you would have to query the obj_to_tag table and retrieve the unique IDs corresponding the type/objectid pair gathered above.
Then you can query the tags table for the names that go with those IDs