Scale Factor on Outfit Level, not on Character Level

Have been facing the following issue.

The main character is scalable. However some of his one-off animations are not (e.g. climbing a ladder in a specific scene), because these anims are drawn on the correct scale. If the scaling could be decided on the outfit level, i could easily include the non-scalable anims in a separate outfit and finish. Now it seems quite a pain as i guess i have to switch to a new char for these anims, which is an issue. Any ideas?