GSmartMix
Benjamin Otte told me on #freedesktop that there's this SoC project called GSmartMix that might end up doing what I want. Stefan Kost (the mentor for the project) told me a short bit later that the first basic demo is done and that they want feedback.
Links: