I know that feeling, doesn't feel good. That's why I reduced work to just and only work and use my free time for the projects and things I want to do, not someone else telling me I have to.
Can't say if this would be suitable for you, but please know you're not alone with that feeling.