Escaping into the Open: The Art of Writing True
by Elizabeth Berg

Berg follows each of her helpful essays with homework assignments.
I'd Rather Be Writing
by Marcia Golub

Golub’s book may not be as well-known as some of the others, but her combination of humor and practicality (“try this” exercises) are effective when you’re not feeling motivated.
The Artist's Way
by Julia Cameron with Mark Bryan

This book provides a twelve week program with exercises each week meant to unleash your creativity.
Writing Down the Bones: Freeing the Writer Within by Natalie Goldberg

A classic book of writing advice broken into short essays.
Bird by Bird: Some Instructions on Writing and Life
by Anne Lamott

I'm a huge fan of all of Lamott's nonfiction writing. She provides meaningful insights into self-doubt and how to get the writing done.