To quit or not to quit

I am seriously thinking about quitting my second part time job. It is entirely too stressful to try and squeeze 5 hours of work into my "free time" during the week, because as we're realizing I don't really have any free time. And this job came at a horrible time when Ryan has soccer 3 nights a week, so even if I wanted to work I can't because someone needs to watch Ryleigh.

But, ugh, I just don't want to quit 3 weeks into my position. I feel like it will make me look like a bad person.
Plus the extra 50$ a week could kind of, sort of, in a small way, help us save more for the big DP (down payment on a house).

What to do? What to do?

I am so totally stressed over this situation!!