Time to Have Another Baby? How Do You Know

Time to have another baby. I don't know how to answer this question. To me this is a harder decision that making the first decision to have our first baby. When my husband and were married I knew right away I wanted a baby. My husband agreed and we started the trying process. I call it the trying process because little did we know how long and how hard is was going to be. After almost 3 years of trying on and off we ended up seeing a fertility specialist who suggested Invitro Fertilization. Long story short, we now have a beautiful baby boy who just turned two years old. This is why my question that I mentioned earlier of when to have baby number two is so difficult. The process of Invitro Fertilization is an extremely long and very difficult process. It takes months and tons of procedures, blood work, sonos, etc...for it to be effective. We unfortunately suffered a twin miscarriage that almost broke my heart. After healing from that pain we went ahead with the process again and it was successful. I am concerned that we will have difficulty conceiving again and will have to go through the Invitro Fertilization again. I am not so sure I want to and I am not so sure my husband wants to either. If we were able to get pregnant naturally then I think this decision would be a little easier to make. But this is not the case so I am back to my original question, is it time to have another baby.