respect for time

Just how many times have you been frustrated with people not keeping up their time? I noticed a problem of another kind, I find people not respecting my time. Or simply "I was busy, Sorry". Well, hello, I am too. Doesn't it become a lot more simpler if all of us realized that everyone around us is probably as busy as us and give them their time and respect for it?