Fallout 3 help? Head of State Quest?

Sorry, but I have no idea what's going on with this quest. It seems buggy to me. I would follow Silas and everyone would shoot at me. Finally, I decided to kill them all, and sure enough, Mr. Walker was amongst the casualties. If you want to help the "Temple of the Union," you may as well get rid of the slavers anyway.