Howard had been on paid administrative leave since late March. He resigned May 8. The county announced his retirement on June 11. His salary at the time was $82,067.
County officials and the County Commissioners have refused to disclose the amount paid to Howard, claiming a county-signed confidentiality agreement with the former director prevents them from doing so.
County Attorney Richard Douglas has also argued several times that the payment was Howard's personal income, not salary, and is protected from being revealed under the Maryland Public Information Act.
Swartz and Wivell have said they didn't sign the agreement and that they disagree with Douglas' opinion.
They said the compensation should be public because it was funded with tax dollars.
Swartz and Wivell said they were told by county officials that they could be sued as individuals if they disclose the amount without an order from the court.
Douglas has said that if the amount is revealed, the county or the person who discloses it would face actual damages, punitive damages, criminal liability, disciplinary action and contempt. He said the county or person would also have to pay attorney fees and litigation costs.
"I want to release it but it's clear I will be singled out. I could lose my home," Swartz said Thursday.
Although Swartz said Howard has said he would not sue Swartz, he was told by county officials he would be at risk if he provides information.
"If we divulge anything, we open ourselves up for a personal lawsuit," Swartz said.
Howard said Thursday he didn't have any plans to reveal the amount and declined to comment further.
He said he had no comment on whether he'd sue the county if the county discloses the amount of his retirement compensation.
Economic Development Commission Chairman Douglas S. Wright Jr. said the EDC board has been told the compensation was not coming from the organization's budget.
EDC Secretary Peggy S. Bushey said that if the money had come from the EDC budget, she'd release the amount to the public.