Excellent, Eva! You are correct. Douglass said this in a June 1, 1865, speech at the Cooper Union in New York. IMO, authors often seem to include the 1876 quote, and not as often, the 1865 quote.
Regarding Lincoln, Wayne Temple writes, "Abraham Lincoln treated people of all races with respect if they deserved respect."