GPT-4-turbo-2024-24-09 (temperature = 0.7) just told me a horse had one “frog” per hoof and went on to clarify that a frog does not refer to the amphibian but to a part of the horse’s hoof.
Gemini Pro (the current web chat version) gave a similar answer, either no frogs or four depending on the intended meaning, and showed a photo of a hoof. All 3 drafts agreed on this.
Other models I have tried said a horse had no frogs. That includes gemini-1.5-pro-api-0409-preview as provided by the Chatbot Arena (temperature = 0.7, 2 tries).
Gemini Pro (the current web chat version) gave a similar answer, either no frogs or four depending on the intended meaning, and showed a photo of a hoof. All 3 drafts agreed on this.
Other models I have tried said a horse had no frogs. That includes gemini-1.5-pro-api-0409-preview as provided by the Chatbot Arena (temperature = 0.7, 2 tries).