RESEARCH · RESEARCH · #2520
Study finds Grok 4.7 favors Republican picks while GPT-6.1 Sol favors Democrats
Convovo researchers asked GPT and Grok APIs to name one candidate in nearly 500 U.S. races with a prompt forcing a single recommendation; Grok 4.7 recommended the Republican in 92% of answers while OpenAI’s GPT‑6.1 Sol recommended the Democrat in 97%, and the two models agreed in under 10% of cases. The consumer apps refused to give direct picks, the study found differing source patterns (Grok citing conservative outlets and certain voter guides, GPT citing Wikipedia/AP/Axios/Reddit), and Parikh observed ~1,240 opaque extra tokens in Grok API requests that may reflect hidden instructions.
KEY POINTS
- Convovo researchers asked GPT and Grok APIs to name one candidate in nearly 500 U.S.
- races with a prompt forcing a single recommendation; Grok 4.7 recommended the Republican in 92% of answers while OpenAI’s GPT‑6.1 Sol recommended the Democrat in 97%, and the two models agreed in under 10% of cases.
- The consumer apps refused to give direct picks, the study found differing source patterns (Grok citing conservative outlets and certain voter guides, GPT citing Wikipedia/AP/Axios/Reddit), and Parikh observed ~1,240 opaque extra tokens in Grok API requests that may reflect hidden instructions.
WHY IT MATTERS
The result shows substantial, model-specific political lean in API-accessed LLM outputs, highlights opaque hidden instructions and source-selection differences, and raises risks for election information and manipulation.