Skip to main content

Summarizing Articles: ChatGPT GPT-4o vs Perplexity.ai Pro

Perpexity.ai Pro prevails over ChatGPT GPT-4o at the Article Summarization task

QuadrupleY Research

Conciseness: ChatGPT GPT-4o > Perplexity AI Pro

  • ChatGPT GPT-4o consistently produced shorter summaries while still capturing essential information
  • Perplexity AI Pro tended to provide more detailed summaries, often longer than ChatGPT GPT-4o's

Accuracy and Objectivity: Perplexity AI Pro ≳ ChatGPT GPT-4o

  • Both ChatGPT GPT-4o and Perplexity AI Pro generally maintained accuracy and objectivity in their summaries
  • Perplexity AI Pro sometimes provided more comprehensive and nuanced information, especially for technical or complex topics

Coherence and Readability: Perplexity AI Pro > ChatGPT GPT-4o

  • Perplexity AI Pro often used clearer structures with headers, bullet points, or numbered lists, enhancing readability
  • ChatGPT GPT-4o's summaries were typically coherent but sometimes lacked the structured presentation of Perplexity AI Pro's

Balance of Completeness and Relevance: Perplexity AI Pro > ChatGPT GPT-4o

  • Perplexity AI Pro frequently offered more comprehensive overviews, including more details from the original text
  • ChatGPT GPT-4o tended to focus on key points, sometimes omitting details that Perplexity AI Pro included

Convenience and Accessibility: Perplexity AI Pro ≛ ChatGPT GPT-4o

  • Both tools offer web and mobile apps, making them fairly accessible
  • During the trial, both tools had issues accessing some articles:
    • ChatGPT couldn't access 17% of URLs
    • Perplexity AI Pro couldn't access 25% of articles
  • Interestingly, disabling Pro mode in Perplexity sometimes made articles accessible for summarization. This was not considered part of the trial evaluation, as we specifically tested Pro mode

Conclusion: Perplexity AI Pro > ChatGPT GPT-4o

  • ChatGPT GPT-4o excels in producing concise, quick-reference summaries
  • Perplexity AI Pro provides more comprehensive, structured summaries with greater detail
  • The choice between ChatGPT GPT-4o and Perplexity AI Pro depends on the user's needs: quick overview (ChatGPT GPT-4o) vs. detailed understanding (Perplexity AI Pro)
  • Both tools demonstrate strengths in different areas, suggesting they could be complementary depending on the task at hand