ChatGPT GPT-4o consistently produced shorter summaries while still capturing essential information
Perplexity AI Pro tended to provide more detailed summaries, often longer than ChatGPT GPT-4o's
Accuracy and Objectivity: Perplexity AI Pro ≳ ChatGPT GPT-4o
Both ChatGPT GPT-4o and Perplexity AI Pro generally maintained accuracy and objectivity in their summaries
Perplexity AI Pro sometimes provided more comprehensive and nuanced information, especially for technical or complex topics
Coherence and Readability: Perplexity AI Pro > ChatGPT GPT-4o
Perplexity AI Pro often used clearer structures with headers, bullet points, or numbered lists, enhancing readability
ChatGPT GPT-4o's summaries were typically coherent but sometimes lacked the structured presentation of Perplexity AI Pro's
Balance of Completeness and Relevance: Perplexity AI Pro > ChatGPT GPT-4o
Perplexity AI Pro frequently offered more comprehensive overviews, including more details from the original text
ChatGPT GPT-4o tended to focus on key points, sometimes omitting details that Perplexity AI Pro included
Convenience and Accessibility: Perplexity AI Pro ≛ ChatGPT GPT-4o
Both tools offer web and mobile apps, making them fairly accessible
During the trial, both tools had issues accessing some articles:
ChatGPT couldn't access 17% of URLs
Perplexity AI Pro couldn't access 25% of articles
Interestingly, disabling Pro mode in Perplexity sometimes made articles accessible for summarization. This was not considered part of the trial evaluation, as we specifically tested Pro mode
Conclusion: Perplexity AI Pro > ChatGPT GPT-4o
ChatGPT GPT-4o excels in producing concise, quick-reference summaries
Perplexity AI Pro provides more comprehensive, structured summaries with greater detail
The choice between ChatGPT GPT-4o and Perplexity AI Pro depends on the user's needs: quick overview (ChatGPT GPT-4o) vs. detailed understanding (Perplexity AI Pro)
Both tools demonstrate strengths in different areas, suggesting they could be complementary depending on the task at hand
