Observed Signal · Sep 11, 2026 · Analysis · Source: t3n · Impact: 2/5 · Sentiment: Neutral
GPT Apps in Customer Advisory: Capabilities and Limits of AI Chatbots
The article examines the use of GPT apps and agentic AI in customer advisory roles, particularly in e-commerce, customer service, and finance/insurance. While these tools can process data quickly and simulate conversational interactions, studies and practical tests reveal significant limitations. For instance, FB Research found a chatbot's advice on household insurance was superficial and incomplete, while Apple Research and a Finance Agent Benchmark demonstrated LLMs' poor performance in complex reasoning tasks. GPT apps are described as transaction-oriented, executing tasks but lacking genuine advisory capabilities. The piece highlights early adopters like PetGPT and Allianz, but concludes that for complex decisions requiring empathy and trust, human advisors remain essential. The article emphasizes that AI is better suited as a copilot for administrative tasks rather than a replacement for humans in advisory roles.
The article provides insights into the limitations of AI in advisory roles, relevant for MarTech but not a breaking industry event.
Track OpenAI Signals & Market Shifts in Real-Time
Polaris7 autonomous intelligence agents track regulatory filings, primary sources, executive changes, and deal flow 24/7. Create your free Explorer workspace to monitor these entities.
Key Takeaways & Evidence Grounding
- OpenAI introduced a platform for apps in ChatGPT in October 2025 and expanded it to a plugin system in July 2026.
- FB Research's practical test revealed significant flaws in ChatGPT's advice on household insurance, including superficial analysis and outdated data.
- The Finance Agent Benchmark (2025) found LLM accuracy below 47% for complex financial analyses.
- Allianz is the first insurance company in Germany to offer services directly in the ChatGPT app.
- OpenAI's GPT apps can now integrate third-party tools like Canva and Booking through 'Skills'.
Connected Companies & Entities
3 Entities mapped“OpenAI has introduced a platform for apps directly in ChatGPT in October 2025, expanded to a plugin system in July 2026....”
“A study by Meta FAIR and the University of Edinburgh shows how reasoning errors occur in language models....”
“Allianz is the first insurance company on the German market to integrate a service directly into the ChatGPT app....”
Ontology Mapping & Concepts
Related Market Signals & Shifts
Recent verified developments and strategic activity across this market segment.
MIT Professor: How to Prompt ChatGPT for Finance
MIT professor Andrew Lo says AI chatbots (ChatGPT, Gemini, Claude) can provide valid personal finance guidance but the usefulness of their answers depends heavily on prompt quality. Citing an Intuit CreditKarma survey (Fall 2025) the article notes broad consumer use of generative AI for financial advice—two thirds of U.S. users overall and over 80% for Millennials/Gen Z—and that ~85% of users acted on chatbot recommendations. Lo recommends detailed prompts that include goals, constraints, tax bracket, residence, assets, timelines and risk tolerance, and that users ask the model to list missing information and express uncertainty. The piece warns about hallucinations and limits of model calculations and urges verifying sources and re-running prompts.
MIT Professor: Write Specific Prompts for Financial AI Advice
Millions use AI chatbots such as ChatGPT, Gemini and Claude for financial advice, but the quality of recommendations depends heavily on prompt design, MIT professor Andrew Lo says. Citing an Intuit Creditkarma survey (Fall 2025), the article reports that two-thirds of U.S. generative-AI users have asked such tools for finance help (over 80% among Millennials and Gen Z) and that about 85% of users implemented the chatbots' advice. Lo recommends prompts include concrete personal details — goals, constraints, tax bracket, residence, assets, timelines, and risk tolerance — and to request identified missing information and uncertainty estimates. He also advises assigning the AI the role of a financial/advisory professional and warns users to verify outputs because hallucinations and calculation limits can distort recommendations. t3n conducted an experiment on using ChatGPT for portfolio creation.
ChatGPT Work: Setup, Use Cases, and Risks
This article is a deep dive into ChatGPT Work, the desktop/mobile ChatGPT app that combines connected tools, scheduled tasks, and computer control to enable agentic workflows. The author gives step-by-step setup advice (recommended plugins and permissions), outlines use cases such as data analysis, scheduled analytics, browser-driven tasks, and prototype/site creation, and warns about over-reliance that produces “AI slop.” The piece also summarizes relevant AI news: the release of Kimi K3 (a 2.8T-parameter open-weight model with native vision and a 1M-token context window), Anthropic’s Fable 5 pricing reversal, Baidu’s 3B OCR model, and other ecosystem updates. The author recommends using Work for the middle 60% of tasks while keeping human judgment at the start and finish.
Track Real-Time Market Signals & Shifts
Set up custom watchlists to receive automated, evidence-grounded executive digests whenever material signals or shifts occur across your tracked landscape.