Harvard Business Review’s Post

View organization page for Harvard Business Review, graphic

14,474,764 followers

Chatbots that draw on generative AI have great potential to significantly improve work processes. But, like any important new technology, they also come with risks.

The Risks of Botshit

The Risks of Botshit

hbr.org

Joseph Jhee

Experienced ERP Leader | Driving Global Transformation through Technology

2mo

The AI hallucinations reminds me of the early days of mass market GPS driving directions. We'd constantly hear about people driving their vehicle into obvious hazards because the GPS said to do it. The problem is that there will always be a subset of people that will take any information provided to them from a "trusted" source and take it as gospel. Unless society as whole embraces and teaches critical thinking at a young age, this problem will never go away. When introducing new technology, innovators need to take this into consideration or they risk embarrassing themselves (Google's AI fiasco) and letting malicious actors take advantage of their product (eg Facebook and 2016 election)

Indeed, managing "botshit" is crucial as chatbots become integral in business operations. Here are some actionable strategies: 1. **Task Criticality Assessment**: For tasks requiring high accuracy, like financial reporting or legal advice, human oversight is essential. Use chatbots for low-stakes tasks where errors are easily correctable. 2. **Verification Mechanisms**: Implement a robust verification process. For example, cross-referencing chatbot responses with trusted data sources can minimize risks. Automated checks can flag discrepancies for human review. 3. **User Training**: Educate users on the limitations of chatbots, emphasizing critical thinking and verification practices. 4. **Feedback Loops**: Establish feedback mechanisms to continuously improve chatbot accuracy and reliability. Balancing innovation with risk management ensures you harness chatbot benefits without compromising on safety or accuracy. #AIResponsibility #RiskManagement #ChatbotSafety

I'd click on half-LIKE if I have such a choice. LIKE for "great potentia", half because of the implied deficiency of "Botshit", use your critical thinking skill and common sense. a) emerging technology is never perfect in its early stage; b) quality of chatbot varies depending on their implementators' skill level.

Christoph Czech

COO | AI enthusiast | Passionate about driving process optimization through digitalization and automation

2mo

A few things need to be emphasized here. Chatbots can bring many advantages, but they also have limitations:  - chatbots have great potential to improve work processes - use chatbots responsibly and with awareness of their limitations - different tasks require different levels of chatbot involvement - chatbots cannot be trusted blindly - chatbots work best when used alongside human expertise, specialized on the respective use case 

AI hallucinations are difficult to identify as they integrate into the response seamlessly. Big minefield that needs addressed

Thanks for sharing! Good article. I think this headline is really key „New Tools, New Risks“ - it’s in the responsibility of organizations of doing the right thing.

Ayasha Ali

Product Evangelist | Technical Product Marketing Management | Fintech, Data & AI

2mo

Liked for the title

Absolutely agree with your viewpoint. The development and implementation of AI-powered chatbots indeed hold the promise of streamlining work processes. However, it's critical to address the inherent risks and ensure necessary safeguards are in place for a secure digital landscape. #AIChatbots #TechnologyRisks

Katie Shire-Engleman

✨ Marketing Executive | Data-Driven Leader | Mentor | Advisor | Strategist | Founder ✨ Let's Connect, Collaborate, and Create Together

2mo

Great article! It's incredible how often people are quick to turn off the "critical thinking" skill.

Son-U Paik

Attorney, AI-App Developer and GRC Consultant

2mo

Thanks for sharing. This is an important heads-up for those of us developing AI-Apps.

Like
Reply
See more comments

To view or add a comment, sign in

Explore topics