From:
Jeffrey Lewin <jclewin**At_Symbol_Here**MTU.EDU>
Subject:
Re: [DCHAS-L] What we know − and don't know − about what caused UD's lab evacuation 2 weeks ago
Date:
May 10, 2023 18:11 UTC
Reply-To:
ACS Division of Chemical Health and Safety <DCHAS-L**At_Symbol_Here**Princeton.EDU>
Message-ID:
<CAEwQnqgWKMDAJmp6-V_+BBXsqYjORJeWXOEcgqimxiWz2KyvQg**At_Symbol_Here**mail.gmail.com>
In-Reply-To:
<99BA4B5D-A6E6-4ECB-9B6B-2056C8FDE7B7**At_Symbol_Here**rstuartcih.org>
"
. One example was related to the flashpoint of dimethyl formamide, which ChatGPT identified as flammable. Because I knew this response to be incorrect,"
I'm guessing ChatGPT is challenged by the semantics of this question.
N,N-Dimethylformamide has a FP of 57.5 °C (135.5 °F) - closed cup.
OSHA (and GHS/
SDS ) as well as
DOT considers it a flammable liquid.
NFPA would consider it a combustible liquid.
RCRA/EPA would consider it an ignitable waste.
Jeff
> >So on this single test, AI seems promising.
I have run 10 or 15 scenarios with ChatGPT; some have had similarly cogent results to yours. However, for others, I had to re-ask the question several times before the AI admitted that its initial response was wrong. One example was related to the flashpoint of dimethyl formamide, which ChatGPT identified as flammable. Because I knew this response to be incorrect, I re-asked the question several times in different ways, and the AI became progressively less sure of itself in tone. It finally admitted it was mistaken. I don’t know if I would have persisted through that process if I didn’t have reason to know the answer before I started, though.
In the larger picture, ChatGPT does not tell you where it gets its information, so I don’t know how to assess the validity of its responses. There are other chatbots that do provide references for their statements, but their statements are less detailed than those from ChatGPT since their responses are more tightly tied to a specific source.
As was pointed out a day earlier, the ACS Publications web site has a more complete description of TATP concerns in its Analytical Chemistry journal, which is peer-reviewed and has references to help assess its broader statements. The CAS Chemical Safety Library does rely on manual entries. We are working to identify ways to mine the chemistry literature to improve the CSL, but I’m not convinced that a chatbot tool will be part of that process.
In sum, my experience is that AI is as likely to confuse a safety question as it is to answer it. We will continue to have to educate our selves and the Chemistry community in chemical safety literacy, including how to assess chat generated answers that will soon be routinely appearing in the literature we work with.
Good luck to us all! ;)
- Ralph
Ralph Stuart, CIH, CCHO
ralph**At_Symbol_Here**rstuartcih.org
---
For more information about the DCHAS-L e-mail list, contact the Divisional membership chair at membership**At_Symbol_Here**dchas.org
-- Jeff Lewin
Director of Chemical Laboratory Operations
Research Integrity Office
Laboratory Operations
205 Lakeshore Center
Michigan Technological University
---
For more information about the DCHAS-L e-mail list, contact the Divisional membership chair at
membership**At_Symbol_Here**dchas.org