My first research thread shared here is a recap of our recent #UIST paper. We asked: How can #AI support #writing without trying to correct us or writing for us? This led us to go "Beyond Text Generation: Supporting Writers with Continuous Automatic Text Summaries". ✍️🤖
@DBuschek Interesting use of language models. I have a few questions -
1. Did the language models behave sensibly? I.e., there is some work now that shows that language models don't understand compositionality or abstractions. So I wonder if you saw that in your study.
2. Are their concerns that people would start writing for the AI - i.e, text that AI understands?
@shiwali
Thanks!
1. We didn't evaluate summarization quality much (a short attempt is in the appendix). Practically speaking, it worked well in observations and people's own impressions. I don't remember that people mentioned specific aspects being better/worse in the summaries, such as the ones you mentioned. I think, as long as summaries are not too bad or outright wrong, the key result - providing a kind of second perspective that triggers writers to reflect - probably holds here.
Daniel Buschek
Shiwali Mohan | शिवाली मोहन