@latofat

4 Followers
15 Following
11 Posts
Master student at RPTU Kaiserslautern-Landau.
Major: Intelligent systems. Minor: Information Systems.
Interned twice at Google Ads as SRE Engineer. Interested in Distributed Systems, Information Retrieval, Natural Language Processing for low-resource languages and Computation Theory.

Wrapping up my Master thesis and presenting a poster for my very first paper at #COLING on the same day! However today it's all about works for #LoResLM \o/

Thrilled to learn what's new!

Is there a way to train one with a dozen of V100 (32GB) GPUs? For RoBERTa the initial paper is scaring me. They used 1024 V100s. In the BERT case, why does transformers doesn't have pertaining scripts for it (NSP+MLM)?
CALL FOR HELP: Looking for someone with experience in pertaining BERT and RoBERTa models? (one BERT with BPE and one with WordPiece tokenization per say) I have major restrictions on university resources and time.

Leslie Lamport's new book "A Science of Concurrent Programs" has been sent to the publisher and the final draft is available for free as a PDF!

https://lamport.azurewebsites.net/tla/science-book.html

#tlaplus

A Science of Concurrent Programs

Thanks to my physiotherapist, after 3.5 years I finally learned how to set modes on my ergonomic desk... I hope I won't forget it too soon o.o
I'm currently working on NLP for the Northern Uzbek language for my Master's thesis.
Hi, everyone. Can anyone recommend good profiles/pages to follow on NLP for low-resource languages? It's been almost a year since I registered to Mastadon, however, I'm still new and still can't get enough use out of it. So, any recommendation for the efficient usage of the platform would be great.
hi, mastodon o.O